TW468120B - Talk to learn system and method of foreign language - Google Patents
Talk to learn system and method of foreign language Download PDFInfo
- Publication number
- TW468120B TW468120B TW089107671A TW89107671A TW468120B TW 468120 B TW468120 B TW 468120B TW 089107671 A TW089107671 A TW 089107671A TW 89107671 A TW89107671 A TW 89107671A TW 468120 B TW468120 B TW 468120B
- Authority
- TW
- Taiwan
- Prior art keywords
- foreign language
- user
- speech recognition
- patent application
- pronunciation
- Prior art date
Links
Landscapes
- Electrically Operated Instructional Devices (AREA)
Abstract
Description
4 6 81 2 0 五、發明說明(l) 本發明 外語教 習,從造句 語音技術的 這些品, 學外語的人 發音比較好 心理因素而 不能在此方 本發明 於: .整合 境,創造了 機器進行互 打破了開口 與提高學習 2. 本設 系統避免挑 人發音特點 建立方法, 機互動性, 用。 3. 為糾 提供了標準 係有關 學類電 到寫文 發展, 其最重 ,不僅 的人, 不敢開 面提供 提供了 了語音 一個报 動式交 說外語 效率的 叶系統 戰語音 ,提出 使得本 因而所 於一種外 子產品種· 章,從讀 說方面的 要的缺陷 是那些口 在與他人 口說外語 學外語的 一種外語 識別技術 好的外語 談,而不 的心理障 目的;。 重點在於 識別技術 了適合華 設計中的 設計出來 語口語學習系統及方法、9 類很多。從辭彙學賈到語法練 至|J寫’以及聽都很豐富。隨著 練習也漸漸走向市場。但綜觀 是口語練習的環境問題。很多 语發s差的人,就是那些〇語 進行口語交流時,也因為許多 。因此’目前的外語教學產品 人一個很好的學習方法、。 口語學習系統。它的優點在 人機語音交流環 ’讓使用者能與 說話_的人,從而 語口語學習興趣 說話,所以設計 ’並特別針對華 識別聲學模板的 常高’增加了人 別適合於華人使 ,設計了多種 口語學習環境 需要面對其他 礙’獲得了外 讓使用者開口 的難點和弱點 人發音之語音 語音識別率非 的學習環境特 正發音錯誤’本設計專門開設了 "音譜園地" 的外語口語發音模板》4 6 81 2 0 V. Description of the invention (l) The foreign language teaching of the present invention, from these products of sentence-making phonetic technology, people who learn foreign languages have better pronunciation. Psychological factors cannot be invented here: .Integrating the environment, creating a machine Interaction breaks the opening and improves learning. 2. The system is designed to avoid picking people's pronunciation characteristics and establish methods, machine interaction, and use. 3. Provided the standard department related to the development of electrical science to writing, which is the most important, not only the people, who dare not open the face to provide the voice of a system of spoken and spoken foreign language efficiency leaves the system voice, proposed to make This book is a foreign product type chapter. The major flaws in reading and speaking are those foreign languages that are good at foreign language recognition techniques that speak foreign languages and foreign languages with other people. The focus is on the identification technology, which is suitable for the Chinese design. The spoken and spoken language learning system and method, there are many 9 types. From vocabulary learning to grammar training to | J writing ’and listening. With the practice also gradually came to the market. But the overview is the environmental issue of oral practice. Many people who speak poorly, even those who have spoken in 0 language, also have many problems. Therefore, the current foreign language teaching products are a good learning method. Speaking learning system. Its advantage lies in the man-machine voice communication ring, which allows users to speak with people who are interested in speaking, so designing 'and especially targeting the constant high of the Chinese recognition acoustic template' increases the number of people suitable for Chinese speakers. Designed a variety of spoken language learning environments that need to face other obstacles. 'Learning environment that has difficulty in speaking to users and weak points. The pronunciation of non-speech recognition rate is abnormal. The pronunciation is wrong.' Foreign Spoken Pronunciation Templates
第5頁 4 6 81 2 0 五、發明說明(2) 友.面: 語教學題 學應用.漱 一套適合 :,,經部 #根據性 或女聲語 環境1% 了 五大功 :音譜.園 本發明之外語口語學習系統,主要包括五僻 —*與說話者無關的語音識別模組,二,外語α 材,三•語音輸入/輸出模組,四.外語口語教 體,及五·顯示模組。 我們以本發明所述之系統,在電腦上建立了 華人英語口語學習的環境,名為"Talk To Learn 分使用者試用後取得了不錯的效果,首先讓使用 別選擇M男聲",或"女聲”,以選用相對應的男聲 音識別聲學模板,從而提高费音識別率,此學習 ”說明"和”退出”兩個輔助功能外,系統還包含了 能:情景對話;語法練習;造句練習;單字關連 地。 以下,就圖式說明本發明之實施例。 圖式簡單說明 第1圖係顯示本發明之外語口語學習系統之結構圖。 第2圖係顯示一套"Talk To Learn"英語口語學習的環 境之主晝面。 第3圖係顯示"Talk To LearrT之控制流程圖。 第4圖係顯示情景對話操作界面。 第5圖係顯示情景對話之流程圖。 第6圖係顯示情景對話之控制流程圖。Page 5 4 6 81 2 0 V. Description of the invention (2) Friends. Faces: Application of language teaching questions. One set is suitable for: ,, 经 部 # Based on sexual or female voice environment 1% Five major achievements: music score. Garden The foreign language oral language learning system of the present invention mainly includes five remote- * speaker-independent speech recognition modules, two, foreign language alpha materials, three voice input / output modules, four foreign language spoken styles, and five display Module. We use the system described in the present invention to set up an environment for Chinese spoken English learning on a computer, named "Talk To Learn". After trials by users, we have achieved good results. First, let us not use M male voice ", or "Women" to select the corresponding male voice recognition acoustic template to improve the recognition rate of tolls. In addition to the two auxiliary functions of "Explanation" and "Exit", the system also includes the ability to: scene dialogue; grammar exercises ; Sentence practice; Words are connected. Hereinafter, embodiments of the present invention will be described with reference to the drawings. Brief Description of Drawings Fig. 1 is a structural diagram showing a foreign language oral language learning system of the present invention. Figure 2 shows a set of "Talk To Learn" masters of the spoken English environment. Figure 3 shows the control flow of "Talk To LearrT". Figure 4 shows the scene dialogue operation interface. Figure 5 is a flowchart showing a scenario dialogue. Fig. 6 is a control flowchart showing a scenario dialogue.
I 第7圖係顯示語法練習操作界面。 第8圖係顯示造句練習操作界面。I Figure 7 shows the interface for grammar practice. Figure 8 shows the operation interface of sentence making exercise.
第6頁 4 6 81 2 0Page 6 4 6 81 2 0
第9圖係顯示單字關逵I 筐in®/ 平子關運刼作界面: 圖係顯示音譜園地操作界面 實施例 示H種=學習“ 夯一__實施例如第1圖所Figure 9 shows the single-word Guan I basket in® / Pingzi Guanyun operation interface: Figure shows the music field garden operation interface. Example H type = learning "ram one __ implementation example shown in Figure 1
,與说話者#關的語章識別模組 為了適合任何華人用戶’並且他們事先無須進行複雜 a H、赴訓.練’開口就能說’就可以與電腦平台進行人機對 活,我們採用了與說話者無關的語音識別引擎 (Speaker independent Voice Recognition Engine)。可 以選用目如世界頂尖級語音識別公司如Drag〇n system, IBM等公司的語音識別引擎。 — 1 為了特別滿足華人用戶的發音特徵,我們選用上述語 音識別引擎的同時,必須對其僅適合歐美語系的語音聲學 模板進行改良,即加入華人發音特徵,建立適合之語 音聲學模板。其方法如下: 第一步:挑選合!的音素提供人(即錄音人)’錄音 人的選擇要求如下: (1) 不同地區: 可選擇以下.十大類人士 :高尚且優秀之台灣人士, 雙束,華中,華南,華北,東北西北,西南,港篇,瘦 外華裔..人.士。 (2) 不同年齡:The speech recognition module related to the speaker # is suitable for any Chinese users, and they do n’t need to perform complicated a H, go to training beforehand. You can perform man-machine interaction with the computer platform by practicing 'talk and speak'. A speaker independent Voice Recognition Engine is used. You can choose the speech recognition engine of the world's top speech recognition companies such as Dragon system, IBM and other companies. — 1 In order to specifically satisfy the pronunciation characteristics of Chinese users, we must improve the speech acoustic template that is only suitable for European and American languages while selecting the above speech recognition engine, that is, adding Chinese pronunciation characteristics to establish a suitable speech acoustic template. The method is as follows: Step 1: Pick the match! The phoneme provider (ie the recorder) 's selection requirements for recorders are as follows: (1) Different regions: The following can be selected. Ten categories of people: noble and excellent Taiwanese people, Shuangbei, Central China, South China, North China, Northeast Northwest, Southwest, Hong Kong articles, thin Chinese .. people. (2) Different ages:
4 6 812 五、發明說明(4) ------- 可選擇18:60歲不同年齡段的各類成年人。 (3 )男女比例: 由於男女聲發音上存在报大差異,所以為了避 音識別技術的難點和弱點,我們必須分別建立男簦和女^ 的聲學模板,因此男女錄音人各佔一半。 (4 )文化層次: 須選擇具有相當外語水準的錄音人,能狗比較正確 和流利地朗讀所要求的錄音題材。 (5)人數: 人數男女各5 0人以上為佳。 第二步:提取這些錄音數據中的聲音特徵值,建立 語音識別用的聲學模板。 二.外語口語教學題材 設計互動性較強的口語教雙題材。它包括以下幾個方 面的内容:情景對話;語法練習;造句練習;單字關連和 音譜園地。其中,音譜園地提供了所有教學題材中的詞和 句子的標準口語發音。 二•語音輸入/^輸出模組4 6 812 V. Description of the invention (4) ------- Various types of adults at different ages of 18:60 can be selected. (3) Male-female ratio: Due to the large differences in the pronunciation of male and female voices, in order to avoid the difficulties and weaknesses of sound recognition technology, we must create acoustic templates for male and female ^ respectively, so male and female voice recorders each account for half. (4) Cultural level: It is necessary to select a recording person with a considerable foreign language level, who can read the required recording subject matter correctly and fluently. (5) Number of people: 50 or more male and female are preferred. Step 2: Extract the characteristic values of the sound from these recorded data and establish an acoustic template for speech recognition. 2. The subject matter of oral English teaching in foreign languages. It includes the following aspects: situational dialogues; grammar exercises; sentence making exercises; vocabulary relations and musical notation. Among them, the music score field provides standard spoken pronunciation of words and sentences in all teaching topics. Two • Voice input / ^ output module
Microphone輸入提供使用者語音輸入的方式。它將用 戶的語音輸入到計算機中,(與說話者無關的)語音識別 引擎將其與聲學模板中的特定模板進行匹配,即進行語音 識別。·Microphone input provides users with voice input. It inputs the user's voice into the computer, and the (speaker-independent) speech recognition engine matches it with a specific template in the acoustic template, that is, speech recognition. ·
Speaker則是給用戶提供標準的外語口語發音。 而聲卡則主.要._完成模/數轉換。Speaker is to provide users with standard spoken foreign language pronunciation. The sound card is the main. To complete the A / D conversion.
第8頁 46 8 彳 20 五、發明說明(5) 四•外語口語教學應用軟體 它將上述功能很好地包裝整合,提供用戶/使用者一 個方便,活潑,輕鬆的口語學習環境。 五·顯示模組 顯示設備周來顯示外語口語教學題材及各種輔助信 息,以提示使用者順利完成各項練習。 外語口語學習的過程大體上可以描述如下,請參考第 1圖(圖中的數字為外語口語教學的控制步驟): 1-— 步驟一.輸入語音 ① 使用者通過Microphone輸入語音信號。 步驟二· 模/數轉換 ② 聲卡將語音信號從模擬信號轉換成計算機可以處 理的數字信藥(輸入)以及將計算機儲存的數字語.音信號轉. 換成模擬一信-號(輸出)。 步驟三· 語音識別(一) ③ 與說話者輊關的語音識別模組(簡稱語音識別模 組)對輸入的語音信號進行識別,且與假設的N個”對象” 的”模板”進行比/對,若與某一"對象η11的"模板"匹配成 r-一一 - - · -' 一 ' 功,則語音識別結果判定該輸入即為”對象η"。 ④ 外語ρ語教學應用軟體(簡稱應用軟體)將語音. 輸入判定為"對象rT。 ⑤ 將判定結果顯示在顯示設備上。 步驟三.詻音識別(二) ③語音敬別模組找不到_佳...„何一個”對象η"的"模板"Page 8 46 8 彳 20 V. Description of the invention (5) IV. Foreign language spoken language teaching application software It packs and integrates the above functions well, and provides users / users with a convenient, lively and relaxed learning environment. V. Display module The display device displays the subject matter of foreign language oral English teaching and various auxiliary information to remind users to successfully complete various exercises. The process of oral foreign language learning can be described as follows, please refer to Figure 1 (the numbers in the figure are the control steps of oral foreign language teaching): 1-— Step 1. Input the voice ① The user inputs the voice signal through the Microphone. Step 2 · Analog-to-digital conversion ② The sound card converts the voice signal from an analog signal into a digital medicament (input) that can be processed by a computer, and converts the digital speech and sound signals stored in the computer into an analog one-sign (sign). Step 3: Speech recognition (1) ③ The speech recognition module (referred to as the speech recognition module) that is related to the speaker recognizes the input voice signal and compares it with the hypothetical "template" of the "objects". Yes, if it matches the "template" of a certain "target object η11" as r-one one-----'one, the speech recognition result judges that the input is the "object η". ④ Foreign language ρ language teaching The application software (referred to as the application software) judges the voice input as the " target rT. ⑤ The judgment result is displayed on the display device. Step three. Voice recognition (two) ③ The voice recognition module cannot be found _ 佳 .. . "What" object η " " template "
第9頁 4 6 812 0 五、發明說明(6) - 與輸入語音匹配’則語音識別結果判定該輸入為,,錯誤輸 入。 ④ 應用影:體將語音輸入判定為I,錯誤輸入。 ⑤ 顯示判定結果。 因為本設計系統重點在於讓像用者開口說話,所以設 计系統避免挑戰語音識別上的難點和弱點,特別設計了外 語口敬教學題材’儘可能設計發音(聲學模板)存在很大 差異的:對象"作為假設對象。只要使用者的發音基本接近 候選的"I象"的"模板11,就很容易與之匹配,並不會與其 他對皇丄的"模板"發生藏淆,使使用者自信心大大提高, 外语口 S吾積極性大大提高、 步驅四•標準g語輸出 根據步驟三·語音識別(一)的結果,電腦平台會給 出不同的結果⑥0⑧,且輸出不同的標準口語與使闬者進 行對話。 任 的 中 容 。Μ 内 出 話 輸 W 。號 出 東信 給 音擬. 台 發模 平 語成 腦。口換 電音準轉 求發樣號 讀語用信 時口調字。 隨準體數音 以標軟將放 可的周卡队 還字應聲喇 者單是是是 用/Φ©⑧ 使子 句 何 我們以本發明所述之系統,在電腦上建立了一奪適合 華人英語口語學習的環境,名為"Talk To Learn".,經部 分使用者試用缘辱得了不錯的蟓果,現詳述如下:Page 9 4 6 812 0 V. Description of the invention (6)-Matching with the input speech ’, the speech recognition result judges that the input is, wrong input. ④ Application shadow: The body judges the voice input as I, and makes a mistake. ⑤ The judgment result is displayed. Because the focus of this design system is to let the user speak, the design system avoids the challenges and weaknesses in speech recognition. In particular, the foreign language oral teaching theme is designed to have as much pronunciation (acoustic template) as possible: Object " as a hypothetical object. As long as the user's pronunciation is basically close to the candidate " I 象 " template 11, it will be easy to match it, and it will not conceal with other "templates" to the emperor, making the user confident The mind has been greatly improved, and the motivation of the foreign language has been greatly improved. Step 4 • Standard g language output According to the result of step 3 · speech recognition (1), the computer platform will give different results ⑥0⑧, and output different standard spoken and used The talker talks. Ren's content. Outgoing call MW loses W. No. out of the East letter to the phonetic transcription. Oral change Electron tune transfer Ask for a sample number Transcribe the word when reading a pragmatic letter. With the quasi-voices, the weekly card team will be able to release the words, but the answer is simply to use / Φ © ⑧ to make clauses. We use the system described in the present invention to establish a suitable match on the computer. The environment for Chinese spoken English learning, named "Talk To Learn", has been tested by some users and has achieved good results. The details are as follows:
ηίίΐί mηίίΐί m
illill
第10頁 4 6 812 0 ----------- 五、發明說明^ "" ------- 首先讓使用者根據性見壤擇"男查",或,,女聲”, 用相對應的男—牵或女免語音識別聲學農赛,從而^高 識【?1.宇然後是主言面,如第2團_所示,除了"說明"和„退 ,Μ .兩個輔助功能外,系統還包含了五太一功...能:情章對 ,,香法練習;造句練習;單字關連;音譜園地。離. 統運行的控弗i流程如第3圖所示^ '、 以下對這五個功能分別加以說明: 一 ·情景對話 情景對話是模擬真實生活中的各種場景,讓使用者 與電滕進行互動式的交流。如第4圖.情景對話操作界面 所示,在”問題區域"電腦提出一個問題後,使用者可從系 統所提借之答案中挑選一個進行回答。由於這些答案並無 對_之分’只不過模擬各種可能的张況,因此使罔者可根 據自己的感受進行回答;而系統...亦會通過語.言識別進行判 斷,並根據你的回答來進行相應的對話,因此可實現使用 者與系統之間互動式的對話蜂習。我們以,’介紹"場景為 例’來看一下對話題材的設計i topic: Introduce yourselfPage 10 4 6 812 0 ----------- V. Description of the invention ^ " " ------- First let the user choose according to sexuality " 男 查 ", Or, female voice ", use the corresponding male-lead or female voice recognition acoustic farming competition, so ^ high cognition [? 1. Yu and then the main face, as shown in the second group _, except" quotation " ; And „Retreat, M. In addition to the two auxiliary functions, the system also contains the five Taiyi one function ... Ability: Psalm pair, Xiangxiang practice; Sentence practice; Single-word connection; Music score garden. The flow of the control system running as shown in Figure 3 ^ ', the following five functions are described separately: 1. Scenario dialogues Scenario dialogues are simulations of various scenarios in real life, allowing the user and Deng to conduct Interactive communication. As shown in Figure 4. Situational dialogue operation interface, after the computer asks a question in the "question area", the user can choose one of the answers borrowed from the system to answer. Because these answers are not correct, It just simulates various possible situations, so that the person can answer according to their own feelings; and the system ... will also judge by speech and speech recognition, and conduct the corresponding dialogue based on your answer, so it can be achieved Interactive dialogue between users and the system. Let ’s take a look at the design of the topic of conversation with “Introduction” as an example. I topic: Introduce yourself
Introduction:Introduction:
Bobby has found that Robot Computer is friendly. So Bobby wants to make friends with him. Robot is also interested in Bobby. So he is goingBobby has found that Robot Computer is friendly. So Bobby wants to make friends with him. Robot is also interested in Bobby. So he is going
4 6 81 2 0 五、發明說明(8) to ask some quest ions about Bobby and Bobby’s family.4 6 81 2 0 V. Description of Invention (8) to ask some quest ions about Bobby and Bobby ’s family.
Dialog:Dialog:
Robot: 氺1: Can you tell roe something about yourself? *2: First, what’s your name? ^3: Then how old are you? 氺4: But I really want to know. *5: I guess you’re 6, right? : Then you are 12 now, right?Robot: 氺 1: Can you tell roe something about yourself? * 2: First, what's your name? ^ 3: Then how old are you? 氺 4: But I really want to know. * 5: I guess you're 6 , Right?: Then you are 12 now, right?
第12頁Page 12
Bobby : 1 a : Yes, certainly. lb: All right. 1 c : What do you want to know? 2a : My name is Bobby. 2b: I’m Bobby. 2c : Bobby, B-O-B-B-Y, Bobby. 3a : I’m 12 years old. 3b: It’s a secret. 3c: Just gU£^JS. 4a : I'm 12. ^ 6 81 2 0 五' 發明說明(9) 4b: Six years ago I was 6. 4c: Don’t ask people about their age! 5a: Yes, you’re right. 5b: Yeah! You’ve guessed it! 5c: Right, I'm 12. 6a: Yes, i * m 12 years old. 6b: You’re good at math. 6c: How clever you are! 而對應每個_機_器發音 -個可能的對話就是語 其中,帶號的是機器之發音, 之句子,都有三俾可能的對話。這 音識別待識別ϋ,個對象。 例如,機器!*1句時,可能的對話是1&或^咬卜, 器再根據—不同的回答’說不同的句子,從而達到情i t 之功能。其對活路据如第5圖所示,整彳m n k 、 如下所示(參考扪圖和第6圖):個對活的控制過程 步驟一 * 輪入..語.音 號。①使用者通過Microphone輸入某一對象之語音信 步騍二.模/數轉換 ②聲卡將語音信號從模擬信號轉換瞀 理的數字信號(輪入)以及將計算機儲、成汁^機叮處 換成模擬信號(輸出)。 缉存的數字語音信號轉Bobby: 1 a: Yes, certainly. Lb: All right. 1 c: What do you want to know? 2a: My name is Bobby. 2b: I'm Bobby. 2c: Bobby, BOBBY, Bobby. 3a: I ' m 12 years old. 3b: It's a secret. 3c: Just gU £ ^ JS. 4a: I'm 12. ^ 6 81 2 0 Five 'Description of invention (9) 4b: Six years ago I was 6. 4c: Don 't ask people about their age! 5a: Yes, you're right. 5b: Yeah! You've guessed it! 5c: Right, I'm 12. 6a: Yes, i * m 12 years old. 6b: You 're good at math. 6c: How clever you are! And for each _machine_device pronunciation-one possible dialogue is the language, where the number is the pronunciation of the machine, the sentence, there are three possible dialogues. This sound identifies the object to be identified. For example, the machine! * 1 sentence, the possible dialogue is 1 & or ^ bite, and the device then speaks different sentences according to-different answers', so as to achieve the function of love it. The data on the live route is shown in Figure 5, and the rectification m n k is as follows (refer to the map and Figure 6): a control process of the live process Step 1 * Turn in.. ① The user inputs the voice message of a certain object through Microphone. 2. Analog-to-digital conversion. ② The sound card converts the voice signal from analog signal to digital signal (round rotation) and the computer storage and juice processing machine is replaced by Analog signal (output). Secret Digital Voice Signal Transfer
4 6 81 2 0 五、發明說明(ίο) ③ 與說話者無關的語音模組(簡稱語音識別模 组)對輸入..的語音信號進行識別’且與假設的及個"對象" 的"模板M進行比對,若與某一"餘象几的模板"匹配成 功,則語音識別結果判定該輸入即為V對象n"。 ④ 外語口語教學塵用.軟體(簡稱應用軟體)將語音 輸入判寒為"對象η"。 ⑤ 將判定結果顯示在顯示設備上。 步驟三.語音識別(二) ⑥語音識别模組找不到任何一盤二對象Π”的”模板” 與輸入語音匹配,則語音識別結果判定該输入為11錯誤輸 入"。 ' . .‘ , ©應用軟體.將語音輸入判定為”錯誤輸入”。 ⑧顯示判定結果乂 步驟四·標準口語輸出 根據步驟三.語音識別(一)的―兹果’電腦半台..會給 出不同的結果©©⑥,且輸出不同的標準口語與使闬者進 行對話。. 使用者還可以隨時請求電腦平台給出對話内容中的任 何句子/單字的標準α語發音。 ⑥是應用軟體調用標準口語羞壹庫。 @是聲卡將數字信號轉換成模擬信號輸出。 ⑧是制放音。 — 以上所示―就〜是情景對話中有關自我介紹"部份的内 容。另有其他部份如',興聲愛好"等等,這裡不再詳細列4 6 81 2 0 V. Description of the invention (ίο) ③ The speaker-independent speech module (referred to as speech recognition module) recognizes the input of the speech signal 'and it is related to the hypothetical " object " " Template M is compared. If the match with a " template of the residual image " is successful, the speech recognition result determines that the input is a V object n ". ④ The foreign language oral teaching software. The software (referred to as the application software) judges the speech input as "the target object". ⑤ Display the judgment result on the display device. Step 3. Speech recognition (2) ⑥ The speech recognition module cannot find any of the "templates" of the two objects Π "that match the input speech, then the speech recognition result judges that the input is 11 wrong input ". '..' , © Application software. The voice input is judged as “wrong input”. ⑧The judgment result is displayed. Step 4 · Standard spoken language output. According to the third step. Speech recognition (a) of the “Ziguo” computer half .. will give different The result is ©© ⑥, and different standard spoken language is output to talk with the messenger .. The user can also request the computer platform to give the standard alpha pronunciation of any sentence / word in the conversation content at any time. ⑥ The application software calls the standard spoken language壹 一 库. @ Is a sound card that converts digital signals to analog signals and outputs them. ⑧ It is a system for playback. — As shown above-just ~ is the content of self-introduction in the scene dialogue. Other parts such as' , Xingsheng Hobby " etc., no more detailed list here
第14頁Page 14
β 81 P 五、發明說明(li) -- 舉。在這種模擬實際生活的情景對話中,相信能讓使用者 勇於開口說話,’而提高生活中的口語能力。 二.語法練習 語法練習是讓使用者在練習英語語法時,也能進行 口語I望。具體操作界面如第7圖.語法練習操作界面所 示’其中,在"題目區"列出的題目如下:β 81 P V. Description of the Invention (li)-Examples. In this kind of situational dialogue that simulates real life, I believe that it will allow users to speak up, and improve their speaking skills in life. 2. Grammar exercises Grammar exercises allow users to practice oral English while practicing English grammar. The specific operation interface is shown in Figure 7. The grammar practice operation interface ’Among them, the topics listed in the " topic area " are as follows:
He is surprised the Robot can speakHe is surprised the Robot can speak
English. (a)which (b ) so (c) because (d) by 其中的四個答案就是待識別的"—對象,,,控制過程 與情景對話類似。可以看出,在題目區列出的題目是讓使 兩者練習語法周的。通常做法一般是選擇正確答案的序 號。但在本學f環境中則是朗讀_使用者所選定的答案。這 樣系統就可以對此進行語音識别,從而判斷出兔用考悬否 回答正確。在這種情沉下’使用考既練習了語法’又練習 了口語,從而得到了語法和口語的綜合練習。 三·造句練習 造句座..._.習是提供一組單字或詞组,讓使用考把它們 組合成一個完整.的句子。它的界面如第冬圖所示,在題目 區中列出了一組(四個)單字或詞組,讓使用者(他_們考 成句子。與傳統互法(如鍵盤或鼠標輸入)不同的是使用English. (A) which (b) so (c) because (d) by Four of the answers are to be identified-objects, and the control process is similar to the contextual dialogue. It can be seen that the topics listed in the topic area allow the two to practice grammar week. The usual practice is to choose the number of the correct answer. But in this environment, it is the answer chosen by the user. In this way, the system can perform speech recognition on this, so as to determine whether the rabbit used the test to answer correctly. In this situation, the ‘use test has both practiced grammar’ and spoken language, and thus has obtained a comprehensive practice of grammar and spoken language. 3. Sentence-making exercises Sentence-building ..._. Xi is to provide a set of words or phrases, and use the test to combine them into a complete sentence. Its interface is shown in the second figure, and a set of (four) words or phrases are listed in the subject area, so that users (they test them into sentences. It is different from traditional interactive methods (such as keyboard or mouse input) Is using
索15頁 46 81 2 0 五、發明說明(12) 者可以通過網讀相應的單字或詞组_來進行造句。如上例 四個單字或詞組分別是: (a) he is surprised (b) can speak English (c) the Robot (d) because 當使用者朗讀其中任何一谭詞組時,系統便會進行 語音識別’並將識別結兔_題示在"餐題區”中。這樣’朗讀 完四組單字或詞組後,一個完整的句子便顯示在”答題區" 中’並可告訴使用者答案是否正確.例如,造句後的句子 如果疋 he is surprised because the Robot can speak -——·. Eng 1 i sh” ’則本次造句結果正確。因此,在做造句練習 時’同樣也得到了 口語的練習。 四*單字關連See page 15 46 81 2 0 V. Description of the invention (12) The person can read the corresponding word or phrase _ on the Internet to make a sentence. As in the above example, the four words or phrases are: (a) he is surprised (b) can speak English (c) the Robot (d) because when the user reads any of the Tan phrases, the system will perform speech recognition 'and The recognition rabbit_question is displayed in the " meal question area. &Quot; In this way, after reading aloud four groups of words or phrases, a complete sentence will be displayed in the " answer area " and can tell the user whether the answer is correct. For example, if the sentence after making a sentence is surprisedhe is surprised because the Robot can speak -—— .. Eng 1 i sh "', then the result of this sentence is correct. Therefore, when doing the sentence making exercise', I also got oral practice. Four * words related
f字關連是為了讓使甩者找出與已知單字同意或万 .義的,=,從而掌握更多的單字量,為口語對話打下基 礎。單字關連的操作界面如j9圖·單字關連操作界面所 不如第j一圖,左面的,,題!區"列出了一組單字,-而右面 的1答遵區"中有一叙順序亂的反義詞。要求使罔者於 出每個單字的正確的反義詞。如下所示: 1 η foolishThe connection of the word f is to make the person who finds it agree with the known word or righteousness, =, so as to grasp more words and lay the foundation for the spoken dialogue. The single-word related operation interface is not as good as the j9 picture. The single-word related operation interface is not as good as the first picture. The left, ,, and the question! Area "lists a group of single words,-and the 1 answer compliance area" on the right has a sequence Messy antonyms. Ask the person who writes the correct antonym for each word. It looks like this: 1 η foolish
friend clean c1 ever dirty- light enemyfriend clean c1 ever dirty- light enemy
out 五、發明說明(13) heavy 練習時’當矣j®的某個單字反白(如圖單字 時,使用者必須在右面一找出铉單字的反義詞。使^ = 將選f力反義詞通過朗讀輪入到系統中,讓系統進語立 識別,然後在這兩個單字之間晝一根線。冑完全部:: 就完成了這一次的^字關連。同時系統可顯示答題是否且= 確。這樣,在做單字履連的時候,也讓使用者得 ^ 鍛鍊。其控制過程與情景H類似e —— 】 - 五.音譜園地 $ 上土一種練習時,都會讓使用者有機會鍛鍊口 語。為了讓用戶能掌握每種練習中的單字或句子的正確讀 晋’設計了音譜園地這個練f。在任何以上四種練習中, 八要使^王知道某個單字或句子如何發音,他都可以進 ΐϋϊϊ地來針對這些單免或詞組進行訓練,從而提高 英π的心a水平。音譜園地的操作界面如第1〇圖音譜園 地操作界鱼西示,舉例來說,當用戶在情景對話中想說 we lj "這句話時,如果他不會讀或者是認為讀得不 準確的祐他就可以進入音譜園地進行訓練。如第ι〇_ =示,在”標準發音波形區,,中會顯示標準發音的波形,同 時還有M標準發音放音鍵"讓使用者可以聆聽標準發音。然 ,"使用者學會以後可按”錄音鍵,,進行錄音。錄音完後就會 在"用戶發、音波形區"顯示兩戶费音的波形,讓周戶與標準 .發音波形進行比較,以知曉哪些部份讀得正確,两哪些部out V. Description of the invention (13) During heavy practice, when a word of 矣 j® is reversed (as shown in the figure, the user must find the antonym of the word 铉 on the right. Make ^ = will choose the f force antonym to pass Read into the system in turn, let the system enter the language recognition, and then a line between the two words. 胄 Complete part :: This completes the ^ character connection this time. At the same time, the system can show whether the answer and = True. In this way, the user can also exercise ^ when doing single-word running. The control process is similar to scenario H e】】-Five. Music spectrum field $ An exercise on the soil will give users a chance to exercise Spoken language. In order to allow users to master the correct reading of the words or sentences in each exercise, the practice of designing the musical notation field f is designed. In any of the above four exercises, the eighth must let the king know how to pronounce a word or sentence. He can train for these waivers or phrases to improve the level of the heart a. The operation interface of the music score field is shown in Figure 10 in the music score field. For example, when the user is in situation In the dialogue, when we want to say "we lj", if he ca n’t read or thinks that the reading is not accurate, he can enter the music field for training. As shown in section ι〇_ =, in the "standard pronunciation waveform area" , Will display the standard pronunciation waveform, and there are M standard pronunciation playback keys ", so that the user can listen to the standard pronunciation. However," users can press the "Record button" to record after learning. After recording Will display the waveforms of the two households' tones in the "User's hair, tone waveform area", and let the households compare with the standard .pronounced waveforms to know which parts are read correctly and which two parts
第17頁 五、發明說明(14) 份可能還讀得不 斷地聆聽兩戶發 準確〇經過這樣 能掌握該單字或 以上所述就 功能等與本發明 綜觀以上五 一個模擬的生活 其他四個功能中 何種練習,他都 是本發明所述之 境下進行外語口 雖然本發明 限定本發明,任 和範圍内,當可 範圍當視後附之 夠好°同時還可以從聲音 音與標準發音有何區別, 反覆的比較/訓練後,相 詞組的正,讀音。 疋該學習環境的五大功能 無關’因此這裡不再詳述 大功能’我們發現,(除了 環境讓使且者與機器進行 免都融入了口語練習}既 必須要用口語進行回答。 "一個外語口語學習系統” 語的學習將得到非常有效 已以較佳實施例揭露如上 何熟習此技藝者,在不脫 作些許之更動與潤飾,因 申請專利範圍所界定者為 上進行比較,不 自己的發音是否 信使用者就一定 其他一聲輔助 情景對話 互動的對 無論使用 這樣一個 。相信在 的結果。 ,然其益 離本發明 此本發明 能提供 話外, 者在做 環境王 這種環 养用以 之精神Page 17 Fifth, the invention description (14) You may also read and listen to the two households accurately. After this, you can master the word or the functions described above, and take a comprehensive look with the present invention. What kind of exercises in the function, he is to perform foreign language speaking in the context of the present invention. Although the present invention limits the present invention, within the scope and scope, when the range is good enough, it can be attached after viewing. What is the difference in pronunciation? After repeated comparisons / training, the correct phrase is pronounced.的 The five major functions of the learning environment are not relevant ', so the major functions are not described in detail here. We found that (except that the environment allows the messenger and the machine to be integrated into oral practice), both must be answered in spoken language. &Quot; A foreign language "Spoken language learning system" will be very effective in learning the language. It has been revealed in a preferred embodiment how those skilled in the art can make changes and retouching without making any changes. Because the scope defined in the scope of the patent application is compared, it is not their own. Whether the pronunciation is believed or not, the user must have another pair of contextual dialogue interactions, regardless of the use of such one. Believe in the result. However, the benefit of the present invention is that the present invention can provide the outside story, or the environment king. Used spirit
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW089107671A TW468120B (en) | 2000-04-24 | 2000-04-24 | Talk to learn system and method of foreign language |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW089107671A TW468120B (en) | 2000-04-24 | 2000-04-24 | Talk to learn system and method of foreign language |
Publications (1)
Publication Number | Publication Date |
---|---|
TW468120B true TW468120B (en) | 2001-12-11 |
Family
ID=21659493
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW089107671A TW468120B (en) | 2000-04-24 | 2000-04-24 | Talk to learn system and method of foreign language |
Country Status (1)
Country | Link |
---|---|
TW (1) | TW468120B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1295673C (en) * | 2003-11-03 | 2007-01-17 | 微星科技股份有限公司 | Voice correcting device and method |
US7962327B2 (en) | 2004-12-17 | 2011-06-14 | Industrial Technology Research Institute | Pronunciation assessment method and system based on distinctive feature analysis |
TWI739286B (en) * | 2020-01-21 | 2021-09-11 | 國立臺灣師範大學 | Interactive learning system |
-
2000
- 2000-04-24 TW TW089107671A patent/TW468120B/en not_active IP Right Cessation
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1295673C (en) * | 2003-11-03 | 2007-01-17 | 微星科技股份有限公司 | Voice correcting device and method |
US7962327B2 (en) | 2004-12-17 | 2011-06-14 | Industrial Technology Research Institute | Pronunciation assessment method and system based on distinctive feature analysis |
TWI739286B (en) * | 2020-01-21 | 2021-09-11 | 國立臺灣師範大學 | Interactive learning system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Baker et al. | DiapixUK: task materials for the elicitation of multiple spontaneous speech dialogs | |
Porter et al. | Authentic listening activities1 | |
Kumar et al. | Improving literacy in developing countries using speech recognition-supported games on mobile devices | |
Johnstone | Linking identity and dialect through stancetaking | |
US8843372B1 (en) | Natural conversational technology system and method | |
Ekayati | Shadowing Technique on Students’ Listening Word Recognition | |
Schegloff | Reflections on research on telephone conversation: Issues of cross-cultural scope and scholarly exchange, interactional import and consequences | |
Michael | Automated Speech Recognition in language learning: Potential models, benefits and impact | |
CN108133632A (en) | The training method and system of English Listening Comprehension | |
Huenerfauth et al. | Evaluating importance of facial expression in American Sign Language and pidgin signed English animations | |
TWI270052B (en) | System for selecting audio content by using speech recognition and method therefor | |
Wagner et al. | The big australian speech corpus (the big asc) | |
Yu | Learning a Foreign Language through Text and Memorisation: The Chinese Learners' Perceptions. | |
Watthajarukiat et al. | An Investigation of English listening strategies used by Thai undergraduate students in public universities in the South | |
KR100450019B1 (en) | Method of service for english training of interactive voice response using internet | |
JP6656529B2 (en) | Foreign language conversation training system | |
JP2003228279A (en) | Language learning apparatus using voice recognition, language learning method and storage medium for the same | |
Nicholson | An impetus for change: Classroom analysis using Sinclair and Coulthard's model of spoken discourse | |
TW468120B (en) | Talk to learn system and method of foreign language | |
Baker et al. | LUCID: a corpus of spontaneous and read clear speech in British English | |
KR20010107035A (en) | An internet english study service method for voice recognition and voice synthesis | |
Shukla | Development of a human-AI teaming based mobile language learning solution for dual language learners in early and special educations | |
TW583610B (en) | System and method using computer to train listening comprehension and pronunciation | |
Karlsen et al. | Analysis of a simultaneousspeaker sound corpus | |
CN112863267B (en) | English man-machine conversation system and learning method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GD4A | Issue of patent certificate for granted invention patent | ||
MM4A | Annulment or lapse of patent due to non-payment of fees |