TWI432179B - Interactive speech testing and training platform - Google Patents
Interactive speech testing and training platform Download PDFInfo
- Publication number
- TWI432179B TWI432179B TW100128996A TW100128996A TWI432179B TW I432179 B TWI432179 B TW I432179B TW 100128996 A TW100128996 A TW 100128996A TW 100128996 A TW100128996 A TW 100128996A TW I432179 B TWI432179 B TW I432179B
- Authority
- TW
- Taiwan
- Prior art keywords
- voice
- test
- database
- training platform
- subject
- Prior art date
Links
Description
本發明係有關於語音測試與訓練,尤其是一種互動式語音測試及訓練平台。The invention relates to speech testing and training, in particular to an interactive speech testing and training platform.
習知技術在醫療上常常需要對有聽障的人做聽力的檢測,尤其由於社會高齡化的關係,聽障人口日益增加,以往大多數的聽障人士必須配戴助聽器以改善聽力。故必須了解聽障者的聽力情況,再據此聽力情況設計符合的助聽器,以有效的改進配戴者的溝通能力。In the medical field, it is often necessary to perform hearing tests on people with hearing impairments, especially due to the aging of the society, and the hearing-impaired population is increasing. In the past, most hearing-impaired people must wear hearing aids to improve hearing. Therefore, it is necessary to understand the hearing of the hearing impaired, and then design a hearing aid according to the hearing situation, in order to effectively improve the communication ability of the wearer.
一般聽力的測試,係在聽力測試室中播放不同性質的聲音,令受測者聆聽,依據其感受而按下控制鈕以回應所聽到的聲音。然後施測者依據受測者的聽力反應,決定受測者的聽力情況。The general hearing test plays different sounds in the hearing test room, allowing the subject to listen and press the control button to respond to the sound heard according to his or her feelings. Then, the examiner determines the hearing condition of the subject according to the hearing response of the subject.
唯依據目前的醫療知識,吾人瞭解聽取能力如果經夠適當的訓練,是有可能復健的。經過復健的訓練,可以有效的改善患者的聽取能力,對於輕度失聽的人,可不必完全仰賴助聽器。而且助聽器的能力也有其極限,如果輔之以聽力復健的訓練,將可裨益於患者。Based on current medical knowledge, we understand that listening ability is likely to be rehabilitated if properly trained. After rehabilitation training, it can effectively improve the patient's listening ability. For those who are mildly hearing loss, they do not have to rely entirely on hearing aids. And the ability of the hearing aid has its limits, and if it is supplemented by listening and rehabilitation training, it will benefit the patient.
本發明的目的係為提出一種互動式語音測試及訓練平台,其中可以對受測者進行重復測試且也可以達到聽能復健的目的。本案中應用相近音的方式將語音的測試以電子裝置的方式達成,所以可以輕易的對受測者進行測試,且也可針對錯誤的結果進行反復的訓練,藉以增強聽力。再者本發明中的相近音的選擇主要是以雙字詞為主。其中對於各個單元依據該詞句的代表性,日常生活上的使用頻率,及語音彼此之間相近的程度決定該詞句出現的頻率。The purpose of the present invention is to propose an interactive voice test and training platform, in which the test subject can be repeatedly tested and can also achieve the purpose of hearing rehabilitation. In this case, the method of using near-tones is used to realize the test of the voice by means of an electronic device, so that the testee can be easily tested, and repeated training can be performed for the wrong result, thereby enhancing the hearing. Furthermore, the selection of the near sounds in the present invention is mainly based on double words. The frequency of occurrence of the phrase is determined by the frequency of use of the phrase, the frequency of use in daily life, and the degree to which the voices are close to each other.
為達到上述目的,本發明中提出一種互動式語音測試及訓練平台,包含:一相近音詞庫,儲存有各種不同相似音的語詞及對應該語詞的所有相似音的詞,各構成該詞庫中的一單元;一等化器係用於將一輸入的語音轉化為電子語音,所謂的電子語音係指從一般電子儀器中所播放的語音;一選擇器,依據內定的選擇邏輯在該相近音詞庫或該相近音句庫中選出測試題目;一播放器,依據該選擇器所選擇該結果播放出語音或影音;播放器的分為語音播放及影音播放;語音播放以語音的形式播放出選擇器所選擇的結果,影音播放主要是語音再加上播放影像;一接收器用於接收由受測者所回覆的結果的正確與否;主要是由受測者所輸入;一評分器,依據該接收器所接收的輸入與內建的答案比對後,決定所受測者所回覆的結果的正確性,並累積各次的回覆結果後評定分數;評分器中並包含一及格機制,用於決定受測者所得到的分數是否及格,如果是則結束該項測驗,如果不是則回到該選擇器中,對於錯誤的題目重新測試,唯此時可應用上述的排除邏輯,從同一單元中選擇其它不同的相近音或相近句進行測試,以避免因為受測者的記憶而影響測試結果。In order to achieve the above object, an interactive voice test and training platform is proposed in the present invention, which comprises: a close-up vocabulary, storing words of different similar sounds and all similar sounds corresponding to the words, each constituting the vocabulary One unit; the first equalizer is used to convert an input voice into electronic voice, the so-called electronic voice refers to the voice played from a general electronic instrument; a selector is similar in accordance with the default selection logic A test title is selected from the sound vocabulary or the similar sentence sentence library; a player plays a voice or video according to the result selected by the selector; the player is divided into a voice play and a video play; the voice play is played in a voice form The result selected by the selector, the audio and video playback is mainly voice plus the playback image; a receiver is used to receive the correctness of the result replied by the subject; mainly input by the subject; a scorer, After the input received by the receiver is compared with the built-in answer, the correctness of the result of the respondent is determined, and after each reply result is accumulated, The scorer includes a pass-through mechanism to determine whether the score obtained by the subject is passed, and if so, the test is ended. If not, return to the selector and re-test the wrong question. Only the above exclusion logic can be applied at this time, and other different near or similar sentences are selected from the same unit for testing to avoid affecting the test result due to the memory of the subject.
由下文的說明可更進一步瞭解本發明的特徵及其優點,閱讀時並請參考附圖。The features of the present invention and its advantages are further understood from the following description, and reference is made to the accompanying drawings.
茲謹就本案的結構組成,及所能產生的功效與優點,配合圖式,舉本案之一較佳實施例詳細說明如下。請參考圖一及圖二,其中顯示本案之互動式與音測試及訓練平台。In view of the structural composition of the case, and the functions and advantages that can be produced, in conjunction with the drawings, a preferred embodiment of the present invention is described in detail below. Please refer to Figure 1 and Figure 2 for the interactive and sound testing and training platform of this case.
本發明中包含一資料庫,其包含下列的次級資料庫。The present invention includes a database containing the following secondary databases.
一相近音詞庫10,儲存有各種不同相似音的語詞及對應該語詞的所有相似音的詞,如此構成該詞庫中的一單元,如希望,幾萬;使用,食用;今年,新年,心連,新人;等等。其中相近音的選擇主要是以雙字詞為主,係因為雙字詞的相似音較多,較不易分辨。對於各個單元依據該詞句的代表性,日常生活上的使用頻率,及語音彼此之間相近的程度決定該詞句出現的頻率。a close-to-sense vocabulary 10, storing words of various similar sounds and all similar sounds corresponding to the words, thus forming a unit in the lexicon, if desired, tens of thousands; use, eat; this year, new year, Heart, newcomer; and so on. Among them, the selection of close sounds is mainly based on double words, because the similar sounds of double words are more difficult to distinguish. For each unit, according to the representativeness of the phrase, the frequency of use in daily life, and the degree to which the voices are close to each other determine the frequency of occurrence of the phrase.
一相近音句庫20,儲存有各種不同句子,並對該句子中的某一詞儲存該詞的相近音的語詞。如”ㄒㄧㄣ ㄋㄧㄢˊ到了要穿新衣”,對於”ㄒㄧㄣ ㄋㄧㄢˊ”的音,也儲存”今年,新年,心連,新人”四個語詞作為測試之用。A close-to-sentence sentence library 20 stores various sentences and stores the similar words of the word for a word in the sentence. For example, "ㄒㄧㄣ ㄋㄧㄢˊ 要 要 要 要 要 要 ” ” ” ” ” ” ” ” ” ” ” , , , , , , 对于 对于 对于 对于 对于 对于 对于 对于 对于 ㄒㄧㄣ 的 ㄒㄧㄣ ㄒㄧㄣ ㄒㄧㄣ ㄒㄧㄣ ㄒㄧㄣ
一嘴形資料庫30儲存對應各種發音的嘴形。The mouth shape database 30 stores mouth shapes corresponding to various pronunciations.
一表情資料庫40儲存對應各種發音的表情。An expression database 40 stores expressions corresponding to various pronunciations.
一般受測者如聽到語音外另輔以嘴形及表情則有可能使聲音辨識的準確度增加20%到30%。所以對於重聽者施行此項測試及訓練有助於加強整體語音辨識的能力。Generally, if the subject is listening to the voice and supplemented by the mouth shape and expression, it may increase the accuracy of the voice recognition by 20% to 30%. Therefore, performing this test and training for the listeners helps to enhance the overall speech recognition ability.
一雜音資料庫50,儲存有各種不同的雜音。A noise database 50 stores various noises.
一等化器60係用於將一輸入的語音轉化為電子語音,所謂的電子語音係指從一般電子儀器中所播放的語音,如電話,手機等等。因此可以使得受測者可以如同聽到從電子儀器發出的語音。應用此一電子語音,可以訓練受測者對於電子語音的辨識能力。The equalizer 60 is used to convert an input voice into an electronic voice, and the so-called electronic voice refers to a voice played from a general electronic device such as a telephone, a mobile phone, or the like. Therefore, the subject can be made to hear the voice from the electronic device. Using this electronic voice, the subject can be trained to recognize the electronic voice.
一選擇器70,依具內定的選擇邏輯在該相近音詞庫或該相近音句庫中選出測試題目。A selector 70 selects a test title in the near-sense vocabulary or the close-up sentence library according to a default selection logic.
其中該選擇邏輯包含由測試員自由選定,或以隨機的方式選定。該選擇邏輯也包含排除邏輯,其可以排除某些語音,如已測試通過的語音,則排除不再出現。Wherein the selection logic is freely selected by the tester or selected in a random manner. The selection logic also includes exclusion logic, which can exclude certain speech, such as voice that has been tested, and the exclusion no longer occurs.
當選擇完語音(即該相近音或該相近句)後,可以再選擇是否加入雜音,或以電子語音的方式呈現,或顯示對應的嘴形或表情。當決定在所選擇的相近音或相近句中加入該雜音時,雜音的音量也是可以視需要調整。當雜音的音量愈大時,則愈難辨識掺雜其中的語音。當決定加入嘴形或表情時,在播放語音時,也同時以影像方式播放嘴形或表情。After selecting the voice (ie, the close sound or the close sentence), you can choose whether to add the noise, or display it in electronic voice, or display the corresponding mouth shape or expression. When it is decided to add the noise to the selected near or close sentence, the volume of the noise can also be adjusted as needed. When the volume of the noise is louder, it is more difficult to recognize the voice doped therein. When it is decided to add a mouth shape or an expression, when playing a voice, the mouth shape or expression is also played as an image.
依據選擇器70的選擇結果可建立測驗題組。A test question group can be established based on the selection result of the selector 70.
一播放器80,依據該選擇器70所選擇該結果播放出語音或影像。播放器80的分為語音播放及影像播放。語音播放以語音的形式播放出選擇器所選擇的結果,影像播放主要是播放影像。A player 80 plays a voice or image according to the result selected by the selector 70. The player 80 is divided into voice playback and video playback. Voice playback plays the result selected by the selector in the form of voice. The video playback is mainly to play the image.
以語音播放時,主要是先以語音播放出一詞,而於顯示幕中顯示與此詞同一單元的其它數個相近音的詞,由受測者決定所顯示的那一個語詞對應該語音所表達者。如施測者唸出:ㄒㄧㄣ ㄋㄧㄢˊ的音,然後顯示幕上顯示”今年,新年,心連,新人”四組語詞,由受測者決定那一語詞的音為施測者所發音者,並輸入答案。對於語句的測試主要是以施測者直接唸出的方式為主。When playing in voice, the word is played first by voice, and the words of other similar sounds in the same unit as the word are displayed on the display screen, and the subject determines which one of the words is displayed corresponding to the voice. Expresser. For example, the tester reads: the sound of ㄒㄧㄣㄋㄧㄢˊ, and then displays the four groups of words on the screen, "This year, New Year, Heart, Newcomer". The subject decides the sound of the word as the tester. The person being pronounced and enter the answer. The test of the sentence is mainly based on the way the tester directly reads it.
一接收器90用於接收由受測者所回覆的結果的正確與否。主要是由受測者所輸入。A receiver 90 is used to receive the correctness of the result replied by the subject. It is mainly input by the subject.
一評分器100,依據該接收器90所接收的輸入與內建的答案比對後,決定所受測者所回覆的結果的正確性,並累積各次的回覆結果後評定分數。評分器100中並包含一及格機制,用於決定受測者所得到的分數是否及格,如果是則結束該項測驗,如果不是則回到該選擇器中,對於錯誤的題目重新測試,唯此時可應用上述的排除邏輯,從同一單元中選擇其它不同的相近音或相近句進行測試,以避免因為受測者的記憶而影響測試結果。A scorer 100 determines the correctness of the results replied by the subject according to the input received by the receiver 90 and compares the built-in answers, and accumulates the results of the responses after each time. The scorer 100 also includes a pass mechanism for determining whether the score obtained by the subject is passed, and if so, ending the test, if not, returning to the selector, retesting the wrong question, only The above exclusion logic can be applied to select other different near or similar sentences from the same unit for testing to avoid affecting the test result due to the memory of the subject.
本發明中測試結果中並包含顯示正確語詞與受測者所選則的語詞中個字元的聲、介、韻、調,並標示出錯誤的聲、介、韻、調,以供受測者分析每個語音中,可以加強聽力的訓練。In the test result of the present invention, the sound, the medium, the rhyme, the tone of the characters in the words of the correct words and the subject selected by the subject are displayed, and the wrong sound, media, rhyme, and tone are marked for testing. The analysis of each voice can enhance the training of listening.
由本發明上述的系統及運作可以對受測者進行重復測試以達到聽力復健的目的。本案中應用相近音的方式將語音的測試以電子裝置的方式達成,所以可以輕易的對受測者進行測試,且也可針對錯誤的結果進行反復的訓練,藉以增強聽力,此為習知技術中所無法達成者。再者本發明中的相近音的選擇主要是以雙字詞為主。其中對於各個單元依據該詞句的代表性,日常生活上的使用頻率,及語音彼此之間相近的程度決定該詞句出現的頻率,此為習知的系統所無者,不啻為本發明的一項創新點。The above-mentioned system and operation of the present invention can repeatedly test the subject to achieve the purpose of hearing rehabilitation. In this case, the method of using near-tones is used to realize the test of the voice by means of an electronic device, so that the testee can be easily tested, and the test can be repeated for the wrong result, thereby enhancing the hearing, which is a conventional technique. Those who cannot be reached in the middle. Furthermore, the selection of the near sounds in the present invention is mainly based on double words. According to the representativeness of the phrase, the frequency of use in daily life, and the degree to which the voices are close to each other determine the frequency of occurrence of the phrase, which is not the case of the conventional system, and is not a Innovation.
綜上所述,本案人性化之體貼設計,相當符合實際需求。其具體改進現有缺失,相較於習知技術明顯具有突破性之進步優點,確實具有功效之增進,且非易於達成。本案未曾公開或揭露於國內與國外之文獻與市場上,已符合專利法規定。In summary, the humanized design of this case is quite in line with actual needs. The specific improvement of the existing defects is obviously a breakthrough improvement advantage compared with the prior art, and it has an improvement in efficacy and is not easy to achieve. The case has not been disclosed or disclosed in domestic and foreign literature and market, and has complied with the provisions of the Patent Law.
上列詳細說明係針對本發明之一可行實施例之具體說明,惟該實施例並非用以限制本發明之專利範圍,凡未脫離本發明技藝精神所為之等效實施或變更,均應包含於本案之專利範圍中。The detailed description of the preferred embodiments of the present invention is intended to be limited to the scope of the invention, and is not intended to limit the scope of the invention. The patent scope of this case.
10...相近音詞庫10. . . Similar pronunciation dictionary
20...相近音句庫20. . . Similar sentence library
30...嘴形資料庫30. . . Mouth database
40...表情資料庫40. . . Expression database
50...雜音資料庫50. . . Noise database
60...等化器60. . . Equalizer
70...選擇器70. . . Selector
75...測試題組75. . . Test question group
80...播放器80. . . player
90...接收器90. . . receiver
100...評分器100. . . Scorer
圖一顯示本案中之資料庫及選擇器邏輯的元件方塊圖。Figure 1 shows the component block diagram of the database and selector logic in this case.
圖二顯示本案中之操作的元件方塊圖。Figure 2 shows a block diagram of the components of the operation in this case.
10...相近音詞庫10. . . Similar pronunciation dictionary
20...相近音句庫20. . . Similar sentence library
30...嘴形資料庫30. . . Mouth database
40...表情資料庫40. . . Expression database
50...雜音資料庫50. . . Noise database
60...等化器60. . . Equalizer
70...選擇器70. . . Selector
75...測試題組75. . . Test question group
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW100128996A TWI432179B (en) | 2011-08-12 | 2011-08-12 | Interactive speech testing and training platform |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW100128996A TWI432179B (en) | 2011-08-12 | 2011-08-12 | Interactive speech testing and training platform |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201306802A TW201306802A (en) | 2013-02-16 |
TWI432179B true TWI432179B (en) | 2014-04-01 |
Family
ID=48169440
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW100128996A TWI432179B (en) | 2011-08-12 | 2011-08-12 | Interactive speech testing and training platform |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI432179B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108831212A (en) * | 2018-06-28 | 2018-11-16 | 深圳语易教育科技有限公司 | A kind of oral English teaching auxiliary device and method |
-
2011
- 2011-08-12 TW TW100128996A patent/TWI432179B/en active
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108831212A (en) * | 2018-06-28 | 2018-11-16 | 深圳语易教育科技有限公司 | A kind of oral English teaching auxiliary device and method |
Also Published As
Publication number | Publication date |
---|---|
TW201306802A (en) | 2013-02-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Zokoll et al. | Internationally comparable screening tests for listening in noise in several European languages: The German digit triplet test as an optimization prototype | |
Cameron et al. | Development of the listening in spatialized noise-sentences test (LISN-S) | |
Zokoll et al. | Development and evaluation of the Turkish matrix sentence test | |
Shayanmehr et al. | Development, validity and reliability of Persian quick speech in noise test with steady noise | |
Wilson et al. | An evaluation of the BKB-SIN, HINT, QuickSIN, and WIN materials on listeners with normal hearing and listeners with hearing loss | |
Nittrouer et al. | Verbal working memory in children with cochlear implants | |
Moya-Galé et al. | The effects of intensive speech treatment on conversational intelligibility in Spanish speakers with Parkinson's disease | |
Dillon et al. | Nonword repetition by children with cochlear implants | |
von Lochow et al. | The effect of voice quality and competing speakers in a passage comprehension task: Perceived effort in relation to cognitive functioning and performance in children with normal hearing | |
Wambaugh et al. | Interrater reliability and concurrent validity for the Apraxia of Speech Rating Scale 3.0: Application with persons with acquired apraxia of speech and aphasia | |
Schiller et al. | Effects of noise and a speaker's impaired voice quality on spoken language processing in school-aged children: A systematic review and meta-analysis | |
Allen et al. | Production of sentence-final intonation contours by hearing-impaired children | |
McGuire | A brief primer on experimental designs for speech perception research | |
Levy et al. | Effects of speech cues in French‐speaking children with dysarthria | |
Visentin et al. | A matrixed speech-in-noise test to discriminate favorable listening conditions by means of intelligibility and response time results | |
Mealings et al. | The development of the Mealings, Demuth, Dillon, and Buchholz classroom speech perception test | |
Culling et al. | The viability of speech-in-noise audiometric screening using domestic audio equipment: La viabilidad del tamizaje audiométrico con lenguaje en ruido utilizando equipo doméstico de audio | |
TWI432179B (en) | Interactive speech testing and training platform | |
Carlie et al. | Development of an auditory passage comprehension task for Swedish primary school children of cultural and linguistic diversity | |
JP6032584B2 (en) | Hearing ability evaluation method, answer sheet and hearing ability evaluation system used therefor. | |
Jamaluddin | Development and evaluation of the digit triplet and auditory-visual matrix sentence tests in Malay | |
Casserly et al. | Auditory training with multiple talkers and passage-based semantic cohesion | |
Mangum | Performance intensity functions for digitally recorded Japanese speech audiometry materials | |
Raymer et al. | Treatment of auditory processing in noise in individuals with mild aphasia: Pilot study | |
Ma et al. | The effects of dysphonic voice on speech intelligibility in Cantonese-speaking adults |