JP2010282058A - Method and device for supporting foreign language learning - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To facilitate foreign language learning by providing a foreign language learning support method and a device, which can check how conversation by speaking the foreign language is successful. <P>SOLUTION: A question database (10) stores questions by a foreign language, and one or more answer examples in Japanese for the question. The question is presented to a learner by a microphone (16) or a display device (18). The learner inputs an answer by a microphone (20). A speech analysis device (22) analyzes a speech signal to perform fixed quantity evaluation of pronunciation. A speech recognition device (24) performs speech recognition on the speech signal from the microphone, and converts it to an answer sentence. A translation device (26) translates the answer sentence to Japanese. A comparison device (28) evaluates a content quantitatively by comparing the sentence translated into Japanese by the translation device (26) with the answer example to the question, and outputs a content evaluation point. A display device (18) displays the answer example, the answer sentence, the pronunciation evaluation point and the content evaluation point. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a foreign language learning assistance method and apparatus for assisting in the acquisition of a foreign language.

  As a device or system for assisting or supporting the learning of foreign languages, Patent Document 1 displays model text as text and makes the learner read it out, captures the voice of the learner, and displays text obtained by voice recognition processing. In addition, a system is described that compares the speech-recognized text with the text of the model sentence to determine the degree of approximation thereof, and displays the degree of approximation determination result for each word.

  Patent Document 2 teaches a learner to read a foreign language sentence, captures the learner's voice, and evaluates and displays the degree (likelihood) of matching with the model voice for each word contained in the sentence. An apparatus is described.

JP 2007-148170 A JP 2001-265 211 A

  Conventional foreign language learning devices that use learning devices generally display translated sentences for foreign language sentences at the same time or after a certain amount of time. It was not enough to learn.

  According to the techniques described in Patent Documents 1 and 2, the accuracy of pronunciation can be quantitatively confirmed, but the read-out sound of a given text is confirmed. However, foreign language learning is mainly intended for conversation in the foreign language, and a learning assistance system that can evaluate whether or not the conversation is established is desired. Conventionally, it has not been possible to confirm whether the content of a foreign language sentence spoken by a learner correctly expresses the intention.

  An object of this invention is to show the foreign language learning assistance method and apparatus which can confirm the establishment of the conversation by a foreign language.

  The foreign language learning assistance method according to the present invention reads a question from a question storage means that accommodates a question in a learning target language and one or more answer examples in a predetermined language different from the learning target language. A question presentation step to be presented to the learner, a voice capture step of capturing the voice of the answer pronounced by the learner with a microphone, and a voice analyzer that analyzes the voice signal captured in the voice capture step to quantitatively evaluate pronunciation A speech analysis step for outputting a pronunciation evaluation score; a speech recognition step for speech recognition of the speech signal captured in the speech capture step; and a speech recognition step for converting the speech signal into an answer sentence; A translation step of translating the reply sentence into a translated sentence of the predetermined language by a translation device; and the translation by the translation device. The comparison step of comparing the sentence and the answer example of the predetermined language for the question by the comparison device to quantitatively evaluate the answer content and outputting the content evaluation point, and the pronunciation evaluation point and the content evaluation point An evaluation point presenting step to be presented.

  The foreign language learning auxiliary device according to the present invention includes a question storage means for accommodating a question of a learning target language, and one or more answer examples in a predetermined language different from the learning target language for the question, and the question storage means The question output device that presents the question from the learner to the learner, the microphone that captures the voice of the answer that the learner pronounces, the voice signal from the microphone is analyzed, the pronunciation is quantitatively evaluated, and the pronunciation evaluation score is output A pronunciation analysis device that performs speech recognition of the speech signal from the microphone and converts it into an answer sentence, and a translation device that translates the answer sentence output from the speech recognition means into a translated sentence in a predetermined language And a comparison device for quantitatively evaluating the content by comparing the translated sentence by the translation device with an example of an answer in the predetermined language for the question, and outputting the content evaluation score, and the pronunciation evaluation score and Characterized by comprising an evaluation point output unit for outputting the contents evaluation point.

  According to the present invention, since the contents and pronunciation are quantitatively evaluated in the answer to the question, it is possible to make the learner accurately recognize the degree of learning and the items to be studied intensively, and efficient learning is achieved. It becomes possible.

1 shows a schematic block diagram of an embodiment of the present invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows a schematic block diagram of an embodiment of the present invention. Here, it is assumed that a Japanese learns English.

  The question database 10 stores voice data (English), text data (English), and answer example text data (Japanese) for each of a plurality of questions presented to the learner. The answer example text data may be one or more depending on the answer. The learning program control device 12 causes the headphones 16 or the display device 18 to sequentially read out the questions stored in the question database 10 in accordance with a user operation by the operation device 14. The headphones 16 are used for outputting the question by voice, and the display device 18 is used for displaying the question text. The headphones 16 and the display device 18 may be used simultaneously or selectively. Which is to be used is set in the learning program control device 12 in advance.

  The learner can instruct the learning program control device 12 to start learning, re-question, change to the next question, return to the previous question, end of learning, and the like by the operation device 14.

  The learner puts the headphones 16 on his / her ear and listens to the question voice, or looks at the display text on the display device 18 and pronounces the answer to the question toward the microphone 20. The microphone 20 captures the voice generated by the learner and supplies the voice signal to the voice analysis device 22 and the voice recognition device 24.

  The voice analyzer 22 analyzes the voice signal from the microphone 20 and quantitatively evaluates the quantification of pronunciation as English. The voice analysis device 22 may output either a pronunciation evaluation score for the entire answer, or may output a pronunciation evaluation score in units of phrases or words. Beginners need to evaluate the entire answer and evaluate pronunciation in shorter units as they become more proficient in English. For this purpose, the pronunciation evaluation unit may be set in the speech analysis device 22 before the start of learning.

  The voice recognition device 24 converts the voice signal from the microphone 20 into text by a known voice recognition technique. The translation device 26 converts the text signal (English text) from the speech recognition device 24 into a Japanese answer text (answer translation text) using a well-known English / Japanese translation system. The translation device 26 also quantitatively determines the grammar of the English answer sentence during the translation process, and corrects the grammar as necessary. The comparison device 28 reads from the question database 10 an answer example that is closest to the answer translation sentence from the translation device 26, and quantitatively evaluates the answer contents in comparison with the answer translation sentence. The comparison device 28 outputs, as content evaluation points, evaluation points based on the comparison between the translated sentence and the answer example, and grammar evaluation points from the translation device 26.

  For learners who want to evaluate the answer examples in English and the contents of the answers, prepare the answer examples in English in the question database 10, and compare the answers with the answer examples in English to quantitatively evaluate the contents of the answers. May be. In this case, the translation device 26 becomes unnecessary.

  The display device 18 displays an answer example from the comparison device 28, an answer translation, and a content evaluation score with respect to the learner's answer, and displays a pronunciation evaluation score from the speech analysis device 22. Thereby, the learner can quantitatively confirm the content of the answer and the quality of the pronunciation.

  The storage device 30 includes, as a learner's learning history, a question sentence from the question database 10, an answer example from the comparison device 28, an answer translation sentence and an answer evaluation point, and a pronunciation evaluation point from the speech analysis device 22. Memorize it together. The learner can confirm the learning history by displaying the question sentence and the like stored in the storage device 30 on the display device 18 after a series of learning, and can know the proficiency level for the same question.

  The learning program control device 12 determines the next question according to the evaluation points from the comparison device 28 and the voice analysis device 22 in addition to the instruction from the operation device 14, and reads the question from the question database 10.

  In the present embodiment, it is possible to confirm whether or not the question has been correctly heard or read by evaluating the content of the answer by the speech recognition device 24 (and the translation device 26). You can also check if you understand. Further, the correctness of the pronunciation can be quantitatively confirmed by the pronunciation evaluation by the voice analyzer 22. As a result, it becomes possible for the learner to focus on a field or task with a low evaluation, and learning efficiency is improved.

  Although the invention has been described with reference to specific illustrative embodiments, various modifications and alterations may be made to the above-described embodiments without departing from the scope of the invention as defined in the claims. This is obvious to an engineer in the field to which the present invention belongs, and such changes and modifications are also included in the technical scope of the present invention.

10: Question database 12: Learning program control device 14: Operation device 16: Headphone 18: Display device 20: Microphone 22: Speech analysis device 24: Speech recognition device 26: Translation device 28: Contrast device 30: Storage device

Claims (8)

A question presenting step of reading out the question and presenting it to the learner from a question storage means for accommodating a question of the learning target language and one or more answer examples of the predetermined language different from the learning target language for the question;
A voice capture step of capturing the voice of the answer pronounced by the learner with a microphone;
A sound analysis step of analyzing the sound signal captured in the sound capturing step with a sound analysis device to quantitatively evaluate pronunciation and outputting a pronunciation evaluation point;
A speech recognition step of recognizing the speech signal captured in the speech capture step with a speech recognition device and converting it into an answer sentence;
A translation step of translating the answer sentence recognized by the voice recognition step into a translation sentence of the predetermined language by a translation device;
A comparison step for quantitatively evaluating the content of the response by comparing the translated sentence by the translation device and an example of an answer in the predetermined language for the question by a comparison device,
A foreign language learning assistance method, comprising: an evaluation score presenting step for presenting the pronunciation evaluation score and the content evaluation score to a learner. The question presenting step is a step of outputting an audio signal indicating the question,
The foreign language learning assistance method according to claim 1, wherein the evaluation score presenting step is a step of displaying the pronunciation evaluation score and the content evaluation score. The question presenting step is a step of displaying text indicating the question,
The foreign language learning assistance method according to claim 1, wherein the evaluation score presenting step is a step of displaying the pronunciation evaluation score and the content evaluation score.   4. The foreign language learning assistance according to claim 1, further comprising a step of storing a question sentence, an answer sentence, the pronunciation evaluation score, and the content evaluation score in a storage device for the question. Method. A question storage means for accommodating a question in a learning target language and one or more answer examples in a predetermined language different from the learning target language for the question;
A question output device for presenting the question to the learner from the question storage means;
A microphone that captures the voice of the answer pronounced by the learner;
A pronunciation analysis device that analyzes the audio signal from the microphone and quantitatively evaluates the pronunciation and outputs a pronunciation evaluation point;
Voice recognition means for recognizing the voice signal from the microphone and converting it into an answer sentence;
A translation device for translating the answer sentence output from the speech recognition means into a translated sentence in a predetermined language;
A comparison device that quantitatively evaluates the content by comparing the translated sentence by the translation device with an example of an answer in the predetermined language for the question, and outputs a content evaluation point;
A foreign language learning auxiliary device, comprising: an pronunciation score output device for outputting the pronunciation evaluation score and the content evaluation score. Furthermore, it comprises a voice output device and a display device for displaying characters and images,
The question output device is means for supplying an audio signal corresponding to the question to the audio output device,
6. The foreign language learning auxiliary device according to claim 5, wherein the evaluation score output device is means for displaying the pronunciation evaluation score and the content evaluation score on the display device. Furthermore, it comprises a voice output device and a display device for displaying characters and images,
The question output device is means for causing the display device to display text corresponding to the question,
6. The foreign language learning auxiliary device according to claim 5, wherein the evaluation score output device is means for displaying the pronunciation evaluation score and the content evaluation score on the display device.   Furthermore, the foreign language learning auxiliary | assistance apparatus of Claim 5 thru | or 7 provided with the memory | storage device which memorize | stores a question sentence, an answer sentence, the said pronunciation evaluation score, and the said content evaluation score with respect to the said question.

Images