KR20140004539A - Method for providing learning language service based on interactive dialogue using speech recognition engine - Google Patents

Method for providing learning language service based on interactive dialogue using speech recognition engine Download PDF

Info

Publication number
KR20140004539A
KR20140004539A KR1020120072542A KR20120072542A KR20140004539A KR 20140004539 A KR20140004539 A KR 20140004539A KR 1020120072542 A KR1020120072542 A KR 1020120072542A KR 20120072542 A KR20120072542 A KR 20120072542A KR 20140004539 A KR20140004539 A KR 20140004539A
Authority
KR
South Korea
Prior art keywords
foreign language
user terminal
voice
recognition engine
learning
Prior art date
Application number
KR1020120072542A
Other languages
Korean (ko)
Inventor
전은경
김종기
문미정
원철희
윤성희
김경숙
이진영
권요성
윤산정
Original Assignee
(주)아이티씨교육
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)아이티씨교육 filed Critical (주)아이티씨교육
Priority to KR1020120072542A priority Critical patent/KR20140004539A/en
Publication of KR20140004539A publication Critical patent/KR20140004539A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • G06Q50/205Education administration or guidance
    • G06Q50/2053Education institution selection, admissions, or financial aid
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • G06Q50/205Education administration or guidance
    • G06Q50/2057Career enhancement or continuing education service
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition

Abstract

The present invention relates to a method for providing a foreign language understanding promotion study service. According to the method for providing the foreign language understanding promotion study service by a bidirectional dialogue about foreign language content using a voice recognition engine suggested in the present invention, the concentration of a foreign content information processing operation is improved by enabling a user to memorize study content and to directly speak an answer thereof. The user directly and precisely understands a meaning. [Reference numerals] (AA) Start; (BB) Step for testing by questions; (CC) Step for continuously testing whole questions; (DD) End; (S100) Step for transferring study content including a plurality of sentences consisting of target study languages to a user terminal; (S200) Step for transferring the questions about study contents and in which consists of the target study languages to the user terminal by voice; (S300) Step for recording and receiving user voice phonated by consisting of the target study languages for answer's sentences about the questions transferred in the S200; (S400) Step for setting scores about the user voice transferred in the S300 and transferring it to the user terminal; (S500) Step for performing processes same as S200 to S400 about each question without performing the S200 to S400; (S600) Step for recording and receiving the user voice phonating the answer sentences about the question individually transferred by using the voice recognition engine from the user terminal while the questions transferred in the S200 to S500 are individually transferred by the voice to the user terminal; (S700) Step for recording the score about the user voice transferred in the S600 and transferring it to the user terminal

Description

METHOOD FOR PROVIDING LEARNING LANGUAGE SERVICE BASED ON INTERACTIVE DIALOGUE USING SPEECH RECOGNITION ENGINE}

The present invention relates to a method for providing a foreign language comprehension learning service, and more particularly, to a method for providing a foreign language comprehension learning service through two-way conversation about a foreign language content using a voice recognition engine.

Reading Comprehension and Listening Comprehension to read or hear foreign language content and understand its meaning are very important skills in using foreign language. When searching for stories or information through foreign language books or the Internet, or listening to foreign language speeches or news, the ability to grasp and understand the meaning more accurately and in a shorter time is more focused and more accessible whenever you encounter foreign language content. There is a need for repeated practice that involves elaborate information processing efforts to gain a lot of meaning. However, existing English learning services on reading and listening focus on solving multiple-choice questions in the `` Lim Saseonda '' for various English tests, checking the key elements of the content and providing a rough plot. After grasping the problem, the user was most likely to focus on the trick of guessing the intention of the question and selecting the most appropriate answer. This traditional learning method is an indirect way to find the correct answer by getting hints in four fingerprints even if the contents are outlined. Therefore, it is insufficient to focus on English contents and understand the contents directly and completely in depth. There was a problem.

Meanwhile, as the language education method through the network is developed due to the development of information communication technology including the Internet, a method of teaching reading, writing, listening and speaking through the network (see Korean Patent Application No. 10-2001-0087880) This is widely used. In addition, with the development of voice recognition technology, interactive training between the server and the user has begun to be implemented, which is expected to accelerate. However, the foreign language education method using the network and the voice recognition server is a method of adding various processes in detail, but the unique use of the speech recognition engine having a remarkable effect in improving foreign language comprehension or original education The development of the method was poor.

Accordingly, the present inventors further understand and understand the meaning of the contents in depth through long-term interactive tests on the foreign language contents in order to improve the reading and listening ability to read or listen to the foreign language contents and to understand the meaning. In addition to training, foreign language learning services are provided through interactive dialogues on foreign language content using voice recognition engines, which allows students to find and answer questions on their own, and to speak and apply foreign language expressions in rapid successive answers. An attempt was made to develop a provisioning method.

The present invention has been proposed to solve the above problems of the conventionally proposed methods, and after providing the learning content, the service providing server provides the user terminal with a question composed of the subject language about the contents by voice and By adopting the configuration that receives the user's voice that has answered the answer sentence using the voice recognition engine, by taking a test method to perform the next step only after scoring a score for the user's voice and obtaining a certain score or more, By letting me remember the contents of learning and express the answer directly in words, I can concentrate on processing information of foreign language contents, grasp the meaning more directly and elaborately, and at the same time strengthen the memory of contents for a long time To maintain. As a result, a method of providing a learning service for improving foreign language understanding through interactive dialogue on foreign language content using a speech recognition engine, which enables multiple and in-depth information processing similar to the native language content without remaining in the superficial information processing for foreign language content. To provide that purpose.

In addition, the present invention provides the foreign language understanding learning service provided by the service providing server divided into a question-by-question test step and the entire question continuous test step, in the question-by-question test step, a part of the correct answer sentence of the question to the user terminal as a letter By including a hint providing step to transmit, increase the recall rate by subjective and active information processing in the process of finding an answer by itself, and expresses the same contents differently according to the way of question through a plurality of questions and hints. Another object of the present invention is to provide a method for providing a learning service for enhancing foreign language understanding through two-way conversation about foreign language content using a voice recognition engine, which can reinforce application ability of foreign language expression through practice.

In addition, the present invention, in the entire question continuous test step, the service providing server transmits the questions to the user terminal by voice in succession one by one, and at the same time by using the speech recognition engine from the user terminal to answer the corresponding sentences Adopting the configuration that receives the user's voice induces the user to speak the answer directly found without any delay at the end of each question. In addition, the voice recognition engine operates only for a predetermined time, and when the duration of silence exceeds the predetermined duration of silence, the operation of the voice recognition engine is stopped and the lowest grade score is implemented so that quick listening is possible. By repeating the process and answering them, it is possible to improve listening concentration and induce unconscious internalization that enables quick automatic withdrawal of foreign language expressions, so that they can respond quickly without hesitation even in actual foreign language conversation situations. Another object of the present invention is to provide a method of providing a learning service for improving foreign language understanding through interactive conversation about foreign language content using an engine.

In order to achieve the above object, a method of providing a foreign language understanding enhancement learning service through a two-way conversation about a foreign language content using a voice recognition engine according to a feature of the present invention includes a service providing server providing a foreign language understanding enhancement learning service,

(1) transmitting the learning content including a plurality of sentences composed of the learning target language to the user terminal;

(2) transmitting a question composed of a learning target language as a voice to the user terminal as the content of the learning content;

(3) recording and transmitting a user voice spoken by constructing an answer sentence to the question transmitted in the step (2) as a learning target language from the user terminal using a voice recognition engine;

(4) setting a score for the user voice received in step (3) and transmitting the score to the user terminal;

(5) performing the same process as step (2) to step (4) with respect to each of the other questions for which step (2) to step (4) has not been performed;

(6) The questions transmitted in steps (2) and (5) are transmitted to the user terminal in succession one by one, and at the same time, the questions transmitted by the user terminal using the voice recognition engine Recording and transmitting a user's voice uttering an answer sentence; And

(7) characterized in that it comprises the step of setting a score for the user voice received in the step (6) and transmitting it to the user terminal.

Preferably,

It may further include a hint providing step of transmitting a portion of the correct answer sentence of the question transmitted in the step (2) to the user terminal as a text.

More preferably, the correct answer sentence,

As stored in the service providing server, there may be a plurality, and when there are a plurality of correct answer sentences, there may be a plurality of hints provided in the step (3).

More preferably, the hint providing step,

It may be implemented to be performed only when a hint view is selected and input from the user terminal.

Preferably, the learning content transmitted to the user terminal in the step (1),

It can be implemented to be transmitted in voice, text, or voice and text.

Preferably,

The voice recognition engine operates only for a predetermined time,

When the duration of silence during the operation of the speech recognition engine exceeds a predetermined silent duration allowance, the operation of the speech recognition engine may be automatically stopped and the lowest grade score may be given.

Preferably, the score in step (7),

Each question is answered by sentence,

A score for the entirety of the continuously transmitted voice of the user and a score for each sentence answered for each question may be transmitted to the user terminal.

Preferably,

The next step may be performed only if the scores set in the above steps (4), (5) and (7) are each more than the predetermined score, and if the scores are less than the predetermined score, the previous step may be re-performed.

According to the present invention, there is provided a learning service providing method for improving foreign language understanding through two-way conversation about foreign language content using a speech recognition engine. Adopt a configuration that receives the user's voice as a voice to the user terminal and transmits the answer sentence using the voice recognition engine, and scores the user's voice and acquires a certain score or more to perform the next step. By taking a test method that allows users to memorize the learning content and express their answers in words, it helps them to concentrate on processing information of foreign language content and to grasp the meaning more directly and precisely. Jiangxi by strengthening the memory of the content And to maintain. As a result, it is possible to perform multiple and in-depth information processing similar to the native language contents without remaining in the superficial information processing for foreign language contents.

In addition, according to the present invention, while providing a foreign language comprehension learning service provided by the service providing server divided into a question-by-question test step and a whole question continuous test step, in the question-by-question test step, a part of the correct answer sentence of the question is written to the user terminal. Including the hint providing step to send to the user, by the subjective and active information processing in the process of finding the answer to increase the recall rate, and through the multiple questions and hints, depending on the way of question about the same content Through the practice of expression, you can strengthen the application of foreign language expression.

In addition, according to the present invention, in the entire question continuous test step, the service providing server transmits the questions to the user terminal one by one continuously by voice, and at the same time, the corresponding sentences are spoken using the voice recognition engine from the user terminal. It adopts a configuration that receives a user's voice and induces the user to speak the answer he found directly and quickly without delay as each question ends. In addition, the voice recognition engine operates only for a predetermined time, and when the duration of silence exceeds the predetermined duration of silence, the operation of the voice recognition engine is stopped and the lowest grade score is implemented so that quick listening is possible. By repeating and answering the questions, it is possible to improve listening concentration and to induce unconscious internalization that enables quick automatic withdrawal of foreign language expressions so that they can respond quickly without hesitation in actual foreign language conversation situations.

1 is a diagram illustrating a configuration of a system for implementing a method for providing a foreign language understanding enhancement learning service through two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention.
2 is a diagram illustrating an example of a learning content, a question and an answer sentence in a method of providing a foreign language comprehension learning service through a two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention.
FIG. 3 is a flowchart illustrating a method of providing a foreign language comprehension learning service through two-way conversation about foreign language content using a voice recognition engine according to an embodiment of the present invention. FIG.
4 is a flowchart illustrating a method of providing a foreign language understanding enhancement learning service through two-way conversation about a foreign language content using a voice recognition engine according to another embodiment of the present invention.
FIG. 5 is a diagram illustrating a screen of a learning page provided with a hint in a method for providing a foreign language comprehension learning service through a two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention.
FIG. 6 is a view showing experimental results for generating effects when only some clues are presented. FIG.
7 is a view showing the results of experiments learning the effect of the variety of feedback.
8 is a diagram illustrating a timeline setting example of a voice recognition engine in a method for providing a foreign language understanding enhancement learning service through two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention.
9 shows experimental results for the combined effect of information retrieval and fast response.
FIG. 10 shows the results of a 2006 testing effect experiment by Roediger and Karpicke. FIG.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. In the following detailed description of the preferred embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The same or similar reference numerals are used throughout the drawings for portions having similar functions and functions.

In addition, in the entire specification, when a part is referred to as being 'connected' to another part, it may be referred to as 'indirectly connected' not only with 'directly connected' . Also, to "include" an element means that it may include other elements, rather than excluding other elements, unless specifically stated otherwise.

1 is a diagram showing the configuration of a system for implementing a method for providing a foreign language understanding enhancement learning service through two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention. As shown in FIG. 1, a system for implementing a method for providing a foreign language comprehension learning service through a two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention includes a service providing server 100 and It may be configured to include a user terminal 200.

The service providing server 100 stores the learning content of the foreign language literacy learning service provided in accordance with the present invention, questions and answers related thereto, and transmits the learning content and the question to the user terminal 200. Responding to the foreign language content using the speech recognition engine provided in accordance with the present invention, such as recording and transmitting the user's voice uttered the answer sentence using the speech recognition engine, and the score for the transmission to the user terminal 200 Enhance foreign language comprehension through two-way dialogue. In the present invention, the learning content includes a plurality of sentences composed of the language to be studied, and may be an essay having one story, a part of a fairy tale, or the like. 2 is a diagram illustrating an example of a learning content, a question and an answer sentence in a method of providing a foreign language comprehension learning service through a two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention. As shown in FIG. 2, the learning content may be part of a fairy tale such as <The Happy Prince>, and the question about the question may be a question from various angles about the content of the learning content. You can also ask questions at different angles, such as “Who does the prince see on a bench?” And “What is the young man doing on a bench?” This allows users to learn how to apply expressions differently depending on their questions. The target language may be English, but is not limited thereto, and may be various foreign languages such as Japanese and Chinese.

The user terminal 200 is a terminal of a user who wants to learn a foreign language by using a foreign language understanding enhancement learning service through two-way conversation about a foreign language content using a speech recognition engine provided by the service providing server 100. After the user downloads and installs a program provided by the service providing server 100 in the user terminal 200, the user records and transmits a user voice through the user terminal 200, and transmits a text or a text message from the service providing server 100. Through a process such as receiving a voice or score, the foreign language comprehension learning service to be provided by the present invention may be provided. The service providing server 100 and the user terminal 200 can transmit and receive information through a network including the Internet, an intranet, a wired / wireless communication network, and a mobile communication network. In the present invention, the user terminal 200 may be a personal computer (PC), but it can be used regardless of the form of a specific terminal if it is an electronic device capable of networking with the service providing server 100 and capable of recording and image execution . However, since the speech recognition test engine must be used for the speech test, a microphone and a speaker (including a headphone) must be provided like the headset shown in FIG.

3 is a diagram illustrating a flow of a method for providing a foreign language comprehension learning service through two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention. As shown in FIG. 3, the method for providing a foreign language comprehension learning service through a two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention includes a plurality of sentences configured as a learning language. Transmitting the content to the user terminal 200 (S100), and transmitting the question composed of the learning target language as voice to the user terminal 200 as the content of the learning content (S200), the question transmitted in step S200. Receiving the user's voice uttered by constructing the answer sentence in the learning target language using the voice recognition engine from the user terminal 200 (S300), by setting a score for the user voice received in step S300 user terminal For each of the steps of transmitting to step (S400), and other questions that have not performed steps S200 to S400 in the user terminal 200, Question-specific test step including the step (S500) performing the same process as step S200 to step S400, and the questions transmitted in step S200 and step S500 one by one to the user terminal 200 in a continuous voice transmission, and At the same time, the user terminal 200 receives the user's voice, which transmits the answer sentences for the questions transmitted one by one using the voice recognition engine, and sets a score for the user's voice received in step S600. It may be implemented to include the entire question continuous test step including the step (S700) for transmitting to the terminal 200.

Step S100 is a step of transmitting the learning content including a plurality of sentences composed of the learning target language to the user terminal 200, the learning content may be transmitted by voice, text, or voice and text. Since the text transmission is effective for enhancing reading comprehension and the listening comprehension for transmitting voice, it may be provided differently according to the learning level or learning environment of the user.

The test step for each question (steps S200 to S500) is a step of transmitting a plurality of questions stored or generated by the service providing server 100 for each question and receiving an answer thereto, and immediately transmitting a score for the answer. It is a step to improve understanding of each question and focus on writing in the target language to form accurate answer sentences. According to an embodiment, the score for the answer to the pre-performed question may be implemented to move to the next question only when the score is equal to or greater than the predetermined score.

In step S200, the content of the learning content is transmitted to the user terminal 200 as a voice composed of the target language for learning, and step S300 is composed of the answer sentences for the question transmitted in the step S200 in the target language for speech. A user voice is recorded and transmitted from the user terminal 200 using a voice recognition engine. That is, a question about the content of the learning content transmitted in step S100 is transmitted to the user terminal 200 by voice, and the user memorizes the content of the learning content transmitted in step S100 and expresses the answer directly in words. It's a step. The user can improve listening comprehension or reading comprehension while listening or reading by concentrating the learning contents composed of the target language, and can test the comprehension through the steps S200 to S300, and adopting an interactive conversation method in which words are spoken directly. Improve general comprehension of foreign languages, including skills and speaking skills.

4 is a diagram illustrating a flow of a method for providing a foreign language comprehension learning service through two-way conversation about a foreign language content using a voice recognition engine according to another embodiment of the present invention. As illustrated in FIG. 4, in the method for providing a foreign language understanding enhancement learning service through a two-way conversation about a foreign language content using a voice recognition engine according to another embodiment of the present invention, a part of the correct answer sentence of the question transmitted in step S200 may be selected. It may further include a hint providing step (S310) for transmitting as a text to the user terminal 200. In this step, the user must write the answer to the question directly in the target language for the first time, and thus provide a little hint to reduce the burden on the user, make it easier to access, and prevent the learning time from extending indefinitely. Can be. If you provide all the correct answer sentence can not induce active writing of the user, only a part of the correct answer sentence is transmitted as a text. The correct answer sentences are stored in the service providing server 100, and may be plural, and when there are plural correct answer sentences, the hints provided in step S300 may also be plural. Since the answer to the question can be expressed in various sentences, it is possible to learn a variety of expressions for the same content by acknowledging a plurality of correct answers and providing a plurality of hints accordingly.

In addition, the hint providing step S310 may be implemented to be performed only when a hint view is selected by the user terminal 200 in step S300. FIG. 5 is a diagram illustrating a screen of a learning page provided with a hint in a method for providing a foreign language comprehension learning service through a two-way conversation about a foreign language content using a voice recognition engine according to an embodiment of the present invention. As shown in FIG. 5, when the service providing server 100 receives an input of the “HINT” button from the user terminal 200, “the statue of the ....... had .. ..... in his ....... ”may be transmitted to the user terminal 200.

6 is a diagram illustrating an experiment result for generating effects when only some clues are presented. As shown in FIG. 6, when the correct answer is directly provided to the question (a group that immediately presents the answer), the learning effects of comparing the learning effects of providing only some clues and finding the answer by themselves (some of the clues presented only) As a result, in the recall rate after a few days, it was confirmed that the group presented only a few clues showed a significantly higher recall rate than the group presenting the answer immediately. This effect can be called the 'production effect', similar to the one demonstrated by the theory of production effect by cognitive psychologist De Winstanley (1995). The Theory of Creation Effect did not give the answer to the memory of the university student experimenters, but rather gave a few clues to give the right answer. It was proved by the result of the experiment that the record of remarkably high recall was recorded. The present inventors have applied such generation effect theory to foreign language comprehension learning to develop a method of providing a learning service which is very effective as compared to the existing method.

In step S400, a score is set for the user voice received in step S300 and transmitted to the user terminal 200. Since the present invention adopts a test method in which the question is asked in step S200 and the answer in step S300 is recorded and transmitted using a voice recognition engine, a detailed score can be provided for the performed test. According to an embodiment, the score may be set for each word of the performed answer sentence and displayed as an alphabet (eg, B +) and a graph. That is, the total score (sentence score) for the corresponding answer sentence and the score set for each word constituting the corresponding answer sentence may be displayed in alphabet and graph. In addition, it can be applied as a number, or as a graph according to various systems. 7 is a diagram illustrating the results of experiments of learning effects on the diversity of feedback. As shown in FIG. 7, the inventors confirm that the spontaneous execution time is higher when there are seven types of feedback, compared to the case where there is no feedback or only two types of feedback such as success / failure. Could. Therefore, in the present invention, by providing a variety of precise feedback sequentially such as providing a step-by-step feedback (scoring and transmission), pronunciation or expression accuracy (word selection) for each word or phoneme, such as graphs to enhance the learning effect It was configured to.

Step S500 is a step of performing the same process as steps S200 to S400 for each of other questions that have not been performed to steps S200 to S400. That is, the service providing server 100 may store or generate a plurality of questions. After performing steps S200 to S400 for one question, the service providing server 100 may perform steps S200 to S400 for the remaining questions in the same manner. Can be.

When the question-specific test steps S200 to S400 are completed for all questions stored or generated by the service providing server 100, the entire question continuous test steps S600 to S700 may be performed. The entire question continuous test step means that the questions transmitted in steps S200 and S500, that is, all the questions stored or generated by the service providing server 100 are successively transmitted to the user terminal 200 by voice one by one, and At the same time, by recording and receiving the user's voice uttering the answer sentences for the questions transmitted one by one using the voice recognition engine from the user terminal 200 (S600) and by setting the score for the user voice received in step S600 Through the step (S700) of transmitting to the user terminal 200 can take the form of a two-way conversation between the service providing server 100 and the user terminal 200 continuously. All questions In the continuous test phase, the point is that a plurality of questions and answers are performed in rapid succession. In other words, the voice is simultaneously transmitted between the service providing server 100 and the user terminal 200 in such a manner that the user speaks the answer sentence as soon as the user recognizes the question and recognizes the next question as soon as the user speaks. By adopting such a configuration, the user may perform a test through two-way conversation, increase concentration through a quick and continuous answering process, and induce an unconscious internalization that allows a foreign language expression to be automatically drawn out quickly.

On the other hand, Figure 8 is a view showing a timeline setting example of the speech recognition engine in the method for providing a foreign language understanding enhancement learning service through the two-way dialogue about the foreign language content using the speech recognition engine according to an embodiment of the present invention. As shown in FIG. 8, according to an embodiment of the present invention, the voice recognition engine used in steps S300, S500, and S600 may set a timeline in its operation. The operating time of the voice recognition engine, the vocalization time, the silent duration allowance before utterance, the silent duration allowance after the utterance can be set and reflected in the scoring. According to the embodiment, when the duration of silence during the operation of the voice recognition engine exceeds the set duration of silence, the operation of the voice recognition engine is automatically stopped, and the score of the lowest grade for the corresponding answer is answered. It can also be implemented to be granted. In other words, after a certain period of time without the user's utterance, the voice recognition engine stops automatically, moves to the next question, or allows the user to perform the test again from the beginning to further increase tension and increase concentration. . In addition, since the user has to perform speaking rapidly, the user (learner) can quickly analyze the character or voice information made in the native language and train the user to convert it into a corresponding foreign language sentence.

9 is a diagram showing the results of experiments on the combined effect of information retrieval and fast response. The present inventors carried out experiments in which subjects were presented with 10 foreigner face photographs and names of foreign languages for each photograph to memorize the effect of quick reaction when fetching information from the human brain. Subjects in Group A were repeatedly instructed to show their names after one second, and group B repeated the training to tell the name seven seconds after the picture appeared. At this time, the number of training repetitions in both groups was the same. As a result, as shown in Figure 9, in the test after a week, group A showed an overwhelmingly high recall rate and a fast reaction rate. In other words, it was confirmed that, in the retrieval of memorized information, as in the present invention, the speedy speaking training exhibits a remarkably high learning effect. This can be particularly useful in the overall question sequential test step for a plurality of sentences described above.

The scoring and transmitting step of step S700 may be performed similarly to that described above with respect to step S400. However, in this step, unlike step S400, the score is set for a plurality of answer sentences, and the overall score may be scored for the entire voice, but the score is set for each answer sentence for each question and added up. Adopt a method to derive a score. In this way, more detailed scoring and padding are possible, and later only the wrong answer sentences can be reviewed separately. Even when the score is transmitted to the user terminal 200, only the total score obtained by summing the scores for the plurality of answer sentences may be transmitted. According to an exemplary embodiment, the score for each answer sentence may be separately transmitted.

In addition, according to one embodiment of the present invention, as shown in FIG. 4, the next step is performed only when the scores set in steps S400, S500, and S700 are each a predetermined score or more, and when the score is less than a predetermined score, the previous step is performed. You can implement the steps to be rerun. Implementing the transition to the next level after complete learning of one level can lead to systematic learning, encourages learning motivation, and enhances learning immersion.

As described above with respect to each step, the present invention uses a 'test' as a process for improving foreign language comprehension, and the high learning effect of the test has been proved by a 2006 experiment by cognitive psychologists Roediger and Karpicke. This is referred to as a testing effect. FIG. 10 shows the results of a 2006 testing effect experiment by Roediger and Karpicke. As shown in FIG. 10, a word recall test score was compared a week after the group tested 4 times and the group tested 3 times after the first exercise in performing the same task. Demonstrated superior learning outcomes. In other words, practice with the best effect proved to be a test. The present invention is designed using a testing effect that maximizes the learning effect in foreign language learning. The test method is then applied equally to the whole question series of test steps.

Meanwhile, by further including a step of receiving member information from the user before the step S100 and receiving membership, the user can perform learning by level, and progress management, score management, and the like can be facilitated.

The present invention may be embodied in many other specific forms without departing from the spirit or essential characteristics of the invention.

100: service providing server 200: user terminal
S100: step of transmitting the learning content including a plurality of sentences consisting of the learning target language to the user terminal
S200: transmitting a voice to the user terminal a question composed of a learning target language as the content of the learning content
S300: recording and transmitting a user's voice generated by using a speech recognition engine from the user terminal by constituting an answer sentence for the question transmitted in step S200 as a learning target language.
S310: a hint providing step of transmitting a portion of the correct answer sentence of the question transmitted in the step S200 to the user terminal as a text when the hint view is selected and input from the user terminal;
S400: setting a score for the user voice received in step S300 and transmitting the score to the user terminal
S500: performing the same process as that of the steps S200 to S400 for each of other questions that have not been performed the steps S200 to S400
S600: Voices the questions transmitted in steps S200 and S500 to the user terminal continuously one by one, and at the same time, generates an answer sentence for the questions transmitted one by one using a voice recognition engine from the user terminal. Step of recording and transmitting one user's voice
S700: setting a score for the user voice received in step S600 and transmitting the score to the user terminal

Claims (8)

A service providing server that provides foreign language comprehension learning services,
(1) transmitting the learning content including a plurality of sentences composed of the learning target language to the user terminal;
(2) transmitting a question composed of a learning target language as a voice to the user terminal as the content of the learning content;
(3) recording and transmitting a user voice spoken by constructing an answer sentence to the question transmitted in the step (2) as a learning target language from the user terminal using a voice recognition engine;
(4) setting a score for the user voice received in step (3) and transmitting the score to the user terminal;
(5) performing the same process as step (2) to step (4) with respect to each of the other questions for which step (2) to step (4) has not been performed;
(6) The questions transmitted in steps (2) and (5) are transmitted to the user terminal in succession one by one, and at the same time, the questions transmitted by the user terminal using the voice recognition engine Recording and transmitting a user's voice uttering an answer sentence; And
(7) enhancing the foreign language comprehension through two-way conversation on foreign language content using a voice recognition engine, comprising: setting a score for the user voice received in step (6) and transmitting the score to the user terminal How to Provide Learning Services.
2. The method of claim 1, wherein step (3)
Further comprising the step of providing a hint for transmitting a portion of the correct answer sentence of the question transmitted in the step (2) to the user terminal, the foreign language comprehension through two-way conversation about the foreign language content using the speech recognition engine How to Provide Enhanced Learning Services.
The method of claim 2, wherein the correct answer sentence,
Stored in the service providing server, there may be a plurality of, if there are a plurality of correct answer sentences, characterized in that there are a plurality of hints provided in the step (3), bidirectional with respect to foreign language content using a speech recognition engine How to provide language learning service through conversation.
The method of claim 2, wherein the hint providing step,
Method for providing a foreign language understanding learning service through a two-way dialogue about the foreign language content using a speech recognition engine, characterized in that is performed only when receiving a hint view input from the user terminal.
The method of claim 1,
Learning content transmitted to the user terminal in the step (1), the voice, text, or language, characterized in that the language and text, the foreign language understanding enhancement learning service through the two-way conversation about the foreign language content using the speech recognition engine How to Provide.
The method of claim 1,
The voice recognition engine operates only for a predetermined time,
When the duration of silence during the operation of the voice recognition engine exceeds a predetermined silent duration allowance time, the operation of the voice recognition engine is automatically stopped, characterized in that the lowest grade is given a score, A method of providing a learning service to enhance foreign language understanding through interactive dialogue on foreign language content using a recognition engine.
The method of claim 1, wherein in step (7),
Each question is answered by sentence,
Enhance foreign language comprehension through two-way conversation about foreign language content using a voice recognition engine, wherein the scores for the entirety of the consecutively transmitted user voices and the scores for each sentence of an answer to each question are transmitted to the user terminal. How to Provide Learning Services.
The method of claim 1,
The next step is performed only when the scores set in the steps (4), (5) and step (7) are each more than or equal to the predetermined score, and if the score is less than the predetermined score, the previous step is performed again. Method of providing learning service to enhance foreign language understanding through two-way conversation about foreign language content using speech recognition engine.
KR1020120072542A 2012-07-03 2012-07-03 Method for providing learning language service based on interactive dialogue using speech recognition engine KR20140004539A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120072542A KR20140004539A (en) 2012-07-03 2012-07-03 Method for providing learning language service based on interactive dialogue using speech recognition engine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120072542A KR20140004539A (en) 2012-07-03 2012-07-03 Method for providing learning language service based on interactive dialogue using speech recognition engine

Publications (1)

Publication Number Publication Date
KR20140004539A true KR20140004539A (en) 2014-01-13

Family

ID=50140512

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120072542A KR20140004539A (en) 2012-07-03 2012-07-03 Method for providing learning language service based on interactive dialogue using speech recognition engine

Country Status (1)

Country Link
KR (1) KR20140004539A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180129166A (en) * 2017-05-25 2018-12-05 주식회사 스터디맥스 Learning system and method using voice input of the learner
KR20200104206A (en) * 2019-08-07 2020-09-03 이용갑 Learning device for improving concentration

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180129166A (en) * 2017-05-25 2018-12-05 주식회사 스터디맥스 Learning system and method using voice input of the learner
KR20200104206A (en) * 2019-08-07 2020-09-03 이용갑 Learning device for improving concentration

Similar Documents

Publication Publication Date Title
Baker Exploring teachers' knowledge of second language pronunciation techniques: Teacher cognitions, observed classroom practices, and student perceptions
Li et al. Effective approaches to teaching listening: Chinese EFL teachers’ perspectives
CN110489756B (en) Conversational human-computer interactive spoken language evaluation system
US20100304342A1 (en) Interactive Language Education System and Method
Michael Automated Speech Recognition in language learning: Potential models, benefits and impact
KR101438087B1 (en) Method for providing language training service based on consecutive and simultaneous interpretation test using speech recognition engine
McCrocklin Learners’ feedback regarding ASR-based dictation practice for pronunciation learning
JP2018180299A (en) Word learning training system
KR20220011109A (en) Digital english learning service method and system
KR20140004539A (en) Method for providing learning language service based on interactive dialogue using speech recognition engine
KR20140004538A (en) Method for providing learning language service based on speaking test using speech recognition engine and subtitles&#39;s sequential abridgment
Sura ESP listening comprehension for IT-students as a language skill
KR20020068835A (en) System and method for learnning foreign language using network
JP6656529B2 (en) Foreign language conversation training system
Ross et al. Speaking with your computer: A new way to practice and analyze conversation
Shivakumar et al. AI-ENABLED LANGUAGE SPEAKING COACHING FOR DUAL LANGUAGE LEARNERS.
May et al. Bottom-Up, Top-Down, and Interactive Processing in Listening Comprehension
KR20140004540A (en) Method for providing foreign language listening training service based on listening and speaking using speech recognition engine
KR20140004537A (en) Method for providing learning language service based on accumulation test and speaking test using speech recognition engine
Shukla Development of a Human-AI Teaming Based Mobile Language Learning Solution for Dual Language Learners in Early and Special Educations
Bilianska The Pedagogical Sequence for Audiobook Listening Instruction ofUkrainian Pre-service Teachers
Shukla et al. iLeap: A Human-Ai Teaming Based Mobile Language Learning Solution for Dual Language Learners in Early and Special Educations.
dan Diksus THE USE OF MOBILE ASSISTED LANGUAGE LEARNING (MALL) IN TEACHING STUDENTS’LISTENING AND SPEAKING SKILLS
Hora The Efficacy of Silent Shadowing of Audiobooks on Japanese Second Language Acquisition
Huh Teaching World Englishes in an Interpreter Training Course: an Action Research: an Action Research

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application