KR20140004538A - Method for providing learning language service based on speaking test using speech recognition engine and subtitles's sequential abridgment - Google Patents

Method for providing learning language service based on speaking test using speech recognition engine and subtitles's sequential abridgment Download PDF

Info

Publication number
KR20140004538A
KR20140004538A KR1020120072540A KR20120072540A KR20140004538A KR 20140004538 A KR20140004538 A KR 20140004538A KR 1020120072540 A KR1020120072540 A KR 1020120072540A KR 20120072540 A KR20120072540 A KR 20120072540A KR 20140004538 A KR20140004538 A KR 20140004538A
Authority
KR
South Korea
Prior art keywords
character
voice
user terminal
dialogue
transmitting
Prior art date
Application number
KR1020120072540A
Other languages
Korean (ko)
Inventor
전은경
김종기
문미정
원철희
윤성희
김경숙
이진영
권요성
윤산정
Original Assignee
(주)아이티씨교육
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)아이티씨교육 filed Critical (주)아이티씨교육
Priority to KR1020120072540A priority Critical patent/KR20140004538A/en
Publication of KR20140004538A publication Critical patent/KR20140004538A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G06Q50/205—Education administration or guidance
    • G06Q50/2053—Education institution selection, admissions, or financial aid
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G06Q50/205—Education administration or guidance
    • G06Q50/2057—Career enhancement or continuing education service
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition

Abstract

The present invention relates to a foreign language role playing study service. According to the method for providing the foreign language role playing study service by successively omitting character information and a speaking test using a voice recognition engine suggested in the present invention, a learner is trained to obtain the internalization of a foreign language dialogue pattern and to quickly deal with an actual dialogue situation.

Description

METHOOD FOR PROVIDING LEARNING LANGUAGE SERVICE BASED ON SPEAKING TEST USING SPEECH RECOGNITION ENGINE AND SUBTITLES'S SEQUENTIAL ABRIDGMENT}

The present invention relates to a method for providing a foreign language role-playing learning service, and more particularly, to a method for providing a foreign language role-playing learning service through sequential omission of a speaking test and text information using a speech recognition engine.

In recent years, with the rapid progress of globalization, the importance of the ability to communicate through English as a practical universal language has become very important. In particular, with the development of IT technology, global communication has become very active beyond the barriers between nations, and since a lot of information, knowledge and culture of the world are provided in English, many people communicate with the world through English. You want to have direct access to a variety of information or knowledge. Unlike in the past, for many people, foreign languages, including English, are becoming a practical living tool. The ability to communicate in English allows you to exchange information about your interests with people around the world, to communicate your message to the world, and to make a better world with you. It also gives you the opportunity to do so. Therefore, many people spare no effort to gain communication skills through English.

In spite of this situation, when we look at the current state of English learning in Korea, due to the wrong English education policy, it shows the lowest rank in the world in speaking English, and the actual English learning is selected by individual learners rather than through formal education. Private education takes up a great deal of weight so that it can be considered as a separate learning process. For example, they may take a lecture by a native speaker, practice pre-talking, or learn English conversation books or video lectures. However, there is a merit that direct communication is possible when learning with the help of a native speaker, but there are disadvantages in that the burden on the cost is large and the difference in learning performance is large depending on the quality of the native speaker. In addition, books and video lectures, if used in a unilateral and passive manner, is understood as a head, but there is a problem that the course of practice is not guaranteed enough to use English through the mouth and ears.

Meanwhile, with the development of information and communication technologies including the Internet, foreign language education methods have been developed through distance education, and with the development of voice recognition technology, Internet foreign language education with feedback is also being implemented, which is expected to accelerate. However, the current language service using the voice recognition technology is most of the degree of simply receiving and evaluating the voice data, and a method of adding various processes in detail has been attempted (see Patent Application No. 10-2001-0071633). ), The development of an original method having a remarkable effect on the method of providing a foreign language learning service was insufficient.

Accordingly, the present inventors, as the most effective process of learning communication through foreign languages, utilizes the speaking test method using voice recognition technology, and performs role-playing learning that plays the role of a character in a realistic dialogue situation implemented by animation. Through this, we develop a method of providing foreign language learning that allows us to speak directly and repeatedly, and internalize foreign language conversation patterns while talking to the other person quickly, so that they can respond quickly and fluently without hesitation even when faced with the actual situation of having to speak foreign languages. Was intended.

The present invention has been proposed to solve the above problems of the conventionally proposed methods, the dialogue of one character in the daily conversation of the first character and the second character composed of the learning target language stored in the service providing server is a service By providing the role-playing learning format through the providing server, which transmits the dialogue of the other character to the user terminal and receives the dialogue of the other character from the user terminal using the voice recognition engine, the user can communicate in two-way communication in a realistic situation. The internalization of expressions can be made more robust while experiencing the subtle feelings of foreign language conversation through various empathy for dialogue situations, which facilitates the recall of foreign language expressions when similar emotions are reproduced in real situations. Speaking frame using voice recognition engine It is an object of the present invention to provide a method for providing a foreign language role-playing learning service through sequential omission of text and character information.

In addition, the present invention, while the service providing server transmits the dialogue of each character to the user terminal as a letter, by adopting a configuration that sequentially omits the text information consisting of the language and the language of the learning language, the user repeats the dialogue Providing foreign language role-playing learning services through sequential omission of speaking test and text information using voice recognition engine to practice, naturally memorize COLLOQUIALISM and unconsciously internalize foreign language conversation patterns It is another object to provide a method.

In addition, the present invention, if the service providing server based on the test technique using the speech recognition technology to quickly set the progress of the dialogue between the characters, the duration of the silence exceeds the predetermined silent duration allowable time or It is designed to move to the next line immediately after a low score is set due to inability to speak correctly and to retest if the total score is below a certain level after the test of the entire line is completed. Withdrawal of fast foreign language conversations in conversation situations is repeated, so that you can achieve internalization of foreign language conversation patterns and respond quickly in real conversation situations. Providing services Serves another purpose.

In order to achieve the above object, a method of providing a foreign language role-playing learning service through a sequential omission of a speaking test and text information using a speech recognition engine according to a feature of the present invention includes a service providing server that provides a foreign language role-playing learning service. ,

(1) transmitting the words of the first character and the second character composed of a learning target language and a mother tongue meaning stored in the service providing server to a user terminal as a text, and transmitting the words of the second character by voice; Receiving and recording a user voice corresponding to the first character's speech from the user terminal using a voice recognition engine;

(2) setting a score for the user voice that spoke the first character received in step (1) and transmitting the score to the user terminal;

(3) transmitting, to the user terminal, a dialogue of the first character composed of a native language meaning, a dialogue of a target language, a native language meaning, or a dialogue of the second character consisting of a target language and a native language meaning, as a text; Transmitting a voice of a character to a voice, and recording and transmitting a user voice of the voice of the first character corresponding to the voice using a voice recognition engine from the user terminal;

(4) setting a score for the user voice that spoke the first character received in step (3) and transmitting the score to the user terminal;

(5) transmitting a dialogue of the second character composed of a learning language, a native language meaning, or a learning language and a native language meaning to the user terminal by text, and transmitting the dialogue of the second character by voice and correspondingly; Recording and transmitting a user voice in which the first character is spoken using a voice recognition engine from the user terminal;

(6) setting a score for the user voice that spoke the first character transmitted in step (5) and transmitting the score to the user terminal;

(7) Instead of transmitting the words of the first and second characters as texts to the user terminal, the words of the second characters are transmitted by voice, and the user voices that have spoken the words of the first characters corresponding thereto are transmitted. Receiving and recording from the user terminal using a voice recognition engine; And

(8) characterized in that it comprises the step of setting a score for the user voice that spoke the first character received in step (7) and transmits it to the user terminal.

In addition, a method for providing a foreign language role-playing learning service through a sequential omission of a speaking test and text information using a speech recognition engine according to a feature of the present invention for achieving the above object, provides a service for providing a foreign language role-playing learning service The server,

(1) transmitting the words of the first character and the second character composed of a learning target language and a mother tongue meaning stored in the service providing server to a user terminal as a text, and transmitting the words of the second character by voice; Receiving and recording a user voice corresponding to the first character's speech from the user terminal using a voice recognition engine;

(1-1) transmitting, to the user terminal, a dialogue of the first and second characters composed of a learning language and a mother tongue meaning as a text, and transmitting the dialogue of the first character by voice and correspondingly; Recording and transmitting a user's voice, which has spoken two characters, from the user terminal using a voice recognition engine;

(2) setting a score for the user voice received in steps (1) and (1-1) and transmitting the score to the user terminal;

(3) transmitting, to the user terminal, a dialogue of the first character composed of a native language meaning and a dialogue of the second character composed of a learning language and a native language meaning as a text, and transmitting the dialogue of the second character by voice; Recording and transmitting a user voice corresponding to the first character of the first character using a voice recognition engine from the user terminal;

(3-1) a dialogue of the second character composed of a native language meaning and a dialogue of the first character composed of a learning language and a native language meaning is transmitted to the user terminal as a text, and the dialogue of the first character is spoken to the user terminal; Transmitting and recording and transmitting a user's voice that has spoken the second character corresponding thereto from a voice recognition engine from the user terminal;

(4) setting a score for the user voice received in steps (3) and (3-1) and transmitting the score to the user terminal;

(5) a user voice that transmits a dialogue of the second character composed of a learning target language as a text to the user terminal, transmits the dialogue of the second character by voice, and speaks the dialogue of the first character corresponding thereto; Receiving and recording from the user terminal using a voice recognition engine;

(5-1) transmitting the dialogue of the first character composed of a learning target language as a text to the user terminal, transmitting the dialogue of the first character by voice, and uttering the dialogue of the second character corresponding thereto. Receiving and recording a user voice from the user terminal using a voice recognition engine;

(6) setting a score for the user voice received in steps (5) and (5-1) and transmitting the score to the user terminal;

(7) Instead of transmitting the words of the first and second characters as texts to the user terminal, the words of the second characters are transmitted by voice, and the user voices that have spoken the words of the first characters corresponding thereto are transmitted. Receiving and recording from the user terminal using a voice recognition engine;

(7-1) A user who does not transmit the dialogue of the first character and the second character to the user terminal as a text but transmits the dialogue of the first character by voice and speaks the dialogue of the second character corresponding thereto. Receiving and recording a voice from the user terminal using a voice recognition engine; And

(8) Another aspect of the present invention includes the step of setting a score for the user voice received in the steps (7) and (7-1) and transmitting the score to the user terminal.

Preferably, in step (2), step (4), step (6) and step (8),

The score transmitted to the user terminal may be a score obtained by adding up a score for the user's voice that spoke the first character and a score for the user's voice that spoke the second character.

Preferably,

The next step is performed only when the scores set in the above steps (2), (4), (6) and (8) are each more than the predetermined score, and if the score is less than the predetermined score, the previous step is performed again. Can be implemented.

Preferably,

The score set in each step is any one selected from the group including a total score for the speech spoken in each step and a score set for each word or phoneme constituting the dialogue including numbers, alphabets, and graphs. It may be displayed as above.

Preferably,

The voice recognition engine operates only for a predetermined time,

When the duration of silence during the operation of the speech recognition engine exceeds a predetermined silent duration allowance, the operation of the speech recognition engine may be automatically stopped and the lowest grade score may be given.

Preferably,

When there are a plurality of dialogues of the first character or the second character,

In step (1), step (3), step (5) and step (7), the voice transmission of the character dialogue between the service providing server and the user terminal is continuous for all the dialogues until the dialogue of the characters is completed. Performed with

The score transmitted to the user terminal may be implemented to be set for each line.

Preferably,

When there are a plurality of dialogues of the first character or the second character,

After the steps (1) to (8) are performed for the first metabolism, the steps (1) to (8) are performed for the first metabolism and the second metabolism, and for the remaining metabolisms, The metabolisms carried out in the accumulation may be accumulated so that the steps (1) to (8) are performed.

Preferably,

When there are a plurality of dialogues of the first character or the second character,

Only for the dialogues whose scores set in step (8) are less than the predetermined scores, the dialogues of the first or second characters corresponding thereto are transmitted to the user terminal, and the first or the second speeches are corresponding to each of the transmitted dialogues. The method may further include a retesting step of recording and transmitting the user voice in which the two characters are spoken by the voice recognition engine from the user terminal.

According to a method for providing a foreign language role-playing learning service through a speech test using a speech recognition engine and sequential omission of text information proposed by the present invention, a first character and a second language configured as a learning target language stored by a service provision server are provided. In the daily conversation of characters, the dialogue of one character is transmitted to the user terminal by the service providing server, and the user adopts a role-playing learning format through actual speech that receives the dialogue of the other character from the user terminal using a voice recognition engine. You can communicate in two-way communication in real life situations, and experience the subtle feelings of foreign language conversation by introducing various emotions into the conversational situation, making the internalization of expression more robust. When reproduced, the foreign language in question Recalling expressions can be facilitated.

In addition, according to the present invention, the service providing server transmits the dialogue of each character to the user terminal as a character, but adopts a configuration that sequentially omits the text information consisting of the language and the language of the learning language, the user repeats the dialogue To facilitate memorization of COLLOQUIALISM naturally and to unconsciously internalize foreign language conversation patterns.

In addition, according to the present invention, even if the service providing server sets the speed of the dialogue between the characters faster, the duration of the silence exceeds the predetermined silent duration allowable time or a low score due to the lack of correct speech It is designed to go on to the next line and speak continuously, and to retest if the sum score is below a certain level after the test of the entire line is completed. Repeatedly, the internalization of foreign language conversation patterns can be achieved and trained to respond quickly in real conversation situations.

1 is a diagram showing the configuration of a system for implementing a method for providing a foreign language role-playing learning service through a sequential omission of a speaking test and text information using a speech recognition engine according to an embodiment of the present invention.
2 and 3 are flow charts illustrating a method of providing a foreign language role-playing learning service through sequential omission of a speaking test and text information using a voice recognition engine according to an embodiment of the present invention.
4 is a diagram illustrating a screen of a learning page in which a method for providing a foreign language role-playing learning service through sequential omission of a speaking test and text information using a voice recognition engine according to an embodiment of the present invention is shown.
FIG. 5 shows the results of a 2006 testing effect experiment between Roediger and Karpicke. FIG.
6 is a score for each word or phoneme is scored for the recorded voice in the method for providing a foreign language role-playing learning service through the sequential omission of the speaking test and text information using the speech recognition engine according to an embodiment of the present invention Figure showing that.
7 is a view showing the results of experiments learning the effect of the variety of feedback.
8 is a diagram illustrating an example of setting a timeline of a speech recognition engine in a method for providing a foreign language role-playing learning service through a sequential omission of a speaking test and text information using the speech recognition engine according to an embodiment of the present invention.
9 shows experimental results for the combined effect of information retrieval and fast response.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. In the following detailed description of the preferred embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The same or similar reference numerals are used throughout the drawings for portions having similar functions and functions.

In addition, in the entire specification, when a part is referred to as being 'connected' to another part, it may be referred to as 'indirectly connected' not only with 'directly connected' . Also, to "include" an element means that it may include other elements, rather than excluding other elements, unless specifically stated otherwise.

1 is a diagram illustrating a configuration of a system for implementing a method for providing a foreign language role-playing learning service through a sequential omission of a speaking test and text information using a speech recognition engine according to an embodiment of the present invention. As illustrated in FIG. 1, a system for implementing a method for providing a foreign language role-playing learning service through a sequential omission of a speaking test and text information using a speech recognition engine according to an embodiment of the present invention includes a service providing server ( 100) and the user terminal 200 may be configured.

The service providing server 100 stores the learning content of the foreign language role-playing learning service provided according to the present invention, and transmits a dialogue to the user terminal 200 by using the stored learning content and transmits a user voice corresponding thereto. Received and transmitted using the voice recognition engine, the score is set to the transmission to the user terminal 200, such as speaking test using the voice recognition engine provided according to the present invention and the foreign language roll through the sequential omission of the text information A series of playing learning services can be performed. In the present invention, the learning content refers to a dialog in which a plurality of characters communicate, and may be composed of a learning target language and a native language meaning thereof. The learning target language may be English, but it is not limited to this, and may be a variety of foreign languages such as Japanese and Chinese.

The user terminal 200 is a terminal of a user who wants to learn a foreign language using a language test using a speech recognition engine provided by the service providing server 100 and a foreign language role-playing learning service through sequential omission of text information. After the user downloads and installs a program provided by the service providing server 100 in the user terminal 200, the user records and transmits a user voice through the user terminal 200, and receives the voice or the voice from the service providing server 100. The foreign language role-playing learning service to be provided by the present invention may be provided through a process such as receiving a score. The service providing server 100 and the user terminal 200 can transmit and receive information through a network including the Internet, an intranet, a wired / wireless communication network, and a mobile communication network. In the present invention, the user terminal 200 may be a personal computer (PC), but it can be used regardless of the form of a specific terminal if it is an electronic device capable of networking with the service providing server 100 and capable of recording and image execution . However, since the speaking test should be performed using the voice recognition engine, the microphone and the speaker (including the headphones) should be provided as in the headset shown in FIG. 1.

2 and 3 are flowcharts illustrating a method of providing a foreign language role-playing learning service through sequential omission of a speaking test and text information using a voice recognition engine according to an embodiment of the present invention. 2 and 3, a method for providing a foreign language role-playing learning service through sequential omission of a speaking test and text information using a speech recognition engine according to an embodiment of the present invention is provided in the user terminal 200. The service providing server 100 transmits the dialogue of the first character and the second character stored as a text, transmits the dialogue of the second character by voice, and transmits the user voice that spoke the dialogue of the first character corresponding thereto. Recording and transmission using the voice recognition engine from the user terminal 200, according to the method of setting a score for the received user voice to transmit to the user terminal 200, the first time (steps S100 to S200) Provide both the character of the user and the dialogue of the opponent character in the language of the learning target language and the mother tongue, and upon the second execution (steps S300 to S400) The dialogue of the character is the native language character, the dialogue of the opponent character is provided in the target language, the mother tongue meaning, or the target language and the native language characters, and at the third time (steps S500 to S600), the character of the character entrusted by the user is a character. Rather than providing, the relative character dialogue is provided in the target language, the mother tongue meaning, or the target language character, and when the fourth performance (steps S700 to S800) does not provide the dialogue as a character, the sequential omission of the character information It may be implemented in a manner. By omitting the character information in this way, the user can repeatedly practice the dialogue, memorize the foreign language conversation naturally, and reach the stage of unconsciously internalizing the foreign language conversation pattern. In addition, according to the embodiment, by further comprising the steps of S110, S310, S510 and S710 of Figures 2 and 3, it can be implemented so that the user can practice both the first character and the dialogue of the second character, respectively. .

4 is a diagram illustrating a screen of a learning page in which a method for providing a foreign language role-playing learning service through sequential omission of a speaking test and text information using a voice recognition engine according to an embodiment of the present invention is performed. Hereinafter, each step will be described in detail through the learning page screen shown in FIG. 4.

Step S100 to step S200 is a step of first learning the dialogue to be learned, as shown in the first learning screen of FIG. 4, in which the service providing server 100 is stored in the user terminal 200. The user terminal 200 transmits a dialogue of a first character and a second character composed of a language and a native language as a text, transmits a dialogue of a second character to a voice, and utters a dialogue of a first character corresponding thereto. Step S100 of recording and transmitting using a voice recognition engine (S100) and setting a score for the user's voice uttering the first character received in step S100 and transmitting the score to the user terminal 200 (S200). It may be implemented to include. That is, in this step, the user learns both the first character (boy character of FIG. 4) spoken and the dialogue of the second character (girl character of FIG. 4) provided by the service providing server 100. A character (subtitle) composed of a target language (eg, English) and its native language meaning (eg, Korean) may be transmitted to the user terminal 200 to be displayed on the learning screen. In the first learning phase, the user learns the correct pronunciation and expression while reading and displaying the dialogue to speak.

Steps S300 to S400 are steps for learning the dialogue to be learned for the second time, as shown in the second learning screen of FIG. 4, and dialogue of the first character composed of a mother tongue meaning in the user terminal 200 and a language to be studied. And a user voice that transmits a dialogue of the second character composed of a native language as a text, a dialogue of the second character by voice, and a user voice that speaks a dialogue of the first character corresponding thereto from the user terminal 200. It is implemented to include the step of recording and transmitting using (S300) and the step of setting the score for the user voice that spoke the first character received in step S300 and transmitting to the user terminal 200 (S400) Can be. That is, in this step, the dialogue of the second character that the service providing server 100 provides voice is transmitted in both the language to be learned and its native language meaning, but the dialogue of the first character spoken by the user is transmitted only in the native language meaning. Thus, the user can be written while memorizing the contents learned through the steps S100 to S200. In this second learning phase, the user is trained to see the native language meaning and to quickly translate it into the corresponding target language. On the other hand, the dialogue of the second character transmitted by the service providing server 100 by voice, as shown in Figure 4, may be configured and transmitted in the language of the target language and the mother tongue, but is not limited to this, the learning level of the user Alternatively, depending on the process, it may be applied in a manner of transmitting only the target language or transmitting only the native language meaning.

Steps S500 to S600 are the third step of learning the dialogue to be learned, as shown in the third learning screen of FIG. 4, and transmitting the dialogue of the second character composed of the learning target language to the user terminal 200 as a text. And transmitting the dialogue of the second character as a voice, and receiving and recording a user voice from the user terminal 200 using the speech recognition engine (S500) and step S500. In operation S600, a score may be set for the user's voice uttered by the dialogue of the first character received by the transmission to the user terminal 200. That is, in this step, the service providing server 100 transmits the dialogue of the second character providing the voice only to the learning target language in which the native language meaning is omitted, and the dialogue of the first character spoken by the user omits the character transmission. In operation S100 to S400, the memorized contents may be tested. In the third learning step as described above, the user may induce the internalization of the foreign language pattern through a test for uttering a memorized sentence in response to the dialogue of the counterpart character. On the other hand, as described above in S300 to S400, the dialogue of the second character that the service providing server 100 transmits by voice may be variously applied and transmitted.

Steps S700 to S800 are fourth steps for learning the dialogue to be learned, as in the fourth learning screen of FIG. 4, without transmitting the dialogue of the first and second characters to the user terminal 200 as text. In step S700 and step S700, the voice of the second character is transmitted to the voice, and the user's voice that has spoken the first character of the corresponding voice is recorded and transmitted from the user terminal 200 using a voice recognition engine (S700). A score may be set for the user voice that spoke the first character of the transmitted character and transmitted to the user terminal 200 (S800). That is, in this step, the service providing server 100 does not transmit the dialogue of the second character that provides the voice as a text, but transmits only the voice, and actually communicates using the conversation contents memorized through steps S100 to S600. Can produce.

As described above, the present invention adopts a method of sequentially omitting the words to be learned, thereby allowing the user to learn easily without excessive burdens at first, but by increasing the amount to be gradually remembered, natural repetitive practice and The effect of strengthening concentration and memory can be seen, which can facilitate memorization of foreign language conversational forms. On the other hand, in addition to the dialogue of the character directly spoken by the user, the service providing server 100 reads and listens to the dialogue of the character transmitted by voice as described above. In addition to increasing the effect of learning, the disappearance of the characters on the learning screen, the user is psychologically nervous, so there is an effect to perform the learning more immersed.

In addition, according to the exemplary embodiment, the user may implement and test both the first character and the dialogue of the second character, respectively. After step S100, the target language and the native language mean to the user terminal 200. Voice recognition of the first character and the second character composed of the letter, the voice of the first character is transmitted to the voice, and the user voice that spoke the dialogue of the second character corresponding to the voice recognition from the user terminal 200 Receiving and transmitting using the engine (S110) and after step S300, the user terminal 200, the dialogue of the second character composed of the mother tongue meaning and the language of the first character composed of the learning language and the mother tongue meaning to the user terminal 200 as a letter. The voice of the first character to transmit the voice of the first character, and the voice of the second character corresponding to the voice of the second character. Receiving and transmitting using the step (S310), after step S500, the user terminal 200 transmits the first character dialogue composed of the learning language as a text, the dialogue of the first character by voice, Receiving and transmitting a user's voice, which has spoken a corresponding second character, from the user terminal 200 using a voice recognition engine (S510) and after step S700, after the first and second user terminals 200, Instead of transmitting the dialogue of the character as a character, the dialogue of the first character is transmitted by voice, and the user's voice that has spoken the dialogue of the second character corresponding thereto is recorded and transmitted from the user terminal 200 using a speech recognition engine. It may be implemented by further comprising a receiving step (S710). In such a case, the scores transmitted to the user terminal 200 in steps S200, S400, S600, and S800 correspond to the score for the user's voice that spoke the first character and the user's voice that spoke the second character. The score may be a sum of the scores.

As described in each step, the present invention uses 'test' as a process of learning foreign language role-playing, and the high learning effect of the test has been proved by the 2006 experiments of cognitive psychologists Roediger and Karpicke. It is called an effect (Testing Effect). FIG. 5 shows the results of 2006 testing effects experiments of Roediger and Karpicke. As shown in FIG. 5, a word recall test score was compared a week after the group tested 4 times and the group tested 3 times after the first exercise to perform the same task. Demonstrated superior learning outcomes. In other words, practice with the best effect proved to be a test. The present invention is designed using a testing effect that maximizes the learning effect in foreign language learning.

In addition, according to an embodiment of the present invention, as shown in Figs. 2 and 3, the next step is performed only when the scores set in steps S200, S400, S600 and S800 are equal to or greater than a predetermined score, respectively. If it is less than the score, the previous step can be implemented again. Implementing the transition to the next level after complete learning of one level can lead to systematic learning, encourages learning motivation, and enhances learning immersion.

6 is a score for each word or phoneme is scored for the recorded voice in the method for providing a foreign language role-playing learning service through the sequential omission of the speaking test and text information using the speech recognition engine according to an embodiment of the present invention It is a figure which shows that. Since the present invention adopts a test scheme, scores are provided for the performed tests and detailed feedback is provided. As shown in FIG. 6, the scores are set for each word for the performed metabolism, and the alphabet (for example, B + ) And a graph. That is, the total score (sentence score or dialogue total score) for the dialogue and the scores set for each word constituting the dialogue may be displayed in alphabets and graphs. In addition, it can be applied as a number, or as a graph according to various systems. 7 is a diagram illustrating the results of experiments of learning effects on the diversity of feedback. As shown in FIG. 7, the present inventors can confirm that the spontaneous execution time is significantly increased when there are 7 types of feedback, compared to the case where there is no feedback or only two types of feedback such as success / failure. there was. Therefore, in the present invention, by providing a variety of precise feedback sequentially such as providing a step-by-step feedback (scoring and transmission), pronunciation or expression accuracy (word selection) for each word or phoneme, such as graphs to enhance the learning effect It was configured to.

8 is a diagram illustrating a timeline setting example of a speech recognition engine in a method of providing a foreign language role-playing learning service through a speaking test and a cumulative test using a speech recognition engine according to an embodiment of the present invention. As shown in FIG. 8, according to an embodiment of the present invention, a timeline of a voice recognition engine may be set. That is, the operation time of the speech recognition engine, the vocalization time, the continuous silence period before vocalization, and the silence duration time after vocalization can be set and reflected in the score formulation. According to the embodiment, when the duration of silence during the operation of the voice recognition engine exceeds the set duration of silence, the operation of the voice recognition engine is automatically stopped, and the lowest grade score is given to the corresponding dialogue. It can also be implemented. In other words, after a certain period of time without the user's utterance, the voice recognition engine stops automatically, moves to the next line, or allows the test to be performed from the beginning to further induce tension and increase concentration. . In addition, since the user has to perform speaking rapidly, the user (learner) can quickly analyze the character or voice information made in the native language and train the user to convert it into a corresponding foreign language sentence.

In addition, in a method of providing a foreign language role-playing learning service through a speaking test using a speech recognition engine and sequential omission of text information according to an embodiment of the present invention, a plurality of dialogues may be provided. That is, a plurality of dialogues of the first character and the second character may be provided, respectively, and may include at least three or more dialogues. In such a case, the two-way voice transmission between the service providing server 100 and the user terminal 200 in steps S100, S300, S500, and S700 is continuously performed for all the plurality of dialogues until all of the conversations of the characters are completed. It can be implemented to run. In addition, when the two-way voice transmission for the entire conversation is completed, it is possible to implement so as to proceed to the next step only when the scores are added to each metabolism and the sum is more than a predetermined score. In addition, according to another embodiment of the present invention, the steps S100 to S800 are first performed only for the first metabolism, and then the steps S100 to S800 are performed for the first metabolism and the second metabolism. The metabolisms carried out in step 2 may be gradually accumulated to repeat steps S100 to S800. By adopting this cumulative test method, we can strengthen the long-term memory of expressions, internalize the conversation patterns of foreign languages, and experience similar nuances of foreign language conversation through various empathy for conversation situations. It can facilitate the recall of foreign language expressions in situations.

As another embodiment of the present invention, when there are a plurality of metabolisms of the first character or the second character, steps S100 to S800 may be performed for all the plurality of metabolisms, and the method may be performed separately for each metabolism. However, the method may be performed in the cumulative manner described above, or may be continuously performed for all the metabolisms. After the completion of the steps S100 to S800 for all the dialogues, only the dialogues whose scores set in step S800 are less than the predetermined scores are transmitted to the user terminal 200 for the dialogues of the first or second characters corresponding thereto. The method further includes a retesting step of recording and transmitting a user voice in which the first or second character is spoken in response to each of the transmitted lines using the voice recognition engine from the user terminal 200. Repetitive training saves time and reduces the boredom of repetitive learning.

On the other hand, when the voice transmission is continuously performed between the service providing server 100 and the user terminal 200 with respect to a plurality of dialogues, the silent duration for one dialogue is more than a predetermined time or wrong. Even if the speech recognition engine is temporarily stopped and the lowest score is set for that metabolism, the operation of the speech recognition engine can be designed to receive the next dialogue without stopping the entire conversation. That is, in the continuous conversation according to the learning stage or selection, as described above with reference to FIG. 8, when the score for the specific metabolism is the lowest point (eg, silence), the voice recognition engine is immediately stopped. At the same time, it can be implemented to stop the conversation and start the conversation again from the beginning, but if a certain amount of practice has been performed or if a quick conversation training is required, the conversation does not stop even if the score for a certain line is at the lowest point. After the whole process has been performed, the sum of the scores can be implemented to determine whether to re-run. In the former case, it is possible to promote rapid response and accurate memorization for each metabolism, while in the latter case, it is possible to train the withdrawal of the fast foreign language conversation in the context of the overall conversation and the interactive conversation. That is, the present invention induces a speedy speaking in a variety of ways to implement a foreign language unconsciously internalized.

9 is a diagram showing the results of experiments on the combined effect of information retrieval and fast response. The present inventors carried out experiments in which subjects were presented with 10 foreigner face photographs and names of foreign languages for each photograph to memorize the effect of quick reaction when fetching information from the human brain. Subjects in Group A were repeatedly instructed to show their names after one second, and group B repeated the training to tell the name seven seconds after the picture appeared. At this time, the number of training repetitions in both groups was the same. As a result, as shown in Figure 9, in the test after a week, group A showed an overwhelmingly high recall rate and a fast reaction rate. In other words, it was confirmed that, in the retrieval of memorized information, as in the present invention, the speedy speaking training exhibits a remarkably high learning effect.

The series of processes of the present invention may be applied as a dialogue between three or more characters, in which case, steps S100 to S800 may be performed for each character. In addition, by further comprising the step of receiving the member information from the user before the step S100 and receiving the membership, it can be implemented to enable the user to learn by level, progress management, score management can be easy.

The present invention may be embodied in many other specific forms without departing from the spirit or essential characteristics of the invention.

100: service providing server 200: user terminal
S100: The user terminal transmits a dialogue of the first character and the second character composed of a learning target language and a native language meaning stored by the service providing server as a text, and transmits the dialogue of the second character by voice. Recording and transmitting a user's voice that has spoken the corresponding first character from the user terminal using a voice recognition engine
S110: transmitting a dialogue of the first character and the second character composed of a learning target language and a mother tongue meaning as a text to the user terminal, and transmitting the dialogue of the first character by voice and corresponding to the second character. Recording and transmitting the user's voice, which has been spoken, from the user terminal using a voice recognition engine
S200: setting a score for the user voice received in steps S100 and S110 and transmitting the score to the user terminal
S300: transmitting the dialogue of the first character composed of a native language meaning and the dialogue character of the second character composed of a learning target language and a native language meaning to the user terminal as a text, and transmitting the dialogue of the second character by voice. Recording and transmitting a user's voice that has spoken the corresponding first character from the user terminal using a voice recognition engine
S310: Transmit the dialogue of the second character composed of a native language meaning and the dialogue target language and the dialogue of the first character composed of a native language meaning to the user terminal, and transmit the dialogue of the first character by voice. Recording and transmitting a user's voice, which has spoken the corresponding second character, from the user terminal using a voice recognition engine
S400: setting a score for the user voice received in steps S300 and S310 and transmitting the score to the user terminal
S500: Sending the dialogue of the second character composed of a learning target language as a text to the user terminal, and transmitting the dialogue of the second character by voice, and the user voice that spoke the dialogue of the first character corresponding thereto. Receiving a recording and transmission from the user terminal using a voice recognition engine
S510: Sending the dialogue of the first character composed of a learning target language as a text to the user terminal, transmitting the dialogue of the first character by voice, and the user voice that spoke the dialogue of the second character corresponding thereto. Receiving a recording and transmission from the user terminal using a voice recognition engine
S600: setting a score for the user voice received in steps S500 and S510 and transmitting the score to the user terminal
S700: The voice of the second character is transmitted to the user terminal without transmitting the dialogue of the first character and the second character as a text, and the user voice that has spoken the dialogue of the first character corresponding thereto is recalled. Receiving recording and transmission from a user terminal using a voice recognition engine
S710: The voice of the first character is transmitted to the user terminal without transmitting the dialogue of the first character and the second character as a text, and the user voice that has spoken the dialogue of the second character corresponds to the user terminal. Receiving recording and transmission from a user terminal using a voice recognition engine
S800: setting a score for the user voice received in steps S700 and S710 and transmitting the score to the user terminal

Claims (9)

A service providing server providing a foreign language role-playing learning service,
(1) transmitting the words of the first character and the second character composed of a learning target language and a mother tongue meaning stored in the service providing server to a user terminal as a text, and transmitting the words of the second character by voice; Receiving and recording a user voice corresponding to the first character's speech from the user terminal using a voice recognition engine;
(2) setting a score for the user voice that spoke the first character received in step (1) and transmitting the score to the user terminal;
(3) transmitting, to the user terminal, a dialogue of the first character composed of a native language meaning, a dialogue of a target language, a native language meaning, or a dialogue of the second character consisting of a target language and a native language meaning, as a text; Transmitting a voice of a character to a voice, and recording and transmitting a user voice of the voice of the first character corresponding to the voice using a voice recognition engine from the user terminal;
(4) setting a score for the user voice that spoke the first character received in step (3) and transmitting the score to the user terminal;
(5) transmitting a dialogue of the second character composed of a learning language, a native language meaning, or a learning language and a native language meaning to the user terminal by text, and transmitting the dialogue of the second character by voice and correspondingly; Recording and transmitting a user voice in which the first character is spoken using a voice recognition engine from the user terminal;
(6) setting a score for the user voice that spoke the first character transmitted in step (5) and transmitting the score to the user terminal;
(7) Instead of transmitting the words of the first and second characters as texts to the user terminal, the words of the second characters are transmitted by voice, and the user voices that have spoken the words of the first characters corresponding thereto are transmitted. Receiving and recording from the user terminal using a voice recognition engine; And
And (8) setting a score for the user's voice that has spoken the first character received in step (7) and transmitting the score to the user terminal. A method for providing a foreign language role-playing learning service through sequential omission of character information.
A service providing server providing a foreign language role-playing learning service,
(1) transmitting the words of the first character and the second character composed of a learning target language and a mother tongue meaning stored in the service providing server to a user terminal as a text, and transmitting the words of the second character by voice; Receiving and recording a user voice corresponding to the first character's speech from the user terminal using a voice recognition engine;
(1-1) transmitting, to the user terminal, a dialogue of the first and second characters composed of a learning language and a mother tongue meaning as a text, and transmitting the dialogue of the first character by voice and correspondingly; Recording and transmitting a user's voice, which has spoken two characters, from the user terminal using a voice recognition engine;
(2) setting a score for the user voice received in steps (1) and (1-1) and transmitting the score to the user terminal;
(3) transmitting, to the user terminal, a dialogue of the first character composed of a native language meaning and a dialogue of the second character composed of a learning language and a native language meaning as a text, and transmitting the dialogue of the second character by voice; Recording and transmitting a user voice corresponding to the first character of the first character using a voice recognition engine from the user terminal;
(3-1) a dialogue of the second character composed of a native language meaning and a dialogue of the first character composed of a learning language and a native language meaning is transmitted to the user terminal as a text, and the dialogue of the first character is spoken to the user terminal; Transmitting and recording and transmitting a user's voice that has spoken the second character corresponding thereto from a voice recognition engine from the user terminal;
(4) setting a score for the user voice received in steps (3) and (3-1) and transmitting the score to the user terminal;
(5) a user voice that transmits a dialogue of the second character composed of a learning target language as a text to the user terminal, transmits the dialogue of the second character by voice, and speaks the dialogue of the first character corresponding thereto; Receiving and recording from the user terminal using a voice recognition engine;
(5-1) transmitting the dialogue of the first character composed of a learning target language as a text to the user terminal, transmitting the dialogue of the first character by voice, and uttering the dialogue of the second character corresponding thereto. Receiving and recording a user voice from the user terminal using a voice recognition engine;
(6) setting a score for the user voice received in steps (5) and (5-1) and transmitting the score to the user terminal;
(7) Instead of transmitting the words of the first and second characters as texts to the user terminal, the words of the second characters are transmitted by voice, and the user voices that have spoken the words of the first characters corresponding thereto are transmitted. Receiving and recording from the user terminal using a voice recognition engine;
(7-1) A user who does not transmit the dialogue of the first character and the second character to the user terminal as a text but transmits the dialogue of the first character by voice and speaks the dialogue of the second character corresponding thereto. Receiving and recording a voice from the user terminal using a voice recognition engine; And
(8) Speaking test and text using a speech recognition engine, characterized in that the step of setting the score for the user voice received in the step (7) and step (7-1) and transmitting to the user terminal A method for providing a foreign language role-playing learning service by sequentially omitting information.
The method of claim 2, wherein in step (2), step (4), step (6) and step (8),
The score transmitted to the user terminal is a score obtained by adding up a score for the user's voice that spoke the first character and a score for the user's voice that spoke the second character. A method for providing a foreign language role-playing learning service through a sequential omission of a speaking test and character information using an engine.
3. The method according to claim 1 or 2,
The next step is performed only if the scores set in the above steps (2), (4), (6) and (8) are each more than the predetermined score, and if the score is less than the predetermined score, the previous step is performed again. A method for providing a foreign language role-playing learning service through a speaking test using a speech recognition engine and sequential omission of character information.
3. The method according to claim 1 or 2,
The score set in each step is any one selected from the group including a total score for the speech spoken in each step and a score set for each word or phoneme constituting the dialogue including numbers, alphabets, and graphs. Method for providing a foreign language role-playing learning service, characterized by the above-described, speaking test using a speech recognition engine and sequential omission of text information.
3. The method according to claim 1 or 2,
The voice recognition engine operates only for a predetermined time,
When the duration of silence during the operation of the voice recognition engine exceeds a predetermined silent duration allowance time, the operation of the voice recognition engine is automatically stopped, characterized in that the lowest grade is given a score, A method of providing a foreign language role-playing learning service through a speaking test using a recognition engine and sequential omission of character information.
3. The method according to claim 1 or 2,
When there are a plurality of dialogues of the first character or the second character,
In step (1), step (3), step (5) and step (7), the voice transmission of the character dialogue between the service providing server and the user terminal is continuous for all the dialogues until the dialogue of the characters is completed. Performed with
The score to be transmitted to the user terminal, it is characterized in that each speech, a speech test using a speech recognition engine and a method for providing a foreign language role-playing learning service through the sequential omission of text information.
3. The method according to claim 1 or 2,
When there are a plurality of dialogues of the first character or the second character,
After the steps (1) to (8) are performed for the first metabolism, the steps (1) to (8) are performed for the first metabolism and the second metabolism, and for the remaining metabolisms, The step (1) to step (8) is carried out by accumulating the metabolism is carried out in, Speaking test using a speech recognition engine and a method for providing a foreign language role-playing learning service through the sequential omission of text information.
3. The method according to claim 1 or 2,
When there are a plurality of dialogues of the first character or the second character,
Only for the dialogues whose scores set in step (8) are less than the predetermined scores, the dialogues of the first or second characters corresponding thereto are transmitted to the user terminal, and the first or the second speeches are corresponding to each of the transmitted dialogues. And a retesting step of recording and transmitting a user voice in which two characters are spoken using a voice recognition engine, from the user terminal. Speaking test using a voice recognition engine and sequential omission of text information To provide foreign language role-playing learning services through
KR1020120072540A 2012-07-03 2012-07-03 Method for providing learning language service based on speaking test using speech recognition engine and subtitles's sequential abridgment KR20140004538A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120072540A KR20140004538A (en) 2012-07-03 2012-07-03 Method for providing learning language service based on speaking test using speech recognition engine and subtitles's sequential abridgment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120072540A KR20140004538A (en) 2012-07-03 2012-07-03 Method for providing learning language service based on speaking test using speech recognition engine and subtitles's sequential abridgment

Publications (1)

Publication Number Publication Date
KR20140004538A true KR20140004538A (en) 2014-01-13

Family

ID=50140511

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120072540A KR20140004538A (en) 2012-07-03 2012-07-03 Method for providing learning language service based on speaking test using speech recognition engine and subtitles's sequential abridgment

Country Status (1)

Country Link
KR (1) KR20140004538A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101605739B1 (en) 2015-03-09 2016-03-28 주식회사 아이엔지 Method for providing play service
WO2020055027A1 (en) * 2018-09-14 2020-03-19 전영숙 Language learning apparatus
KR102483055B1 (en) 2022-07-26 2022-12-30 주식회사 모두의연구소 Method for converting text of character to simple voice and appratus and system using the same

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101605739B1 (en) 2015-03-09 2016-03-28 주식회사 아이엔지 Method for providing play service
WO2020055027A1 (en) * 2018-09-14 2020-03-19 전영숙 Language learning apparatus
KR102483055B1 (en) 2022-07-26 2022-12-30 주식회사 모두의연구소 Method for converting text of character to simple voice and appratus and system using the same

Similar Documents

Publication Publication Date Title
Baker Exploring teachers' knowledge of second language pronunciation techniques: Teacher cognitions, observed classroom practices, and student perceptions
Siegel et al. Getting to the bottom of L2 listening instruction: Making a case for bottom-up activities
Li et al. Effective approaches to teaching listening: Chinese EFL teachers’ perspectives
Indrasari Designing Listening Tasks For English Students
Hismanoglu et al. A qualitative report on the perceived awareness of pronunciation instruction: Increasing needs and expectations of prospective EFL teachers
KR20220011109A (en) Digital english learning service method and system
KR20140004538A (en) Method for providing learning language service based on speaking test using speech recognition engine and subtitles's sequential abridgment
Silviyanti et al. The magic of storytelling: Does storytelling through videos improve EFL students’ oral performance?
Sura ESP listening comprehension for IT-students as a language skill
KR20020068835A (en) System and method for learnning foreign language using network
KR20140004531A (en) Method for providing language training service based on concentrative type speaking test using speech recognition engine
Barnes-Hawkins English Language Learners' Perspectives of the Communicative Language Approach
KR20140004537A (en) Method for providing learning language service based on accumulation test and speaking test using speech recognition engine
KR20140004539A (en) Method for providing learning language service based on interactive dialogue using speech recognition engine
Ardriyati Using an authentic and selected film for teaching listening and speaking
KR20140004540A (en) Method for providing foreign language listening training service based on listening and speaking using speech recognition engine
Darwissyah Irwan et al. Designing listening tasks for English students
Li et al. Game Design to Improve Thai Speaking Skills for Chinese Students.
dan Diksus THE USE OF MOBILE ASSISTED LANGUAGE LEARNING (MALL) IN TEACHING STUDENTS’LISTENING AND SPEAKING SKILLS
Brown Task-Based Listening: What Every ESL Teacher Needs to Know
Wahyuni An Analysis of Students’ Listening Comprehension through English song of Eleventh Grade Students at Senior High School IT Azzuhra Pekanbaru
Putri THE INFLUENCE OF STORYTELLING TECHNIQUE TOWARD STUDENTS’ABILITY IN TELLING A FABLE AT FIRST SEMESTER OF EIGHTH GRADE OF SMPN 5 MESUJI LAMPUNG IN ACADEMIC YEAR 2022/2023
Silvani The Effect Of Storytelling Towards The First Grade Students Speaking Ability SMAN 3 At Mandau
Lu Methods and Effects of Shadowing Using Online Authentic Videos on L2 Acquisition of Mandarin Chinese Tones
LIA The Influence of Using ELSA Application toward Students' Speaking Ability in the first Semester at the Ninth Grade Students of SMPN 11 Kotabumi Lampung Utara in the Academic Year of 2023/2024

Legal Events

Date Code Title Description
A201 Request for examination
A302 Request for accelerated examination
E902 Notification of reason for refusal
E601 Decision to refuse application
J201 Request for trial against refusal decision
S901 Examination by remand of revocation
E902 Notification of reason for refusal
S601 Decision to reject again after remand of revocation