KR100593590B1 - Automatic Content Generation Method and Language Learning Method - Google Patents

Abstract

An object of the present invention is to provide a method for generating a standard content file that allows a learner to actively participate in a learning content and a language learning method using the same. Standard content file generation method of the present invention for this purpose, preparing the English sentence data; Preparing native voice data and an image for reproducing the English sentence; Preparing moving picture data showing the utterance of a word; Preparing source data for speech recognition; Compressing the prepared English sentence data, voice and image data, video data, and voice recognition source data into a predetermined standard content file using a standard content editor; And converting the generated standard content file into a streaming file structure. Therefore, according to the present invention, unlike the existing English language learning site, using the speech recognition technology to the maximum, you can practice conversation through various example sentences, and you yourself as the hero of the movie 1: 1 and 1: many The learning efficiency can be greatly improved by providing differentiated contents such as a cinema learning room that proceeds movies through speaking.

Language Learning Contents, Content Editor, File Creation, Learning Method, Cinema, Speech Recognition

Description

Automatic content generation method and language learning method using the same {Contents file generation method for language learnning and Studying method using the file}

1 is a schematic diagram of language learning using a conventional video or speech recognition,

2 is a conceptual diagram illustrating a concept of content creation and learning according to the present invention;

3 is a flowchart illustrating a procedure for generating a content file according to the present invention;

4 is an example showing the structure of a standard content file created according to the present invention;

5 is a flowchart illustrating a language learning procedure according to the present invention;

6 is an example of a main screen of language learning according to the present invention;

7 is an example of a painting study room screen according to the present invention;

8 is an example of a cinema study room screen according to the present invention;

9a and 9b are examples of the sound compensator screen according to the present invention;

10 is an example of a speech test screen according to the present invention.

* Explanation of symbols for the main parts of the drawings

21: Source 22: Content Editor

23: Standard Content File 24: Language Learning System

25: User (learner)

The present invention relates to a language learning system, and more particularly, to a method for generating standard content for language learning, an objective test for conversation, and a language learning method using the same.

As the modern society is said to be a global village, transportation and culture have developed and international exchanges have become commonplace. Therefore, foreign language learning has become a very important element that is the foundation of national competitiveness. However, since language learning is a tedious process rather than a short time, much effort is being made to develop an efficient language learning system.

1 is a schematic diagram of a conventional language learning concept using a video or voice recognition, the conventional language learning system was a method of simply playing the video 11 as one file 12, when the language learning using the video, In the case of language learning using speech recognition, learning was carried out by executing the source 13 for speech recognition in real time.

However, such a conventional language learning system is a method of simply playing a video, and thus the learner does not actively respond to the contents of the content, but is a one-way learning method that only the viewer watches. . In addition, the content of the conventional language learning system consists of simple video files stored without any rules, and various services are difficult, and there is a problem that it is difficult to expand the content.

The present invention has been proposed to solve the above problems, a method for generating a standard content file that allows learners to actively participate in learning content in language learning and conversation test and series test, and language learning method and test using the same The purpose is to provide.

In order to achieve the above object, the standard content file generation method of the present invention comprises the steps of preparing English sentence data; Preparing native voice data and an image for reproducing the English sentence; Preparing moving picture data showing the utterance of a word; Preparing source data for speech recognition; Compressing the prepared English sentence data, voice and image data, video data, and voice recognition source data into a predetermined standard content file using a standard content editor; And converting the generated standard content file into a streaming file structure.

Language learning method using the standard content file of the present invention to achieve the above object, in the language learning method using a language learning system consisting of a plurality of standard content files, driving the language learning system to display the main screen Doing; Selecting a desired language learning process on the main screen; Selecting a painting study room, selecting a theme, a conversation method, and a main character and then learning on a predetermined painting learning screen; Selecting a cinema study room, selecting a desired movie, selecting a conversation method, selecting a main character, and then learning on a predetermined cinema learning screen; And a conversation and watering test step for objectively evaluating conversational language by speech recognition technology.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a conceptual diagram illustrating a standard content generation and learning concept using the same according to the present invention.

Referring to FIG. 2, the present invention is classified into a content generation process performed by a content provider and a language learning process that a user learns about the generated content. The content provider (CP) uses a content editor 22 according to the present invention to provide a standard content file (also called a GYC (GY Intech Content Data File) content file) 23 for language learning from the multimedia source 21. Create

As shown in FIG. 4, the generated standard content file 23 includes a content unique number 231, a security code 232, a source 233 for voice recognition, an image 234, and a native speaker 235. ), And a video 236. The source 233, the image 234, and the native speaker 235 for voice recognition are voice recognition and multimedia sources tailored to the number of conversations.

Referring to Figure 4, the unique number and security code (231,232) allows the content provider (CP) to easily add on (add on) and add to the existing Internet education site in the production of content. In addition, the standard content file 23 has a streaming structure. At least 500KB to 10MB or more files can be provided to learners (users) by providing streaming services on the Internet, such as the existing video streaming service. By using 'standard content file' for various multimedia functions, interactive two-way learning is possible so that learners can actively learn.

[Create standard content file]

3 is a flow chart illustrating a procedure for generating a standard content file in accordance with the present invention.

According to the present invention, the procedure for generating a standard content file may include preparing an English sentence (S1), preparing a voice and an image for reproducing the English sentence (S2), and vocalization of a word, as shown in FIG. 3. Preparing a video showing (S3), preparing a source for speech recognition (S4), compressing a plurality of sources into a standard file using a content editor (S5), converting to a streaming file structure Step S6 is made.

First, the present invention is a technology that provides a convenience between the learner and the content provider by defining a standard content file format in producing English learning content using speech recognition. The content creator (CP) produces a compressed standard file of voice recognition and multimedia that only the standard content file according to the present invention has, and the supplier supplies the standard content produced according to the present invention as the Internet or software. In addition, learners can easily learn English using various standard content files.

Referring to Figure 3, the English sentence is each sentence used in the actual conversation, the voice and image is a situation that is appropriate when the screen is changed while the conversation is made. The video is a recording of the utterance of the words used in the conversation, and the voice recognition source is a function that the learner can practice along during the conversation. Speech recognition is being developed by many research institutes and industry companies, and has been re-developed for English education. As described above, the present invention can be learned by talking with native speakers of the real world, and combined with various multimedia sources to enable learners to improve learning.

In addition, the content editor 22 according to the present invention is implemented in software, which creates a standard content file (GYC file) 23 for importing a movie file and applying it to a speech recognition component, and an intuitive screen interface for use. Create data for voice recognition easily and quickly. In addition, there is an automatic input function for minimal input in inputting related data, and by selecting a section of the entire movie, only a desired portion can be made into content.

 The main functions of the content editor 22 include a video playback function, subtitle sync control function, section data extraction function, movie information reading (subtitle, time) function, subtitle editing function, GYC (GY Intech Content Data File) Content data (cinema, conversation, pronunciation correction) function, file creation and storage function, reading function, data editing (Redo, Undo, Cut, Copy, Paste) function, automatic data character input (index number, speaker) function, recording Features such as editing WAV files, converting audio files to MP3, simple image editing and saving, changing the format between image files, previewing and testing the produced contents.

[Language learning using standard content files]

Meanwhile, the process of learning using the standard content file 23 generated by the content editor 22 is as follows.

The driving of the standard content file according to the present invention is to practice virtual conversation with a native speaker. First, the presented speaker is selected as the learner. Then set up the microphone, set the conversation method, and press the start button to learn voice recognition.

5 is a flowchart illustrating a language learning procedure according to the present invention. The language learning system according to the present invention may be implemented as a stand alone using a desktop computer or a notebook computer, or may be implemented in the form of a dedicated terminal such as a language learner, or a mobile terminal such as a PDA or a mobile phone. It can also be provided through. And it can also be provided via the Internet, in the embodiment of the present invention will be described taking a service provided through the Internet website as an example.

Referring to FIG. 5, the learner generates a standard content file and accesses a site providing a service through the Internet (501). When accessing the service site, when the main screen as shown in Figure 6 appears, sign up as a member (502 ~ 504). When the normal login is made, the user may select various menus from the main screen to learn desired information (505). Representative language learning menu provided according to the present invention include "conversation study room" and "cinema study room", "pronounced pronunciation", "test menu" and the like.

Here, the 'conversation study room' provides contents that can practice painting repeatedly through various examples, and the 'cinema study room' selects the main character of the movie that he / she wants and proceeds with the story of the movie along with the surrounding characters. Provide contents for learning conversation. In addition, 'pronouncement correction learning room' provides contents composed by specializing pronunciation correction part, and 'game learning room' provides content that can enhance user's interest and learning effect by using English word matching game using voice recognition technology. .

When the learner selects the 'conversation study room' menu, a screen for selecting a theme appears, and after selecting a theme, a screen for setting a conversation method and a screen for selecting a main character appear. After completing the selection and setting in each of the above screen, the 'painting study room' screen for learning a language appears as shown in the rain shown in FIG.

Referring to Figure 7, the 'conversation study room' screen is a picture window (A) and time graph (B), native speaker pronunciation display window (C), user pronunciation display window (D), English fingerprint window (E), score window (F) , English fingerprint list (G), play button (H), pause button (I), and close button (J). The picture window (A) shows the reference picture, and the time graph (B) shows the time elapsed so as to pronounce the microphone at the specified time. The native speaker's pronunciation display window (C) displays the native speaker's pronunciation as a waveform, and the user's pronunciation window (D) displays the user's pronunciation as a waveform. The English fingerprint window (E) shows English, interpretation, etc., and the score window (F) displays their pronunciation scores for native speakers' pronunciations. The fingerprint of the theme appears in the English fingerprint list window (G), pressing the play button (H) can start learning.

Conversation study room according to the present invention as a learning room that can practice the conversation through a variety of example sentences, it is configured around the sentences commonly used in everyday life so that it can be easily applied in real life. As described above, the present invention not only learns daily conversation but also listens to and speaks the same, so that the user can learn a living English that can be used practically, and can supplement the weak points through customized additive education according to the learning result. It was. It also allows you to correct pronunciation and intonation through voice waveform graphs, making it easier to reach native speakers as well as speaking.

Meanwhile, when the learner selects the 'cinema study room' menu, a screen for selecting a movie appears, and when a movie is selected, a screen for setting a conversation method and a screen for selecting a main character appear. After completing the above selection and setting process, a 'cinema study room' screen for learning a language using a cinema is shown as shown in FIG. 8 so that the conversation can be studied using the cinema.

Referring to Figure 8, the 'cinema study room' screen is a movie window (A) and time graph (B), English ambassador window (C), score window (D), English metabolism list (E), play button (F), It consists of a pause button (G) and a close button (H). The movie window A displays a movie, the time graph B indicates the passage of a designated time to be input into the microphone, and the English metabolism window E displays English metabolism and interpretation. The score window (D) is compared with the native speaker's pronunciation in the actual movie and the user's pronunciation is displayed as a score and a graph, the English ambassador list (E) is displayed in English. Pressing the play button (F) can start cinema learning, press the pause button (G) to pause, and press the close button (H) to end the cinema learning.

Cinema study room according to the present invention is a content of the application of voice recognition technology, the content of the movie itself with the protagonists of the movie to advance the story of the movie. In other words, after selecting a desired character, the user directly pronounces the dialogue through the microphone and checks the user's pronunciation score and waveform form compared to the native speaker. This allows the user to be immersed in learning English with an interest as if he is the main character of the movie, and naturally improves confidence and ability in English conversation.

When the learner selects the 'pronounced' menu, a submenu for selecting words, sentences, and TTS appears. After selecting the conversation method and the main character, the word pronunciation study room, the sentence pronunciation study room, and the TTS study room are similar to the above procedure. You can study pronunciation on the screen. An example of a word pronunciation study room screen is composed of a word display window, a native speaker pronunciation display window, a user pronunciation display window, a pronunciation mouth display window, a score window, a list window, and a control window. And the example of the TTS study room screen, as shown in Figure 9b, consisting of a text input window, a native speaker pronunciation display window, a user pronunciation display window, a controller 1, a controller 2 buttons. The text input window may input a desired word or sentence, the native speaker's pronunciation display window displays a waveform of the native speaker's pronunciation, and the user's pronunciation display window displays the user's pronunciation. The controller 1 has a button for playing, stopping, and clearing a word or sentence input by a native speaker, and the controller 2 has a REC button, a play button, and a stop button for directly recording and recording a word.

In this way, the 'pronounced pronunciation' learning room according to the present invention is a learning room that specializes in the part of pronunciation correction, so that the user's pronunciation can be corrected to the level of a native speaker. In other words, it is possible to compare the pronunciation of native speakers and their pronunciation through the waveform, and it is configured to intensively supplement the vulnerable part by repeatedly practicing the pronunciation and words of the vulnerable part.

When the learner selects the 'test' menu, a submenu for selecting words, speaking, and dictation appears, and when a desired submenu is selected, the student can test his or her ability on the test screen as shown in FIG. 10. .

Referring to FIG. 10, the conversation and water test (test) screen is composed of a level display window, a time graph, an end button, a first level, a sound window, a score window, a time bar graph, a score graph, and the like. You can check your level of conversation and pronunciation. Here, the level display shows the current level and the time graph shows English or Korean for each problem. The scorecard shows the score for each question and counts the time to pronounce the timeline graph. The score graph shows the score for each problem. In this way, the accuracy of conversation and pronunciation is evaluated by individuals, institutions, and schools, and objective (eg, pronunciation scores, native speakers and speech waveform comparison and analysis) are assessed by voice recognition technology, rather than subjective assessment of learners' skills and abilities. It can be used as an evaluation system to fairly evaluate individual's ability and language supply.

As described above, according to the present invention, by using the voice recognition technology, it is possible to 1: 1 speech training and pronunciation correction that was difficult to implement in the existing English learning site. Specifically, unlike the existing English language learning site, you can make full use of the voice recognition technology and practice conversation through various example sentences, and you can be the main character of the movie and proceed with 1: 1 speaking. By providing differentiated contents such as cinema learning room, and simultaneously providing high quality contents such as English writing practice, reading practice, dictation, etc., the learning efficiency can be greatly improved.

Claims (8)

In the method for automatically generating standard content used for online language learning according to the user's operation by a standard content editor running on a computer, The computer receiving English sentence data; Receiving, by the computer, native speaker voice data and an image for reproducing the English sentence; Receiving, by the computer, video data showing utterances of words used in the English sentence; Receiving source data for speech recognition by the computer; The standard content editor running on the computer stores the input English sentence data, voice and image data, video data, and voice recognition source data, content identification number, security code, voice recognition source, image, native speaker voice, Generating a standard content file by compressing the video into a standard content file consisting of a video; And Converting the generated standard content file into a streaming file structure. delete The method of claim 1, wherein the content editor Create a standard content file for importing movie files and applying them to speech recognition components, but you can create only the desired parts by selecting sections among the entire movie and the automatic input function for minimal input in inputting related data. Standard content file creation method characterized in that. In the language learning method using a language learning system composed of a plurality of standard content files, Displaying a main screen by driving the language learning system; Selecting a desired language learning process on the main screen; Selecting a painting study room, selecting a theme, a conversation method, a main character, and learning on a predetermined painting learning screen; Selecting a cinema study room, selecting a desired movie, selecting a conversation method, selecting a main character, and then learning on a predetermined cinema learning screen; When you select the pronunciation manager menu, a submenu for selecting words, sentences, and TTS appears. After selecting the conversation method and the main character, the pronunciation manager can study pronunciation in the word pronunciation study room, sentence pronunciation study room, or TTS study room. step; And If you select the 'test' menu, a submenu for selecting words, speaking, and dictation appears. If you select a submenu you want, you can test your skills on a given test screen. A method for learning a language using a standard content file, comprising the steps of: objectively evaluating an individual's ability, such as speaking, listening, dictation, and language test. delete delete The method of claim 4, wherein the predetermined conversation learning screen Picture and time graph, native speaker pronunciation display window, user pronunciation display window, English fingerprint window, score window, English fingerprint list, play button, pause button, close button, the language learning method using a standard content file. The method of claim 4, wherein the predetermined cinema learning screen is A language learning method using a standard content file comprising a movie window, a time graph, an English metabolism window, a score window, an English metabolism list, a play button, a pause button, and a close button.

Images