KR101180846B1 - Method for Music-based Language Training and On-Line Training System thereof - Google Patents

Abstract

According to the present invention, when a learner selects a word or sentence to be memorized in a language learning platform through a wired / wireless communication network and selects one of a plurality of pre-stored music, the word or sentence and meaning are songs, and the music is accompaniment words. Audio-visual language learning method using the image related to the text and sentences to create a customized multimedia customized learning content, and learners play and watch it in the learning terminal supporting the wired / wireless communication network and the online learning system using the same It is about.
Music-based language learning method according to an embodiment of the present invention comprises the steps of designating words or sentences and accompaniment previously stored in the language learning platform by the learner terminal connected through a wired or wireless communication network; Generating and storing music-based customized learning content as a voice file, a text file, a related image file, and an accompaniment file of a designated word or sentence in the language learning platform; And providing the customized learning content generated in the language learning platform to the learner terminal by immediately requesting the learner's terminal to play the customized learning content in real time, outputting text and a related image as a video through the display unit of the learner terminal, And outputting a voice file and an accompaniment file through the speaker of the learner terminal.

Description

Music-based language learning method and online learning system using the same {Method for Music-based Language Training and On-Line Training System about}

The present invention relates to a music-based language learning method and an online learning system using the same. More specifically, the learner selects a word or phrase to be memorized in a language learning platform through a wired / wireless communication network and stores a plurality of pre-stored words. If you select one of the music, the words or phrases and meanings as songs, music as accompaniment, images related to words and sentences are processed into video to create customized multimedia customized learning content, the learner is a wired or wireless network The present invention relates to an audio-visual language learning method that follows by playing and watching the same in a learning terminal that supports the learning and an online learning system using the same.

As the modern society became globalized, foreign languages such as English, Japanese, and Chinese characters became very important in social life.

Accordingly, language education is being conducted early, and various methods for effective language learning are being developed.

For example, in learning a foreign language, it is common to register and attend a foreign language school and listen to the lecturer's lecture, but this is expensive and time-limited.

In addition, the online foreign language learning method through the Internet is to record lectures of lecturers, provide recorded contents through the Internet, or learners are provided with unilaterally recorded contents, which decreases learning efficiency.

Recently, as the importance of foreign language education has emerged in line with the trend of the global era, various foreign language education methods have been tried, but the development of vocabulary ability that is the basis of language acquisition is dominant depending on individual efforts, so the learning effect of words It was insignificant.

In addition, the existing language learning method does not deviate from the offline learning form that provides a voice file recording the pronunciation of native speakers or provides a learning process as a video, and is content-oriented for repeat learning through the provided learning contents. In-learning method, there was a lack of satisfying the needs of learners who prefer to learn the customized learning content for learners anytime, anywhere by allowing users to reconstruct the desired learning content.

In addition, although the mobility of learning methods has been solved by language learning through miniaturized learning terminals, in order to maintain the continuity of language learning and language learning anytime and anywhere, the necessity of continuous learning content management and learning stage and level management has emerged online.

The present invention has been made to solve the above-described problems, when a learner selects a word or sentence to be memorized in a language learning platform through a wired or wireless communication network and selects one of a plurality of pre-stored music, Meaning is a song, music is accompaniment, images related to words or sentences are processed into a video to create a customized multimedia customized learning content, music-based language learning method that uses while playing and watching on the learner's terminal and utilizing it Its purpose is to provide an online learning system.

In addition, another object of the present invention is to learn the language by incorporating the characteristics of the music acquired unknowingly through the rhythm as a repetitive viewing in the language, by incorporating the relevant images in the video to induce continuous interest in language learning, one It is to provide a music-based language learning method and an online learning system using the same, which can improve the vocabulary ability that is the basis of language acquisition by not connecting with the song.

Music-based language learning method according to the present invention for achieving the above object comprises the steps of designating words or sentences and accompaniment previously stored in the language learning platform by a learner terminal connected through a wired or wireless communication network;

Generating and storing music-based customized learning content as a voice file, a text file, a related image file, and an accompaniment file of a designated word or sentence in the language learning platform; And

Providing the customized learning content generated in the language learning platform to the learner terminal in response to the immediate playback request of the learner terminal to play the customized learning content in real time, and outputs the text and related images as a video through the display unit of the learner terminal, And outputting a voice file and an accompaniment file through the speaker of the terminal.

In addition, the online learning system using the music-based language learning method according to the present invention draws a voice file, a text file, an image file, and a specified accompaniment file of a specified word or sentence to generate a music-based customized learning content as a video, and for each learner. A language learning platform for storing and providing the information through a wired or wireless communication network;

Designate a word or sentence and accompaniment while connected to a language learning platform through the wired / wireless communication network, play customized learning content provided by the language learning platform, and output a voice file of a word or sentence through a speaker, and display unit It is configured to include a plurality of learner terminal for outputting a text file and a related image file as a video through.

1 is a block diagram of an online language learning system according to the present invention;
2 is a block diagram of a learner terminal shown in FIG.
3 is a configuration diagram of a content DB shown in FIG. 1;
4 is a configuration diagram of the storage shown in FIG. 1;
5 is a configuration diagram of an application server shown in FIG. 1;
6 is a flowchart of a language learning method according to a first embodiment of the present invention;
7 is a flowchart illustrating a language learning method according to a second embodiment of the present invention;
8a and 8b is a curve graph by the pitch extraction program applied to the present invention,
9A to 9C are exemplary screens outputted to a display unit in the playback step of FIG. 6;
10A to 10J are exemplary screens output to the display unit of each step of FIG. 7.

Hereinafter, the configuration and operation of the present invention will be described with reference to the accompanying drawings.

1 is a block diagram of an online language learning system according to the present invention.

As shown, the online language learning system according to the present invention comprises a plurality of learner terminals (10a, ..., 10d), wired and wireless communication networks (20a, 20b) and language learning platform (30).

A plurality of learner terminals (10a, ..., 10d) is a wired and wireless communication network (20a, 20b) to the language learning platform 30 that provides music-based customized learning content or music-based completion learning (recommended learning) content required for language learning services Connect via

The learner terminal (10a, ..., 10d) is a terminal that supports the connection of the wired and wireless communication network (20a, 20b) is all good, for example, a mobile phone (10a), a tablet PC (10b), including a smartphone, voice And a learning-only terminal 10c supporting a video and a video, and a computer 10d such as a laptop.

The wired / wireless communication network includes, for example, a wireless data network 20a such as High Speed Downlink Packet Access (HSDPA), 3G, and WIFI, or a wired Internet network 20b.

The language learning platform 30, which is a subject providing language learning services through wired and wireless communication networks 20a and 20b, is a language learning method according to the present invention to learner terminals 10a,..., 10d connected to wired and wireless communication networks 20a and 20b. A web server 31, a media server 32, an application server 33, a content DB 34, a storage 35, and a learner DB 36 are provided to provide a service.

Among the learner terminals, the mobile phone 10a or the tablet PC 10b are connected to the web server 31 or the media server 32 through the wireless data network 20a or the wired internet network 20b, and the learning-only terminal 10c. Or the computer 10d is connected to the web server 31 or the media server 32 through the wired Internet network 20b.

The web server 31 manages the connection of the learner terminals 10a, ..., 10d connected through the wired / wireless communication networks 20a, 20b, and is adapted to the environment of the learner terminals 10a, ..., 10d. ) Is a web service system with a service management system for data transmission with the language learning platform (30).

The media server 32 is a service system for streaming multimedia learning content in real time.

The application server 33 is a server that provides various applications required for language learning services.

The content DB 34 stores various content data for generating multimedia learning content, that is, word information, sentence information, accompaniment information, voice information, related images, and the like, and stores meta information, storage location values, and the like of each information.

The storage 35 is a physical storage space for storing the generated content.

The learner DB 36 stores learner information, learning level information, learning management and evaluation information for learner authentication.

The language learning platform 30 is executed according to the selection of the learner terminal (10a, ..., 10d) divided into the main learning customized mode and the quick learning recommended menu mode, in the custom learning mode, the words that the learner wants to memorize In the case of selecting a sentence or a sentence and selecting one of a plurality of pre-stored music, the content DB 34 retrieves a text file, a related image file, a voice file, and an accompaniment file of a corresponding word or sentence, and customizes a customized multimedia. You can learn the language by creating the content and the application server 33, in the recommended learning mode, the content information (completed learning content provided by the learning information provider, or pre-stored in the language learning platform 30, or Learner can learn the language by outputting different learning function for each learning function).

FIG. 2 is a configuration diagram of the learner terminal shown in FIG. 1.

As shown, the learner terminal 10 includes a control unit 11, an input unit 12, a display unit 13, a voice processing unit 14, a communication unit 15, a memory unit 16, an evaluation unit 17, and pitch extraction. It is comprised including the part 18.

The controller 11 controls the overall operation for performing language learning according to the present invention.

The memory unit 16 includes a program storage area for storing a program for performing language learning through the language learning platform 30 connected to the wired / wireless communication networks 20a and 20b, and temporarily storing data generated during the program execution. And a temporary storage area for storing the learning information required for learning the language.

In addition, the learning content data stored in the memory unit 16 may store the learning content data that can be reproduced in a state in which the learner terminal 10 is independently operated and not connected to the wired / wireless communication networks 20a and 20b. When connecting to the wired or wireless communication network (20a, 20b) in the environment through the language learning platform 30 can be configured in real-time custom learning content desired by the user, the learning content can be stored in the memory unit 16 to be played on the terminal .

The pitch extraction unit 18 extracts the pitch (pitch) according to the pronunciation of the native speaker or learner and visualizes it and displays it in a curved graph.

8A and 8B are, for example, a curve graph extracted with different pitch extraction programs when the English words polite, current, severe, and remote are pronounced, and it is understood that two different pitch extraction programs draw the same curve graph. have.

The evaluation unit 17 compares the curve graph of the native speaker and the learner drawn by the pitch extraction program with each other and scores the scores according to the similarity.

That is, when the learner follows the voice file of the native speaker outputted to the speaker SP at a predetermined interval and records and stores it, the pitch extractor 18 stores the pitch, volume, and playback time information of the stored learner voice file. To generate a speech curve graph by extracting the pitch, the pitch is the height of the speech curve graph, the volume is the thickness, the playback time is the length so that you can visually compare the pronunciation difference between the native speaker and the learner, 17 ) Calculates the score by evaluating the similarity of two ignition curve graphs.

In addition, when the word 17 included in the content is learned and a test game related to the learned word is performed, the evaluation unit 17 calculates a score according to the result of the test game, the number of incorrect answers and correct answers.

The score calculated by the evaluation unit 17 is stored in the learner DB 36 of the memory unit 16 and the language learning platform 30.

The input unit 12 includes a virtual key input system through a screen supporting a plurality of keys, a mouse, or a touch interface as an input means for controlling the operation of the learner terminal 10, and is provided with a key, a mouse, or a touch interface pressed by the learner. The operated data is output to the control unit 11.

The display unit 13 is a screen or a CRT monitor supporting a liquid crystal display (LCD) or a touch interface. The display unit 13 displays various language learning information as text, images, and videos under the control of the controller 11.

The voice processor 14 is connected to the microphone MIC and the speaker SP, and processes the analog voice input through the microphone MIC in the PCM, EVRC or MP3 format, and outputs the voice to the controller 11. 11 stores it in the memory unit 16 or in the storage 35 of the language learning platform 30 through wired / wireless communication networks 20a and 20b.

In addition, the voice processor 14 converts voice data (pronounced) or song file stored in the memory unit 16 and outputs the sound through the speaker SP.

The communication unit 15 is connected to the language learning platform 30 through wired / wireless communication networks 20a and 20b under the control of the control unit 11 so as to receive various language learning services.

The display unit 13 is preferably configured as a screen supporting the touch interface so that the display unit 13 also functions as the input unit 12.

3 is a configuration diagram of the content DB shown in FIG. 1.

As shown, the content DB 34 includes a word DB 34a, a sentence DB 34b, an accompaniment DB 34c, a voice DB 34d, and a related image DB 34e.

The word DB 34a is a dedicated dictionary of the language learning platform 30. The word DB 34a can search a word through the word DB 34a, and the searched word is stored in the history.

The word DB 34a stores a plurality of words, their meanings, and phonetic symbols.

The sentence DB 34b stores a plurality of sentences categorized into slang, proverb, and conversation, and their translations. The sentence DB 34b can be used to search for a sentence and make a list.

Accompaniment DB 34c stores information on a number of songs consisting of accompaniment (background music) or melody (hereafter referred to as accompaniment), and is about 1 to 2 minutes per song so that the user is not bored during playback. It is configured to have a reproduction length of a degree.

The voice DB 34d stores words of the word DB 34a and its meanings, native voice files such as idioms, proverbs, and conversations of the sentence DB 34b, translation voice files, and decay files of words and sentences.

In the related image DB 34e, a picture file representing the meaning or meaning of a word or sentence stored in the word DB 34a or the sentence DB 34b is stored in correspondence with the word or sentence.

4 is a configuration diagram of the storage shown in FIG. 1.

As shown in the drawing, the storage 35 includes a recommended learning content storage 35a, a customized learning content storage 35b, and a recording information storage 35c.

The recommended learning content storage 35a is a storage space in which completed learning (recommended learning) content for learning a language is selected by the learner in the recommended learning mode, and is stored by learning level and function, and the recommended learning content is a video function. (35aa), section practice (35ab), pronunciation practice (35ac), multimedia book function (35ad), vocabulary function (35ae), example sentence function (35af), game function (35ag) can learn the language. .

Here, the content is composed of a learning music content made of a song with accompaniment or parts of words or words combined in accompaniment, the basic form of the song is a way to alternate words and meanings, where the time interval between words and meanings 0.5 to 0.7 seconds.

The learning level is based on the learning level (elementary, middle, high school, TOEIC / TOEFL) information stored by the user in the learner DB (36), and the learning activity through the evaluation of learning (beginner, intermediate, advanced) Can be defined separately.

The video function 35aa is a function of outputting a video file in which an image representing each word and a meaning included in content and a text image having a typography visual match are matched.

The section practice function 35ab divides the content into predetermined sections (for example, eight sections) and outputs a previously recorded native speaker's song (sound data composed of a content database). One song consisting of about three minutes can be learned by dividing it into small units by allowing the user to sing along a predetermined section.

The pronunciation practice function 35ac divides the words contained in the content into predetermined units, and then outputs the relevant image file of each word to the display unit 13 in real time, and the native speaker's pronunciation to the speaker SP (voice DB 34d). This function allows the learner to listen to the native speaker's pronunciation along with the music along with the video, and to learn the pronunciation without boring while following a predetermined interval (for example, 1.2 seconds).

The multimedia book function 35ad is a function of outputting a word and a related image included in the content by one cut on the screen of the display unit together with the voice file.

The vocabulary function (35ae) is a function that allows you to view the headwords and corresponding information (such as etymology, derivatives, synonyms, antonyms, idioms, etc.) included in the contents in the form of an e-book.

Example sentence function (35af) is a function that outputs a sentence made of the headword included in the content, can be learned by matching the pronunciation of the accompaniment and native speakers, can collect and learn only the desired sentences.

The game function 35ag is a function of simultaneously outputting the correct answer and the wrong answer of the language included in the content on the display unit and allowing the learner to select one of them, and the evaluation unit 12 calculates a score according to the number of the incorrect answer and the correct answer.

In the customized learning content storage 35b, music-based multimedia content generated by matching a word or accompaniment designated by a learner through wired / wireless communication networks 20a and 20b with a related image in the application server 33 is stored for each learner.

In the recording information storage 35c, the learner-generated customized learning content or the pre-provided recommended learning content is played through the learner terminals 10a, 10d, 10d, and the learner's pronunciation is voice data for each learner. Is stored in the form.

5 is a configuration diagram of the application server shown in FIG. 1.

As shown, the application server 33 includes a learner authentication module 33a, a content generation module 33b, a visualization module 33c, and a learning management module 33d.

The learner authentication module 33a checks and authenticates through simple learner information to check whether the language learning platform 30 is allowed to access, and manages new learner registration.

When the learner selects a word or sentence and an accompaniment through the web server 31 and requests the generation of customized learning content, the content generation module 33b corresponds to data corresponding to data in the content DB 34 to generate the requested content. File (word DB 34a, sentence DB 34b), accompaniment file (accompaniment DB 34c), voice file (voice DB 34d) and related image file (related image DB 34e) To generate and store the generated multimedia content in the customized learning content storage 35b of the storage 35 together with the content list for each learner so that they can be played at any time.

At this time, depending on how much the user wants to set the interval of voice file of each word (for example, one beat or two beats) and which pitch type (basic type, change type, etc.) Even if the same combination or the same word list, different accompaniment may be selected to generate completely different content.

In addition, since the playing time of the accompaniment is approximately 1 to 2 minutes, the number of words is selected according to the playing time of the accompaniment.

The visualization module 33c includes a graph management module 33ca, a typography management module 33cb, and a game module 33cc.

The graph management module 33ca is provided when the learner connects to the language learning platform 30 and learns the language, and the voice file and the content DB input through the microphone MIC of the learner terminal 10 while maintaining the connection. Visualize the voice files of native speakers stored in 34) and display them in a graph. The learner's pronunciation is evaluated by the similarity between the height, thickness and time of the two graphs.

The typography management module 33cb is an algorithm for visualizing the text of a word when generating customized learning content. The typography management module 33cb includes a time value (for example, 0.6 or 1.2 seconds) at which a word and a meaning are displayed on a display unit. It contains the direction, speed, and animation values per effect as words and meanings enter the frame.

The game module 33cc provides a video game by utilizing various question-taking methods based on the data of the content DB 34.

The learning management module 33d includes a learning progress management module 33da, an evaluation management module 33db, and a recommended learning management module 33dc.

The learning progress management module 33da manages the overall progress according to the learner's learning level.

Evaluation management module (33db) manages the information on the assessment for each learning level.

The recommended learning management module (33dc) provides a content recommendation list according to the learner's level and learning evaluation result, and manages the list so that the user can store and manage individual customized learning content.

6 is a flowchart illustrating a language learning method according to a first embodiment of the present invention.

First, the learner terminal (10a, ..., 10d) requests a connection to the web server 31 of the language learning platform 30 through the wired or wireless communication network (20a, 20b) (S602).

Web server 31 provides a user interface (User Interface) to the learner terminal (10a, ..., 10d), the learner terminal (10a, ..., 10d) inputs the ID and password through the input unit 12 to the application server When the learner authentication is requested at 33, the learner authentication module 33a of the application server 33 checks the authentication information at the learner DB 36 and then connects the learner terminals 10a,. Allowed (S604).

The learner terminals 10a, ..., 10d select a mode to be learned through the input unit 12 from the mode selection window output to the display unit 13 by the provision of the web server 31 (S606).

For example, if a learner wants to learn by specifying words, sentences, and accompaniment, select a custom learning mode, and the pre-stored content (completed recommended learning content provided by the learning information provider, or the learner customizes it). If you want to learn using the custom learning content stored in the parasitic mode through the mode, select the recommended learning mode.

When the customized learning mode is selected, the learner terminal 10a, ..., 10d selects (specifies) a word or sentence and accompaniment through the user interface (S607), and requests the application server 33 to generate the customized learning content. (S608).

At this time, when the electronic dictionary (word DB 34a and sentence DB 34b) provided by the language learning platform 30 is outputted on the display unit 13, the learner designates a desired word or sentence through the input unit 12 to learn the list. Create and save a learning list by entering its name.

The content generation module 33b of the application server 33 extracts a corresponding text file (words and sentences), a related image file, a voice file, and an accompaniment file from the content DB 34 to generate multimedia content, and the storage 35 After storing the customized learning content (in this case, the physical storage location and the reproduction function information are provided from the storage 35 to the application server 33), and completing the creation of the customized learning content on the learner terminals 10a, ..., 10d. While notifying and requesting a playback method (S610).

The learner terminal 10a, ..., 10d selects a playback method and then selects either playback or user storage through the user interface provided by the web server 31 (S612).

If the immediate playback is selected, the web server 31 requests the immediate playback from the application server 33, and the application server 33 based on the physical storage location and the playback function information provided from the strobe 35 in step S610. By requesting playback information from the storage 35 and allowing playback, the learner terminals 10a,..., 10d play the customized learning content in real time through the media server 32 (S614).

In this case, when the customized learning content generated by designating a word is played, the display unit 13 outputs an image of the corresponding word at intervals of 2.4 seconds, for example, with the text (see FIGS. 9A to 9C). ), The word speech file is output at intervals of, for example, 2.4 seconds in accordance with the specified accompaniment.

In addition, when the customized learning content generated by the selection of the word + meaning option is output, the display unit 13 outputs an image of the corresponding word at intervals of 2.4 seconds with the text, for example, through the speaker SP. The word speech file and the meaning speech file are output at 1.2 second intervals, for example, in accordance with the specified accompaniment.

In addition, when the customized learning content generated by the selection of the sentence option is output, the display unit 13 outputs the image of the corresponding sentence together with the text, and the voice file of the sentence is transmitted to the designated accompaniment through the speaker SP. The output is correct.

At this time, the output interval (blank) between the specific sentence and the next sentence adds 2 seconds to the length (time) of the specific sentence so that the learner can follow the native speaker's voice.

The application server 33 of the language learning platform 30 can apply a typography (text image with visual effect) to the sentence, extracting the pitch information, the volume information, and the time information from the voice file of the sentence. The extracted information may be reflected in the text, and the pitch of the pitch may be reflected in the height of the text so that the curve may be generated in the text, and the text may be output to the display unit 13 by varying the thickness of the text according to the degree of volume.

In addition, when the customized learning content generated by the selection of the sentence + translation option is output, the display unit 13 outputs the image of the corresponding sentence together with the text, and the native speaker voice file and the translation through the speaker SP. The audio file is output in accordance with the specified accompaniment.

This allows learners to listen to the native speaker's voice or meaning (translation) with their accompaniment, to see text and related images with their eyes, and to follow them through their mouths. Experience three-dimensional learning.

That is, they naturally learn spontaneous and self-directed language as if they are singing.

At this time, the learner's voice is input through the microphone (MIC) and is recorded by the learner in the storage 35 through the voice processor 14 and stored as voice data (S616).

The media server 32 of the language learning platform 30 provides the learner's pronunciation to the learner terminals 10a, 10d, and outputs the recorded pronunciation of the learner along with the native speaker's pronunciation through the speaker SP. The pronunciation difference can be compared audibly (S618).

At this time, through the graph management module 33ca of the application server 33 extracts the pitch, volume, and playing time information from the native speaker and learner's voice file to generate an ignition curve graph, the pitch is high and low, the volume is the thickness of the ignition curve graph The reproduction time is displayed on the display unit 13 to indicate the length so that the pronunciation difference between the native speaker and the learner can be visually compared (S620).

In addition, the evaluation management module 33db of the application server 33 calculates a score by comparing the similarity between the native speaker and the learner's speech curve graph (S622).

On the other hand, when the user storage is selected in step S612, when the web server 31 requests the user server to store the user (S632), the application server 33 stores the user of the customized learning content file in the storage 35. Request, whereby the storage 35 provides storage location information to the application server 33, and the application server 33 allows the learner terminals 10a, ..., 10d to drive the file transfer protocol for download. The learning content is downloaded and stored in the memory unit 16 of the learner terminal (S634).

According to the language learning method according to the first embodiment as described above, when the learner designates a word or sentence and accompaniment using the user interface of the learner terminal 10a, ..., 10d, the word specified by the language learning platform 30 Creates music-based customized learning content that matches sentences and accompaniment with images and provides them to learner terminals 10a, 10d to sing words, sentences, and meanings by the learner's designation through wired and wireless communication networks 20a and 20b. You can learn (memorize) as you do.

7 is a flowchart illustrating a language learning method according to a second embodiment of the present invention.

When the recommended learning mode is selected in step S606 of FIG. 6, the display unit 13 outputs a learning level selection window provided by the language learning platform 30 (see FIG. 10A), and the learner learns his or her own learning through the input unit 12. Select a level (S702).

Here, the learning level is input by the user through the initial authentication or change at any time to learner information (elementary school students, middle school students, high school students, TOEIC / TOEFL) information in the learner DB, or learning by analyzing the learning activity through the input learning information and learning evaluation It can be determined according to the degree of (beginner, intermediate, advanced).

When the learning level is selected, a plurality of content lists corresponding to the selected learning level provided by the language learning platform 30 are output on the display unit 13 (see FIG. 10B), and the learner selects one content through the input unit 12. (S704).

At this time, without going through step S702, the recommended learning management module 33dc of the application server 33 may check the learner's learning level in the learner DB 36 and then output the recommended learning content suitable for the learning level to the display unit 13. have.

Here, the content is composed of learning music contents that are composed of songs with accompaniment or parts of words combined with parts of speech, and the basic form of the song is a method of alternating words and meanings, and the time output between words and meanings. The interval is 0.5 to 0.7 seconds.

After the content is selected, the display unit 13 outputs a learning function list corresponding to the content provided by the language learning platform 30 (see the bottom of FIG. 10B), and the learner learns the selected content through the input unit 12. (S706).

Here, the function to learn the content includes a video, section practice, pronunciation practice, multimedia book, vocabulary, example sentences, games.

When one of the learning functions of the content is selected, the selected content is provided to the learner terminals 10a, ..., 10d in the language learning platform 30 differently for each learning function through the speaker SP and the display unit 13. It is reproduced (S708).

When the video function 35aa is selected, a video file in which an image or typography meaning each word is matched to the content is output (see FIG. 10C).

If the section practice function 35ab is selected, the content is divided into predetermined sections (for example, eight sections), and prerecorded songs (audio data) are output to the speaker SP together with accompaniment, meaning each word. The image and the text are output to the display unit 13 (see FIG. 10D).

At this time, the learner listens and sings along with the native speaker's song, but the color of the text displayed on the display unit 13 is different before starting the song and when the native speaker sings and the user sings to avoid confusion in learning. do.

When the pronunciation practice function 35ac is selected, the content is divided into predetermined units and the native speaker's pronunciation is output, but options such as word, word + meaning, unaccompaniment, and screen off can be selected.

In this case, the display unit 13 outputs the relevant image of the word at a predetermined interval (for example, 2.4 seconds) along with the text, and the speaker SP outputs the accompaniment and pronunciation of the native speaker at a predetermined interval (for example, 2.4 seconds). .

If the word + meaning is selected, the display unit 13 outputs the relevant image of the word at a predetermined interval (for example, 2.4 seconds) together with the text (see FIG. 10E), and the speaker SP includes the pronunciation and meaning voice file of the native speaker. The accompaniment is output at predetermined intervals (for example, 1.2 seconds).

At this time, the learner learns (memorizes) words and meanings by accommodating the pronunciation and meaning voice files of native speakers in accompaniment.

When the unaccompaniment is selected, the audio file is output to the speaker SP without accompaniment, and the image and text are output to the display unit 13.

When the screen off is selected, only the voice file and the accompaniment are output through the speaker SP.

When the multimedia book function 35ad is selected, the relevant image of the words included in the content is output by the cut to the display unit 13, and the native speaker's pronunciation is output to the speaker SP accordingly.

At this time, a word is output by one cut by the learner's selection, or the same word is repeatedly output.

Options of the multimedia book function 35ad include a native speaker's pronunciation, a song, a silence, information, and an overall view.

When the native speaker is selected, the native speaker's pronunciation of the corresponding word is output through the speaker SP every time the learner makes a cut.

When the song is selected, a song of the corresponding word is output through the speaker SP every time the screen of the display unit is turned by one cut.

If the mute is selected, no sound is output even when the learner touches the screen of the display unit 13.

When the information is selected, the information window (origin, derivative, synonym, antonym, idiom, etc.) of the corresponding word is displayed on the display unit 13 (see FIGS. 10F and G).

When the entire view is selected, screenshots corresponding to the words constituting a piece of content are output to the display unit (see FIG. 10H).

Select this overview to scroll through the screen to quickly find the words you want.

When the wordbook function 35ae is selected, the headword and the corresponding information (the etymology, the derivative, the synonym, the antonym, the idiom, etc.) included in the selected content are output through the display unit 13 and the speaker SP (see FIG. 10I). .

In this case, the learner checks only the unknown word, and outputs only the checked word and the corresponding information through the display unit 13 and the speaker SP.

When the example sentence function 35af is selected, a sentence made of a headword included in the selected content is output through the display unit 13 and the speaker SP.

In this case, the learner may check only the sentence to be learned and output only the checked sentence and its translation through the display unit 13 and the speaker SP.

The example sentence function (35af) can be learned by matching the pronunciation of the accompaniment and native speakers, it can also learn by collecting only sentences.

When the game function 35ag is selected, the correct answer and the wrong answer of the language included in the content are simultaneously output to the display unit 13 (see FIG. 10J).

At this time, the learner clicks what he thinks is the correct answer according to the beat. After the game, the evaluation unit 17 or the evaluation management module 33db of the application server 33 calculates a score according to the number of incorrect answers and correct answers. This is stored in the memory unit 16 or the learner DB 36.

The learner follows the pronunciation of the native speaker according to the selected learning function, and the learner's pronunciation or meaning (translation) is input through the microphone (MIC), recorded by the learner in the storage 35 through the voice processor 14, and voice data. It is stored as (S710).

When the word is selected as an option in the pronunciation practice function (35ac), the accompaniment and the pronunciation of the native speaker are output at a predetermined interval (for example, 2.4 seconds) through the speaker SP. Follow the pronunciation, which is input through the microphone (MIC) is stored in the storage 35, the recording for each learner, voice data.

The media server 32 of the language learning platform 30 provides the learner's pronunciation to the learner terminals 10a, 10d, and outputs the recorded pronunciation of the learner along with the native speaker's pronunciation through the speaker SP. The pronunciation difference can be compared audibly (S712).

At this time, the graph management module 33ca of the application server 33 extracts pitch, volume, and playback time information of native speakers and learner's pronunciations to generate an utterance curve graph, the pitch being high and low in the utterance curve graph, the volume being the thickness, The reproduction time is displayed on the display unit 13 by indicating the length so that the pronunciation difference between the native speaker and the learner can be visually compared (S714).

The graph management module 33ca of the application server 33 calculates a score by comparing the similarity between the native speaker and the learner's speech curve graph (S716).

According to the language learning method according to the second embodiment as described above, the recommended learning content consisting of a learning music content made of songs along with accompaniment of a plurality of words or parts of words stored in the language learning platform 30 combined with accompaniment Through the learner terminals 10a, ..., 10d, they can be used as various learning functions to learn (memorize) the words and sentences as they sing pronunciation and meaning (translation or meaning).

10: learner terminal 20: communication network
30: language learning platform 31: web server
32: media server 33: application server
34: content DB 35: storage
36: learner DB

Claims (17)

Designating words or sentences and accompaniment previously stored in a language learning platform by a learner terminal connected through a wired or wireless communication network;
Generating and storing music-based customized learning content as a voice file, a text file, a related image file, and an accompaniment file of a designated word or sentence in the language learning platform; And
Providing the customized learning content generated in the language learning platform to the learner terminal in response to the immediate playback request of the learner terminal to play the customized learning content in real time, and outputs the text and related images as a video through the display unit of the learner terminal, Music-based language learning method comprising the step of outputting a voice file and an accompaniment file through the speaker of the terminal. The method of claim 1,
When the text is output to the display unit, the language learning platform applies the volume information, the pitch information, and the time information in the voice file to typography to make the text thicker or thinner according to the volume level, and to increase or decrease the pitch. According to the music-based language learning method characterized in that the height of the text to increase or decrease to give the text alive. The method of claim 1,
Music-based language further comprising the step of allowing the file transfer protocol for downloading of the customized learning content generated in the language learning platform by the user request of the learner terminal to store the customized learning content in the learner terminal. Learning method. When the learning level is selected by the learner terminal connected through the wired / wireless communication network, the recommended learning consists of a learning music content made of songs along with accompaniment of a plurality of words in a part-of-speech or semantic unit suitable for the learning level in the language learning platform. Outputting a list of contents to a display unit of a learner terminal;
Outputting a learning function list of the content to the display unit of the learner terminal when the content of any one of the recommended learning content list is selected by the learner terminal; And
When the learning function of any one of the learning function list is selected by the learner terminal, the content of the content in the language learning platform is played through the learner terminal differently for each learning function, and the text and the related image are output as a video through the display unit. Music-based language learning method comprising the step of outputting a voice file and an accompaniment file through the speaker of the learner terminal. The method of claim 4, wherein
The learning function list includes a video function that outputs a video file matching images and typography meaning each word included in the content;
A section practice function of dividing the content into predetermined sections and outputting a native speaker's song to the speaker along with the accompaniment;
A pronunciation exercise function of dividing the content into predetermined units and outputting native speaker's pronunciation to a speaker;
The image of the word included in the content is output to the display unit by one cut, the speaker according to the multi-media book function to output the native speaker's voice or song,
A vocabulary function in which the headword included in the content and corresponding information (such as etymology, derivative, synonym, antonym, idiom, etc.) are output through the display unit and the speaker;
Example sentence function that the sentence made of the headword included in the content is output through the display unit and the speaker,
A music-based language learning method, characterized in that the content is made up of any one or more of the game function to output the correct answer and the wrong answer of the headword included in the content at the same time on the display unit. The method according to claim 1 or 4,
Storing the learner's pronunciation in the storage of the language learning platform for each learner when the learner follows the pronunciation;
And comparing the pronunciation of the stored learner with a native speaker's pronunciation through a speaker. The method according to claim 6,
Music-based language learning method, characterized in that for extracting the pitch, volume, and playback time information according to the pronunciation of the native speaker and learner in the language learning platform and outputs the comparison to the display unit in the ignition curve graph. The method of claim 7, wherein
In the language learning platform, the pitch is represented in the typography, the volume is the thickness, the playback time is the length of the native speaker and learner utterance curve graph of the music-based language learning method, characterized in that printed on the display. The method of claim 7, wherein
Music-based language learning method, characterized in that for comparing the curve graph of the native speaker and learner in the language learning platform and calculating the score according to the similarity. The method according to claim 1 or 4,
After the voice file of the word or sentence is output through the speaker, the meaning of the word or sentence is output through the speaker after 0.5 ~ 0.7 seconds. A language learning platform that generates a music-based customized learning content as a video by extracting a specified voice file, a text file, an image file, and a designated accompaniment file of a specified word or sentence, and stores them for each learner and provides them through a wired or wireless communication network;
Designate a word or sentence and accompaniment while connected to a language learning platform through the wired / wireless communication network, play customized learning content provided by the language learning platform, and output a voice file of a word or sentence through a speaker, and display unit An online learning system utilizing a music-based language learning method comprising a plurality of learner terminals outputting a text file and a related image file as a video. The method of claim 11,
The language learning platform further stores the recommended learning content consisting of learning music contents made of songs with accompaniment of a number of words or parts combined in a semantic unit for each learning level,
The language learning platform is an online learning system using a music-based language learning method, characterized in that the content of the recommended learning content to the learner terminal for each learning level or learning function differently provided. The method of claim 12,
The language learning platform manages the access of learner terminals connected through wired and wireless communication networks, and provides a user interface suitable for the environment of the learner terminals to provide a web server with a service management system for data transmission with the language learning platform. Wow,
A media server for streaming multimedia recommendation learning content and customized learning content to the learner terminal in real time;
An application server that provides various applications required for language learning services;
A content DB for storing information of words, sentences, accompaniment, voice, and related images for generating the customized learning content;
A storage that becomes a physical space for storing the recommended learning content, customized learning content, and recording information;
On-line learning system using the music-based language learning method comprising a learner DB for storing learner information, learning level information, learning management and evaluation information for learner authentication. The method of claim 13,
The application server is a learner authentication module for confirming and authenticating through learner information to confirm whether to allow access to the language learning platform, and manages new learner registration;
When requesting the creation of customized learning contents by selecting words or sentences and accompaniment through a web server, the corresponding data is fetched from the contents DB to generate the requested contents, the multimedia customized learning contents are generated, and the generated multimedia customized learning contents A content creation module that stores the content along with the content list in storage,
In the case of language learning while the learner terminal is connected to the language learning platform, the pitch of the pitch is displayed as a curve graph by comparing the voice stored in the learner terminal's microphone with the pronunciation stored in the content DB, and the similarity, height, and Graph management module that evaluates pronunciation by grading according to thickness, and visualizes the text of the word or sentence when matching words and sentences with related images and accompaniment when creating custom learning content A typography management module that outputs text at regular time intervals and emphasizes the size and color of words or sentences in the beat, and a video game that utilizes a touch interface or various question-taking methods using data of the content DB. A visualization module having a game module providing a scheme;
A learning progress management module that manages the entire learning process according to the learner's learning level, an evaluation management module that manages the information about the evaluation by learning level, and a content recommendation list according to the learner's level and the learning evaluation result. An online learning system utilizing a music-based language learning method comprising a learning management module having a recommended learning management module for managing a list so as to store and manage individual customized learning contents. 15. The method of claim 14,
The typography management module characterized in that the typography of a word or sentence is made thicker or thinner in accordance with the strength of the pronunciation, and the height or height of the font is increased or lowered depending on the height of the pronunciation to give life to the word or sentence. Online learning system using music-based language learning method. The method of claim 11,
When the learner listens to the learner's pronunciation and follows the pronunciation of the native speaker, the learner extracts the pitch, volume, and playing time information of the native speaker and the learner's pronunciation, and outputs the information to the display on a curve graph. A pitch extraction unit to indicate a playback time length;
On-line learning system using a music-based language learning method, characterized in that the evaluation unit for comparing the curve graph of the native speaker and the learner to evaluate the score according to the similarity. The method of claim 11,
The learner terminal is a dedicated terminal for each learning object, and the display unit is an online learning system using a music-based language learning method, wherein the screen supports a touch interface.

Images