KR101826714B1 - Foreign language learning system and foreign language learning method - Google Patents

Abstract

The foreign language learning system and foreign language learning method of the present invention will be disclosed. The foreign language learning system of the present invention is characterized in that, in the speech learning mode, a learning mode in which a learning system outputs speech data of native speakers and a learner follows them, and a conversation mode in which a learner is pronounced and a learning system outputs speech data , The learner can execute a more effective speaking learning method according to his or her choice. Further, the learning system of the present invention records the pronunciation of the learner on the pronunciation evaluation screen, compares the pronunciation of the learner with the pronunciation of the native speaker, and displays the result, thereby displaying the result of the learner's pronunciation to the learner. So that it is possible to confirm the results of the learning in the meantime, as well as the effect of improving the motivation to learn. Particularly, in a pronunciation evaluation screen, a learner can set a recording unit. When a learner selects "sentence / phrase" as a recording unit, the learner's pronunciation is recorded in the corresponding unit, By comparing the pronunciation of the native speaker with the pronunciation of the native speaker, the learners who have difficulty in completely pronouncing a sentence can use the learning system without any sense of refutation, thereby making it possible to continuously perform speaking learning. In addition, by using song or video contents familiar to the learner, it is possible to minimize a feeling of rejection against a foreign language and to create a comfortable learning environment.

Description

[0001] The present invention relates to a foreign language learning system and a foreign language learning method having a speech learning function,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a foreign language learning system and a foreign language learning method, and more particularly, to a foreign language learning system and a foreign language learning method having a speaking learning function using an electronic device.

Various foreign language learning materials such as Chinese, Japanese, and the like are being put on the market in accordance with the trend of internationalization. Due to the spread of portable electronic devices, various contents capable of performing foreign language learning in portable smart devices have been recently provided .

However, such foreign language learning contents merely provide a function of reproducing foreign language texts, pronunciation of native speakers, and instructor's lecture contents to the user through a video player such as a smart phone, and the learner can perform self- Function.

For example, when watching foreign language video contents, which is the most widely-used foreign language learning method, the learner can listen to, read, speak, write while reading and learning, which are four areas of foreign language learning, There was an impossible problem.

Especially, in order to learn the foreign language speaking area, the learners have to register with the foreign language institute by paying expensive tuition and take conversational classes with native speakers. Even if they register to the institute, there are many time restrictions on visiting the institute. There were problems that were difficult to perform speaking learning.

A problem to be solved by the present invention is to provide a foreign language learning system and a learning method provided with a speaking learning function capable of learning a foreign language speaking area by itself using a portable electronic device.

According to a preferred embodiment of the present invention, there is provided a foreign language learning system comprising: a database for storing foreign language text data and voice data pronounced by a native speaker in a unit of a word; A display unit for outputting the foreign language text; An acoustic output unit for outputting the voice data; An input unit for receiving setting information and selection information from a learner; And a speaking module for executing a conversation mode in which a learner and a foreign language learning system alternately perform speaking learning by pronouncing a foreign language text, wherein the speaking module is configured to allow a learner to learn a foreign language text System waiting time) has elapsed, audio data corresponding to the foreign language text of the next learning unit is output through the sound output unit.

According to a preferred embodiment of the present invention, the speaking module selects the conversation mode or the following reading mode according to a user's selection, and in the following reading mode, outputs voice data corresponding to a foreign language text through the sound output unit After the learner waits for a time (system waiting time) for pronouncing the same foreign language text, voice data corresponding to the next foreign language text can be output through the sound output unit.

In addition, the speaking module according to a preferred embodiment of the present invention can classify the foreign language text into units of learning units of any one of words, phrases, sentences, and paragraphs.

The speech module according to the preferred embodiment of the present invention may output the voice data through the display unit by inverting the foreign language text corresponding to the voice data in a text unit set by the user.

Further, the speech module according to the preferred embodiment of the present invention can output speech data in accordance with the speech output speed set by the learner.

In addition, the system standby time according to the preferred embodiment of the present invention can be calculated according to the output time and voice output speed of voice data corresponding to the foreign language text to be pronounced by the learner.

In addition, the speech module according to the preferred embodiment of the present invention can output words through words, phrases, sentences, and paragraphs of words to be pronounced by the learner in the system standby time and output the words through the display unit.

In addition, the speech module according to the preferred embodiment of the present invention compares the learner's pronunciation with voice data when the learner pronounces, calculates the similarity degree, and when the similarity degree is equal to or greater than a preset value, the system outputs voice data .

The speech module according to a preferred embodiment of the present invention activates a pronunciation evaluation screen to output a text set to the dictionary to a learner, And calculates the similarity between the pronunciation of the learner and the voice data, and outputs the result through the display unit.

Further, in a preferred embodiment of the present invention, the unit for inputting the pronunciation of the learner on the pronunciation evaluation screen is set to any one of a word, a phrase and a sentence. When the set unit is a word or phrase, And outputs the speech data corresponding to the text, receives the pronunciation of the learner, and receives the pronunciation of the learner for all words or all phrases displayed on the pronunciation evaluation screen , And the similarities can be calculated by combining the pronunciation of the input learners.

Further, in a preferred embodiment of the present invention, when the foreign language text is a song lyrics, the voice data corresponding to the song lyrics is classified into an actual song sound source and a general sound source including a tone rate, According to the setting, audio data can be outputted from the actual song sound source or general sound source.

Further, the speech module according to a preferred embodiment of the present invention includes: a rate setting unit that receives an output speed (voice output speed) of voice data from a learner; And a speaking mode including a conversation mode and a reading mode from the learner via the input unit. In the conversation mode, when a time (system waiting time) for the learner to pronounce the foreign language text has elapsed, In the reading mode, the voice data corresponding to the foreign language text is output through the sound output unit, and after the learner waits for the time (system waiting time) for pronouncing the same foreign language text, And a speech controller for outputting the voice data corresponding to the foreign language text through the voice output unit and adjusting the system standby time according to the time of outputting the voice data and the voice output speed.

Further, the speech module according to a preferred embodiment of the present invention includes: a recording unit for recording a pronunciation of a learner; And a similarity evaluating unit comparing the pronunciation of the learner inputted from the recording unit with the speech data to evaluate the similarity, and the speaking controller may output the evaluation result of the similarity evaluating unit through the display unit.

Further, the speech module according to a preferred embodiment of the present invention includes: a recording unit for recording a pronunciation of a learner; And a transmission / reception unit for transmitting a pronunciation of the learner inputted from the recording unit to a similarity evaluation server and receiving a similarity evaluation result from the similarity evaluation server, wherein the speaking control unit stores the similarity evaluation result inputted from the transmission / Can be output through the display unit.

According to another aspect of the present invention, there is provided a foreign language learning method comprising the steps of: (a) outputting a foreign language text of a content selected by a learner; (b) receiving a learning mode, a speech output speed, and a learning unit from a learner, and inputting a conversation mode or a follow-up mode from a learner when the learning mode input by the learner is a speaking mode; And (c) when the learner selects the conversation mode, the learner and the foreign language learning system alternately execute the conversation mode in which the foreign language text corresponding to the learning unit is pronounced to perform speaking learning, And when the time to be sounded (system standby time) elapses, the foreign language learning system outputs voice data corresponding to the foreign language text of the next learning unit.

(D) when the learner selects the following mode, the learning system outputs the speech data corresponding to the foreign language text according to the learning unit, and when the learner selects the same foreign language Outputting voice data corresponding to the next foreign language text after waiting for a time for which the text is to be pronounced (system standby time).

Further, in the foreign language learning method according to the preferred embodiment of the present invention, the learning unit may be any one of a word, a phrase, a sentence, and a paragraph.

In addition, the foreign language learning method according to the preferred embodiment of the present invention can output the foreign language text corresponding to the voice data in a text unit set by the user when the voice data is output.

Further, the foreign language learning method according to the preferred embodiment of the present invention can output the speech data according to the speech output speed set by the learner.

Also, in the foreign language learning method according to the preferred embodiment of the present invention, the system standby time may be calculated according to the pronunciation time and the voice output speed of the voice data corresponding to the foreign language text to be pronounced by the learner.

In addition, the foreign language learning method according to the preferred embodiment of the present invention can display words in words, phrases, sentences, or paragraphs to be pronounced by the learner in the system standby time.

Further, in a foreign language learning method according to a preferred embodiment of the present invention, when the learner pronounces, the pronunciation of the learner is compared with the voice data to calculate the similarity degree, and when the similarity degree is equal to or greater than a preset value, can do.

In addition, a foreign language learning method according to a preferred embodiment of the present invention includes switching to a pronunciation evaluation screen when reaching a foreign language text set in advance in a pronunciation evaluation area, outputting the preset text to a learner, The pronunciation of the learner and the similarity of the voice data can be calculated and the result can be displayed.

Further, a foreign language learning method according to a preferred embodiment of the present invention is characterized in that a unit for inputting a pronunciation of a learner on the pronunciation evaluation screen is set to one of words, phrases and sentences, and when the set unit is a word or phrase, The speech data corresponding to the text is output, and then the pronunciation of the learner is input. Then, for all the words or phrases displayed on the pronunciation evaluation screen, the learner The pronunciation of the input learner can be combined to calculate the similarity.

According to a preferred embodiment of the present invention, when the foreign language text is song lyrics, the audio data corresponding to the song lyrics is classified into a song sound source and a general sound source including a tone rate, And outputting voice data from the song sound source or the general sound source in accordance with the setting of the learner between the step (c) and the step (c).

The foreign language learning system of the present invention provides a learning mode in which a learning system outputs speech data of native speakers and follows a learner, and a conversation mode in which the learner is pronounced and the learning system outputs speech data Thus, the learner can execute the speech learning method more effectively in accordance with his or her choice.

Further, the learning system of the present invention records the pronunciation of the learner on the pronunciation evaluation screen, compares the pronunciation of the learner with the pronunciation of the native speaker, and displays the result, thereby displaying the result of the learner's pronunciation to the learner. So that it is possible to confirm the results of the learning in the meantime, as well as the effect of improving the motivation to learn.

Particularly, in a pronunciation evaluation screen, a learner can set a recording unit. When a learner selects "sentence / phrase" as a recording unit, the learner's pronunciation is recorded in the corresponding unit, By comparing the pronunciation of the native speaker with the pronunciation of the native speaker, the learners who have difficulty in completely pronouncing a sentence can use the learning system without any sense of refutation, thereby making it possible to continuously perform speaking learning.

In addition, by using song or video contents familiar to the learner, it is possible to minimize a feeling of rejection against a foreign language and to create a comfortable learning environment.

1 is a block diagram showing a configuration of a foreign language learning system according to a preferred embodiment of the present invention.
2 is a diagram showing a structure of learning contents stored in a database according to a preferred embodiment of the present invention.
3 is a block diagram illustrating a detailed configuration of a learning management module according to a preferred embodiment of the present invention.
4 is a diagram showing an example of a word learning menu displayed to a learner according to a preferred embodiment of the present invention.
FIG. 5 is a diagram showing an example of execution of a reading module according to a preferred embodiment of the present invention.
6A and 6B are diagrams showing examples of execution of a writing module according to a preferred embodiment of the present invention.
7 is a diagram showing an example of execution of a listening module according to a preferred embodiment of the present invention.
FIG. 8A is a block diagram showing a detailed configuration of a speaking module according to a preferred embodiment of the present invention, and FIGS. 8B to 8L are diagrams showing examples of learning of the speaking module.
FIG. 9A is a flowchart for explaining a foreign language learning method according to a preferred embodiment of the present invention, and FIG. 9B is a detailed flowchart of the step S940 shown in FIG. 9A.
10A to 10C are detailed flowcharts illustrating the step S914 shown in FIG. 9A in detail.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a foreign language learning system according to a preferred embodiment of the present invention.

Referring to FIG. 1, a foreign language learning system according to a preferred embodiment of the present invention can be implemented with software installed in a portable electronic device such as a smart phone, and includes an input unit 110, a display unit 120, 130, a control unit 200, and a database 300.

The input unit 110 receives the selection information from the learner and outputs the selected information to the control unit 200. The display unit 120 outputs the foreign language text data output from the control unit 200 to the learner. The input unit 110 and the display unit 120 may be implemented with a touch panel installed in a portable electronic device.

The sound output unit 130 is implemented by a speaker and outputs voice data in which foreign language text data input from the control unit 200 is pronounced by the native speaker.

The database 300 includes a learning content storage unit 310, a learning data storage unit 320, and a dictionary data storage unit 330.

The learning content storage unit 310 stores a foreign language learning content to be displayed to the learner. The learning contents include foreign language text data to be displayed to the learner through the display unit 120 and voice data in which the corresponding text is pronounced by the native speaker. In addition, the learning contents store time information of the voice data corresponding to each word of each foreign language text, and store the start time information and the end time information in which the words are pronounced together.

2 is a diagram showing the structure of learning contents stored in the database 300 according to a preferred embodiment of the present invention.

Referring to FIG. 2, foreign language text data 311 is stored in the learning content storage unit 310, and the voice data 312 in which the corresponding text is pronounced by the native speaker is stored. In addition, time information (timing information) 313 indicating the start time and the end time at which the word is pronounced is stored in association with the text data and the voice data for each word included in the text data.

For example, the word "kingdom" among the words included in the text data can be known from the speech data for the entire sentence, and the pronunciation starts at time 0013 and ends at 0019. Therefore, the time information of "kingdom " is stored (start time: 0013, end time: 0019).

Likewise, the word "far" is stored (start time: 0019, end time: 0021), and other words are stored in association with time information corresponding to the voice data in the same manner.

In addition, the learning contents may include not only general sound source data in which plain text data and plain text are pronounced by native speakers but also lyrics and song sound source data, and a movie (or a drama) and a movie (or drama) animation. That is, the lyrics of the song are stored as foreign language text data, and the genre source data or song lyrics can be stored in association with the song lyrics text, and the genre text of the movie (or drama) And corresponding moving picture data may be stored in association with each other. Hereinafter, general voice data associated with plain text, song sound source data associated with song lyrics, and moving image data associated with a movie (or drama) will be collectively referred to as voice data.

On the other hand, the learning data storage unit 320 stores wordbook data that the learner selects words during learning and inputs meaning of the words, scrap memo data generated by the learner during learning, and the like.

The dictionary data storage unit 330 stores dictionary data including a plurality of words, pronunciation symbols and meaning of each word, idioms, and the like. The learner can instantaneously select an unknown word during learning and confirm the word stored in the dictionary data storage unit 330. [

The control unit 200 includes a word management module 250, a learning management module 260, a reading module 210, a writing module 220, a listening module 230, and a speaking module 240. 3, the word management module 250 includes a listening function unit 251, a yaw sound listening function unit 253, a dictionary function unit 255, a wordbook function unit 257, (259).

The reading module 210, the writing module 220, the listening module 230, and the speaking module 240 are activated according to the learning mode set by the learner to execute the corresponding learning function, The management module 260 is activated when the learner selects a word or selects the learning menu during execution of the learning mode, and provides the learner with a function corresponding to the menu selected by the learner.

FIG. 3 is a block diagram illustrating a detailed configuration of a word management module 250 according to a preferred embodiment of the present invention. FIG. 4 illustrates an example of a word learning menu displayed to a learner according to a preferred embodiment of the present invention. FIG.

Referring to FIGS. 3 and 4, the function of the word management module 250 of the present invention will be described. As shown in FIG. 4, in a text displayed to a learner during learning, When a word is selected, the word management module 250 is activated and a word learning menu as shown in Fig. 4 is displayed on the display unit 120. [

When the learner selects the scrap menu, the scrap function unit 259 is activated, receives the learner's memo from the learner, and stores it in the learning data storage unit 320. [

When the learner selects the wordbook menu, the wordbook function unit 257 is activated to display the dictionary data and display it to the learner, and the meaning displayed in the meaning input field is filled so that the meaning of the dictionary can be stored. And stores the meaning of the dictionary and the meaning inputted in the learning operation in the learning data storage unit 320. [

When the learner selects the dictionary menu, the dictionary function unit 255 is activated to look up words selected by the learner among the words stored in the dictionary data storage unit 330, Symbols, idioms, etc. are displayed to the learner.

On the other hand, when the learner selects the listening menu, the listening function unit 251 is activated, and outputs the voice data stored in the learning content storage unit 310 to the learner through the sound output unit 130 in association with the corresponding word. As described above, the listening function unit 251 reads the start time and the end time stored in association with the selected word, and outputs the voice data corresponding to the corresponding time. In the example shown in Fig. 2, if the learner selects "kingdom" and selects the listening menu, voice data corresponding to the time from 0013 to 0019 of voice data is output.

In addition, when the learner selects the menu for listening to the tune, the tune listening function unit 253 is activated to select not only the words selected by the learner but also the preceding and succeeding words of the corresponding words, And outputs the voice data stored in the storage unit 310 to the learner through the sound output unit 130. [ In the example shown in Fig. 2, if the learner selects "kingdom " and selects the menu for listening to the praise," a " The audio data corresponding to the time from the start time 0012 to the end time " 0021 " of "far"

Referring again to FIG. 1, the reading module 210 of the control unit 200 is a module for executing a learning mode so that a learner can perform direct and direct exercises by himself / herself. Referring to FIG. 5, the reading module 210 reads text data from the learning content storage unit 310 and reads the text data from the learning content storage unit 310 The display unit 120, and displays the break reading units required for direct and indirect practice according to the learner's choice, in units of phrases or sentences. FIG. 5 shows an example in which the break is read on a per-sphere basis.

The writing module 220 of the control unit 200 displays the text data set in advance with the writing section through the display unit 120 and outputs the corresponding voice data together. When the writing section reaches the writing section while the voice data is being output, the writing module 220 displays the contents corresponding to the sentence to be written in the learner's native language while switching to the writing mode, and receives the learning foreign language corresponding thereto.

6A and 6B are diagrams showing an example of the execution of the writing module 220 according to the preferred embodiment of the present invention. Referring to FIGS. 6A and 6B, it is indicated that the red line is set as the writing section, and when the writing section such as "as Ella grew older" is reached while the voice data corresponding to the text is outputted, As shown in the figure, the learner selects a plurality of words in accordance with the order and executes the writing while switching to the writing screen. Here, although the learner can input the spelling every time, there is a disadvantage in that the learning time becomes longer in this case. In addition, the writing section may perform writing in units of phrases according to the learner's setting, or writing in units of sentences.

The listening module 230 of the control unit 200 inverts the text portion of the speech data output by the learner in units of words, phrases, or sentences, and outputs the reversed text portion through the display unit 120. In the example shown in Fig. 7, an example is shown which is set in units of sphere.

8A is a block diagram showing the detailed configuration of the speaking module 240 according to the preferred embodiment of the present invention, and FIGS. 8B to 8L are diagrams showing an example of learning of the speaking module 240. FIG. Hereinafter, a speech learning method of the present invention will be described with reference to Figs. 8A to 8L.

8A, a speaking module 240 according to a preferred embodiment of the present invention basically includes a speed setting unit 241, a recording unit 243, and a speaking control unit 245, and the similarity evaluating unit 247 -1) and a transmission / reception unit 247-2.

The speed setting unit 241 receives the speed (voice output speed) at which the voice data is output in the speaking learning mode through the input unit 110 from the learner.

The recording unit 243 receives the learner's pronunciation through the microphone 800, and temporarily stores the pronunciation in the storage memory in the learning system.

The similarity evaluator 247-1 compares the pronunciation of the learner received from the recording unit 243 with the speech data, and evaluates the degree of similarity indicating how much the pronunciation of the learner is similar to the pronunciation of the native speaker.

The transmission / reception unit 247-2 transmits the pronunciation of the learner input from the recording unit 243 to a similarity evaluation server (not shown) through a wired / wireless communication network, and receives the similarity evaluation result from the similarity evaluation server.

The speaking controller 245 selects one of the speaking modes including the conversation mode and the reading mode from the learner through the input unit 110 and selects a word, a phrase, a sentence and the like as a text unit in which the reading mode and the conversation mode are to be performed, One of the paragraphs is input.

In addition, the speaking controller 245 allows the learner and the learning system to alternately speak in a text unit in the conversation mode. When the time for the learner to pronounce the foreign language text (system standby time) has elapsed, the learner outputs the voice data corresponding to the foreign language text through the sound output unit 130.

In addition, the speech control unit 245 outputs the speech data corresponding to the foreign language text through the sound output unit 130 in the read mode, and waits for the learner to speak the same foreign language text (system waiting time) , And outputs the voice data corresponding to the next foreign language text through the sound output unit 130.

At this time, the system standby time is variably adjusted according to the time of outputting the voice data and the voice output speed.

8B to 8L, a learner selects a content (for example, Cinderella) to be learned first, a foreign language text is displayed as shown in FIG. 8B, In the setting menu 1110, the "speaking mode" is selected as the learning mode, the "following mode" 1130 is selected in the speaking learning mode, and the learning unit 1120 such as phrases, sentences and paragraphs is selected.

Further, the learner adjusts the audio output speed 1140 on the screen, and the speed adjusted by the learner is input to the speed setting unit 241. The learner can adjust the voice output speed to 0.8 times, 0.9 times, 1 time, 1.1 times, 1.2 times, etc. through the speed setting unit 241. [

Then, the speaking controller 245 extracts voice data corresponding to the text in the foreign language from the database, and sets the unit (word, sentence, or paragraph unit) set by the learner according to the voice output speed set by the speed setting unit 241 Through the sound output unit 130. The sound output unit 130 outputs the sound signal through the sound output unit 130. [ At this time, the speaking controller 245 can display a portion where the learner is listening to the current voice data by inverting a unit word, phrase, sentence, etc. in which the voice data is output.

After the speech data is output in units set by the learner, the speaking controller 245 waits for the time for the learner to pronounce the same foreign language text (system waiting time). At this time, the system standby time is calculated according to the pronunciation time and the voice output speed of the voice data corresponding to the foreign language text to be pronounced by the learner. For example, when the pronunciation time of the voice data pronounced by the native speaker is 10 seconds and the voice output speed is 1 time, the system standby time can be set to 10 seconds, and when the voice output speed is 0.8 time, Can be set to 12 seconds.

Thereafter, when the system standby time is over, the speaking controller 245 proceeds to the next unit of foreign language text, outputs the voice data corresponding to the foreign language text according to the voice output speed, reverses and displays the corresponding foreign language text . At this time, the speaking controller 245 can automatically control to proceed to the next text according to the preset setting, or when the learner actually pronounces the voice through the microphone 800 connected to the recording unit 243 Only the system wait time can be counted and passed to the next text. Further speaking, the speaking controller 245 records the actual pronunciation of the learner through the microphone 800, outputs the recorded voice to the similarity evaluator 247-1, and the similarity evaluator 247-1 It is also possible to skip to the next text only if the evaluated result is greater than or equal to a predefined threshold.

On the other hand, when the speaking control section 245 reaches a pronunciation evaluation sentence or a pronunciation evaluation phrase set in advance during the follow-up mode, the speech control section 245 performs pronunciation evaluation and outputs the result to the learner.

Specifically, the present invention allows the system manufacturer to set a sentence or phrase that is difficult to pronounce in advance as a pronunciation evaluation area, or to set a pronunciation evaluation area for a sentence or phrase that is difficult for a learner to empirically pronounce. The pronunciation evaluation area is displayed (for example, marked with a red underline) in the foreign language text displayed on the display unit 120 so as to be distinguished from other texts.

The speech control unit 245 displays a pronunciation evaluation page as shown in FIG. 8C when reaching a sentence or phrase corresponding to the pronunciation evaluation area during speech learning, or when the learner selects the sentence or phrase. Thereafter, when the learner presses the record button and pronounces the presented text, the recording unit 243 records the pronunciation of the learner and outputs it to the similarity evaluating unit 247-1, and the similarity evaluating unit 247-1 And the degree of similarity with the voice data of the native speaker can be evaluated and displayed to the learner. The similarity evaluation indicates the accuracy and fluency of the pronunciation as a score as shown in FIG. 8D. In addition, the learner can compare the pronunciation of the native speaker by listening to the navtive listening button and the You listening button.

If the similarity evaluating unit 247-1 is not implemented in the learning system due to the restriction on the system resource, the recording unit 243 outputs the learner's pronunciation to the transmitting and receiving unit 247-2, and the transmitting and receiving unit 247-1 -2) transmits the recorded data of the learner's pronunciation to the similarity evaluation server (not shown), receives the evaluation value evaluated by the similarity evaluation server, and outputs the result as shown in FIG. 8D.

In addition, in the example shown in FIG. 8C, pronunciation is recorded on a sentence-by-sentence basis. However, as shown in FIG. 8E, the learner can change the recording unit in units of phrases on the pronunciation evaluation screen.

8E, when the learner changes the recording unit to the phrase and presses the record button, the speaking controller 245 inverts the phrase to be recorded first and displays the corresponding voice data And outputs it to the learner. Thereafter, as shown in Fig. 8G, the learner's pronunciation starts to be recorded while outputting the microphone on the screen.

When the learner has pronounced the phrase and finishes the recording and presses the next button, the speaking controller 245 outputs the corresponding voice data while inverting the next phrase as shown in FIG. 8H, As indicated, the microphone is displayed to record the student's pronunciation. Here, instead of the learner pressing the next button, the speaking control unit 245 may detect the start and end of the learner's pronunciation through the recording unit 243, and may be automatically implemented in the next text unit.

When the recording is completed, the learner presses the recording stop button, and the speaking controller 245 clips only the pronunciation part of the learner from the recorded pronunciation data inputted from the recording part 243, And outputs the same to the similarity evaluating unit 247-1 or outputs it to the transmitting and receiving unit 247-2 in the same manner as described above to receive the similarity evaluation result, Display.

8J, the learner selects the conversation mode in the speaking mode, selects the text unit and the speech output speed, selects the first speaker as the learner or the system (shown as "funny lang" in Fig. 8J) Button is pressed, the speaking controller 245 allows the learner and the learning system to alternately pronounce on a word unit, a phrase unit, or a sentence unit selected by the learner.

For example, if the learner selects a sentence in units of speech, selects a learner as the first speaker, and then presses the play button, the speaking controller 245 controls the speech output speed and the output time of the speech data corresponding to the sentence to be pronounced by the learner Wait for the learner to pronounce the first sentence during the calculated system wait time.

At this time, the process of waiting the system is the same as the follow-up mode described above. That is, the speaking controller 245 may simply output the voice data of the next sentence after waiting for the calculated waiting time of the system, input the voice actually learned by the learner through the microphone, The pronunciation of the learner may be output to the similarity evaluator 247-1 to compare the pronunciation of the learner with the pronunciation of the native speaker to evaluate the similarity. If the evaluation result is equal to or greater than a predefined threshold value, Data can be output. It is also possible to count the system standby time from the point of time when the learner's pronunciation is detected, as in the case of the follow-up mode. In addition, words to be read by the learner can be reversed and displayed.

8J, the speaker control unit 245 switches the speaker from the learner to the system (indicated by "Funny Lang"), and outputs the voice corresponding to the next sentence And outputs the data through the sound output unit 130. At this time, the text corresponding to the output audio data can be reversed and displayed.

Thereafter, when the output of the speech data of the learning system is finished, the speaking controller 245 again changes the speaker from the system to the learner, and waits for the learner to pronounce the text of the next learning unit. For example, in the above example, the speaker is changed in real time so as to display the speaker to be pronounced. However, only the first speaker set by the learner may be displayed in the item displaying the speaker.

By repeating the above-described process, the conversation mode is performed. When the conversation mode is in progress, as in the following mode, pronunciation evaluation is performed when a predetermined pronunciation evaluation sentence or pronunciation evaluation word / phrase is reached, To the learner. The pronunciation evaluation process is the same as the above-described method with reference to Figs. 8C to 8I, and thus a detailed description thereof will be omitted.

On the other hand, in the speaking module 240, the contents used for learning may be simple text contents, or song contents combined with songs or video contents combined with moving pictures.

8K, the contents stored in the learning content storage unit 310 include a real music source corresponding to the song lyrics, and a general sound source in which the native song is pronounced by the native speaker are implemented as voice data Can be stored in association with each other.

When the content set by the learner is the song content, as shown in Fig. 8K, a book-shaped icon indicating a general sound source or a musical note icon indicating a song sound source is displayed on the menu item. When the learner selects the general sound source icon and performs the above-described follow-up mode, the voice data in which the song lyrics are pronounced by the native speaker is output, and the learner sounds accordingly.

If the learner selects the song sound source icon and performs the above-described follow-up mode, the following mode is performed in the same manner as described above, and the speech data output from the learning system is converted into actual speech data It differs only in that it is song data.

Similarly, as shown in FIG. 81, when the learner selects the song content as the learning content, selects the general sound source icon, and performs the conversation mode, as described above, in the order in which the system outputs the voice data, If the learner selects the song sound source icon and performs the above conversation mode, the conversation mode is performed in the same manner as described above, and the speech data output from the learning system is stored in the text Only the actual song data including the tone rate, which corresponds to the actual song data.

In a case where the learning content is a movie or a drama video, the video is displayed on the screen together with the subtitle and the learning system displays only the audio data of the actual movie or drama corresponding to the dialogue text and the video screen corresponding thereto And the remaining configuration is the same as described above.

The configuration and function of the foreign language learning system according to the preferred embodiment of the present invention have been described.

9A is a flowchart for explaining a foreign language learning method according to a preferred embodiment of the present invention, FIG. 9B is a detailed flowchart of the step S940 shown in FIG. 9A, FIGS. 10A to 10C are flowcharts showing the details of the step S914 shown in FIG. This is a detailed flow chart that explains

The functions performed in the foreign language learning method shown in Figs. 9A to 10C are overlapped with the functions performed in the foreign language learning system described with reference to Figs. 1 to 8L. 9A and 10C, the overall flow of the foreign language learning method according to the preferred embodiment of the present invention will be described.

First, when a learner selects a specific content by driving a foreign language learning system to use the foreign language learning method of the present invention, foreign language texts included in the selected content are output to the learner (S910).

Then, the learner inputs a learning mode (reading, writing, speaking, listening) on the screen (S912), and the foreign language learning system performs learning such as reading, writing, speaking, and listening in accordance with the learning mode selected by the learner S914). Learning contents to be performed in each learning mode are described above with reference to FIGS. 5 to 8L, and a characteristic speaking learning mode of the present invention will be described later with reference to FIGS. 10A to 10C.

Meanwhile, while performing the learning, the learner can select a word as shown in Fig. 4, and the foreign language learning system monitors whether the learner selects a word during learning (S916). When the learner selects a word , The word learning menu is displayed to the learner and the selection information is inputted (S920).

If the learner selects the dictionary function, the foreign language learning system retrieves the word selected by the learner from the dictionary data storage unit 330 and outputs it to the learner, and then proceeds to step S914 to re-execute the learning mode (S922).

If the learner selects the wordbook function, the foreign language learning system inputs the meaning of the word selected by the learner, stores it in the learning data storage unit 320, and returns to step S914 to re-execute the learning mode (S924).

If the learner selects the scrap function, the learner saves the memo in the learning data storage unit 320, and then returns to step S914 to re-execute the learning mode (S926).

If the learner selects the tune listening function, the foreign language learning system checks whether the word selected by the learner is the first word of the sentence or the last word of the sentence (S932).

If the word selected by the learner is the first word of the sentence, the foreign language learning system selects the word selected by the learner together with the next word, and if the word selected by the learner is the last word of the sentence, The learner selects the word and the immediately preceding word together (S934).

If the word selected by the learner is neither the first word of the sentence nor the last word of the sentence, the learner selects both the preceding word and the following word of the selected word (S936).

Thereafter, the foreign language learning system outputs sound source data for words selected by the learner and the foreign language learning system (S940).

On the other hand, if it is determined in step S920 that the learner has selected the listening function, the process proceeds to step S940 where the learner outputs sound source data only for words selected by the learner (S940).

In the method of outputting the sound source data, as described above, the start time and end time stored in association with the selected word or words are extracted, and word or tune listening is performed by outputting sound source data corresponding to the time.

As described above, through the steps S932 to S940, the learner can listen not only to the single pronunciation of the selected one word but also to the original pronunciation of the native speaker in the actual sentence, so that the learner can place the selected word in front of and behind It is possible to listen to the pronunciation that is changed in relation to the words that have been learned, thereby learning more realistic pronunciation.

Meanwhile, as described above, the learning contents of the present invention may be plain text, but may be song contents or movie (or drama) video contents. 9A, if the plain text content and the song content are stored together in the learning content storage unit 310, step S940 shown in FIG. 9A may be implemented as shown in FIG. 9B.

Referring to FIG. 9B, the foreign language learning system first checks whether the selected content is the song content (S941). If the selected content is the song content, it examines the type of the sound source to be output (S943). The sound source format to be output can be selected by the learner or set in advance.

If the sound source type to be output is a song sound source, the foreign language learning system outputs corresponding sound data corresponding to the selected word from the corresponding song sound source data stored in the learning content storage unit 310 (S945).

If the learning content is the song content but the learner is set to output it as a general sound source, or if the learning content is the plain text content as a result of the examination in step S941, the audio data of the time corresponding to the words selected from the general sound source is output S947).

In the above examples, it has been described that the voice data is outputted. However, in the case where the learning content is the movie (or drama) dialogue text and the video data associated therewith, Or drama) If one or more words are selected while listening to a moving picture and listening to the praise is selected, in the same manner as that of outputting the above-mentioned voice data, a moving picture portion corresponding to the word from the front word to the rear word of the selected one or more words is reproduced .

It should be noted that steps S916 to S940 described above have been described after step S914 for convenience of explanation, but are performed during execution of speaking, listening, reading, or writing learning in step S914.

Referring to FIGS. 10A to 10C, step S914 of FIG. 9A will be described in detail. First, the learning system checks whether the learning mode selected by the learner is the speaking mode or the listening / writing / reading mode (S914-1) , And in the case of the listening / writing / reading mode, the modules are activated to execute the listening / writing / reading learning (S914-2).

If the learning mode selected by the learner is the speaking mode, the speaking module 240 is activated and the speech output speed, the learning unit (words, phrases, sentences, paragraphs, etc.), the speaking learning mode Mode) (S914-3). However, it should be noted that the speech output speed and the learning unit may be input together in the above-described step S912.

Then, the speaking module 240 examines whether the content selected by the learner is song (or moving picture) content, and if it is not the song (or moving picture) content, proceeds to step S914-7 (S914-4).

If the content selected by the learner is a song (or video) content, the speaking module 240 examines which learner has selected the learner's song (or video) content (S914-5) If it is selected, the process goes to step S914-6 to set audio data to be extracted from the song (or moving picture) sound source (S914-6).

On the other hand, if it is determined in step S914-4 that the content selected by the learner is not the song (or moving picture) content, or the learner selects the general sound source of the song (or moving picture) content in step S914-5, And extracts voice data (S914-7).

After that, the speaking module 240 examines whether the speaking mode set by the learner is a conversation mode or a follow-up mode (S914-8). When the speaking mode selected by the learner is a conversation mode, 8l, the learning system and the learner alternately pronounce the unit text, which is the learning unit set by the learner, and performs learning (S914-9).

The learning method performed in the conversation mode is the same as that described above with reference to Figs. 8J to 8L, so that the learner sets the initial speaker (S914-91) The system checks whether the initial speaker is set as the learning system. If the learner is set as the initial speaker, the system proceeds to step S914-94 (S914-92). When the learning system is set as the first speaker, the learning system first outputs the unitary text voice data (S914-93), waits for the system waiting time so that the learner can pronounce the next unit text, 93, and the learning system outputs audio data corresponding to the next unit text (S914-94). At this time, as described above, the learning system records the pronunciation of the learner after step S914-94, evaluates the degree of similarity with the native voice of the native speaker, and repeats steps S914-94 if the degree of similarity is less than the threshold value (S914-95).

On the other hand, if the learner selects the speaking mode according to the following mode, the learning system first pronounces the pronunciation as described above with reference to FIG. 8B, and the learner performs learning by pronouncing the learning unit pronounced by the learning system S914-10). The learning method performed in the follow-up mode is the same as that described above with reference to FIG. 8B. Therefore, the flow will be briefly described with reference to FIG. 10C. , The system waits for a system wait time so that the learner can pronounce the next unit text, and then proceeds to step S914-101 so that the learning system outputs the speech data corresponding to the next unit text (S914-102). At this time, as described above, the learning system records the pronunciation of the learner after steps S914-102, and evaluates the similarity with the native speech data. If the similarity is less than the threshold value, the learning system repeats steps S914-102 (S914-103).

On the other hand, the speaking module 240 examines whether or not it has reached the pronunciation evaluation area while performing the conversation mode and the follow-up mode (S914-11). When the speaking module 240 reaches the pronunciation evaluation area, The evaluation screen is activated and displayed to the learner (S914-12).

Then, the speaking module 240 checks whether the recording unit is a sentence or a word / phrase (S914-13). If the recording unit is a sentence, the learner records the pronunciation performed after the recording button is pressed, The signal is temporarily stored (S914-14).

On the other hand, if the learner-set recording unit is a word / phrase, the speaking module 240 inverts and displays the text corresponding to the recording unit first, as shown in FIG. 8F, and outputs corresponding audio data (S914 -15). As shown in FIG. 8G, the learner's pronunciation of the word / phrase is recorded and stored as a voice signal (S914-16).

If the word / phrase to be pronounced is left, the speech module 240 proceeds to step S914-15 (step S914-17). In step S914-17, the word / phrase is recorded for all the words / phrases If completed, the speech signals recorded in word / phrase unit and temporarily stored are combined and completed in one sentence (S914-18).

Then, the speaking module 240 compares the recorded voice signal with the voice data, evaluates the degree of similarity to the learner as shown in FIG. 8D, and proceeds to step S914-9 or S914-10 And performs the conversation mode or the follow-up mode again (S914-19).

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner.

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

110 input unit 120 display unit
130 sound output unit 200 control unit
210 reading module 220 writing module
230 listening modules 240 speaking modules
241 Speed setting section 243 Recording section
245 speaking controller 247-1 similarity evaluator
247-2 Transmission /
250 word management module 251 Listening function
253 Listening function 255 Pre-function
257 Wordbook Function 259 Scrap Function
260 Learning Management Module 300 Database
310 Learning content storage unit 320 Learning data storage unit
330 Dictionary data storage 800 MIC

Claims (25)

Language data of the foreign language text data and the pronunciation data of the foreign language text pronounced by the native speaker are stored in correspondence to the foreign language text by word units and the time information of the voice data corresponding to the foreign language text is stored for each word of the foreign language text, A database for storing start time information and end time information that are pronounced together;
A display unit for outputting the foreign language text;
An acoustic output unit for outputting the voice data;
An input unit that receives setting information and selection information from a learner and selects a word from the foreign language text output through the display unit;
A speaking module for executing a conversation mode in which a learner and a foreign language learning system alternately perform speech learning by pronouncing a foreign language text; And
And a word management module for outputting a word learning menu related to a word selected through the input unit through the display unit and receiving menu selection information through the input unit,
The speech module outputs speech data corresponding to a foreign language text of a next learning unit through the sound output unit when a time (system waiting time) for the learner to pronounce the foreign language text according to the learning unit passes in the conversation mode, Classifies the learning unit into any one of a word, a phrase, a sentence, and a paragraph, and activates a pronunciation evaluation screen when reaching a foreign language text set in advance as a pronunciation evaluation area, and outputs the text set in the dictionary to a learner The pronunciation of the learner is input and stored, the pronunciation of the learner and the similarity of the voice data are calculated and output through the display unit,
The word management module outputs the speech data corresponding to the time from the start time of the previous word of the selected word to the end time of the next word of the selected word among the texts output to the display unit when the menu selection information is the yaw sound Language learning system. 2. The method of claim 1,
The conversation mode or the following reading mode is selected according to the user's selection,
In the reading mode, the voice data corresponding to the foreign language text is output through the sound output unit. After the learner waits for a time (system waiting time) for pronouncing the same foreign language text, And outputs it through the sound output unit. delete 3. The method of claim 1 or 2, wherein the speaking module
Wherein when outputting the voice data, the foreign language text corresponding to the voice data is inverted in a text unit set by the user and output through the display unit. 3. The method of claim 1 or 2, wherein the speaking module
And outputs voice data in accordance with the voice output speed set by the learner. 6. The method of claim 5, wherein the system latency is
Wherein the learner is calculated according to the output time and the speech output speed of the speech data corresponding to the foreign language text to be pronounced by the learner. 3. The method of claim 1 or 2, wherein the speaking module
And the words are reversed in units of words, phrases, sentences and paragraphs to be pronounced by the learner in the system waiting time, and outputted through the display unit. 3. The method of claim 1 or 2, wherein the speaking module
The pronunciation of the learner is compared with the voice data to calculate the similarity, and when the similarity is equal to or greater than a predetermined value, the system outputs voice data. delete The method according to claim 1,
A unit for inputting a pronunciation of a learner on the pronunciation evaluation screen is set to any one of a word, phrase, and sentence. When the set unit is a word or phrase, the learner inverts the text corresponding to the word or phrase The pronunciation of the learner is inputted, and when the pronunciation of the learner is input to all the words or all the phrases displayed on the pronunciation evaluation screen, Of the foreign language learning system. 3. The method according to claim 1 or 2,
If the foreign language text is song lyrics, the audio data corresponding to the song lyrics is classified into an actual song source and a general source including a tone rate,
Wherein the speaking module outputs voice data from an actual song sound source or a general sound source according to the setting of the learner. 3. The method of claim 1 or 2, wherein the speaking module
A speed setting unit that receives an output speed (audio output speed) of voice data from a learner; And
When the learner speaks the foreign language text (system standby time), the user selects one of the voice corresponding to the foreign language text and the voice corresponding to the foreign language text Outputting the data through the sound output unit,
In the following reading mode, voice data corresponding to a foreign language text is output through the sound output unit. After the learner waits for a time (system waiting time) to pronounce the same foreign language text, voice data corresponding to the next foreign language text is output to the sound output Output through the part,
And a speaking controller for adjusting the system standby time according to a time at which the voice data is outputted and the voice output speed. 13. The method of claim 12,
A recording unit for recording the pronunciation of the learner; And
Further comprising a similarity evaluating unit for comparing the pronunciation of the learner inputted from the recording unit with the speech data to evaluate the similarity,
Wherein the speech control unit outputs the evaluation result of the similarity evaluating unit through the display unit. 13. The method of claim 12,
A recording unit for recording the pronunciation of the learner; And
Further comprising a transceiver for transmitting a pronunciation of the learner input from the recording unit to a similarity evaluation server and receiving a similarity evaluation result from the similarity evaluation server,
Wherein the speech control unit outputs the similarity evaluation result input from the transceiving unit through the display unit.
Language data of the foreign language text data and the pronunciation data of the foreign language text pronounced by the native speaker are stored in correspondence to the foreign language text by word units and the time information of the voice data corresponding to the foreign language text is stored for each word of the foreign language text, A foreign language learning method performed in a foreign language learning system having a database for associating and storing start time information and end time information to be pronounced,
(a) outputting a foreign language text of a content selected by a learner;
(b) receiving a learning mode, a speech output speed, and a learning unit from a learner, and inputting a conversation mode or a follow-up mode from a learner when the learning mode input by the learner is a speaking mode; And
(c) when the learner selects the conversation mode, the learner and the foreign language learning system alternately execute the conversation mode in which the foreign language text corresponding to the learning unit is pronounced to perform speaking learning, When the time to wait (system waiting time) elapses, the foreign language learning system outputs voice data corresponding to the foreign language text of the next learning unit,
Wherein the learning unit is any one of a word, a phrase, a sentence, and a paragraph,
The learning system switches to the pronunciation evaluation screen, outputs the text set in the dictionary to the learner, receives and stores the pronunciation of the learner, Calculates the similarity between the pronunciation of the learner and the voice data, displays the result,
In the step (c), it is checked whether or not the learner selects a word. When the learner selects a word, the learner outputs a word learning menu for the selected word. When the learner selects the word, , The speech data corresponding to the time from the start time of the previous word of the selected word to the end time of the next word of the selected word is outputted. 16. The method of claim 15,
(d) When the learner selects the following mode, the learning system outputs the speech data corresponding to the foreign language text according to the learning unit, waits for the learner to speak the same foreign language text (system waiting time) Further comprising the step of outputting speech data corresponding to the next foreign language text. delete 17. The method according to any one of claims 15 to 16,
Wherein the learning system inverts the foreign language text corresponding to the voice data in a text unit set by the user when the voice data is output, and outputs the inverted foreign language text. 17. The method according to claim 15 or 16,
Wherein the learning system outputs speech data in accordance with the speech output speed set by the learner. 20. The method of claim 19,
Wherein the learner is calculated according to a pronunciation time and a voice output speed of voice data corresponding to a foreign language text to be pronounced by the learner. 17. The method according to claim 15 or 16,
Wherein the learning system reverses and displays words in words, phrases, sentences, or paragraphs to be pronounced by the learner in system standby time. 17. The method according to claim 15 or 16,
Wherein the learning system compares the learner's pronunciation with the loudspeaker data when the learner is uttered to calculate the similarity degree, and when the similarity degree is equal to or greater than a preset value, the learning system outputs the loudspeaker data. delete 16. The method of claim 15,
A unit for inputting a pronunciation of a learner on the pronunciation evaluation screen is set to any one of a word, phrase, and sentence. When the set unit is a word or phrase, the learner inverts the text corresponding to the word or phrase The pronunciation of the learner is inputted, and when the pronunciation of the learner is input to all the words or all the phrases displayed on the pronunciation evaluation screen, Is calculated. 17. The method according to claim 15 or 16,
When the foreign language text is a song lyrics, the voice data corresponding to the song lyrics is classified into a song sound source including a tone rate and a general sound source,
Between the step (b) and the step (c)
Further comprising the step of extracting speech data from a song sound source or a general sound source in accordance with a learner's setting.

Images