KR20160111335A - Foreign language learning system and foreign language learning method - Google Patents

Abstract

Disclosed are a foreign language learning system and a foreign language learning method. According to the present invention, the foreign language learning system comprises: a database for storing foreign language text data and sound data in which a native speaker pronounces the foreign language text corresponding to the foreign language text word by word; a display part for outputting the foreign language text; a sound output part for outputting the sound data; an input part for receiving setting information and optional information from a learner; a read module for displaying a text in a read unit to be read at the current time to be distinguished from other texts, to allow a learner to read along with a text output in the display part in a read-along-with mode of a read learning mode, by being activated when a read learning mode is selected as a selection mode; a speak module for outputting sound data corresponding to a foreign language text in a next learning unit through the sound output part if the time (the system standby time) when a learner pronounces a foreign language text in a learning unit has elapsed, to perform speak learning by pronouncing a foreign language text by a learner and a foreign language learning system in turns in a conversation mode of a speak learning mode, by being activated when a speak learning mode is selected as a selection mode; and a write module for sequentially outputting sound data corresponding to foreign language text data through the sound output part, and performing write learning by sequentially inputting listed foreign words to correspond to a meaning of a displayed native language by a learner by displaying a write display on the display part when reaching a write section set in advance, by being activated when a write learning mode is selected as selection information.

Description

[0001] The present invention relates to a foreign language learning system and a foreign language learning method,

The present invention relates to a foreign language learning system and a foreign language learning method, and more particularly, to a foreign language learning system using an electronic device and a foreign language learning method.

Various foreign language learning materials such as Chinese, Japanese, and the like are being put on the market in accordance with the trend of internationalization. Due to the spread of portable electronic devices, various contents capable of performing foreign language learning in portable smart devices have been recently provided .

However, such foreign language learning contents merely provide a function of reproducing foreign language texts, pronunciation of native speakers, and instructor's lecture contents to the user through a video player such as a smart phone, and the learner can perform self- Function.

For example, in viewing foreign language video content, which is the most widely-used foreign language learning method, a learner can learn listening, reading, speaking and writing while listening to four areas of foreign language learning, There is a problem in that the language area is required to purchase a separate learning material or register with a foreign language institute so that the lecturer learns it.

A problem to be solved by the present invention is to provide a foreign language learning system and a learning method capable of self-learning the foreign language listening, reading, speaking and writing areas by using a portable electronic device.

According to a preferred embodiment of the present invention, there is provided a foreign language learning system comprising: a database for storing foreign language text data and voice data pronounced by a native speaker in a unit of a word; A display unit for outputting the foreign language text; An acoustic output unit for outputting the voice data; An input unit for receiving selection information for a learning mode from a learner; The text of the reading unit to be read at the current time is distinguished from the other text so that the learner can read along with the text displayed on the display unit in the reading mode during the reading learning mode A reading module to display; The learner is activated when the learner selects the speech learning mode and the learner and the foreign language learning system alternately speak the foreign language text in the speech mode during the speech learning mode so that the learner can pronounce the foreign language text according to the learning unit A speech module for outputting speech data corresponding to a foreign language text of a next learning unit through the sound output unit when a time (system standby time) has elapsed; And when the learner selects the write learning mode, outputs sound data corresponding to the foreign language text data sequentially through the sound output unit, and when a predetermined writing period is reached, the writing screen is displayed on the display unit And a writing module for performing a writing learning by causing the learner to sequentially input the listed foreign language words so as to correspond to the meaning of the displayed native language.

In addition, the database stores the time at which the pronunciation begins and the time at which the pronunciation ends, for each word included in the text, in association with each other, and in the reading mode, the reading module reads, The time information corresponding to each word is extracted from the database, and the time per reading unit is calculated according to the time information and the set speed, and displayed so as to be distinguished from other texts during the calculated time have.

In addition, the reading module sets either the constant speed mode or the normal speed mode through the input unit. When the learner sets the normal speed mode, the reading module reads the text of the reading unit to be read at the current time according to the calculated time If the learner sets the uniform speed mode, the time per unit of reading is calculated according to the time set by the learner or the time set in advance by the learning system and the set speed, It can be marked to distinguish.

The reading module may extract time information from voice data included in a general sound source in which a native speaker pronounces a song lyrics or a moving picture caption in accordance with a learner's selection when the foreign language text is a song lyrics or a moving picture caption, The time information is extracted from the voice data included in the actual song sound source or the actual moving picture and the text of the reading unit corresponding to the time corresponding to each reading unit can be displayed to be distinguished from other texts.

In addition, the reading module sets the reading mode or the basic reading mode according to the learner, and when the learner sets the basic reading mode, the reading module can display the identifier for each section to be read by reading the reading unit set by the learner.

In addition, the writing module can allow a foreign language word to be entered in units of words or phrases on the writing screen according to the learner's selection.

The speaking module selects the conversation mode or the following mode according to the learner's selection. In the following reading mode, the speech module outputs the speech data corresponding to the foreign language text through the sound output unit. After waiting for a time to be sounded (system standby time), voice data corresponding to the next foreign language text can be output through the sound output unit.

In addition, the speaking module can classify the learning unit into any one of words, phrases, sentences, and paragraphs in a foreign language text.

When the speech data is output, the speaking module may output the foreign language text corresponding to the speech data in a text unit set by the learner and output the text through the display unit.

Further, the speaking module can output the voice data in accordance with the voice output speed set by the learner.

In addition, the speaking module may output words through words, phrases, sentences, and paragraphs to be pronounced by the learner in the system standby time and output the words through the display unit.

In addition, the speaking module compares the learner's pronunciation with the loudspeaker data when the learner pronounces, calculates the similarity, and when the similarity is equal to or greater than a predetermined value, the system can output the voice data.

In addition, the speaking module activates the pronunciation evaluation screen to output the text set to the learner, receives and saves the pronunciation of the learner, and stores the pronunciation of the learner and the similarity And output it through the display unit.

The unit for receiving the pronunciation of the learner on the pronunciation evaluation screen is set to any one of a word, a phrase, and a sentence. When the set unit is a word or a phrase, And outputs the speech data corresponding to the text, receives the pronunciation of the learner, and receives the pronunciation of the learner with respect to all words or all phrases displayed on the pronunciation evaluation screen, The degree of similarity can be calculated.

In the case where the foreign language text is a song lyrics, the speech data corresponding to the song lyrics is classified into an actual song source including a tone rate and a general tone source, and the speaking module sets, Audio data can be output from a general sound source.

The speech module may further include: a rate setting unit that receives the output speed (audio output speed) of the voice data from the learner; And a speaking mode including a conversation mode and a reading mode from the learner via the input unit. In the conversation mode, when a time (system waiting time) for the learner to pronounce the foreign language text has elapsed, In the reading mode, the voice data corresponding to the foreign language text is output through the sound output unit, and after the learner waits for the time (system waiting time) for pronouncing the same foreign language text, And a speech controller for outputting the voice data corresponding to the foreign language text through the voice output unit and adjusting the system standby time according to the time of outputting the voice data and the voice output speed.

The foreign language learning system may further include: a recording unit for recording pronunciation of the learner; And a similarity evaluating unit comparing the pronunciation of the learner inputted from the recording unit with the speech data to evaluate the similarity, and the speaking controller may output the evaluation result of the similarity evaluating unit through the display unit.

The foreign language learning system may further include: a recording unit for recording pronunciation of the learner; And a transmission / reception unit for transmitting a pronunciation of the learner inputted from the recording unit to a similarity evaluation server and receiving a similarity evaluation result from the similarity evaluation server, wherein the speaking control unit stores the similarity evaluation result inputted from the transmission / Can be output through the display unit.

Also, the input unit selects a word from the foreign language text output through the display unit, the foreign language learning system outputs a word learning menu related to the selected word through the display unit, and inputs the menu selection information through the input unit Wherein the word management module is adapted to receive a voice corresponding to a word from a previous word of the selected word to a back word of the selected word among the texts output to the display unit when the menu selection information is a yaw sound, Data can be output sequentially through the sound output unit.

Also, the database may store time information of voice data corresponding to each word of each foreign language text, and may store the start time information and the end time information in which the words are pronounced together.

The word management module may output the speech data corresponding to the time from the start time of the previous word of the selected word to the end time of the next word of the selected word, when the tune listening is selected for the selected word.

If the selected word is the first word of the sentence, the word management module updates the speech data corresponding to the speech data from the start time of the selected word to the end time of the next word of the selected word, If the selected word is the last word of the sentence, audio data corresponding to the time from the start time of the previous word of the selected word to the end time of the selected word can be output.

Also, the foreign language text may be a song lyrics, and the voice data may be extracted and output from a song sound source corresponding to the song lyrics or a general sound source in which a native speaker reads the song lyrics, according to a learner's selection or preset.

In addition, the foreign language text may be a movie or a drama, and the audio data may be video data corresponding to the movie or drama.

Further, the word learning menu may include a menu for listening to a praise, a listening menu for outputting voice data corresponding to the selected word, a dictionary menu for inquiring dictionary information of the selected word, a wordbook menu for storing the meaning of the word selected by the learner, And a scrap menu for inputting a memo for the selected word or phrase.

In addition, the database may include a learning content storage unit for storing the foreign language text data, the voice data, and the time information; A learning data storage unit for storing semantic data of a word and a word inputted by a learner selecting a wordbook menu and a memo inputted by a learner selecting a scrap menu; And a dictionary data storage unit for storing the dictionary data.

According to another aspect of the present invention, there is provided a foreign language learning method comprising the steps of: (a) outputting a foreign language text of a content selected by a learner and selecting a learning mode from a learner; (b) when the learning mode selected by the learner is in the reading learning mode, the reading unit is input, the reading unit is interrupted every reading unit, and when the learner sets the reading mode according to the reading mode, Displaying the text of the read unit to be read at the current time so as to be distinguishable from other text so that the text can be read along with the text; (c) receiving a speech output speed and a learning unit from a learner and inputting a conversation mode or a follow-up mode when the learning mode selected by the learner is the speaking mode, and when the learner selects the conversation mode, The system executes a conversation mode in which speech learning is performed by pronouncing the foreign language text corresponding to the learning unit alternately. When the time (system waiting time) for the learner to pronounce the foreign language text according to the learning unit has elapsed, Outputting speech data corresponding to text by a foreign language learning system; And (d) when the learning mode selected by the learner is the writing mode, the sound data corresponding to the foreign language text data is sequentially outputted through the sound output section, and when the writing section reaches a predetermined writing section, the writing screen is displayed on the display section And performing a writing learning by causing the learner to sequentially input the listed foreign language words so as to correspond to the meaning of the displayed native language.

In the step (b), when the learner sets the reading mode, the user inputs the speed setting from the learner, and calculates the time at which pronunciation of each word starts and the time at which the pronunciation ends The time information for each reading unit may be calculated according to the time information and the set speed, and displayed so as to be distinguished from other texts during the calculated time.

In the step (b), when the learner sets the normal speed mode and either the constant speed mode or the normal speed mode is set, the learner sets the normal speed mode, And the learner sets the time per unit of reading in accordance with the time set by the learner or the time set in advance by the learning system and the set speed, As shown in FIG.

In the step (b), when the foreign language text is a song lyrics or a moving picture caption, time information is extracted from voice data included in a general sound source where a native speaker pronounces a song lyrics or a moving picture caption according to a learner's choice , The time information may be extracted from the voice data included in the actual song sound source or the actual moving picture and the text of the reading unit corresponding to the time corresponding to each reading unit may be displayed to be distinguished from other texts.

In the step (b), if the learner sets the reading mode or the basic reading mode in accordance with the learner, and the learner sets the basic reading mode, the learner can display the identifier for each section to be read by reading the reading unit have.

Also, in the step (d), a foreign language word may be input on a word-by-word or phrase-by-word basis in accordance with the learner's selection on the writing screen.

In the step (c), when the learner selects the following mode in the speaking mode, the learning system outputs the voice data corresponding to the foreign language text according to the learning unit, and the time System standby time), and then output voice data corresponding to the next foreign language text.

Further, the learning unit may be any one of a word, a phrase, a sentence, and a paragraph.

In addition, when outputting the voice data, the learning system can output the foreign language text corresponding to the voice data in a text unit set by the learner and output it.

Further, the learning system can output the voice data in accordance with the voice output speed set by the learner.

In addition, the learning system can display the words by reversing words in words, phrases, sentences and paragraphs to be pronounced by the learner in the system standby time.

In addition, the learning system compares the learner's pronunciation with the loudspeaker data when the learner pronounces it, calculates the similarity, and when the similarity is equal to or greater than a predetermined value, the system can output the voice data.

In addition, when the learning system reaches a predetermined foreign language text, the learning system switches to the pronunciation evaluation screen, outputs the preset text to the learner, inputs and stores the pronunciation of the learner, And the result can be displayed.

The unit for receiving the pronunciation of the learner on the pronunciation evaluation screen is set to any one of a word, a phrase, and a sentence. When the set unit is a word or a phrase, And outputs the speech data corresponding to the text, receives the pronunciation of the learner, and receives the pronunciation of the learner with respect to all words or all phrases displayed on the pronunciation evaluation screen, The degree of similarity can be calculated.

In the case where the foreign language text is song lyrics, the audio data corresponding to the song lyrics is classified into a song sound source and a general sound source including a tone rate, and the step (c) Audio data can be output from the sound source.

Further, during the steps (b) to (d), it is checked whether or not the learner selects a word. When the learner selects a word, the learner outputs a word learning menu for the word selected by the learner. The speech data corresponding to the selected word from the selected word to the next word of the selected word may be sequentially output through the sound output unit.

Also, the database stores time information of voice data corresponding to each word of each foreign language text, and start time information and end time information, in which the words are pronounced, can be stored together in association with each other.

In addition, when listening to the selected word is selected, audio data corresponding to the time from the start time of the preceding word to the end time of the next word of the selected word can be output.

Outputting speech data corresponding to a time from a start time of the selected word to an end time of the next word of the selected word when the selected word is the first word of the sentence, If the selected word is the last word of the sentence, voice data corresponding to the time from the start time of the preceding word to the end time of the selected word can be output.

Also, the foreign language text is a song lyrics, and the song sound source corresponding to the song lyrics or the native sound source reading the song lyrics can be extracted and output according to the learner's selection or preset.

In addition, the foreign language text may be a movie or a drama, and the audio data may be video data corresponding to the movie or drama.

Further, the word learning menu may include a menu for listening to a praise, a listening menu for outputting voice data corresponding to the selected word, a dictionary menu for inquiring dictionary information of the selected word, a wordbook menu for storing the meaning of the word selected by the learner, And a scrap menu for inputting a memo for the selected word or phrase.

In the present invention, by storing the pronunciation data of each foreign language text data and the foreign language text data pronounced by the native speaker in association with the start time of pronunciation of each word and end time information of ending pronunciation, Not only can the speech data be heard and learned in units of words, phrases, and sentences according to the sentence, but also when the learner selects one or more words, And the function of being able to listen to the voice data to be pronounced in lie with the words arranged behind the learner can be improved, thereby improving the learner's learning efficiency.

Further, the foreign language learning system of the present invention is characterized in that, in the speech learning mode, a learning mode in which a learning system outputs speech data of native speakers and a learner follows them, and a conversation mode in which a learner is pronounced and a learning system outputs speech data The learner can execute a speaking learning method more effective in accordance with his or her choice.

Further, the learning system of the present invention records the pronunciation of the learner on the pronunciation evaluation screen, compares the pronunciation of the learner with the pronunciation of the native speaker, and displays the result, thereby displaying the result of the learner's pronunciation to the learner. So that it is possible to confirm the results of the learning in the meantime, as well as the effect of improving the motivation to learn.

Particularly, in a pronunciation evaluation screen, a learner can set a recording unit. When a learner selects "sentence / phrase" as a recording unit, the learner's pronunciation is recorded in the corresponding unit, By comparing the pronunciation of the native speaker with the pronunciation of the native speaker, the learners who have difficulty in completely pronouncing a sentence can use the learning system without any sense of refutation, thereby making it possible to continuously perform speaking learning.

In addition, by using song or video contents familiar to the learner, it is possible to minimize a feeling of rejection against a foreign language and to create a comfortable learning environment.

Further, the foreign language learning system of the present invention allows the learner to select one of the basic reading mode and the following reading mode when the learner selects the reading learning mode, and the reading unit is selected in units of words, phrases, sentences or paragraphs So that it can be set. If the learner chooses the basic reading mode and the reading unit as a sphere unit, the learner performs the direct learning by reading the foreign language text by performing a separate mark ("/") in the phrase unit forming the meaning unit in the sentence There is an effect to be able to.

If the learner selects the read mode according to the learner, the learner is allowed to select whether or not to read the constant velocity. In the case where the learner is not in the constant velocity reading mode, (Read time information) is displayed and displayed so that the text of each reading unit is inverted, displayed in a large size, or displayed in a different color, in such a manner as to be distinguished from other texts at the corresponding pronunciation rate And the learners can learn by themselves so that they can read in the same way as native speakers.

In addition, when a uniform speed reading is performed, all the reading units are displayed so as to be distinguished from other texts for the same period of time, thereby giving the learner the feeling of reading a paper book, allowing quick practice of quick reading, (Words, phrases, sentences) can be recognized (stamped).

In addition, the foreign language learning system of the present invention displays a foreign language text and sequentially outputs voice data when the learner selects the write learning mode. When the learner reaches the preset writing period, So that it is possible to perform the writing learning through the electronic device by inputting the words so as to correspond to the meaning indicated in the mother language.

1 is a block diagram showing a configuration of a foreign language learning system according to a preferred embodiment of the present invention.
2 is a diagram showing a structure of learning contents stored in a database according to a preferred embodiment of the present invention.
3 is a block diagram illustrating a detailed configuration of a learning management module according to a preferred embodiment of the present invention.
4 is a diagram showing an example of a word learning menu displayed to a learner according to a preferred embodiment of the present invention.
FIG. 5A is a block diagram showing a detailed configuration of a read module according to a preferred embodiment of the present invention, and FIGS. 5B to 5D are diagrams showing examples of learning of a read module.
6A to 6C are diagrams showing examples of execution of a writing module according to a preferred embodiment of the present invention.
7 is a diagram showing an example of execution of a listening module according to a preferred embodiment of the present invention.
FIG. 8A is a block diagram showing a detailed configuration of a speaking module according to a preferred embodiment of the present invention, and FIGS. 8B to 8L are diagrams showing examples of learning of the speaking module.
FIG. 9A is a flowchart for explaining a foreign language learning method according to a preferred embodiment of the present invention, and FIG. 9B is a detailed flowchart of the step S940 shown in FIG. 9A.
10A to 10C are detailed flow charts for explaining an embodiment for performing the speech learning mode in step S914 shown in FIG. 9A in detail.
FIGS. 11A and 11B are detailed flowcharts for explaining an embodiment for performing a read learning mode in step S914 shown in FIG. 9A.
FIG. 12 is a detailed flowchart illustrating an embodiment of performing a write learning mode in step S914 shown in FIG. 9A in detail.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a foreign language learning system according to a preferred embodiment of the present invention.

Referring to FIG. 1, a foreign language learning system according to a preferred embodiment of the present invention can be implemented with software installed in a portable electronic device such as a smart phone, and includes an input unit 110, a display unit 120, 130, a control unit 200, and a database 300.

The input unit 110 receives information such as selection information and setting information from a learner, and outputs the received information to the control unit 200. The input unit 110 receives from the learner the selection information for a learning mode such as reading, speaking, listening, and writing, menu selection information, selection information for a specific word to be searched by a learner, , Sentences, etc.), and the like, and outputs the information to the control unit 200.

The display unit 120 outputs the foreign language text data output from the control unit 200 to the learner.

The input unit 110 and the display unit 120 may be implemented with a touch panel installed in a portable electronic device.

The sound output unit 130 is implemented by a speaker and outputs voice data in which foreign language text data input from the control unit 200 is pronounced by the native speaker.

The database 300 includes a learning content storage unit 310, a learning data storage unit 320, and a dictionary data storage unit 330.

The learning content storage unit 310 stores a foreign language learning content to be displayed to the learner. The learning contents include foreign language text data to be displayed to the learner through the display unit 120 and voice data in which the corresponding text is pronounced by the native speaker. In addition, the learning contents store time information of the voice data corresponding to each word of each foreign language text, and store the start time information and the end time information in which the words are pronounced together.

2 is a diagram showing the structure of learning contents stored in the database 300 according to a preferred embodiment of the present invention.

Referring to FIG. 2, foreign language text data 311 is stored in the learning content storage unit 310, and the voice data 312 in which the corresponding text is pronounced by the native speaker is stored. In addition, time information (timing information) 313 indicating the start time and the end time at which the word is pronounced is stored in association with the text data and the voice data for each word included in the text data.

For example, the word "kingdom" among the words included in the text data can be known from the speech data for the entire sentence, and the pronunciation starts at time 0013 and ends at 0019. Therefore, the time information of "kingdom " is stored (start time: 0013, end time: 0019).

Likewise, the word "far" is stored (start time: 0019, end time: 0021), and other words are stored in association with time information corresponding to the voice data in the same manner.

In addition, the learning contents may include not only general sound source data in which plain text data and plain text are pronounced by native speakers but also lyrics and song sound source data, and a movie (or a drama) and a movie (or drama) animation. That is, the lyrics of the song are stored as foreign language text data, and the genre source data or song lyrics can be stored in association with the song lyrics text, and the genre text of the movie (or drama) And corresponding moving picture data may be stored in association with each other. Hereinafter, general voice data associated with plain text, song sound source data associated with song lyrics, and moving image data associated with a movie (or drama) will be collectively referred to as voice data.

On the other hand, the learning data storage unit 320 stores wordbook data that the learner selects words during learning and inputs meaning of the words, scrap memo data generated by the learner during learning, and the like.

The dictionary data storage unit 330 stores dictionary data including a plurality of words, pronunciation symbols and meaning of each word, idioms, and the like. The learner can instantaneously select an unknown word during learning and confirm the word stored in the dictionary data storage unit 330. [

The control unit 200 includes a word management module 250, a learning management module 260, a reading module 210, a writing module 220, a listening module 230, and a speaking module 240. 3, the word management module 250 includes a listening function unit 251, a yaw sound listening function unit 253, a dictionary function unit 255, a wordbook function unit 257, (259).

The reading module 210, the writing module 220, the listening module 230, and the speaking module 240 are activated according to the learning mode set by the learner to execute the corresponding learning function, The management module 260 is activated when the learner selects a word or selects the learning menu during execution of the learning mode, and provides the learner with a function corresponding to the menu selected by the learner.

FIG. 3 is a block diagram illustrating a detailed configuration of a word management module 250 according to a preferred embodiment of the present invention. FIG. 4 illustrates an example of a word learning menu displayed to a learner according to a preferred embodiment of the present invention. FIG.

Referring to FIGS. 3 and 4, the function of the word management module 250 of the present invention will be described. As shown in FIG. 4, in a text displayed to a learner during learning, When a word is selected, the word management module 250 is activated and a word learning menu as shown in Fig. 4 is displayed on the display unit 120. [

When the learner selects the scrap menu, the scrap function unit 259 is activated, receives the learner's memo from the learner, and stores it in the learning data storage unit 320. [

When the learner selects the wordbook menu, the wordbook function unit 257 is activated to display the dictionary data and display it to the learner, and the meaning displayed in the meaning input field is filled so that the meaning of the dictionary can be stored. And stores the meaning of the dictionary and the meaning inputted in the learning operation in the learning data storage unit 320. [

When the learner selects the dictionary menu, the dictionary function unit 255 is activated to look up words selected by the learner among the words stored in the dictionary data storage unit 330, Symbols, idioms, etc. are displayed to the learner.

On the other hand, when the learner selects the listening menu, the listening function unit 251 is activated, and outputs the voice data stored in the learning content storage unit 310 to the learner through the sound output unit 130 in association with the corresponding word. As described above, the listening function unit 251 reads the start time and the end time stored in association with the selected word, and outputs the voice data corresponding to the corresponding time. In the example shown in Fig. 2, if the learner selects "kingdom" and selects the listening menu, voice data corresponding to the time from 0013 to 0019 of voice data is output.

In addition, when the learner selects the menu for listening to the tune, the tune listening function unit 253 is activated to select not only the words selected by the learner but also the preceding and succeeding words of the corresponding words, And outputs the voice data stored in the storage unit 310 to the learner through the sound output unit 130. [ In the example shown in Fig. 2, if the learner selects "kingdom " and selects the menu for listening to the praise," a " The audio data corresponding to the time from the start time 0012 to the end time " 0021 " of "far"

Referring again to FIG. 1, the reading module 210 of the control unit 200 is a module that executes a learning mode so that a learner can perform a direct reading practice by himself / herself.

FIG. 5A is a block diagram showing a detailed configuration of a read module 210 according to a preferred embodiment of the present invention, and FIGS. 5B to 5D are diagrams showing examples of learning of the read module 210. FIG.

Referring to FIG. 5A, the reading module 210 of the present invention includes a reading function unit 214, a basic reading function unit 212, and a reading control unit 216.

First, the reading control unit 216 is activated when the learner selects the reading learning mode through the input unit 110. If the learner selecting the reading learning mode selects the basic reading mode through the input unit 110, the basic reading function 212 And activates the read function unit 214 by selecting the read mode.

The basic reading function unit 212 reads the foreign language text from the learning content storage unit 310 and outputs the read foreign language text to the learner through the display unit 120 while receiving the reading unit from the learner through the input unit 110, Display reading units on text in foreign countries.

The reading unit can be selected from the word / phrase / sentence / paragraph, and if the learner selects the phrase, the learner can read the meaning of the phrase Quot; / "), the learner can naturally perform direct-to-body exercises while reading the foreign-language text. In addition, even when the learner selects a sentence or paragraph unit, the basic reading function unit 212 can display an identifier for each sentence or each paragraph, thereby performing efficient reading learning.

On the other hand, the following reading function unit 214 reads the foreign language text from the learning content storage unit 310 and outputs it to the learner through the display unit 120, while receiving the reading unit from the learner through the input unit 110. [

Thereafter, the read function unit 214 receives selection information about whether to perform reading in the normal speed mode or reading in the constant speed mode from the learner. When the learner sets the constant speed, it is determined that the constant speed mode is set. If the learner has not set the constant speed, it is determined that the normal speed mode is set.

When the learner selects the normal speed mode, the following reading function unit 214 inquires the voice data corresponding to the foreign text output to the display unit 120 and stored in the learning content storage unit.

Then, as shown in FIG. 2, time information (timing information) corresponding to each of the words is extracted, and based on the extracted time information, the words selected by the learner such as words, sentences, (For example, words, phrases, sentences, etc.) to be read by the learner by displaying the reading unit in a manner such that the reading unit is inverted, markedly displayed, or displayed in a different color so as to be distinguished from other reading units It is marked to distinguish it from reading units. At this time, when the learner separately sets the speed, the reading function unit 214 adaptively changes the time for displaying each reading unit to be distinguished from the other reading units according to the time information and the speed.

For example, if the double speed is set to 1.1 times and the reading unit is sphere, if the time information of the sphere to be read currently (the start time to end time of pronunciation) is 0.5 seconds, the sphere can be displayed in reverse for 0.45 seconds. By marking phrases that should be read at the current time different from other phrases, the learner can learn to read the text at the same tempo as the native speaker reads.

If the learner selects the constant speed mode, the reading function unit 214 distinguishes the reading units from other reading units in such a manner that the reading unit 214 inverts, displays, . The time at which each reading unit is displayed to be distinguished is set by the learning system or the learner in advance.

For example, when the learner sets the constant velocity mode, sets the reading unit to a sphere, and sets the pronunciation speed to 0.3 s for each sphere, the word is displayed separately in every 0.3 sec. If the learner does not specify the speed in advance, the sphere with the reading unit is displayed according to the speed set by the learning system in advance by default.

Further, when the speed is set to a specific speed, the time allocated per reading unit may be calculated again according to the speed and displayed so as to be distinguished. In the above example, when the time per unit is set to 0.3 seconds and the double speed is set to 1.1 times, the time for displaying each phrase is 0.27 seconds.

It is needless to say that the reading unit displayed to be distinguished from other reading units as described above can be performed not only in units of words but also in word units, sentence units, and paragraph units.

Also, in the following reading mode, the learner can perform the direct learning by displaying the identifier "/" for each reading unit as in the basic reading mode according to the learner's selection. And can be freely set and released.

On the other hand, the learning contents of the present invention include plain text data and plain text as well as general sound source data pronounced by native speakers, as well as song lyrics and song sound source data, and a movie (or drama) The reason is as described above. Accordingly, in the following reading mode, the learner can extract the time information from the general sound source data according to the selection of the sound source, or extract the time information from the song (or moving picture) sound source.

When a learner selects a general sound source, the diary units to be read in accordance with the time information included in the sound data included in the general sound source in which the lyrics (or subtitles) are pronounced as the native speakers read the book, . If the learner selects a song (or video) source, time information is extracted from the actual song source (or video source) containing the tone rate, so that the learner can perform the read learning have.

Referring to FIGS. 5B to 5D, a description will be made of a reading learning example. First, as shown in FIG. 5B, a reading is selected in a learning mode (510), a phrase is selected in a reading unit (520) When the mode is selected (530), a menu 540 and a double speed adjustment menu 550 for selecting whether or not to set the constant speed are activated. Here, the learner can set the constant speed and the read speed.

Thereafter, when the execution button () is pressed, as shown in FIG. 5C, the current reading unit (the sphere unit in the example shown) is reversed in red and displayed separately from the other reading units.

On the other hand, when the learning content is the song content, as shown in Fig. 5D, a selection button for selecting a normal sound source indicated by a book icon and a song sound source indicated by a note icon is displayed. As described above, time information can be extracted from a general sound source, time information can be extracted from a song sound source, and the read unit to be currently read or currently read can be reversed and displayed.

The writing module 220 of the control unit 200 is activated when the learner selects the writing learning mode through the input unit 110 and the activated writing module 220 displays the foreign language text contents selected by the learner on the display unit 120, Lt; / RTI > At this time, in the foreign language text output by the writing module 220, a writing section is set in advance, and a writing section is indicated by an underline or the like. It should be noted that this write interval may be changed by the learner.

The writing module 220 receives the text unit (words / phrases / sentences) to be displayed and inverted when the learner outputs the voice data, and when the learner presses the execution button, the voice data corresponding to the foreign language text is sequentially outputted , And displays the text unit (word / phrase / sentence) corresponding to the voice data to be distinguished from other text units. In the example shown in FIG. 6A, the learner sets the text unit to a sphere, and the sphere to which the voice data is output is displayed in inverted red letters so that the learner can confirm that the current voice data is being output.

When the predetermined writing period is reached while the voice data is being output, the writing module 220 switches the screen to the writing mode and displays the contents corresponding to the foreign language sentence to be written in the native language of the learner, The corresponding learning foreign language is input.

Referring to FIGS. 6A and 6B, it is indicated that the red line is set as the writing section, and when the writing section such as "as Ella grew older" is reached while the voice data corresponding to the text is outputted, As shown in the figure, the learner selects a plurality of words arranged in an arbitrary order in accordance with the order indicated in the mother tongue, and executes the writing. Here, the order of the words displayed in the same writing section is arbitrarily changed by the learning system every time the writing screen is activated.

In addition, although the learner can input the spelling every time, there is a disadvantage in that the learning time becomes longer in this case. In addition, the writing unit may perform writing in units of words as shown in FIG. 6B (a), or writing in units of words as shown in FIG. 6B (b) have.

If the learner selects one of the listed words or phrases, as shown in (c) of FIG. 6B, the selected word or phrase is changed in color and the contents are filled in the blank space. When the learner selects the words or phrases that are selected in order in the correct order, the learner is informed that the learner has been correctly entered as shown in (d) of FIG. 6, and if the learner can not input it correctly, (A) screen of FIG. 6b so that the learner can perform re-input.

On the other hand, even in the case of the learning learning mode, in the case where the foreign language text is the song lyrics or the moving picture caption, the learner can select the sound source including the sound data to be outputted from the general sound source and the song .

As shown in FIG. 6C, when the foreign language text selected by the learner is a song lyric, the writing module selects a text unit from among words, phrases, and sentences, and then activates a menu in which the learner can select a sound source. In the sound source selection menu, when the learner selects the icon indicated by the book, the general sound source is selected as the sound source, and the sound data pronounced as the native speaker reads the book is outputted. When the learner selects the icon indicated by the note, The actual song is outputted so as to correspond to the text unit.

The listening module 230 of the control unit 200 inverts the text portion of the speech data output by the learner in units of words, phrases, or sentences, and outputs the reversed text portion through the display unit 120. In the example shown in Fig. 7, an example is shown which is set in units of sphere.

8A is a block diagram showing the detailed configuration of the speaking module 240 according to the preferred embodiment of the present invention, and FIGS. 8B to 8L are diagrams showing an example of learning of the speaking module 240. FIG. Hereinafter, a speech learning method of the present invention will be described with reference to Figs. 8A to 8L.

8A, a speaking module 240 according to a preferred embodiment of the present invention basically includes a speed setting unit 241, a recording unit 243, and a speaking control unit 245, and the similarity evaluating unit 247 -1) and a transmission / reception unit 247-2.

The speed setting unit 241 receives the speed (voice output speed) at which the voice data is output in the speaking learning mode through the input unit 110 from the learner.

The recording unit 243 receives the learner's pronunciation through the microphone 800, and temporarily stores the pronunciation in the storage memory in the learning system.

The similarity evaluator 247-1 compares the pronunciation of the learner received from the recording unit 243 with the speech data, and evaluates the degree of similarity indicating how much the pronunciation of the learner is similar to the pronunciation of the native speaker.

The transmission / reception unit 247-2 transmits the pronunciation of the learner input from the recording unit 243 to a similarity evaluation server (not shown) through a wired / wireless communication network, and receives the similarity evaluation result from the similarity evaluation server.

The speaking controller 245 selects one of the speaking modes including the conversation mode and the follow-up mode from the learner through the input unit 110, and selects a word, a phrase, a sentence, and the like as a text unit in which the follow- One of the paragraphs is input.

In addition, the speaking controller 245 allows the learner and the learning system to alternately speak in a text unit in the conversation mode. When the time for the learner to pronounce the foreign language text (system standby time) has elapsed, the learner outputs the voice data corresponding to the foreign language text through the sound output unit 130.

In addition, in the following mode, the speaking controller 245 outputs the voice data corresponding to the foreign language text through the sound output unit 130, and waits for the learner to speak the same foreign language text (system waiting time) , And outputs the voice data corresponding to the next foreign language text through the sound output unit 130.

At this time, the system standby time is variably adjusted according to the time of outputting the voice data and the voice output speed.

8B to 8L, a learner selects a content (for example, Cinderella) to be learned first, a foreign language text is displayed as shown in FIG. 8B, In the setting menu 1110, the "speaking mode" is selected as the learning mode, the "following mode" 1130 is selected in the speaking learning mode, and the learning unit 1120 such as phrases, sentences and paragraphs is selected.

Further, the learner adjusts the audio output speed 1140 on the screen, and the speed adjusted by the learner is input to the speed setting unit 241. The learner can adjust the voice output speed to 0.8 times, 0.9 times, 1 time, 1.1 times, 1.2 times, etc. through the speed setting unit 241. [

Then, the speaking controller 245 extracts voice data corresponding to the text in the foreign language from the database, and sets the unit (word, sentence, or paragraph unit) set by the learner according to the voice output speed set by the speed setting unit 241 Through the sound output unit 130. The sound output unit 130 outputs the sound signal through the sound output unit 130. [ At this time, the speaking controller 245 can display a portion where the learner is listening to the current voice data by inverting a unit word, phrase, sentence, etc. in which the voice data is output.

After the speech data is output in units set by the learner, the speaking controller 245 waits for the time for the learner to pronounce the same foreign language text (system waiting time). At this time, the system standby time is calculated according to the pronunciation time and the voice output speed of the voice data corresponding to the foreign language text to be pronounced by the learner. For example, when the pronunciation time of the voice data pronounced by the native speaker is 10 seconds and the voice output speed is 1 time, the system standby time can be set to 10 seconds, and when the voice output speed is 0.8 time, Can be set to 12 seconds.

Thereafter, when the system standby time is over, the speaking controller 245 proceeds to the next unit of foreign language text, outputs the voice data corresponding to the foreign language text according to the voice output speed, reverses and displays the corresponding foreign language text . At this time, the speaking controller 245 can automatically control to proceed to the next text according to the preset setting, or when the learner actually pronounces the voice through the microphone 800 connected to the recording unit 243 Only the system wait time can be counted and passed to the next text. Further speaking, the speaking controller 245 records the actual pronunciation of the learner through the microphone 800, outputs the recorded voice to the similarity evaluator 247-1, and the similarity evaluator 247-1 It is also possible to skip to the next text only if the evaluated result is greater than or equal to a predefined threshold.

On the other hand, when the speaking control section 245 reaches a pronunciation evaluation sentence or a pronunciation evaluation phrase set in advance during the follow-up mode, the speech control section 245 performs pronunciation evaluation and outputs the result to the learner.

Specifically, the present invention allows the system manufacturer to set a sentence or phrase that is difficult to pronounce in advance as a pronunciation evaluation area, or to set a pronunciation evaluation area for a sentence or phrase that is difficult for a learner to empirically pronounce. The pronunciation evaluation area is displayed (for example, marked with a red underline) in the foreign language text displayed on the display unit 120 so as to be distinguished from other texts.

The speech control unit 245 displays a pronunciation evaluation page as shown in FIG. 8C when reaching a sentence or phrase corresponding to the pronunciation evaluation area during speech learning, or when the learner selects the sentence or phrase. Thereafter, when the learner presses the record button and pronounces the presented text, the recording unit 243 records the pronunciation of the learner and outputs it to the similarity evaluating unit 247-1, and the similarity evaluating unit 247-1 And the degree of similarity with the voice data of the native speaker can be evaluated and displayed to the learner. The similarity evaluation indicates the accuracy and fluency of the pronunciation as a score as shown in FIG. 8D. In addition, the learner can compare the pronunciation of the native speaker by listening to the navtive listening button and the You listening button.

If the similarity evaluating unit 247-1 is not implemented in the learning system due to the restriction on the system resource, the recording unit 243 outputs the learner's pronunciation to the transmitting and receiving unit 247-2, and the transmitting and receiving unit 247-1 -2) transmits the recorded data of the learner's pronunciation to the similarity evaluation server (not shown), receives the evaluation value evaluated by the similarity evaluation server, and outputs the result as shown in FIG. 8D.

In addition, in the example shown in FIG. 8C, pronunciation is recorded on a sentence-by-sentence basis. However, as shown in FIG. 8E, the learner can change the recording unit in units of phrases on the pronunciation evaluation screen.

8E, when the learner changes the recording unit to the phrase and presses the record button, the speaking controller 245 inverts the phrase to be recorded first and displays the corresponding voice data And outputs it to the learner. Thereafter, as shown in Fig. 8G, the learner's pronunciation starts to be recorded while outputting the microphone on the screen.

When the learner has pronounced the phrase and finishes the recording and presses the next button, the speaking controller 245 outputs the corresponding voice data while inverting the next phrase as shown in FIG. 8H, As indicated, the microphone is displayed to record the student's pronunciation. Here, instead of the learner pressing the next button, the speaking control unit 245 may detect the start and end of the learner's pronunciation through the recording unit 243, and may be automatically implemented in the next text unit.

When the recording is completed, the learner presses the recording stop button, and the speaking controller 245 clips only the pronunciation part of the learner from the recorded pronunciation data inputted from the recording part 243, And outputs the same to the similarity evaluating unit 247-1 or outputs it to the transmitting and receiving unit 247-2 in the same manner as described above to receive the similarity evaluation result, Display.

8J, the learner selects the conversation mode in the speaking mode, selects the text unit and the speech output speed, selects the first speaker as the learner or the system (shown as "funny lang" in Fig. 8J) Button is pressed, the speaking controller 245 allows the learner and the learning system to alternately pronounce on a word unit, a phrase unit, or a sentence unit selected by the learner.

For example, if the learner selects a sentence in units of speech, selects a learner as the first speaker, and then presses the play button, the speaking controller 245 controls the speech output speed and the output time of the speech data corresponding to the sentence to be pronounced by the learner Wait for the learner to pronounce the first sentence during the calculated system wait time.

At this time, the process of waiting the system is the same as the follow-up mode described above. That is, the speaking controller 245 may simply output the voice data of the next sentence after waiting for the calculated waiting time of the system, input the voice actually learned by the learner through the microphone, The pronunciation of the learner may be output to the similarity evaluator 247-1 to compare the pronunciation of the learner with the pronunciation of the native speaker to evaluate the similarity. If the evaluation result is equal to or greater than a predefined threshold value, Data can be output. It is also possible to count the system standby time from the point of time when the learner's pronunciation is detected, as in the case of the follow-up mode. In addition, words to be read by the learner can be reversed and displayed.

8J, the speaker control unit 245 switches the speaker from the learner to the system (indicated by "Funny Lang"), and outputs the voice corresponding to the next sentence And outputs the data through the sound output unit 130. At this time, the text corresponding to the output audio data can be reversed and displayed.

Thereafter, when the output of the speech data of the learning system is finished, the speaking controller 245 again changes the speaker from the system to the learner, and waits for the learner to pronounce the text of the next learning unit. For example, in the above example, the speaker is changed in real time so as to display the speaker to be pronounced. However, only the first speaker set by the learner may be displayed in the item displaying the speaker.

By repeating the above-described process, the conversation mode is performed. When the conversation mode is in progress, as in the following mode, pronunciation evaluation is performed when a predetermined pronunciation evaluation sentence or pronunciation evaluation word / phrase is reached, To the learner. The pronunciation evaluation process is the same as the above-described method with reference to Figs. 8C to 8I, and thus a detailed description thereof will be omitted.

On the other hand, in the speaking module 240, the contents used for learning may be simple text contents, or song contents combined with songs or video contents combined with moving pictures.

8K, the contents stored in the learning content storage unit 310 include a real music source corresponding to the song lyrics, and a general sound source in which the native song is pronounced by the native speaker are implemented as voice data Can be stored in association with each other.

When the content set by the learner is the song content, as shown in Fig. 8K, a book-shaped icon indicating a general sound source or a musical note icon indicating a song sound source is displayed on the menu item. When the learner selects the general sound source icon and performs the above-described follow-up mode, the voice data in which the song lyrics are pronounced by the native speaker is output, and the learner sounds accordingly.

If the learner selects the song sound source icon and performs the above-described follow-up mode, the following mode is performed in the same manner as described above, and the speech data output from the learning system is converted into actual speech data It differs only in that it is song data.

Similarly, as shown in FIG. 81, when the learner selects the song content as the learning content, selects the general sound source icon, and performs the conversation mode, as described above, in the order in which the system outputs the voice data, If the learner selects the song sound source icon and performs the above conversation mode, the conversation mode is performed in the same manner as described above, and the speech data output from the learning system is stored in the text Only the actual song data including the tone rate, which corresponds to the actual song data.

In a case where the learning content is a movie or a drama video, the video is displayed on the screen together with the subtitle and the learning system displays only the audio data of the actual movie or drama corresponding to the dialogue text and the video screen corresponding thereto And the remaining configuration is the same as described above.

The configuration and function of the foreign language learning system according to the preferred embodiment of the present invention have been described.

9A is a flowchart for explaining a foreign language learning method according to a preferred embodiment of the present invention, FIG. 9B is a detailed flowchart of the step S940 shown in FIG. 9A, FIGS. 10A to 10C are a flowchart 11A and 11B are detailed flowcharts for explaining an embodiment for performing a read learning mode in step S914 shown in FIG. 9A, and FIG. 12 is a detailed flowchart for explaining an embodiment for performing a read learning mode in FIG. 9A is a detailed flowchart illustrating in detail an embodiment for performing the write learning mode in step S914 shown in FIG. 9A.

The functions performed in the foreign language learning method shown in FIGS. 9A to 12 are overlapped with the functions performed in the foreign language learning system described with reference to FIGS. 1 to 8L. Therefore, the overall flow of the foreign language learning method according to the preferred embodiment of the present invention will be described with reference to FIGS. 9A to 12.

First, when a learner selects a specific content by driving a foreign language learning system to use the foreign language learning method of the present invention, foreign language texts included in the selected content are output to the learner (S910).

Then, the learner inputs a learning mode (reading, writing, speaking, listening) on the screen (S912), and the foreign language learning system performs learning such as reading, writing, speaking, and listening in accordance with the learning mode selected by the learner S914). The learning contents to be performed in each learning mode are described above with reference to FIGS. 5A to 8L, the speaking learning mode of the present invention will be described later with reference to FIGS. 10A to 10C, The writing learning mode of the present invention will be described below in detail with reference to FIG. 12 with reference to FIG. 11B. FIG.

Meanwhile, while performing the learning, the learner can select a word as shown in Fig. 4, and the foreign language learning system monitors whether the learner selects a word during learning (S916). When the learner selects a word , The word learning menu is displayed to the learner and the selection information is inputted (S920).

If the learner selects the dictionary function, the foreign language learning system retrieves the word selected by the learner from the dictionary data storage unit 330 and outputs it to the learner, and then proceeds to step S914 to re-execute the learning mode (S922).

If the learner selects the wordbook function, the foreign language learning system inputs the meaning of the word selected by the learner, stores it in the learning data storage unit 320, and returns to step S914 to re-execute the learning mode (S924).

If the learner selects the scrap function, the learner saves the memo in the learning data storage unit 320, and then returns to step S914 to re-execute the learning mode (S926).

If the learner selects the tune listening function, the foreign language learning system checks whether the word selected by the learner is the first word of the sentence or the last word of the sentence (S932).

If the word selected by the learner is the first word of the sentence, the foreign language learning system selects the word selected by the learner together with the next word, and if the word selected by the learner is the last word of the sentence, The learner selects the word and the immediately preceding word together (S934).

If the word selected by the learner is neither the first word of the sentence nor the last word of the sentence, the learner selects both the preceding word and the following word of the selected word (S936).

Thereafter, the foreign language learning system outputs sound source data for words selected by the learner and the foreign language learning system (S940).

On the other hand, if it is determined in step S920 that the learner has selected the listening function, the process proceeds to step S940 where the learner outputs sound source data only for words selected by the learner (S940).

In the method of outputting the sound source data, as described above, the start time and end time stored in association with the selected word or words are extracted, and word or tune listening is performed by outputting sound source data corresponding to the time.

As described above, through the steps S932 to S940, the learner can listen not only to the single pronunciation of the selected one word but also to the original pronunciation of the native speaker in the actual sentence, so that the learner can place the selected word in front of and behind It is possible to listen to the pronunciation that is changed in relation to the words that have been learned, thereby learning more realistic pronunciation.

Meanwhile, as described above, the learning contents of the present invention may be plain text, but may be song contents or movie (or drama) video contents. 9A, if the plain text content and the song content are stored together in the learning content storage unit 310, step S940 shown in FIG. 9A may be implemented as shown in FIG. 9B.

Referring to FIG. 9B, the foreign language learning system first checks whether the selected content is the song content (S941). If the selected content is the song content, it examines the type of the sound source to be output (S943). The sound source format to be output can be selected by the learner or set in advance.

If the sound source type to be output is a song sound source, the foreign language learning system outputs corresponding sound data corresponding to the selected word from the corresponding song sound source data stored in the learning content storage unit 310 (S945).

If the learning content is the song content but the learner is set to output it as a general sound source, or if the learning content is the plain text content as a result of the examination in step S941, the audio data of the time corresponding to the words selected from the general sound source is output S947).

In the above examples, it has been described that the voice data is outputted. However, in the case where the learning content is the movie (or drama) dialogue text and the video data associated therewith, Or drama) If one or more words are selected while listening to a moving picture and listening to the praise is selected, in the same manner as that of outputting the above-mentioned voice data, a moving picture portion corresponding to the word from the front word to the rear word of the selected one or more words is reproduced .

It should be noted that steps S916 to S940 described above have been described after step S914 for convenience of explanation, but are performed during execution of speaking, listening, reading, or writing learning in step S914.

Referring to FIGS. 10A to 10C, the embodiment in which the speaking learning mode is executed in step S914 of FIG. 9A will be described in detail. First, the learning system determines whether the learning mode selected by the learner is the speaking mode or the listening / (S914-1). If the mode is the listening / writing / reading mode, the modules are activated to execute the listening / writing / reading learning (S914-2).

If the learning mode selected by the learner is the speaking mode, the speaking module 240 is activated and the speech output speed, the learning unit (words, phrases, sentences, paragraphs, etc.), the speaking learning mode Mode) (S914-3). However, it should be noted that the speech output speed and the learning unit may be input together in the above-described step S912.

Then, the speaking module 240 examines whether the content selected by the learner is song (or moving picture) content, and if it is not the song (or moving picture) content, proceeds to step S914-7 (S914-4).

If the content selected by the learner is a song (or video) content, the speaking module 240 examines which learner has selected the learner's song (or video) content (S914-5) If it is selected, the process goes to step S914-6 to set audio data to be extracted from the song (or moving picture) sound source (S914-6).

On the other hand, if it is determined in step S914-4 that the content selected by the learner is not the song (or moving picture) content, or the learner selects the general sound source of the song (or moving picture) content in step S914-5, And extracts voice data (S914-7).

After that, the speaking module 240 examines whether the speaking mode set by the learner is a conversation mode or a follow-up mode (S914-8). When the speaking mode selected by the learner is a conversation mode, 8l, the learning system and the learner alternately pronounce the unit text, which is the learning unit set by the learner, and performs learning (S914-9).

The learning method performed in the conversation mode is the same as that described above with reference to Figs. 8J to 8L, so that the learner sets the initial speaker (S914-91) The system checks whether the initial speaker is set as the learning system. If the learner is set as the initial speaker, the system proceeds to step S914-94 (S914-92). When the learning system is set as the first speaker, the learning system first outputs the unitary text voice data (S914-93), waits for the system waiting time so that the learner can pronounce the next unit text, 93, and the learning system outputs audio data corresponding to the next unit text (S914-94). At this time, as described above, the learning system records the pronunciation of the learner after step S914-94, evaluates the degree of similarity with the native voice of the native speaker, and repeats steps S914-94 if the degree of similarity is less than the threshold value (S914-95).

On the other hand, if the learner selects the speaking mode according to the following mode, the learning system first pronounces the pronunciation as described above with reference to FIG. 8B, and the learner performs learning by pronouncing the learning unit pronounced by the learning system S914-10). The learning method performed in the follow-up mode is the same as that described above with reference to FIG. 8B. Therefore, the flow will be briefly described with reference to FIG. 10C. , The system waits for a system wait time so that the learner can pronounce the next unit text, and then proceeds to step S914-101 so that the learning system outputs the speech data corresponding to the next unit text (S914-102). At this time, as described above, the learning system records the pronunciation of the learner after steps S914-102, and evaluates the similarity with the native speech data. If the similarity is less than the threshold value, the learning system repeats steps S914-102 (S914-103).

On the other hand, the speaking module 240 examines whether or not it has reached the pronunciation evaluation area while performing the conversation mode and the follow-up mode (S914-11). When the speaking module 240 reaches the pronunciation evaluation area, The evaluation screen is activated and displayed to the learner (S914-12).

Then, the speaking module 240 checks whether the recording unit is a sentence or a word / phrase (S914-13). If the recording unit is a sentence, the learner records the pronunciation performed after the recording button is pressed, The signal is temporarily stored (S914-14).

On the other hand, if the learner-set recording unit is a word / phrase, the speaking module 240 inverts and displays the text corresponding to the recording unit first, as shown in FIG. 8F, and outputs corresponding audio data (S914 -15). As shown in FIG. 8G, the learner's pronunciation of the word / phrase is recorded and stored as a voice signal (S914-16).

If the word / phrase to be pronounced is left, the speech module 240 proceeds to step S914-15 (step S914-17). In step S914-17, the word / phrase is recorded for all the words / phrases If completed, the speech signals recorded in word / phrase unit and temporarily stored are combined and completed in one sentence (S914-18).

Then, the speaking module 240 compares the recorded voice signal with the voice data, evaluates the degree of similarity to the learner as shown in FIG. 8D, and proceeds to step S914-9 or S914-10 And performs the conversation mode or the follow-up mode again (S914-19).

9A, the learning system first determines whether the learning mode selected by the learner is the reading learning mode or the listening / learning mode is selected in step < RTI ID = 0.0 > (S914-a). If the mode is the listening / writing / speaking learning mode, the modules are activated to perform listening / writing / speaking learning (S914-b).

If the learning mode selected by the learner is the reading mode, the learning system activates the reading module 210 and selects a reading unit of words, phrases, sentences, paragraphs, etc. from the learner as shown in FIG. 5B S914-c), a read-out identifier is displayed for each read unit (S914-d). In the preferred embodiment of the present invention, "/" is interrupted to use as a read identifier as described above.

Thereafter, the learning system checks whether the learner has selected the basic reading mode or the following reading mode as the reading mode. If the basic reading mode is selected, the learning system proceeds to step S916 (S914-e). If it is determined in the step S914-e that the learner has selected the read mode, the learning system is set to the speed of the learner (S914-f). The speed can be set to 0.8 times, 0.9 times, 1.0 times, 1.1 times, 1.2 times, or the like. When the learner does not separately set the speed, the speed is set to 1x speed, that is, the speed as pronounced by the native speaker.

After the speed setting step is performed, the learning system examines whether the learner has set the reading mode during the reading learning mode to the normal speed mode or the constant speed mode (S914-g). If the learner sets the constant speed, it is determined that the constant speed mode is set. If the learner does not set the constant speed, it is determined that the normal speed mode is set.

When the learner sets the normal speed mode, the learning system extracts the time information from the voice data, calculates the time per reading unit according to the time information and the speed, and displays the read unit text (S914-h). The step S914-h will be described in more detail with reference to FIG. 11B.

On the other hand, when the learner sets the constant velocity mode, the learning system calculates the time per unit of reading in accordance with the set time and the speed set by the learner or preset by the learning system, So as to be distinguished from the texts (S914-i)

Steps S914-h and S914-i are repeated until the last unit text displayed on the display unit 120, and step S914 is performed again for the next page (S914-j)

Referring to FIG. 11B, step S914-h will be described in detail. If the learning system is not set at the constant speed, it is checked whether the current content is song (or moving picture) content, ), The process advances to step S914-h3 (S914-h1).

If the current content is a song (or moving picture) content, the learning system selects a sound source from the learner and proceeds to steps S914-h3 when the selected sound source is a general sound source, The flow advances to step S914-h4 (S914-h2).

If the content selected by the learner is general foreign language text content, not song (or video) content, or the content is a song (or video), but the learner selects a general sound source, the learning system extracts time information (S914-h3). As described above, the general sound source includes voice data in which words (or subtitles) of a song (or a moving picture) are pronounced and recorded by a native speaker as if reading a general book.

If the learner selects a song (or video) sound source, the learning system extracts time information from the sound data included in the sound source of the actual song (or actual motion picture) (S914-h4).

Then, the learning system calculates the time to be displayed so as to be distinguished per unit of reading according to the time information and the speed information (S914-h5), and inverts the text of the reading unit for the calculated time, displays it in a specific color, And displays it so as to be distinguished from other text in a manner of displaying (S914-h6).

The steps S914-a to S914-h6 described so far have been described in detail with reference to Figs. 5A to 5D, and a detailed description thereof will be omitted.

12, a description will be made in detail of an embodiment for performing a writing learning mode according to a preferred embodiment of the present invention. First, the learning system determines whether a learning mode selected by a learner is a writing learning mode or a listening / speaking / If it is the listening / speaking / reading learning mode, the modules are activated to execute the listening / speaking / reading learning (S914-2).

If the learning mode selected by the learner is the writing mode, the writing module 220 is activated, and a text unit such as a word, phrase, and sentence is selected from the learner as shown in FIG. 6A (S914- And sequentially outputs the speech data corresponding to the text unit to the learner through the sound output unit 130 (S914- (4)).

At this time, the content selected by the learner may be a general foreign language text content, but may be a song content or a moving picture content in which a song lyrics text or a subtitle text is combined with an actual song sound source or actual video data. In the case where the content selected by the learner is the song content or the video content, the learner can select the general speech data pronounced by the native speaker as if reading the song lyrics or subtitles, or the actual song containing the tone rate It is possible to select the audio data to be outputted or the moving picture audio data including the audio of the actual actors.

On the other hand, during the output of the audio data sequentially, when the predetermined writing section is reached (S914-⑤), the learning system activates the writing screen as shown in Figs. 6A and 6B, And displays the meaning of the sentence or phrase to be input by the learner in the native language of the learner, and lists words to be input by the learner in an arbitrary order (S914-⑥). Here, the writing period may be changed by the learner, and the order of the words displayed in the same writing period is arbitrarily changed by the learning system every time the writing screen is activated.

If the learner selects and enters the listed words in order (S914-⑦) as shown in (c) of FIG. 6B, the learning system compares the contents inputted by the learner with the original text, (Step S914-S814). If the numbers match, the process advances to step S914- (4).

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner.

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

110 input unit 120 display unit
130 sound output unit 200 control unit
210 Reading module 212 Basic reading function
214 read function part 216 read control part
220 writing module
230 listening modules 240 speaking modules
241 Speed setting section 243 Recording section
245 speaking controller 247-1 similarity evaluator
247-2 Transmission /
250 word management module 251 Listening function
253 Listening function 255 Pre-function
257 Wordbook Function 259 Scrap Function
260 Learning Management Module 300 Database
310 Learning content storage unit 320 Learning data storage unit
330 Dictionary data storage 800 MIC

Claims (48)

A database for storing the foreign language text data and the voice data in which the foreign language text is pronounced by the native speaker in association with the foreign language text on a word by word basis;
A display unit for outputting the foreign language text;
An acoustic output unit for outputting the voice data;
An input unit for receiving selection information for a learning mode from a learner;
The text of the reading unit to be read at the current time is distinguished from the other text so that the learner can read along with the text displayed on the display unit in the reading mode during the reading learning mode A reading module to display;
The learner is activated when the learner selects the speech learning mode and the learner and the foreign language learning system alternately speak the foreign language text in the conversation mode in the speech learning mode so that the learner can pronounce the foreign language text according to the learning unit A speech module for outputting speech data corresponding to a foreign language text of a next learning unit through the sound output unit when a time (system waiting time) has elapsed; And
The learner is activated when the learner selects the writing learning mode to sequentially output the voice data corresponding to the foreign language text data through the sound output unit and display the writing screen on the display unit when the learner reaches the predetermined writing period, And a writing module that performs writing learning by sequentially inputting the listed foreign language words so as to correspond to the meaning of the displayed native language. The method according to claim 1,
The database stores the time at which the pronunciation starts and the time at which the pronunciation finishes for each of the words included in the text in association with each other,
In the following reading mode, the reading module receives the speed setting from the learner through the input unit, extracts time information corresponding to each word from the database, calculates the time per reading unit according to the time information and the set speed So as to be distinguished from other texts during the calculated time period. 3. The method of claim 2,
Wherein the reading module sets either the constant velocity mode or the normal velocity mode through the input unit,
And displays the text of the reading unit to be read at the current time so as to be distinguished according to the calculated time when the learner sets the normal speed mode,
When the learner sets the constant speed mode, the time per unit of reading is calculated according to the time set by the learner or the time set in advance by the learning system and the set speed, and displayed so as to be distinguished from other texts during the calculated time Foreign language learning system. 4. The system of claim 2 or 3, wherein the reading module
When the foreign language text is a song lyrics or a moving picture subtitle, time information is extracted from the speech data included in a general sound source in which the native speaker pronounces the lyrics of the song or the moving picture caption, according to the learner's choice, Extracts time information from the included voice data, and displays the text of the reading unit corresponding to the time corresponding to each reading unit so as to be distinguished from other texts. 4. The system of any one of claims 1 to 3, wherein the reading module
The learner sets the reading mode or the basic reading mode according to the learner,
Wherein when the learner sets the basic reading mode, the learner breaks the reading unit by the reading unit set by the learner and displays the identifier for each section to be read.
2. The apparatus of claim 1, wherein the writing module
Wherein a foreign language word can be entered in units of words or phrases in accordance with a selection of a learner on the writing screen.
2. The method of claim 1,
The conversation mode or the follow-up mode is selected according to the learner's selection,
In the reading mode, the voice data corresponding to the foreign language text is output through the sound output unit. After the learner waits for a time (system waiting time) for pronouncing the same foreign language text, And outputs it through the sound output unit. 8. The method of claim 1 or 7, wherein the speaking module
Wherein the learning unit classifies the foreign language text into units of one of words, phrases, sentences, and paragraphs. 8. The method of claim 1 or 7, wherein the speaking module
Wherein when outputting the voice data, the foreign language text corresponding to the voice data is inverted in a text unit set by the learner and output through the display unit. 8. The method of claim 1 or 7, wherein the speaking module
And outputs voice data in accordance with the voice output speed set by the learner. 8. The method of claim 1 or 7, wherein the speaking module
And the words are reversed in units of words, phrases, sentences and paragraphs to be pronounced by the learner in the system waiting time, and outputted through the display unit. 8. The method of claim 1 or 7, wherein the speaking module
The pronunciation of the learner is compared with the voice data to calculate the similarity, and when the similarity is equal to or greater than a predetermined value, the system outputs voice data. 8. The method of claim 1 or 7, wherein the speaking module
And a display unit for displaying the pronunciation of the learner and for calculating the similarity between the pronunciation of the learner and the voice data and displaying the pronunciation of the learner through the display unit. And outputting the foreign language learning data. 14. The method of claim 13,
A unit for inputting a pronunciation of a learner on the pronunciation evaluation screen is set to any one of a word, phrase, and sentence. When the set unit is a word or phrase, the learner inverts the text corresponding to the word or phrase The pronunciation of the learner is inputted, and when the pronunciation of the learner is input to all the words or all the phrases displayed on the pronunciation evaluation screen, Of the foreign language learning system. 8. The method of claim 1 or 7,
If the foreign language text is song lyrics, the audio data corresponding to the song lyrics is classified into an actual song source and a general source including a tone rate,
Wherein the speaking module outputs voice data from an actual song sound source or a general sound source according to the setting of the learner. 8. The method of claim 1 or 7, wherein the speaking module
A speed setting unit that receives an output speed (audio output speed) of voice data from a learner; And
When the learner speaks the foreign language text (system standby time), the user selects one of the voice corresponding to the foreign language text and the voice corresponding to the foreign language text Outputting the data through the sound output unit,
In the following reading mode, voice data corresponding to a foreign language text is output through the sound output unit. After the learner waits for a time (system waiting time) to pronounce the same foreign language text, voice data corresponding to the next foreign language text is output to the sound output Output through the part,
And a speaking controller for adjusting the system standby time according to a time at which the voice data is outputted and the voice output speed. 17. The method of claim 16,
A recording unit for recording the pronunciation of the learner; And
Further comprising a similarity evaluating unit for comparing the pronunciation of the learner inputted from the recording unit with the speech data to evaluate the similarity,
Wherein the speech control unit outputs the evaluation result of the similarity evaluating unit through the display unit. 17. The method of claim 16,
A recording unit for recording the pronunciation of the learner; And
Further comprising a transceiver for transmitting a pronunciation of the learner input from the recording unit to a similarity evaluation server and receiving a similarity evaluation result from the similarity evaluation server,
Wherein the speech control unit outputs the similarity evaluation result input from the transceiving unit through the display unit.
The method according to claim 1,
The input unit receives a word from the foreign language text output through the display unit,
The foreign language learning system includes:
And a word management module for outputting a word learning menu related to the selected word through the display unit and receiving menu selection information through the input unit,
Wherein the word management module sequentially outputs audio data corresponding to a word from a preceding word of the selected word to a back word of the selected word among the texts output to the display unit through the sound output unit Language learning system. 20. The method of claim 19,
Wherein the database stores the time information of the voice data corresponding to the word in each foreign language text and stores the start time information and the end time information in which the words are pronounced together, . 21. The method of claim 20,
Wherein the word management module outputs the speech data corresponding to the time from the start time of the previous word of the selected word to the end time of the next word of the selected word when the tune listening is selected for the selected word . 21. The method of claim 20,
The word management module, when listening to the selected word is selected,
If the selected word is the first word of the sentence, output voice data corresponding to the time from the start time of the selected word to the end time of the next word of the selected word,
When the selected word is the last word of the sentence, outputs the speech data corresponding to the time from the start time of the previous word of the selected word to the end time of the selected word. 23. The method according to any one of claims 20 to 22,
Wherein the foreign language text is a song lyrics and the voice data is extracted and output from a song sound source corresponding to the song lyrics or a general sound source in which a native speaker reads the song lyrics according to a learner's selection or presetting, system. 23. A method according to any one of claims 20 to 22
Wherein the foreign language text is a metabolism of a movie or a drama, and the voice data is animation data corresponding to the movie or drama metabolism. 23. A method according to any one of claims 20 to 22
The word learning menu includes a listener listening menu, a listening menu for outputting voice data corresponding to the selected word, a dictionary menu for inquiring dictionary information of the selected word, a wordbook menu for storing the meaning of the word selected by the learner, And a scrap menu capable of inputting a memo about a phrase or a phrase. 26. The system of claim 25, wherein the database
A learning content storage unit for storing the foreign language text data, the audio data, and the time information;
A learning data storage unit for storing semantic data of a word and a word inputted by a learner selecting a wordbook menu and a memo inputted by a learner selecting a scrap menu; And
And a dictionary data storage unit for storing dictionary data.

(a) outputting a foreign language text of a content selected by a learner and receiving a learning mode from a learner;
(b) when the learning mode selected by the learner is in the reading learning mode, the reading unit is input, the reading unit is interrupted every reading unit, and when the learner sets the reading mode according to the reading mode, Displaying the text of the read unit to be read at the current time so as to be distinguishable from other text so that the text can be read along with the text;
(c) receiving a speech output speed and a learning unit from a learner and inputting a conversation mode or a follow-up mode when the learning mode selected by the learner is the speaking mode, and when the learner selects the conversation mode, The system executes a conversation mode in which speech learning is performed by pronouncing the foreign language text corresponding to the learning unit alternately. When the time (system waiting time) for the learner to pronounce the foreign language text according to the learning unit has elapsed, Outputting speech data corresponding to text by a foreign language learning system; And
(d) When the learning mode selected by the learner is the writing mode, the voice data corresponding to the foreign language text data is sequentially output through the sound output unit. When the learning mode reaches the predetermined writing period, the writing screen is displayed on the display unit And performing a writing learning by causing the learner to sequentially input the listed foreign language words so as to correspond to the meaning of the displayed native language.
28. The method of claim 27, wherein in step (b)
Extracting time information defining a time at which the pronunciation of each word begins and a time at which pronunciation of each word is defined from the voice data corresponding to the foreign language text when the learner sets the reading mode according to the learner; Calculating the time per reading unit according to the time information and the set speed, and displaying the time so as to be distinguished from other texts during the calculated time. 29. The method of claim 28, wherein step (b)
The learner is set to either the constant velocity mode or the normal velocity mode,
And displays the text of the reading unit to be read at the current time so as to be distinguished according to the calculated time when the learner sets the normal speed mode,
When the learner sets the constant speed mode, the time per unit of reading is calculated according to the time set by the learner or the time set in advance by the learning system and the set speed, and displayed so as to be distinguished from other texts during the calculated time Foreign language learning method. 30. The method of claim 28 or 29, wherein step (b)
When the foreign language text is the song lyrics or the moving picture caption, time information is extracted from the speech data included in the general sound source where the native speaker pronounces the song lyrics or the moving picture caption according to the learner's choice, Extracting time information from the voice data and displaying the text of the reading unit corresponding to the time corresponding to each reading unit so as to be distinguished from other texts. 30. The method of claim 28 or 29, wherein step (b)
The learner sets the reading mode or the basic reading mode according to the above,
And when the learner sets the basic reading mode, the learner breaks the reading unit by the reading unit set by the learner, and displays the identifier for each section to be read.
28. The method of claim 27, wherein step (d)
And a foreign language word can be entered in units of words or phrases in accordance with the learner's choice on the writing screen.
28. The method of claim 27, wherein in step (c)
When the learner selects the following mode in the speaking mode, the learning system outputs the voice data corresponding to the foreign language text according to the learning unit, waits for the learner to speak the same foreign language text (system waiting time) And outputting speech data corresponding to the next foreign language text. 34. The method of claim 27 or 33,
Wherein the learning unit is any one of a word, a phrase, a sentence, and a paragraph. 34. The method of claim 27 or 33,
Wherein the learning system inverts the foreign language text corresponding to the voice data in a text unit set by the learner and outputs the foreign language text when outputting the voice data. 34. The method of claim 27 or 33,
Wherein the learning system outputs speech data in accordance with the speech output speed set by the learner. 34. The method of claim 27 or 33,
Wherein the learning system inverts words in units of words, phrases, sentences, and paragraphs to be pronounced by the learner in the system standby time, and displays the words. 34. The method of claim 27 or 33,
Wherein the learning system compares the learner's pronunciation with the loudspeaker data when the learner pronounces the loudspeaker to calculate the similarity degree, and when the similarity degree is equal to or greater than a preset value, the system outputs the loudspeaker data. 34. The method of claim 27 or 33,
When the learning system reaches a predetermined foreign language text, the learning system switches to the pronunciation evaluation screen, outputs the preset text to the learner, receives and stores the pronunciation of the learner, calculates the similarity between the pronunciation of the learner and the speech data And the result is displayed. 40. The method of claim 39,
A unit for inputting a pronunciation of a learner on the pronunciation evaluation screen is set to any one of a word, phrase, and sentence. When the set unit is a word or phrase, the learner inverts the text corresponding to the word or phrase The pronunciation of the learner is inputted, and when the pronunciation of the learner is inputted to all the words or all the phrases displayed on the pronunciation evaluation screen, Is calculated. 34. The method of claim 27 or 33,
When the foreign language text is a song lyrics, the voice data corresponding to the song lyrics is classified into a song sound source including a tone rate and a general sound source,
Wherein the step (c) outputs voice data from a song sound source or a general sound source in accordance with a learner's setting.
28. The method of claim 27,
The learner checking whether a learner selects a word during the steps (b) to (d), and when the learner selects a word, the learner outputs a word learning menu for the word selected by the learner, And outputting, through the sound output unit, voice data corresponding to the words from the previous word of the selected word to the backward word of the selected word out of the text output to the display unit, Learning method. 43. The method of claim 42,
Wherein the database stores time information of the voice data corresponding to the word in each foreign language text and stores start time information and end time information in which the words are pronounced together in association with each other Way. 44. The method of claim 43,
And outputting speech data corresponding to a time from a start time of a preceding word of the selected word to an end time of a backward word of the selected word when listening to the selected word is selected. 44. The method of claim 43,
If listening is selected for the selected word,
If the selected word is the first word of the sentence, output voice data corresponding to the time from the start time of the selected word to the end time of the next word of the selected word,
If the selected word is the last word of the sentence, output speech data corresponding to the time from the start time of the previous word of the selected word to the end time of the selected word. A method according to any one of claims 43 to 45,
Wherein the foreign language text is a song lyrics and extracts the voice data from a song sound source corresponding to the song lyrics or a general sound source in which a native speaker has read the song lyrics according to a learner's selection or preset, Way. A method according to any one of claims 43 to 45,
Wherein the foreign language text is a metabolism of a movie or a drama, and the voice data is animation data corresponding to the movie or drama metabolism. A method according to any one of claims 43 to 45,
The word learning menu includes a listener listening menu, a listening menu for outputting voice data corresponding to the selected word, a dictionary menu for inquiring dictionary information of the selected word, a wordbook menu for storing the meaning of the word selected by the learner, And a scrap menu capable of inputting a memo for a phrase or a phrase.

Images