JP5230515B2 - Language teaching method using thought units and connected questions - Google Patents

Description

  The present invention relates to a language education system. More specifically, according to the level of the learner, the education process is performed using the Internet and multimedia so that the language education of listening, speaking, reading and writing can be effectively learned. The present invention relates to a system and method.

  Recently, as ultra high-speed Internet services are provided to general subscribers, subscribers are becoming more accessible to various contents such as real-time video.

  There are various services provided through the Internet, such as electronic commerce and Internet education.

  However, since such Internet education is merely a transfer of the conventional learning method to the Internet, there is a problem that it is difficult to provide effective learning. That is, the conventional Internet education method has an advantage of providing learning materials online by converting learning materials into a multimedia method, but does not provide a service by a learning method that can enhance learning effects. On the other hand, conventionally, there is used an educational method in which a learner can learn spontaneously by a method of storing multimedia learning material on a CD (Compact Disk) or DVD (Digital Video Disk) and providing it to the learner. However, such a method for providing learning materials can provide a large amount of multimedia learning materials to the learner, but does not provide a method for the learner to effectively learn.

  One example is English education. English education can be divided into listening, speaking, reading, and writing. Therefore, in order to effectively teach English, it is necessary to effectively learn both listening, speaking, reading, and writing.

  The conventional English teaching method as described above has a problem that it is difficult to expect a large learning effect because a conversation scene suitable for the situation is reproduced as a moving image and repeatedly learned. Moreover, since the conventional method connects all simple sentences and outputs them to the learner, it is impossible to recognize the thought units (a set of words constituting one meaning) constituting each sentence. Therefore, since the learner needs to memorize all the sentences in a circle, it becomes impossible to implement the sentences that suit the situation.

  Accordingly, the present invention has been made to solve the above-mentioned problems of the prior art, and sequentially provides one sentence divided into units of thought, asks the learner, and then responds to the learner's response. Its purpose is to provide a language education system that uses thought units and linked questions to advance the learning phase.

  Another object of the present invention is to divide a sentence into units of thought and provide them sequentially so that they can learn listening, speaking, reading, and writing, and then advance the learning phase according to the learner's response after the question. The object is to provide a language teaching method using thought units and linked questions.

  In order to achieve the object, a language education method using thought units and linked questions according to the present invention includes a language learning program according to a subscriber's learning level, and each sentence in accordance with a word order and a plurality of thought units and the thoughts. Storing the divided questions corresponding to the unit separately, receiving the learning stage information of the subscriber and the learning program progress method from the subscriber terminal connected through the network, and the input Extracting learning material corresponding to the learning stage information, and controlling the extracted learning material to be output to the subscriber's terminal according to the input learning program progression method. .

  As explained above, the present invention has a problem that it is difficult to expect a high learning effect because the conventional English teaching method reproduces scenes according to the situation by moving images and repeats learning, and all simple sentences are connected. Solved the problem that the learner could not recognize the thought units that make up each sentence, and the learner had to memorize the whole sentence as a circle, making it impossible to embody the sentence according to the situation. Therefore, listening, speaking and writing education can be effectively provided according to the ability of the learner via the Internet. Moreover, this invention can provide a thinking unit and a connection question so that each sentence can be changed according to a condition. Moreover, according to the present invention, the word order structure of the language to be learned can be naturally learned, and the sentence generation ability and sentence prediction ability can be improved. Furthermore, according to the present invention, it is possible to learn in various ways online and offline using multimedia learning materials.

It is a block diagram which shows in detail the structure of the information provider apparatus in the language education system by one Example of this invention. It is a block diagram which shows in detail the structure of the subscriber apparatus in the language education system by one Example of this invention. It is a block diagram which shows in detail the structure of the information provider apparatus in the language education system by the other Example of this invention. It is a block diagram which shows in detail the structure of the subscriber apparatus in the language education system by the other Example of this invention. (A) is a figure which shows the structure of the multimedia database shown in FIG.1 and FIG.3, (b) is a figure which shows the structure of the learning material database shown in FIG.1 and FIG.3, (c) is a figure which shows FIG. 4 is a diagram showing a structure of a master file of the member database shown in FIG. 3, and FIG. 4D is a diagram showing a structure of a result file of the member database shown in FIGS. 1 and 3. FIG. 4 is a flowchart illustrating an operation of a language education system using thinking units and linked questions according to an embodiment of the present invention. It is a flowchart which shows in detail the example which outputs the thinking unit data sentence output step shown in FIG. 6 by a basic learning formula. It is a flowchart which shows in detail the example which outputs the thought unit data sentence output step shown in FIG. 6 by a cumulative iterative learning formula. It is a flowchart which shows the role learning control step shown in FIG. 6 in detail. It is a flowchart which shows an example (utterance learning control 1) of the utterance learning control stage shown in FIG. It is a flowchart which shows the other example (utterance learning control 2) of the utterance learning control stage shown in FIG. It is a flowchart which shows the further another example (utterance learning control 3) of the utterance learning control stage shown in FIG. It is a flowchart which shows the further another example (utterance learning control 4) of the utterance learning control stage shown in FIG. It is a flowchart which shows the further another example (utterance learning control 5) of the utterance learning control stage shown in FIG. It is a flowchart which shows the further another example (utterance learning control 6) of the utterance learning control stage shown in FIG. It is a flowchart which shows in detail the example which outputs the reading learning control stage shown in FIG. 6 by a basic learning formula. 7 is a flowchart showing in detail an example of outputting the reading learning control stage shown in FIG. 6 by a cumulative iterative learning formula. It is a flowchart which shows in detail the example which outputs the writing learning control stage shown in FIG. 6 by a basic learning formula. It is a flowchart which shows in detail the example which outputs the writing learning control step shown in FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS.

  The embodiment of the present invention shown in FIGS. 1 and 2 shows an example in which the learning process is controlled by the information provider device.

  FIG. 1 is a diagram illustrating in detail a configuration of an information provider device in a language education system using the Internet and multimedia according to an embodiment of the present invention. In the figure, reference numeral 110 is a learning material storage unit, 120 is a recognition unit, 130 is a transmission control unit, 140 is a member management unit, 150 is a reception material storage unit, 160 is a network interface, 111 is a learning material database, 113 is Learning material extraction control unit, 115 is a thought unit text buffer, 116 is a moving picture data buffer, 117 is a linked question text buffer, 121 is a first comparison unit, 122 is a speech recognition unit, 123 is a second comparison unit, and 141 is a member Reference numeral 142 denotes a member recognition unit, 151 denotes a reception text buffer, 152 denotes a reception audio buffer, and 153 denotes a reception control unit.

  First, the learning material storage unit 110 will be described in detail based on the drawings. All learning materials are stored in the learning material database 111. The learning material database 111 can be composed of, for example, an SQL server.

  Thus, the learning material stored in the learning material database 111 is extracted under the control of the learning material extraction control unit 113 and then stored in the buffer for each content. That is, the thought unit text from the learning material database 111 is stored in the thought unit text buffer 115, and the linked question text is stored in the linked question text buffer 117.

  In the present invention, it can be said that the unit of thought is a set of words constituting one meaning constituting a sentence. For example, the sentence “I went to Kimpo airport to see my American friend.” Is divided into four thought units of “I went”, “to Kimpo airport”, “to see”, and “my America friend”. Here, when thinking units are examined in order, there is a thinking unit called “to Kimpo airport” after the thinking unit “I went”. However, the thinking unit “to Kimpo airport” is a thinking unit indicating a place. Therefore, in order to obtain the answer “to Kimpo airport” from the learner, it is better to ask the question “where” after the thought unit “I went”. In the present invention, such a question “where” is called a linked question for obtaining a thought unit indicating a place. Therefore, in the above example, three linked questions can be configured.

  In the above embodiment, one thinking unit is connected to one linked question. However, in order to improve the sentence generation ability, a plurality of thinking units may be connected to one connected question. Good.

  At this time, n buffers are stored according to the number of thought units. The learning material extraction control unit 113 selects the learning material to be extracted according to the control signal from the transmission control unit 130.

  Thus, the data stored in the thought unit text buffer 115 and the linked question text buffer 117 of the learning material storage unit 110 are input to the transmission control unit 130. The data input to the transmission control unit 130 is transmitted to the Internet 170 via the network interface 160.

  On the other hand, data from the Internet 170 is input to the reception control unit 153 via the network interface 160. Then, the reception control unit 153 outputs the received data to the member recognition unit 142 when the received data indicates member information. If the received data is audio data, the reception control unit 153 outputs the received audio buffer 152. If the received data is text data, the reception control unit 153 outputs the received text buffer. 151 is output.

  The member recognition unit 142 recognizes the member by comparing the member information stored in the member database 141 with the member information from the reception control unit 153.

  The first comparison unit 121 of the recognition unit 120 compares the texts in the thought unit text buffer 115 and the received text buffer 151, determines whether the subscriber's writing is accurate, and outputs the result to the transmission control unit 130. Similarly, the second comparison unit 123 of the recognition unit 120 compares the thought unit text from the thought unit text buffer 115 with the recognized text from the speech recognition unit 122 to determine whether the pronunciation of the subscriber is accurate. To the transmission control unit 130.

  FIG. 2 is a diagram showing in detail a configuration of a subscriber device in a language education system using the Internet and multimedia according to an embodiment of the present invention. In the figure, reference numeral 210 is a network interface, 220 is a reception control unit, 230 is a transmission control unit, 240 is a learning material storage buffer, 250 is an output control unit, 260 is a video card, 270 is a sound card, 280 is a microphone, Reference numeral 241 denotes a thought unit text buffer, 242 denotes an audio conversion unit, 243 denotes a linked question text buffer, and 244 denotes a moving image data buffer.

  Data from the information provider device is received by the reception control unit 220 via the network interface 210. Then, the reception control unit 220 classifies the received data, and stores the thinking unit text data in the thinking unit text buffer 241 and the linked question text data in the linked question text buffer 243, respectively.

  As described above, the text data stored in the thought unit text buffer 241 and the linked question text buffer 243 is output to the monitor via the video card 260 under the control of the output control unit 250. On the other hand, the thought unit or the connected question audio data converted by the voice conversion unit 242 is output to the speaker via the sound card 270 under the control of the output control unit 250.

  On the other hand, the audio signal from the subscriber is input to the sound card 270 via the microphone 280. The audio signal input to the sound card 270 is converted into audio data and then transmitted under the control of the transmission control unit 230. The audio data transmitted in this way is received by the information provider apparatus via the Internet.

  In the embodiment shown in FIGS. 1 and 2, the learning material is transmitted between the information provider device and the subscriber device via the Internet as an example, but learning provided from the information provider device is described. It may be executed after the material is stored in a mobile storage device (eg, CD, DVD, etc.) and provided to the subscriber device collectively. In this case, the subscriber unit can be constituted by a personal computer, for example, which can drive a mobile storage device. Similarly, the learner can perform learning by downloading the learning materials from the information provider device collectively via the joining device and then executing the learning material. Therefore, the language education system according to the embodiment of the present invention can be taught online and offline.

  3 and 4 show an example in which the learning process is controlled by a subscriber unit.

  FIG. 3 is a diagram showing in detail the configuration of an information provider device in a language education system using the Internet and multimedia according to another embodiment of the present invention. In the figure, reference numeral 310 is a learning material storage unit, 320 is a transmission control unit, 330 is a member management unit, 340 is a reception control unit, 360 is a network interface, 370 is the Internet, 311 is a learning material extraction control unit, and 312 is The learning material database, 313 is a thought unit text buffer, 314 is a linked question text buffer, 315 is a moving image data buffer, 331 is a member database, and 332 is a member recognition unit.

  The learning material storage unit 310 will be described in detail based on the drawings. All learning materials are stored in the learning material database 312. The learning material database 312 can be composed of, for example, an SQL server.

  As described above, the learning material stored in the learning material database 312 is extracted under the control of the learning material extraction control unit 311 and then stored for each content. That is, the thought unit text from the learning material database 312 is stored in the thought unit text buffer 313, and the linked question text is stored in the linked question text buffer 314.

  At this time, n buffers are stored according to the number of thought units. The learning material extraction control unit 311 selects the learning material to be extracted according to the control signal from the transmission control unit 320.

  Thus, the data stored in the thought unit text buffer 313 and the linked question text buffer 314 of the learning material storage unit 310 are input to the transmission control unit 320. The data input to the transmission control unit 320 is transmitted to the Internet 370 through the network interface 360.

  On the other hand, data from the Internet 370 is input to the reception control unit 340 via the network interface 360. Then, the reception control unit 340 outputs the received data to the member recognition unit 332 when the received data indicates member information. The member recognition unit 332 recognizes the member by comparing the member information stored in the member database 331 with the member information from the reception control unit 340.

  FIG. 4 is a diagram showing in detail a configuration of a subscriber device in a language education system using the Internet and multimedia according to still another embodiment of the present invention. In the figure, reference numeral 410 is a network interface, 420 is a transmission / reception control unit, 430 is a learning material storage buffer, 440 is a recognition unit, 450 is an output control unit, 460 is a video card, 470 is an input unit, 471 is a text buffer, Reference numeral 472 denotes a keyboard, 473 denotes an audio buffer, 474 denotes a sound card, and 475 denotes a microphone.

  Data from the information provider device is received by the transmission / reception control unit 420 via the network interface 410. Then, the transmission / reception control unit 420 classifies the received data, and stores the thinking unit text data in the thinking unit text buffer 431 and the linked question text data in the linked question text buffer 433, respectively.

  The text data thus stored in the thought unit text buffer 431 and the linked question text buffer 433 is output to the monitor via the video card 460 under the control of the output control unit 450. On the other hand, the thought unit or the connected question audio data converted by the voice conversion unit 432 is output to the speaker via the sound card 474 under the control of the output control unit 450.

  The text data input to the keyboard 472 is input to the text buffer 471, and the audio data input via the microphone 475 and the sound card 474 is stored in the audio buffer 473, respectively.

  On the other hand, the third comparison unit 441 of the recognition unit 440 compares the texts in the thought unit text buffer 431 and the text buffer 471, determines whether the subscriber's writing is accurate, and outputs the result to the output control unit 450. Similarly, the text comparison unit 443 of the recognition unit 440 compares the recognized texts from the thought unit text buffer 431 and the speech recognition unit 442, determines whether the pronunciation of the subscriber is accurate, and sends it to the output control unit 450. Output.

  In the embodiment shown in FIG. 3 and FIG. 4, the learning material is transmitted between the information provider device and the subscriber device via the Internet as an example, but learning provided from the information provider device is described. It may be executed after the material is stored in a mobile storage device (eg, CD, DVD, etc.) and provided to the subscriber device collectively. In this case, the subscriber unit can be constituted by a personal computer, for example, which can drive a mobile storage device. Similarly, the learner can perform learning by downloading the learning materials from the information provider device collectively via the joining device and then executing the learning material. Therefore, the language education system according to the embodiment of the present invention can be taught online and offline.

  5a to 5d are diagrams showing in detail the structures of the learning material database and the member database shown in FIGS.

  5a shows a multimedia database, FIG. 5b shows a learning material database, FIG. 5c shows a master file of the member database, and FIG. 5d shows a result file of the member database.

  First, the multimedia database (FIG. 5a) includes a learning material code, moving image data, and a learning progress procedure program field. The learning material database (FIG. 5b) includes a learning material code, an actor code, a caption code, a thinking unit text, a thinking unit translation text, and a linked question text field, as shown. The thought unit text and the linked question text field are composed of one set, for example, n sets corresponding to the number of thought units. In the present invention, each set is defined as a linked question set. The thought unit translation text is a field in which translation data of the corresponding thought unit text is stored. Since the nth set of the linked question set has no next question, it is configured not to include a linked question text field.

  The master file of the member database (FIG. 5c) is composed of a member code, name, address, secret number, current learning material code, current caption code, learning level, and learning result field. Here, the current learning material code field stores a learning material code that the member is learning. The current caption code stores the caption code of the speech that the learner finally learned.

  Finally, the member database results file (FIG. 5d) is composed of a member code, a learning material code, a basic learning score, an utterance score, and a writing score. In such a member database, the basic learning score, the utterance score, and the writing score are recorded for each member's learning material. The results file of the first term member database and the master file of the member database correspond to the member code on a one-to-many basis.

  FIG. 6 is a flowchart illustrating the operation of the language education system using the thinking unit and the linked question according to the embodiment of the present invention.

  Such operation control is controlled by the transmission control unit 130 shown in FIG. 1 or the output control unit 250 shown in FIG. The transmission control unit 130 or the output control unit 250 controls learning based on a learning progress procedure program stored in the learning material database 111 corresponding to the corresponding learning material. Here, for ease of explanation, it is assumed that the learning progress procedure program is installed in the output control unit 250 and executed.

  First, the output control unit 250 determines whether the learner has selected the impression mode (S110). At this time, when the learner selects the impression mode, the output control unit 250 extracts the moving image data from the moving image data buffer 244 and plays the moving image data (S120). Thus, the learner can view a moving image (for example, a movie or a lecture) related to learning.

  Next, the output control unit 250 determines whether the learner has selected the listening learning mode (S130). The listening learning mode allows the learner to learn while listening to a specific dialogue part while thinking about moving images, or by listening to the whole sentence repeatedly. When the learner selects the listening learning mode, the output control unit 250 sequentially outputs corresponding learning sentences for each thinking unit.

  On the other hand, when the learner selects the utterance learning mode (S150), the output control unit 250 enables role learning. That is, the utterance learning mode enables learning by selecting one of the moving picture actors and letting the actor speak. Therefore, when the learner selects the utterance learning mode, the output control unit 250 starts role learning control (S160).

  Next, when the learner selects the reading learning mode (S170), the output control unit 250 performs control so that reading learning can be performed. In such a reading learning mode, a sentence corresponding to the position of a moving image is output for each thinking unit so that the learner can pronounce and learn reading. In the reading learning mode, the learner can learn using the thinking units and the connected questions constituting the sentence, so that the language utilization ability can be enhanced.

  Finally, when the learner selects the writing learning mode (S190), the output control unit 250 enables the learner to write and learn. Therefore, in the writing learning mode, the learner can input the corresponding sentence in the moving image with the keyboard or selectively input the word so that the learning can be performed. Such a writing learning mode enables writing learning with respect to a thinking unit or all sentences constituting the sentence.

  FIG. 7 is a flowchart showing in detail an example of outputting the thought unit data sentence output stage shown in FIG. 6 by a basic learning formula.

  As shown in the figure, according to the basic learning method, the transmission control unit 130 or 320 transmits the current thought unit text (S310), and transmits the corresponding current thought unit text and the voice output command (S320).

  That is, when the value of the current thinking unit is i, the transmission control unit outputs the i-th thinking unit text.

  FIG. 8 is a flowchart showing in detail an example of outputting the thought unit data sentence output stage shown in FIG. 6 by a cumulative iterative learning formula.

  As shown in the figure, according to the cumulative iterative learning formula, the transmission control unit 130 or 320 combines text data from the first thinking unit to the current thinking unit (S330). Next, the transmission control unit transmits the combined text data as described above (S340), and then transmits the combined thought unit text and voice output command (S350). Therefore, each time the current thinking unit increases by 1, the subscriber receives the text data of the thinking unit accumulated one by one.

  FIG. 9 is a flowchart showing in detail the role learning control stage shown in FIG.

  First, when the utterance learning mode is started, the output control unit 450 causes the learner to select an actor that can play a role in a moving image (S412). At this time, the information on the actor selected by the learner corresponds to the actor code shown in FIG. The role of the learner can be changed during the course of learning.

  As described above, when the actor role of the learner is selected, the output control unit extracts the moving image data from the moving image data buffer 434 and plays it through the video card 460 and the sound card 474 (S414). At this time, the sentence of the actor's dialogue of the moving image data to be played is output as text via the video card in correspondence with the caption code as shown in FIG. 5b. The output text is output as one sentence by combining the first thought unit text to the nth thought unit text shown in FIG. 5B.

  As learning proceeds, the output control unit determines whether the actor's dialogue to be output corresponds to the actor's dialogue designated as the role of the learner (S416). At this time, if it corresponds to the dialogue of the actor selected by the learner, the audio data of the moving image data is stopped so as not to be output via the sound card, and the playing of the moving image is stopped for a while (S418 to S420).

  Next, the output control unit starts the utterance learning control so that the learner can learn the utterance in response to the role person's dialogue (S422). In the embodiment of the present invention, the speech learning control will be described with reference to six examples (FIGS. 10 to 15). When the utterance learning control is completed, the output control unit continues role learning (utterance learning) according to the learner's selection or ends role learning (S424).

  FIG. 10 is a flowchart showing an example (utterance learning control 1) of the utterance learning control step S422 shown in FIG. Here, the learner can perform imitation talk learning corresponding to the start part of speech learning.

  First, the output control unit outputs the current thought unit text (for example, “I went”) to the learner (S42). The current thought unit text is output as voice or text. Then, the output control unit recognizes the learner's voice (S434) and determines whether the learner has correctly imitated the conversation. At this time, when the learner's voice is not correctly recognized, the output control unit inputs and corrects the input several times (for example, three times).

  Next, the output control unit outputs the output translated text of the current thinking unit and a linked question (for example, “I went (where)”) (S436). Then, the output control unit recognizes the learner's voice (S438) and determines whether the imitation talk has been performed correctly. Thus, the text of the current thinking unit, the translation text, and the linked question are output.

  As described above, when the translated text of the current thought unit and the connected question are output, the output control unit repeats from the step S432 after increasing the current thought unit (S440). When all the thought units are output in step S440 of increasing the current thought unit, the output control unit returns the utterance learning control.

  FIG. 11 is a flowchart showing another example (speech learning control 2) of the utterance learning control step S442 shown in FIG. Here, a learning method will be described as an example in which when the translated text of the thought unit included in the dialogue of the role person is output by voice, the learner speaks the thought unit corresponding to the output translated text. At this time, the connection question is not output to the learner.

  First, the output control unit outputs a translated text (for example, “I did”) of the current thinking unit to the learner by voice (S452). Then, a voice is input from the learner to be recognized (S454), and it is determined whether or not it matches (S456). At this time, the output control unit compares the speech recognition result of the learner with the current thought unit text (for example, “I went”). Therefore, the learner can perform utterance learning by making a foreign language response (thinking unit text) to the native language question (thinking unit translation text).

  Next, the output control unit increases the current thinking unit (S458), and advances the utterance learning for the thinking unit constituting the role person's dialogue.

  FIG. 12 is a flowchart showing still another example (speech learning control 3) of the utterance control step S422 shown in FIG. This is an example in which the utterance learning of FIG. 11 is advanced by a cumulative iteration formula.

  First, the output control unit outputs a translation text (for example, “I went”) of the current thought unit (S461). The output control unit recognizes the learner's voice (S462). At this time, the output control unit compares the recognized learner's voice with the current thought unit text (for example, “I went”).

  Next, the output control unit increases the current thinking unit (S463), and if there is no current thinking unit text, the speech learning control is returned. If there is a current thought unit text, the output control unit outputs the current thought unit translation text (for example, “to Kimpo Airport”) (S465). Then, the output control unit recognizes the learner's voice (S466). At this time, the output control unit compares the recognized learner's voice with the current thought unit text (for example, “to Kimpo airport”).

  Subsequently, the output control unit outputs the accumulation of thought unit translation texts output so far (for example, “I went to Kimpo Airport”) (S467). The output control unit recognizes the learner's voice (S468). At this time, the output control unit compares the recognized learner's voice with the accumulation of the current thought unit text (for example, “I went to Kimpo airport”). After performing the learner's speech recognition step S468, the output controller repeats the current thinking unit increase step S463.

  FIG. 13 is a flowchart showing still another example (speech learning control 4) of the utterance learning control step S422 shown in FIG. This shows an example of thinking unit utterance learning for a linked question.

  First, the output control unit outputs the current thought unit translation text (for example, “I did”) (S471). Then, the output control unit recognizes the learner's voice (S472). At this time, the output control unit compares the speech recognition result of the learner with the current thought unit text (for example, “I went”). Next, the output control unit outputs a connected question (for example, “where”) of the current thought unit (S473).

  When the linked question is output in this way, the output control unit increases the current thinking unit (S474), and determines whether the output of the thinking unit is finished (S475). At this time, when the output of the thinking unit of the utterance learning is finished, the output control unit returns the utterance learning control. If the output of the thought unit of utterance learning is not finished, the output control unit recognizes the learner's voice (S476). At this time, the output control unit compares the voice recognition result of the learner with the current thought unit text (for example, “to Kimpo airport”). Then, the output control unit repeatedly performs the current thought unit linked question output step S473.

  FIG. 14 is a flowchart showing still another example (utterance learning control 5) of the utterance learning control step S422 shown in FIG. This shows an example of a case where the output of the connected question of speech learning in FIG.

  First, the output control unit outputs a translation text (for example, “I did”) of the current thought unit (S481). Then, the output control unit recognizes the learner's voice (S482). At this time, the output control unit compares the voice recognition result of the learner with the current thought unit text (for example, “I went”). Next, the output control unit outputs a connected question (for example, “where”) of the current thought unit (S483).

  As described above, when the linked question is output, the output control unit increases the current thinking unit (S484), and determines whether the output of the thinking unit is finished (S485). At this time, when the output of the thinking unit of the utterance learning is finished, the output control unit returns the utterance learning control. If the output of the thought unit of speech learning has not been completed, the output control unit recognizes the learner's voice (S486). At this time, the output control unit compares the voice recognition result of the learner with the current thought unit text (for example, “to Kimpo airport”).

  Subsequently, the output control unit outputs the accumulation of the linked question texts (for example, “I went (where)”) (S487). Then, the output control unit recognizes the learner's voice (S488). At this time, the output control unit compares the voice recognition result of the learner with the current thought unit text (for example, “I went to Kimpo airport”). Next, the output control unit repeatedly performs the current thought unit connection question output step S483.

  FIG. 15 is a flowchart showing still another example (utterance learning control 6) of the utterance learning control step S422 shown in FIG. Here, an utterance learning method for inputting a learner's voice and determining whether the inputted voice corresponds to a role person's speech (sentence) will be described as an example. That is, the learner must input the sentence of the role person's speech.

  First, the output control unit receives a voice of the role person's speech from the learner (S491). Then, the input voice is recognized (S492) and compared with the role person's dialogue (S493). The comparison is made by comparing the speech recognition result of the learner and the text that combines all the thought units constituting the role of the role.

  In the comparison, if it is determined that it matches, the output control unit returns so that role learning can be continued, and if it is determined that it does not match, control is performed so that the learner inputs the voice again ( S494).

  FIG. 16 is a flowchart showing in detail an example in which the reading learning control stage shown in FIG.

  As shown in the figure, when utterance learning by the basic learning method is started, the transmission control unit 130 or 320 first outputs text data of the current thinking unit (S510).

  Next, the transmission control unit 130 or 320 transmits an instruction to output the current unit of thought data as text (S520), and then receives audio data from the subscriber (S530). The audio data from the subscriber includes audio information produced by the subscriber.

  Then, the transmission controller recognizes the output audio of the current thinking unit and the audio data received from the subscriber (S540), compares it with the current thinking unit text (S550), and determines whether the pronunciation is suitable. Is determined (S560). That is, in this case, the feature of the received audio data is extracted (Feature Extraction) and speech recognition (Speech Recognition) is performed. Therefore, if the voice recognition is not correctly performed, it is determined that the sound is erroneous.

  If it is determined that the audio data from the subscriber is due to mispronunciation, the transmission control unit outputs, for example, a voice message “please change” (S570), and then outputs the audio data of the current thinking unit. This step is performed again (S520).

  FIG. 17 is a flowchart showing in detail an example in which the reading learning control stage shown in FIG.

  As shown in the figure, when utterance learning by the cumulative iterative learning method is started, the transmission control unit 130 or 320 combines text data from the first thinking unit to the current thinking unit (S610).

  Next, the transmission control unit transmits the combined thought unit text data as described above (S620), and then instructs the combined thought unit data to be output as text (S630). Then, the transmission control unit receives audio data from the subscriber (S640). The audio data from the subscriber includes audio information produced by the subscriber.

  Subsequently, the transmission control unit recognizes the audio data received from the subscriber and compares it with text (S660), and determines whether the pronunciation is suitable (S670). That is, in this case, the feature of the received audio data is extracted (Feature Extraction) and speech recognition (Speech Recognition) is performed. Therefore, if the voice recognition is not correctly performed, it is determined that the sound is erroneous.

  If it is determined that the audio data from the subscriber is due to mispronunciation, the transmission control unit, for example, outputs a voice message “please change” (S680), and then the audio data of the combined thought unit Is again performed (S630).

  In the embodiment shown in FIG. 17, utterance learning is advanced in accordance with the output of the output of the thought unit, but the text of the thought unit is not displayed and the text of the thought unit is displayed. Reading learning can be advanced as if. In order to advance such reading learning, first, all the texts to be learned in step S610 are combined (S610), and then the thought unit text is transmitted (S620).

  Next, the transmission control unit receives the audio data from the subscriber without performing step S630 so that the sound output of the unit of thought is not performed (S640). As described above, when audio data is received from the subscriber, after voice recognition (S650), it is compared with the transmitted thought unit text to determine whether the reading is appropriate (S670).

  FIG. 18 is a flowchart showing in detail an example in which the writing learning control stage shown in FIG.

  As shown in the figure, when writing learning by the basic learning method is started, the transmission control unit transmits text data of the current thinking unit (S710). Then, an instruction is given to output the current thinking unit as a voice (S720).

  Next, after receiving the text data from the subscriber (S730), the transmission control unit compares the text data of the current thinking unit with the text data from the subscriber (S740). At this time, if the text comparison result matches, the transmission control unit determines that the subscriber has correctly written, and if not, determines that the writing has been incorrect (S570).

  If it is determined in the above determination that the writing has been mistakenly performed, the transmission control unit, for example, outputs a message “Please input again” (S670), and then outputs a sound of the current thought unit. Perform again (S720).

  If it is determined that the subscriber has correctly written, the transmission control unit instructs the subscriber to output the text data of the current thought unit so that the subscriber can confirm (S770).

  FIG. 19 is a flowchart showing in detail an example in which the writing learning control stage shown in FIG.

  As shown in the figure, when writing learning by the cumulative iterative learning formula is started, the transmission control unit combines text data from the first thinking unit to the current thinking unit (S810).

  Next, the transmission control unit transmits the combined thought unit audio data (S820), and instructs the combined thought unit to output a voice (S830). Then, text data is received from the subscriber (S840). In addition, the transmission control unit compares the combined text data of the current thought unit with the text data from the subscriber (S850), and determines whether the writing has been correctly performed (S860). That is, the transmission control unit determines that the subscriber has correctly performed writing when the text comparison results match, and determines that the writing has been performed incorrectly when they do not match.

  If it is determined in the above determination that the writing has been mistakenly performed, the transmission control unit, for example, outputs a message “Please input again” (S870), and then outputs the voice of the combined thought unit. The step is performed again (S830).

  If it is determined that the subscriber has correctly written, the transmission control unit outputs text data of thought units combined so that the subscriber can confirm (S880).

In the above embodiment, the present invention has been described by taking the case where English learning is advanced as an example. However, as long as the sentence can be divided into thought units, all can be applied regardless of the language. Also, in the above embodiment, after the subscriber is asked a connection question with the unit of thought, it is attacked to receive audio or text data from the subscriber to determine whether it fits. After providing the text, it may be configured to select and determine whether it fits. In other words, in this case, after providing the subscriber with a large number of thought units suitable for one linked question and a large number of inappropriate thought units as pictures or texts, the subscriber 's choice is included in the suitable thought unit. It is good to judge whether At this time, if it is a picture, it is preferable to make a judgment by associating the picture with the text.

  On the other hand, in the above description, the learning material is transmitted through the Internet in real time as an example, but the learning material is transmitted to the learner's terminal after all the learning material selected by the learner is transmitted. The terminal (subscriber device) may be used. Further, such a learning method stores the learning material in the learning material database provided from the information provider device in a recording medium such as a CD, a DVD, and a tape, and then provides it to the learner (subscriber). It can be executed on the learner's computer. In the embodiment of the present invention, the voice of the learner is recognized in order to enhance the learning effect of the learner. However, if the voice recognition engine is not provided, the sentence to be learned You may make it output a sound based on a thought unit and a connection question. Therefore, language education using thought units and linked questions according to an embodiment of the present invention can be performed online or offline.

  As described above, those skilled in the art to which the present invention pertains will understand that the present invention can be implemented in other specific forms without changing the technical idea or essential features thereof. Accordingly, it should be understood that the above-described embodiments are illustrative in all aspects and not limiting. The scope of the present invention is determined by the scope of the claims rather than the foregoing detailed description, and all changes and modifications derived from the meaning and scope of the claims and the equivalent concepts are construed as being included in the scope of the present invention. There must be.

110 learning material storage unit 111 learning material database 113 learning material extraction control unit 115 thought unit text buffer 116 moving picture data buffer 117 connected question text buffer 120 recognition unit 121 first comparison unit 122 voice recognition unit 130 transmission control unit 140 member management unit 141 Member Database 142 Member Recognition Unit 151 Reception Text Buffer 152 Reception Audio Buffer 153 Reception Control Unit 160 Network Interface 170 Internet

Claims (1)

Using a transmission control unit that provides a language learning program from a learning providing server to a subscriber's terminal via a network, and sends learning materials to the terminal to allow the subscriber to perform language education according to the procedure of the language learning program In language teaching methods,
When the set of words constituting one meaning for each sentence is a thinking unit, and the question for deriving the next thinking unit in each thinking unit is a connected question, the language learning program In accordance with the learning level of the subscriber, each sentence is divided into a plurality of thought units and linked questions corresponding to the thought units according to the word order, and the learning data in advance as the learning material together with the voice data corresponding to the text of the thought unit Stored in the database,
The transmission control unit
A first step of accepting a current learning material code and a learning program progression method corresponding to the current learning level of the subscriber input from the terminal of the subscriber connected via the network;
A second step of extracting the learning material associated with the current learning material code received in the first step from the learning material database;
The learning material extracted in the second step includes a third step of outputting to the subscriber's terminal according to the learning program progress method accepted in the first step,
The first step includes
A fourth step of identifying whether the accepted learning program progression method is a learning program progression method of a basic progression method or a learning program progression method of a cumulative iterative progression method;
A fifth method for specifying whether the listening learning method for listening, the utterance learning method for utterance, the writing learning method for writing, or the reading learning method for reading is used as the learning method to proceed according to the accepted learning program progression method. Including steps,
The third step is
In the fifth step, when an utterance learning method for uttering is specified as a learning method,
A sixth step of extracting speech data corresponding to the text of the thought unit from the learning material database and outputting it to the subscriber terminal;
A seventh step of receiving audio data from the subscriber's terminal and recognizing the voice;
An eighth step of determining whether the recognized pronunciation of the voice in the seventh step matches the pronunciation obtained from the voice data output to the subscriber's terminal in the sixth step;
In the eighth step, if it is determined that the pronunciation is suitable, a ninth step of outputting voice data and a linked question corresponding to the text of the thought unit output in the sixth step to the terminal of the subscriber When,
Receiving audio data from the subscriber 's terminal and recognizing speech;
The eleventh step of determining whether the recognized pronunciation of the voice in the tenth step matches the translated text of the unit of thought output to the terminal of the subscriber and the pronunciation obtained from a linked question; ,
In the eighth step, when it is determined that the pronunciation is not suitable, the thought unit characterized in that it returns to the sixth step and outputs voice data corresponding to the text of the thought unit to the terminal of the subscriber again. Language teaching method using linked questions.

Images