KR100914502B1 - Computer network-based interactive multimedia learning system and method thereof - Google Patents

Abstract

In cyber education using a communication network such as the Internet, the present invention provides an avatar corresponding to a learner and a teacher, and induces interest in learning by controlling the gesture of each avatar in real time based on the accuracy of the learner's pronunciation. An interactive multimedia learning system and a method of operating the same are provided. If the learner is provided with a standard pronunciation for each item of the multimedia learning content and a corresponding voice frequency graph, and the learner pronounces according to the provided standard pronunciation, the system of the present invention measures the similarity between the pronunciations, and the measured similarity is measured. If the predetermined condition is satisfied, the process proceeds to the next learning; Otherwise, have the learner repeat the pronunciation for each item. In addition, the present invention provides a target animation that is gradually achieved according to the learner's learning progress, the learner may have an interest in learning. The information learned by the learner is automatically stored in the database 31 of the present invention, and can be read only by parents and / or teachers certified through the network 20, and thus effectively used as learning guidance information for the learner. Can be.

Description

Network-based interactive multimedia learning system and method {COMPUTER NETWORK-BASED INTERACTIVE MULTIMEDIA LEARNING SYSTEM AND METHOD THEREOF}

The present invention relates to a system for implementing cyber education using a communication network such as the Internet, and more particularly, to a cyber learning application that can improve the learning efficiency by controlling the operation of a virtual image.

Usually, in order to learn a language such as English, a medium such as a textbook, a video tape, or a CD is used. Unlike conventional language learning that is performed at a certain time in a predetermined space such as a school or a school, a learner can study a language without being constrained by time and space by using such a medium. As an example of a learning method using a medium such as a tape, a CD, and the like, for example, US Patent No. 5,810,598 as shown in Figs.

In FIG. 1, when a learner or a user inserts a language learning video tape 4 into the deck 5, the learning contents contained in the video tape 4 are displayed in the monitor 4 of the monitor device 1 as shown in FIG. 2. Play on the). As shown in Fig. 2, on the monitor 4, images of men and women and conversational captions A and B corresponding to each are provided. The pronunciation for the subtitle A is reproduced through the left speaker 2a at the same time as the male image is activated, and the pronunciation for the subtitle B is reproduced through the right speaker 2b at the same time as the female image is activated. The channel switches 3 and 6 are used to selectively reproduce the pronunciation of the male image and the subtitle A or the pronunciation of the female image and the subtitle B under the control of the remote controller 7. The learner may hear the pronunciation of the subtitle A or the pronunciation of the subtitle B, and thus, may input his / her own voice through the microphone 8 and listen through the speaker 2a or the speaker 2b.

According to the conventional learning method, the learner may repeatedly practice pronunciation of the subtitle A or the subtitle B through channel switching to practice conversation.

However, such a conventional language learning apparatus requires a separate purchase of a language learning video tape and a deck for reproducing the language, and not only incurs a considerable cost, but also requires a rewinding and replaying of the tape in order to repeat the conversation. In addition, since the conventional language learning apparatus repeats a conversation sentence in a predetermined order regardless of the accuracy of the pronunciation of the learner, the learning efficiency is reduced.

In order to solve this problem, in recent years, cyber education or cyber distance education using a communication network such as the Internet has been widely operated. Such cyber education is performed in a multimedia environment that provides voice, image, video, etc. through a network, and there is no cost burden and limitation of time and space, and thus it is greatly different from the existing school education method and learning method using a medium.

As an example, Japanese Patent Application Laid-open No. 11-249540 uses a communication network such as the Internet to determine the learning progress or understanding of the educational content taken by each student, and to provide a training curriculum suitable for each student. System is disclosed. According to the conventional distance learning system, when the learner has taken any training content, the learner is provided with a test problem for grasping the understanding of the training content. Examination results are automatically sent to the distance learning system. Based on the predetermined criteria, if it is determined that the test result is passed, the system determines that the learner has mastered the corresponding education content, and provides new learner content to the learner. As such, the conventional system manages the progress and understanding of learning for each learner to provide content suitable for each learner, so that each learner can focus on new learning content without having to repeat the understood education content.

However, such a conventional system can eliminate the hassle of previous learning by providing only the content required by each participant in a timely manner, but it is not an interactive interactive learning system, and thus the learner can easily lose interest. have. In addition, in a language content such as English, the conventional system does not provide a function for determining the accuracy of the pronunciation of the learner, the efficiency of language learning is reduced.

Therefore, in order to maximize the learning efficiency of learners, it is necessary to implement a learning environment and a teaching method similar to the real life where possible, and provide an environment for viewing, listening to, and communicating with the real environment. In addition, when a learner such as a child takes the learning content through the cyber education using the Internet, the parent or learner's teacher uses the learning result information of the learning content taken by the learner to learner's learning attitude, ability, and progress. It is desirable to further improve the learning efficiency by judging learners by judging or the like.

Accordingly, an object of the present invention is to provide a virtual image corresponding to a learner and a teacher in cyber education using a communication network, and to control the operation of each virtual image in real time based on the accuracy of the learner's pronunciation. It is to provide an interactive multimedia learning system and method that can generate interest.

Another object of the present invention is to provide a virtual image corresponding to two learners for the same learning content in cyber education using a communication network, and control the operation of each virtual image in real time based on the accuracy of pronunciation of each learner. Accordingly, the present invention provides an interactive multimedia learning system and method capable of improving learning efficiency.

Still another object of the present invention is to provide a virtual image corresponding to a plurality of learners for the same learning content in cyber education using a communication network, and to perform the operation of each virtual image in real time based on the accuracy of pronunciation of each learner. By controlling, there is provided an interactive multimedia learning system and method for supporting each learner's learning level within a predetermined period of time.

Another object of the present invention, in cyber education using a communication network, by automatically accumulating the learning result information of the content learned by the learner and providing the accumulated information to the authorized administrator, useful for teaching and improving the learner's learning The present invention provides a system and method for supporting information.

In order to achieve the above object, according to a preferred embodiment of the present invention, there is provided an interactive multimedia learning system using a communication network, each of which includes a plurality of multimedia learning content information including virtual object image information and comprising a plurality of items; A data source for storing a subject image set each representing a virtual subject image and a plurality of standard pronunciation information associated with the plurality of multimedia learning content information, the plurality of multimedia learning content information and the subject image set stored in the data source Providing means for providing a computer to the learner's computer, selecting means for the learner to select desired learning content and subject image from the provided multimedia learning content information and subject image set, learning content selected by the learner; Standard pronunciation output means for extracting and outputting an associated standard pronunciation from the data source, input means for inputting the learner's pronunciation for the selected learning content, and for measuring the similarity between the standard pronunciation and the learner's pronunciation There is provided an interactive multimedia learning system comprising similarity measuring means and control means for controlling at least one of the selected object image or the selected subject image based on the measured similarity.

According to another preferred embodiment of the present invention, a method for operating a system for displaying the learning situation of the learning content based on the accuracy of the learner's pronunciation of the multimedia learning content provided through the communication network, comprising a plurality of items And providing the multimedia learning content having the virtual teacher avatar and history on the learner computer, and providing the learner avatar information on the learner computer, requiring the learner to select an avatar desired by the learner, and each item in the learning content. Output a standard pronunciation for the subject, require the learner to pronounce according to the standard pronunciation for each item, measure the similarity between the standard pronunciation and the learner's pronunciation for each item, and based on the measured similarity, the teacher avatar and / or learner Control your avatar to see the history of your learning content in real time And storing the learning content information about the learner and the measured similarity in a database.

The information stored in the database can be viewed only by the administrator who is authenticated through the network 20, that is, the learner's parent and / or the teacher in charge, and can be used as the learning guidance information.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

3 is a schematic diagram of an interactive multimedia learning system according to the present invention.

The interactive multimedia learning system 100 according to the present invention utilizes virtual images such as avatars and animations to learners through a communication network 20 such as the Internet, and provides a variety of learning contents and provides learning contents in a dialogue or game manner. You can improve the learning efficiency of learners by operating. Hereinafter, as a representative learning content of the present invention, language related content such as English will be described.

As shown in FIG. 3, the architecture of the interactive multimedia learning system 100 of the present invention may include one or more learner computers 10 connected to the network 20 and utilizing the system of the present invention, various multimedia learning contents, and the present invention. Web site 30 having database 31 and learning operator server 32 storing various operational information and learning result information necessary for operating the system of the invention, and database 31 of web site 30. It consists of an authorized administrator computer 40 for managing the learner by querying and analyzing the stored learning result information. Authorized administrators are those who are authorized to use the system 100 of the present invention and are learners' guardians (ie, parents) and / or teachers.

The learner computer 10 has multimedia data 11 provided through a medium such as a CD-ROM (not shown) or downloaded from the learning operator server 32 through the network 20. The multimedia data 11 is, for example, various avatar and animation data used as a learner's virtual image, video related data, and data supporting a voice recognition function.

4 is a diagram illustrating a database (DB) 31 storing various operational information required for operating the interactive multimedia learning system 100 according to the present invention. As shown, the database 31 includes the member information DB 31a, the learning content DB 31b, the avatar management information DB 31c, the achievement target animation DB 31d, the standard pronunciation information DB 31e, and voice recognition. It consists of the management information DB 31f, the graphic information DB 31g, the personal learning information DB 31h, the one-to-one learning information DB 31i, and the multilateral learning information DB 31j. It demonstrates, referring FIG.

Referring to FIG. 5, there is shown a flow chart illustrating the process of signing up as a member to a web site 30 operating the system 100 of the present invention.

Prior to the registration, the system 100 of the present invention distributes the demo version of the learning content so that the client can sufficiently query the learning content information (S51). As will be appreciated, the demo version can be downloaded by accessing the web site 30 of the present invention or provided through a medium such as a CD-ROM.

After selecting the content suitable for the learner from the distributed learning content, the parent (or the learner) selects the desired teacher by searching the personal information of the teachers registered as members in the web site 30 (S52). The learner and his / her basic information are input to apply for membership to the selected teacher (S53).

The selected teacher inquires the subscription application information through the teacher computer 40, and requests learning approval to the web site 30 through the network 20 in consideration of its work situation (S54). Accordingly, the website 30 notifies the selected teacher and / or learner of the learning approval (S55). In this case, a unique registration code is assigned to the learner and the parent, and the basic information about the parent and the learner is stored in the member information DB 31a of the database 31 of FIG. 4 as member information. Thereafter, when a predetermined fee is received from the subscription applicant (S56), the learning operator server 32 opens the applicant so that the applicant can use the selected learning content (S57).

Through such a process, the learner can acquire various learning content information and level information about the teacher in advance before joining the member and select desired contents and teachers, thereby enabling learning to be reliable.

6 to 8 are flowcharts illustrating an individual learning process according to a first embodiment of the present invention, and FIGS. 8 and 9 are views illustrating examples of a learning screen provided in an individual learning process.

When the learner accesses the web site 30 through the network 20 and performs login (S61), the control process determines whether the input login information is valid (S62). If the login information is valid, the control process extracts the information of the learning content requested by the learner from the learning content DB 31b of the database 31 and provides it on the display 12 of the learner computer 10. In the provided learning content information, a menu of, for example, an alphabet piece, a word piece, a sentence piece, a conversation piece, and the like is provided, and each piece includes a submenu corresponding thereto. For example, the word edition includes a menu related to health, traffic lights, travel, etc. as a submenu.

The learner selects a desired learning menu from the provided learning content menu (S64). In detail, when the learner selects, for example, a traffic light of a word piece from the learning content menu, the control process extracts the avatar and the achievement target animation information from the avatar information DB 31c and the achievement target animation DB 31d, respectively, to the learner. In operation S66, the learner selects his or her desired avatar and the achievement target animation.

Here, the achievement target animation is an animation that is achieved in stages according to the learner learning the learning content, and may include animations such as a car assembly process, a space trip, a princess rescue process, and the like. When the learner masters all the learning contents, the target animated image is completed (described later). If the predetermined stage of the selected learning content is five stages, it is noted that the achievement target animation information provided in step S66 provides animation information with five stages. In addition, according to the present invention, the learner can edit the color, decoration, etc. of the avatar selected by the learner according to the taste.

Then, when the learner applies to the website 30 for personal learning based on the above-described selection information, the control process performs a session connection online in a known manner (S67), for example, as shown in FIG. In the same manner, a learning screen for the learning content selected by the learner is provided on the display 12 of the learner computer 10 (step S68). FIG. 8 is an example of a case where a learner selects a traffic light of a word piece from a learning content menu, selects a penguin 51 as an avatar, and a car assembly process as an achievement target animation, as shown in FIG. 8.

In step S69, when the learner selects an item to learn from the provided learning screen, the control process performs the personal learning process of FIG. 7. Specifically, when the learner clicks on "G" in the traffic light section 52 of FIG. 8, as shown in FIG. 9 (a), the control process activates the teacher avatar 50, thus for the word "green". The standard pronunciation and the corresponding graph are extracted from the standard pronunciation information DB 31e, the standard pronunciation is output through a speaker (not shown), and the standard pronunciation graph is displayed in bold solid lines on the section 54 (S71). ). In this case, the teacher avatar 50 produces a simple gesture. Standard pronunciations and corresponding graph information stored in the standard pronunciation information DB 31e may be obtained by applying a sampling method to a plurality of native pronunciations.

The control process then switches the mode of section 55 to the learner mode (S72), allowing the learner to pronounce according to the standard pronunciation. If the learner clicks on the "start" button 56a of section 56 and pronounces the word "green" (S73), the control process is simple by activating the learner avatar 51 as shown in Figure 9 (b). Print the message "green" with the gesture. At the same time, the control process recognizes the learner's pronunciation using a conventional speech recognition algorithm (S74), and outputs the learner pronunciation graph in a thin solid line on the section 54 of FIG. 8 (S75).

Then, the control process measures the similarity between the standard pronunciation and the learner's pronunciation (S76) to determine whether the measured similarity satisfies the preset threshold condition (S77). The threshold condition is normally set automatically by the learning operator server 32 at 60% or more, but the parent or teacher can arbitrarily change in consideration of the learning situation of the learner. In addition, in order to determine the evaluation of the learner pronunciation for each level, the threshold condition may be divided into several steps.

If the measured similarity satisfies the preset threshold condition, the control process outputs the message "That's right. Select a next word." With a simple gesture of the teacher avatar 50 as shown in FIG. (S79). Thus, the learner learns the next word "red" in the manner described above.

On the other hand, if the measured similarity does not meet the preset threshold condition, the control process repeats the word "green" to the learner through the teacher avatar 50 as shown in FIGS. 9 (d) to 9 (f). To be pronounced (S78), and the process returns to step S71 to repeat the above-described process. In this case, the system of the present invention does not output the standard pronunciation for "green" every time, but may require the learner to repeat the pronunciation of "green".

In this way, the number of repeated pronunciations is accumulated, and the accumulated number is displayed on the section 58 and automatically stored in the personal learning information DB 31e of the database 31. In Fig. 8, the number of standard pronunciation repetitions of the teacher avatar 50 is three times, and the cumulative number of pronunciation repetitions of the learner avatar 51 so far is four times.

Section 53 of Fig. 8 is a screen showing the learning results of the words that the learner has learned so far, the pronunciation evaluation for the word "traffic" is A level, the similarity mean is 90%, mastering the pronunciation of the word "traffic" It can be seen that it took 10 seconds to repeat 4 times.

In step S80, the control process determines whether the learner has passed the current learning step. If the current learning step is not passed, the control process performs the above-described steps S71 to S79 to continue to pronounce the next learning word. On the other hand, when passing the current learning phase, as shown in section 57 of FIG. 8, the control process performs one more step of the image of the achievement target animation selected by the learner, that is, the automobile assembly process. The total stage of the achievement target animation of section 57 is five stages consisting of five sub-parts as shown in section 57b, and the present stage of achievement corresponds to three stages as shown in section 57c. . Once the learner has fully mastered the learning content, a complete race car image as shown in section 57a will be displayed on section 57c.

According to the present invention, the step of the achievement target animation is set in advance for each learning content, and the achievement goal animation information corresponding to the achievement step of each learning content is provided to the learner.

Thereafter, when the learner presses the "end" button 56c of the section 56, the learning result information and the achievement step information of the target animation as shown in the section 53 are transmitted to the web site 30 through the network 20. ) Is stored in the personal learning information DB 31h of the database 31 (S82).

10 is a flowchart illustrating a process of a teacher in charge of accessing a web site 30 to analyze learner's learning result information and to perform a learning instruction.

In step S100, the teacher in charge performs a log-in by a normal method through the teacher computer 40 or a separate computer. Accordingly, the control process determines whether the login information input by the teacher in charge is valid (S101). If valid, the control process provides learner's learning result information and / or parental counseling information via the network 20 on the display 41 of the teacher computer 40 (S102).

In step S103, the teacher in charge analyzes the provided learning result information and / or counseling information to perform a learning instruction suitable for the learner. For example, the teacher in charge may modify the threshold condition on the similarity arbitrarily in order to enhance the learner's learning interests, or consult with the parents to provide instruction for the learner. In particular, if the learner cannot pronounce correctly due to a learner's physical deficiency or other reasons, the teacher (or parent) may adjust the level of similarity measurement accordingly to instruct the learner not to lose interest in learning. Can be.

In addition, the teacher in charge provides the learning guidance information for the learner to the parents using a separate communication means such as the network 20 or a telephone, so that the parents refer to the learning guidance (step S104).

FIG. 11 is a flowchart illustrating a process of a parent accessing a web site 30 to analyze learner learning result information and input counseling information.

In step S111, the parent performs a log-in in the usual way through the learner computer 10 or a separate computer. The information input at the time of login is the information given from the learning operator server 32 at the time of initial membership. In step S112, the control process determines whether the login information input by the parent is valid. If valid, the control process provides the parent with the learner's learning result information and / or the learning guidance information analyzed by the responsible teacher (step S113).

The parent analyzes the learning result information and / or the learning guidance information, and transmits the counseling information necessary for the learning guidance of the learner to the teacher in charge by using a separate communication means such as the network 20 or the telephone (step S114).

Through the exchange of learning information between the parent and the teacher in charge, the learner can learn under optimal learning conditions, thereby improving the learner's learning efficiency.

12 to 16 are schematic diagrams illustrating another example for explaining personal learning according to the first embodiment of the present invention, and an example of performing alphabet learning using a baby dinosaur hatching process.

As shown in FIG. 12, the section 49 is provided with an elliptical egg 60 with an alphabetic character engraved on its surface and a learner avatar 51 of a penguin image.

First, the voice "Hi, I need you help" is output from the egg 60 with the message, and the translation for the message, that is, the phrase "Hi, I need your help", appears on the helper section 61. Is displayed.

13, the system of the present invention outputs the standard pronunciation of "A", emphasizing the portion of the alphabet "A" on the surface of the egg 60 and displays "A" on section 61. Pronounce it. "At the same time, the standard pronunciation graph for" A "is displayed in bold solid lines on section 54 as described above. According to the standard pronunciation of" A ", the learner" If it is pronounced "A", the system of the present invention displays the learner pronunciation graph in thin solid lines on the section 54 using a conventional speech recognition algorithm, and measures the similarity between the standard pronunciation and the learner's pronunciation. For example, 82% is indicated on section 62.

As described above, if the measured similarity does not meet a predetermined threshold condition, the control process requests the learner to pronounce "A" repeatedly. The number of repeated pronunciations of "A" and the average value of each similarity measured by the number of repeats are displayed on section 62. In Fig. 13, the number of repeated pronunciations for "A" is two times, the similarity mean value for each number is 80, and the similarity for the current "A" pronunciation is 82. As described above, the threshold condition may be arbitrarily changed by the parent or the teacher in accordance with the learner's learning level.

According to the present invention, when the learner's pronunciation "A" satisfies a predetermined threshold condition, the control process converts the alphabet "A" portion of the egg 60 to lowercase "a" as shown in FIG. And the oval egg 60 from which the letter "A" is missing is left as shown in Fig. 14 (d). Then, the system 100 of the present invention activates the alphabet "B" portion and simultaneously outputs the standard pronunciation and the corresponding standard pronunciation graph for the alphabet "B" as described above. Since the following process is the same as the above process, a detailed description thereof will be omitted.

Finally, when mastering the pronunciation up to the alphabet "Z", as shown in FIGS. 15 and 16, the baby dinosaur 70 hatches from the egg 60 and gives the learner avatar 51 "hello" and "Excellent". Nice to meet you ", and the average value of the similarity measured so far is displayed on section 62. As described above, the alphabet learning result information learned by the learner is accumulated in the personal learning information DB 31h of the database 31 at the same time as the learner finishes learning.

According to the exemplary embodiment of the present invention, the alphabet pronunciation practice may be performed separately by providing only an alphabet that is difficult to pronounce among 26 alphabetical letters. In addition, according to the present invention, by dividing the 26-character alphabet into several groups and setting the achievement target animation image, by displaying the completion process of the achievement target animation as described above in real time each time mastering pronunciation for each group It can be interesting to learners.

17 and 19 are flowcharts illustrating one-to-one learning according to the second embodiment of the present invention, and FIGS. 20 and 21 are screens provided when one-to-one learning is performed according to the second embodiment of the present invention. A schematic diagram showing an example.

In one-to-one learning according to the present invention, learner A who has learned a specific learning content through the above personal learning learns in a conversational manner by connecting with another learner B on the web for the purpose of practice or repetition. By learning realistically using the avatars and animations, the learners can be intrigued by each learner to improve the learning efficiency.

In steps S170 and S171 of FIG. 17, learner A connects to the learning operator server 32 of the present invention through the network 20 and logs in in a conventional manner. If the input login information is valid, the control process provides the learner A with an initial screen (step S172). On the initial screen, a menu for personal learning menu, one-to-one learning and multi-party learning is provided.

On the initial screen, when learner A selects the one-to-one learning menu (step S173), the control process provides the registrant status information as shown in FIG. 20, for example.

In step S175, learner A determines from the registrant status information provided from learning operator server 32 whether a learner suitable for his learning level exists. Here, it is assumed that the subject, the learning stage, and the learning contents learned by the learner A are the subject 1, the stage 1, and the conversation piece, respectively. Accordingly, when learner A selects learner B that is the same as his or her level of learning from the registrant status information, the control process provides learner A with avatar and achievement target animation information to select the desired avatar and animation (step S177). . In this case, the achievement target animation information is an animation list belonging to the number of steps corresponding to the achievement target animation of the selected learner B.

When learner A selects learner B, an avatar, and animation for one-to-one learning and requests an online session connection with learner B, the control process simultaneously provides one-to-one learning screen to learner A and learner B as shown in FIG. Step S179), the one-to-one learning implementation of FIG. 18 is controlled in real time.

On the other hand, if there is no learner suitable for the learning level of learner A among the provided registrant status information, learner A inputs its own learning information, avatar, and achievement target animation, respectively, and then waits for one-to-one learning (step S178). When the learner B selects the learner A in the same process as the learner A described above, it is a matter of course that the learner B is connected to the online session to perform one-to-one learning.

In FIG. 18, the control process controls the mode of section 83 of FIG. 21, for example, learner A mode, such that learner A pronounces the sentence “How are you” corresponding to learner A in section 82. (Step S180). When learner A clicks on the "How are you" sentence in section 82, the control process outputs the standard pronunciation for "How are you" and its corresponding standard pronunciation graph in bold solid lines on section 54 ( Step S181).

According to the standard pronunciation, when learner A clicks the "Start" button in section 84 and inputs the pronunciation of "How are you" through a microphone (not shown) (step S182), the control process is performed by learner A. The avatar 80 is activated and a message "How are you" is output on the section 49 at the same time.

Learner A's learning pronunciation is analyzed via a conventional speech recognition algorithm as described above, and the graph for the analyzed learning pronunciation is displayed in thin solid line on section 54 (step S183). At the same time, the control process measures the similarity between the standard pronunciation and the learning pronunciation as described above (step S184), and displays the measured similarity (for example 60) on the section 54.

In step S185, it is determined whether the measured similarity satisfies the preset threshold condition, and if it is determined that the condition is satisfied, the control process determines the current achievement step of learner A in step S186 to achieve the achievement target animation image for learner A. And control proceeds to step S187. Referring to FIG. 21, it can be seen that the achievement target animation image of learner A is a vehicle assembly process, and the current achievement stage is three stages.

On the other hand, if the measured similarity does not meet the preset threshold condition, the control process requests learner A to repeat the pronunciation of "How are you" for a predetermined time (for example, 10 seconds) (step S188). . Similarly, repeated pronunciation is processed through steps S182 to S185. In addition, before repeating the pronunciation every time, as described above, the standard pronunciation of "How are you" may be output each time.

In step S189, the control process determines whether the predetermined time has elapsed. If the predetermined time has elapsed, the control process determines whether the learn " end " button in section 84 has been clicked by learner A or learner B (step S190). When the "end" button is clicked, the control process stores the one-to-one learning result information generated by learner A and learner B so far in the one-to-one learning information DB 31i of the database 31 (step S191). On the other hand, if the "end" button is not clicked, the control process proceeds to step S187.

In step S187, the control process switches the mode of section 84 to learner B mode, thereby controlling learner B to pronounce a response to learner A, that is, a sentence "I am fine, and you?". Similarly, upon switching to learner B mode, learner B's avatar 51 is active and the achievement target animation image for learner B is output on section 81.

Specifically, in the mode of learner B, when learner B clicks on the sentence "I am fine, and you?" On section 82 in the same manner as learner A described above, the control process returns to "How are you". The standard pronunciation and the corresponding standard pronunciation graph are output in bold solid lines on the section 54 (step S181). According to the standard pronunciation, when learner B clicks the "Start" button in section 84 and inputs the pronunciation for "I am fine, and you?" Through a microphone (not shown) (step S182), the control process Activates the avatar 51 of learner B and simultaneously outputs a message " I am fine, and you? &Quot;

Learner B's learning pronunciation is analyzed using a conventional speech recognition algorithm as described above, and the graph of the analyzed learning pronunciation is displayed in thin solid line on section 54, and at the same time, the similarity between the standard pronunciation and the learning pronunciation is measured. And the similarity measured is displayed on the section 54. Since the following process is the same as the above process, description thereof will be omitted.

As shown in FIG. 21, it took 13 seconds for learner A to pronounce the sentence "How are you" according to the condition, and the average value of the similarity or the similarity for each repeated pronunciation was 95%. The section 85 is one-to-one learning result data stored in the one-to-one learning information DB 31i of the database 31 and includes information such as the completion stage of the achievement target animation for each learner, the total time required, and the average time required for each step.

According to the present invention, when the similarity measured in step S185 does not satisfy the preset threshold condition, the learning operator server 32 may request learner A or learner B to repeat the pronunciation of the sentences corresponding to N times. .

That is, as shown in FIG. 19, the control process requests the learner A to repeat pronunciation for "How are you" N times, for example, through the process of steps S182 to S184 of FIG. 18 described above ( Step S192), it is determined whether learning pronunciation satisfying the threshold condition is output among the repeated learning pronunciations (step S193).

If the learning pronunciation that satisfies the threshold condition is output, the control process proceeds to step S186 of FIG. 18 to switch the learner mode, otherwise, it is determined whether N learning pronunciations have been input (step S194). If N learning pronunciations have been input, the control process determines whether the "end" button in section 84 has been clicked on to end one-to-one learning as described above (step S195). Since the subsequent process is the same as the process of FIG. 18, description thereof will be omitted. In the above, before learner A repeats the pronunciation for "How are you", the control process may provide learner A with a standard pronunciation for "How are you" and a corresponding standard pronunciation graph.

Therefore, according to the one-to-one learning according to the second embodiment of the present invention, each learner can apply the learning content acquired through the personal learning of the present invention with other learners in a conversational manner, so that the learning content can be repeated and learned. It can provide the practical usefulness of the learning contents, and can further induce learning motivation through comparative evaluation with other learners.

FIG. 22 is a flowchart illustrating a multilateral learning according to a third embodiment of the present invention, and FIG. 23 is a schematic diagram illustrating an example of a screen provided when a multilateral learning is performed.

The multilateral learning according to the third embodiment of the present invention is for learners who have completed a specific personal learning range to evaluate their learning level online, and by assigning a predetermined score based on the accuracy of pronunciation of each learner, During this time, the ranking is based on each learner's score.

Referring to FIG. 22, in step S220 and step S221, for example, learner A accesses the learning operator server 32 of the present invention through the network 20 and logs in in a conventional manner. If the input login information is valid, the control process provides an initial screen to learner A (step S222).

On the initial screen, if learner A selects a multi-learning menu providing a multi-learning function (step S223), the control process provides learner A with multi-learning type information to select a desired type (step S224). Examples of the multilateral learning type include content evaluation games such as word pieces, conversation pieces, and words / conversations, progress evaluation games in which members who join at the same time, and general summary evaluation games are played regardless of the learning range.

If the desired multilateral learning type is selected, the control process provides learner A with avatar type information, and learner A selects a desired avatar (for example, a penguin) from the avatar types (step S225).

Thereafter, when learner A requests multi-learning learning to learning operator server 32 (step S226), learning operator server 32 responds to the conditions of each type of learning, for example, the number of participants, time, date, and the like. On the basis of this, it is determined whether each applicant can participate in the multilateral learning game, and the learner A is notified of the approval result (step S228). If it is not approved, the control process returns to step S224 to ask learner A to reselect the type of multilateral learning to participate. If approved, the control process provides the learner A who has applied for the multiparty learning through the online session connection, as shown in FIG. 23. Similarly, learner B, learner C, learner D (hereinafter omitted) can participate in the multi-player learning game of the present invention by the same procedure as learner A described above.

For example, when the multi-learning type is a conversation evaluation evaluation based on a 100-meter race, as illustrated in FIG. 23, distance information and each avatar corresponding to each learner are displayed on the multi-learning screen 12. Each avatar is located at a different distance depending on the score. That is, it can be seen that the rank of the current acquisition score is learner A, learner C, learner B, and learner D. This information is stored in the multilateral learning information DB 31j of the database 31.

Therefore, according to the multilateral learning according to the third embodiment of the present invention, since each learner can compete with other learners online, each learner can compare and evaluate the learning level acquired through the personal learning. Can provide a sense of accomplishment and motivation, and can further induce interest in learning.

While various embodiments of the present invention have been described above, those skilled in the art can make various changes without departing from the scope of the claims of the present invention.

Therefore, according to the present invention, the following effects are obtained.

1. The learner can acquire various learning contents information and level information about the teacher from the communication network and select the desired learning contents and the teacher in charge, so that learning can be implemented with reliability.

2. By providing the avatar and the achievement target animation image corresponding to the learner and the teacher, and controlling the development process of the achievement target animation in real time according to the pronunciation accuracy of the learner, it is possible to induce interest in learning.

3. Parents and teachers can share the learner's learning results information on the network and exchange learning information so that parents and teachers can guide learners to learn under optimal learning conditions, further enhancing learners' learning efficiency. Can be improved.

4. Two learners with similar levels of learning can learn the specific learning contents in a realistic and interactive way through an online session connection, which can increase the efficiency of learning by inducing interest to each learner.

5. A number of learners with similar levels of learning learn specific learning content within a set period of time through an online session connection, and rank each student with their own level of learning by using animations. Comparative assessment can provide a sense of achievement and motivation for learning.

1 is a schematic diagram showing a conventional learning system using video tape for language learning.

FIG. 2 is a diagram illustrating a learning screen provided in the learning system of FIG. 1. FIG.

3 is a schematic diagram of an interactive multimedia learning system according to a preferred embodiment of the present invention.

4 is a diagram showing a database storing various operational information required for operating the interactive multimedia learning system according to the present invention.

Figure 5 is a flow chart illustrating the process of joining as a member to the website 30 operating the interactive multimedia learning system 100 of the present invention.

6 and 7 are flowcharts illustrating an individual learning process according to a first embodiment of the present invention.

8 and 9 illustrate examples of a learning screen provided in a personal learning process according to the first embodiment of the present invention.

10 is a flowchart illustrating a process of a teacher in charge of accessing a web site, analyzing a learner's learning result information, and performing a learning instruction.

11 is a flow chart illustrating a process of a parent accessing a web site to analyze learner learning result information and input counseling information.

12 to 16 are schematic diagrams showing another example for explaining the personal learning according to the first embodiment of the present invention.

17 and 19 are flowcharts for explaining one-to-one learning according to a second embodiment of the present invention.

20 and 21 are schematic diagrams showing examples of screens provided when one-to-one learning is executed according to the second embodiment of the present invention.

22 is a flowchart for explaining multilateral learning according to the third embodiment of the present invention.

Fig. 23 is a schematic diagram showing an example of a screen provided when a multilateral learning is executed;

<Explanation of symbols for main parts of the drawings>

10: Learner Computer

20: Network

30: Website

31: database

32: Learning Operator Server

40: Parent or teacher computer

50: virtual teacher avatar

51: virtual learner avatar

54: Standard pronunciation and graph display section

57: Achieve Goal Animation Display Section

Claims (59)

In the interactive multimedia learning system using a communication network, A plurality of multimedia learning content information each comprising virtual object image information and consisting of a plurality of items, a subject image set each representing a virtual subject image, and a plurality of standard pronunciation information associated with the plurality of multimedia learning content information The data source that you store, Providing means for providing the learner's computer with the plurality of multimedia learning content information and the subject image set stored in the data source; Selecting means for the learner to select desired learning content and subject image from the provided multimedia learning content information and subject image set; Standard pronunciation output means for extracting and outputting a standard pronunciation associated with the learning content selected by the learner from the data source; Input means for inputting the learner's pronunciation of the selected learning content; Similarity measuring means for measuring similarity between the standard pronunciation and the learner's pronunciation, Control means for controlling at least one of the selected object image and the selected subject image based on the measured similarity Interactive multimedia learning system comprising a. The method of claim 1, And the multimedia learning content is a language related learning content including at least one of a vowel, a consonant, an alphabet, a word, a sentence, and a conversation. The method of claim 1, And the object image represents a virtual teacher. The method of claim 1, The standard pronunciation output means displays a frequency graph corresponding to the standard pronunciation on the learner computer, The similarity measuring means displays a frequency graph corresponding to the learner pronunciation on the learner computer, The frequency graph of the standard pronunciation and the frequency graph of the learner pronunciation are superimposed and displayed on the learner computer. The method of claim 4, wherein And said standard pronunciation output means comprises means for displaying a sentence corresponding to said standard pronunciation on said learner computer. The method of claim 1, The similarity measuring means Means for displaying the measured similarity on the learner computer; Means for determining whether the measured similarity satisfies a preset threshold condition; Means for transitioning to the next item in the learning content if the measured similarity satisfies the threshold condition; otherwise, requesting the learner to repeat until the threshold condition is satisfied according to the standard pronunciation. Interactive multimedia learning system. The method of claim 6, The similarity measuring means And means for displaying on the learner computer an average value of the number of repetitions for each item, the time required, and each similarity measured during the number of repetitions. The method of claim 7, wherein The similarity measuring means And means for transmitting the number of iterations, the time required, and the similarity average value for each item of the learning content learned by the learner to the data source for storage in the data source. . The method of claim 8, The information stored in the data source can be viewed only by an administrator authorized through the network, wherein the authenticated administrator is one of the learner's parent and teacher. The method of claim 6, And said threshold condition is varied by an authorized administrator. The method of claim 8, The similarity measuring means Means for developing a target image composed of a plurality of stages in which each stage represents a learning progress of the learning content according to the measured similarity degree, And the target image is completed when the learning content is completely mastered. The method of claim 11, And the step of developing the target image is different for each multimedia learning content. In the interactive multimedia learning system using a communication network, A plurality of multimedia learning content information each having virtual object image information and history and consisting of a plurality of items, a subject image set each representing a virtual subject image, and a plurality of standard pronunciation information associated with the plurality of multimedia learning content information A data source for storing Means for providing the multimedia learning content information and the subject image set on a learner computer; Means for selecting the desired learning content and the subject image from the provided multimedia learning content information and the subject image set, respectively; Standard pronunciation output means for outputting a standard pronunciation for each item in the selected learning content; Means for inputting the learner's pronunciation with respect to the standard pronunciation for each item; Similarity measuring means for measuring similarity between the standard pronunciation and the learner's pronunciation for each item; Means for controlling one of the selected object image and the selected subject image based on the measured similarity to develop a history of the learning content Interactive multimedia learning system comprising a. The method of claim 13, The learning content is a language-related learning content including at least one of vowels, consonants, alphabets, words, sentences and conversations. The method of claim 13, The standard pronunciation output means displays a frequency graph corresponding to the standard pronunciation on the learner computer, The similarity measuring means displays a frequency graph corresponding to the learner pronunciation on the learner computer, The frequency graph of the standard pronunciation and the frequency graph of the learner pronunciation are superimposed and displayed on the learner computer. The method of claim 15, And said standard pronunciation output means comprises means for displaying a sentence corresponding to said standard pronunciation on said learner computer. The method of claim 13, The similarity measuring means Means for displaying the measured similarity on the learner computer; Means for determining whether the measured similarity satisfies a preset threshold condition; Means for transitioning to the next item in the learning content if the measured similarity satisfies the threshold condition; otherwise, requesting the learner to repeat until the threshold condition is satisfied according to the standard pronunciation. Interactive multimedia learning system. The method of claim 17, The similarity measuring means And means for displaying on the learner computer an average number of repetitions for each item and an average value for each similarity measured during the repetitions. The method of claim 18, The similarity measuring means And means for transmitting the repetition number and the similarity average value for each item of the learning content learned by the learner to the data source for storage in the data source. The method of claim 19, The information stored in the data source can be viewed only by an administrator authorized through the network, wherein the authenticated administrator is one of the learner's parent and teacher. The method of claim 17, And said threshold condition is varied by an authorized administrator. An interactive multimedia learning system for displaying the learning situation of each learner based on the accuracy of each learner's pronunciation of the same multimedia learning content using a communication network, A plurality of multimedia learning content information having a plurality of items consisting of a first item set and a second item set and including a predetermined learning step indicating a progress of learning, a subject image set each representing a virtual subject image; and A data source for storing a plurality of standard pronunciation information associated with the plurality of multimedia learning content information; Means for assigning a virtual subject image and a target image having a development step corresponding to the predetermined learning step, respectively, to the first and second learners who have mastered the same multimedia learning content, and for connecting a session through the network; Means for providing a standard pronunciation for the first item of the learning content to the first learner, and alternately providing a standard pronunciation for the second item to the second learner; Means for inputting pronunciations of the first and second learners relative to the standard pronunciation; Similarity measuring means for measuring similarity between the standard pronunciation and the pronunciation of each learner; Control means for controlling the development step of the virtual subject image and the target image respectively assigned to each learner based on the measured similarities, to display the current learning progress for the learning content in real time; Interactive multimedia learning system comprising a. The method of claim 22, The learning content is a language-related learning content including at least one of vowels, consonants, alphabets, words, sentences and conversations. The method of claim 22, The standard pronunciation output means displays a frequency graph corresponding to the standard pronunciation on the learner computer, The similarity measuring means displays a frequency graph corresponding to the learner pronunciation on the learner computer, The frequency graph of the standard pronunciation and the frequency graph of the learner pronunciation are superimposed and displayed on the learner computer. The method of claim 24, And said standard pronunciation output means comprises means for displaying a sentence corresponding to said standard pronunciation on said learner computer. The method of claim 22, The similarity measuring means Means for determining whether the measured similarity with respect to the first and second learners satisfies a predetermined threshold condition; If the similarity with respect to the first learner satisfies the predetermined threshold condition, deploying the subject image and the target image assigned to the first learner; otherwise, in the mode of the second learner. Means for switching, If the similarity with respect to the second learner satisfies the threshold condition, deploying the subject image and the target image assigned to the second learner; otherwise, switching to the mode of the first learner. Interactive multimedia learning system comprising means. The method of claim 26, The similarity measuring means, prior to switching to the first and second learner mode, And means for requesting the first learner and the second learner to repeat until the threshold condition is satisfied according to the corresponding standard pronunciation, respectively. The method of claim 27, The similarity measuring means And means for displaying on the learner computer an average value of the number of repetitions for each item, the time required, and each similarity measured during the number of repetitions. The method of claim 28, The similarity measuring means And means for transmitting the number of iterations, the time required, and the similarity average value for each item in the learning content learned by each learner to the data source for storage in the data source. Learning system. The method of claim 29, The information stored in the data source can be viewed only by an authorized administrator through the network, wherein the authenticated administrator is one of the parent and the teacher of each learner. In an interactive multimedia learning system that displays the learning situation of each learner based on the accuracy of pronunciation of each learner connected through a communication network, A data source for storing multimedia learning content information consisting of a plurality of items, virtual substitute image information, and a plurality of standard pronunciation information associated with the multimedia learning content information; Means for assigning each of said virtual substitute images to each learner who has mastered said multimedia learning content; Means for providing each learner with a standard pronunciation of each item of multimedia learning content; Means for inputting the pronunciation of each learner relative to the standard pronunciation of each item, Means for measuring the similarity between the standard pronunciation and the pronunciation of each learner for each item, and giving the corresponding learner a score corresponding to each measured similarity; Means for controlling a substitute image assigned to each learner based on the assigned scores to simultaneously display the learning progress of each learner on a computer of each learner in real time for a predetermined period of time; Interactive multimedia learning system comprising a. The method of claim 31, wherein The learning content is a language-related learning content including at least one of vowels, consonants, alphabets, words, sentences and conversations. The method of claim 31, wherein The standard pronunciation providing means displays a frequency graph corresponding to the standard pronunciation on each learner computer, The similarity measuring means displays the frequency graph corresponding to each learner pronunciation separately on each learner computer, The frequency graph of the standard pronunciation and the frequency graph of the learner pronunciation are superimposed and displayed on the learner computer. The method of claim 31, wherein The means for providing standard pronunciation comprises means for displaying a sentence corresponding to the standard pronunciation on the learner computer. A method of providing a multimedia learning content to a learner computer connected through a communication network and operating a system for displaying a learning situation of the learning content based on the accuracy of the learner's pronunciation of the learning content, The multimedia learning content is composed of a plurality of items, each step includes a plurality of learning steps indicating the progress of learning of the learning content, (a) providing the learner computer with a plurality of multimedia learning contents each containing virtual object image information and a subject image set each representing a virtual subject image to select the desired learning content and the desired subject image by the learner; With the required steps, (b) outputting a standard pronunciation for each item of selected learning content; (c) requiring the learner to pronounce according to the standard pronunciation for each item; (d) measuring the similarity between the standard pronunciation and the learner's pronunciation for each item; (e) controlling one of the object image and the selected subject image based on the measured similarity; (f) storing said learning content about said learner and said measured similarity in a data source of said system. 36. The method of claim 35 wherein And the learning content is a language related learning content including at least one of a vowel, a consonant, an alphabet, a word, a sentence, and a conversation. 36. The method of claim 35 wherein And the object image represents a virtual teacher. 36. The method of claim 35 wherein Step (b) includes outputting a frequency graph corresponding to the standard pronunciation on the learner computer, The step (d) includes the step of outputting a frequency graph corresponding to the learner pronunciation on the learner computer, The frequency graph of the standard pronunciation and the frequency graph of the learner pronunciation are superimposed and displayed on the learner computer. 36. The method of claim 35 wherein Step (e) is (e1) determining whether the measured similarity satisfies a predetermined threshold condition; (e2) if the measured similarity satisfies the threshold condition, transitioning to the next item of the learning content; otherwise, requesting the learner to repeat the threshold condition according to the standard pronunciation until the learner satisfies the threshold condition; Interactive multimedia learning operating method comprising a. The method of claim 39, The threshold condition is varied by the learner's manager through the network, wherein the manager is one of the learner's parent and teacher. 36. The method of claim 35 wherein And information stored in the data source can be viewed only by an authorized administrator. 36. The method of claim 35 wherein Step (e) is And deploying, according to the measured similarity, a target image each consisting of a plurality of development steps representing a learning progress of the learning content. The method of claim 42, And the target image is completed as the learner completely masters the learning content, and the step of developing the target image is different for each multimedia learning content. 36. The method of claim 35 wherein And the subject image is transformed by the learner. In the method for operating a system for displaying the learning situation of the learning content based on the accuracy of the learner's pronunciation of the multimedia learning content provided through a communication network, (a) providing multimedia learning content comprising a plurality of items and having virtual object images and history on a learner computer; (b) providing a set of subject images on the learner computer, each representing a virtual subject image, requesting the learner to select a desired subject image; (c) outputting a standard pronunciation of each item in the learning content; (d) requiring the learner to pronounce according to the standard pronunciation of each item; (e) measuring the similarity between the standard pronunciation and the learner's pronunciation for each item; (f) controlling one of the object image and the selected subject image based on the measured similarity to develop a history of the learning content in real time; (g) storing the learning content about the learner and the measured similarity in a data source of the system. The method of claim 45, And the learning content is a language related learning content including at least one of a vowel, a consonant, an alphabet, a word, a sentence, and a conversation. The method of claim 45, Step (b) includes outputting a frequency graph corresponding to the standard pronunciation on the learner computer, The step (d) includes the step of outputting a frequency graph corresponding to the learner pronunciation on the learner computer, The frequency graph of the standard pronunciation and the frequency graph of the learner pronunciation are superimposed and displayed on the learner computer. 36. The method of claim 35 wherein Step (f) is (f1) determining whether the measured similarity satisfies a predetermined threshold condition; (f2) if the measured similarity satisfies the threshold condition, transitioning to the next item of the learning content; otherwise, requesting the learner to repeat the threshold condition according to the standard pronunciation until the learner satisfies the threshold condition. Interactive multimedia learning operating method comprising a. 49. The method of claim 48 wherein The threshold condition is varied by the learner's manager through the network, wherein the manager is one of the learner's parent and teacher. The method of claim 49, And information stored in the data source can be viewed only by an authorized administrator. In a method for operating a system for displaying the learning situation of each learner based on the accuracy of each learner's pronunciation of the same multimedia learning content using a communication network, The learning content has a plurality of items consisting of a first item set and a second item set, and includes a predetermined learning step indicating the learning progress, (a) assigning a virtual subject image and a target image having a development step corresponding to the predetermined learning step to the first and second learners who have mastered the same multimedia learning content, respectively, and connecting sessions through the network; , (b) providing a standard pronunciation for the first item of the learning content to the first learner, and alternately providing a standard pronunciation for the second item to the second learner; (c) requesting the first and second learners to pronounce according to the standard pronunciation for each item; (d) measuring the similarity between the standard pronunciation of each item and the pronunciation of each learner; (e) controlling the development steps of the virtual subject image and the target image respectively assigned to each learner based on the measured similarities, and displaying the current learning progress for the learning content in real time. Wow, (f) storing the multimedia learning content information, the subject image set and the standard pronunciation information in a data source of the system. The method of claim 51 wherein Step (c) displays a frequency graph corresponding to the standard pronunciation on the learner computer, Step (e) displays a frequency graph corresponding to the learner pronunciation on the learner computer, The frequency graph of the standard pronunciation and the frequency graph of the learner pronunciation are superimposed and displayed on the learner computer. The method of claim 51 wherein Step (f) is (f1) determining whether the measured similarity with respect to the first and second learners satisfies a preset threshold condition; (f2) if the similarity with respect to the first learner satisfies the predetermined threshold condition, deploying the subject image and the target image allocated to the first learner; otherwise, the second learner Switch to the mode of, (f3) if the similarity with respect to the second learner satisfies the threshold condition, develop a development step of the subject image and the target image assigned to the second learner; otherwise, mode of the first learner Interactive multimedia learning operating method comprising the step of switching to. The method of claim 53 wherein Step (f), prior to switching to the first and second learner mode, (f4) further comprising requesting the first learner and the second learner to repeat the threshold condition according to the standard pronunciation corresponding to each of the learners. The method of claim 54, wherein Step (f4) is and (f41) displaying on the learner computer an average value of the number of repetitions for each item, the time required, and the similarity measured during the number of repetitions. The method of claim 55, Step (f4) is (f42) transmitting the repetition number, the time required, and the similarity average value for each item in the learning content learned by each learner to the data source for storage in the data source. How to run interactive multimedia learning. The method of claim 56, wherein The information stored in the data source can be viewed only by authorized administrators through the network, wherein the authenticated administrator is one of the parent and the teacher of each learner. A method of operating a system for displaying the learning situation of each learner based on the accuracy of pronunciation of each learner connected through a communication network, (a) assigning each virtual substitute image to each learner who has mastered a particular multimedia learning content; (b) providing each learner with a standard pronunciation of each item of the particular multimedia learning content; (c) requiring each learner to pronounce according to a standard pronunciation for each item; (d) measuring the similarity between the standard pronunciation and each learner's pronunciation for each item, and giving the corresponding learner a score corresponding to each measured similarity; (e) controlling the substitute image assigned to each learner based on the assigned scores to simultaneously display the learning progress of each learner on the computer of each learner for a predetermined period of time; (f) storing the multimedia learning content information, the virtual substitute image information, and the standard pronunciation information in a data source of the system. The method of claim 58, Step (b) displays a frequency graph corresponding to the standard pronunciation on each learner computer, Step (d) displays a frequency graph corresponding to each learner pronunciation on each learner computer, The frequency graph of the standard pronunciation and the frequency graph of the learner pronunciation are displayed superimposed on each learner computer.