KR102354768B1 - Method, system and computer-readable recording medium for providing foreign language learning based on intelligent matching - Google Patents

Abstract

Disclosed are a method, a system and a computer-readable recording medium for providing foreign language learning based on intelligent matching. According to an embodiment of the present invention, a method for providing foreign language learning on a communication network, comprises: a process of providing a plurality of learner activity spaces generated by accessing a plurality of learner terminal devices and a plurality of tutor activity spaces generated by accessing a plurality of tutor terminal devices, respectively; a process of recommending a plurality of tutor activity spaces to a corresponding learner terminal device by matching each other according to a degree of similarity based on matching information set in the plurality of learner activity spaces and the plurality of tutor activity spaces; a process in which, when a conversation connection with the corresponding tutor activity space is requested according to the selection of the learner's terminal device, the conversation is conducted according to the consent of the tutor's terminal device of the corresponding tutor activity space, and recorded and stored; a process of recognizing voice information in the recording and converting the same into dialogue text; a process in which a corrected text is generated by an artificial intelligence (AI) machine learning algorithm on the basis of the spelling of the corresponding dialogue language, and the dialogue text and the corrected text are transmitted to the learner terminal device through the corresponding learner activity space; and a process in which the learner terminal device pays a fee according to the required time of the conversation, and is differentially paid to the tutor terminal device according to the class of the tutor activity space. The present invention recommends that matching is possible according to the similarity of matching information.

Description

METHOD, SYSTEM AND COMPUTER-READABLE RECORDING MEDIUM FOR PROVIDING FOREIGN LANGUAGE LEARNING BASED ON INTELLIGENT MATCHING

The present invention relates to a method, system, and computer-readable recording medium for providing foreign language learning based on intelligent matching. More specifically, it relates to a technology capable of providing a foreign language learning service through optimized matching by analyzing information and conversation content set between a learner (student) and a tutor (native speaker) when learning a foreign language over a communication network.

With the trend of globalization and the development of information and communication technology, more information is being actively exchanged in various languages in the international community. In particular, the importance of English, which is widely used as a universal language, is increasing.

However, the fragmentary language skills centered on grammar learned at school have limitations in improving conversation-oriented communication skills, which is the most demanded in the global era. It has restrictions on accessibility and popularity that requires spending. In addition, in the case of online learning, the relative accessibility is good, but there is a problem in that it does not deviate from the standardized online course with a limited pool of instructors, and the autonomy of learning, such as artificially matching students and instructors according to the convenience of the administrator. Because it has limitations, it has a problem that it is difficult to achieve efficient foreign language learning optimized for students who are consumers.

Among these online foreign language learning methods, the most popular one is phone English learning. However, since the existing telephone English learning system is a system in which a company hires a professional instructor and the manager matches the students who paid one to one, it has the disadvantage of having to pay a small amount of time and most of the students It is difficult to find a professional instructor you want, and even if you find a professional instructor, most of the time you want to speak English over the phone is concentrated at a specific time, so it is difficult to fit the schedule of the professional instructor and students.

Accordingly, there is a demand for development of a new concept of foreign language learning service that is cheaper and allows autonomous matching.

Laid-open Patent Publication No. 10-2009-0003525 (published date: 2009.01.12.)

Therefore, the present invention is to solve the problems of the prior art as described above. When learning a foreign language over a communication network, it is recommended to match each other according to the similarity of matching information set between the learner (student) and the tutor (native speaker). There is a purpose.

In addition, the present invention records a conversation (call) between a learner and a tutor, recognizes the recorded voice and converts it into dialog text, and an artificial intelligence (AI) machine learning algorithm based on the spelling of the corresponding dialog language. It has another purpose to provide it as proofreading text modified by

In addition, another object of the present invention is to automatically match the learner with a tutor suitable therefor by reflecting the keyword analysis result of the dialogue text and the spelling analysis result of the proofreading text.

In addition, another object of the present invention is to pay a fee according to the required time of the conversation (call), but differentially pay according to the class of the tutor.

Another object of the present invention is to provide dialogue text (caption) in real time during a conversation (call) between a learner and a tutor, or to provide a recording of the conversation and convert the dialogue text and the proofreading text into voice. .

The above object of the present invention is to provide a method for providing foreign language learning on a communication network, including a plurality of learner activity spaces created by connecting a plurality of learner terminal devices and a plurality of tutor activity spaces created by connecting and connecting a plurality of tutor terminal devices. Courses each offered; a process of recommending a plurality of tutor activity spaces to a corresponding learner terminal device by matching each other according to a degree of similarity based on matching information set in the plurality of learner activity spaces and the plurality of tutor activity spaces; a process of, when a conversation connection with the corresponding tutor activity space is requested according to the selection of the learner's terminal device, the conversation is conducted according to the consent of the tutor's terminal device of the corresponding tutor activity space, and recorded and stored; Recognizing voice information from the recording and converting it into dialogue text; A corrected text is generated by an artificial intelligence (AI) machine learning algorithm based on the spelling of the corresponding dialogue language, and the dialogue text and the corrected text are transmitted to the learner terminal device through the corresponding learner activity space. process to provide; and the learner terminal device pays a fee according to the required time of the conversation, and is differentially paid to the tutor terminal device according to the class of the tutor activity space.

In addition, the above object of the present invention is a system for providing foreign language learning over a communication network, a plurality of learner activity spaces generated by connecting a plurality of learner terminal devices, and a plurality of tutor activities generated by connecting a plurality of tutor terminal devices an activity space providing unit that provides each space; an AI matching unit that recommends a plurality of tutor activity spaces to a corresponding learner terminal device by matching each other according to a degree of similarity based on matching information set in the plurality of learner activity spaces and the plurality of tutor activity spaces; a conversation management unit that, when a conversation connection of the corresponding tutor activity space is requested according to the selection of the learner's terminal device, proceeds with the conversation according to the consent of the tutor's terminal device of the corresponding tutor activity space, and records and stores the conversation; Recognizing voice information from the recording, converting it into dialogue text, and generating proofreading text corrected by an artificial intelligence (AI) machine learning algorithm based on the spelling of the dialogue language for the dialogue text, the dialogue text and the dialogue text a learning management unit providing the corrected text to the learner terminal device through the corresponding learner activity space; And the learner terminal device pays a fee according to the required time of the conversation, but is also achieved by a system characterized in that it comprises a payment management unit that is differentially paid to the tutor terminal device according to the class of the tutor activity space .

In addition to this, other configurations, systems, and methods for implementing the present invention are also achieved by a computer-readable recording medium for recording a computer program for executing the method.

According to the present invention, when learning a foreign language over a communication network, it is recommended to match each other according to the similarity of matching information set between the learner (student) and the tutor (native speaker), thereby enabling intelligent matching learning. .

In addition, according to the present invention, an artificial intelligence (AI) machine that records a conversation (call) between a learner and a tutor, recognizes the recorded voice and converts it into dialogue text, and converts the dialogue text based on the spelling of the corresponding dialogue language By providing the corrected text by the learning algorithm, the learner has the effect of learning by checking the wrong part of his or her conversation in text.

In addition, according to the present invention, by reflecting the keyword analysis result of the dialogue text and the spelling analysis result of the proofreading text, the learner and the appropriate tutor are automatically matched accordingly, so that more optimized matching learning is possible. have.

In addition, according to the present invention, the cost is paid according to the time required for the conversation (call) but differentially paid according to the class of the tutor, so that the quality and cost of the tutor's lecture (conversation) can be reasonably settled. have.

In addition, according to the present invention, during a conversation (call) between a learner and a tutor, the conversation text (caption) is provided in real time, or the conversation is recorded and the dialogue text and the proofreading text are converted into voice, so that the learner can apply it in various ways. It has the effect of being able to learn.

1 is a diagram showing the configuration of an overall system for providing foreign language learning based on intelligent matching according to an embodiment of the present invention.
2 is a diagram illustrating in detail the internal configuration of the intelligent foreign language learning system 300 according to an embodiment of the present invention.
3 is a flowchart between components for providing foreign language learning based on intelligent matching according to an embodiment of the present invention.
4 to 8 are interface screens of a user (a learner, a tutor) who provides a foreign language learning service based on intelligent matching according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] Reference is made to the accompanying drawings, which show by way of illustration specific embodiments in which the present invention may be practiced. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. In the present invention, combinations of each block in the accompanying block diagram and each step in the flowchart may be performed by computer program instructions. Each such block or each step may represent a module, segment, or portion of code comprising one or more executable instructions for executing the specified logical function(s). It should also be noted that it is also possible for the functions recited in blocks or steps to occur out of order in some alternative embodiments. For example, two blocks or steps that are adjacent or shown in order may in fact be performed substantially simultaneously or that the blocks or steps may be performed in reverse order according to a corresponding function.

It should also be understood that the location or arrangement of individual components in each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description set forth below is not intended to be taken in a limiting sense, and the scope of the present invention should be construed to cover all scopes equivalent to those claimed by the claims. In addition, like reference numerals in the drawings refer to the same or similar functions in various aspects, and the form may be exaggerated for convenience.

On the other hand, the terms used in the present invention are terms used to properly express preferred embodiments of the present invention, which may vary depending on the intention of the user or customs in the field to which the present invention belongs. Accordingly, definitions of these terms should be understood based on the content throughout this specification. In the entire specification, when a part "includes" a certain element, this means that other elements may be further included, rather than excluding other elements, unless otherwise stated. In addition, terms such as "unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily practice the present invention.

Whole system configuration

1 is a diagram showing the configuration of an overall system for providing foreign language learning based on intelligent matching according to an embodiment of the present invention.

1 , the entire system according to an embodiment of the present invention includes a communication network 100 , a server 200 , an intelligent foreign language learning system 300 , a learner terminal device 400 , and a tutor terminal device 500 . can be configured.

First, the communication network 100 according to an embodiment of the present invention is a network network capable of performing a series of data transmission/reception operations for data transmission and information exchange, regardless of its communication mode such as wired and/or wireless can be configured.

More specifically, the communication network 100 includes a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), and an integrated services digital network (ISDN). , may be any one of a wireless LAN, a mobile communication network, etc., or various types of wired/wireless communication networks connected and configured by a combination thereof. Preferably, the communication network 100 configured by the present invention may be an Internet network that can use a World Wide Web (WWW) service.

Next, the server 200 according to an embodiment of the present invention may be an operating server capable of performing operation tasks related to intelligent foreign language learning services, such as access (login) management, learner/tutor member management, and payment processing. have.

More specifically, the server 200 may perform the function of a web/app server of an intelligent foreign language learning service operating company. A user (learner, tutor) registers as a member in the web/app and logs in to access the foreign language learning service. If requested, we can support related services. At this time, the server 200 is a dedicated web that connects the intelligent foreign language learning system 300 and the learner terminal device 400 and/or the tutor terminal device 500 to be described later through the communication network 100 and/or It can operate an App program or perform a function that supports it. In addition, the server 200 enables the intelligent foreign language learning system 300 and other terminal devices 400 and 500 to run the application for implementing the network according to the present invention, on the web/app, API (Application Programming Interface) ) can also perform a function that supports the necessary interfaces to build applications such as

Next, in the intelligent foreign language learning system 300 according to an embodiment of the present invention, a plurality of learner activity spaces and a plurality of tutors are generated by connecting a plurality of learners through a plurality of learner terminal devices 400 . Based on matching information set in a plurality of tutor activity spaces generated by accessing the tutor terminal device 500, it is recommended to match each other according to the degree of similarity, or a conversation (call) between the learner and the tutor is recorded and analyzed. It may be a system that provides an intelligent foreign language learning service by automatically matching according to the result.

More specifically, the intelligent foreign language learning system 300 records the conversation (call) between the learner and the tutor by connecting the learner activity space and the tutor activity space, recognizes the recorded voice and converts it into dialog text, and The dialogue text may be modified by an artificial intelligence (AI) machine learning algorithm based on the spelling of the corresponding dialogue language and provided to the learner terminal device 400 as proofreading text.

In addition, the intelligent foreign language learning system 300 may reflect the keyword analysis result of the dialogue text and the spelling analysis result of the proofreading text, and automatically match and provide the learner activity space and the tutor activity space accordingly.

In addition, the intelligent foreign language learning system 300 pays a fee according to the required time of the conversation, but may also pay differentially according to the class of the tutor.

In addition, the intelligent foreign language learning system 300 provides dialogue text (subtitles) in real time during a conversation (call) between a learner and a tutor, or converts the conversational text and the proofreading text into voice and provides it An intelligent foreign language learning service can be implemented, and the intelligent foreign language learning system 300 according to an embodiment of the present invention may be understood in more detail by the following detailed description with reference to FIG. 2 .

Next, the learner terminal device 400 according to an embodiment of the present invention connects to the intelligent foreign language learning system 300 according to the selection of a user (learner) using the terminal device, and creates a learner activity space, and conversation It may be a digital device capable of collecting (call) and transmitting it to the intelligent foreign language learning system 300 .

More specifically, the learner terminal device 400 may create (open) a virtual learner activity space by accessing the intelligent foreign language learning system 300 according to the selection of the learner using the terminal device, for example, ' Student Room', you can enter learner matching information that consists of any one or a combination of learner's age, gender, occupation, academic background, major, hobbies, interests, desired foreign language, desired nationality, desired learning time zone, and learning goals. have.

In addition, the learner terminal device 400 may collect conversations (calls) of learners using the terminal device and provide (transmit) them to the server 200 and/or the intelligent foreign language learning system 300 . Conversely, a function of receiving (receiving) a conversation (call) of another terminal device (eg, the tutor terminal device 500) provided from the intelligent foreign language learning system 300 may be performed.

In addition, the learner terminal device 400 is a correction corrected by an artificial intelligence (AI) machine learning algorithm based on the recording of the conversation, the conversation text converted from the voice of the conversation, and/or the spelling of the corresponding conversation language It can also perform a function of receiving (receiving) text.

In the learner terminal device 400, the learner activity space (eg, student room) and a dedicated web or app program that can receive the recording of the conversation, dialogue text, and proofreading text are further installed. there may be In particular, a call function capable of implementing the conversation (including phone calls and Internet calls) may be further included.

Next, the tutor terminal device 500 according to an embodiment of the present invention connects to the intelligent foreign language learning system 300 according to the selection of a user (learner) using the terminal device, and creates a learner activity space, and talks It may be a digital device capable of collecting (call) and transmitting it to the intelligent foreign language learning system 300 .

More specifically, the tutor terminal device 500 may connect to the intelligent foreign language learning system 300 according to the selection of a user (tutor) using the terminal device to create (open) an activity space for a virtual tutor, e.g. For example, by opening a 'tutor room', tutor matching is set consisting of any one or a combination of the tutor's age, gender, occupation, academic background, major, hobbies, interest, foreign language, nationality, desired conversation time, and conversation goal. You can enter information.

Also, the tutor terminal device 500 may collect conversations (calls) of a user (tutor) using the terminal device and provide (transmit) them to the server 200 and/or the intelligent foreign language learning system 300 . Conversely, a function of receiving (receiving) a conversation (call) of another terminal device (eg, the learner terminal device 400 ) provided from the intelligent foreign language learning system 300 may be performed.

The tutor terminal device 500 may further have a dedicated web or app program for receiving the tutor activity space (eg, tutor room) and information related to the conversation. In particular, a call function capable of implementing the conversation (including phone calls and Internet calls) may be further included.

On the other hand, the learner terminal device 400 and/or the tutor terminal device 500 according to the embodiment of the present invention described above is connected through the communication network 100 to transmit and receive the above-described intelligent foreign language learning service. Various terminal devices such as all known mobile communication terminal devices, information communication devices, multimedia terminal devices, wired terminal devices, fixed terminal devices, and IP (Internet Protocol) terminal devices can be applied as digital devices including digital devices. have. Specifically, the terminal device includes a smart phone, a portable multimedia player (PMP), a personal digital assistant (PDA), a mobile Internet device (MID), a telematics terminal, a desktop, and a tablet. It is a digital device equipped with a memory means such as a computer (tablet PC), notebook (note book), netbook (Net book), etc. and equipped with a microprocessor to have arithmetic capability. / If it includes a wireless communication function and a call function (including phone calls and Internet calls), it may be adopted as a terminal device according to the present invention.

In addition, the learner terminal device 400 and/or the native speaker terminal device 500 may include a display means capable of displaying the foreign language learning service according to the present invention and related information. Here, the display means is LCD (Liquid Crystal Display), TFT-LCD (Thin Film Transistor LCD), OLED (Organic Light Emitting Diodes), light emitting diode (LED), AMOLED (Active Matrix Organic LED), flexible display (Flexible display) and a three-dimensional display (3 Dimension), and the like. In this case, since the display means may include a touch screen type, some or all of the functions of the input means may be performed.

In particular, in the learner terminal device 400 and the tutor terminal device 500 in the present invention, a microphone device capable of collecting voice information (conversation voice), and a speaker device to transmit voice (replay recorded voice) (including a headset and earphones) may be further included or linked thereto to improve the convenience of conversation and learning of users (learners, tutors).

Meanwhile, in FIG. 1 showing an embodiment of the present invention, the intelligent foreign language learning system 300 and the server 200 are shown to be separately configured, but according to the needs of those skilled in the art to implement the present invention, the intelligent foreign language learning system 300 and the server 200 are separately configured. It will be apparent that the learning system 300 can be configured by integrating with the server 200 .

Configuration of the intelligent foreign language learning system 300

In the following detailed description, the internal configuration of the intelligent foreign language learning system 300 that performs an important function for the implementation of the present invention and the function of each component will be described.

2 is a diagram illustrating in detail the internal configuration of the intelligent foreign language learning system 300 according to an embodiment of the present invention.

Referring to FIG. 2 , the intelligent foreign language learning system 300 according to an embodiment of the present invention includes an activity space providing unit 310 , an AI matching unit 320 , a conversation management unit 330 , a learning management unit 340 , and payment. It may be configured to include a management unit 350 , a database 360 , a communication unit 370 , and a control unit 380 .

According to this embodiment of the present invention, the activity space providing unit 310, the AI matching unit 320, the conversation management unit 330, the learning management unit 340, the payment management unit 350, the database 360, the communication unit ( 370 ) and the controller 380 may be program modules, at least some of which transmit and receive data to and from the server 200 , the learner terminal device 400 , and/or the tutor terminal device 500 . These program modules may be included in the intelligent foreign language learning system 300 in the form of an operating system, an application program module, and other program modules, and may be physically stored in various known storage devices, hardware components ( For example, it may be implemented as a general-purpose processor, a dedicated processor) and/or a software component (eg, firmware, an application, a program module) and a combination thereof. In addition, these program modules may be stored in a remote storage device capable of communicating with the intelligent foreign language learning system 300 . Meanwhile, these program modules include routines, subroutines, programs, objects, components, data structures, etc. that perform specific tasks to be described later or execute specific abstract data types according to the present invention, but the present invention is not limited thereto. .

First, the activity space providing unit 310 according to an embodiment of the present invention includes a plurality of learner activity spaces generated by connecting a plurality of learners through a plurality of learner terminal devices 400 and a plurality of tutors using a plurality of tutors. A function of providing each of a plurality of tutor activity spaces generated by accessing through the terminal device 500 may be performed.

More specifically, the activity space providing unit 310 is a process in which a plurality of learners log in to the intelligent foreign language learning system 300 (or the server 200) through their learner terminal device 400 (including membership registration) After connecting through , it is possible to create (open) and provide a learner activity space (eg, a student room), which is an online virtual space for the learner. In the same way, after a plurality of tutors (native speaker) log in to the intelligent foreign language learning system 300 (or the server 200) through their tutor terminal device 500, the corresponding tutor It is possible to create (open) a tutor activity space (eg, a tutor room), which is an online virtual space of , and provide it. In this case, the learner activity space (student room) and the tutor activity space (tutor room) can be managed separately from each other in functions and privileges from the log-in process (including membership registration).

For example, in the learner activity space (student room), the learner can enter information such as the learner's (student's) name, nickname, ID, password, nationality, e-mail, brief self-introduction, image (photo), desired language, etc. You can create an activity space.

In addition, in the tutor activity space (tutor room), information such as the name, nickname, ID, password, nationality, email, brief self-introduction, image (photo), available languages and language proficiency of the corresponding tutor (native speaker) is input. You can create a tutor activity space by doing this.

Next, the AI matching unit 320 according to an embodiment of the present invention matches the plurality of learner activity spaces (eg, student rooms) and the plurality of tutor activity spaces (eg, tutor rooms). Based on the information, it is possible to perform a function of matching with each other according to the degree of similarity and recommending to the corresponding learner terminal device 400 .

More specifically, the AI matching unit 320 provides matching information set in the plurality of learner activity spaces (student rooms), for example, learner age, gender, occupation, academic background, major, hobbies, fields of interest, desired foreign language, desired nationality. , desired learning time zone, learning goal, or a combination of learners matching information, and matching information set in a plurality of the tutor activity space (tutor room), for example, tutor age, gender, occupation, academic background, major Based on the tutor matching information consisting of any one or a combination of , hobbies, interests, conversational languages, nationality, desired conversation time, and a combination thereof, the learner terminal device 400 is matched with each other according to the degree of similarity of each item. can perform the recommended function.

For example, in the case of a male social welfare college student in his early 20s who wants to communicate in English with an English-speaking national, a male social welfare-related college student in his early twenties, who is in a similar range for each item, or a Filipino national who can speak English in a related job You can match and recommend the tutors. Accordingly, a learner who has been recommended by a plurality of tutors can request matching through the process of finally selecting a tutor most suitable for him or her. In this case, the matching information set for each learner and tutor can be changed by a user (a learner, a tutor), and thus recommended matching can be controlled according to the user's wishes.

On the other hand, the AI matching unit 320 according to another embodiment of the present invention recognizes voice information in a recording storing a conversation (call) between a matched learner and a tutor, and a keyword analysis result of the converted conversation text and the conversation By reflecting the result of analysis of the correction text corrected by the artificial intelligence (AI) machine learning algorithm based on the spelling of the corresponding dialogue language, the appropriate learner and tutor are automatically matched according to the corresponding learner terminal device ( 400) can also perform the function provided. In this case, the corresponding learner may request matching through the process of finally selecting through the learner terminal device 400 . For example, the keyword that exists most frequently among the contents of the dialogue text is extracted, and if the extracted keyword is 'movie', then the tutor containing the keyword is reflected by reflecting the analysis result of 'movie' in the subsequent matching process. You can find and automatically match a tutor in the activity space (tutor room). Similarly, when the correction frequency (probability) of correction is high because the learner does not pronounce the correct pronunciation as a result of the analysis of the correction contents of the corrected text, for example, among a plurality of tutors, the tutor activity space ( Tutor room) can be searched and matched. This intelligent matching service will be more clearly understood by the detailed description of the conversation management unit 330 and the learning management unit 340 and FIG. 3 below.

Next, when the conversation management unit 330 according to an embodiment of the present invention requests a conversation connection between the corresponding learner activity space and the corresponding tutor activity space according to the selection of the corresponding learner terminal device 400, According to the consent of the tutor terminal device 500, a conversation may be conducted, and a function of recording and storing the conversation may be performed.

More specifically, the conversation management unit 330 according to the selection of the learner terminal device 400 from among the matching information recommended by the AI matching unit 320 (or by intelligent automatic matching), the corresponding learner activity space and the corresponding tutor activity space If you request a conversation connection with the tutor, you can proceed with the conversation (call) according to the consent of the tutor terminal device 500 . At this time, the conversation is a phone call using a wired/wireless telephone network, or an Internet phone using a wired/wireless data communication network, that is, VOIP (Voice Over IP) that converts and transmits voice through a network using an Internet (IP) address Or it may be any one of mobile Internet phone (mVoIP). These conversations (calls) may be recorded files stored in the form of electronic files, and learners can receive and use them for learning. It can be classified and managed by topic, and learners can selectively re-listen to it and use it for foreign language learning.

In addition, the recorded conversation can be converted into conversation text in the learning management unit 340 to be described later and used as learning information, and the content (keyword) of the conversation text is analyzed as mentioned in the AI matching unit 320 . Thus, a more optimized learner-tutor intelligent matching service can be implemented, which can be understood by the detailed description below.

Next, the learning management unit 340 according to an embodiment of the present invention recognizes the voice information in the recording, converts it into a dialogue text, and converts the dialogue text into a spelling of a corresponding dialogue language (eg, pronunciation and grammar) It is possible to perform a function of generating corrected text by an artificial intelligence (AI) machine learning algorithm based on , and providing the corrected text to the learner terminal device through the corresponding learner activity space.

More specifically, the learning management unit 340 extracts and recognizes voice information (signal) from the recording stored as an electronic file, and then may perform a process of converting it into a dialogue text, a known voice-text technology (STT). : Speech-to-Text) can be applied without limitation. Looking at the concept of such SST technology as an example, it is possible to compare the input voice with an acoustic model (AM) and a language model (LM), and finally convert the voice signal into a text symbol based on the value. can

For example, a typical algorithm is the Hidden Markov Model (HMM), which models the basic unit (phoneme) for speech recognition, and compares the standard pattern of speech with the input speech as word unit recognition. There are a pattern matching method for finding the closest voice pattern to the input voice, and an identification function method for determining a function by preparing a function for distinguishing one word from another word in advance and applying the function to the input voice. In addition to the above-described method, various known methods for speech recognition and speech-text conversion may be used, and the present invention is not limited to the above-described method.

Subsequently, it is possible to check whether the dialogue text fits the spelling based on the pronunciation and grammar of the corresponding dialogue language, and to correct (correct) the wrong part by an artificial intelligence (AI) machine learning algorithm. Basically, these spelling algorithms can be implemented by combining AI methodologies such as machine learning, deep learning, and natural language processing methods. , detailed description will be omitted in the present invention.

In addition, the learning management unit 340 according to an embodiment of the present invention, for example, converts a recording of conversation in English into English conversation text, then corrects it to generate an English correction text, and machine-translates it back into Korean. By providing the Korean translation text, the learner can recognize and recognize their English conversation level more clearly in their native language, Hangul.

In addition, the learning management unit 340 according to an embodiment of the present invention may further perform a process of converting (synthesizing) the Korean translation text into a Korean voice. Through this text-to-speech conversion, the recorded English It is also possible to improve the foreign language learning effect by repeatedly listening to a certain section (eg, sentence unit) of a conversation and a Korean voice conversion (synthesis) section of the predetermined section. Such text-to-speech (TTS) technology can be processed by applying known techniques without limitation. As an example, the voice is cut into very short units such as phonemes and stored, and a sentence to be synthesized is constructed. Concatenative speech synthesis (TTS), which synthesizes speech by combining Synthesis (parametric TTS) and the like.

In addition to the above-described method, various known methods for speech synthesis and text-to-speech conversion may be used, and the present invention is not limited to the above method.

In addition, during a conversation (call) between a learner and a tutor, the dialogue text or proofreading text is provided in real time as subtitles, or the dialogue is recorded and the dialogue text and the proofreading text are converted into voice to allow learners to apply learning in various ways. may be

Next, the payment management unit 350 according to an embodiment of the present invention provides a function in which the learner terminal device 400 pays a cost according to the required time of the conversation, but is differentially paid according to the class of the tutor. can be done

More specifically, the payment management unit 350 can make a payment using any known monetary means capable of cost settlement, such as cash, credit card, electronic money (simple payment), and virtual currency, without limitation. Preferably, learners and tutors In consideration of the distribution of

In addition, the payment management unit 350 can automatically pay (deduct) the cost from the already charged charge without a separate payment process, for example, the learner terminal device 400 is the above-mentioned known monetary means It can be used by charging the charge (eg, coin unit) in the minimum time unit (eg, 10 minutes charging).

At this time, a certain discount can be applied in proportion to the charging unit time. For example, 500 coins per 10 minutes based on icloud pay, 3000 coins for 2900 won for 1 hour, and 30000 coins for 27000 won for 10 hours can be applied to charge.

On the other hand, when payment is made, when payment is made by monetary means or when automatic payment is made with a charge (coin), it may be differentially paid according to the grade of the tutor (tutor activity space) opened by the tutor terminal device 500. , for example, in the case of payment as a charge, a general tutor may pay 500 coins in 10 minutes, a best tutor may pay 500 to 1000 coins in 10 minutes, and a partner tutor may pay 5000 to 10,000 coins in 10 minutes.

When paying such a fee, a certain fee may be deducted from the intelligent foreign language learning system 300. For example, of the total payment cost, the intelligent foreign language is 20% for general tutors, 15% for best tutors, and 10% for partner tutors. A payment may be made to the learning system 300 .

On the other hand, the criterion for classifying the class of the tutor is, for example, when the tutor terminal device 500 joins, starting as a general tutor, classes for 300 minutes or more per week, rating 4.0 or more, 50 reviews or more, enjoy If you find more than 10 people, you can be promoted to Best Tutor. In addition, if a class of 1500 minutes or more per week, a GPA of 4.0 or more, 100 reviews or more, and 20 or more favorites, you can be promoted to a partner tutor through screening.

Next, the database 360 according to an embodiment of the present invention provides information necessary or related to a foreign language learning service, for example, activity space information, learner/tutor information, conversation recording information, dialogue text information, and proofreading text information. , STT model information (acoustic model information, language model information), TSS model information (speech synthesis information, word/sentence information), etc. may be stored as a storage device.

On the other hand, although the database 360 is illustrated as being included in the intelligent foreign language learning system 300 in FIG. 2 , according to the needs of those skilled in the art to implement the present invention, the database 360 is the intelligent foreign language learning system 300 . ) may be configured separately or configured to be included in the server 200 . The database 360 is a concept including a computer-readable recording medium, and refers not only to a narrow database, but also a database in a broad sense including a data record based on a file system, and even a simple set of logs. If data can be extracted by searching, it may be included in the database 360 referred to in the present invention.

Next, in the communication unit 370 according to an embodiment of the present invention, the internal components of the intelligent foreign language learning system 300 are configured such as the server 200, the learner terminal device 400 and/or the tutor terminal device 500, and the like. It can perform a function that enables transmission and reception of data (information) with an external device.

Finally, the control unit 380 according to an embodiment of the present invention includes an activity space providing unit 310 , an AI matching unit 320 , a conversation management unit 330 , a learning management unit 340 , a payment management unit 350 , It may perform a function of controlling the flow of data between the database 360 and the communication unit 370 . That is, the control unit 380 according to the present invention controls the flow of data from the outside or between each component of the intelligent foreign language learning system 300, so that the activity space providing unit 310, the AI matching unit 320, The conversation management unit 330 , the learning management unit 340 , the payment management unit 350 , the database 360 , and the communication unit 370 may be controlled to perform their own functions, respectively.

Course to provide foreign language learning based on intelligent matching

In the following detailed description, with respect to the process of providing foreign language learning based on intelligent matching according to the present invention, the data processing process between the intelligent foreign language learning system 300 , the learner terminal device 400 and the tutor terminal device 500 is described. Although an example is mainly described, this is a description of the most representative process for convenience of description, and the present invention is not limited thereto.

3 is a flowchart between components for providing foreign language learning based on intelligent matching according to an embodiment of the present invention.

Referring to FIG. 3 , first, a plurality of learners log in and access the intelligent foreign language learning system 300 through their learner terminal device 400 ( S11 ), and a plurality of learner activity spaces (eg, student room) A process (S12) of creating (opening) and providing (S10: S11, S12) may be performed. In addition, a plurality of tutors log in and access the intelligent foreign language learning system 300 through their tutor terminal device 500 (S21), and create (open) a plurality of tutor activity spaces (eg, tutor rooms). The providing process (S22) may be performed (S20: S21, S22).

Subsequently, a process of inputting and setting matching information into the plurality of learner activity spaces and the plurality of tutor activity spaces may be performed (S31 and S32). The matching information set in the plurality of learner activity spaces (student rooms) is, for example, any one of the learner's age, gender, occupation, academic background, major, hobbies, interests, desired foreign language, desired nationality, desired learning time zone, and learning goal. Alternatively, it may be learner matching information made up of a combination thereof (S31). In addition, matching information set in the plurality of tutor activity spaces (tutor rooms), for example, tutor age, gender, occupation, academic background, major, hobbies, interests, available foreign languages, nationality, desired conversation time, conversation goals It may be tutor matching information made up of any one or a combination thereof (S32).

Then, based on the matching information (learner matching information, tutor matching information), matching each other according to the degree of similarity of each item to recommend a plurality of (similar) tutors suitable for the learner terminal device 400 Can be performed. There is (S40, S41).

Then, if a conversation connection with the corresponding tutor activity space is requested according to the selection of the corresponding learner terminal device 400, the conversation can be conducted according to the approval of the corresponding tutor terminal device 500 (S50). A foreign language (English) can be learned, and at this time, the process of recording and storing the conversation can be performed (S60). Accordingly, the learner can conveniently learn a foreign language (English) desired by the learner through such a conversation (call) through the learner terminal device 400 . On the other hand, the conversation (call) is a phone call using a wired/wireless phone network, or an Internet phone using a wired/wireless data communication network, that is, VOIP (Voice) that converts and transmits voice through a network using an Internet (IP) address. Over IP) or mobile Internet telephony (mVoIP).

Subsequently, the recording of the conversation is provided to the learner (S70), and in the learner's activity space (eg, student room), the conversation partner can be classified and managed according to the tutor, the date of the conversation, and the topic of the conversation. By selectively re-listening, it can be used for applied learning of foreign languages, which will be described later.

Then, the voice information from the recording is recognized and converted into dialogue text, and the dialogue text is corrected by an artificial intelligence (AI) machine learning algorithm based on the spelling including the pronunciation and grammar of the corresponding dialogue language to obtain proofreading text. A learning management process to create may be performed (S80). At this time, the process of automatically matching the learner and the tutor (S40) may be further performed by reflecting the analysis result of analyzing the keyword of the dialogue text and the analysis result of analyzing the correction content of the proofreading text (S81), Afterwards, when a new matching is requested for foreign language conversation learning, a more suitable intelligent matching process may be performed according to the analysis result (S81, S40).

Subsequently, a process of providing the dialogue text and the proofreading text to the learner terminal device 400 through the corresponding learner activity space may be performed (S90).

Subsequently, the learner may perform an applied learning process of comparing the dialogue text and the proofreading text and confirming the wrong part of their English conversation with text (S100).

Then, the learner terminal device 400 calculates and pays the cost according to the required time of the conversation, but differentially calculates (S110) according to the class of the tutor and performs the payment process (S120). Accordingly, the tutor may receive the payment processed as described above (S130). For example, payment can be made using known monetary means that can be settled, such as cash, credit card, electronic money (simple payment), and virtual currency, or the cost is automatically deducted from the pre-loaded amount without a separate payment process. It can be paid (deducted), for example, it can be used by charging a charge (eg, coin unit) in a minimum time unit (eg, 10 minutes charging).

Example of foreign language learning service based on intelligent matching

In the following detailed description, in the foreign language learning service App (App) based on intelligent matching according to an embodiment of the present invention, as an example, a learner living in Korea who wants to have an English conversation uses English as a common language in the Philippines. The learning process in which a living tutor is connected by intelligent matching is described as an example, but this is a representative example for convenience of explanation, and the present invention is not limited thereto.

4 to 8 are interface screens of a user (a learner, a tutor) who provides a foreign language learning service based on intelligent matching according to an embodiment of the present invention.

First, referring to FIG. 4 , based on the matching information set in the plurality of learner activity spaces and the plurality of tutor activity spaces, a plurality of tutor activity spaces are recommended to the corresponding learner terminal device 400 by matching each other according to the degree of similarity In this case, screen (a) is an interface screen of the learner activity space (student room) of the learner terminal device 400, and screen (b) is a case in which the learner terminal device 400 visits the tutor activity space (tutor room). This is the interface screen. When they match each other, the profile contents can be checked, and by examining the profile contents, it is possible to finally select whether or not to match. can proceed in this way.

Next, referring to FIG. 5 , a screen (a) is a process of transmitting and receiving a message to and from the tutor terminal device 500 through the message menu on the interface screen of the learner activity space (student room) of the learner terminal device 400, The message function can be freely used without a separate consent process. Next, the screen (b) is profile information through the My Page menu on the interface screen of the tutor activity space (tutor room) of the tutor terminal device 500 . At this time, it is also possible to enter into the tutor activity space (tutor room) by registering a favorite through the learner activity space (student room) of the learner terminal device 400. It requires a process, so it can be used only after more than one learning (conversation).

In this way, the schedule can be publicly checked in the tutor activity space (tutor room) on the registered favorites, the class can be reserved according to the schedule, and the tutor can choose to approve or reject the learner's reservation request. can provide

Next, referring to FIG. 6 , when a reserved (agreed) conversation is established through the above process, the conversation voice is recorded and related information is stored in the learner activity space (student room) of the learner terminal device 400. can provide In screen (a), through the My Page menu of the learner activity space (student room), you can check the recording history and the tutor history of the conversation the learner has had. Then, on the screen (b), you can check the details of the tutor that the learner has had conversations with through the Favorites menu.

Next, referring to FIG. 7 , the screen (a) is a case in which 'View conversation contents' is selected on the screen (a) of FIG. have. Subsequently, the screen (b) is a case in which 'view tutor details' is selected on the screen (a) of FIG. 6 , and a specific conversation time, tutor information, profile information, and the like can be checked.

Next, referring to FIG. 8 , as shown in the screen (a) of the actual chat window, when 'suggested word: CEO' is given, the learner and the tutor continue a natural conversation (call). For example, the minimum unit time You can choose whether to extend or not every 10 minutes. Subsequently, on the screen (b), after the conversation process is classified, the learner can input a review or rating for the tutor to provide standard information for payment of fees along with the quality evaluation of the tutor.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software field. Examples of the computer-readable recording medium include hard disks, magnetic media such as floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floppy disks. media), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for carrying out the processing according to the present invention, and vice versa.

In addition, in the detailed description of the present invention, specific matters such as specific components and limited embodiments and drawings have been described, but these are only provided to help a more general understanding of the present invention, and the present invention is limited to the above embodiments. It is not, and those of ordinary skill in the art to which the present invention pertains can devise various modifications and variations from these descriptions. Accordingly, the spirit of the present invention is not limited to the above-described embodiments, and not only the claims described below, but also all modifications equivalently or equivalent to the claims are within the scope of the spirit of the present invention. will do it

100: communication network
200: server
300: intelligent foreign language learning system
310: activity space providing unit
320: AI matching unit
330: Conversation management unit
340: Learning Management Department
350: payment management unit
360: database
370: communication department
380: control unit
400: learner terminal device
500: tutor terminal device

Claims (10)

A method for providing foreign language learning over a communication network, comprising:
A process of providing, by the activity space providing unit, a plurality of learner activity spaces generated by accessing a plurality of learner terminal devices and a plurality of tutor activity spaces generated by accessing a plurality of tutor terminal devices;
a process of recommending, by the AI matching unit, a plurality of tutor activity spaces to the corresponding learner terminal device by matching each other according to the degree of similarity based on matching information set in the plurality of learner activity spaces and the plurality of tutor activity spaces;
a process of, when a conversation connection with the corresponding tutor activity space is requested by the conversation management unit according to the selection of the corresponding learner's terminal device, the conversation is conducted according to the agreement of the tutor's terminal device of the corresponding tutor's activity space, and recorded and stored;
a process of recognizing, by the learning management unit, voice information in the recording and converting it into dialogue text;
By the learning management unit, the dialogue text is generated as a corrected text by an artificial intelligence (AI) machine learning algorithm based on the spelling of the corresponding dialogue language, and the dialogue text and the corrected text are used in the corresponding learner activity space. providing to the learner terminal device through; and
A process in which, by the payment management unit, the learner terminal device pays a fee according to the required time of the conversation, but is differentially paid to the tutor terminal device according to the class of the tutor activity space
including,
The process of reflecting the keyword analysis result of the text and the correction content analysis result of the proofreading text by the AI matching unit, automatically matching the learner activity space and the tutor activity space according to this and providing it to the learner terminal device ;
a process of providing, by the learning management unit, the recorded conversation and related information to the corresponding learner activity space for each conversation partner tutor, conversation date, and conversation topic;
When the activity space providing unit requests to register the corresponding tutor activity space as a favorite according to the selection of the learner terminal device, completing the bookmark registration according to the consent of the tutor terminal device of the corresponding tutor activity space; and
The process of completing the class reservation according to the agreement of the tutor terminal device in the tutor activity space when the schedule is checked by the conversation management unit in the tutor activity space on the registered favorites and a class reservation is requested according to the selection of the learner terminal device
further comprising,
The method characterized in that the bookmark registration request is activated only when there is a conversation record between the learner terminal device and the tutor terminal device.
delete According to claim 1,
The matching information is
It consists of learner matching information of the learner activity space input by the learner terminal device and the tutor matching information of the tutor activity space input by the tutor terminal device,
The learner matching information consists of any one or a combination of the learner's age, gender, occupation, academic background, major, hobbies, interests, desired foreign language, desired nationality, desired learning time zone, and learning goals,
The tutor matching information is the tutor's age, gender, occupation, academic background, major, hobbies, fields of interest, foreign languages that can be communicated, nationality, desired conversation time, the method characterized in that it consists of any one or a combination of these goals.
According to claim 1,
The cost is
A method, characterized in that it is a payment payment by means of money or automatic deduction payment by a charge.
According to claim 1,
The tutor's grade is:
According to the criteria consisting of any one or a combination of the total conversation time of the tutor activity space, ratings, reviews, and favorites,
A method characterized in that it is divided into general tutors, best tutors, and partner tutors.
A system for providing foreign language learning over a communication network, comprising:
an activity space providing unit that provides a plurality of learner activity spaces generated by accessing a plurality of learner terminal devices and a plurality of tutor activity spaces generated by accessing a plurality of tutor terminal devices;
an AI matching unit that recommends a plurality of tutor activity spaces to a corresponding learner terminal device by matching each other according to a degree of similarity based on matching information set in the plurality of learner activity spaces and the plurality of tutor activity spaces;
a conversation management unit that, when a conversation connection of the corresponding tutor activity space is requested according to the selection of the learner's terminal device, proceeds with the conversation according to the consent of the tutor's terminal device of the corresponding tutor activity space, and records and stores the conversation;
Recognizing voice information from the recording, converting it into dialogue text, and generating proofreading text corrected by an artificial intelligence (AI) machine learning algorithm based on the spelling of the dialogue language for the dialogue text, the dialogue text and the a learning management unit that provides the corrected text to the learner terminal device through the corresponding learner activity space; and
The learner terminal device pays a fee according to the duration of the conversation, but a payment management unit that is differentially paid to the tutor terminal device according to the class of the tutor activity space
including,
The AI matching unit,
By reflecting the keyword analysis result of the text and the analysis result of the correction content of the proofreading text, the learner activity space and the tutor activity space are automatically matched accordingly and provided to the learner terminal device,
The learning management unit provides the recorded conversation and related information to the corresponding learner activity space for each conversation partner, each tutor, the date of the conversation, and the topic of the conversation,
When the activity space providing unit requests to register the corresponding tutor activity space as a favorite according to the selection of the learner's terminal device, it completes the bookmark registration according to the consent of the tutor terminal device of the corresponding tutor activity space,
The conversation management unit confirms the schedule in the tutor activity space on the registered favorites and applies for a class reservation according to the selection of the learner terminal device, and completes the class reservation according to the consent of the tutor terminal device in the tutor activity space,
The system, characterized in that the bookmark registration request is activated only when there is a conversation record between the learner terminal device and the tutor terminal device.
delete 7. The method of claim 6,
The matching information of the AI matching unit,
It consists of learner matching information of the learner activity space input by the learner terminal device and the tutor matching information of the tutor activity space input by the tutor terminal device,
The learner matching information consists of any one or a combination of the learner's age, gender, occupation, academic background, major, hobbies, interests, desired foreign language ability, desired learning time period, and learning goals,
The tutor matching information is the tutor's age, gender, occupation, academic background, major, hobbies, fields of interest, foreign language ability, desired conversation time, the system characterized in that it consists of any one or a combination of these goals.
7. The method of claim 6,
The payment management unit,
A system, characterized in that for the above cost, payment by monetary means or automatic deduction payment by charge.
7. The method of claim 6,
The tutor's grade is:
According to the criteria consisting of any one or a combination of the total conversation time of the tutor activity space, ratings, reviews, and favorites,
A system characterized in that it is divided into general tutors, best tutors, and partner tutors.

Images