KR20050095312A - Real-time language learning system and method thereof for which uses the camera - Google Patents

Abstract

The present invention relates to a system and method for introducing natural conversations with native speakers of a country using the language and video chat via a P2P-based Internet, and more specifically, users and native speakers. Equipped with an image input means for recording and transmitting the picture of the user in real time and a voice input and output means for receiving and outputting the conversation between the user and the native speaker as a real-time voice, support the P2P function and process the image and voice in real time It includes a user terminal equipped with a program for supporting a user and a P2P function and a database of the user's information and native speaker's information, and a web server connected to the user terminal and the Internet to provide various services related to language learning. Real-time Linguistics Using Image Cameras It provides a system and a method thereof.

Description

Real-time language learning system and method about for uses uses the camera

The present invention relates to an interactive language learning method and a method of talking directly with a native speaker of a corresponding country in a P2P-based internet, and more specifically, to connecting a native speaker with a language study candidate through a P2P-based internet image camera. It's about giving, and how it works, as well as how to build your English skills through pen pals, and make friends with foreigners (sometimes called WebCamPal) and build your language skills.

Many people around the world are struggling to learn a language, and even after studying in their home country, they try to raise their level through language training. This is because dialogue with native speakers is an important determinant for language study. Reflecting these influences, a number of methods for learning languages have recently been suggested through the Internet and the image media, which mainly provide words, sentences, and grammars for learning languages, and especially as part of improving language listening ability. For example, a method of providing a native speaker's pronunciation of a word or sentence, a foreign language-oriented language learning method such as listening to or viewing an English word or sentence first and then showing a corresponding Korean interpretation is proposed.

In particular, an interactive language learning system and service method (Korean Publication No. 2003-0079497, filed April 4, 2002) have been proposed as a language learning method on the Internet. The interactive language learning system and service method of the present invention separate and control a moving picture of a produced movie or animation by frame according to a sentence in a talker's conversation, while the user's voice is recognized by voice recognition technology and the voice of the moving picture is directly Alternatively, it is possible to help the user learn the language in a three-dimensional conversational form that causes interest by outputting the machine sound by voice synthesis technology, and by controlling the display state of the screen according to the sentence, it is possible to realistically learn the language.

However, since the above method uses pre-produced movies or animations, direct dialogue with native speakers is impossible, and since the voice is also output as a machine sound by voice synthesis technology, it is difficult to present the accuracy of pronunciation required for conversation. In addition, since the same picture and the same painting are repeatedly performed, various contents that occur in actual painting cannot be realized, and in particular, there is an inconvenience in that it is not possible to meet foreigners directly and only to satisfy with indirect experience.

The present invention has been devised to solve the above problems, and introduces a natural conversation to the user who wants to study the language with a native camera of the country using the video camera through the P2P-based Internet, the user The aim is to provide a new concept real-time language training system and method that can improve the level of language naturally while making native speakers, and the native speaker who is a partner can work part-time and make foreigners win-win. There is this.

In order to achieve the above object, a system and a learning method for providing a natural conversation to a user who wishes to study a language using a video camera and a P2P function of the Internet of the present invention while watching directly with a native speaker of a country using the language. In

Equipped with an image input means 110 for recording and transmitting the user and the native speaker in real time and a voice input and output means 120 for receiving and outputting the conversation between the user and the native speaker as a real-time voice, P2P function And a program for real-time processing of images and audio, and the user D / B 180 for storing and providing user information and information related to a native speaker for authenticating the user in the user terminal 100 and the user. The user terminal 100 further comprises a conversation D / B 190 for providing and managing video and audio conversation information generated by forming a group including a user and a native speaker or a helper of the native speaker, and supporting the P2P function. Customer D / B (550) for storing and providing the database of the user information and native speaker information and helper information, the user and the native speaker A real-time language learning system is provided using a video camera comprising a web server 500 further comprising a program for providing various learning services using related information so as to perform a function of a P2P server capable of real-time conversation. ,

The step of connecting the user to the Internet to the user terminal 100 for a conversation with the native speaker at a specified time (S700), the user authentication step (S710) to confirm that the user is a member of the web server, and the native speaker Step (S720) of checking whether or not the helper to support the conversation, connecting with the helper when the helper request (S730), the user accessing a preset native speaker (S740), and the user image And performing a real-time conversation with the native speaker by voice (S750) and terminating the real-time conversation (S760).

The native speaker is a national of the country that speaks the language of the country, an American who speaks English, a Chinese who speaks Chinese, a German who speaks German, and the like.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

1 is a view showing a schematic configuration of an entire system according to an embodiment of the present invention. In detail with reference to Figure 1,

The present invention consists of a user terminal 100, a native speaker terminal 200, a helper terminal 300, the Internet 400, a web server 500,

The user terminal 100 can receive and output the image input means 110 for real-time recording and transmission of the conversation between the user and the native speaker while watching the conversation in real time and a real-time voice. A user D / B equipped with a voice input / output means 120, and equipped with a program for processing images and voices, and storing and providing information related to the user and the native speaker who want to learn a language by talking with a native speaker ( 180) and a conversation D / B 190 configured to provide and manage video and audio conversation information generated by forming a group including a user and a native speaker one-to-one or a helper.

In particular, the image input means 110 is a general image camera mounted on a computer, by using an image camera of 300,000 pixels or more of the CCD method and the CMOS method, it is possible to clearly distinguish the shape of the user's face and mouth at least. It is characteristic.

The voice input and output means 120 is based on a speaker, a microphone attached to the user's terminal, it is preferable to include external audio and the like connected to the terminal.

The native speaker terminal 200 and the helper terminal 300 perform the same components and functions as the user terminal 100, and the helper participates in the conversation between the user and the native speaker when the user requests it. It helps to lose.

Since the Internet 400 uses known techniques, description thereof will be omitted.

The web server 500 stores and stores the information of the user, the native speaker's information, and helper information in a database, and is connected to the user terminal and the Internet to provide and manage various web services related to language learning. do.

2 is a block diagram of the user terminal 100 according to an exemplary embodiment of the present invention. Referring to Figure 2 in more detail the components of the user terminal 100,

The user terminal 100 is equipped with a program for real-time language learning while supporting a P2P-based function, the image recognition module 131, the image output module 132, the voice recognition module 133, the voice output module 134 ), Text processing module 135, main control module 140, networking module 170, synchronization module 171, group management module 172, D / B management module 160, user D / B (180) , Including dialogue D / B 190,

The image recognition module 131 performs a function of converting and processing natural conversations between a user and a native speaker photographed through the image input means 110 into digital data that can be processed and processed by a computer,

The image output module 132 performs a function of providing a direct view of the user and the native speaker by displaying a natural conversation between the user and the native speaker photographed through the image input means 110 on a terminal such as the user and the native speaker.

The voice recognition module 133 converts the voice conversation between the user and the native speaker inputted into the voice input / output means 120 into digital data that can be recognized and processed by a computer, and performs processing.

The voice output module 134 outputs a voice conversation between the user and the native speaker inputted through the voice input / output means 120 to the user and the native speaker using a speaker or an external device attached to the terminal of the user and the native speaker. Then,

The text processing module 135 performs a function of displaying the text on the user terminal 100 by the user and the native speaker using a keyboard or the like,

The main control module 140 controls and manages the natural appearance, voice, and text of the user and the native speaker in real time, and maintains the synchronization for the conversation between the user and the native speaker (including a case where a helper participates) in real time. Converts to streaming to enable conversation, performs a function that provides various functions according to language learning,

The networking module 170 transmits the information streamed by the main control module 140 to enable real time conversation using the Internet.

The synchronization module 171 performs a function to enable real-time conversation by synchronizing the user and the native speaker with the conversation using the image camera of the Internet,

The group management module 172 performs a function of controlling while the user configures a group so as to control a conversation with a native speaker and a helper of the corresponding country at the same time,

The D / B management module 160 manages the user D / B 180 and the conversation D / B 190.

The user D / B 180 stores and provides information for forming and communicating information and groups related to the native speaker and the helper with the user who wants to learn a language through natural conversation with the native speaker,

The conversation D / B 190 performs a function of providing and managing image and audio conversation information generated by forming a group including one-to-one or a helper of the user and a native speaker.

3 is a block diagram of a web server 500 according to an exemplary embodiment of the present invention. Referring to Figure 3 in more detail the components of the web server 500,

The web server 500 performs a P2P-based server role, and facilitates the information related to the user, the information of the native speaker, and the dialogue between the user and the native speaker in a natural conversation with the native speaker. Customer D / B (550) that stores and manages the helper information to help to build, and a program that provides a variety of learning services using the relevant information to perform the function of the P2P server capable of real-time conversation between the user and the native speaker. It is composed.

The customer D / B 550 may include information such as age, hobby, specialty, and interests related to the user who wants to learn a language through natural conversation with the native speaker, nationality, age, hobby, specialty, and interest of the native speaker. Store and provide information such as language information of the helper and the like, and store information such as the learning time of the user and provide the user with data related to learning, and the user and the native speaker have a one-to-one conversation or It stores and provides information, such as the language level of the user required when forming a group including a helper, and the helper's information that provides help and explanation for the user's language level.

In particular, the customer D / B (550) is to build and manage a database for users who want to communicate with native speakers and native speakers by the administrator who installs and operates the inventor system,

First of all, the applicants should be selected in consideration of their educational background, living standards, age, gender, and ability to comply with appointments after signing up, and register as native speakers by registering them on the Internet website. It is desirable that native speakers who join as members maintain real-time conversations (communication) using video cameras for a certain period of time and for a certain period of time with mandatory language study applicants, and receive a certain amount of part time in return.

In particular, when selecting a native speaker, the applicants are selected by considering the internet access time of the language study applicants and the time difference of the relevant country, and the students and the elderly who are advantageous for the part-time salary payment are selected by considering the educational background and level. It is desirable to store the relevant information.

In addition, the helper when the user and the native speaker has a real-time conversation when the user requests a helper to participate in the conversation between the user and the native speaker to help facilitate the conversation, the language ability when registering as a helper member By testing and publishing the test results, the user can select a helper for the level.

The program mounted on the web server 500 includes a networking module 510, a main control module 520, a member management module 530, and a D / B management module 540.

The networking module 510 manages a P2P group in which the user and the native speaker or helper participate,

The main control module 520 registers the user accessing the Internet, provides various information related to the learning, and provides helpers as necessary to mediate the user and the native speaker in real time. ,

The member management module 530 receives and registers information of a user who first accesses the Internet, and provides and manages information such as age, hobby, specialty, interests, and learning time of the user,

The D / B management module 540 stores information of a user and a native speaker registered as the member, information of a helper selectively required for a conversation, and processes authentication of a user, a native speaker, a helper, and the like, participating in the conversation. Do this.

A method of real-time conversation with a native speaker of a corresponding country using a real-time language learning system using the image camera of the present invention configured as described above will be described in more detail with reference to the accompanying drawings.

4 and 5 and 6 is a flow chart illustrating a member registration process of a user, a native speaker, a helper for real-time conversation with a native speaker according to an embodiment of the present invention.

4 and 5 and 6 will be described in detail.

First, in order to explain the present invention, a user who wishes to study a language is equipped with an image camera and a sound card in his terminal, and is also connected to the web server 500 of the present invention to register as a member (S410). Download and install the program, and enter the initial information, such as the user's gender, age, education level, language skills, hobbies, specialty (S420), check the request of the helper (S430), if you request a helper Set the minimum desired conditions such as the gender of the assistant (S440), the specified time desired by the user, the language and his level to learn, the conditions for native speakers (association, age, education, time and time, etc.) By setting the native speaker corresponding to this (S450), when the registration process is completed (S460).

The native speaker selects the target person by considering the internet access time of the language study applicant and the time difference of the relevant country, and considers the educational level and the level, but accepts students and the elderly who are advantageous for the part-time salary, and receives them from the Internet web server. Register as a native speaker member (S510), download and install the relevant program, input initial information such as gender, age, education, language skills, hobbies, special skills of the native speaker, and the relevant country, access time zone (S520), The contract is terminated when the membership registration process is completed by discussing contract terms such as part-time compensation (S530).

In particular, if a certain contract period (for example, one month) has elapsed and the user's language learning has been achieved to some extent, the user and the native speaker may have a continuous relationship. If native speakers are required, new costs can be paid.

The helper registers as a helper member in a web server of the Internet (S610), inputs information such as language and access time desired by the helper (S620), and a user who wishes to study a language has difficulty in conversation with a native speaker from the beginning. In order to solve the problem to test the level of the language selected by the helper and store the result, the administrator who installs and operates the system of the present invention for reference when assigning a suitable helper to the user (S630), the registration process When the operation is completed (S640).

The method of paying the above costs can be paid using existing methods such as internet banking or electronic payment.

7 is a flowchart illustrating a real-time conversation method with a native speaker according to an embodiment of the present invention.

Referring to FIG. 7 in more detail, the user accesses the web server of the Internet using the user's terminal for a dialogue with a native speaker with or without a helper at a designated time (S700).

When the user accesses the user through the user authentication step to confirm that the web server member (S710), and if the helper is requested through the step of setting the request of the helper (S720) and connected with the helper assigned in advance (S730) If the native speaker of the country set in advance at the specified time waiting for access to the native speaker (S740), the user is in real-time with the video and voice to the native speaker (S750). If it does not request the helper, the user does not go through the connection step with the helper immediately connected to a preset native speaker (S740) and performs a real time conversation (S750). If necessary, the user may display the text on the screen using a native speaker or a helper and a keyboard during a real-time conversation. When the conversation between the user and the native speaker elapses for a predetermined time, the user is notified of the termination and the conversation between them is terminated (S760).

Although the preferred embodiment of the present invention has been described above, the present invention may use various changes, modifications, and equivalents. It is clear that the present invention can be applied to the same embodiment by appropriately modifying the embodiment, for example, through a mobile phone system. Accordingly, the above description does not limit the scope of the invention as defined by the limitations of the following claims.

As described above, the present invention provides a real-time language learning system and method using a P2P-based Internet image camera, and a plurality of clients wishing to study a language connect to a service provider's web server via the Internet and register according to a predetermined form. After the application, the service provider combines the native database of the client database where the client's information is registered to form an optimal group of 1: 1 native clients and native speakers. Real-time companionship is made by the image information displayed on the computer terminal equipped with and the audio information through the speaker, because the conversation is made while watching the other party in real time, not only limited by time and space, but also by agreement Or talk time No adjustment is possible because there is an effect that meet and speak with the actual foreign friends.

1 is a view showing a schematic configuration of an entire system according to an embodiment of the present invention.

2 is a block diagram of a user terminal according to an exemplary embodiment of the present invention.

3 is a block diagram of a web server according to an embodiment of the present invention.

4, 5, and 6 are flowcharts illustrating a member registration process of a user, a native speaker, and a helper for a real-time conversation with a native speaker according to an exemplary embodiment of the present invention.

7 is a flowchart illustrating a real-time conversation method with a native speaker according to an embodiment of the present invention.

*** Explanation of symbols for main parts of drawing ***

100: user terminal 110: image input means

120: voice input and output means 131: image recognition module

132: image output module 133: voice recognition module

134: voice output module 135: text processing module

140: main module 160: D / B management module

170: networking module 171: synchronization module

172: group management module 180: user D / B

190: conversation D / B 200: a native speaker

300: helper terminal 400: Internet

500: web server 510: networking module

520: Main module 530: Membership management module

540: D / B management module 550: Customer D / B

Claims (8)

In the system that uses the video camera and P2P function of the Internet to service the user who wants to study the language while talking directly with the native speaker of the country that speaks the language, Equipped with an image input means for recording and transmitting the user and the native speaker in real time and a voice input and output means for receiving and outputting the conversation between the user and the native speaker in real time, and supports the P2P function and supports the image and voice Is equipped with a program for real-time processing, and comprises a user D / B for storing and providing user information for authenticating the user in a user terminal and information related to a native speaker, and a group including one-to-one or a helper of the user and a native speaker. A user terminal further comprising a conversation D / B for providing and managing the generated image and voice conversation information; Supporting the P2P function, the customer D / B to store and provide a database of the information of the user and the native information and helper information, and related information to perform the function of the P2P server capable of real-time conversation between the user and the native speaker Web server further comprises a program for providing a variety of learning services using; Real-time language learning system using an image camera comprising a. The method of claim 1, The image input means is a general image camera mounted on a computer, a real-time language learning system using an image camera, characterized in that using an image camera of more than 300,000 pixels of CCD and CMOS methods. The method of claim 1, The program mounted on the user terminal An image recognition module for converting and processing images of a user and a native speaker photographed through the image input means into digital data that can be recognized by a computer; An image output module for displaying images of a user and a native speaker photographed through the image input means on a user terminal; A voice recognition module for converting and processing voice conversations between a user and a native speaker inputted through the voice input / output means into digital data that can be recognized by a computer; A voice output module for outputting a voice conversation between the user and the native speaker inputted through the voice input / output means to the user and the native speaker as voice using a user terminal; A text module which the user and a native speaker display on the user terminal as text using a keyboard or the like; Manage the P2P function by selectively controlling the video, voice, and text of the user and the native speaker (including the case when the helper participates), converting to streaming to enable real-time conversation while maintaining synchronization, and various according to language learning A main control module providing a function; A networking module for transmitting the streamed information using the Internet so that the main control module can communicate in real time; A synchronization module for synchronizing the conversation between the user and the native speaker using the image camera of the Internet; A group management module configured to control and manage the user so as to configure a group so that a user can simultaneously attempt to communicate with a native speaker of the corresponding country; A D / B management module for managing a conversation D / B with a user D / B of the user terminal; Real-time language learning system using a video camera that further comprises. The method of claim 1, The program provided by the web server A networking module configured to manage a P2P group in which the user and the native speaker or helper participate; A main control module for registering a user initially accessing the Internet, providing various information related to learning, and providing a helper if necessary so that the user and a native speaker can communicate in real time; A member management module which receives and registers information of a user accessing the Internet, and registers and manages information of a user and a native speaker required for P2P; A D / B management module that stores information of a user and a native speaker registered as the member, information of a helper selectively required for a conversation, and processes authentication of a user and a native speaker who participate in the conversation; Real-time language learning system using a video camera that further comprises. In a method of providing a user who wishes to study a language by using a video camera of the Internet to have a natural conversation with a native speaker of a country using the language. (a) accessing a web server of the Internet using a user's terminal for a conversation with a native speaker at the designated time; (b) a user authentication step of confirming that the user is a member of a web server; (c) setting whether to request a helper; (d) contacting a pre-assigned helper when requesting a helper; (e) accessing a preset native speaker at a designated time; (f) the user conducting a real-time conversation with the native speaker by video and audio; (e) terminating a real-time conversation between the user and a native speaker; Real-time language learning method using an image camera comprising a. The method of claim 5, Step (a) is Registering the user as a learning member by accessing the web server; Downloading and installing a program necessary for language learning to a user terminal, and inputting initial information; Confirming, by the user, whether a helper is requested; Setting a desired helper when the user requests a helper; Setting a native speaker of the desired country of the user; Terminating when the membership registration process is completed; Real-time language learning method using an image camera, characterized in that it further comprises. The method of claim 5, Step (a) is The native speaker accessing a web server and registering as a member; Downloading and installing a program required for language learning by a native speaker by the native speaker, and inputting initial information; Negotiating the contract terms with the native speaker of the web server; Terminating when the membership registration process is completed; Implementation using a video camera characterized in that it further comprises a language learning method. The method of claim 5, Step (a) is The helper accessing a web server and registering as a member; Inputting time zone and initial information accessible by the helper; Selecting a desired language by the helper to test a language level; Terminating when the membership registration process is completed; Real-time language learning method using an image camera, characterized in that it further comprises.