WO2001067719A2

WO2001067719A2 - Language learning system using a telecommunication device

Info

Publication number: WO2001067719A2
Application number: PCT/KR2001/000346
Authority: WO
Inventors: Seungheon Baek
Original assignee: Seungheon Baek
Priority date: 2000-03-10
Filing date: 2001-03-07
Publication date: 2001-09-13
Also published as: AU2001241223A1; WO2001067719A3

Abstract

The present invention relates to a foreign language study system using a communication terminal unit. After the standard pronunciation data of a foreign language and the data for analyzing a pattern of phonetic signals of a user by using the standard pronunciation data are established as database in a main server, the necessary menu data for a foreign language study are provided to the communication terminal of the user when the user connects to the main server by using his communication terminal and the phonetic signals of the user are received and stored when the user pronounces a predetermined sentence or word according to the menu data provided by the main server. The main server analyzes the phonetic signals of the user and the pattern of the standard pronunciation and outputs the analyzed data of the pronunciation to the communication terminal so that the user can study a foreign language.

Description

LANGUAGE LEARNING SYSTEM USING A TELECOMMUNICATION

DEVICE

TECHNICAL FIELD The present invention relates to a language learning system, and more particularly to a language learning system using telecommunication terminals capable of recording sentences or words users directly pronounce during the language learning through communication terminals such as wire/wireless telephone, mobile phones, and so on, comparing respective users' pronunciations with preset standard pronunciations, and providing corresponding users with results.

BACKGROUND ART In general, developments in information communications fields indispensable to advanced information societies is world-widely spreading, which explosively increases the use of cellular phones, PCS phones, and so on, which enable users to make telephone communications during their traveling while conveniently carrying them, together with wire and wireless telephones which enable the users to give and take voice signals to and from other remote users.

The above portable phones provide, in their uses, functions capable of receiving various kinds of information such as weather, stocks, in addition to basic telephone communications, and of transmitting simple messages.

Further, besides the various communication terminals including the above phones, individuals make lots of efforts to enhance the most necessary foreign language speaking capabilities for improving themselves in the advanced information society.

However, since a foreign language is different from its formation process and linguistic system when compared with a local language, especially, a mother tongue, in a place where they live, there exist difficulties they can not easily acquire a foreign language. Therefore, they, the individuals, are using ways of attending academic institutions for foreign languages and the like in order to learn a foreign language.

However, since the ways of learning a foreign language in the academic institutions and the like give lots of economic burdens to individuals as well as the individuals are limited in time, a method has been proposed and used for allowing a foreign language learner to learn a foreign language through connections to a foreign language lecturer in a one-to-one basis by using the above wire and wireless phones and portable phones without directly going to the academic institutions, which has a problem in that the method is insufficient in systematically solving pronunciation matters relatively considered important in the foreign language learning.

DISCLOSURE OF THE INVENTION In order to solve the above problem, it is an object of the present invention to provide a language learning system using communication terminals in which users of communication terminals such as wire/wireless telephones, portable phones, and the like connect to a main server of supporting a language learning, recording in the server sentences or words the respective users pronounce during the language learning along with certain menus provided from the main server, comparing the pronunciations of the respective users with preset standard pronunciations, and providing the comparison results to the corresponding users, to thereby naturally carry out the language learning.

In order to achieve the above object, a language learning system using communication terminals according to the present invention comprises a wire/wireless communication network for connecting undefined plural communication lines and carrying out voice and data communications therebetween; plural communication terminals for performing communication connections with an external of supporting a language learning through the wire/wireless communication network according to users' manipulations, outputting to the external voice signals of the users who pronounce sentences or words according to menu data inputted from the external after the communication connections, and receiving from the external language learning result data according to users' pronunciations; and a main server having a database built with plural data on standard pronunciations of a foreign language, and, if the communication connections to the communication terminals are performed through the wire/wireless communication network, outputting to corresponding communication terminals the menu data for the users to carry out a language learning, and outputting data corresponding to menus the users of the corresponding communication terminal select, if the users of the corresponding communication terminals pronounce specific words or sentences, inputting and storing corresponding voice signals, graphing the stored voice signals of the users in a frequency-time domain, analyzing patterns with the standard pronunciation data, and outputting to the corresponding communication terminals language learning result data according to the pattern analysis.

In order to achieve the above object, a language learning method using communication terminals according to the present invention comprises ( 1 ) building a database with data for analyzing signal patterns of voices users pronounce through foreign language standard pronunciation data and standard pronunciation data in a main server; (2) providing to corresponding communication terminals menu data necessary for a language learning in the main server if users carry out communication connections with the main server through communication terminals; (3) inputting and storing signals of the voices the users pronounce in the main server if the users pronounce certain sentences or words according to the menu data provided from the main server; and (4) analyzing, in the main server, patterns of the voice signals the users pronounce and preset standard pronunciations, producing language learning result data as to the users' pronunciations, outputting the produced language learning result data to the corresponding communication terminals, so that the corresponding users carry out the language learning.

BRIEF DESCRIPTION OF THE DRAWINGS The above object and other advantages of the present invention will become more apparent by describing in detail a preferred embodiment thereof with reference to the attached drawings, in which:

FIG. 1 is a block diagram for schematically showing a structure of a language learning system using communication terminals according to an embodiment of the present invention;

FIG. 2 is a block diagram for showing in detail a structure of the main server 30 of FIG. 1 ;

FIG. 3 is a view for showing in detail a structure of the database 34 of FIG. 2; and FIG. 4 to FIG. 8 are views for showing in detail flows of a language learning method using communication terminals according to an embodiment of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, a language learning system using communication terminals according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram for schematically showing a structure of a language learning system using communication terminals according to an embodiment of the present invention.

As shown in FIG. 1, a wire/wireless communication network 10 includes the public switched telephone network(PSTN) and a wireless communication network for relaying portable phones, which connects communication lines between plural communication terminals 20, described later, and a main server 30 for supporting a language learning such as pronunciation corrections and the like to carry out voice and data communications therebetween.

The plural communication terminals 20 are communication devices such as wire/wireless phones, portable phones, personal digital assistants, and so on, which perform communication connections with the main server 30. described later, for supporting a language learning through the wire/wireless communication network 10 according to users' manipulations, output to the main server 30 voice signals of the users who pronounce sentences or words according to menu data inputted from the main server 30 after the communication connections, and receive from the main server 30 language learning result data according to the users' pronunciations. 5 The main server 30 has a database built with plural data on standard pronunciations of a foreign language, and, if a communication connection to a communication terminal 20 is performed through the wire/wireless communication network 10. outputs to a corresponding communication terminal 20 the menu data for a user to carry out a language learning, and outputs data corresponding to the0 menus the user of the corresponding communication terminal 20 selects.

The above main server 30, if the user of the corresponding communication terminal 20 pronounces a specific word or sentence provided from the main server 30, inputs and stores a corresponding voice signal, visualizes in graphics the stored voice signal of the user in a frequency-time domain, analyses patterns with the5 standard pronunciation data stored in advance, and outputs to the corresponding communication terminal 20 language learning result data produced according to the pattern analysis.

Further, FIG. 2 is a block diagram for showing in detail a structure of the main server 30 of FIG. 1, and FIG. 3 is a view for showing in detail a structure of o the database 34 of FIG. 2.

As shown FIG. 2 and FIG. 3, a data input unit 31 inputs an administration program necessary for operating a language learning and standard pronunciation data of plural foreign languages, and outputs the administration program to the main control unit 32 and the standard pronunciation data o the graphic conversion unit 33. 5 Further, the data input unit 31 continuously inputs various data related to the language learning such as reading comprehension of sentences, daily English, and so on, in addition to the administration program and the standard pronunciation data and outputs the inputted data to the main control unit 32 to be stored in the database 34. 0 The main control unit 32 converts the standard pronunciation data outputted from the data input unit 31 to a frequency-time domain, controls a graphic conversion unit 33, described later, to store the converted standard pronunciation data in the database 34, and controls the output of the menu data for the language learning if communication connections are carried out by the plural communication terminals 20.

Further, the main control unit 32 controls the storage of signals of voices a user of the communication terminal 20 pronounces, analyses patterns of the voice signals of the user of the communication terminal 20 and the standard pronunciation data according to the administration program inputted through the data input unit 31 while controlling the storage of the analysis result, and controls the language learning result data output of the corresponding communication terminal user.

At this time, for a pattern analysis carried out in the main control unit 32, it is preferable to use a method of superimposing graphics of the user's pronunciation and the standard pronunciation, identifying to what extent the two are different or separated, that is, a difference degree(or a separation degree), and checking a pronunciation accuracy degree. In addition, any method can be employed if it can correct user's pronunciations.

The graphic conversion unit 33 converts into a frequency-time domain the standard pronunciation data inputted through the data input unit 31 according to the control of the main control unit 32 and outputs the converted data to the database to be described later, and converts into the frequency-time domain the voice signals, which are obtained from the pronunciations of a user of the communication terminal 20. outputted from the database 34 according to the control of the main control unit 32 and outputs the converted voice signals to the main control unit 32. The database 34 stores standard pronunciation data converted in a frequency-time domain through the graphic conversion unit 33, menu data for a language learning to be provided to the plural communication terminals 20, and data as to basic items of a pattern analysis to be carried out in the main control unit 32, and stores signals of voices that each communication terminal user pronounces according to the controls of the main control unit 32 as well as language learning result data of corresponding users produced according to the pattern analysis of the main control unit 32.

At this time, the above database 34 consists of a first area 34A for storing the standard pronunciation data converted into a frequency-time domain through the graphic conversion unit 33, a second area 34B for storing the menu data for a language learning to be provided to users of the communication terminals 20 in communication connections and the data as to the basic items for the pattern analysis of the signals of the voices of communication terminal users and the standard pronunciations, a third area 34C for storing the signals of the voices the communication terminal users pronounces, and a fourth area 34D for storing the language learning result data of the corresponding users which are produced according to the pattern analysis of the main control unit 32.

Further, although not shown in figures, various data related to a language learning such as reading comprehension of sentences, daily English, and so on to be provided according to the menu selections of the communication terminal users.

The communication control unit 35, if communication connections are made to the plural communication terminals 20, outputs to a corresponding communication terminal 20 the menu data for a language learning according to the control of the main control unit 32, inputs the signals of the voices a user of the corresponding communication terminal 20 pronounces and outputs the signals to the main control unit 32, and outputs the language learning result data outputted from the main control unit 32 to the corresponding communication unit 20.

At this time, it is preferable to output documents in a text form when outputting to the corresponding communication terminal 20 the language learning result data analyzed through a comparison of the pronunciations of sentences or words done by the communication terminal user with the preset standard pronunciations for an analysis from the above main server 30. In addition, the language learning result data of the corresponding user may be converted into audio signals to be provided in voices. Further, the main server 30 outputs the language learning result data in real time or at times when the communication terminal users want, in order for each user to carry out the language learning.

Next, a detailed description will be made on operations of a language learning system using communication terminals according to an embodiment of the present invention as stated above with reference to FIG. 4 to FIG. 8.

FIG. 4 to FIG. 8 are views for showing in detail flows of a language learning method using communication terminals according to an embodiment of the present invention.

First, the main server 30 which provides a language learning such as pronunciation corrections and the like to users who use the communication terminals 20 such as portable phones and so on builds a database on basic data for analyzing signal patterns of voices users pronounce through pronunciation data which is the standard of a corresponding foreign language and standard pronunciation data(SlO). That is, the main server 30 judges if the standard pronunciation data of a foreign language is inputted by a server administrators 11), graphs the standard pronunciations of the corresponding language in a frequency-time domain, and stores the graphic standard pronunciations in the database 34(S 12).

Further, the main server 30 judges if the basic data is inputted for analyzing signal patterns of the voices users pronounce through the standard pronunciation data by the server administrators 13), and stores the corresponding pattern analysis data in the above database 34.

At this time, the basic data for analyzing the patterns stored in the above database 34 are documents coming through arrangements from data to be provided to each communication terminal user in the main server 30 in accordance with to what extent his or her pronunciations are different from the standard pronunciation data.

The main server 30, which builds a database with the standard pronunciation data and the pattern analysis data through the above step S10, provides the menu data necessary for the language learning to the corresponding communication terminal 20 if each user carries out a communication connection through the communication terminal 20(S20).

That is, if each user performs a communication connection to the main server 30 by using the communication terminal 20(S21), the main server 30 outputs certain data for a user authentication to the corresponding communication terminal 20 to which the communication connection has been made(S22).

Further, the main server 30 judges if authentication data a communication terminal user 20 inputs is inputted(S23) and if the user is an authenticated user based on the authentication data the corresponding user inputs(S24). As a result of the judgment, in case that the authenticated user, the main server 30 outputs the menu data for the language learning to the corresponding communication terminal 20(S25), and, in case that the user is not authenticated as a result of the judgment in the step S24, the main server 30 judges that the user is a new one, executes a new registration, and outputs the menu data for the language learning to the corresponding communication terminal 20(S26).

At this time, the user authentication done in the main server 30 through the steps S22 to S24 may be automatically executed with a subscriber's number of the corresponding communication terminal to which the communication connection is made. Now, if a user selects a pronunciation menu of the menu data provided to the communication terminal 20 and pronounces a certain sentence or word outputted from the main server 30, the main server 30 stores in the database 34 voice signals inputted through the corresponding communication terminal 20(S30).

That is, the main server 30 judges if the user selects the pronunciation menu of the menu data provided to the corresponding communication terminal 20(S31), and, if the user selects the pronunciation menu, outputs to the corresponding communication terminal 20 the certain sentence or word to be pronounced by the user(S32).

However, as a result of the judgment in the step S31 , if the user selects a menu other than the pronunciation menu, the main server 30 outputs language learning data according to the menu the user has selected(S33).

Further, the main server 30 judges if the user of the corresponding communication terminal 20 pronounces the certain sentence or word outputted from the main server 30(S34), inputs signals of the voices the user pronounces, and stores the signals in the database 34(S35).

Thereafter, the main server 30 analyzes the voice signals the user has pronounced and the standard pronunciation patterns built in the database 34, produces language learning result data as to the user's pronunciations, and outputs the produced language learning result data to the corresponding communication terminal 20. so that the corresponding user carries out the language learning(S40).

That is. the main control unit 32 of the main server 30 graphs the voice signals, stored in the database and obtained from the user's pronunciations of the certain sentence or word, in a frequency-time domain through the graphic conversion unit 33(S41), and extracts the standard pronunciation data of the corresponding sentence and word built in the database(34)(S42).

Further, the main server 30 compares the patterns of the user's voice signals graphed in the frequency-time domain with the patterns of the standard pronunciations extracted from the database 34 for an analysis(S43), produces and stores in the database 34 the language learning result data as to the user's pronunciations according to the pattern analysis between the user's pronunciations and the standard pronunciations(S44).

Furthermore, the main server 30 outputs to the corresponding communication terminal 20 the user's language learning result data produced according to the pattern analysis(S45), and the corresponding communication terminal 20 input the language learning result data outputted from the main server 30 so that the user confirms a voice result he or she has pronounced while learns a language by finding out the problems in pronunciations based on the language learning result data(S46).

At this time, the main server 30 provides the language learning result data to the communication terminal 20 in documents of a text form or in voice signals, and the above language learning result data is outputted to the corresponding communication terminal 20 in real time or at times the respective users wish.

As stated above, the language learning system using communication terminals according to the present invention has an advantage in that users of 5 communication terminals such as portable phones benefit from an efficient pronunciation correction effect with low costs since they easily confirms to what extent their pronunciations are close to the standard pronunciations and where their pronunciations has problems through a main server which supports a foreign language learning such as pronunciation corrections and the like regardless of ι o places and times.

Although the preferred embodiment of the present invention has been described, it will be understood by those skilled in the art that the present invention should not be limited to the described preferred embodiment, but various changes and modifications can be made within the spirit and scope of the present invention

15 as defined by the appended claims.

Claims

CLAIMS What is claimed is:

1. A language learning system using communication terminals, comprising: a wire/wireless communication network for connecting undefined plural communication lines and carrying out voice and data communications therebetween; plural communication terminals for performing communication connections with an external of supporting a language learning through the wire/wireless communication network according to users' manipulations, outputting to the external voice signals of the users who pronounce sentences or words according to menu data inputted from the external after the communication connections, and receiving from the external language learning result data according to users' pronunciations; and a main server having a database built with plural data on standard pronunciations of a foreign language, and, if the communication connections to the communication terminals are performed through the wire/wireless communication network, outputting to corresponding communication terminals the menu data for the users to carry out a language learning, and outputting data corresponding to menus the users of the corresponding communication terminal select, if the users of the corresponding communication terminals pronounce specific words or sentences, inputting and storing corresponding voice signals, graphing the stored voice signals of the users in a frequency-time domain, analyzing patterns with the standard pronunciation data, and outputting to the corresponding communication terminals language learning result data according to the pattern analysis.

2. The language learning system as claimed in claim 1, wherein the main server includes: a data input unit for inputting an administration program necessary for operating the language learning and the standard pronunciation data of plural foreign languages by a server administrator; a main control unit for converting the standard pronunciation data outputted from the data input unit in a frequency-time domain and storing the converted standard pronunciation data, outputting the menu data for the language learning if the communication connections are carried out by the plural communication terminals, storing signals of voices the users of the communication terminals pronounce, analyzing patterns of the voice signals of the users of the communication terminals and the standard pronunciation data according to the administration program inputted through the data input unit while controlling the storage of an analysis result, and controlling an output of the language learning result data of the corresponding communication terminal users; a graphic conversion unit for converting into a frequency-time domain the signals of the voices the communication terminal users pronounce and the standard pronunciation data inputted through the data input unit according to the control of the main control unit; a database for storing the standard pronunciation data converted in a frequency-time domain through the graphic conversion unit, the menu data for the language learning to be provided to the communication terminals, and data as to basic items of the pattern analysis to be carried out in the main control unit, storing the signals of the voices that each communication terminal user pronounces according to the controls of the main control unit, and storing the language learning result data of the corresponding users according to the pattern analysis of the main control unit; and a communication control unit for, if the communication connections are made to the plural communication terminals, outputting the menu data for the language learning according to the control of the main control unit, inputting and outputting to the main control unit the signals of the voices the users of the corresponding communication terminals pronounce and, and outputting the language learning result data outputted from the main control unit to the corresponding communication units.

3. The language learning system as claimed in claim 2, wherein the database includes: a first area for storing the standard pronunciation data converted into a frequency-time domain through the graphic conversion unit; a second area for storing the menu data for the language learning to be provided to users of the communication terminals in communication connections and the data as to the basic items for the pattern analysis of the signals of the voices the communication terminal users pronounce and the standard pronunciations; a third area for storing the signals of the voices the communication terminal users pronounces; and a fourth area for storing the language learning result data of the corresponding users according to the pattern analysis of the main control unit.

4. The language learning system as claimed in claim 1 or claim 2, wherein the language learning result data of the corresponding users outputted to the plural communication terminals in the main server is data written in a text form for a result obtained from comparison and analysis of the users' pronunciations of sentences or words with the preset standard pronunciations.

5. The language learning system as claimed in claim 1 or claim 2, wherein the language learning result data of the corresponding users outputted to the plural communication terminals in the main server is data converted into voices for a result obtained from comparison and analysis of the users' pronunciations of sentences or words with the preset standard pronunciations.

6. A language learning method using communication terminals, comprising:

( 1 ) building a database with data for analyzing signal patterns of voices users pronounce through foreign language standard pronunciation data and standard pronunciation data in a main server;

(2) providing to corresponding communication terminals menu data necessary for a language learning in the main server if users carry out communication connections with the main server through communication terminals;

(3) inputting and storing signals of the voices the users pronounce in the main server if the users pronounce certain sentences or words according to the menu data provided from the main server; and

(4) analyzing, in the main server, patterns of the voice signals the users pronounce and preset standard pronunciations, producing language learning result data as to the users' pronunciations, outputting the produced language learning result data to the corresponding communication terminals, so that the corresponding users carry out the language learning.

7. The language learning method as claimed in claim 1, wherein the step(l) includes:

(1-1) judging if the standard pronunciation data of a foreign language is inputted by a server administrator;

(1-2) graphing the standard pronunciations of the corresponding language in a frequency-time domain, and storing the graphic standard pronunciations in the database;

(1-3) judging if the data is inputted for analyzing signal patterns of the voices the users pronounce through the standard pronunciation data by the server administrator; and

( 1-4) storing the corresponding pattern analysis data in the above database.

8. The language learning method as claimed in claim 6, wherein the step (2) includes: (2-1) carrying out the communication connections to the main server according to manipulations of the communication terminal users;

(2-2) outputting user authentication data to the corresponding communication terminals to which the communication connections are made in the main server; (2-3) judging if the authentication data corresponding users input is inputted to the main server;

(2-4) judging if the users are authenticated based on the authentication data the corresponding users input;

(2-5) outputting the menu data for the language learning to the corresponding communication terminals if the user authentication is completed; and (2-6) judging that the users are new in case that the users are not authenticated as a result of the judgment in the step (2-4), executing new registrations, and outputting the menu data for the language learning to the corresponding communication terminals.

9. The language learning method as claimed in claim 8, wherein the user authentication executed in the main server through the steps (2-2), (2-3), and (2-4) automatically executes the user authentication with subscriber' numbers of the corresponding terminals to which the communication connections are made.

10. The language learning method as claimed in claim 6, wherein the step (3) includes:

(3-1) judging if the users select the pronunciation menu of the menu data provided in the main server;

(3-2) outputting certain sentences and words to the corresponding communication terminals in the main server if the users select the pronunciation menu;

(3-3) outputting the language learning data according to the menu the user selects in the main server if the users select a menu other than the pronunciation menu;

(3-4) judging if the corresponding communication terminal users pronounce the certain sentences or words outputted from the main server; and

(3-5) inputting the signals of the voices the users pronounce and storing the inputted voice signals.

11. The language learning method as claimed in claim 6, wherein the step(4) includes: (4-1) graphing the voice signals, stored in the database and obtained from the users' pronunciations of the certain sentences or words, in a frequency-time domain;

(4-2) extracting the standard pronunciation data of the corresponding sentences and words built in the database; (4-3) comparing and analyzing the patterns of the users' voice signals graphed in the frequency-time domain with the patterns of the standard pronunciations extracted from the database;

(4-4) producing the language learning result data as to the users' pronunciations according to the pattern analysis between the users' pronunciations and the standard pronunciations;

(4-5) outputting to the corresponding communication terminals the users' language learning result data produced; and

(4-6) inputting the language learning result data outputted from the main server to the communication terminals and correcting users' own pronunciations.