KR101554619B1 - System and method for learning language using touch screen - Google Patents

Abstract

The present invention relates to language learning using a touch screen, and various types of Hangul learning are performed according to a touch occurrence pattern. More particularly, the present invention relates to a method and apparatus for sensing a touch of a user, analyzing a user's touch generation pattern and touch space information, selecting a learning function according to a user's touch generation pattern and touch space information, Searching for learning data corresponding to the touch space information, and providing the retrieved learning data to the user as a voice output or a screen output, and a method of learning the language using the touch screen Learning system. It is possible to improve the efficiency of Hangul learning by allowing the learners to learn Korean language unit, word unit, word unit, sentence unit by simple and easy touch screen interface to Korean and foreign people who want to learn Korean language. do.

Description

[0001] The present invention relates to a language learning system and a language learning method using a touch screen,

The present invention relates to language learning using a touch screen, and allows various types of Hangul learning to be performed according to a touch occurrence pattern. In learning Hangul, the learning information is stored in the database in units of Hangul, word (word), word (spacing) unit, and sentence. The learning information is retrieved from the learning information database And extract and provide them.

Generally, a multimedia learning apparatus is a device that visually displays language learning image data to be learned by a learner through an LCD screen (or a touch screen), and at the same time audibly outputs speech data for language learning through a speaker or an audio device to be. Therefore, even if the learner does not carry a separate textbook, the learner learning data to be learned can be audibly and visually provided through the multimedia learning apparatus.

Conventionally, a sentence-based foreign language learning system utilizing a processing screen has been disclosed (Korean Patent Publication No. 10-2010-0129455). In this conventional technology, it is possible to express the unknown word or idiom in the sentence by using the electronic response method using the touch screen while enabling the sentence learning of English. However, in this conventional technique, when touching any word in an English sentence, only the touch time is discriminated and a voice of native pronunciation is outputted, or only the dictionary meaning is displayed.

In order to accurately learn Hangul, it is necessary to have a way to study Hangul's word unit, word unit, spelling unit and sentence unit comprehensively and effectively.

For example, in the sentence "Ahn Jung-geun desperately wishes independence of Korea", "Ahn Jung-geun", "Korea", "independence", "passion", "hope" correspond to vocabulary morpheme, It can be a target. From the standpoint of learning Hangul, in order to understand the sentence in the above example, the vocabulary (vocabulary) is extracted from the words "Ahn Jung-geun", "Korea", "independence", "eagerly" Words).

On the other hand, learning from phonetic point of view is necessary considering phonetic phenomenon in the word. In phonetics, the phonetic rules of the Hangul (palatalization, assimilation, tense, etc.) are applied to the pronunciation, which is different from when the individual characters are pronounced individually. For example, if we look at the case of "independence" in the example sentence, each letter sounds individually with "poison", "lip", "urn", cognition (word) "And the verse sounds" Dong Nibble ". In other words, in the above example, when we look at the word "lip" in a word, the individual letter sounds are "lip" and the sound in the word is "nip" Pronounced. Therefore, for effective Hangul learning, it is required to learn phonetic learning of a word, pronunciation learning in a word, and pronunciation learning in a word.

However, there is still not sufficient content in the Korean language learning system to which the touch interface technology has been applied properly, and there is no Korean language learning device utilizing the touch screen based touch tester technology.

SUMMARY OF THE INVENTION In view of the above-described conventional problems, the present invention has been made in view of the above circumstances, and an object of the present invention is to provide a method and apparatus for learning in a Korean language by using a touch screen such that learning is performed in units of a word unit, a word unit, a spacing unit, And to provide a language learning system and a learning method that utilize a touch screen for simple and easy learning of Korean language.

In addition, the present invention provides a separate database so that learning is performed reflecting the phonological phenomenon and intonation of Hangul in the unit of word, unit of word, unit of word, unit of sentence, and sentence unit, so that correct Hangul pronunciation .

In addition, the present invention has a dictionary function that is essential for language learning so that words can be quickly and accurately learned, and in the case of a sentence, foreigners can understand the meaning of a sentence quickly and clearly by providing a translation function The present invention provides a language learning system and a learning method using a touch screen.

According to an embodiment of the present invention, there is provided an electronic language learning system including a touch screen, Analyzing a user touch generation pattern and touch space information; Selecting a learning function according to a user touch generation pattern and touch space information; Retrieving learning data corresponding to the touch space information from a learning DB according to the selected learning function; And providing the searched learning data to a user as a voice output or a screen output. The present invention provides a method of learning a language using a touch screen.

According to another aspect of the present invention, there is provided a touch screen module having a touch screen; A touch pattern recognition unit for classifying the touch input inputted by a user as a touch generation pattern and touch space information; A learning database (DB) storing language learning data; A character output unit for outputting the learning text data to the touch screen; An audio output unit for audio output of learning audio data; A touch generating unit for inputting the touch generation pattern and the touch space information recognized by the touch pattern recognizing unit and selecting a corresponding learning DB in the learning database according to the learning function, And a control unit for searching at least one of the data and the learning text data and providing the retrieved learning data as learning data.

The present invention can improve the efficiency of Hangul learning by allowing the learners to learn not only Korean people but also foreigners through a touch screen interface in a simple and easy manner by word unit, word unit, word unit, and sentence unit, .

In addition, it enables to learn the phonological phenomenon and intonation of Hangul through the separate voice database in word unit, word unit and sentence unit learning, and provides the function of translating the meaning of words and sentences in the sentence, .

1 is a block diagram illustrating a language learning system using a touch screen according to an embodiment of the present invention.
2 is a flowchart illustrating a language learning method using a touch screen according to an embodiment of the present invention.
3 is a diagram illustrating a syllable learning function according to an embodiment of the present invention.
4 is a diagram of a word learning function according to an embodiment of the present invention.
5 is a diagram illustrating a word learning function according to an embodiment of the present invention.
6 is a diagram of a sentence learning function according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. In order to facilitate a thorough understanding of the present invention, the same reference numerals are used for the same means regardless of the number of the drawings.

FIG. 1 is a block diagram of a language learning system using a touch screen according to an embodiment of the present invention. Referring to FIG. 1, a touch screen module 11 having a touch screen 11 for displaying sentences, pictures, A touch pattern recognition unit 20 for recognizing a touch generation pattern and touch space information by analyzing a state touched by a user on the screen of the touch screen, The touch generating pattern and the touch space information are received and the corresponding learning DB is selected in the learning DB 40 according to the learning function and at least one of the voice data and the text data matched to the corresponding touch space information in the corresponding learning DB according to the learning function (30) for providing learning data to the touch screen (11) in accordance with an execution command of the control section (30) (50) for outputting the learning text data so as to be distinguished from other texts and outputting the learning learning data in the same manner as the overlay or overlay of the learning data in accordance with the execution instruction of the control unit (30) And an audio output unit 60 for outputting audio data.

The touch screen module 10 includes a touch screen 11 for displaying a learning screen, a touch sensor 12 for recognizing a touch of a user, and a controller for switching a touch time and a touch to coordinates, And a controller (13) for recognizing the user.

The touch pattern recognition unit 20 recognizes the touch generation pattern and the touch space information by combining the touch time, the number of touches, the touch type, the touch position, and the touch region information provided by the controller 13 of the touch screen module. For example, a short-touch or long-touch is distinguished according to the touch time, and one touch or two-touch is distinguished according to the number of touches . The touch type distinguishes whether it is a simple touch or a drag, and in the case of a drag, it distinguishes which area range is a drag. In the case of simple touch, the touch position information is extracted. In case of drag, the touch region is recognized by extracting position information of the drag region.

The learning DB 40 includes a syllable DB 41, a word DB 42, a word DB 43, and a sentence DB 44. The learning DB 40 is composed of a plurality of DBs instead of one DB. The learning of Hangul is based on a phonological phenomenon and an intonation in a sentence. The pronunciation of a syllable (word), the pronunciation of a word, the pronunciation of a word, So that the learning is performed according to the input of the interface of the user's touch screen.

The syllable DB 41 comprises a recorded voice DB of each syllable to be used for syllable learning.

The word DB 32 comprises a voice DB recorded in units of words to be used for word learning and a dictionary text DB for providing a dictionary function. Here, the dictionary text DB to be provided with the dictionary function is not a dictionary including all the general dictionaries, but a dictionary text DB storing only the meaning of the words used in the learning. In addition, the dictionary text DB can be, for example, a Korean-English dictionary, a Korean-Japanese dictionary, a Han-Chinese dictionary, or a Vietnamese dictionary for foreigners as well as a Hangul dictionary. A dictionary text database for understanding the meaning of words in Hangul learning is selected by user's setting in one of several dictionaries such as Korean dictionary, Korean-English dictionary, Korean-Japanese dictionary, Korean-Chinese dictionary and so on. The dictionary text DB may have all available dictionary text DBs, but only the dictionary text databases selected by the user may be selectively downloaded or selected in order to reduce the storage space of unnecessary dictionary text DBs.

The word DB 33 is made up of a voice DB recorded in units of words to be used for word learning.

The sentence DB 34 is composed of a voice DB and a translated text DB recorded in sentence units to be used for sentence learning. English translation text, Japanese translation text, Chinese translation text, and Vietnamese translation text for providing a translation function according to the user's selection, and is selected by the user's setting. However, in order to reduce the storage space of the unnecessary translation text DB, only the translation text DB selected by the user selection may be selectively downloaded or selected and provided.

Among the dictionary DBs of the word DB and the translated text DB among the sentence DB, the present invention is intended to provide Korean language learning to foreigners as well as native Koreans who want to learn Korean language. Therefore, It is. This allows foreigners who are not accustomed to Hangul to clearly understand their meaning through dictionary and translation functions, and also to make it possible for Koreans to learn other foreign languages.

An operation method of the language learning system using the touch screen having such a configuration will now be described with reference to FIG.

With the setting screen of the touch screen 11 being displayed, the learner selects the language to be used for the dictionary function and the language to be used for the translation function. Accordingly, the language to be used in the Hangul learning and the language of the translation function are selected in advance (not shown).

First, when a user touches the touch screen 11 on the touch screen screen in a state where sentences to be learned are displayed on the touch screen screen in step S201, when the user generates an event, the touch of the user is sensed.

In step S202, the sensed user's touch analyzes the touch generation pattern and the touch space information by analyzing the touch type, the touch time, the drag direction, the touch position, and the touch area information. The touch type distinguishes whether it is a simple touch or a drag, and in the case of a drag, it distinguishes which area range is a drag. It distinguishes between short-touch and long-touch depending on the touch time, and distinguishes whether the movement is from right to left or from left to right according to the drag direction. In the case of simple touch, the touch position information is extracted. In case of drag, the touch region is recognized by extracting position information of the drag region.

We want to classify the touch generation pattern based on the touch type, touch time, drag direction, touch area, and so on. In the embodiment of the present invention, the touch generation pattern is classified as shown in [Table 1] below based on the touch type, touch time, drag direction, and touch area information. The embodiment of the present invention is only one possible embodiment, and various Hangul learning functions according to a touch pattern can be combined, so that the present invention is not limited to the embodiments.

Touch type Touch area  Touch time Drag direction Touch generation pattern Simple touch One short - Pattern 1 In Chinese language long - Pattern 2  drag More than one Chinese language   - - Pattern 3 Sentence or line   - Left -> Right Pattern 4 Right -> Left Pattern 5

Also, according to the touch generation pattern, touch space information is recognized as shown in [Table 2].

Touch type Touch generation pattern Touch space information Simple touch Pattern 1 The syllable position Pattern 2 Corresponding word location  drag Pattern 3 The corresponding phrase area (beginning phrase to end phrase) Pattern 4 The sentence area or its line Pattern 5 The sentence area or its line

When the simple touch is performed, the position information of the touched coordinates is utilized. When a simple touch and a short-touch are performed once or twice (pattern 1), a certain syllable (syllable) is used in order to utilize the touch space information in syllable units And extracts the position information of the syllable. Here, in the case of the pattern 1, in the case of a short-touch, it may be distinguishable from a long-touch in one stroke. However, in order to clearly distinguish the long-touch from the long-touch, It may be necessary to clarify. On the other hand, in order to classify the long touch (pattern 2) as being for word learning, it is determined which word in the word is used to utilize the touch space information in the unit of the word, .

When the touch type is drag, the touch area is recognized by extracting the position information of the drag area. Here, the area of the drag is recognized in Chinese characters when a word (syllable unit) is exceeded in a Chinese phrase. When dragging is performed, the drag operation extracts the touch area information by determining which word is used to start from which word and which word is used to utilize the touch space information in the unit of the word. In other words, if dragging is performed over a single word and all the phrases of one character or all of the phrases in one line are not selected (pattern 3), the phrase from the start word to the end of the drag word Is selected as the area information of the corresponding word. On the other hand, when all the phrases in one sentence or all the phrases in a line are selected (patterns 4 and 5) by the action of the drag, the sentence area or the entire line The phrases are selected as the area information of the sentence or line.

In step S203, the learning function is selected according to the touch generation pattern.

If the syllable DB 41 is selected as the syllable learning function, the syllable DB 41 is selected as the syllable learning function when the short touch (short-touch) indicating simple syllable is performed once or twice (pattern 1) .

When a long touch (pattern 2) indicating a simple word and a word is performed, the word DB 42 of the learning DB 40 is selected for the word learning function.

When all the phrases of one character or all the phrases of one line are not selected (pattern 3), the dragon is selected for the phrase learning function, and the word DB 43 of the learning DB 40 ) Is selected.

In the case where all the phrases in one sentence or all the phrases in one line are selected (patterns 4 and 5) by the drag operation, the phrase DB 44 ) Is selected. Here, pattern 4, in which the direction of the drag is progressing from left to right, is a simple sentence learning function, and a pattern translation function is performed in the pattern 5 in which the progress direction of the drag is from the right to the left.

Touch type Touch generation pattern Learning function Simple touch Pattern 1 Syllable learning Pattern 2 Word learning  drag Pattern 3 Word-of-mouth learning Pattern 4 Simple sentence learning Pattern 5 Sentence translation function

In step S204, data to be learned in the learning DB according to the learning function selected in S203 is searched in the learning DB according to the touch generation pattern in S202, and at least one of the voice data and the text data matched with the corresponding touch space information is searched .

In step S205, the learning text data among the learning data extracted according to the learning function is output to the touch screen 11 in the same manner as overlay, or the extracted learning text data is displayed so as to be distinguished from other texts. And the learning audio data is output by voice so that the user can proceed the learning.

The syllable learning function, the word learning function, the word learning function, and the sentence learning function of the language learning method using the touch screen having the above-described configuration will be described with reference to FIG. 3 to FIG.

3 is a diagram showing the function of syllable learning. The user touches a syllable "syllable" on the touch screen screen twice with a short touch. 2, the touch generating pattern corresponds to the pattern 1, whereby the position information of the syllable of "positive" is recognized as the touch space information, the syllable learning function is performed, A text "pure" is displayed on the touch screen 11 through the character output unit 50 so as to be distinguishable. The way to display the distinction status may be that the color of the text changes, or the size of the text changes.

4 is a diagram showing the function of word learning. The user has touched one word section "bad" on the touch screen screen for a long time. As shown in Fig. 2, the touch generation pattern corresponds to the pattern 2, whereby the position information of the "bad" word is recognized as the touch space information and the word learning function is performed. In the learning of the word, the main word and the dictionary meaning of the main word are displayed on the touch screen screen in the same manner as the overlay on the touch screen 11 through the character output unit 50, Is a verb or an adjective, it provides a basic form. In the case of "bad ", the dictionary meaning of the word" bad "is displayed on the screen. The dictionary meaning is provided according to the language of the dictionary function set by the user, and the Korean dictionary function is provided as shown in FIG. 4 (a), and the Korean dictionary function is provided as shown in FIG. 4 (b). In addition, the sound output unit 60 may output a sound of "bad ". (not shown)

5 is a diagram showing the function of the phrase learning. The user has dragged the phrase "really" or "from the plate" on the touchscreen screen. This means that the touch generation pattern corresponds to the pattern 3 as described in Fig. 2, so that the area information of the words of "bad" or "in the dish today" is recognized as touch space information, Function is performed. The pronunciation of the words selected by dragging is cut off in the unit of the word, and the pronunciation learning is performed. In the pronunciation learning of the eulogy, the pronunciation learning of the eulogy unit to which the pronunciation rule such as the praise rule and the palatalization are applied is performed.

In the case of Fig. 5 (a) in which one word is selected, the voice output unit 60 outputs the voice "Really" Quot ;, " Today ", " Today ", and " Today in the dish "are output through the character output unit 50 Displays the progress of the text of the characters. A method of displaying the progress state may be a method in which the color of the text is changed, the size of the text is changed, or a color progress bar in which the text is distinguished may be displayed.

6 is a diagram showing the function of sentence learning. The user drags the phrase "really bad!" As a sentence in the sentence on the touchscreen screen. 2, the touch generation pattern corresponds to the pattern 4 or the pattern 5. Accordingly, the sentence of "really bad!" Or the area information of one line is recognized as the touch space information, and the selected sentence or one line The sentence learning function is performed. Sentence learning involves pronunciation rules in sentences and sentence pronunciation learning including intonation, tone, and emotion. Here, pattern 4, in which the direction of the drag is progressing from left to right, is a simple sentence learning function, and a pattern translation function is performed in the pattern 5 in which the progress direction of the drag is from the right to the left.

6A is a pattern 4 in which a simple sentence learning function is performed. In the voice output unit 60, a voice "really bad!" Is output. The voice output unit 60 is connected to the touch screen 11 via a character output unit 50 The string of "I am really bad!" Which is the sentence that I am studying is displayed according to the speed of sound output, and the text progresses to the text of learning progress. The size of the corresponding text may be changed, or the color bar may be distinguished from the corresponding text.

6B shows a pattern 5 in which a sentence translation function is performed. In the touch screen 11, a character string of "really bad ", which is a learned sentence, is displayed on the touch screen 11 through the character output unit 50, " Really Bad! "is displayed on the screen in English according to the language of the translation function set by the user in the same manner as the overlay.

Although the present invention is illustrated and exemplified only with respect to the learning of Korean language using the touch screen for the sake of convenience, the present invention is not limited thereto, and the present invention can be applied to foreign language learning such as English, Japanese, Chinese, It will be self-evident.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. It will be understood that the invention may be variously modified and changed without departing from the scope of the invention.

10: Touch screen module 11: Touch screen
12: touch sensor 13: controller
20: touch pattern recognition unit 30:
40: learning DB 41: syllable DB
42: Word DB 43: Word DB
44: sentence DB 50: character output section
60: Audio output unit

Claims (10)

In an electronic language learning system having a touch screen,
Sensing a user's touch;
Analyzing the detected user's touch to classify the touch generation pattern, analyzing the user's touch generation pattern and touch space information for recognizing the touch space information according to the classified touch generation pattern;
Selecting one of a plurality of learning functions according to the classified touch generation pattern and selecting a learning function database corresponding to a selected learning function among a learning database (DB) composed of a plurality of learning function databases;
Retrieving learning data matching the touch space information in a learning function database according to the selected learning function;
And providing the searched learning data to a user as a voice output or a screen output,
Wherein the plurality of learning functions comprise a syllable learning function, a word learning function, a word learning function, and a sentence learning function, wherein the plurality of learning function databases comprise a syllable learning database, a word learning database, a word learning database, A language learning method using a touch screen.
The method according to claim 1,
The step of analyzing the user touch generation pattern and the touch space information
Wherein the touch occurrence pattern is classified in consideration of at least one of a shape of a user's touch operation, a touch time, a drag direction, and a touch area.

delete The method according to claim 1,
Wherein the step of providing the searched learning data to the user as a voice output or a screen output includes displaying the text data to be displayed on the screen in a manner distinguishable from other texts and outputting the text data in accordance with the voice output. Learning method.
The method according to claim 1,
Wherein the step of providing the retrieved learning data to the user as a voice output or a screen output includes providing a dictionary function or a phrase translation function of the word.
A touch screen module having a touch screen;
A touch pattern recognition unit for recognizing a touch generation pattern by analyzing a touch input inputted by a user and recognizing touch space information according to the recognized touch generation pattern;
A learning database (DB) composed of a plurality of learning function databases corresponding to a plurality of learning functions;
A character output unit for outputting the learning text data to the touch screen;
An audio output unit for audio output of learning audio data;
Wherein the touch pattern recognition unit receives the touch generation pattern recognized by the touch pattern recognition unit and the recognized touch space information, selects a learning function and a learning function database according to the recognized touch generation pattern, And a control unit for searching at least one of learning speech data and learning text data matched with the information and providing the learning data as learning data,
Wherein the plurality of learning functions comprise a syllable learning function, a word learning function, a word learning function, and a sentence learning function, wherein the plurality of learning function databases comprise a syllable learning database, a word learning database, a word learning database, A language learning system that utilizes a touch screen feature.
The method according to claim 6,
Wherein the touch pattern recognizing unit classifies a touch generation pattern in consideration of at least one of a form of a touch operation of a user, a touch time, a drag direction, and a touch area.


delete The method according to claim 6,
Wherein the control unit causes the text data to be learned to be distinguished from other texts so as to be simultaneously output in accordance with the speech output.
The method according to claim 6,
Wherein the control unit includes a dictionary function of a word or a translation function of a sentence.

Images