KR20230117943A - Self-directed memorization learning apparatus and method therefor - Google Patents

Abstract

A self-directed rote learning device is disclosed. According to an embodiment, the self-directed memorization learning device registers learning notes for self-directed memorization learning, recognizes text and memorization symbols set by a user for memorization in the registered learning notes, and recognizes the recognized text. The whole is converted into a voice signal and then reproduced, but the text marked with memorized symbols is repeatedly reproduced or reproduced with emphasis. Accordingly, the rote learning efficiency of the user can be improved.

Description

Self-directed memorization learning apparatus and method therefor}

The present invention relates to a data processing system or method, and more particularly, to a technology for providing audible presentation of learning material.

In foreign language learning, memorization of words or sentences is the most basic and important learning means. In addition to foreign language learning, memorization through repetition is a major learning method so far in various learning fields such as mathematical formulas, history, and law. From flash cards that strengthen short-term memory by showing images and words at the same time, there are many learning materials combined with various memory theories.

Recently, memorization apps using smartphones have also been released. When users record English words in the vocabulary provided by the app, there are vocabulary apps that allow users to repeatedly express words to apps that enable learning of more complex sentences or contents.

These memorization apps using smartphones are convenient to carry, so learning is possible anywhere, and by using the scheduling provided by the app, it provides the convenience of periodically checking and memorizing the contents to be memorized. is being used

However, despite the convenient portability of smart phones, recorded voices are supported only in some key words or sentences, and most words or sentences must be memorized by the user while viewing them as text. Therefore, in a situation where it is difficult to use a mobile phone, such as when a user is still on the move or in the middle of another task, it is not easy to learn using the sight, and the learning efficiency for memorization is reduced.

According to an embodiment, a self-directed rote learning apparatus and method capable of increasing memorization efficiency are proposed.

In particular, by using artificial intelligence-based speech synthesis technology, all learning content can be fully converted into voice and provided, and text-based learning notes can be created by individual users on their own initiative, and personalized learning is possible. We propose a self-directed memorization learning device and method that can increase the effect.

A self-directed memorization learning apparatus according to an embodiment includes a learning note registration unit for obtaining and registering learning notes that a user wants to memorize, and visual information including text and memorization symbols emphasized by the user for memorization from the registered learning notes. and a text recognition unit that recognizes. A text extraction unit for extracting text marked with recognized memorization symbols; a text-to-speech conversion unit for converting the entire extracted text into a voice signal; Include an output section.

The memorized symbol may be at least one of an underline, a square, a circle, an important mark, a fluorescent color, a boldface, an oblique font, a font change, and a text color displayed in the text.

The learning note may be a document directly prepared and input by the user through a document preparation program of a user terminal, or a document uploaded by scanning or capturing an existing document.

The text extraction unit extracts the positional information of sentences and words recognized within the text of the learning note, matches the text content of the sentence and word with the positional information of the sentence and word in the text, stores it in the storage unit, and recognizes it in the learning note. After extracting the positional information of the memorized symbols, the positional information of the memorized symbols is stored in the storage unit, and the sentences and words in the text marked with the memorized symbols can be extracted using the positional information of sentences and words and the positional information of the memorized symbols. .

The self-directed rote learning apparatus further includes an input unit for receiving user setting information for rote learning, the user setting information includes voice reproduction information, and the output unit may reproduce a voice signal according to the voice reproduction information.

The self-directed rote learning apparatus may further include an input unit for receiving user setting information for rote learning, and the user setting information may include study note sharer information for sharing study notes with a sharer.

The self-directed rote learning apparatus may further include a study note sharing unit for sharing study notes written by the user with a sharer set by the user.

The self-directed rote learning apparatus may further include a study note editing unit that provides a tool for editing study notes written by users or sharers and provides the edited study notes to a study note register.

The self-directed rote learning apparatus may further include a wordbook providing unit that generates and provides a wordbook using sentences or words of text marked with memorized symbols.

The self-directed rote learning apparatus may further include a test providing unit that displays sentences or words generated by the wordbook providing unit as blanks and provides a test for filling in the blanks according to user input for problems including blanks. there is.

When the test providing unit reproduces the sentences or words generated by the wordbook providing unit through the output unit, it may provide a blank test targeting the corresponding sentence or word.

A self-directed memorization learning method according to another embodiment includes acquiring and registering learning notes that a user wants to memorize, and recognizing visual information including text and memorization symbols emphasized by the user for memorization from the registered learning notes. Steps of extracting text marked with the recognized memorization symbol, converting the entire extracted text into a voice signal, and reproducing the converted voice, but repeating or emphasizing the text marked with the memorization symbol. do.

According to the self-directed rote learning apparatus and method according to an embodiment, by outputting the entire text of the study note as voice, the user can learn the contents of the study note using hearing. Accordingly, even when it is difficult for the user to learn visually, the efficiency of rote learning can be increased.

Furthermore, as the entire text is output as voice and sentences or words that need to be memorized among the text are output as voices according to the user's learning style, the user can more easily memorize the words or sentences that need to be memorized in a customized way. In addition, memorization learning is possible without the user touching and manipulating the user terminal and without checking words or sentences displayed on the screen. In addition, it is possible to repeatedly learn through voice even while the user is on the move with the user terminal, thereby increasing the efficiency of rote learning.

Since the user can create and edit study notes on his or her own initiative, rote learning services tailored to the individual user can be provided. Furthermore, learning efficiency of the user is increased by recognizing the memorized symbols displayed by the user and repeating or emphasizing sentences or words of the text marked with the memorized symbols and reproducing them as voices to the user.

Sentences or words marked with memorization symbols may be recognized as important sentences or important words, and a wordbook may be created and provided based on the recognized important sentences or important words. Furthermore, the user's learning efficiency can be further increased through a test method in which important sentences or important words are provided in the form of blanks.

In addition, users can share their study notes with sharers, and sharers can receive rote learning services for study notes in a user-specified way, and can be used as their own study notes through additional editing. Ease of use is improved.

1 and 2 are diagrams showing the configuration of a self-directed rote learning device according to various embodiments of the present invention;
3 is a diagram showing the configuration of a self-directed rote learning device according to an embodiment of the present invention;
4 is a diagram showing an example of extracting text marked with memorization symbols for rote learning from a learning note created by a user according to an embodiment of the present invention;
5 is a diagram showing the flow of a self-directed rote learning method according to an embodiment of the present invention;
6 is a diagram illustrating an example of learning note registration and user setting according to an embodiment of the present invention.

Advantages and features of the present invention, and methods for achieving them, will become clear with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments make the disclosure of the present invention complete, and common knowledge in the art to which the present invention belongs It is provided to fully inform the holder of the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numbers designate like elements throughout the specification.

In describing the embodiments of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted, and the terms described later will be used in the embodiments of the present invention. These terms are defined by reflecting the functions of, and may vary depending on the user's or operator's intention or custom. Therefore, the definition should be made based on the contents throughout this specification.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiments of the present invention exemplified below may be modified in many different forms, and the scope of the present invention is not limited to the embodiments described below. The embodiments of the present invention are provided to more completely explain the present invention to those skilled in the art.

1 and 2 are diagrams showing the configuration of a self-directed rote learning device according to various embodiments of the present invention.

As shown in FIG. 1, the self-directed rote learning device 1 may have a structure provided in the user terminal 2, and as shown in FIG. 2, the user terminal 2 and the management server 3 have functions. It may also be a distributed structure through the network (4). The management server 3 may be implemented in the form of a web server, database server, or proxy server. The management server 3 may include a plurality of database servers.

The user terminal 2 is a smart phone, a navigation terminal, a personal computer, a notebook computer, a tablet PC, a wearable device (for example, a watch type terminal ( Smartwatch), flexible terminal (Flexible Terminal), can be applied to various terminals such as digital signage devices.

The self-directed rote learning device 1 may install a dedicated app on the user terminal 2 . The self-directed rote learning device 1 may execute a dedicated app pre-installed in the user terminal 2 and display an app execution result screen according to the execution of the dedicated app.

The self-directed rote learning device 1 performs a membership registration process for the user of the user terminal 2 and registers personal information related to the user of the user terminal 2 . At this time, the self-directed rote learning device 1 may register and manage the corresponding personal information in the DB.

The self-directed rote learning device 1 according to an embodiment provides a self-directed rote learning service that can be led by the user himself. In order to provide a self-directed rote learning service, various technologies such as artificial intelligence (AI) technology and text to speech (TTS) technology are applied to the self-directed rote learning device 1. Remote control is also possible. Artificial intelligence technology includes technology that automatically recognizes visual information such as objects and texts from images through machine learning. Voice conversion technology includes a technology of converting recognized visual information, for example, text image, into text information, converting it into a voice signal that a user can hear, and outputting a voice. At this time, a predetermined speech synthesis model may be selected from among a plurality of speech synthesis models, and text may be reproduced with the voice of the selected speech synthesis model. The remote control includes a technique in which the user terminal 2 receives remote control from the management server 3 connected through the network 4 and the management server 3 monitors the user terminal 2 .

The self-directed memorization learning device 1 provides a self-directed rote learning service that completely converts a user's learning notes into speech by applying artificial intelligence-based speech conversion technology and provides the result to the user. By using artificial intelligence voice synthesis technology to completely reproduce all study notes as voices, users can memorize effectively.

The self-directed rote learning device 1 registers study notes for self-directed rote learning. In addition, the entire text is recognized in the registered learning note, and the recognized text is converted into a voice signal and reproduced. At this time, the self-directed rote learning apparatus 1 emphasizes or repeatedly reproduces the text marked with the rote symbol designated by the user for memorization. For example, text marked with memorization symbols can be repeatedly reproduced, the voice volume increased, or reproduced with a different voice. The emphasis or repetition type can be set by the user.

Hereinafter, the detailed configuration of the self-directed rote learning device 1 having the above-described characteristics will be described later.

3 is a diagram showing the configuration of a self-directed rote learning device according to an embodiment of the present invention.

Referring to FIG. 3 , the self-directed rote learning device 1 includes a processor 10, an input unit 20, an output unit 30, and a storage unit 40. The processor 10 includes a learning note registration unit 11, a text recognition unit 12, a text extraction unit 13, a text-to-speech conversion unit 14, a learning note sharing unit 15, a learning note editing unit 16, and a word book. A provision unit 17 and a test provision unit 18 may be included.

The learning note registration unit 11 acquires learning notes that the user wants to memorize from the user terminal 2 , registers them, and stores them in the storage unit 40 . The learning note may be a document directly created and input by the user through a document preparation program of the user terminal 2, or may be a document uploaded by scanning or capturing an existing document. The types of study notes are not particularly limited, and are reference books and textbooks necessary for the user's learning, textbooks and exam books necessary for various qualification tests, entrance exams and employment tests, and national exams, workbooks, foreign language textbooks and grammar books that require a high proportion of memorization by examinees. , history books, English books, and the like.

The text recognition unit 12 recognizes time information from registered learning notes. Visual information includes text and images. Text includes sentences or words. At this time, the text recognition unit 12 recognizes the memorization symbol set by the user for memorization. The memorized symbol may be at least one of an underline, a square, a circle, an important mark, a fluorescent color, a boldface, an oblique font, a font change, and a text color displayed in the text. Important marks include an asterisk, a billiard table, and a check mark. At this time, the text recognition unit 12 may obtain location information of memorized symbols.

The user can display memorization symbols such as underlines, squares, circles, important marks, fluorescent colors, boldfaces, italics, font changes, and text colors on predetermined sentences or words in the learning note. The text recognition unit 12 memorizes this Sentences or words marked with symbols may be determined as important sentences or important words to be memorized by the user.

If the registered learning notes are scanned or captured image files, the text recognition unit 12 provides an optical character reader (OCR) function in consideration of the user's convenience when editing learning notes and voice conversion when outputting audio. After converting an image file to a text file format, text can be recognized in a text file.

The text extraction unit 13 extracts text recognized through the text recognition unit 12 . The text extractor 13 extracts the positional information of sentences and words recognized in the text of the study note, and then stores the information in the storage unit 40 by matching the text contents of the sentences and words with the positional information of the sentences and words in the text. can be saved In addition, the text extractor 13 may extract the type and location information of the memorized symbol recognized through the text recognition unit 12 from the learning note, match the type and location information of the memorized symbol, and store the information in the storage unit 40. there is. Subsequently, the text extractor 13 may extract sentences and words from the text in which the memorized symbols are displayed using location information of sentences and words and location information of memorized symbols.

The text extractor 13 may extract important words from words presented in the text recognized by the text recognizer 12 . The text extraction unit 13 may extract sentences or words of the text marked with memorization symbols as important words, the user may directly set important words in the text, and the frequency of use, importance, age of the user, learning The text extracting unit 13 may automatically extract important words in consideration of ability or the like.

The text-to-speech conversion unit 14 converts the entire text extracted through the text extraction unit 13 into a voice signal. The text-to-speech conversion unit 14 analyzes the morphemes of the text using speech synthesis technology, converts them into phoneme units, models the optimal prosody, and selects the optimal speech synthesis model among them by utilizing the recorded speech synthesis model DB. and convert it into a specific voice (for example, the voice of a person preferred by the user, such as female and male tones, celebrities or voice actors).

The output unit 30 reproduces the voice signal converted through the text-to-speech converter 14 for memorization and learning by the user. Accordingly, all texts of the study notes can be reproduced and output as voices. The user can perform memorization learning while listening to the contents of the learning note output as a voice, so that memorization learning can be performed more efficiently and conveniently.

When the output unit 30 reproduces the entire text as voice, the text marked with the encryption symbol can be repeated as many times as the number of repetitions set by the user or can be reproduced with emphasis in an emphasizing method set by the user.

As another embodiment of the present invention, the self-directed rote learning device 1 can display the text of the learning note through the screen of the output unit 30 and output it as a voice through the speaker of the output unit 30 at the same time. there is. This method is a method that can greatly improve rote learning efficiency compared to using only sight or hearing separately.

The input unit 20 receives user setting information for rote learning.

The user setting information may include voice reproduction information for sentences or words in text. The voice reproduction information may include the number of repetitions, reproduction time, reproduction section, emphasis information, etc. of a corresponding sentence or word. The emphasis information may be information for increasing the volume of a voice when reproducing a corresponding sentence or word or reproducing a different voice. The output unit 30 may reproduce sentences or words according to the set number of repetitions, reproduction time, reproduction period, and emphasis information.

The user setting information may include learning note sharer information. In this case, the input unit 20 may additionally set a sharer to share the study note created by the user. Accordingly, it is possible to share study notes created by users among users, and the shared study notes can be edited to suit one's own needs.

The user setting information may include memorized symbols to be recognized by the text recognition unit 12 for rote learning. In this case, the input unit 20 may set memorized symbols to be recognized by the text recognition unit 12 for rote learning according to the user. For example, fluorescent colors, underlines, and text colors are not limited to specific colors, but may be set to colors requested by the user.

User setting through the input unit 20 may be performed before or after providing rote learning, or may be performed during rote learning. For example, user settings may be performed using icons on the screen of the user terminal, screen touches, motion recognition, and the like during user rote learning.

The learning note sharing unit 15 shares the learning note created by the user with a sharer. The user can share his or her study notes with a sharer, and the sharer can receive rote learning services in a manner written by the user.

The learning note editing unit 16 provides a tool for editing learning notes created by users or sharers, and provides and registers the edited learning notes to the learning note registration unit 11 . The sharer can additionally edit the user's study notes and use them as their own study notes. Users or sharers can add, delete, or change sentences or words to be memorized in the study notes. Accordingly, it is possible to configure study notes in a personalized manner.

The wordbook providing unit 17 creates and provides a wordbook using sentences or words of text marked with memorized symbols.

The test providing unit 18 may provide a test to improve rote learning of the user. The test providing unit 18 may display sentences or words generated by the wordbook providing unit 17 as blank cells and provide a test for filling in blank cells according to a user input for a problem including blank words.

For example, the test provider 18 She felt jaded and in need of emotional uplift. When there is a sentence, present the problem passage as "She was fed up and needed emotional encouragement." She felt ( ) and in need of emotional ( ). By presenting a problem containing blank spaces, such as, the user fills in the appropriate words in the blank spaces, so that the user additionally memorizes the entire sentence. The test providing unit 18 may automatically generate problems for a test to fill in blanks, and the user may create problems together when the user makes a study note.

When reproducing the sentences or words generated by the wordbook providing unit 17 through the output unit 30, the test providing unit 18 may provide a blank test for the corresponding sentence or word.

4 is a diagram illustrating an example of extracting text marked with memorization symbols for rote learning from a learning note created by a user according to an embodiment of the present invention.

Referring to FIGS. 3 and 4 , the self-directed rote learning device 1 obtains location information 41 of words included in text in a user's learning notes 40 such as textbooks, books, and reference books.

In addition, the self-directed rote learning device 1 recognizes a memorized symbol whose main part is underlined 400 or marked with a square 410, and obtains location information 42 for the recognized memorized symbol.

Subsequently, the self-directed rote learning apparatus 1 determines sentences and words in which the location of the memorization symbol indicated by the user is displayed among words included in the text as important sentences and important words 43 that need to be memorized.

5 is a diagram illustrating the flow of a self-directed rote learning method according to an embodiment of the present invention.

Referring to FIGS. 3 and 5 , the self-directed rote learning device 1 acquires and registers study notes that the user wants to memorize (510). The learning note may be a document directly created and input by the user through a document preparation program of the user terminal, or a document uploaded by scanning or capturing an existing document.

Next, the self-directed rote learning device 1 recognizes visual information including text and memorization symbols set by the user for memorization from the registered study notes (520). The memorized symbol may be at least one of an underline, a square, a circle, an important mark, a fluorescent color, a boldface, an oblique font, a font change, and a text color displayed in the text.

Next, the self-directed rote learning apparatus 1 extracts text (530). In this case, the self-directed rote learning apparatus 1 may extract sentences or words from texts marked with memorized symbols using location information of sentences or words in the text and location information of memorized symbols.

Subsequently, the self-directed rote learning apparatus 1 converts the entire extracted text into a voice signal (540).

Subsequently, the self-directed rote learning apparatus 1 reproduces the converted voice, and repeatedly or emphasizes the text displayed with the memorization symbol (550).

Furthermore, the self-directed rote learning device 1 may receive user setting information for rote learning. At this time, the user setting information includes voice reproduction information, and in the voice reproduction step 550, a voice signal may be reproduced according to the voice reproduction information. The voice reproduction information may include the number of repetitions, reproduction time, reproduction section, emphasis information, etc. of a corresponding sentence or word. The emphasis information may be information for increasing the volume of a voice when reproducing a corresponding sentence or word or reproducing a different voice.

The user setting information may include learning note sharer information for sharing the learning note with the sharer. In this case, the self-directed rote learning device 1 may share the user-created study note with a sharer set by the user.

The self-directed rote learning device 1 provides a tool for editing study notes written by users or sharers, registers the edited study notes, and can use them for rote learning.

Furthermore, the self-directed rote learning apparatus 1 may generate and provide a wordbook using sentences or words of text in which memorized symbols are displayed. Furthermore, the self-directed rote learning apparatus 1 may display sentences or words generated by the wordbook as blank spaces and provide a test for filling in blank spaces according to user input for problems including blank spaces. In this case, when the self-directed rote learning apparatus 1 reproduces the sentences or words generated by the wordbook, a blank test may be provided for the corresponding sentence or word.

6 is a diagram illustrating an example of learning note registration and user setting according to an embodiment of the present invention.

Referring to FIGS. 3 and 6 , the self-directed memorization learning device 1 acquires a learning note that the user wants to memorize, determines whether the obtained learning note is a paper learning note (600), and scans it if it is a paper learning note. Or capture and upload (602). On the other hand, if it is not a paper learning note, it is determined as a learning note directly created by the user through a document writing program (604).

Subsequently, the self-directed rote learning device 1 recognizes text including sentences and words from the scanned or captured learning notes or the learning notes created through the document writing program (606), and recognizes sentences and words in the recognized text. The text contents and location information 607 of are extracted and stored. In addition, a memorization symbol for memorization is recognized in the learning note (608), and type and location information (609) of the recognized memorization symbol are extracted and stored.

Subsequently, the self-directed rote learning apparatus 1 extracts sentences and words from the text in which the memorized symbols are displayed using location information of sentences and words and location information of memorized symbols (610).

Next, the self-directed rote learning device 1 receives user setting information for rote learning (612). For example, voice reproduction information may be set, and study note sharer information for sharing the study note with the sharer may be set.

So far, the present invention has been looked at mainly by its embodiments. Those skilled in the art to which the present invention pertains will be able to understand that the present invention may be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered from a descriptive point of view rather than a limiting point of view. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the equivalent scope will be construed as being included in the present invention.

Claims (12)

a learning note registration unit that obtains and registers learning notes that the user wants to memorize;
a text recognition unit recognizing visual information including text and memorization symbols set by a user for memorization from registered learning notes;
a text extraction unit for extracting the recognized text;
a text-to-speech conversion unit that converts the entire extracted text into a voice signal; and
an output unit for reproducing the converted voice and repeating or emphasizing the text displayed with memorized symbols;
Self-directed rote learning device comprising a. The method of claim 1, wherein the memorized symbol is
A self-directed rote learning device, characterized in that at least one of underline, square, circle, important mark, fluorescent color, boldface, dead body, font change, and text color is displayed in the text. The method of claim 1, wherein the learning notes
A self-directed rote learning device, characterized in that the document is a document that a user directly creates and inputs through a document creation program of a user terminal, or a document that is uploaded by scanning or capturing an existing document. The method of claim 1, wherein the text extraction unit
After extracting the positional information of the sentences and words recognized within the text of the learning note, the text content of the sentences and words and the positional information of the sentences and words in the text are matched and stored in the storage unit,
After extracting the location information of the memorized symbol recognized from the learning note, the location information of the memorized symbol is stored in the storage unit,
A self-directed rote learning device, characterized in that for extracting sentences and words from a text in which memorized symbols are displayed using location information of sentences and words and location information of memorized symbols. The method of claim 1, wherein the self-directed rote learning device
an input unit for receiving user setting information for rote learning; Including more,
The user setting information includes voice reproduction information including the number of reproduction repetitions and emphasis information,
the output part
A self-directed rote learning device characterized in that it reproduces a voice signal according to the voice reproduction information. The method of claim 1, wherein the self-directed rote learning device
an input unit for receiving user setting information for rote learning; Including more,
The user setting information includes learning note sharer information for sharing the study note with the sharer. The method of claim 1, wherein the self-directed rote learning device
a learning note sharing unit that shares the learning notes created by the user with a sharer set by the user;
Self-directed memorization learning device characterized in that it further comprises. The method of claim 1, wherein the self-directed rote learning device
a study note editing unit that provides a tool for editing study notes created by users or sharers and provides the edited study notes to a study note register;
Self-directed memorization learning device characterized in that it further comprises. The method of claim 1, wherein the self-directed rote learning device
a wordbook providing unit that generates and provides a wordbook using sentences or words of text marked with memorized symbols;
Self-directed memorization learning device characterized in that it further comprises. The method of claim 9, wherein the self-directed rote learning device
a test providing unit that displays sentences or words generated by the wordbook providing unit as blank spaces and provides a test for filling in blank spaces according to user input for problems including blank spaces;
Self-directed memorization learning device characterized in that it further comprises. 11. The method of claim 10, wherein the test providing unit
A self-directed rote learning device characterized in that when the sentences or words generated by the vocabulary providing unit are reproduced through the output unit, a blank test is provided for the corresponding sentence or word. Acquiring and registering study notes that the user wants to memorize;
Recognizing visual information including text and memorization symbols set by a user for memorization from registered learning notes;
extracting the recognized text;
converting the entire extracted text into a voice signal; and
Reproducing the converted voice, but repeating or emphasizing the text marked with memorized symbols;
Self-directed rote learning method comprising a.