KR101840358B1 - Mathematics learning apparatus and method using handwritten mathematical expressions recognition - Google Patents

Abstract

A mathematical learning apparatus and method using handwritten mathematical expression recognition that allows a learner to practice a solving process of a mathematical problem and can correct the mistaken solving process by himself without the help of a guidance teacher.
The mathematical learning apparatus using the handwritten mathematical expression recognition according to an exemplary embodiment may include a step of determining a solving process grade of a mathematical problem; Displaying a mathematical problem display area and an input area of a kind corresponding to the determined solving process grade through a display of the mathematical problem, the solving process of the mathematical problem, and the mathematical learning screen including a plurality of function icons ; Highlighting an Nth blank among two or more blank spaces included in the solving process of the mathematical problem; Recognizing a written expression in an input area of the mathematical learning picture; Determining whether the recognized equation matches a previously stored solution formula; And emphasizing the two or more blank spaces to output a notification signal indicating that the solving process is incorrect, according to the determination result.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mathematical learning apparatus and method using mathematical expression recognition using handwritten mathematical expression recognition,

A mathematical learning apparatus and method using written mathematical expression recognition are disclosed. More particularly, the present invention discloses a mathematical learning apparatus and a mathematical learning method using handwritten mathematical expression recognition, in which a learner can practice a solving process for a mathematical problem and can correct the mistaken solving process without assistance of a guidance teacher.

Mathematics must understand basic concepts and principles before memorizing formulas. Based on the understanding of the concept and principle of the formula, we can develop the application by solving various types of problems directly.

In learning mathematics, if learning textbooks containing the concepts and principles of formulas and various types of problems were mainly used in the past, recently, these learning materials can be displayed on a learning site or provided as e-learning Method is mainly used.

According to the conventional electronic learning method, a learner accesses a learning site, selects a desired learning unit, learns the concept and principle of the formula provided in the learning unit, and then answers the mathematical problems presented in the learning unit Can be input. In the learning system linked to the learning site, the learner confirms whether the answer inputted for each mathematical problem is the correct answer or the wrong answer, and shows the result to the learner.

However, according to the conventional electronic learning method, in order to facilitate the scoring of the mathematical problems, almost all the mathematical problems are presented as the question of the multiple choice or short answer. Therefore, there is a limit to learners' practice of solving mathematical problems.

Korean Patent Laid-Open No. 10-2010-0014017 (entitled " e-learning terminal apparatus and method of executing the application program thereof;

A mathematical learning apparatus and method using handwritten mathematical expression recognition that allows a learner to practice a solving process of a mathematical problem and can correct the mistaken solving process by himself without the help of a guidance teacher.

According to an embodiment of the present invention, there is provided a mathematical learning method using handwritten mathematical expression recognition, the mathematical learning method comprising: determining a solving grade of a mathematical problem; Displaying the mathematical problem, the solving process of the mathematical problem and the mathematical learning screen including a plurality of function icons through a display; Highlighting an Nth blank among two or more blank spaces included in the solving process of the mathematical problem; Recognizing a written expression in an input area of the mathematical learning picture; Determining whether the recognized equation matches a previously stored solution formula; And emphasizing the (N + 1) th blank among the two or more blanks according to the determination result.

At least one of the number of blanks, the placement position, and the area included in the solving process of the mathematical problem is determined according to the determined solution grade.

The number of the blank spaces increases as the determined process grade is lower.

As the determined process grade is lower, the area of the blank decreases.

The input area is an area excluding the area where the plurality of function icons are displayed.

The recognized formula is displayed according to the size of the N-th blank.

And changing at least one of a border color, a border thickness, a border type, a shadow, and a blinking pattern of the blank space.

 And outputting a notification signal indicating that the solving process is incorrect according to the determination result.

 The step of outputting the notification signal may include: emphasizing the recognized formula; Highlighting the N-th empty space in which the recognized formula is displayed; And displaying an icon around the recognized formula.

The plurality of function icons may include a list icon for displaying a math learning list, at least one practice field icon for displaying a practice field, a model answer icon for displaying a math problem answer, an initialization icon for initializing the math learning screen, A degree of difficulty downward adjustment icon for indicating an easier mathematical problem than the mathematical problem, a difficulty level up icon for displaying a mathematical problem that is more difficult than the mathematical problem, and a clue icon for displaying clues related to the mathematical problem .

Displaying a driving range area capable of writing a solution to the mathematical problem when the driving range icon is dragged in a first direction; Disengaging the training-practice area when the training-practice area is dragged in a second direction; And storing the handwritten content in the practice area in a written state.

The step of superimposing and displaying the exercise area includes disabling the activated formula recognition function, and the step of unmarking the exercise area includes activating the disabled formula recognition function.

Activating the model answer icon if the solving process for the mathematical problem progresses beyond a reference value; If the icon for the best answer is dragged in the first direction, superimposing and displaying the best answer area including the solving process of the mathematical problem; And unmarking the best answer area if the best answer area is dragged in a second direction.

The superimposing and displaying of the exemplary answer area may include superimposing and displaying the best answer of the mathematical problem on the two or more spaces.

If a learner writes a solving process for a mathematical problem in the input area, the learner can be notified of the wrong part of the written solving process in real time so that the learner can correct the wrong solving process without the help of the guidance teacher .

Since different types of input areas are displayed based on the solution process class determined among the solution process classes of the mathematical problem, the learner can practice the solution process of the mathematical problem according to his or her level.

1 is a block diagram illustrating a configuration of a mathematical learning apparatus using handwritten mathematical expression recognition according to an embodiment of the present invention.
2 is a diagram showing an example of a mathematical problem and a solution process thereof.
FIGS. 3A and 3B are views showing examples of mathematical learning screens displayed when a higher grade is selected among solving process classes of a mathematical problem.
FIGS. 4A to 4C are diagrams showing other examples of mathematical learning screens displayed when a higher grade is selected among solving process classes of a mathematical problem. FIG.
5A to 5C are diagrams showing mathematical learning screens displayed when a median grade is selected among solving process classes of a mathematical problem.
FIGS. 6A to 6F are diagrams showing mathematical learning screens displayed when a lower grade is selected among the solution grade classes of the mathematical problem. FIG. 7 is a flowchart illustrating a mathematical learning method using handwritten mathematical expression recognition according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In this specification, singular forms include plural forms unless otherwise specified in the opening paragraph. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the drawings, like reference numerals designate like elements.

FIG. 1 is a block diagram illustrating the configuration of a mathematical learning apparatus 100 (hereinafter, referred to as a mathematical learning apparatus) using handwritten mathematical expression recognition according to an embodiment of the present invention.

1, the mathematical learning apparatus 100 includes an input unit 110, an output unit 120, a mathematical expression recognizing unit 130, a storage unit 140, a power source unit 150, a control unit 160, ).

The input unit 110 receives various information from the learner. For example, the learner information is input. The learner information includes at least one of a name, an age, and a grade. As another example, setting information related to mathematics learning is input. For example, the setting information may be a rating information of a solving mathematical problem.

Also, the input unit 110 receives various commands from the learner. For example, a mathematical learning application execution command, a command for selecting a grade of solving a mathematical problem, and a mathematical learning termination command can be input. However, the types of commands received from learners are not limited to those illustrated.

In order to input various information and / or commands from the learner, the input unit 110 includes input means such as a turntable feed and a touch panel. The touch panel includes a resistive touch panel, a capacitive touch panel, an ultrasonic touch panel, or an infrared touch panel. The touch panel is stacked on the display 121 of the output unit 120 to be described later to form a touch screen. In the following description, the touch panel of the input unit 110 is stacked on the display unit 121 of the output unit 120 to be described later to form a touch screen.

The output unit 120 outputs the command processing result to at least one of a visual signal and an auditory signal. To this end, the output unit 120 includes at least one of a display 121 for outputting a visual signal and a speaker 122 for outputting an auditory signal. The display 121 may be a flat panel display, a flexible display, an opaque display, a transparent display, an electronic paper (E-paper), or any other form of art known in the art Lt; / RTI >

The output unit 120 may further comprise any type of output means well known in the art to which the present invention pertains, in addition to the display 121 and the speaker 122. For example, it may further include at least one of a vibrator for outputting a tactile signal such as vibration and a light emitting element for outputting an optical signal.

The formula recognizing unit 130 recognizes the formula written by the learner on the touch panel. For this, the formula recognizing unit 130 may use one of various formula recognizing methods. For example, the formula recognizer 130 may use a handwritten formula recognition method using a sequential block model (SBM). Alternatively, the formula recognizing unit 130 may receive the formulas from the learner, analyze the position information of each character forming the formulas, and group them based on the adjacency between the characters to recognize them as independent expressions. The formula recognizing unit 130 may use another formula recognizing method other than the illustrated formula recognizing method. The mathematical expression recognized by the mathematical expression recognizing unit 130 is provided to the controller 160, which will be described later.

The storage unit 140 may be a non-volatile memory, a volatile memory, an internal memory, a removable external memory, a hard disk, an optical disk, a magneto-optical disk, or any form of computer readable storage medium known in the art And a recording medium. Examples of the external memory include an SD card (Secure Digital Card), a mini SD card, and a micro SD card.

The storage unit 140 stores the math learning application and the math problem database. A mathematical problem database contains various types of mathematical problems and a solution process for each mathematical problem. 2 is a diagram illustrating a mathematical problem 210 and a solving process 220 therefor. Referring to FIG. 2, it can be seen that the solving process for the mathematical problem 210 includes a total of four steps 221, 222, 223, and 224. The mathematical expression of each step can be compared with the mathematical expression recognized by the mathematical expression recognizing unit 130. [ The mathematical problem database may be implemented separately from the mathematical learning application, or may be implemented to be included in the mathematical learning application.

Referring again to FIG. 1, the mathematical learning application stored in the storage unit 140 and / or the mathematical problem database may be continuously updated. For example, when the storage unit 140 is implemented as a removable external memory, the external memory in which the existing mathematical learning application and / or mathematical problem database is stored is stored in an external memory storing a new mathematical learning application and / By replacing, the mathematical learning application and / or mathematical problem database can be updated. As another example, if the storage unit 140 is implemented in a non-removable external memory, the new mathematical learning application and / or mathematical problem database may be downloaded from an external device via a wired or wireless network and stored in the storage unit 140 Existing mathematical learning applications and / or mathematical problem databases may be replaced with new mathematical learning applications downloaded and / or mathematical problem databases.

Meanwhile, the storage unit 140 stores various data in addition to the mathematical learning application and the mathematical problem database. For example, learner information input from a learner, a solving process written by a learner during mathematics learning (i.e., a recognized mathematical expression), and an evaluation result obtained by evaluating a mathematical learning level of the learner are stored.

The power supply unit 150 supplies power to the respective components of the mathematical learning apparatus 100. The power supply unit 150 can be charged in various ways. For example, the power supply unit 150 may be charged with electric power supplied from a commercial power supply through a cable connected to a commercial power supply (not shown). As another example, the power source unit 150 may be powered by a wireless power transmission technique from a wireless charging device (not shown) electrically connected to a commercial power source.

The control unit 160 connects and controls the elements in the mathematical learning apparatus 100 with each other. Specifically, when a math learning application execution command is input, the control unit 160 drives a math learning application stored in the storage unit 140. [

Then, the control unit 160 determines a solution grade of the mathematical problem. The pool grade may be determined, for example, by one of the upper, middle, or lower classes. According to one embodiment, the controller 160 refers to the pool class that was used during the previous mathematical learning, and determines the pool grade for the current mathematical learning. According to another embodiment, the control unit 160 determines the solution grade based on the evaluation result of the learner's mathematical learning level. At this time, the control unit 160 may refer to only the evaluation results of the previous mathematical learning, or may collectively refer to the evaluation results to date. According to another embodiment, the control unit 160 determines the class of the pool selected by the learner as the class for the current mathematics learning.

When the pool grade is determined, the controller 160 forms a mathematical learning screen. According to an embodiment, the mathematical learning screen includes a mathematical problem, a solving process for a mathematical problem, and a plurality of function icons.

The mathematical problem is placed, for example, above the mathematical learning screen. The location where the mathematical problem is placed is fixed or is modified to be changed by the learner.

The process of solving mathematical problems is, for example, placed at the bottom of mathematical problems. According to the embodiment, at the bottom of the mathematical problem, a solving process of the kind corresponding to the solving grade determined in advance is displayed. Specifically, if the determined pool is of a higher grade, each step of the solving process may be marked as blank, or the entire process may be displayed as a single space, or the space itself may not be displayed. If the determined pool grade is a middle grade or a lower grade, the number of blanks, the location of the blanks, and the area of the blanks are different for each step of the solving process. For example, if the determined pool is of a moderate grade, two spaces are displayed for each step of the solving process, and each space is placed in a region where it is difficult to derive the correct answer. On the other hand, if the determined pool grade is a lower grade, one blank is displayed for each step of the solving process, and each blank is placed in a portion where the correct answer can be easily obtained.

For example, the plurality of function icons are arranged along the corners of the math learning screen. The function icons include a list icon 330 for displaying a mathematics learning list, a practice field icon 340 for displaying a practice field, a model answer icon 350 for displaying a model answer of a mathematical problem, An initialization icon 360, a difficulty leveling icon 370 for displaying an easier mathematical problem than the currently displayed mathematical problem, a difficulty leveling icon 380 for displaying a mathematical problem that is more difficult than the currently displayed mathematical problem, And a clue icon 390 for displaying a clue associated with the clue.

It can be understood that an area excluding the area where the function icons are displayed on the math learning screen as described above is an input area. The input area is an area where the learner can write a solving process for the mathematical problem. A more detailed description of the math learning screen will be given later with reference to Figs. 3A to 7E.

Meanwhile, the controller 160 determines whether the mathematical expressions recognized by the mathematical expression recognizing unit 130 and the mathematical expressions of the previously stored mathematical expressions match each other. If it is determined that the recognized formula does not match the previously stored formula, the controller 160 outputs a notification signal indicating that the solution process is incorrect.

According to one embodiment, the notification signal may be output as a visual signal. For example, the control unit 160 visually emphasizes the recognized mathematical expression. At this time, as the emphasis method, a method of changing at least one of a character color of a recognized formula, a character size, a character size, a character shape, and a blinking pattern may be used. As another example, the control unit 160 displays an icon around the recognized formula. At this time, the shape of the icon can be variously provided, and the learner can select the shape of the icon suitable for his / her taste. As another example, the control unit 160 may visually emphasize the blank space in which the recognized mathematical expression is displayed. At this time, as the emphasis method, a method of changing at least one of the border color, the thickness of the textures, the type of border, the shadow and the flickering pattern may be used.

According to another embodiment, the announcement signal may be output as an audible signal. Specifically, a notification sound may be output through the speaker 122.

In addition, the control unit 160 may evaluate the math learning level of the learner when the mathematical learning is terminated. For example, the evaluation results are generated by analyzing the time taken by the learner to input all of the solving process of the mathematical problem, and the number of times the solving process was entered incorrectly. The result of the evaluation can be stored in the storage unit 140 described above. The stored evaluation results can be referenced in the next math learning to determine the pool grade.

The communication unit 170 communicates with an external device (not shown) through a wired / wireless network. For example, the communication unit 170 receives a mathematical learning application application from an external device. To this end, the communication unit 170 supports a wired communication method and / or a wireless communication method. Wireless communication systems include wireless broadband Internet, WiFi, ZigBee, Bluetooth, Bluetooth low energy (BLE), Ultra Wide Band, UWB) and Near Field Communication (NFC).

The math learning apparatus 100 according to an embodiment of the present invention has been described above. The math learning apparatus 100 as described above may be a wired / wireless communication device that is personally possessed by a learner. The wired / wireless communication device may be a personal computer (PC), a cellular phone, a PCS phone, a synchronous / asynchronous IMT-2000 (International Mobile Telecommunication-2000) A Personal Digital Assistant (PDA), a Wireless Application Protocol (WAP) phone, a mobile game machine, a smart phone, and a tablet . The wire / wireless communication device as illustrated may be a wearable device that can be worn on the wearer's body such as the head, face, arm, cuff, finger, thigh, or ankle. The wearable device may be implemented in the form of a patch that can be attached to a part of the body, or in the form of a band.

Next, the math learning screen displayed through the mathematical learning apparatus 100 will be described.

FIGS. 3A and 3B are diagrams showing examples of mathematical learning screens displayed when a higher grade is selected among the solving grades of the mathematical problem. FIG.

3A, the mathematical learning screen 300 includes a mathematical problem and a plurality of function icons 330, 340, 350, 360, 370, 380, and 390. The mathematical problem is placed on the top of the screen, and a plurality of function icons (330, 340, 350, 360, 370, 380, 390) are arranged along the periphery of the screen. Specific descriptions of the function icons 330, 340, 350, 360, 370, 380, and 390 will be described later with reference to Figs. 7A to 7E.

It can be understood that an area excluding the function icons 330, 340, 350, 360, 370, 380, and 390 in the mathematical learning screen 300 of FIG. The input area is an area where learners can write solving process about mathematical problems. Therefore, the area excluding the function icons 330, 340, 350, 360, 370, 380, and 390 is the input area, which means that the area where the mathematical problem is displayed also corresponds to the input area.

FIG. 3A shows a case where a solving process of a mathematical problem is not displayed on the mathematical learning screen 300. FIG. In this case, the learner can directly write the solving process of the mathematical problem in the input area.

When the handwritten formula is recognized in the input area, a determination is made as to whether the recognized formula and the formula of the previously stored solve process (for example, the solving process shown in FIG. 2) coincide with each other. As a result of the determination, if the recognized equation and the formula of the previously stored solution do not match with each other, a notification signal indicating that the solution process is incorrect is output as shown in FIG. 3B. Referring to FIG. 3B, a pencil-shaped icon 310 is displayed in the vicinity of the recognized equation, so that the notification signal is visually output.

FIGS. 4A to 4C are diagrams showing other examples of mathematical learning screens displayed when a higher grade is selected among the solving grades of the mathematical problem. FIG.

FIG. 4A shows a case where a solving process is displayed on the mathematical learning screen 300. FIG. Assuming that the solving process of the mathematical problem includes a total of four steps, each step of the solving process can be marked as blank. At this time, the first blank space 322A corresponding to the first step among the plurality of blank spaces 322A, 322B, 322C, and 322D is emphasized. As a method of emphasizing a blank, a method of changing at least one of a border color, a border thickness, a border type, a shadow, and a flicker pattern is used. 4A shows that the first blank space 322A is emphasized by displaying the frame type of the first blank space 322A by a one-dot chain line.

In the state shown in FIG. 4A, the written formula is recognized when the learner writes the formula corresponding to the first step of the solving process in the input area. The recognized formula is displayed according to the size of the first blank space 322A, as shown in FIG. 4B. At this time, if the recognized formula matches the formula of the stored pool process, the highlighting of the first blank 322A is canceled and the second blank 322B is emphasized as shown in FIG. 4B.

When the learner writes the formula corresponding to the second step in the input area in the state as shown in FIG. 4B, the written formula is recognized, and the recognized formula is displayed according to the size of the second blank 322B. At this time, if the recognized formula does not match with the formula of the stored pool process, a notification signal indicating that the solution process is incorrect is output as shown in FIG. 4C. Referring to FIG. 4C, by displaying the border color of the second blank 322B in red, it can be seen that the notification signal is visually output.

FIGS. 5A to 5C are diagrams showing mathematical learning screens displayed when a median grade is selected among the solving classes of the mathematical problem. FIG.

FIG. 5A shows a case where a solving process is displayed on the mathematical learning screen 300. FIG. The solving process shown in FIG. 5A is similar to the solving process shown in FIG. 4A in that it includes a plurality of spaces. However, in FIG. 4A, the learner has to input a complete expression for each step of the solving process, whereas FIG. 5A requires only the learner to input some expressions for each step of the solving process. Therefore, the learner can input the solving process more easily than the mathematical learning screen 300 of FIG. 4A. As shown in FIG. 5A, when the first blank 324A of the first step is emphasized, a written formula is recognized when the user writes the formula to be entered in the first blank 324A into the input area. The recognized formula is displayed according to the size of the first blank space 324A, as shown in FIG. 5B. At this time, if the recognized formula matches the formula of the stored pool process, the highlighting of the first blank space 324A is canceled and the second blank space 324B is emphasized as shown in FIG. 5B.

In the state as shown in FIG. 5B, if the learner writes a formula to be entered in the second blank space 324B into the input area, the written formula is recognized and the recognized formula is displayed according to the size of the second blank space 324B. At this time, if the recognized formula and the formula of the previously stored solution do not match with each other, a notification signal indicating that the solution process is incorrect is output as shown in FIG. 5C. Referring to FIG. 3C, the character color of the recognized formula is displayed in red so that the notification signal is visually output.

FIGS. 6A to 6G are diagrams showing mathematical learning screens displayed when a lower grade is selected among the grade classes of the mathematical problem. FIG.

FIG. 6A shows a case where a solving process is displayed on the mathematical learning screen 300. FIG. The solving process shown in FIG. 6A is similar to the solving process shown in FIG. 5A in that it includes a plurality of spaces. However, in FIG. 5A, the learner has to input some formulas for each step of the solving process. In contrast, FIG. 6A shows only that the learner inputs only numbers in each step of the solving process. Therefore, the learner can input the solving process more easily than the mathematical learning screen 300 of FIG. 5A.

6A, if a practice field icon is dragged in a first direction (for example, from right to left), a practice field area 342 in which a solving process can be practiced is a math problem and a solving process Are overlaid on top. The practice area area 342 is displayed as opaque or translucent. Then, the learner can practice the solving process by writing a formula in the practice field area 342 as shown in Fig. 6C.

6C shows a case where the practice area 342 is displayed in a translucent black color. However, the transparency and / or color of the practice area 342 can be set in advance according to the learner's taste, And may be implemented to be changeable during the process. For example, when a learner touches an arbitrary area in the exercising area 342, a menu for changing the transparency and / or color of the exercising area 342 may be displayed, and the learner may select a desired transparency And / or color.

6C, if the cue area 342 is dragged in the second direction (for example, from left to right), the cue area 342 to be superimposed is disappeared. At this time, the formula written in the practice field area 342 is stored in the storage unit 140 in a written state. Accordingly, when the training puzzle icon 340 is dragged again in the first direction, the formula written by the learner is displayed in the training puzzle area 342 as it is. One or more of these exercise field icons 340 may be arranged, and the number of the practice field icons 340 may be changed by the learner.

In the state where the superimposed display area 342 has disappeared, the written expression is recognized when an expression (for example, numeral 8) to be entered in the first blank space 326A is written in the input area, as shown in Fig. 6D. The recognized formula is displayed according to the size of the first blank space 326A. At this time, if the recognized formula matches the formula of the stored pool process, the highlighting of the first blank space 326A is canceled and the second blank space 326B is emphasized as shown in FIG. 6E.

On the other hand, if the solving process proceeds beyond the reference value, the exemplary answer icon 350 is activated as shown in FIG. 6F. When the exemplary answer icon 350 is dragged in the first direction, as shown in FIG. 6G, the exemplary answer area 352 including the exemplary answer is overlaid on the mathematical problem and the solving process. At this time, the best answer for each space is superimposed on the space. FIG. 6G shows a case where the exemplary answer area 352 is displayed in a semitransparent blue color. However, the transparency and / or the color of the exemplary answer area 352 can be set in advance in accordance with the user's taste, May be implemented to be changeable during the mathematical learning process. For example, when a learner touches an arbitrary area in the exemplary answer area 352, a menu for changing the transparency and / or color of the exemplary answer area 352 may be displayed, You can specify the transparency and / or color you want.

In the state as shown in FIG. 6G, when the exemplary answer area 352 is dragged in the second direction, the model answer area 352 that has been displayed as superimposed disappears. Then, the screen of FIG. 6F is displayed again.

7 is a flowchart illustrating a math learning method according to an embodiment of the present invention.

When the math learning application inputs an execution command, the math learning application is driven (S700).

Thereafter, the grade of solving the mathematical problem is determined (S705). For example, a pool may be determined to be one of a higher class, a middle class, or a lower class. According to one embodiment, the step S705 determines a pool grade for current mathematics learning based on the pool grade used during the previous mathematics learning, the evaluation result for evaluating the learner's mathematics learning level, or the pool grade selected by the learner .

Thereafter, a mathematical learning screen 300 including a solving process of a kind corresponding to the determined pool grade is displayed (S710). For example, if the determined pool is of a lower grade, the math learning screen 300 of FIG. 6A is displayed.

Thereafter, the Nth blank space of the solving process is emphasized (S715). Here, N is a natural number of 1 or more. In step S715, the N-th blank in the solving process is emphasized and the formula recognition function is activated.

Thereafter, it is determined whether a function icon is selected in the math learning screen 300 (S720).

If it is determined in step S720 that the function icon is selected, the function corresponding to the selected function icon is executed while the formula recognition function activated in step S715 is deactivated (step S725). For example, when the list icon 330 is selected in FIG. 6A, the math learning list is superimposed on the screen. 6A, when the cue area icon 340 is selected, a cue area 342 in which a solving process can be practiced is overlaid on the screen, as shown in FIG. 6C. When the difficulty downward adjustment icon 370 is selected in FIG. 6A, a mathematical problem having a lower difficulty than the currently displayed mathematical problem is displayed on the screen. On the contrary, when the difficulty level up icon 380 is selected, a math problem having a higher degree of difficulty than the currently displayed math problem is displayed on the screen. In FIG. 6A, since the model answer icon 350 is in the inactivated state, no change is made even if it is selected. If the initialization icon 360 is selected with the written contents in the input area, all the contents written in the input area are deleted. After the operation corresponding to the function icon is executed, the formula recognition function is activated again.

After step S725, if the learner writes the formula in the input area as shown in FIG. 6D, the formula recognized in the input area is recognized by the formula recognition unit 130 (S730). The recognized formula is displayed according to the size of the first blank space 326A.

Thereafter, a determination is made as to whether the mathematical expression of the previously stored solving process (for example, the solving process of FIG. 2) matches the recognized mathematical expression (S735).

If it is determined in step S735 that the equation of the pre-stored solution does not match with the recognized equation, an alert signal indicating that the solving process is incorrect is output as at least one of a visual signal, a tactile signal, and an auditory signal (S740). According to one embodiment, the step S750 includes visually emphasizing the recognized mathematical expression. According to another embodiment, the step S750 includes displaying an icon around the recognized formula. According to still another embodiment, the step S750 includes a step of visually emphasizing a blank space in which the recognized mathematical expression is displayed.

As a result of the determination in step S735, if the mathematical expression of the pre-stored solving process and the recognized mathematical expression match each other, the highlighting of the N-th blank is canceled and the (N + 1) -th blank is highlighted (S745). That is, as shown in FIG. 6E, the emphasis display of the first blank space 326A is canceled, and the second blank space 326B is emphasized.

Thereafter, a determination is made as to whether the solving process of the mathematical problem has progressed beyond the reference value (S750).

As a result of the determination in step S750, if the solving process of the mathematical problem progresses beyond the reference value, the exemplary answer icon 350 is activated as shown in FIG. 6F (S755).

Thereafter, in accordance with the instruction inputted by the learner, the exemplary answer area 352 is displayed superimposed on the screen as shown in Fig. 6G, or the displayed best answer area is unmarked (S760).

Thereafter, a determination is made as to whether the solving process of the mathematical problem is completed (S765).

 If it is determined in step S765 that the solving process for the mathematical problem is not completed (for example, if the answer to the mathematical problem is not recognized), the process returns to step S720.

If it is determined in step S765 that the solving process of the mathematical problem is completed (for example, if the answer to the mathematical question is recognized), a determination is made as to whether the mathematical learning is completed (S770).

As a result of the determination in step S770, if the mathematical learning is not completed, a step of determining a solving grade of the mathematical problem (S705) or a step of displaying the mathematical learning screen (S710) is performed again.

If it is determined in step S770 that the mathematical learning is completed, the mathematical learning level recognized during the mathematical learning is stored and the mathematical learning level of the learner is evaluated based on the stored mathematical solution (S775). The evaluation result at step S775 may be referred to in order to determine the pool grade at the next mathematical learning.

The embodiments of the present invention have been described above. In addition to the embodiments described above, embodiments of the present invention may be embodied in a medium, such as a computer-readable medium, including computer readable code / instructions for controlling at least one processing element of the above described embodiments have. The medium may correspond to media / media enabling storage and / or transmission of the computer readable code.

The computer readable code may be recorded on a medium as well as transmitted over the Internet, including, for example, a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.) A recording medium such as a recording medium (e.g., CD-ROM, Blu-Ray, DVD), or a transmission medium such as a carrier wave. Since the media may be a distributed network, the computer readable code may be stored / transmitted and executed in a distributed manner. Still further, by way of example only, processing elements may include a processor or a computer processor, and the processing elements may be distributed and / or contained within a single device.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be understood that the invention may be practiced. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

100: A mathematical learning device using handwritten formula recognition
300: math learning screen
310: display area
320: input area
322A, 322B, 322C, 322D: input window
324A, 324B, 324C, 324D: input window
326A, 326B, 326C, 326D: input window

Claims (15)

Determining a solution grade of the mathematical problem;
Displaying the mathematical problem, the solving process of the mathematical problem and the mathematical learning screen including a plurality of function icons through a display;
Highlighting an Nth blank among two or more blank spaces included in the solving process of the mathematical problem;
Recognizing a written expression in an input area of the mathematical learning picture;
Determining whether the recognized equation matches a previously stored solution formula; And
And emphasizing the (N + 1) th blank among the two or more blanks according to the determination result. The method according to claim 1,
Wherein at least one of the number of blanks included in the solving process of the mathematical problem, the arrangement position and the area is determined according to the determined solving grade. 3. The method of claim 2,
Wherein the number of blank spaces is increased as the determined process grade is lower. 3. The method of claim 2,
The mathematical learning method using handwritten mathematical expression recognition that the area of the blank space decreases as the determined process grading level is lower. The method according to claim 1,
Wherein the input area is an area excluding an area where the plurality of function icons are displayed. The method according to claim 1,
The recognized equation
Wherein the mathematical learning method is matched to the size of the N-th blank. The method according to claim 1,
The step of emphasizing
And changing at least one of a border color, a border thickness, a border type, a shadow, and a blinking pattern of the blank space. The method according to claim 1,
And outputting a notification signal indicating that the solving process is incorrect according to a result of the determination. 9. The method of claim 8,
The step of outputting the notification signal includes:
Highlighting the recognized formula;
Highlighting the N-th empty space in which the recognized formula is displayed; And
And displaying an icon on the periphery of the recognized mathematical expression. The method according to claim 1,
The plurality of function icons
A list icon for displaying a mathematics learning list, at least one practice field icon for displaying a practice field, a model answer icon for displaying the best answer of the mathematical problem, an initialization icon for initializing the mathematical learning screen, A handwritten downward adjustment icon for indicating a problem, a difficulty level up icon for displaying a mathematical problem more difficult than the mathematical problem, and a clue icon for displaying a clue related to the mathematical problem, Using mathematical learning methods. 11. The method of claim 10,
Displaying a driving range area capable of writing a solution to the mathematical problem when the driving range icon is dragged in a first direction;
Disengaging the training-practice area when the training-practice area is dragged in a second direction; And
And storing the handwritten content in the handwriting area in the handwritten state. 12. The method of claim 11,
Wherein the step of superimposing the exercise area includes deactivating the activated formula recognition function,
Wherein the step of canceling the exercise area includes activating the disabled formula recognition function. 11. The method of claim 10,
Activating the model answer icon if the solving process for the mathematical problem progresses beyond a reference value;
If the icon for the best answer is dragged in the first direction, superimposing and displaying the best answer area including the solving process of the mathematical problem; And
And unmarking the best answer area if the best answer area is dragged in a second direction. 14. The method of claim 13,
The step of superimposing and displaying the best-
And superimposing and displaying an exemplary answer of the mathematical problem on the two or more spaces. delete

Images