WO2016117899A1 - Method and system for outputting solving process in accordance with mathematical formula recognition - Google Patents

Abstract

The present invention relates to a method and a system for outputting a solving process in accordance with mathematical formula recognition, in which an equation handwritten on a touch screen is recognized and a solving process and a graph of the recognized equation are outputted together.

Description

Solving Process Output Method and System by Equation Recognition

The present invention relates to a method and a system for outputting a solution process according to mathematical recognition, and in detail, recognizes an equation written by hand on a touch screen, and solves the process according to mathematical recognition for outputting a process of solving the recognized equation and a graph together. The present invention relates to an output method and system.

Recently, a computer or a portable terminal has a function of an electronic calculator which is used to obtain a desired result quickly and accurately by calculating a numerical expression together with various operators.

However, complex calculations, especially engineering calculations that require a variety of operators, require dozens of buttons. Due to the complex calculations of various operators, mathematical input methods are too complex and require a lot of input time. In addition, the existing electronic calculator has a keypad-based interface, which provides a different arrangement of keypads for each manufacturer, so that the user has to find and enter a button for a complicated formula. The size of the electronic calculator was also limited.

In order to overcome this size limitation, the conventional commercial scientific calculator has a separate function switching button and adopts a method of inputting a desired formula by combining it with a button for inputting a number and an operator. There is a hassle to access and select the desired function.

The formula input method is a machine-centered interface rather than a user-centered interface. In order to input a formula, the user has to press a button after thinking about the input order, and has to take the inconvenience of checking the output formula.

Accordingly, a technique for recognizing a formula input by hand on a touch screen based device which is actively spreading recently is being developed. In particular, it is applied to educational sites that use electronic blackboards, so that teachers spend a lot of time writing equations or drawing graphs in traditional mathematics or physics. There was no problem.

The present invention has been created to solve the above problems, an object of the present invention is to recognize the mathematical symbols entered by hand on the touch screen-based device to convert the output into text, equations such as equations or functions that can be solved In this case, the present invention provides a method and a system for outputting a solution according to mathematical equations that can automatically draw a solution answer and graph.

Solving process output method according to the present invention equation recognition for the above purpose is a solution process output method according to the equation recognition made by the solution process output system according to the equation recognition having a touch screen based interface, the equation Databaseting the solving process according to the type of data; Receiving mathematical expressions from the user through the handwriting on the interface unit; Recognizing, textifying, and outputting equations input through handwriting to an interface unit; Analyzing the textual equations and classifying them according to types and determining whether they can be solved; Importing and substituting a solution according to a type from a database when the classified equation is solved and is an equation; Generating a graph along with a solution and answer of the equation and outputting the graph to an interface unit; Characterized in that consists of.

In this case, if the classified equations cannot be solved, outputting a non-solvable signal to the interface unit and receiving a continuous straight line having a zigzag shape so as to overlap with the equations output to the interface unit; Deleting the equation overlapping the continuous straight line on the interface unit; It is preferable to further include.

In addition, transmitting the solution process and the answer and the graph of the equation to a specified device and outputting through the display; It may further include.

In addition, the solution output system according to the present invention for the above object is a database that stores the solution according to the type of equation; A touch screen based interface unit which receives a mathematical expression from a user through handwriting and outputs a display signal; A recognition unit for recognizing and text-forming equations input through the interface unit; A determination unit for analyzing the textual equations and classifying them according to types and determining whether they can be solved and outputting a signal that cannot be solved through the interface unit; A pooling unit for solving the equations classified through the determination unit and generating a pooling process and an answer by importing and substituting a pooling process according to a type from a database; A graph generator for creating a graph of the above scheme; A controller for outputting a mathematical expression textified through the recognition unit, a solving process and answer generated through the solver, and the graph through the interface unit; Characterized in that consists of.

At this time, if the continuous straight line of the zigzag shape is input so as to overlap the equations output to the interface unit correction unit for deleting the overlapping equations; A sharing unit for transmitting the solution process, the answer and the graph of the equation to a designated device and outputting the same through a display unit of the device; It is preferable to further include.

Through the present invention in particular, it is possible to improve the visibility and readability by converting mathematical expressions expressed by handwriting into various clear texts, and by automatically drawing the solving process and graphs of complex mathematical problems. It can improve the quality.

In addition, by replacing the existing engineering calculator that requires a complicated use method and cumbersome keypad input for each manufacturer, faster input of the formula and results can be achieved in the touch screen-based device.

1 is a flow chart according to a preferred embodiment of the solution process output method according to the present invention equation;

2 is a flow chart according to another embodiment of the solution process output method according to the present invention equation;

Figure 3 is a block diagram showing the configuration and connection relations according to a preferred embodiment of the solution output system according to the present invention equation recognition.

Hereinafter, with reference to the accompanying drawings will be described in detail a method and system for outputting the solving process according to the present invention.

1 is a flow chart according to a preferred embodiment of the solution process output method according to the present invention, the present invention is basically a device having a touch screen-based interface, such as an electronic blackboard Based on the solution output system according to the equation recognition including a.

In addition to the electronic blackboard, the system includes a device having a touch screen as an input / output means such as a smart phone or a smart pad, and capable of processing and calculating graphic signals, and additionally has a data transmission / reception function.

First, the first step (S 110) is a database of the solving process according to the type of equation. The present invention is not only a function of the conventional calculator to simply calculate the equation to derive the answer, but also the writing time by automatically outputting the solving process and graphs while clearly displaying the educator's handwriting in the education of various mechanics including mathematics or physics. Reduce and increase the efficiency of education.

It may consist of only numbers and operators, or, in the case of the arithmetic function, the function of outputting only the answer without solving the problem may be provided by default. However, in the case of equations containing unknowns (variables), education cannot be carried out by memorizing the formulas of haphazardly without understanding the solution process. Therefore, the type and characteristics of equations and the solution process are stored according to the curriculum. To build a database.

At this time, the function having the same form as the equation can be handled. The equation may include all kinds of equations belonging to the curriculum, such as first-order multi-order equations, one-way equations, two-way equations, simultaneous equations, etc., and the type of such equations and the solution to them are databased.

Next, the second step (S 120) is a step of receiving a mathematical expression by the user through the handwriting on the interface unit, input the mathematical expression according to the education through the touch pen or the equivalent means and, in some cases, the finger of the educator. Receive. At this time, the input equation is basically composed of letters for variables including numbers and operators and includes an equal sign.

The third step (S 130) is a step of recognizing and text-forming the equation input through the handwriting to the interface unit, the text clearly input the equation through the recognition algorithm represented by the optical character reading method Converted to output. For example, a method of recognizing a corresponding operator, a number, and a letter by comparing the operator, the number, and the letter written in the handwriting on the interface with the operator, the number, and the letters stored in advance.

Through this, not only mathematical expressions can be solved through the recognized operators, numbers, and letters, but also the expressions are clearly re-expressed as text even if the input formulas are skewed or the handwriting is not clear according to the characteristics of the educators. It is possible to recognize the convenience.

The fourth step (S 140) is to analyze the textual equations, classify them according to their types, and determine whether they can be solved. As mentioned earlier, linear equations, equality equations, binary linear equations, linear inequalities, and simultaneous systems Based on the set criteria, the typed equations inputted to the interface unit such as linear equations, simultaneous linear inequalities, quadratic equations, quadratic inequalities, cubic equations, quadratic equations, negative equations, upper half equations, and ternary linear equations Classify and determine whether it can be solved.

An equation that cannot be solved is, for example, an equation where the equation does not hold whatever value is assigned to an unknown called 'impossible', or an unknown value that satisfies a given equation, that is, an equation with infinite number of solutions. The case is called 'negative'.

In the fifth step (S 150), when the classified equations are solved and the equations are solved, the solution of the equations is retrieved from the database and substituted. The type of equations that can be solved is first retrieved from the database and the equations of the corresponding type are solved. The procedure is called and the operators, numbers, and letters belonging to the equation are assigned.

Thereafter, the sixth step S 160 generates a graph along with the solution and the solution of the equation and outputs the graph to the interface unit. In other words, it solves equations such as binomial or parentheses for solveable equations, multiplying the least common multiple of denominators in the case of fractional equations, or multiplying them to form a polynomial equation. The concrete process is to output step by step to the equation type. Preferably, the descriptions of each process may be databased together to be output through this step to help the trainees understand.

In addition, by creating a graph corresponding to the corresponding equation and outputting it together and adding a basic description of the graph, the educator can reduce the effort of directly drawing the graph of the equation on the existing board, as well as create an accurate graph. .

Figure 2 is a flow chart according to another embodiment of the solution process output method according to the present invention equation recognition, in another embodiment by the intuitive gesture when the deletion is necessary for reasons such as the correction of the equation or impossible to solve Delete the expression. In addition, a procedure for sharing a solution of an equation to another device is added in an education site using a network. Detailed description of the same contents as in the preferred embodiment of the solution process output method according to the present invention equation recognition in the following description will be omitted.

First, in another embodiment of the present invention, after analyzing the textified equations and classifying them according to their types, and determining whether they can be solved (S 140), when the classified equations cannot be solved, the interface signal is not available. In step S 151, a continuous straight line having a zigzag shape is inputted to the unit and overlapped with an equation outputted to the interface unit.

As a preferable example, a mark such as a question mark may be output to an equation input as a fusible signal so that the user may recognize that the equation cannot be solved, or the reason for solving the fugable problem, such as negation or inability, may be output together.

After that, the user deletes the corresponding equation from the interface unit. In general, the electronic blackboard deletes an incorrect equation through a separate delete menu. However, in the present invention, the equation overlapping the continuous straight line by an intuitive gesture of inputting a continuous zigzag straight line reminiscent of the eraser quality so as to overlap on the target object to be erased by an input means, ie, a touch pen or a finger, on the interface portion. Deletion (S 152) is made. This makes it easier and easier to delete and modify equations and eliminate unnecessary work, such as switching between menus.

Next, after generating the graph along with the solution and the solution of the equation (S 160) and outputting the equation and the solution and the graph of the equation to the specified device and outputting through the display unit (S 160) S 170) is added. This is achieved through a communication module that uses a short-range wireless communication such as Wi-Fi or Bluetooth, or a wired cable, depending on the distance between the device having the touch screen interface unit possessed by the educator.

This is to extend the scope of the education through the present invention, the educator can directly enter the equation on the electronic blackboard that is the main interface unit, and the above-described process on the electronic blackboard can be made, but the educator possesses The results performed through the smart pad can be output through the device possessed by the trainee. In addition, if necessary, after inputting a mathematical expression through a smart pad possessed by the educator, it may be transmitted to an electronic blackboard or a separate display means so that the educator can check all of them.

3 is a block diagram illustrating a configuration and a connection relationship according to a preferred embodiment of a solution process output system according to the present invention equation recognition, a method of outputting the solution process according to the present invention equation described with reference to FIGS. The system which can be implemented is shown, and detailed description of the overlapping content will be omitted.

As mentioned above, the real-time content sharing system of the present invention basically includes a database 110, an interface unit 120, a recognition unit 130, a determination unit 140, a solver 150, and graph creation. The unit 160 and the controller 190 may further include a correction unit 170 and a sharing unit 180 as a preferred embodiment.

The database 110 is a configuration in which the solving process according to the type of equation is stored. As described above, the database 110 stores the characteristics and the solving process of the equation according to the curriculum.

The interface unit 120 is an input / output means for receiving a mathematical expression through writing by a user and outputting a display signal. In the present invention, the interface unit 120 is configured based on a touch screen of various methods such as an electronic blackboard. In such an interface unit 120, the educator inputs a mathematical formula according to the curriculum through a touch pen or equivalent means and, in some cases, the finger of the educator.

The recognition unit 130 is a configuration for recognizing and text-forming equations by recognizing equations input through the interface unit 120, input through handwriting through a character recognition algorithm represented by an optical character reading method The equations are clearly textized and converted and output through the interface unit. This not only solves mathematical equations through the recognized operators, numbers, and letters, but also allows the educators to recognize the equations clearly, even if the input equations are skewed depending on the characteristics of the educator. Convenience is provided.

The determination unit 140 is configured to analyze the textual equations, classify them according to their types, and determine whether they can be solved, and output a non-pullable signal through the interface unit when it is impossible.

As mentioned earlier, various equations such as linear equations, identity, binary linear equations, linear inequalities, simultaneous linear equations, simultaneous linear inequalities, quadratic equations, quadratic inequalities, tertiary equations, quadratic equations, inequality equations, counter equations, and three-way linear equations Among the types of equations, the type of equations inputted to the interface unit are classified according to the type set by the determination unit.

In this case, when the classified equations are not poolable, the pool impossible signal is output to the interface unit. As a preferable example, a mark such as a question mark is output to an equation input as a fusible signal so that a user recognizes that the equation cannot be solved, or the reason for solving the fugable problem such as negation or incapability mentioned above is output together.

When the solver 150 is capable of solving equations classified through the determiner 140 and is an equation, the solver 150 loads and substitutes a solver according to a type from the database 110 to generate a solver and an answer. The graph generator 160 is configured to create a graph of the equation.

 That is, the type of the equation that can be solved is first searched from the database 110, and then the operator, numbers, and letters belonging to the equation are called by the solution process of the equation of the type.

In addition, for equations that can be solved, equations such as binomial or parentheses are processed, or in the case of fractional equations, multiply the least common multiples of the denominators to create a polynomial equation or a theorem using inverse and inverse circles. Solving is to output a specific process step by step to the equation type, and preferably, the description of each process can be configured with a database to be output through this step to help the trainees understand.

In addition, by creating a graph corresponding to the corresponding equation and outputting it together and adding a basic explanation, the educator can reduce the effort of directly drawing the graph of the equation on the existing board, as well as making an accurate graph.

The controller 190 includes the database 110, the interface unit 120, the recognizer 130, the determiner 140, the solver 150, the graph generator 160, and the like. The configuration corresponds to the MCU to control the correction unit 170 and the sharing unit 180. In particular, the text unit through the recognition unit 130, the solving process and answer generated by the solver 150, and the graph created through the graph generator 160 to the interface unit 120 Control to output through.

The correction unit 170 is configured to be easily deleted by an intuitive gesture when it is necessary to delete or modify the input equation, or the like, and zigzag to overlap the equation output on the interface unit 120. When a continuous straight line of the shape is input, the overlapping equation is deleted.

The sharing unit 180 is configured to share the solution of the equation to other devices in the education site using the network, the device 200 by transmitting the solution and the answer and graph of the equation to the specified device 200 ) Through the display unit 210.

The sharing unit 180 is configured by applying an appropriate communication module according to the distance between the device having the touch screen interface unit possessed by the educator and other designated devices. A short-range communication module such as Bluetooth may be used. Preferably, the short-range communication module is configured as a communication module that can be connected to the Internet network so that data can be transmitted and received through the Internet network and a device equipped with a Wi-Fi communication module. You can widen it.

The rights of the present invention are not limited to the embodiments described above, but are defined by the claims, and those skilled in the art can make various modifications and adaptations within the scope of the claims. It is self-evident.

Claims (5)

1. As a solution output method according to equation recognition by the solution output system according to equation recognition having a touch screen based interface,

   Database the solving process according to the type of equation;

   Receiving mathematical expressions from the user through the handwriting on the interface unit;

   Recognizing, textifying, and outputting equations input through handwriting to an interface unit;

   Analyzing the textual equations and classifying them according to types and determining whether they can be solved;

   Importing and substituting a solution according to a type from a database when the classified equation is solved and is an equation;

   Generating a graph along with a solution and answer of the equation and outputting the graph to an interface unit; Solving process output method according to equation recognition, characterized in that consisting of.
2. The method of claim 1,

   If the classified equations cannot be solved, outputting a non-solvable signal to the interface unit and receiving a continuous straight line having a zigzag shape to overlap with the equations output to the interface unit;

   Deleting the equation overlapping the continuous straight line on the interface unit; Solving process output method according to the equation recognition, characterized in that it further comprises.
3. The method of claim 1,

   Transmitting the solution process, the answer and the graph of the equation to a designated device and outputting the same through a display unit; Solving process output method according to the equation recognition, characterized in that it further comprises.
4. In the solution process output system according to the equation recognition,

   A database storing a solution process according to the type of equation;

   A touch screen based interface unit which receives a mathematical expression from a user through handwriting and outputs a display signal;

   A recognition unit for recognizing equations inputted through the interface unit and textifying the equations;

   A determination unit for analyzing the textual equations and classifying them according to types and determining whether they can be solved and outputting a signal that cannot be solved through the interface unit;

   A pooling unit for solving the equations classified through the determination unit and generating a pooling process and an answer by importing and substituting a pooling process according to a type from a database;

   A graph generator for creating a graph of the equation;

   A controller for outputting a mathematical expression textified through the recognition unit, a solving process and answer generated through the solver, and the graph through the interface unit; Solving process output system according to the equation recognition, characterized in that consisting of.
5. The method of claim 4, wherein

   A correction unit for deleting the overlapping equations when a continuous zigzag straight line is input so as to overlap the equations output to the interface unit;

   A sharing unit for transmitting the solution process, the answer and the graph of the equation to a designated device and outputting the same through a display unit of the device; Solving process output system according to the equation recognition further comprising a.

Images