KR100906758B1 - Writing materials for providing calculation function using the detection of hand written mathematical expression and system for calculating using the detection of hand written mathematical expression - Google Patents

Abstract

A writing instrument with a calculation function using formula recognition and a calculation system using the formula recognition are provided to receive a formula directly through the writing instrument without hardware, thereby maximizing portability. A formula input unit(201) produces movement information data by sensing motion of a body end of a writing instrument. A formula recognizing unit(202) converts the movement information data into a formula which can be calculated. A calculating device(203) calculates a result value by calculating the recognized formula. A display device(206) outputs at least one between the recognized formula and the result value. A central controller(200) controls all kinds of data transmission. A power managing unit(205) supplies operation power.

Description

Writing materials for providing calculation function using the detection of hand written mathematical expression and System for calculating using the detection of hand written mathematical expression}

The present invention relates to a writing instrument having a calculation function using a formula recognition and a calculation system using a formula recognition, and more particularly, to convert a movement of the writing instrument tip in contact with a calculation sheet into a formula and converting the converted formula and the calculated result value. A writing instrument having a calculation function using a mathematical recognition outputted in real time to a display device on the side of the writing instrument, and a user terminal for displaying the converted recognition formula and calculation result values using movement information data of the writing instrument and the writing instrument body end; Relates to a calculation system.

Conventional commercial scientific calculators required about 50 buttons for numeric and operator input. In order to sufficiently secure the size of such a button and the space between the buttons, it is difficult to reduce the size of the calculator below a certain size. Due to this, in spite of the fact that the calculator is an electronic calculation device developed for easy and convenient use by an individual, the conventional calculator has a problem in that its appearance is clunky and large so that its portability is poor.

In addition, the conventional button input type commercial calculator for a function has a function switch button, and adopts a method of inputting the formula desired by the user by combining the function switch button and about 50 buttons for inputting numbers and operators. In the case of more complicated formulas, it is cumbersome to access a separately stored menu and select a desired function.

This input method is not a user-oriented interface but a machine-oriented interface. To input a formula to be calculated, the user must press a button directly after thinking about the button input order of the formula to be calculated. You need to check carefully to make sure that you have typed the formula correctly and to contrast it with the formula you want to calculate.

If you enter a complex formula, there is a risk that a user may mistakenly think about the order of button input for the formula, and frequent button input mistakes may occur. In addition, since the interface varies among calculator manufacturers, the user has to learn how to use a calculator for each manufacturer.

On the other hand, the Republic of Korea Patent Publication No. 10-2006-0064965 in order to solve the above problems by using the touch screen and the pen for the touch screen to directly enter the formula to the operation on the screen to obtain the result of the electronic A computing device is disclosed.

The electronic calculation device includes a data storage unit for storing an operator and numbers required for calculation of an equation, an input screen for inputting an operator and a number necessary for calculation from a user by a pen type input means and a touch screen method. And a recognition storage unit for comparing the operator and the numbers written on the input screen with the operator and the numbers stored in the data storage unit and recognizing and storing the operator and the number as the corresponding operator and number. And an output screen for displaying the calculation result calculated by the calculation unit.

However, touch screen pens and touch screens used by the user for input and output purposes are accompanied by hardware other than writing instruments and are not suitable as portable computing devices because a large touch screen is required for inputting a sufficient length. In addition, in order to calculate the formula desired by the user, there is a need to input the formula on the touch screen once more by using a touch screen pen.

The problem to be solved by the present invention is to solve the above problems, writing instruments having a calculation function using a formula recognition that maximizes portability by eliminating hardware such as buttons and touch screen and directly receiving the formula through the writing instrument To provide.

Another problem to be solved by the present invention is to solve the above problems, and when the user intuitively writes a formula using a writing instrument, it recognizes and calculates the formula and displays the result value in terms of the writing instrument. It is to provide a writing instrument having a calculation function using the recognition.

Another problem to be solved by the present invention is to solve the above problems, the user terminal receives the movement information data at the end of the writing instrument body converted into a formula to recognize and display the equation and result value recognized It is to provide a calculation system using recognition.

The present invention relates to a writing instrument having a calculation function using mathematical recognition, comprising: a writing instrument body: a formula input unit configured to generate movement information data by detecting a movement of an end of the writing instrument body; An equation recognition unit converting the movement information data into a calculable equation and recognizing the moving information data; A calculation device for calculating a result of the recognized equation and calculating a result value; A display device formed on the outside of the writing instrument body and outputting any one or more of a recognized equation and a corresponding result value; A central control unit controlling various data transmissions between the equation input unit, the equation recognition unit, the calculation device, the display device, or the power management unit; And a power manager supplying operating power.

The data storage unit may further include a data storage configured to store the recognized equation or a result value corresponding thereto.

Also preferably, the power button is formed on the outside of the writing instrument body to change the power state by the user's operation; characterized in that it further comprises.

Specifically, the mathematical input unit, a light source for irradiating the calculation paper in contact with the end of the writing instrument body; An image sensor converting the reflected light into digital image data; A semi-transparent mirror that sends light of the light source to the calculation sheet or sends light reflected from the calculation sheet to the image sensor; A balanced light lens for converting light from the light source into balanced light; An active mirror whose angle is adjusted about a rotation axis so that light of the light source can be irradiated perpendicularly to the calculation sheet; A condenser lens focusing the reflected light onto the image sensor; And an acceleration sensor for measuring data inclined between the writing instrument body and the calculation sheet and providing data for driving the active mirror.

Here, the translucent mirror or the active mirror is characterized in that the microelectromechanical systems (MEMS) type mirror or bimorph (Bimorph) type mirror.

Also preferably, the mathematical recognition unit may include a function of grasping handwriting information of a user, classifying the shape of the handwriting into mathematical symbols, and identifying a correlation between mathematical symbols separated on a two-dimensional plane.

Also preferably, the display device may be any one of a liquid crystal display (LCD), a luminescent diode (LED), and organic light emitting diodes (OLED).

Preferably, the power management unit supplies operating power to the central control unit, and the mathematical input unit, the mathematical recognition unit, the calculation device, and the display device are supplied with power from the central control unit.

The present invention relates to a calculation system using mathematical recognition, comprising: a writing instrument including a writing instrument body and a formula input unit configured to detect movement of an end of the writing instrument body to generate movement information data and to transmit the generated movement information data; A user terminal that converts the received movement information data into a calculable formula and recognizes the result; And an information communication network connecting the equation input unit and the user terminal to each other.

Preferably, the mathematical input unit, a light source for irradiating the calculation paper in contact with the end of the writing instrument body; An image sensor converting the reflected light into digital image data; A semi-transparent mirror that sends light of the light source to the calculation sheet or sends light reflected from the calculation sheet to the image sensor; A balanced light lens for converting light from the light source into balanced light; An active mirror whose angle is adjusted about a rotation axis so that light of the light source can be irradiated perpendicularly to the calculation sheet; A condenser lens focusing the reflected light onto the image sensor; And an acceleration sensor for measuring data inclined between the writing instrument body and the calculation sheet and providing data for driving the active mirror.

Here, the translucent mirror or the active mirror is characterized in that the microelectromechanical systems (MEMS) type mirror or bimorph (Bimorph) type mirror.

Also preferably, the user terminal may include a formula recognition unit for converting the received movement information data into a formula that can be calculated and recognized; A calculation device for calculating a result of the recognized equation and calculating a result value; A display device formed outside the user terminal and outputting any one or more of a recognized equation and a result value corresponding thereto; A central control unit controlling various data transmissions between the equation recognition unit, the calculation device, the display device, or the power management unit; And a power manager for supplying operating power.

Specifically, the method may further include a data storage configured to store the recognized equation or a result value corresponding thereto.

In detail, the mathematical recognition unit may include a function of grasping handwriting information of a user, classifying the shape of the handwriting into mathematical symbols, and identifying a correlation between mathematical symbols separated on a two-dimensional plane.

According to the present invention, eliminating hardware such as a button and a touch screen and directly inputting a formula through a writing instrument has the effect of maximizing portability.

According to the present invention, when a user writes an equation using a writing instrument, the expression is recognized and calculated in real time, and the result value is displayed on the side of the writing instrument in real time, thereby providing excellent intuition and convenience.

According to the present invention, since the writing instrument only performs a function of receiving a formula and the formula recognition, calculation and display of result values may be shared by a user terminal such as a mobile phone or a PDA, the scope of application may be extended in actual industrialization.

Before describing the details for carrying out the present invention, it should be noted that configurations that are not directly related to the technical gist of the present invention are omitted within the scope of not distracting the technical gist of the present invention.

In addition, the terms or words used in the present specification and claims are consistent with the technical spirit of the present invention on the basis of the principle that the inventor can appropriately define the concept of the term in order to explain the invention in the best way. It should be interpreted as meaning and concept.

Hereinafter, a configuration of a writing instrument having a calculation function using mathematical recognition according to a preferred embodiment of the present invention will be described with reference to FIGS. 1 and 2.

FIG. 1 is an overall configuration diagram of a writing instrument having a calculation function using mathematical recognition according to a preferred embodiment of the present invention, and FIG. 2 is a configuration diagram of an optical input module.

As shown in FIG. 1, a writing instrument having a calculation function using equation recognition according to a preferred embodiment of the present invention includes a mathematical expression input unit 201, a mathematical expression recognition unit 202, a calculation device 203, and a display device ( 206, a central control unit 200, a data storage unit 204, a power management unit 205, and a writing instrument body (not shown in FIG. 1).

First, the equation input unit 201 generates movement information data by detecting the movement of the writing instrument end according to the preferred embodiment of the present invention.

Since the mathematical input unit 201 needs to detect the movement of the writing instrument end, the mathematical input unit 201 is formed at the end of the writing instrument in contact with the writing paper, and may be set as an optical input module for detecting the movement.

As shown in FIG. 2, the light input module includes an active mirror 1, a light source 2, a translucent mirror 3, a lens 4, a condenser lens 5, an image sensor 6, and an acceleration sensor. (7) may be included. The active mirror 1 refers to a mirror in which the reflection angle of light is adjusted by the driver, and reference numeral 1 ′ denotes a mirror rotation axis.

Light emitted from the light source 2 is reflected by the translucent mirror 3 and passes through the lens 4, and is reflected by the active mirror 1 and irradiated to the bottom surface 8. Light reflected from the bottom surface 8 is reflected by the active mirror 1, passes through the lens 4, passes through the translucent mirror 3, and enters the image sensor 6 by the condensing lens 5. The image sensor 6 converts the image into digital image data, analyzes the pixel movement of the bottom surface from the converted data, and extracts the navigation of the writing instrument. The writing instrument is inclined at a predetermined angle when used, and the inclination angle is detected by the acceleration sensor 7 and the reflection angle of the active mirror 1 is changed using the detected angle data. The lens 4 is preferably a balanced light lens that converts light into balanced light.

For sufficient reflected light, the scanning light is preferably perpendicular to the bottom surface 8. In order to reduce the size of the light input module and reduce the power consumption, the mirror is preferably a MEMS type micro mirror or a bimorph type film mirror. It is also possible to adjust the focus by making the curvature of the mirror active.

The acceleration sensor 7 informs the tilt with respect to gravity. When the bottom surface 8 is inclined, the active mirror 1 is driven under an initial condition to detect the point where the angle of the reflected light of the bottom surface 8 is maximum to correct the tilt data of the acceleration sensor 7. .

The optical input module may accurately detect the movement of the writing instrument tip regardless of the inclination angle of the writing instrument or the state of the bottom surface, and may accurately detect the movement of the writing instrument tip even at a certain distance from the tip of the writing instrument.

Next, the equation recognition unit 202 receives the movement information data from the equation input unit 201 and calculates the received movement information data using the handwriting information of the user stored in the data storage unit 204. Recognize the transformation. Specifically, the shape of the user's handwriting is divided into mathematical symbols, and then the correlation between mathematical symbols on the two-dimensional plane is grasped and converted into mathematical expressions.

The transformation recognition method of the equation recognition unit 202 may adopt a method used in the conventional pattern recognition field, and may be implemented, for example, from Nicholas E. Matsakis' MIT doctoral dissertation 'Recognition of Handwritten Mathematical Expressions'. The description will be omitted.

Next, the calculation device 203 calculates the equation recognized by the equation recognition unit 202 to obtain a result value. The computing device 203 can be set as a conventional electronic computing device.

Next, the display device 206 is formed on the outer side of the writing instrument and outputs the equation and the result value recognized by the equation recognition unit 202, so that the user can check in real time.

The display device 206 may be implemented as a liquid crystal display (LCD), a luminescent diode (LED), organic light emitting diodes (OLED), or the like, and receives a formula and a result value to be output by the control of the central controller 200. do.

Next, the central control unit 200 controls the equation input unit 201, the equation recognition unit 202, the calculation device 203, the display device 206, the data storage unit 204, and the power management unit 205. It controls the various data transfer between them, and transmits the formula and the result value stored in the data storage unit 204 to the display device 206 to output.

Next, the data storage unit 204 stores the equation recognized by the equation recognition unit 202, the result data calculated by the calculation device 203, and handwriting information of the user.

Next, the power management unit 205 is the central control unit from the battery when the power state of the writing instrument having a calculation function using the mathematical recognition according to an embodiment of the present invention is turned on (ON) by the power button 100 Supply constant operating power to 200. All other components except for the central control unit 200 may be set to be directly connected to the central control unit 200 to receive power from the central control unit 200.

Lastly, the writing instrument body includes the equation input unit 201, the equation recognition unit 202, the calculation device 203, the display device 206, the central control unit 200, the data storage unit 204, and the power management unit 205. ) Supports them, and real-time expression recognition, calculation, and output of result value by user's handwriting. The writing instrument may be any kind of pen, fountain pen, or other writing material.

Hereinafter, an actual use state of a writing instrument having a calculation function using mathematical recognition according to a preferred embodiment of the present invention will be described with reference to FIG. 3.

3 is a schematic diagram of a use state of a writing instrument having a calculation function using mathematical recognition according to a preferred embodiment of the present invention.

In FIG. 3, the power button 100 is a button which is pressed when the user starts the operation of the writing instrument according to the preferred embodiment of the present invention for calculation. When the power is turned off, the power button 100 is turned on and the power is turned on. It is preferable to set so that it may turn off when it is in the on state. The power off state is a state in which the writing instrument according to a preferred embodiment of the present invention is used for general writing purposes, and the power supply on state is a state used for calculation of mathematical expressions.

In addition, in FIG. 3, the display apparatus 206 described above may be confirmed.

Hereinafter, a calculation system using equation recognition according to another embodiment of the present invention will be described with reference to FIG. 4.

4 is an overall configuration diagram of a calculation system using equation recognition according to another embodiment of the present invention.

As shown in FIG. 4, a calculation system using mathematical recognition according to another embodiment of the present invention includes a writing instrument, an information communication network 400, and a user terminal 300.

First, the writing instrument includes a writing instrument body and a formula input unit 201.

The equation input unit 201 generates movement information data by detecting a movement of the writing instrument end according to another embodiment of the present invention, and generates the movement information data and the handwriting information of the user through the information communication network 400. Transmit to the terminal 300.

In addition, the information communication network 400 performs a function of connecting the writing instrument and the user terminal 300 to each other. The information communication network 400 includes a wired internet network using a TCP / IP protocol and a wireless internet network using a WAP protocol.

In addition, the user terminal 300 converts and recognizes the received movement information data into a formula, calculates a result value, displays a result value, a formula recognition unit 202, a calculation device 203, a display device 206, The central control unit 200, a data storage unit 204, and a power management unit 205 are included.

The user terminal 300 may be configured of a personal computer, a personal digital assistant, a mobile phone, and the like.

Since the equation recognition unit 202 and the calculation device 203 have been described above, a detailed description thereof will be omitted.

The display device 206 is formed outside the user terminal 300 to output the equation and the result value recognized by the equation recognition unit 202, so that the user can check in real time. The display device 206 may be implemented as a liquid crystal display (LCD), a luminescent diode (LED), organic light emitting diodes (OLED), or the like, and may use a display device provided according to specifications such as a personal computer, a PDA, or a mobile phone. have.

The central control unit 200 controls the equation recognition unit 202, the calculation device 203, the display device 206, the data storage unit 204, and the power management unit 205, and controls various data transmission therebetween. The expression and result stored in the data storage unit 204 may be transmitted to the display device 206 for output.

The data storage unit 204 stores equations recognized by the equation recognizer 202, result data calculated by the calculation device 203, and handwriting information of the user.

The power manager 205 supplies the operating power of the user terminal 300 from a battery. The power manager 205 may use a battery provided according to specifications of a personal computer, a PDA, or a mobile phone.

As described above and described with reference to a preferred embodiment for illustrating the technical idea of the present invention, the present invention is not limited to the configuration and operation as shown and described as described above, it is a deviation from the scope of the technical idea It will be understood by those skilled in the art that many modifications and variations can be made to the invention without departing from the scope of the invention. Accordingly, all such suitable changes and modifications and equivalents should be considered to be within the scope of the present invention.

1 is an overall configuration diagram of a writing instrument having a calculation function using a mathematical recognition in accordance with a preferred embodiment of the present invention.

2 is a block diagram of an optical input module.

3 is a schematic diagram of a use state of a writing instrument having a calculation function using mathematical recognition according to a preferred embodiment of the present invention.

4 is an overall configuration diagram of a calculation system using equation recognition according to another embodiment of the present invention.

Claims (14)

In a writing instrument having a calculation function using mathematical recognition, Writing instrument body: A formula input unit for detecting movement of the writing instrument body end and generating movement information data; An equation recognition unit converting the movement information data into a calculable equation and recognizing the moving information data; A calculation device for calculating a result of the recognized equation and calculating a result value; A display device which is formed on the outside of the writing instrument body and outputs any one or more of a recognized equation and a result value corresponding thereto; A central control unit controlling various data transmissions between the equation input unit, the equation recognition unit, the calculation device, the display device, or the power management unit; And Writing device having a calculation function using a mathematical recognition including a power management unit for supplying the operating power. The method of claim 1, And a data storage unit for storing the recognized equation or a result value corresponding thereto. The method of claim 1, And a power button which is formed on the outside of the writing instrument body to change a power state by a user's manipulation. The method of claim 1, The formula input unit, A light source for irradiating a calculation sheet in contact with an end of the writing instrument body; An image sensor converting the reflected light into digital image data; A semi-transparent mirror that sends light of the light source to the calculation sheet or sends light reflected from the calculation sheet to the image sensor; A balanced light lens for converting light from the light source into balanced light; An active mirror whose angle is adjusted about a rotation axis so that light of the light source can be irradiated perpendicularly to the calculation sheet; A condenser lens focusing the reflected light onto the image sensor; And And an acceleration sensor for measuring the inclination between the writing instrument body and the calculation sheet and providing data capable of driving the active mirror. The method of claim 4, wherein The translucent mirror or the active mirror is a writing instrument having a calculation function using a mathematical recognition, characterized in that the MEMS (Microelectromechanical systems) mirror or Bimorph (mirror) mirror. The method of claim 1, The mathematical recognition unit calculates the handwriting information of the user to classify the shape of the handwriting into mathematical symbols, and calculates a correlation between mathematical symbols distinguished on a two-dimensional plane. Writing instrument having a. The method of claim 1, The display device is a writing instrument having a calculation function using a mathematical recognition, characterized in that any one of a liquid crystal display (LCD), a luminescent diode (LED) and organic light emitting diodes (OLED). The method of claim 1, The power management unit supplies operating power to the central control unit, and the formula input unit, the formula recognition unit, the calculation device and the display device is a writing instrument having a calculation function using a formula recognition, characterized in that the power is supplied from the central control unit. . In a calculation system using mathematical recognition, A writing instrument including a writing instrument body and a formula input unit configured to detect movement of the writing instrument body end to generate movement information data and to transmit the generated movement information data; A user terminal that converts the received movement information data into a calculable formula and recognizes the result; And And an information communication network connecting the equation input unit and the user terminal to each other. The method of claim 9, The formula input unit, A light source for irradiating a calculation sheet in contact with an end of the writing instrument body; An image sensor converting the reflected light into digital image data; A semi-transparent mirror that sends light of the light source to the calculation sheet or sends light reflected from the calculation sheet to the image sensor; A balanced light lens for converting light from the light source into balanced light; An active mirror whose angle is adjusted about a rotation axis so that light of the light source can be irradiated perpendicularly to the calculation sheet; A condenser lens focusing the reflected light onto the image sensor; And And an acceleration sensor for measuring the inclination between the writing instrument body and the calculation sheet and providing data capable of driving the active mirror. The method of claim 10, The translucent mirror or the active mirror is a microelectromechanical systems (MEMS) type mirror or bimorph (bimorph) type calculation system using a mathematical recognition, characterized in that. The method of claim 9, The user terminal, A formula recognition unit for converting the received movement information data into a formula that can be calculated and recognized; A calculation device for calculating a result of the recognized equation and calculating a result value; A display device formed outside the user terminal and outputting any one or more of a recognized equation and a result value corresponding thereto; A central control unit controlling various data transmissions between the equation recognition unit, the calculation device, the display device, or the power management unit; And And a power management unit for supplying operating power. The method of claim 12, And a data storage unit for storing the recognized equation or a result value corresponding thereto. The method of claim 12, The mathematical recognition unit calculates the handwriting information of the user to classify the shape of the handwriting into mathematical symbols, and calculates the correlation between mathematical symbols separated on a two-dimensional plane calculation system using a mathematical recognition, characterized in that .

Images