KR102075433B1 - Handwriting input apparatus and control method thereof - Google Patents

Abstract

A handwriting input device is disclosed. The handwriting input device may include a touch screen that displays handwriting according to a user touch input, performs text recognition on the handwriting, classifies the handwriting into editing units based on the text recognition, and based on the editing unit in response to a user command. And a processor that performs an editing operation on the handwriting.

Description

Handwriting input device and its control method {HANDWRITING INPUT APPARATUS AND CONTROL METHOD THEREOF}

The present invention relates to a handwriting input device and a control method thereof, and more particularly, to a handwriting input device and a control method thereof capable of creating or editing a document through a handwriting input on a touch screen.

Recently, as portable terminals such as tablet PCs and smart phones have become widespread, users' demand for intuitively inputting or outputting information through handwriting input has increased. Accordingly, the mobile terminal has evolved from a traditional UI method, for example, a keyboard, a keypad, a mouse, etc. for various user inputs, to an intuitive UI method for inputting information using a finger or a touch pen. have.

On the other hand, the method of writing a memo, a message, and a general document through a handwriting input has a higher degree of freedom in content writing compared to a conventional document writing method through a conventional keyboard input, and enables more intuitive and quick input.

However, a handwriting written in a document writing method through handwriting input is usually processed as an image file or converted into a text file through handwriting recognition, and accordingly, a conventional keyboard that processes input text itself by character unit Difficulties exist in editing compared to the document creation method through input.

Accordingly, in the handwriting input device, a search for a method of realizing a document editing experience in a document writing method through keyboard input is required.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problem, and an object of the present invention is to provide a writing environment based on a document writing method through a keyboard input, which is more intuitive and user-friendly in the creation of a document through a writing input. An input device and a control method thereof are provided.

According to an embodiment of the present invention, a handwriting input device may include a touch screen displaying a handwriting according to a user touch input, performing text recognition on the handwriting, and editing the handwriting based on the text recognition. And a processor configured to divide the data into units and perform an editing operation on the writing based on the editing unit in response to the user command.

In addition, when the user command is a selection command for at least one region in which the writing is performed, the processor may select the editing target region by dividing the writing included in the selected region based on the editing unit.

In addition, when a size change command for changing the size of the handwriting included in the editing target area is input, the processor may determine the size of the handwriting for each editing unit and adjust the size of the handwriting for each editing unit to correspond to the size change command. have.

In addition, when a line spacing change command for changing the line spacing between writings included in the editing target area is input, the processor determines a line spacing between writings for each editing unit, and between writings to correspond to the line spacing changing command. You can adjust the line spacing of each edit unit.

In addition, when a new writing is input to the editing target area, the processor may replace the editing target area with the new writing and rearrange the area where the writing is performed based on the replaced writing for each editing unit.

In addition, when a handwriting movement command for moving the position of the handwriting included in the editing target area to another area in which the writing is made is input, the processor moves the position of the handwriting included in the editing target area according to the writing movement command. The writing order of the region where the writing is performed may be rearranged for each editing unit based on the moved writing position.

The processor may generate a text box in the selected editing target area and edit the text box based on the editing unit according to a user command for the text box.

In addition, when a table generation command for the editing target region is input, the processor analyzes a row and a column for distinguishing the handwriting included in the editing target region based on the editing unit, and includes the result in the editing target region based on the analysis result. Can generate a table divided into rows and columns.

In addition, when the user command is a command for adjusting the size of the input window in which the writing is performed, the processor may rearrange the writing by editing units based on the size of the adjusted input window.

Here, the editing unit may be one character or word.

On the other hand, the control method of the handwriting input device according to an embodiment of the present invention, on the touch screen for displaying the handwriting according to the user touch input, performing a text recognition for the handwriting, based on the text recognition Dividing the editing unit, and performing an editing operation on the writing based on the editing unit divided according to the user command.

In the performing of the editing operation, when the user command is a selection command for at least one region in which writing is performed, the editing target region may be selected by dividing the writing included in the selected region based on the editing unit.

In the editing operation, when a size change command for changing the size of the handwriting included in the editing target area is input, the size of the handwriting is determined to correspond to the size change command, and the size of the handwriting is determined to correspond to the size change command. Can be adjusted by editing unit.

In the editing operation, when a line spacing change command for changing line spacing between writings included in an editing target area is input, the line spacing between writings is determined for each editing unit, and the line spacing changing command is performed. The line spacing between writings can be adjusted for each editing unit so as to correspond.

In the performing of the editing operation, when a new writing is input for the editing target area, the editing target area may be replaced with the new writing, and the writing operation may be rearranged for each editing unit based on the replaced writing. have.

In the performing of the editing operation, when a handwriting movement command for moving the position of the handwriting included in the editing target region to another region of the writing region is input, the handwriting included in the editing target region according to the handwriting movement command is input. The location of the letter may be moved, and the writing order of the area where the writing is performed may be rearranged for each editing unit based on the moved location of the writing.

In the performing of the editing operation, a text box may be generated in the selected editing target area, and the text box may be edited based on an editing unit according to a user command for the text box.

In the editing operation, when a table generation command for the editing target region is input, the rows and columns for distinguishing the writings included in the editing target region are analyzed based on the editing unit, and based on the analysis result. You can create a table in which the handwriting included in the editing target area is divided into rows and columns.

In the performing of the editing operation, when the user command is a command for adjusting the size of the input window in which the writing is performed, the writing may be rearranged for each editing unit based on the adjusted size of the input window.

Here, the editing unit may be one character or word.

According to various embodiments of the present disclosure, in the creation and editing of a document through a handwriting input, the user's convenience of document creation and editing through a keyboard input may be maintained, thereby improving user convenience.

1 is a block diagram schematically illustrating a configuration of a writing input device according to an embodiment of the present invention;
2A and 2B are views for explaining a method of selecting an editing target area according to an embodiment of the present invention;
3A to 3C are diagrams for describing various methods of rewriting writing according to the size adjustment of an input window, according to an embodiment of the present invention;
4 is a view for explaining a method of adjusting the size of a handwritten according to one embodiment of the present invention;
5 is a diagram for describing a method of adjusting line spacing between writings according to an embodiment of the present invention;
6 and 8 are diagrams for describing a method of changing a writing attribute according to various embodiments of the present disclosure;
9 and 10 are views for explaining a method of applying a bullet, according to an embodiment of the present invention;
FIG. 11 is a diagram for describing a method of replacing or moving a writing in an editing target area according to an exemplary embodiment;
12 is a view for explaining a method of copying and pasting writing in an editing target area according to an embodiment of the present invention;
13A and 13B are diagrams for describing a method of inputting a figure, according to an embodiment of the present invention;
14A and 14B are diagrams for describing a method of inputting a registered object according to one embodiment of the present invention;
15A to 16 are views for explaining a method of creating and editing a text box according to one embodiment of the present invention;
17 and 18 are diagrams for describing a method of generating a table according to one embodiment of the present invention;
19A to 20B are views for explaining a method of editing a table according to an embodiment of the present invention;
21A and 21B are diagrams for describing a method of outputting a calculation result of a formula, according to an exemplary embodiment;
22 is a block diagram illustrating in detail a configuration of a handwriting input device according to another embodiment of the present invention;
23 is a flowchart illustrating a control method of a handwriting input device according to an embodiment of the present invention.

Hereinafter, with reference to the drawings will be described in detail with respect to the present invention.

1 is a block diagram schematically illustrating a configuration of a writing input device according to an embodiment of the present invention.

Referring to FIG. 1, the handwriting input device 100 according to an embodiment of the present invention includes a touch screen 110 and a processor 120.

The handwriting input device 100 may be implemented as a smart phone, a mobile phone, a portable multimedia player (PMP), an MP3 player, a tablet PC, a personal navigation device, or the like including a touch screen capable of handwriting input by a user through a touch input. .

In the present invention, the writing input device 100 will be described only in the case where the smart phone is implemented as a smart phone, but is not limited thereto. In addition, the handwriting input device 100 may be implemented as various devices including a touch screen.

The touch screen 110 is a configuration for receiving and displaying handwriting through a finger or a touch pen. In detail, the touch screen 110 may include a display panel (not shown) that performs a display function for output information output from the handwriting input device 100, and an input sensing panel (not shown) that performs various input functions by a user. It can be composed of).

In this case, the display panel may be configured as a liquid crystal display (LCD), organic light emitting diodes (OLED), or the like, and may be structurally integrated with the input sensing panel. The display panel may display various screens such as various operation states, menu states, application execution states, and services, including the writing screen of the writing input device 100.

The input sensing panel may detect various inputs such as a single or multi-touch input, a drag input, a writing input, a drawing input, and the like of a user using various objects such as a finger and an electronic pen. The input sensing panel may be implemented using one panel capable of both finger input sensing and pen input sensing, or implemented using two panels such as a touch panel capable of sensing finger input and a pen recognition panel capable of sensing pen input. May be

The processor 120 is a component that controls the overall operation of the handwriting input device 100. In particular, the processor 120 may perform text recognition on handwriting according to a user touch input. In detail, the processor 120 may extract feature information from the drawn trajectory of handwriting according to a touch input, and recognize the character having the same or similar feature information as the character corresponding to the handwriting from the extracted feature information. The characteristic information of the handwriting may include length ratio, angle, direction, and relative position information, and the characteristic information may be pre-stored in a database (not shown).

In addition, the processor 120 may perform the editing operation by dividing the handwriting into editing units based on text recognition. Here, the editing unit refers to the minimum unit on which the editing is based, and may be one character or word. The letter may include letters, numbers, and symbols, and the word may mean a group of letters based on a space.

For example, if a handwriting input of "Long live in our country" is performed, and if the editing unit is a character, "Wu", "Lee", "I", "L", "Men", and "Three" are respectively edited. Can be divided into units. If the editing unit is a word, "our country" and "hurray" may be divided into editing units.

The processor 120 may perform an editing operation on writing based on an editing unit set by a user, in response to a user command. Here, when the user command is a selection command for at least one region in which writing is performed, the processor 120 may select an editing target region by dividing the writing included in the selected region based on the editing unit. Details thereof will be described in detail with reference to FIGS. 2A and 2B.

2A and 2B are diagrams for describing a method of selecting an editing target area, according to an exemplary embodiment.

As illustrated in FIG. 2A, in the related art, when an "up to 21" is to be edited on an input writing screen, an editing target region is selected by dragging and selecting the letters in a form surrounding the corresponding letters. However, this method is selected in the state that text recognition for the character is not performed, so that the accuracy of the selection is reduced.

2B illustrates a case where the editing unit is set to a character. As shown in (a) of FIG. 2, when a user selects at least one region in which writing is performed by dragging, a writing region including "day", "to", "ji", and "bottom" for each character ( 22) may be clearly distinguished from other writing areas and may be selected as an editing target area. In this case, the editing target area may be displayed to be distinguished from other writing areas by setting a block or applying a highlighter effect.

2B (b) illustrates a case where the editing unit is set to words. As shown in (b) of FIG. 2, when a user selects at least one region in which writing is performed in the same manner, a writing region in which the writing region 23 including "up to day" and "sky" is different for each word. It is clearly distinguished from and can be selected as an editing target area.

That is, according to the present invention, since the editing is performed by dividing the writing into editing units set by the user based on text recognition, the writing can be accurately selected as the editing unit.

When the user command is a command for adjusting the size of the input window in which the handwriting is made, the processor 120 may rearrange the handwriting for each editing unit based on the adjusted size of the input window. Details thereof will be described in detail with reference to FIGS. 3A to 3C.

3A illustrates an embodiment in which handwriting is rearranged according to the size adjustment of an input window.

According to FIG. 3A, the handwriting input may be performed on an input window Windows 31 that can be resized displayed on the touch screen 110. As shown in FIG. 3A, the input window 31 may provide a UI including various editing functions.

After the writing input is performed on the input window 31, the size or shape of the input window 31 may need to be adjusted according to various applications of the user to the touch screen 110. Accordingly, when the size or shape of the input window 31 is adjusted by the user, the writing in the input window 31 is changed to the size or shape of the new input window 31 according to the size or shape of the adjusted input window 31. Can be automatically rearranged by editing unit.

In detail, the processor 120 may calculate the width of the newly adjusted input window 31 and reposition the writing by wrapping lines by editing units so as to correspond to the calculated width. Accordingly, even if the size or shape of the input window 31 is adjusted, the readability of the input handwriting may be minimized.

FIG. 3B illustrates another embodiment in which handwriting including a formula is rearranged according to the size adjustment of an input window.

According to FIG. 3B, when the writing input on the input window 32 includes a formula such as y = ax + b, a = 2, b = 3, the size or shape of the input window 32 is adjusted. Accordingly, when writing is wrapped, each formula itself may be wrapped in one unit.

For example, when the size or shape of the input window 32 is adjusted so that one formula of y = ax + b is divided and arranged on another line, the readability of the formula may be degraded. Therefore, the processor 120 applies a line break even when the editing unit of y = ax + b is each character of "y", "=", "a", "x", "+", and "b". In the equation, the expression "y = ax + b" is wrapped in one unit so that the expression "y = ax + b" is always arranged on the same line.

FIG. 3C illustrates another embodiment in which handwriting including a table is rearranged according to the size adjustment of an input window.

According to FIG. 3C, when the input window 33 includes an object (picture or table) distinguished from the input writing area, when the writing is wrapped as the size or shape of the input window 33 is adjusted. The object distinguished from the handwriting area may be rearranged by analyzing the size or shape of the input window 33 and the position of the input handwriting area.

For example, as shown in FIG. 3C, when the input window 33 includes the table 34, the input writing area automatically increases as the width of the input window 33 increases and the height decreases. Line breaks However, the table 34 is an object which is distinguished from the input writing area, and no line breaks are applied, and the table 34 is rearranged according to the size or shape of the input window 33 and the position of the input writing area.

Meanwhile, when a size change command for changing the size of the handwriting included in the editing target area is input, the processor 120 determines the size of the handwriting for each editing unit and adjusts the size of the handwriting so as to correspond to the size change command. You can adjust it very much.

In detail, the user may select one of the areas where the writing is made as an editing target area for changing the size of the writing, and the processor 120 may change the size for changing the size of the writing included in the selected editing target area. According to the command, the minimum enclosing rectangle (hereinafter, MER: Minimum Enclosing Rectangle) that surrounds the per-editing unit may be extracted.

For example, when the editing unit is a character, the processor 120 may extract the MER of each character included in the editing target area. The processor 120 may calculate a font size for each character based on the extracted MER, and adjust the font size of each character to correspond to the font size selected by the user based on the calculated font size for each character. The processor 120 may adjust the line spacing and the flatness of the writing area while adjusting the text size of the editing target area. A detailed embodiment thereof will be described with reference to FIG. 4.

4 is a diagram for describing a method of adjusting the size of writing according to an embodiment of the present invention.

As illustrated in FIG. 4, since it is difficult to input writing while maintaining a constant size of the input character due to the characteristics of the writing input, there is a problem that readability of the writing input document is degraded or aesthetics are deteriorated. According to the present embodiment, the user can easily select an editing target region and change the font size of the text to the same size.

The user may select by dragging the editing target area 41 whose font size is to be changed. In this case, the processor 120 may extract a letter-by-letter MER for the selected editing target region 41 and calculate a font size for each letter based on the extracted MER. In this case, when the font sizes of the letters included in the editing target area 41 are different, the font size changing UI 42 capable of changing the font size may change the minimum font of the letters in the editing target area 41. The size can be estimated and displayed.

For example, when the font having the smallest font size calculated based on the MER in the selected editing target area 41 is "ki", and the font size of "ki" is 14pt, the processor 120 may edit The font size representing each character in the area 41 may be displayed as "14+" or the like to inform the user.

The user can manipulate the font size change UI 42 to apply the desired font size 24pt to the edit target area 41. In this case, the processor 120 may equally adjust the size of the MER of each letter so that each letter of the editing target region 41 corresponds to 24pt, which is a font size selected by the user. According to the size of the adjusted MER, the size of each letter in the editing target area 41 is changed to be the same, and together with this, the processor 120 adjusts the line spacing and the flatness so that the editing target area 41 does not overlap other writing areas. Can be.

In addition, when a line spacing change command for changing line spacing between writings included in the editing target area is input, the processor 120 determines a line spacing between writings for each editing unit, and corresponds to a line spacing changing command. The line spacing between handwriting can be adjusted by editing units as much as possible. A detailed embodiment thereof will be described in detail with reference to FIG. 5.

5 is a diagram for describing a method of adjusting line spacing between writings, according to an exemplary embodiment.

As illustrated in FIG. 5, the user may select a writing area for adjusting line spacing as the editing target area 51. When the edit target region 51 is selected, the MER of all the letters in the edit target region 51 may be extracted, the average font size may be calculated, and the line spacing may be reset to correspond to the calculated average font size.

In addition, the user may input a line spacing change command for changing the line spacing by selecting the line spacing through the line spacing adjustment UI 52.

At this time, the processor 120 extracts the MER of each letter included in the editing target area 51, and based on the extracted MER, the letter 53 that is present at the bottom of the letters existing in the same line as the upper line and the next one are as follows. The line spacing between the uppermost letters 54 among the letters existing in the line may be determined and displayed. Specifically, the processor 120 calculates a vertical distance between the bottom side of the MER of the letter 53 existing at the bottom of the top line and the top side of the MER of the character 54 present at the top of the next line, and the top line and the bottom line. By determining the line spacing between the lines, the line spacing adjustment UI 52 may display the determined line spacing.

In this case, when the line spacing of the editing target area 51 is one or more times the calculated average font size, the line spacing may be displayed on the line spacing adjustment UI 52 as "1.0+" to inform the user.

Accordingly, the processor 120 may adjust the line spacing between letters to correspond to the line spacing change command based on the determined line spacing.

6 to 8 are diagrams for describing a method of changing a writing attribute according to various embodiments of the present disclosure. According to various embodiments of the present disclosure, the user may change the writing attributes (color, thickness, writing instrument, shape, etc.) of the editing target region for each editing unit.

According to FIG. 6, when the user selects the editing target region 61 and changes the pen type of writing in the selected editing target region 61, the user may change the writing attribute as the input writing according to the changed pen. For example, as shown in FIG. 6, when the pen is hovered over the editing target area 61, a result of changing the writing property according to the pen type may be displayed as a preview screen along with a UI for selecting the pen type. have.

As such, the processor 120 may display the result of the writing property change to which the option is applied as a preview screen together with a UI that provides an option for changing the writing property. Accordingly, the user can know the result of the writing property change before changing the writing property of the editing target region.

According to FIG. 7, when the user selects the editing target region 71 and changes the color or thickness of the writing in the selected editing target region 71, the user may change the writing attribute according to the changed color or thickness. For example, as shown in FIG. 7, the UI 73 capable of changing the color of the editing target area 71 to red and the thickness of the editing target area 71 can be changed on the UI 72. When the thickness is adjusted to 14 on the image, the adjusted color and thickness may be applied to each letter in the selected editing target area 71.

According to FIG. 8, the user may select the edit target region 81 and apply various form change options to the writing in the selected edit target region 81. For example, as shown in FIG. 8, by applying a bold option and an italic option to the editing target area 81 on the UI 82 providing the shape change option, the editing target area ( 81 may be displayed in bold or tilted for each letter.

In addition, when an underline option, a strikethrough option, or the like is applied, the underline or strikethrough may be applied to the handwriting in the editing target area 81 as a cursive handwriting.

9 and 10 are diagrams for describing a method of applying a bullet according to an embodiment of the present invention.

According to FIG. 9, a bullet may be applied to the selected editing target region 91. Specifically, the processor 120 calculates the line spacing and the average letter size in the editing target area 91, and when the bullet is selected through the UI screen to which the bullet or bullet number is applied, the selected bullet is selected. The head can be applied to the editing target area 91 based on the line spacing and the average letter size.

Here, the line spacing of the edit target region 91 is to extract the MER of each letter included in the edit target region 91, and based on the extracted MER, the line spacing exists at the bottom of the letters existing in the same line as the upper line. It may be calculated through a method of calculating the line spacing between the character 53 and the character 54 present at the top of the characters existing in the next line.

In addition, the average character size of the editing target region 91 may be calculated by extracting a MER for each character of the editing target region 91 and calculating a font size for each character based on the extracted MER.

In addition, according to FIG. 10, the user may apply the bullet registered in advance to the editing target region 101 by registering the bullet in the handwriting input in advance and selecting the registered bullet. Accordingly, since a bullet similar to the font of the writing area can be applied, readability and deterioration can be prevented by improving the unity or unity of the font.

On the other hand, when a new writing is input to the editing target area, the processor 120 may replace the editing target area with the new writing, and rearrange the area where the writing is made based on the replaced writing by the editing units. have. Details thereof will be described in detail with reference to FIG. 11.

FIG. 11 is a diagram for describing a method of replacing or moving a writing in an editing target area, according to an exemplary embodiment.

As shown in (a) of FIG. 11, the user selects "to the day of the sky" which is the editing target region 111, and the new writing "heart" is overlaid on the selected editing target region 111. Editing can be performed by overwriting "." In this case, the processor 120 may rearrange the regions in which the writing is performed based on the replaced writing by editing units, replacing “to the sky” with “heart”. That is, the processor 120 may rearrange "dead," "heartly," and "look up" at regular intervals, while eliminating the white space resulting from the replaced handwriting. In this case, the repositioning interval may be determined by calculating an average font size of letters in the handwritten area.

FIG. 11B illustrates an embodiment in which writing of an editing target area is moved to another area.

When a handwriting movement command for moving the position of the handwriting included in the editing target area to another area in which the writing is made is input, the processor 120 moves the position of the writing included in the editing target area according to the writing movement command. The writing order of the writing area may be rearranged for each editing unit based on the moved writing position.

Referring to (b) of FIG. 11, the user selects "to the sky" which is the editing target region 111, and the fourth line "I suffered" and the fifth line " One line can be newly created by moving the stars 112 to " with stars singing stars. &Quot;

At this time, the processor 120 rearranges the "death" and "look up" of the first line at a certain spacing interval, and performs a calculation to uniformly narrow the line spacing of the writing area based on the height of the input window The line spacing can be set according to the result of the calculation performed. Accordingly, when the editing target area 111 "to the sky until day" is moved to the corresponding area 112, the writing may be automatically aligned according to a predetermined spacing interval and a set line spacing.

FIG. 12 is a diagram for describing a method of copying and pasting a writing in an editing target area, according to an exemplary embodiment.

According to FIG. 12, when the user wants to select a writing area of "one point shy to the sky" as the editing target area in the writing area, dragging from the front of "up to the day" to the back of the "shy" Thus, the writing area can be selected. A block 1201 may be set in the editing target area “one point shy up to the sky”.

Once the block 1201 is set, a UI menu 1202 is displayed for selecting options such as 'cut', 'copy', 'delete', 'clipboard' and 'add area' for the edit target area. Can be.

When the user wants to copy the editing target area, the user may select the 'copy' option from the UI menu 1202 to perform copying. As shown in FIG. You can also do a 'paste'. If 'cut' is performed on the edit target area, 'paste' is performed in the same manner as described above, and the edit target area in which the cut is performed is removed, and the writing area is rewritten for each editing unit. Can be arranged.

13A and 13B are diagrams for describing a method of inputting a figure, according to an exemplary embodiment.

According to FIG. 13A, a user may draw a figure and a figure drawn corresponding to a shape drawn by the user may be transformed into a basic shape.

Specifically, when the user wants to input a rectangle, the user draws a line in the shape of a rectangle 132, and when the user wants to input a square, the user draws a line in the shape of a square 133, thereby inputting a basic shape of the rectangle or square. Can be.

However, as shown in FIG. 13A, in order to further increase the accuracy of figure recognition, the user may first perform a task of preselecting a figure to be drawn in the figure selection UI 131. For example, when drawing an arrow, the user may first select an arrow shape on the figure selection UI 131 before drawing the arrow 134.

Accordingly, the processor 120 may first receive information that the figure drawn by the user is an arrow, and thus, the arrow 134 drawn by the user may be transformed into a basic arrow shape whose size or shape is somewhat changed, and is a rectangle. It can be prevented from being deformed into shapes other than the back arrow.

In the same manner as above, the user first selects the horsehead figure in the figure selection UI 131 and draws the horsehead figure 135, thereby allowing the user to intuitively input a basic horseman figure of a desired size and shape.

As shown in FIG. 13B, the basic shape of the arrow may be determined by extracting feature points such as a corner point and a control point of the figure drawn by the user.

In detail, the processor 120 may extract a corner point of the figure drawn by the user and correct the drawing input angle. Thereafter, the processor 120 may calculate an average of symmetric lengths and correct the relative lengths of the line segments forming the figure according to the calculated average length. Accordingly, the processor 120 may replace the arrow figure drawn with the basic arrow figure corresponding to the corrected result.

14A and 14B are diagrams for describing a method of inputting a registered object, according to an exemplary embodiment.

According to FIG. 14A, a user may register a simple symbol that matches a specific image. Here, the specific image may be an image stored in the storage unit or an external server. Accordingly, when a user writes a registered simple symbol, the input simple symbol may be converted into a specific image to be matched.

Specifically, referring to FIG. 14A, a star figure 141 in which each line segment does not cross is matched to a star figure 142 in which each line segment is expressed more simply, and a face figure 143 of a smiling person is shown. ) Is matched to the face picture 144 represented more simply.

In this case, when the user draws and inputs a star figure 142 where each line segment intersects, the processor 120 recognizes the drawn star figure 142 and matches the recognized star figure 142 thereto. Each line segment can be converted into a star figure 141 that does not intersect.

In addition, an external image or photo 145 representing the cuttlefish may be matched to the simply represented cuttlefish picture 146. As shown in FIG. 14B, when the user draws and inputs the simply represented squid picture 146, the processor 120 recognizes the drawn squid picture 146 and attaches the recognized squid picture 146 to it. The image may be converted into a matching external image or photo 145 to be displayed. In this case, the converted external image or photo 145 may be automatically scaled and displayed to fit the size of the drawn squid figure 146.

Meanwhile, the processor 120 may generate a text box in the selected edit target area and edit the text box based on the editing unit according to a user command for the text box. Details thereof will be described in detail with reference to FIGS. 15A to 16.

15A to 16 are diagrams for describing a method of creating and editing a text box, according to an exemplary embodiment.

According to FIG. 15A, a user may create a text box by drawing a line surrounding an area where a writing input is made. Specifically, when the user draws an outline 151 such as a square shape on the area where the writing input is made, the processor 120 calculates the shape and margin of the outline, and applies the margin option to the outline 151, thereby providing a text box. 152 may be generated. That is, the processor 120 may apply a margin option so that a certain margin is generated in the text box 152 corresponding to the MER including the handwriting included in the outline 151.

Accordingly, the handwriting included in the text box 152 and the text box 152 may be grouped and moved, rotated, and edited as one object. In this case, the outline of the text box 152 may be set to be invisible, and the background color of the text box 152 may be set.

As shown in FIG. 15B, when the size or shape of the text box 152 is adjusted, the handwriting included in the text box 152 may be rearranged for each editing unit based on the adjusted size of the text box 152. .

In detail, the processor 120 may calculate the width of the newly adjusted text box 152 and relocate the handwriting by editing units to correspond to the calculated width. Accordingly, even if the size or shape of the text box 152 is adjusted, the readability of the input handwriting may be minimized.

In addition, as shown in FIG. 16, when a new handwriting 162 is input near the outline of the text box 161 or superimposed on the outline, the text box 161 is sized to include the new handwriting 162. Can be adjusted.

Specifically, as shown in FIG. 16, when the new handwriting 162 is input by overlapping with an outline, the processor 120 calculates a new boundary 163 to include the new handwriting 162 with respect to the overlapping outline. The size of the text box 161 can be adjusted. In this case, the processor 120 may resize the text box 161 by applying a margin option so that a certain margin is generated in the text box 161.

On the other hand, when a table generation command for the editing target area is input, the processor 120 analyzes a row and a column for distinguishing the handwriting included in the editing target area based on the editing unit, and based on the analysis result, the editing target. You can create a table with the characters contained in the region divided into rows and columns. Details thereof will be described in detail with reference to FIGS. 17 and 20B.

17 and 18 are diagrams for describing a method of generating a table according to one embodiment of the present invention.

As shown in FIG. 17, the processor 120 analyzes the structure of the handwriting input in the selected editing target area 171 based on the interval between the editing unit and the editing unit, and divides the area according to the analysis result. (173) may be generated. Specifically, the processor 120 may determine them as letters existing on the same first line, based on the position of the "element", the "periodic number", the "feature", and the text recognition result. Further, based on the position of "hydrogen", "1", "lightest" and the text recognition result, they can be judged as characters existing in the same second line.

Meanwhile, the processor 120 may determine these as the letters existing in the same first column based on the text recognition results of "element", "hydrogen", "carbon", and "oxygen". Further, based on the text recognition results of "periodic number", "1", "6", and "8", these can be judged as characters existing in the same second column.

As described above, the processor 120 analyzes the rows and columns of the editing target region 171, and generates a table 173 in which the writings included in the editing target region 171 are divided into the same rows and columns based on the analysis result. can do. Meanwhile, when writing in the selected editing target area 172 is input unevenly, the table 173 may be generated by rearranging the writing so that the arrangement is even.

Meanwhile, as illustrated in FIG. 18, the user may draw a table by handwriting input to generate a table reflecting the intended size of the cell. In this case, the processor 120 may replace the drawn table 181 by extracting the feature points of the drawn table 181 and recognizing and generating the basic table 182 corresponding to the extracted feature points.

19A to 20B are diagrams for describing a method of editing a table according to an embodiment of the present invention.

As shown in FIG. 19A, when the handwritten input “element” 193 in the drawn table is input in an incorrect position of the cell, the processor 120 automatically adjusts the cell height according to the height of the handwritten input text. The input handwriting may be adjusted or moved so that the input handwriting is included in one of the cells 191 and 192 overlapped. In addition, the processor 120 may generate a basic table corresponding to the drawn table to replace the drawn table.

In addition, as illustrated in FIG. 19B, when a handwriting input is to be added to a cell 194 in the generated table, the handwriting 195 may be input to overlap one outline of the cell 194. The handwriting 195 may be further moved to be included in the cell 194. At this time, the size of the table and the size of the cells constituting the table can be automatically adjusted.

Meanwhile, as the borders of cells constituting the generated table are dragged, the sizes of the cells may be adjusted, and new lines or columns may be generated as lines crossing each cell are drawn.

Specifically, as illustrated in FIG. 19C, in the generated table, when a size 196 of cells corresponding to any row or column is to be adjusted in a batch, a vertical line of the row or column is selected. By adjusting the position, such as by dragging, the size of the cell 196 can be adjusted. At this time, the size of the table and the size of the cells constituting the table can be automatically adjusted.

In addition, as shown in FIG. 20A, when a line 201 intersects a cell in a column in the generated table, a new column 202 may be additionally generated based on the drawn line 201. .

Similarly, according to FIG. 20B, in the generated table, when a line 203 dividing any cell is drawn, a new single cell 204 based on the drawn line 203 may be additionally generated. .

21A and 21B are diagrams for describing a method of outputting a calculation result of a formula, according to an exemplary embodiment.

According to FIG. 21A, in a table, when a calculation is to be performed by using numbers input in one column or row, a multi-cell to be calculated is selected and a function is input to a cell to output the calculation result. The calculation result can be output.

For example, as shown in FIG. 21A, a user enters numbers from the top to the fourth cell of a table of 5 rows and 1 columns, selects a formula calculation mode, and then selects the cell from top to fourth cells to be calculated. Can be selected. At this time, a list of frequently used functions may be displayed to inform the user.

Subsequently, if a handwriting input of 'Sum', which is a command for calculating the sum of all the handwritten input numbers in the last fifth cell, is performed, the calculation result may be output to the fifth cell.

In this case, the user may register the numeric handwriting in advance, and the calculation result may be output as the registered numeric handwriting.

Meanwhile, as illustrated in (a) of FIG. 21B, when the user selects multiple cells, a frequently used function list may be displayed near the multiple cells, and the user may select one of the function lists.

In addition, according to (b) of FIG. 21B, by inputting a formula for the selected multiple cell into the fifth cell from the top, a calculation result based on the formula may be output. At this time, the formula may be input out of the cell area.

In (b) of FIG. 21B, A, B, C, and D are alphabets indicating position indications by cells, where A is the first cell from the top, B is the second cell, C is the third cell, and D is the fourth cell. Correspond to the handwritten input number.

FIG. 22 is a block diagram illustrating in detail a configuration of a display device configuring a handwriting input device according to an exemplary embodiment. As illustrated in FIG. 22, the handwriting input device 100 ′ according to another embodiment of the present invention may include a touch screen 110, a processor 120, a communication unit 130, a storage 140, and an audio processor 150. ), An audio output unit 160 and a user interface unit 170. Hereinafter, descriptions of parts overlapping with the description in FIG. 1 will be omitted.

The communication unit 130 is a component that performs communication with an external device. The communication unit 130 may communicate with an external device through various communication methods such as BT (BlueTooth), Wi-Fi (Wireless Fidelity), Zigbee, IR (Infrared), and NFC (Near Field Communication).

The storage 140 stores a variety of modules for driving the handwriting input device 100 ′.

In more detail, the storage 140 may include a base module for processing signals transmitted from hardware included in the handwriting input device 100 ′, a storage module for managing a database (DB) or a registry, a security module, a communication module, and the like. Can be saved. In particular, the storage 140 may store a handwriting recognition module that can recognize handwriting by extracting feature points for the input handwriting.

The audio processor 150 is a component that processes audio data.

The audio output unit 160 is a component for outputting an audio signal. The audio output unit 160 may include a receiver terminal and a speaker.

The user interface unit 170 is a component for detecting a user interaction for controlling the overall operation of the handwriting input device 100 ′.

The processor 120 controls the overall operation of the handwriting input device 100 ′ using various modules stored in the storage 140.

As shown in FIG. 22, the processor 120 includes a RAM 121, a ROM 122, a handwriting recognition unit 123, a graphics processing unit 124, a main CPU 125, and first through n-th interfaces 126-. 1 to 126-n) and a bus 127. At this time, the RAM 121, the ROM 122, the handwriting recognition unit 123, the graphics processing unit 124, the main CPU 125, the first to n interfaces 126-1 to 126-n, and the like, are connected to the bus 127. Can be connected to each other.

The ROM 121 stores a command set for system booting. The main CPU 125 copies various application programs stored in the storage 140 to the RAM 121 and executes the application programs copied to the RAM 121 to perform various operations.

The handwriting recognition unit 123 may recognize the handwriting input through the touch screen 110 as text using the handwriting recognition module and the character feature information stored in the storage 140. In detail, the handwriting recognition unit 123 forms a displacement signal that is moved with a certain trajectory according to the movement of a finger or the electronic pen as character data having a specific pattern, and stores character characteristic information corresponding to the formed character data of the specific pattern. The character may be recognized through the character conversion algorithm extracted from the unit 140.

The graphic processor 124 generates a screen including various objects such as an icon, an image, and a text by using a calculator (not shown) and a renderer (not shown). The calculator calculates attribute values such as coordinates, shapes, sizes, and colors in which objects are displayed according to the layout of the screen. The renderer generates screens of various layouts including objects based on the attribute values calculated by the calculator.

The main CPU 125 accesses the storage 140 and performs booting using the operating system stored in the storage 140. In addition, the main CPU 125 performs various operations using various programs, contents, data, etc. stored in the storage 140. In particular, the main CPU 125 controls the handwriting recognition of the handwriting recognition unit 123 using the handwriting recognition module stored in the storage 140.

The first to n interfaces 126-1 to 126-n are connected to the aforementioned various components. One of the interfaces may be a network interface connected to an external device through a network.

23 is a flowchart illustrating a control method of a handwriting input device according to an embodiment of the present invention.

First, on a touch screen displaying a handwriting according to a user touch input, text recognition of the handwriting is performed (S2310).

Thereafter, editing units for handwriting are classified based on text recognition (S2320). The editing unit may be one character or word.

Thereafter, the editing operation for the writing is performed based on the editing units classified in correspondence with the user command (S2330). In this case, when the user command is a selection command for at least one region in which the writing is performed, the editing target region may be selected by dividing the writing included in the selected region based on the editing unit. When a size change command for changing the size of the handwriting included in the editing target area is input, the size of the handwriting may be determined for each editing unit, and the size of the handwriting may be adjusted for each editing unit to correspond to the size change command. Also, when a line spacing change command for changing line spacing between writings included in the editing target area is input, the line spacing between writings is determined for each editing unit, and the line spacing between writings is adjusted to correspond to the line spacing changing command. You can adjust it by editing unit.

In the performing of the editing operation, when a new writing is input for the editing target area, the editing target area may be replaced with the new writing, and the writing operation may be rearranged for each editing unit based on the replaced writing. have.

As described above, according to various embodiments of the present disclosure, in the creation and editing of a document through a handwriting input, the user's convenience in document creation and editing through a keyboard input may be maintained, thereby improving user convenience.

According to various embodiments of the present disclosure, a control method of a writing input device may be implemented as a program and stored in various recording media. That is, a computer program processed by various processors and capable of executing the various control methods described above may be used in a state stored in a recording medium.

For example, performing text recognition on writing according to a user's touch input, classifying editing units for writing based on text recognition, and based on editing units classified according to user commands, A non-transitory computer readable medium may be provided that stores a program including performing an editing operation.

A non-transitory readable medium refers to a medium that stores data semi-permanently and is read by a device, not a medium that stores data for a short time such as a register, a cache, or a memory. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, a DVD, a hard disk, a Blu-ray disk, a USB, a memory card, a ROM, or the like.

Although the above has been shown and described with respect to preferred embodiments of the present invention, the present invention is not limited to the specific embodiments described above, it is usually in the art to which the invention belongs without departing from the spirit of the invention claimed in the claims. Various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

100: handwriting input device 110: touch screen
120: processor

Claims (20)

A touch screen for displaying handwriting according to a user touch input; And
Perform text recognition on the handwriting, classify the handwriting into one or more editing sections according to the editing unit based on the text recognition, and perform a editing operation on the handwriting based on the editing unit when a user command is input; A processor;
The processor,
When a user command to select at least one region of the region where the writing is displayed is input, an editing target region including at least one editing section corresponding to the selected region is selected, and a new writing is overlaid on the selected editing target region. If it is written, the writing input device replaces the one or more editing sections included in the editing target area with the new writing, and rearranges the area in which the writing is displayed according to the editing unit based on the replaced writing. delete The method of claim 1,
The processor,
When a size change command for changing the size of the handwriting included in the editing target area is input, the size of the handwriting is determined for each of the editing sections, and the size of the handwriting is adjusted for each of the editing sections so as to correspond to the size change command. Handwriting input device, characterized in that. The method of claim 1,
The processor,
When a line spacing change command for changing line spacing between writings included in the editing target region is input, the line spacing between the writings is determined for each of the editing sections, and the line spacing change command corresponds to the line spacing changing command. And a line spacing for each of the editing sections. delete The method of claim 1,
The processor,
When a handwriting movement command for moving the position of the handwriting included in the editing target region to another region of the region where the handwriting is displayed is input, the position of the handwriting included in the editing target region is moved according to the handwriting movement instruction. And reorder the writing order of the area where the writing is displayed based on the edited unit, based on the editing unit. The method of claim 1,
The processor,
And a text box in the selected editing target area, and editing the text box based on the editing unit according to a user command for the text box. The method of claim 1,
The processor,
When a table generation command for the editing target region is input, the rows and columns for classifying the handwriting included in the editing target region are analyzed based on the editing unit, and included in the editing target region based on the analysis result. A handwriting input device for generating a table in which handwritten notes are divided into rows and columns. The method of claim 1,
The processor,
And when the user command is a command for adjusting the size of the input window in which the writing is displayed, relocating the writing according to the editing unit based on the adjusted size of the input window. The method of claim 1,
The editing unit,
Handwriting input device, characterized in that one character (Character) or word (Word). In the control method of the handwriting input device,
Performing text recognition on the handwriting on a touch screen displaying a handwriting according to a user touch input;
Dividing the handwriting into one or more editing sections according to an editing unit based on the text recognition; And
And performing an editing operation on the handwriting based on the editing unit when a user command is input.
The step of performing the editing operation,
When a user command to select at least one region of the region where the writing is displayed is input, an editing target region including at least one editing section corresponding to the selected region is selected, and a new writing is overlaid on the selected editing target region. If written, the one or more editing sections included in the editing target area are replaced with the new writing, and the area in which the writing is displayed based on the replaced writing is rearranged according to the editing unit. delete The method of claim 11,
The step of performing the editing operation,
When a size change command for changing the size of the handwriting included in the editing target area is input, the size of the handwriting is determined for each of the editing sections, and the size of the handwriting is adjusted for each of the editing sections so as to correspond to the size change command. Control method characterized in that. The method of claim 11,
The step of performing the editing operation,
When a line spacing change command for changing line spacing between writings included in the editing target region is input, the line spacing between the writings is determined for each of the editing sections, and the line spacing change command corresponds to the line spacing changing command. And adjusting the line spacing for each editing section. delete The method of claim 11,
The step of performing the editing operation,
When a handwriting movement command for moving the position of the handwriting included in the editing target region to another region of the region where the handwriting is displayed is input, the position of the handwriting included in the editing target region is moved according to the handwriting movement instruction. And rearranging the writing order of the area where the writing is displayed based on the editing unit based on the moved writing position. The method of claim 11,
The step of performing the editing operation,
And generating a text box in the selected editing target area and editing the text box based on the editing unit according to a user command for the text box. The method of claim 11,
The step of performing the editing operation,
When a table generation command for the editing target region is input, the rows and columns for classifying the handwriting included in the editing target region are analyzed based on the editing unit, and included in the editing target region based on the analysis result. And a table in which the written notes are divided into rows and columns. The method of claim 11,
The step of performing the editing operation,
And when the user command is a command for adjusting the size of the input window in which the writing is displayed, repositioning the writing according to the editing unit based on the adjusted size of the input window. The method of claim 11,
The editing unit,
Control method, characterized in that one character (Character) or word (Word).

Images