CN112740151A

CN112740151A - Data input method of terminal equipment, terminal equipment and storage medium

Info

Publication number: CN112740151A
Application number: CN201880097847.2A
Authority: CN
Inventors: 黄千洋
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Priority date: 2018-11-08
Filing date: 2018-11-08
Publication date: 2021-04-30
Also published as: WO2020093329A1

Abstract

The application provides a data input method of a terminal device, the terminal device and a computer readable storage medium, wherein the method comprises the following steps: after a calculator application in terminal equipment is started, monitoring handwriting input operation in a handwriting input interface of the calculator application, if the handwriting input operation in the handwriting input interface of the calculator application is monitored, generating a handwriting track according to handwriting information input by the handwriting input operation, and after the handwriting input operation is detected to be finished, identifying the handwriting track to obtain an identification result, wherein the identification result comprises one or more characters, and the characters comprise: arabic numerals and mathematical symbols can improve the efficiency of character input in the application of the calculator at present.

Description

Data input method of terminal equipment, terminal equipment and storage medium

Technical Field

The present application belongs to the technical field of input methods, and in particular, to a data input method for a terminal device, and a computer-readable storage medium.

Background

With the development of terminal device technology, the traditional calculator function has been widely applied to various terminal devices, and users can enjoy the calculator function only by using the terminal devices. Due to the adoption of the touch screen, the calculator function on the terminal equipment also realizes the input of mathematical symbols mainly through virtual buttons displayed on the touch screen.

At present, the interface of a calculator on a terminal device mainly comprises two areas: the device comprises an input area and a display area, wherein the input area provides characters (Arabic numerals and mathematical symbols) for a user to click and select, and the display area is used for displaying the characters or operation results and the like clicked and selected by the user.

Disclosure of Invention

The application provides a data input method of a terminal device, the terminal device and a computer readable storage medium, so as to improve the efficiency of character input in the current calculator application.

A first aspect of the present application provides a data input method for a terminal device, including:

after a calculator application in terminal equipment is started, monitoring handwriting input operation in a handwriting input interface of the calculator application;

if the handwriting input operation in a handwriting input interface applied by the calculator is monitored, generating a handwriting track according to handwriting information input by the handwriting input operation;

after the handwriting input operation is detected to be finished, recognizing the handwriting track to obtain a recognition result, wherein the recognition result comprises one or more characters, and the characters comprise: arabic numerals and mathematical symbols.

A second aspect of the present application provides a terminal device, comprising:

the handwriting information monitoring unit is used for monitoring handwriting input operation in a handwriting input interface of the calculator application after the calculator application in the terminal equipment is started;

the handwriting track generating unit is used for generating a handwriting track according to handwriting information input by the handwriting input operation if the handwriting input operation in a handwriting input interface applied by the calculator is monitored;

a character recognition unit, configured to, after detecting that the handwriting input operation is ended, recognize the handwriting trajectory to obtain a recognition result, where the recognition result includes one or more characters, and the characters include: arabic numerals and mathematical symbols.

A third aspect of the present application provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the method provided in the first aspect of the embodiment of the present application when executing the computer program.

A fourth aspect of the present application provides a computer-readable storage medium storing a computer program which, when executed by one or more processors, performs the steps of the method provided by the first aspect of an embodiment of the present application.

A fifth aspect of the application provides a computer program product comprising a computer program which, when executed by one or more processors, performs the steps of the method provided by the first aspect of the application.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1 is a schematic flow chart illustrating an implementation of a data input method of a terminal device according to an embodiment of the present application;

FIG. 2 is a schematic diagram illustrating an effect of a display interface of a calculator application according to an embodiment of the present application;

FIG. 3 is a diagram illustrating an effect of a handwriting input process of a calculator application according to an embodiment of the present application;

fig. 4 is a schematic implementation flow chart of another data input method for a terminal device according to an embodiment of the present application;

FIG. 5 is a schematic diagram illustrating a handwriting input direction in a landscape state according to an embodiment of the present application;

FIG. 6 is a diagram illustrating a handwriting input direction in a vertical screen state according to an embodiment of the present application;

fig. 7 is a schematic diagram illustrating an effect of dividing an area where a handwriting track is located into a plurality of sub-areas according to an embodiment of the present application;

fig. 8 is a schematic implementation flow chart of another data input method for a terminal device according to an embodiment of the present application;

fig. 9 is a schematic effect diagram of a process of dividing a region where a handwriting track is located into a plurality of sub-regions through a sliding window according to an embodiment of the present application;

fig. 10 is a schematic block diagram of a terminal device provided in an embodiment of the present application;

fig. 11 is a schematic block diagram of another terminal device provided in an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It is also to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to a determination" or "in response to a detection". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".

In order to explain the technical solution described in the present application, the following description will be given by way of specific examples.

Fig. 1 is a schematic implementation flow diagram of a data input method of a terminal device according to an embodiment of the present application, and as shown in the drawing, the method may include the following steps:

step S101, after a calculator application in terminal equipment is started, monitoring handwriting input operation in a handwriting input interface of the calculator application.

In the embodiment of the application, a calculator application can be installed in the terminal device, and after the computer application is started, a handwriting input interface is displayed on a display interface of the terminal device. Certainly, after the calculator application is started, a preset button may be set on the display interface of the terminal device, and the user may switch between the handwriting input interface and the button input interface (which does not support handwriting) through the preset button. Or one interface is taken as a default interface, and the default interface is directly displayed after the calculator application is started. The handwriting input interface provides a region for a user to perform handwriting input operation. The handwriting input operation may be a touch operation. For example, a user performs a touch operation with a finger or a stylus pen on a handwriting input interface to input handwritten information.

Step S102, if the handwriting input operation in the handwriting input interface of the calculator application is monitored, generating a handwriting track according to the handwriting information input by the handwriting input operation.

In the embodiment of the application, if the monitoring of the handwriting input operation in the handwriting input interface of the calculator application indicates that the touch operation in the handwriting input interface is monitored. For example, a sensor is disposed in a display screen of the terminal device, if a sensor sensing a touch of a user exists, it indicates that a handwriting input operation in a handwriting input interface of the calculator application is monitored, and a position (coordinate) of the sensor sensing the touch of the user in an area where the handwriting input interface is located is recorded as handwriting information. In one handwriting input operation, the positions (coordinates) of all sensors which feel the touch of the user in the handwriting input interface are combined to generate a handwriting track.

As another embodiment of the present application, after generating a handwriting track according to handwriting information input by the handwriting input operation, the method further includes:

and displaying the handwriting track according to the position of the handwriting information in the handwriting input interface.

In the embodiment of the application, in order to facilitate the user to view the written characters, the handwriting track may be displayed in the handwriting input interface, and during the display, the handwriting track is displayed according to the position (coordinates) of the handwriting information in the handwriting input interface. By way of example, the location (sensor location or coordinates) touched by the user is displayed in a color different from the background color of the handwriting input interface.

Fig. 2 is a schematic diagram illustrating an effect of a display interface of a calculator application according to an embodiment of the present application, where as shown in fig. 2, after a user inputs "1024" by handwriting in a handwriting input interface, a handwriting track "1024" is displayed by a color different from a background color of the handwriting input interface.

Step S103, after detecting that the handwriting input operation is finished, recognizing the handwriting track to obtain a recognition result, wherein the recognition result comprises one or more characters, and the characters comprise: arabic numerals and mathematical symbols.

In this embodiment of the present application, the display interface of the terminal device further includes: a virtual button; as shown in fig. 2, the display interface includes a handwriting input interface and virtual buttons. The user can input characters by handwriting on a handwriting input interface, and the user can input the characters by clicking a selection virtual button. Other arrangements between the handwriting input interface and the virtual buttons in fig. 2 are also possible, and there may be no clear boundary between the handwriting input interface and the virtual buttons for dividing the handwriting input interface and the virtual buttons.

The characters in the embodiment of the application may include: arabic numerals (0, 1, 2, 3, 4, 5, 6, 7, 8, 9), mathematical symbols (., +, -,/, etc.). Of course, in practical application, other calculator-related characters can be set according to requirements.

When the set virtual buttons include ·, +, -, ×, ÷ and ═ then, after the arabic numbers input in the interface are handwritten, the method has the function of recognizing the arabic numbers. When the set virtual button does not include the decimal point, the method has a function of recognizing the decimal point. When the set virtual button does not include +, -, ×, ÷ x, or ═ then the method has a function of recognizing +, -, ×, ÷ or ═ v. In principle, the method can realize the functions of a calculator for characters which can be recognized by a handwriting track input by the handwriting input interface and characters in a virtual button.

As another embodiment of the present application, after detecting that the handwriting input operation is ended, recognizing the handwriting trajectory to obtain a recognition result includes:

and if the new touch operation is not monitored within the preset time after the touch operation in the handwriting input interface disappears, determining that the handwriting input operation is finished, and identifying the handwriting track to obtain an identification result.

Alternatively, the first and second electrodes may be,

and if the operation of clicking the virtual button is monitored, determining that the handwriting input operation is finished, and identifying the handwriting track to obtain an identification result.

In the embodiment of the application, at least two ways can be provided to judge whether the current handwriting input operation is finished, wherein the handwriting input operation can be touch operation, and the calculator application provided by the embodiment of the application can identify a plurality of characters input by a user at one time, so that one touch operation can be included in one handwriting input operation, for example, one touch operation of Arabic numeral 1 can be finished; multiple intermittent touch operations may also be included, for example, where the Arabic numeral 10 requires two intermittent touch operations. Since the user is allowed to input a plurality of characters by handwriting, it is necessary to determine whether the user needs the calculator application to recognize the character when writing 1, 10, or continues to input other characters after 10. The judgment mode can be that if no new touch operation is performed in the handwriting input interface within the preset time after the user lifts the finger after the touch operation is performed in the handwriting input interface, the handwriting input operation is determined to be finished; or after the user performs touch operation in the handwriting input interface, detecting the operation of clicking the virtual button, and determining that the handwriting input operation is finished.

For example, in the effect diagram of the handwriting input process shown in fig. 3, after the user enters "1024" by handwriting in the handwriting input interface, the user clicks the virtual button "+" to indicate that the current handwriting input is finished, and then "1024" handwritten by the user in the handwriting area may be recognized to obtain a recognition result, which is 1024. After the user enters "+" through the virtual buttons, the user may also continue to enter a plurality of mathematical symbols "168". Certainly, after the user inputs 1024 on the handwriting input interface, the user may also pause for a time longer than the preset time, and as long as no new touch operation is monitored within the preset time after the touch operation in the handwriting input interface disappears, it is determined that the current handwriting input is finished.

As can be seen from fig. 2 and 3, a user may hand-write multiple characters at a time in a handwriting input interface, and then the calculator application may recognize the multiple characters. The problem that the process of finding a plurality of virtual buttons by a user is long when all characters to be input are input through the virtual buttons is solved; the problem that the process of recognizing one character only by inputting one character each time in the hand-written input is long is also solved; thus, the efficiency of inputting characters in calculator applications can be improved.

As another embodiment of the present application, the respectively recognizing the handwriting trajectory in each sub-region, and obtaining the character corresponding to the handwriting trajectory in each sub-region includes:

and matching the handwriting tracks in each sub-area with a plurality of preset character templates respectively to obtain characters corresponding to the handwriting tracks in each sub-area respectively.

In the embodiment of the present application, templates of characters that can be recognized by the calculator application are pre-stored, for example, if the set calculator application has a function of recognizing arabic numerals for the handwritten traces, the templates of characters that are arabic numerals may be stored in a preset database. If the calculator application has the function of identifying the Arabic numerals and the decimal points, the Arabic numerals and the decimal point templates can be stored in a preset database, and if the calculator application also has the function of identifying the mathematical operation symbols, the mathematical operation symbol templates can be stored in the preset database. After the plurality of sub-areas are divided, the handwriting track of one character in each sub-area can be identified, and the handwriting track in each sub-area can be matched with a plurality of preset character templates in the identification process, so that characters corresponding to the handwriting track in each sub-area are obtained. In the specific matching process, the character corresponding to the character template with the highest matching degree may be used as the character corresponding to the handwriting track in the current sub-area.

As another embodiment of the present application, before matching the handwriting trajectory in each sub-region with a plurality of preset character templates, the method further includes:

displaying characters of a template to be set and a template input interface, and monitoring handwritten information input through the template input interface;

and if the handwritten information input through the template input interface is monitored, generating a handwritten track based on the handwritten information input through the template input interface, and taking the current handwritten track as a character template corresponding to the character of the template to be set.

In the embodiment of the application, because the handwriting modes of different users for the same character are not completely the same, in order to accelerate the matching efficiency and the matching accuracy, the corresponding character can be input by the user through handwriting, and the character input by the user through handwriting is stored as a template. Characters (e.g. 6) of templates to be set and a template input interface can be displayed on a display interface of the terminal device, a user writes the input 6 on the template input interface, then a handwriting track is generated from handwriting information in the template input interface, and the handwriting track 6 handwritten by the user is taken as a character template corresponding to the characters 6. In this way, the efficiency and accuracy of matching can be improved.

Fig. 4 is a flowchart of another handwriting input method provided in an embodiment of the present application, and fig. 4 describes how to recognize the handwriting trajectory to obtain a recognition result based on the embodiment shown in fig. 1, and as shown in the figure, the method may include the following steps:

step S401, recognizing the handwriting trace to obtain one or more characters corresponding to the handwriting trace.

In the embodiment of the application, a handwriting input direction can be acquired, and the area where the handwriting track is located is divided into one or more sub-areas based on the handwriting input direction; and respectively identifying the handwriting track in each sub-area to obtain characters corresponding to the handwriting track in each sub-area.

The handwriting input direction may be in a left-to-right order on the display interface from a user's perspective when the user is facing the display interface of the calculator application. I.e. the handwriting input direction is the direction in which the user inputs characters.

As another embodiment of the present application, the acquiring a handwriting input direction includes:

and acquiring the handheld direction of the terminal equipment, and determining the handwriting input direction according to the handheld direction of the terminal equipment.

In this embodiment of the application, when the terminal device is a portable terminal device such as a mobile phone and a tablet personal computer, a handheld direction of the terminal device may be obtained, and usually, a plurality of sensors (for example, gravity sensors) may exist in the terminal device, where the handheld direction of the terminal device may be a handheld direction corresponding to a landscape screen state or a handheld direction corresponding to a portrait screen state, and if the handheld direction of the terminal device is a handheld direction corresponding to a landscape screen state, the handwriting input direction is a direction from left to right (a user's viewing angle) in a display interface in the landscape screen state of the terminal device, as shown in fig. 5, a direction identified in the drawing is a handwriting input direction in the landscape screen state; similarly, when the handheld direction of the terminal device is the handheld direction corresponding to the vertical screen state, the handwriting input direction is the direction from left to right (the user's view angle) in the display interface in the vertical screen state of the terminal device, as shown in fig. 6, the direction indicated in the drawing is the handwriting input direction in the vertical screen state.

As another embodiment of the present application, when the handwriting input operation is a multiple-intermittent touch operation, the acquiring a handwriting input direction includes:

and generating a curve according to the starting point position of the multi-touch operation, and taking the baseline direction of the curve as the handwriting input direction.

In the embodiment of the application, since there may be multiple intermittent touch operations in one handwriting input operation of the user, for example, 168 three characters are written in the handwriting input interface at a time, there may be three touch operations, each touch operation is a touch operation from detecting the touch in the handwriting input interface until the touch disappears, and if the touch is written in 168, there may be three touch operations. The starting point position of the three touch operations may be generated into a curve, and the baseline direction of the curve may be used as the handwriting input direction.

In practical applications, the following manner of determining the handwriting input direction may be selected only when the aspect ratio of the area (rectangular area) where the handwriting track is located is greater than a preset value: and generating a curve according to the starting point position of the multi-touch operation, and taking the baseline direction of the curve as the handwriting input direction.

After the handwriting input direction is determined, dividing the area where the handwriting track is located into one or more sub-areas based on the handwriting input direction; and respectively identifying the handwriting track in each sub-area to obtain characters corresponding to the handwriting track in each sub-area.

In the embodiment of the present application, after the division into the multiple sub-regions, the arrangement direction of the multiple sub-regions is the handwriting input direction, for example, as shown in fig. 7, 168 characters are input by a user handwriting input operation in the handwriting input interface, and the region where the handwriting trajectory 168 is located is divided into 3 sub-regions along the handwriting input direction. And identifying the handwriting track in each sub-area to obtain characters corresponding to the handwriting track in each sub-area. As shown in fig. 7, the recognition result of the handwriting trajectory in the first sub-area is character 1, the recognition result of the handwriting trajectory in the second sub-area is character 6, and the recognition result of the handwriting trajectory in the third sub-area is character 8, in the handwriting input direction.

In step S402, if a character is obtained, the obtained character is used as a recognition result.

Step S403, if a plurality of characters are obtained, sorting the plurality of characters based on the positions of the handwriting trajectories corresponding to the characters, and using the sorted plurality of characters as recognition results.

In the embodiment of the present application, if the character is divided into one sub-region, that is, one character is recognized, the obtained character is a recognition result. If the characters are divided into a plurality of sub-regions, a plurality of characters may be recognized, and actually, a user has a sequence of a plurality of characters input by handwriting, so that the recognized characters need to be sorted, and characters corresponding to handwriting tracks in each sub-region can be sorted according to the sequence of the sub-regions in the handwriting input direction, that is, the characters are sorted based on the positions of the sub-regions corresponding to the characters respectively. Of course, the characters corresponding to the handwriting tracks in each sub-area may also be sorted according to the detected time of the touch operation corresponding to the handwriting track in each sub-area.

Fig. 8 is a flowchart of another handwriting input method provided in an embodiment of the present application, and fig. 8 describes how to divide an area where the handwriting track is located into one or more sub-areas based on the handwriting input direction on the basis of the embodiment shown in fig. 4, and as shown in the figure, the following steps may be included:

step S801, controlling a sliding window with a preset width to slide along the handwriting input direction in the area where the handwriting track is located, and obtaining a position of the sliding window when a first preset condition is met.

In this embodiment of the application, the area where the handwriting track is located may be an area where a minimum circumscribed rectangle of the handwriting track is located. As shown in fig. 9, the white frame at the outermost periphery of the handwriting trace 168 is the smallest circumscribed rectangle of the handwriting trace 168. The window at the position of W0 is a sliding window, the width of the sliding window may be preset, and the sliding window is controlled to slide in the smallest circumscribed rectangular area of the handwriting track along the sliding direction. The sliding direction may be a handwriting input direction, the width of the sliding window is preset, and the length of the sliding window is greater than or equal to the width of the minimum circumscribed rectangle in the direction perpendicular to the sliding direction. During the sliding of the sliding window, there are a plurality of positions, for example, the position of W1, the position of W2.

In the process that a sliding window with a preset width slides along the handwriting input direction in the area where the handwriting track is located, the area where the sliding window intersects with the handwriting track at each position in the handwriting input direction can be obtained. Meanwhile, along with the sliding of the sliding window, the area of the intersecting area of the sliding window and the handwriting track (or the number of pixel points in the intersecting area) is also changed, and a curve that the area of the intersecting area (or the number of pixel points) changes along with the position can be generated. And finding out the position of the sliding window when the position meets a first preset condition according to the area or the number of the pixel points.

As another embodiment of the present application, when obtaining the position of the sliding window when the first preset condition is met, the method may further include:

taking the position where the area of the area intersected with the handwriting track is smaller than a preset area as the position of the sliding window when a first preset condition is met;

or, the position where the number of the pixel points in the area intersected with the handwriting track is smaller than the preset number is used as the position of the sliding window when the first preset condition is met.

In the embodiment of the present application, different preset areas or different preset numbers may be set according to the sliding windows with different widths. When the width of the sliding window is smaller, the preset area and the preset number may also be set to 0, taking the preset area or the preset number as 0 as an example, in fig. 9, when the sliding window is at the position W1, the area where the sliding window and the handwriting track intersect is 0, and in the position W2, the area where the sliding window and the handwriting track intersect is greater than 0, so that the position W1 is the position of the sliding window when the first preset condition is met. W2 is not at the position of the sliding window when the first preset condition is met. Of course, in practical applications, there may be one or more positions of the sliding window when the first preset condition is satisfied, and W1 and W2 shown in fig. 9 are only for example and are not intended to limit the present invention.

Step S802, based on the position of the sliding window when a first preset condition is met, determining a center line of the sliding window when the first preset condition is met, and marking the center line as a boundary line, wherein the center line is perpendicular to the handwriting input direction.

In the embodiment of the present application, the position of the sliding window when the first preset condition is met may be used as a boundary between two sub-regions, and since the sliding window itself has a certain width, the position of the center line of the sliding window may be used as the position of the boundary between two sub-regions, and of course, the center line is selected to be the center line perpendicular to the sliding direction. In practical applications, the position of another line parallel to the center line in the area defined by the sliding window may be selected as the position of the boundary.

Step S803, determining a distance between any two adjacent boundary lines, merging the two adjacent boundary lines smaller than the first preset distance, and using the center line of the region defined by the two adjacent boundary lines smaller than the first preset distance as the merged boundary line.

Step S804, a new boundary line is generated between two adjacent boundary lines with a distance greater than the second preset distance and at a position satisfying the second preset condition.

In this embodiment of the present application, the generating of the new boundary line between two adjacent boundary lines with a distance greater than the second preset distance and at a position satisfying the second preset condition is:

and taking the central line of the area defined by two adjacent boundary lines which are larger than the second preset distance as a newly generated boundary line.

After the dividing line is determined, since the width, the preset area or the preset number of the set sliding window may be unreasonable, or when the user performs handwriting input in the handwriting input interface, different characters are too close to each other, so that the sub-regions divided by the obtained dividing line are unreasonable, for example, a plurality of dividing lines exist between a first character and a second character, or a dividing line does not exist between two characters. Therefore, it is necessary to process the obtained boundary lines, merge adjacent boundary lines with an excessively small distance (no character exists between adjacent boundary lines with an excessively small distance), and add a boundary line between adjacent boundary lines with an excessively large distance (a plurality of characters may exist between adjacent boundary lines with an excessively large distance), where a first preset distance and a second preset distance may be set, and a distance between two adjacent boundary lines with a smaller distance than the first preset distance is excessively small and a distance between two adjacent boundary lines with a larger distance than the second preset distance is excessively large. Thus, it is necessary to merge two adjacent dividing lines that are smaller than the first preset distance, take any line between the two adjacent dividing lines that is parallel to the dividing line as a new dividing line, and cancel the two adjacent dividing lines before merging, that is, merge the two dividing lines into one dividing line. It is also necessary to add a dividing line between two adjacent dividing lines which are larger than the second predetermined distance, i.e. two dividing lines are changed into three dividing lines.

In the merging process, a line between two adjacent dividing lines with the same distance between the two dividing lines can be selected as a new dividing line, and the two dividing lines are cancelled. In the process of adding a new boundary, a line between two adjacent boundaries, which is the same as the distance between the two boundaries, can be selected as the newly added boundary, and the two original boundaries are reserved. In the process of adding the new boundary, a position between two boundaries which meets other conditions can be selected as the position of the newly added boundary.

From the above analysis it follows that: the second preset distance is greater than the first preset distance. In addition, the width of the minimum bounding rectangle of the handwriting trajectory in the direction perpendicular to the handwriting input direction represents the height of one character, and a first preset distance may be set to be less than half of the character height, that is, the first preset distance is less than or equal to half of the width of the minimum bounding rectangle of the handwriting trajectory in the direction perpendicular to the handwriting input direction.

Step S805, based on the boundary, dividing the area where the handwritten trajectory is located into one or more sub-areas.

In this embodiment of the application, after performing merging processing or adding processing on dividing lines, a region where a handwritten trajectory is located may be divided into one or more sub-regions according to the dividing lines, where a determined dividing line is 0, it indicates that the region where the handwritten trajectory is located is one sub-region, and where a determined dividing line is at least 1, it indicates that the region where the handwritten trajectory is located is divided into at least two sub-regions. For example, as shown in fig. 7, the area where the handwriting track is located is divided into three sub-areas.

It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

Fig. 10 is a schematic block diagram of a terminal device according to an embodiment of the present application, and only a part related to the embodiment of the present application is shown for convenience of description.

The terminal device 10 may be a software unit, a hardware unit or a combination of software and hardware unit built in a mobile phone, a tablet computer, a notebook computer and other terminal devices, or may be integrated into the mobile phone, the tablet computer, the notebook computer and other terminal devices as an independent pendant.

The terminal device 10 includes:

the handwriting information monitoring unit 101 is configured to monitor a handwriting input operation in a handwriting input interface of a calculator application after the calculator application in the terminal device is started;

a handwriting track generating unit 102, configured to generate a handwriting track according to handwriting information input by a handwriting input operation if the handwriting input operation in a handwriting input interface of the calculator application is monitored;

a character recognition unit 103, configured to, after detecting that the handwriting input operation is ended, recognize the handwriting trajectory to obtain a recognition result, where the recognition result includes one or more characters, and the characters include: arabic numerals and mathematical symbols.

As another embodiment of the present application, the terminal device 10 further includes:

a display unit 104, configured to display a handwriting track according to a position of the handwriting information in the handwriting input interface after generating the handwriting track according to the handwriting information input by the handwriting input operation.

As another embodiment of the present application, the character recognition unit 103 is further configured to:

As another embodiment of the present application, the display interface of the terminal device further includes: a virtual button; correspondingly, the character recognition unit 103 is further configured to:

As another embodiment of the present application, the character recognition unit 103 includes:

a character recognition module 1031, configured to recognize the handwriting trajectory to obtain one or more characters corresponding to the handwriting trajectory;

a recognition result obtaining module 1032, configured to, if a character is obtained, take the obtained character as a recognition result;

the recognition result obtaining module 1032 is further configured to, if multiple characters are obtained, sort the multiple characters based on the positions of the handwriting tracks corresponding to the characters, respectively, and take the sorted multiple characters as recognition results.

As another embodiment of the present application, the character recognition module 1031 includes:

a region dividing submodule 10311, configured to obtain a handwriting input direction, and divide a region where the handwriting trajectory is located into one or more sub regions based on the handwriting input direction;

a character recognition submodule 10312, configured to respectively recognize the handwriting tracks in each sub-area, and obtain characters corresponding to the handwriting tracks in each sub-area;

correspondingly, the identification result obtaining module 1032 is further configured to:

and sequencing the characters based on the positions of the sub-regions corresponding to the characters respectively.

As another embodiment of the present application, the region division sub-module 10311 is further configured to:

As another embodiment of the present application, when the handwriting input operation is a multiple-time intermittent touch operation, the area division sub-module 10311 is further configured to:

and generating a curve according to the starting point position of the multi-touch operation, and taking the direction of the base line of the curve as the handwriting input direction.

controlling a sliding window with a preset width to slide along the handwriting input direction in the area where the handwriting track is located, and obtaining the position of the sliding window when a first preset condition is met;

determining a center line of the sliding window when a first preset condition is met based on the position of the sliding window when the first preset condition is met, and marking the center line as a boundary line, wherein the center line is perpendicular to the handwriting input direction;

and dividing the area where the handwriting track is located into one or more sub-areas based on the boundary.

and controlling a sliding window with a preset width to slide along the handwriting input direction in the area where the handwriting track is located, and obtaining the area where the sliding window intersects with the handwriting track at each position in the handwriting input direction.

determining a distance between any two adjacent borderlines before dividing the area of the handwritten trajectory into one or more sub-areas based on the borderlines;

and merging two adjacent boundary lines which are smaller than the first preset distance, and taking the central line of the area defined by the two adjacent boundary lines which are smaller than the first preset distance as the merged boundary line.

before dividing the area where the handwritten trajectory is located into one or more sub-areas based on the borderlines, a new borderline is generated at a position between two adjacent borderlines that are larger than a second preset distance and that satisfy a second preset condition.

As another embodiment of the application, the area where the handwriting track is located is an area where a minimum circumscribed rectangle of the handwriting track is located.

As another embodiment of the present application, the first preset distance is less than or equal to half of a width of a minimum circumscribed rectangle of the handwriting trajectory in a direction perpendicular to the handwriting input direction, and the second preset distance is greater than the first preset distance.

As another embodiment of the present application, the character recognition sub-module 10312 is further configured to:

the character template monitoring unit is used for displaying characters of a template to be set and a template input interface and monitoring handwritten information input through the template input interface;

and the character template setting unit is used for generating a handwriting track based on the handwriting information input through the template input interface and taking the current handwriting track as a character template corresponding to the character of the template to be set after monitoring the handwriting information input through the template input interface.

It is obvious to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional units and modules is merely used as an example, and in practical applications, the foregoing function distribution may be performed by different functional units and modules as needed, that is, the internal structure of the terminal device is divided into different functional units or modules to perform all or part of the above-described functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the terminal device may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Fig. 11 is a schematic block diagram of a terminal device according to another embodiment of the present application. As shown in fig. 11, the terminal device 11 of this embodiment includes: one or more processors 110, a memory 111, and a computer program 112 stored in the memory 111 and executable on the processors 110. The processor 110, when executing the computer program 112, implements the steps in the various method embodiments described above, such as the steps S101 to S103 shown in fig. 1. Alternatively, the processor 110, when executing the computer program 112, implements the functions of the modules/units in the terminal device embodiments, such as the functions of the modules 101 to 103 shown in fig. 10.

Illustratively, the computer program 112 may be partitioned into one or more modules/units that are stored in the memory 111 and executed by the processor 110 to accomplish the present application. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used for describing the execution process of the computer program 112 in the terminal device 11. For example, the computer program 112 may be divided into a handwritten information monitoring unit, a handwriting trajectory generation unit, a character recognition unit, exemplarily:

the character recognition unit is configured to, after detecting that the handwriting input operation is ended, recognize the handwriting trajectory to obtain a recognition result, where the recognition result includes one or more characters, and the characters include: arabic numerals and mathematical symbols.

Other units or modules can be referred to the description of the embodiment shown in fig. 10, and are not described again here.

The terminal device includes, but is not limited to, a processor 110 and a memory 111. Those skilled in the art will appreciate that fig. 11 is only one example of a terminal device 11, and does not constitute a limitation to the terminal device 11, and may include more or less components than those shown, or combine some components, or different components, for example, the terminal device may also include an input device, an output device, a network access device, a bus, a touch display screen, etc.

The Processor 110 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The storage 111 may be an internal storage unit of the terminal device 11, such as a hard disk or a memory of the terminal device 11. The memory 111 may also be an external storage device of the terminal device 11, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the terminal device 11. Further, the memory 111 may also include both an internal storage unit and an external storage device of the terminal device 11. The memory 111 is used for storing the computer program and other programs and data required by the terminal device. The memory 111 may also be used to temporarily store data that has been output or is to be output.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed terminal device and method may be implemented in other ways. For example, the above-described terminal device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical function division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method of the embodiments described above can be realized by a computer program, which can be stored in a computer-readable storage medium and can realize the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable storage medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable storage media that does not include electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.

Claims

A data input method of a terminal device, comprising:

after a calculator application in terminal equipment is started, monitoring handwriting input operation in a handwriting input interface of the calculator application;

if the handwriting input operation in a handwriting input interface applied by the calculator is monitored, generating a handwriting track according to handwriting information input by the handwriting input operation;

after the handwriting input operation is detected to be finished, recognizing the handwriting track to obtain a recognition result, wherein the recognition result comprises one or more characters, and the characters comprise: arabic numerals and mathematical symbols.
The data input method of a terminal device according to claim 1, further comprising, after generating a handwriting trajectory from handwriting information input by the handwriting input operation:

and displaying the handwriting track according to the position of the handwriting information in the handwriting input interface.
The data input method of the terminal device according to claim 1, wherein the recognizing the handwriting trajectory to obtain a recognition result after detecting that the handwriting input operation is ended comprises:

and if the new touch operation is not monitored within the preset time after the touch operation in the handwriting input interface disappears, determining that the handwriting input operation is finished, and identifying the handwriting track to obtain an identification result.
The data input method of a terminal device according to claim 1, wherein the display interface of the terminal device further comprises: a virtual button;

correspondingly, after the handwriting input operation is detected to be finished, recognizing the handwriting track to obtain a recognition result includes:

and if the operation of clicking the virtual button is monitored, determining that the handwriting input operation is finished, and identifying the handwriting track to obtain an identification result.
The data input method of the terminal device according to any one of claims 1 to 4, wherein the recognizing the handwriting trajectory to obtain a recognition result comprises:

recognizing the handwriting track to obtain one or more characters corresponding to the handwriting track;

if a character is obtained, the obtained character is used as a recognition result;

and if a plurality of characters are obtained, sequencing the characters based on the positions of the handwriting tracks respectively corresponding to the characters, and taking the sequenced characters as recognition results.
The data input method of the terminal device according to claim 5, wherein the recognizing the handwriting track and obtaining one or more characters corresponding to the handwriting track comprises:

acquiring a handwriting input direction, and dividing an area where the handwriting track is located into one or more sub-areas based on the handwriting input direction;

respectively identifying the handwriting track in each sub-area to obtain characters corresponding to the handwriting track in each sub-area;

correspondingly, the sorting the characters based on the positions of the handwriting tracks respectively corresponding to the characters includes:

and sequencing the characters based on the positions of the sub-regions corresponding to the characters respectively.
The data input method of a terminal device according to claim 6, wherein the acquiring the handwriting input direction comprises:

and acquiring the handheld direction of the terminal equipment, and determining the handwriting input direction according to the handheld direction of the terminal equipment.
The data input direction of the terminal device according to claim 6, wherein when the handwriting input operation is a plurality of intermittent touch operations, the acquiring the handwriting input direction comprises:

and generating a curve according to the starting point position of the multi-touch operation, and taking the direction of the base line of the curve as the handwriting input direction.
The data input method of the terminal device according to claim 6, wherein the dividing the area where the handwriting trajectory is located into one or more sub-areas based on the handwriting input direction comprises:

controlling a sliding window with a preset width to slide along the handwriting input direction in the area where the handwriting track is located, and obtaining the position of the sliding window when a first preset condition is met;

determining a center line of the sliding window when a first preset condition is met based on the position of the sliding window when the first preset condition is met, and marking the center line as a boundary line, wherein the center line is perpendicular to the handwriting input direction;

and dividing the area where the handwriting track is located into one or more sub-areas based on the boundary.
The data input method of the terminal device according to claim 9, wherein the sliding window controlling the preset width slides along the handwriting input direction in the area where the handwriting track is located, and obtaining the position of the sliding window when a first preset condition is met comprises:

and controlling a sliding window with a preset width to slide along the handwriting input direction in the area where the handwriting track is located, and obtaining the area where the sliding window intersects with the handwriting track at each position in the handwriting input direction.

Taking the position where the area of the area intersected with the handwriting track is smaller than a preset area as the position of the sliding window when a first preset condition is met;

or, the position where the number of the pixel points in the area intersected with the handwriting track is smaller than the preset number is used as the position of the sliding window when the first preset condition is met.
The data input method of a terminal device according to claim 9, wherein before dividing the area where the handwritten trajectory is located into one or more sub-areas based on the borderline, further comprising:

determining the distance between any two adjacent dividing lines;

and merging two adjacent boundary lines which are smaller than the first preset distance, and taking the central line of the area defined by the two adjacent boundary lines which are smaller than the first preset distance as the merged boundary line.
The data input method of a terminal device according to claim 11, wherein before dividing the area where the handwritten trajectory is located into one or more sub-areas based on the borderline, further comprising:

and generating a new boundary line between two adjacent boundary lines with the distance larger than the second preset distance at the position meeting the second preset condition.
The data input method of the terminal device according to claim 12, wherein the generating a new boundary line at a position satisfying a second preset condition between two adjacent boundary lines that are greater than a second preset distance includes:

and taking the central line of the area defined by two adjacent boundary lines which are larger than the second preset distance as a newly generated boundary line.
The data input direction of the terminal device according to any one of claims 6 to 13, wherein the area where the handwritten trajectory is located is an area where a smallest circumscribed rectangle of the handwritten trajectory is located.
The data input method of a terminal device according to claim 14, wherein the first preset distance is less than or equal to half of a width of a minimum bounding rectangle of the handwriting track in a direction perpendicular to the handwriting input direction, and the second preset distance is greater than the first preset distance.
The data input method of the terminal device according to any one of claims 6 to 13, wherein the respectively recognizing the handwriting trajectory in each sub-region and obtaining the character corresponding to the handwriting trajectory in each sub-region comprises:

and matching the handwriting tracks in each sub-area with a plurality of preset character templates respectively to obtain characters corresponding to the handwriting tracks in each sub-area respectively.
The data input method of a terminal device according to claim 16, before matching the handwriting trajectory in each sub-region with a plurality of preset character templates, respectively, further comprising:

displaying characters of a template to be set and a template input interface, and monitoring handwritten information input through the template input interface;

and if the handwritten information input through the template input interface is monitored, generating a handwritten track based on the handwritten information input through the template input interface, and taking the current handwritten track as a character template corresponding to the character of the template to be set.
A terminal device, comprising:

the handwriting information monitoring unit is used for monitoring handwriting input operation in a handwriting input interface of the calculator application after the calculator application in the terminal equipment is started;

the handwriting track generating unit is used for generating a handwriting track according to handwriting information input by the handwriting input operation if the handwriting input operation in a handwriting input interface applied by the calculator is monitored;

a character recognition unit, configured to, after detecting that the handwriting input operation is ended, recognize the handwriting trajectory to obtain a recognition result, where the recognition result includes one or more characters, and the characters include: arabic numerals and mathematical symbols.
A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 17 when executing the computer program.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by one or more processors, implements the steps of the method according to any one of claims 1 to 17.