TWI709894B - Gesture feature processing method and touch control module using the same - Google Patents

Abstract

A method for processing gesture features is applicable to a touch module, wherein the touch module includes a touch screen, a sensing unit, and a calculation unit. The sensing unit is electrically connected to the touch screen, and the calculation The unit is electrically connected to the sensing unit, and the gesture feature processing method includes: the sensing unit detects an initial coordinate of a user's finger touching the touch screen; the calculation unit executes a direction recording step to obtain a direction Data set; the sensing unit detects an end coordinate where the finger leaves the touch screen; and the calculation unit performs gesture recognition based on the start coordinate, the direction data set and the end coordinate.

Description

Gesture feature processing method and touch control module using the same

The present invention relates to a gesture feature processing method suitable for a touch module, and in particular to a gesture feature processing method that strengthens recognition features through the scribing direction.

The current gesture recognition model algorithm used in touch devices mainly relies on the matching and calculation of the direction code to recognize the gesture input by the user, and the above direction code is based on the current touch point and the line direction between the past touch points As a basis, the direction code and the determination of the marking direction have a great correlation. However, due to the rough classification of scribing directions of general touch modules, only the most basic four directions of up, down, left, and right can be determined, which easily leads to insufficient analysis of the direction changes of the gestures input by the user Fine, and actually judge the strokes in different directions as the same direction; on the other hand, for some gestures that have the same turning direction but belong to different characters or patterns due to different stroke lengths, the current recognition model algorithms that are too rough will also It is judged as the same direction combination.

In order to solve the above problems, a novel gesture feature processing method is urgently needed in the art.

One purpose of the present invention is to disclose a gesture feature processing method suitable for a touch module, which can record the scribing direction to the direction data set, thereby enhancing the related features of gesture recognition.

Another object of the present invention is to disclose a touch module, which can record the scribing direction to the direction data set, thereby enhancing the related features of gesture recognition.

To achieve the above objective, a gesture feature processing method suitable for a touch module is proposed. The touch module includes a touch screen, a sensing unit, and a calculation unit. The sensing unit is electrically connected to the The touch screen is touched, and the computing unit is electrically connected to the sensing unit, and the gesture feature processing method includes:

The sensing unit detects an initial coordinate of a user's finger touching the touch screen;

The calculation unit executes a direction recording step to obtain a direction data set;

The sensing unit detects an end point where the finger leaves the touch screen; and

The calculation unit performs gesture recognition according to the start coordinates, the direction data set, and the end coordinates;

Among them, the direction recording steps include:

Obtaining a previous coordinate and a current coordinate, where the previous coordinate is the coordinate of the finger on the touch screen before the current coordinate by one hour;

Calculate a horizontal change vector and a vertical change vector based on the previous coordinates and the current coordinates;

Calculate an angle change vector based on the horizontal change vector and the vertical change vector;

Determine the direction of a line of the current coordinate according to the angle change vector; and

Record the line direction to the direction data group.

In an embodiment, the scribing direction is one of up, down, left, right, top left, bottom left, top right, and bottom right.

In one embodiment, the direction recording step further includes:

Obtain a steering coordinate, where the steering coordinate is the coordinate of the finger on the touch screen after the current coordinate and the time interval;

Determine whether a distance from the steering coordinate to the previous coordinate and the current coordinate line is greater than a threshold; and

Determine whether the steering coordinate is equal to the end point coordinate;

Wherein, when the distance is greater than the threshold, the calculation unit determines a steering direction of the current coordinate according to a steering vector from the current coordinate to the steering coordinate, and records the steering direction in the direction data set;

Wherein, when the steering coordinate is not equal to the end point coordinate, the calculation unit updates the steering coordinate after the time interval.

In an embodiment, the steering direction is one of up, down, left, right, top left, bottom left, top right, and bottom right.

In one embodiment, the calculation unit performing gesture recognition based on the start coordinates, the direction data set, and the end coordinates includes executing a similarity algorithm on the direction data set and a character database.

To achieve the above objective, the present invention further provides a touch module, which includes a touch screen, a sensing unit, and a calculation unit to perform a gesture feature processing method, wherein the sensing unit is electrically connected to the touch screen And the computing unit is electrically connected to the sensing unit, and the gesture feature processing method includes:

The sensing unit detects an initial coordinate of a user's finger touching the touch screen;

The calculation unit executes a direction recording step to obtain a direction data set;

The sensing unit detects an end point where the finger leaves the touch screen; and

The calculation unit performs gesture recognition according to the start coordinates, the direction data set, and the end coordinates;

Among them, the direction recording steps include:

Obtaining a previous coordinate and a current coordinate, where the previous coordinate is the coordinate of the finger on the touch screen before the current coordinate by one hour;

Calculate a horizontal change vector and a vertical change vector based on the previous coordinates and the current coordinates;

Calculate an angle change vector based on the horizontal change vector and the vertical change vector;

Determine the direction of a line of the current coordinate according to the angle change vector; and

Record the line direction to the direction data group.

In an embodiment, the scribing direction is one of up, down, left, right, top left, bottom left, top right, and bottom right.

In one embodiment, the direction recording step further includes:

Obtain a steering coordinate, where the steering coordinate is the coordinate of the finger on the touch screen after the current coordinate and the time interval;

Determine whether a distance from the steering coordinate to the previous coordinate and the current coordinate line is greater than a threshold; and

Determine whether the current coordinate or the steering coordinate is equal to the end coordinate;

Wherein, when the distance is greater than the threshold, the calculation unit determines a steering direction of the current coordinate according to a steering vector from the current coordinate to the steering coordinate, and records the steering direction in the direction data set;

Wherein, when the current coordinates and the steering coordinates are not equal to the end coordinates, the calculation unit updates the previous coordinates, the current coordinates, and the steering coordinates after the time interval.

In an embodiment, the steering direction is one of up, down, left, right, top left, bottom left, top right, and bottom right.

In one embodiment, the calculation unit performing gesture recognition based on the start coordinates, the direction data set, and the end coordinates includes executing a similarity algorithm on the direction data set and a character database.

In order to enable your reviewer to further understand the structure, features and purpose of the present invention, the drawings and detailed descriptions of preferred specific embodiments are attached as follows.

Please refer to FIGS. 1 and 2. FIG. 1 is a block diagram of an embodiment of the touch module of the present invention, and FIG. 2 is a flowchart of an embodiment of a gesture feature processing method of the present invention. The touch module 1 provided by the present invention includes a touch screen 11, a sensing unit 12, and a calculation unit 13, wherein the sensing unit 12 is electrically connected to the touch screen 11, and the calculation unit 13 is electrically connected The sensing unit 12 and the gesture feature processing method include: the sensing unit 12 detects an initial coordinate of a user's finger touching the touch screen 11 (step a); the calculation unit performs a direction recording step To obtain a direction data set (step b); the sensing unit 12 detects an end point coordinate of the finger leaving the touch screen 11 (step c); and the calculation unit according to the start coordinate, the direction data set, and Gesture recognition is performed on the endpoint coordinates (step d).

Specifically, when the touch module 1 is activated and the user wants to perform gesture recognition, the sensing unit 12 will detect the initial position where the user’s finger touches the touch screen 11 and define it Is the starting coordinate. In order to further obtain other characteristic data of the gesture, the calculation unit 13 will continue to perform the direction recording step.

Please refer to FIG. 3, which shows a flowchart of an embodiment of the direction recording step, which includes: obtaining a previous coordinate and a current coordinate (step b1); calculating a level change based on the previous coordinate and the current coordinate Vector and a vertical change vector (step b2); calculate an angle change vector based on the horizontal change vector and the vertical change vector (step b3); determine a line direction of the current coordinate based on the angle change vector (step b4) ); Record the line direction to the direction data set (step b5); obtain a steering coordinate (step b6); determine whether a distance from the steering coordinate to the previous coordinate and the current coordinate line is greater than a threshold (step b7); Determine a steering direction of the current coordinate based on a steering vector from the current coordinate to the steering coordinate, and record the steering direction to the direction data set (step b8); and determine the current coordinate or the steering Whether the coordinates are equal to the end point coordinates (step b9).

Specifically, the calculation unit 13 obtains the coordinates of the finger on the touch screen at the current time point through the sensing unit 12, and defines them as the current coordinates; in addition, the calculation unit 13 uses the sensing unit 12 Obtain the coordinates of the finger on the touch screen before the current coordinate by one time interval (for example, one frame), and define it as the previous coordinates.

After obtaining the previous coordinate and the current coordinate, a horizontal change vector Δx and a vertical change vector Δy from the previous coordinate to the current coordinate can be calculated. After obtaining the horizontal change vector Δx and the vertical change vector Δy , The calculation unit 13 can calculate an angle change vector Δθ by using the vertical change vector Δy and the horizontal change vector Δx.

In detail, the relationship between the angle change vector Δθ, the horizontal change vector Δx, and the vertical change vector Δy can be expressed by the following formula:

At this time, according to the sign of the vertical change vector Δy and the horizontal change vector Δx, and the range of the angle change vector Δθ, the line direction of the current coordinate can be classified into up, down, left, right, top left, bottom left, One of the upper right and lower right, please refer to the table below for specific classification basis: Table 1 Underline direction Δy Δx Δθ Scribing direction ＜30 degrees 30 degrees to 60 degrees ＞ 60 degrees + + + - - right + + - + - Upper right + + - - + on + - - - + on + - - + - Upper left + - + - - left - - + - - left - - - + - Lower left - - - - + under - + - - + under - + - + - Lower right - + + - - right

It is worth mentioning that the angle range in the above table is only the reference value of this embodiment, and is not used to limit the present invention. According to the actual needs of identifying the direction, the user or designer can adjust the upper and lower limits of the angle to Meet the range of the direction. After the scribing direction is successfully determined, the calculation unit 13 records the scribing direction to the direction data set as a feature basis for subsequent gesture recognition.

On the other hand, when the finger moves to a position other than the previous coordinate and the current coordinate during the touch, the gesture direction may change. At this time, in order to determine whether it is the necessary steering of the gesture or the user Deflection caused by the writing habit of, the calculation unit 13 will define the current coordinate at the time interval (for example, one frame) after the finger is far away from the previous coordinate on the touch screen and the coordinate connected with the current coordinate as A steering coordinate, and calculating whether a distance from the steering coordinate to the previous coordinate and the current coordinate is greater than a threshold. If the distance is less than the threshold, it means that the movement of the finger may be caused by the user's writing habits, not the turning point of the gesture itself, so there is no need to record the steering action; if the distance is greater than the threshold, it means the The stroke should be a valid stroke. At this time, the calculation unit will determine a steering direction of the current coordinate based on a steering vector that advances from the current coordinate to the steering coordinate. In detail, the steering vector can also be decomposed into a horizontal change vector and a vertical change vector, and by the vertical change vector and the sign and ratio of the horizontal change vector, the steering direction is obtained and classified as up, down, and left. One of, right, upper left, lower left, upper right, and lower right is similar to the above-mentioned method for obtaining the marking direction, so it will not be repeated here. After obtaining the steering direction, the calculation unit 13 records the steering direction in the direction data set.

After the determination and recording of the scribing direction and the turning direction are performed, the calculation unit 13 detects through the sensing unit 12 whether the user's finger leaves the touch screen 11, that is, the current coordinates or the turning direction Whether the coordinates are equal to the end coordinates. If yes, it means that the direction recording step of the current stage is temporarily finished; if not, it means that the user is still in the writing process, and the calculation unit 13 will update the previous coordinates and the current position after the time interval (for example, one frame) The coordinates and the steering coordinates, that is, the previous coordinates, the current coordinates, and the steering coordinates are obtained again after the time interval, and the new horizontal change vector Δx, the vertical change vector Δy and the angle are obtained through the new previous coordinates, the current coordinates and the steering coordinates Change the vector Δθ, and further obtain the new marking direction, possible steering coordinates and steering direction, and record it in the direction data group.

When the user's finger leaves the touch screen 11, the sensing unit 12 detects the final position where the finger leaves the touch screen 11 and defines it as the end point coordinates. After that, the calculation unit performs gesture recognition according to the start coordinates, the direction data set, and the end coordinates.

In detail, since each scribing direction and turning direction in the direction data group are sequentially recorded, and are simultaneously subdivided into one of up, down, left, right, top left, bottom left, top right, and bottom right. Therefore, when performing gesture feature recognition, the similarity algorithm can be performed on the direction data group and a character database while ignoring the stroke itself, as long as the stroke direction and turning direction arrangement combination of the gesture itself and the character database If the similarity of the arrangement in the direction reaches the standard, it can be judged as the character. In addition, this method can additionally combine stroke length, turning point position and other feature recognition, which further improves the success rate and accuracy of gesture recognition.

The disclosure in this case is a preferred embodiment, and any partial changes or modifications that are derived from the technical ideas of the case and can be easily inferred by those who are familiar with the art do not deviate from the scope of the patent right of the case.

In summary, regardless of the purpose, means and effect of this case, it is shown that it is very different from the conventional technology, and its first invention is suitable for practicality, and it does meet the patent requirements of the invention. I implore the examiner to investigate and grant the patent as soon as possible. Society is for the best prayer.

Step a: The sensing unit detects that a finger of a user touches an initial coordinate of the touch screen Step b: The computing unit performs a direction recording step to obtain a direction data set Step b1: Obtain a previous coordinate and a current coordinate Step b2: Calculate a horizontal change vector and a vertical change vector based on the previous coordinates and the current coordinates Step b3: Calculate an angle change vector based on the level change vector and the vertical change vector Step b4: Determine the direction of a line of the current coordinate according to the angle change vector Step b5: Record the line direction to the direction data group Step b6: Obtain a steering coordinate Step b7: Determine whether a distance from the steering coordinate to the previous coordinate and the current coordinate line is greater than a threshold Step b8: Determine a steering direction of the current coordinate based on a steering vector that advances from the current coordinate to the steering coordinate, and record the steering direction in the direction data set Step b9: Determine whether the current coordinate or the steering coordinate is equal to the end coordinate Step c: The sensing unit detects an end point where the finger leaves the touch screen Step d: The calculation unit performs gesture recognition according to the start coordinates, the direction data set, and the end coordinates 1: Touch module 11: Touch screen 12: Sensing unit 13: Computing unit

FIG. 1 shows a block diagram of an embodiment of the touch module of the present invention. FIG. 2 shows a flowchart of an embodiment of the gesture feature processing method of the present invention. FIG. 3 is a flowchart of an embodiment of the direction recording step in FIG. 2.

Step a: The sensing unit detects that a finger of a user touches an initial coordinate of the touch screen

Step b: The computing unit performs a direction recording step to obtain a direction data set

Step c: The sensing unit detects an end point where the finger leaves the touch screen

Step d: The calculation unit performs gesture recognition according to the start coordinates, the direction data set, and the end coordinates

Claims (10)

A method for processing gesture features is applicable to a touch module, wherein the touch module includes a touch screen, a sensing unit, and a calculation unit. The sensing unit is electrically connected to the touch screen, and the calculation The unit is electrically connected to the sensing unit, and the gesture feature processing method includes: The sensing unit detects an initial coordinate of a user's finger touching the touch screen; The calculation unit executes a direction recording step to obtain a direction data set; The sensing unit detects an end point where the finger leaves the touch screen; and The calculation unit performs gesture recognition according to the start coordinates, the direction data set, and the end coordinates; Among them, the direction recording steps include: Obtaining a previous coordinate and a current coordinate, where the previous coordinate is the coordinate of the finger on the touch screen before the current coordinate by one hour; Calculate a horizontal change vector and a vertical change vector based on the previous coordinates and the current coordinates; Calculate an angle change vector based on the horizontal change vector and the vertical change vector; Determine the direction of a line of the current coordinate according to the angle change vector; and Record the line direction to the direction data group. As described in the first item of the scope of patent application, the gesture feature processing method, wherein the marking direction is one of up, down, left, right, top left, bottom left, top right, and bottom right. For the gesture feature processing method described in the first item of the scope of patent application, the direction recording step further includes: Obtain a steering coordinate, where the steering coordinate is the coordinate of the finger on the touch screen after the current coordinate and the time interval; Determine whether a distance from the steering coordinate to the previous coordinate and the current coordinate line is greater than a threshold; and Determine whether the current coordinate or the steering coordinate is equal to the end coordinate; Wherein, when the distance is greater than the threshold, the calculation unit determines a steering direction of the current coordinate according to a steering vector from the current coordinate to the steering coordinate, and records the steering direction in the direction data set; Wherein, when the current coordinates and the steering coordinates are not equal to the end coordinates, the calculation unit updates the previous coordinates, the current coordinates, and the steering coordinates after the time interval. As for the gesture feature processing method described in item 3 of the scope of patent application, the turning direction is one of up, down, left, right, top left, bottom left, top right, and bottom right. For the gesture feature processing method described in item 1 of the scope of patent application, wherein the calculation unit performs gesture recognition based on the start coordinate, the direction data set, and the end coordinate includes performing similarity on the direction data set and a character database Algorithm. A touch module includes a touch screen, a sensing unit and a calculation unit for performing a gesture feature processing method, wherein the sensing unit is electrically connected to the touch screen, and the calculation unit is electrically connected to the sensor The measurement unit, the gesture feature processing method includes: The sensing unit detects an initial coordinate of a user's finger touching the touch screen; The calculation unit executes a direction recording step to obtain a direction data set; The sensing unit detects an end point where the finger leaves the touch screen; and The calculation unit performs gesture recognition according to the start coordinates, the direction data set, and the end coordinates; Among them, the direction recording steps include: Obtaining a previous coordinate and a current coordinate, where the previous coordinate is the coordinate of the finger on the touch screen before the current coordinate by one hour; Calculate a horizontal change vector and a vertical change vector based on the previous coordinates and the current coordinates; Calculate an angle change vector based on the horizontal change vector and the vertical change vector; Determine the direction of a line of the current coordinate according to the angle change vector; and Record the line direction to the direction data group. As for the touch module described in item 6 of the scope of patent application, the scribing direction is one of up, down, left, right, top left, bottom left, top right, and bottom right. For the touch module described in item 6 of the scope of patent application, the direction recording step further includes: Obtain a steering coordinate, where the steering coordinate is the coordinate of the finger on the touch screen after the current coordinate and the time interval; Determine whether a distance from the steering coordinate to the previous coordinate and the current coordinate line is greater than a threshold; and Determine whether the current coordinate or the steering coordinate is equal to the end coordinate; Wherein, when the distance is greater than the threshold, the calculation unit determines a steering direction of the current coordinate according to a steering vector from the current coordinate to the steering coordinate, and records the steering direction in the direction data set; Wherein, when the current coordinates and the steering coordinates are not equal to the end coordinates, the calculation unit updates the previous coordinates, the current coordinates, and the steering coordinates after the time interval. For the touch module described in item 8 of the scope of patent application, the turning direction is one of up, down, left, right, top left, bottom left, top right, and bottom right. For the touch module described in item 6 of the scope of patent application, wherein the calculation unit performs gesture recognition according to the start coordinate, the direction data set, and the end coordinate including performing similarity to the direction data set and a character database Algorithm.

Images