CN108920076B

CN108920076B - User gesture operation recognition method and recognition system

Info

Publication number: CN108920076B
Application number: CN201810676452.XA
Authority: CN
Inventors: 朱欣健; 林森全; 曹译珑
Original assignee: Qingyuan Momo Education Technology Co ltd
Current assignee: Qingyuan Momo Education Technology Co ltd
Priority date: 2018-06-27
Filing date: 2018-06-27
Publication date: 2021-03-02
Anticipated expiration: 2038-06-27
Also published as: CN108920076A

Abstract

The invention provides a user gesture operation recognition method and a recognition system, which comprise a coordinate system establishing step, a function area dividing step, a threshold setting step, an initial step and a judging step, wherein the judging step comprises a function area judging step, a function triggering judging step, a mobile function judging step and a prompt function real-time judging step; the method comprises the steps of dividing a function area by establishing a function plug-in coordinate system, determining coordinates of a starting point and an end point of a user gesture operation, and calculating displacement of the user gesture operation; judging whether a user triggers the function of the function area or not by dividing the function area and calculating the displacement of the endpoint of the gesture operation of the user from the origin of the coordinate system of the function plug-in; the method for judging the user gesture operation function area is simple, so that the user gesture operation not only can achieve the effect of function triggering, but also can achieve the effect of triggering different function areas, and the cost of user gesture recognition is reduced.

Description

User gesture operation recognition method and recognition system

Technical Field

The invention relates to the technical field of gesture recognition, in particular to a user gesture recognition method and a user gesture recognition system.

Background

At present, interaction modes of a user and intelligent terminal equipment are more and more diversified, gesture operation is generally divided into static operation and dynamic operation, the static operation means that the gesture of the user is static, then a camera is used for capturing the gesture of the hand or an induction system is used for inducing the position of the hand, and different processing is performed according to different gesture definitions of the hand or different processing is performed according to different induced positions; the dynamic gesture operation is to judge gesture actions through the motion track of the hand.

The conventional gesture recognition method and device are a mode that a straight line of a starting point and an end point of a motion track is constructed, a straight line distance is compared with a preset threshold value to judge whether a gesture operation is effective, an included angle alpha between the straight line and a transverse axis of a screen coordinate system is calculated, and a motion direction of a gesture is judged according to the included angle alpha and coordinate values of the starting point and the end point; the existing gesture recognition method and device can only judge whether the gesture operation is effective, but cannot accurately judge different functions triggered by the gesture operation.

Disclosure of Invention

The invention mainly aims to provide a user gesture operation recognition method and a user gesture operation recognition system, which simplify a gesture track calculation method, judge whether a gesture operation is effective and simultaneously accurately recognize what kind of functions are triggered by the gesture operation.

In order to achieve the above object, the present invention is realized by:

a user gesture operation recognition method comprises a function plug-in setting step and a user gesture operation recognition step, and is suitable for being executed on an intelligent terminal device through finger touch, an original coordinate system is arranged on a screen of the intelligent terminal device, an original point of the original coordinate system is arranged at an upper left corner endpoint of the screen of the intelligent terminal device, a function plug-in is arranged on the screen of the intelligent terminal device, and a user performs gesture operation on the function plug-in, wherein:

the function plug-in setting step comprises:

s1, establishing a functional plug-in coordinate system:

selecting a certain point on a screen of the intelligent terminal equipment as an initial position, and establishing an XY axis coordinate system by taking the initial position as an origin;

s2, setting a threshold value:

the set threshold comprises a set trigger function area displacement threshold delta X and a set trigger time threshold delta T;

s3, dividing functional areas:

establishing a circle on the function plug-in coordinate system by taking R as a radius and the origin of the function plug-in coordinate system as a circle center, and establishing Y on the function plug-in coordinate system₁＝-kX，

The functional plug-in coordinate system is divided into 5 functional areas by the two straight lines, wherein:

point set { (X, Y) | X on function plug-in coordinate system²+Y²≤R²，X∈[-R，+R]The area in which the electronic device is located is a functional area A;

set of points on a function plug-in coordinate system

The area is a functional area B;

set of points on a function plug-in coordinate system

The area is a functional area C;

set of points on a function plug-in coordinate system

The area is a functional area D;

set of points on a function plug-in coordinate system

The area is a functional area E;

the value of k is not zero;

the steps S1 and S3 are to form a function touch area on the screen of the intelligent terminal device; different functional areas of the functional touch area are distinguished by different colors;

after the functional plug-in setting step is completed, the user performs gesture operation on the functional plug-in, obtains the gesture operation state of the user, and performs the gesture operation recognition step of the user;

the step of recognizing the gesture operation of the user comprises the following steps:

s1, an initial step:

acquiring a coordinate O (x, y) of an origin of the functional plug-in coordinate system on the original coordinate system; meanwhile, the user starts timing after starting the touch screen;

s2, judging:

s2-1, a functional area judging step:

if the user touches the screen by the finger and the finger generates displacement on the screen, canceling time timing, and acquiring a coordinate a (x, y) of a central point of the position of the user finger on the original coordinate system when the user finger finishes touching the screen; converting a (x, y) into a coordinate a on the function plug-in coordinate system_m(x_m,y_m)；

Will coordinate a_mX in (2)_mSubstituted into Y₁＝-kX,

Respectively calculate y in₁And y₂；

If x_m ²+y_m ²<R²Judging that the functional area where the touch end point is located is a circular functional area A;

if y_m＜y₁And y is_m≤y₂And x_m ²+y_m ²＞R²If so, judging that the functional area where the touch end point is located is a functional area B;

if y_m＞y₁And y is_m≥y₂And x_m ²+y_m ²＞R²If so, judging that the functional area where the touch end point is located is a functional area C;

if y_m≥y₁And y is_m＜y₂And x_m ²+y_m ²＞R²If so, judging that the functional area where the touch end point is located is a functional area D;

if y_m≤y₁And y is_m＞y₂And x_m ²+y_m ²＞R²If so, judging that the functional area where the touch end point is located is a functional area E;

s2-2, function triggering and judging step:

calculating the coordinate a_m(x_m,y_m) The distance delta S to the origin of the functional plug-in coordinate system;

if deltaS is larger than or equal to the preset trigger function areaThe displacement threshold value delta X of the domain is used for judging the position central point a of the finger of the triggering user when the finger finishes touching the screen_mThe function of the functional area;

if the Delta S is smaller than a preset displacement threshold Delta X of the trigger function area, judging that the position center point a of the user finger when the touch screen is finished is not triggered_mThe function of the functional area;

s2-3, a mobile function judging step:

if the user does not generate displacement when touching the screen, calculating the time for the user to press the screen of the intelligent terminal for a long time;

if the long-time is less than a triggering time threshold value delta T, triggering the function of the circular functional area A;

if the long-time is greater than or equal to a triggering time threshold value delta T, triggering a moving function; after the mobile function is triggered, the trigger function area moves along the movement direction of the finger of the user;

and after the user finishes moving, acquiring a central point of a finger touch position of the user when the user finishes moving, reestablishing an XY axis coordinate system by taking the central point as an original point to form a new functional plug-in coordinate system, and subdividing the functional area on the new functional plug-in coordinate system according to the functional area dividing step.

Preferably, on the original coordinate system, assuming that the left boundary of the screen is represented as X ═ W1, and the right boundary of the screen is represented as X ═ W2, W1< W2; the upper boundary of the screen is represented as Y-H1, the lower boundary of the screen is represented as Y-H2, H1< H2;

the area in which the point set is { (x, y) | (W1+ R) ≦ x ≦ W2-R and (H1+ R) ≦ y ≦ H2-R) } is the area range in which the initial position center point O (x, y) is located;

after the movement function is triggered, acquiring a central point O '(x', y ') of a position touched by a user finger when the movement is finished, wherein the area in which the point set is { (x', y ') | (W1+ R) ≦ x' ≦ W2-R) and (H1+ R) ≦ y '≦ H2-R) } is the area range in which the initial position central point O' (x ', y') is located;

if (x '-W1) < R, reset x' ═ W1+ R;

if (W2-x ') < R, reset x' ═ W2-R;

if (y '-H1) < R, then y' is reset to H1+ R;

if (H2-y ') < R, resetting y ═ H2-R, specifically, in the above-mentioned method, when the user's finger moves to the outside of the boundary, the functional plug-in can rebound to the inside of the boundary, resetting the coordinates of the functional plug-in, and facilitating the user's operation.

Preferably, the step of setting the threshold further includes setting a trigger prompt function displacement threshold Δ F;

the range of R is [28dp,36dp ];

the range of the displacement threshold value delta X of the trigger function region is [42dp,50dp ];

the range of the trigger time threshold value delta T is 450-550 ms;

the range of the prompt function displacement threshold delta F is [35dp,43dp ];

the step of setting the functional plug-in further comprises the step of S4. unit conversion: the unit conversion step converts dp units of R, delta X, delta F into px units;

preferably, the step of dividing the functional area specifically includes:

establishing a circle by taking the origin as the center of a circle and R as the radius, and establishing Y on the XY axis coordinate system₁＝-X，Y₂Dividing the function plugin coordinate system into 5 function regions, where:

the point set { (X, Y) | Y < -X and Y ≦ X and X on the function plug-in coordinate system²+Y²＞R²The region in which X ∈ (- ∞, + ∞) } is the functional region B;

the point set { (X, Y) | Y > -X on the function plug-in coordinate system, Y ≧ X and X²+Y²＞R²The region in which X belongs to (-infinity, + ∞) } is the functional region C;

the point set { (X, Y) | Y ≧ X and Y < X and X on the function plug-in coordinate system²+Y²＞R²The region in which X ∈ (0, + ∞) } is the functional region D;

the point set on the function plug-in coordinate system { (X, Y) | Y ≦ -X and Y > X and X²+Y²＞R²The region in which X belongs to (- ∞,0) } is a functional region E;

the circular functional area A is defined as a sound playing function; the functional region B is defined as a "cognitive" function; the functional region C is defined as "unrecognized" function;

judging the position of the origin on the screen of the intelligent terminal;

if the origin is located on the right side of the central line of the screen of the intelligent terminal, the functional area D has no specific function, and the functional area E is defined as an 'uncertain' function;

if the origin is located on the left side of the center line of the screen of the intelligent terminal, the functional area D is defined as an uncertain function, and the functional area E has no specific function.

Preferably, the optimal value of the displacement threshold Δ X of the trigger function region is 46 dp; the optimal value of the trigger time threshold value delta T is 500 ms;

the range of the value of the prompt function displacement threshold value delta F is [35dp,43dp ], and the optimal value is 39 dp;

the optimum value of R is 32 dp.

Preferably, the judging step further includes a prompt function real-time judging step, and the real-time judging step includes the following specific operations:

s2-4, prompting function real-time judging step:

if the user touches the screen by the finger and the finger generates displacement on the screen, canceling time timing, acquiring coordinates a '(x', y ') of the central point of the real-time touch position of the user finger on the original coordinate system, and calculating the distance delta S' between the central point of the real-time touch position of the user finger and the origin O (x, y) of the coordinate system of the functional plug-in unit;

when the distance delta S' between the center point of the real-time touch position of the user finger and the origin O (x, y) of the coordinate system of the functional plug-in is equal to the displacement threshold delta F of the trigger prompt function, triggering the prompt function, wherein the prompt function adopts a prompt circle to prompt the user;

determining a user's real-time handConverting the coordinate a ' (x ', y ') of the central point of the position of the user finger on the touch screen in real time on the original coordinate system into the coordinate a on the function plug-in coordinate system_n(x_n,y_n) (ii) a Will coordinate a_nX in (2)_nSubstituted into Y₁＝-kX,

Respectively calculate y in₁' and y₂’；

If x_n ²+y_n ²<R²Then, a is judged_m' the functional area is a circular functional area A;

if y_n＜y₁' and y_n≤y₂' and x_n ²+y_n ²＞R²Starting to cut into a part of a prompting circle, wherein the cut-in part of the prompting circle gradually becomes larger along with the increase of deltaS', and prompting a user that the function of the function area B is about to be triggered;

if y_n＞y₁' and y_n≥y₂' and x_n ²+y_n ²＞R²Starting to cut into a part of a prompting circle, wherein the cut-in part of the prompting circle gradually becomes larger along with the increase of deltaS', and prompting a user that the function of the functional area C is about to be triggered;

if y_n≥y₁' and y_n＜y₂' and x_n ²+y_n ²＞R²Starting to cut into a part of a prompting circle, wherein the cut-in part of the prompting circle becomes larger gradually along with the increase of deltaS', and prompting a user that the function of the function area D is about to be triggered;

if y_n≤y₁' and y_n＞y₂' and x_n ²+y_n ²＞R²Starting to cut into a part of a prompting circle, wherein the cut-in part of the prompting circle gradually becomes larger along with the increase of deltaS', and prompting a user that the function of the function area E is about to be triggered; the prompt circleIs the same color as the functional area.

Preferably, the radius of the functional insert is the same as the radius R of the circular functional area;

the color of the functional plug-in corresponds to the distinguishing color of the functional touch area;

the color of the functional insert is translucent when the functional touch area is not used;

when the mobile function is triggered, the radius of the functional plug-in is amplified by 1.5 to 2 times;

when a user finger triggers any function, vibration feedback can be generated;

preferably, in the technical scheme, dp is used as a unit for R, Delta X and Delta F; dp is an abstract unit based on screen Density, namely, device-independent pixels (Density-independent pixels); px, pixel, is an abbreviation for pixel; ppi (pixel per inch), the number of pixels possessed per inch, i.e., pixel density; when the screen size of the intelligent terminal equipment is known, the value of ppi can be obtained;

substituting a value of ppi with (ppi/160) × according to a formula dp to obtain a proportional relation between dp and px, so as to convert a value with unit dp in the technical scheme into a value with unit px; for example:

when the screen density is 160ppi, 1dp is 1 px;

when the screen density is 480ppi, 1dp is 3 px.

The utility model provides a user gesture operation recognition system, includes function plug-in setting module and user gesture operation recognition module, is applicable to finger touch and carries out on intelligent terminal, is provided with original coordinate system on the intelligent terminal screen, the original point setting of original coordinate system is at the upper left corner extreme point of intelligent terminal screen, be provided with the function plug-in on the intelligent terminal screen, the user carries out the gesture operation on the function plug-in, wherein:

the function plug-in setting module includes:

s1, creating a functional plug-in coordinate system module:

s2, setting a threshold module:

the set threshold comprises a set triggering function area displacement threshold delta X and a set triggering time threshold delta T;

s3, functional area division module:

establishing a circle on the function plug-in coordinate system by taking R as a radius and the origin of the function plug-in coordinate system as a circle center, and establishing Y on the function plug-in coordinate system₁＝-kX,

point set { (X, Y) | X on function plug-in coordinate system²+Y²≤R²,X∈[-R,+R]The area in which the electronic device is located is a functional area A;

set of points on a function plug-in coordinate system

The area is a functional area B;

set of points on a function plug-in coordinate system

The area is a functional area C;

set of points on a function plug-in coordinate system

The area is a functional area D;

set of points on a function plug-in coordinate system

The area is a functional area E;

the value of k is not zero;

after the functional plug-in setting module is completed, the user performs gesture operation on the functional plug-in, obtains the gesture operation state of the user, and performs the gesture operation recognition module of the user;

the user gesture operation recognition module comprises:

s1, an initial module:

s2, a judgment module:

s2-1, function area judging module:

Will coordinate a_mX in (2)_mSubstituted into Y₁＝-kX,

Respectively calculate y in₁And y₂；

s2-2, function triggering judgment module:

calculating the coordinate a_m(x_m，y_m) A distance Δ S to the origin of the functional plug-in coordinate system;

if the delta S is larger than or equal to a preset displacement threshold delta X of the trigger function area, judging that the position center point a of the finger of the trigger user when the finger finishes touching the screen is triggered_mThe function of the functional area;

if the delta S is smaller than the preset displacement threshold delta X of the trigger function area, judging that the position center point a of the user finger when the touch screen is finished is not triggered_mThe function of the functional area;

s2-3, a mobile function judgment module:

if the long-time is less than the triggering time threshold value delta T, triggering the function of the circular functional area A;

if the long-time is greater than or equal to the trigger time threshold value delta T, triggering the mobile function; after the mobile function is triggered, the trigger function area moves along the movement direction of the finger of the user;

and after the user finishes moving, acquiring a central point of a finger touch position of the user when the user finishes moving, reestablishing an XY axis coordinate system by taking the central point as an original point to form a new functional plug-in coordinate system, and subdividing the functional area on the new functional plug-in coordinate system according to the functional area division module.

if (x '-W1) < R, reset x' ═ W1+ R;

if (W2-x ') < R, reset x' ═ W2-R;

if (y '-H1) < R, then y' is reset to H1+ R;

Preferably, the threshold setting module further sets a trigger prompt function displacement threshold Δ F;

the range of R is [28dp,36dp ];

the range of the trigger time threshold value delta T is 450-550 ms;

the function plug-in setting module further comprises S4. a unit conversion module: the unit conversion module converts dp units of R, delta X and delta F into px units;

the optimal value of the displacement threshold value delta X of the trigger function area is 46 dp; the optimal value of the trigger time threshold value delta T is 500 ms;

the value range of the prompt function displacement threshold delta F is [35dp,43dp ], and the optimal value is 39 dp;

the optimum value of R is 32 dp.

Preferably, the functional area division module specifically includes:

the point { (X, Y) | Y < -X and Y ≦ X and X on the function plug-in coordinate system²+Y²＞R²The region in which X ∈ (- ∞, + ∞) } is the functional region B;

point { (X, Y) | Y > -X on the function plug-in coordinate system and Y ≧ X and X²+Y²＞R²The region in which X belongs to (-infinity, + ∞) } is the functional region C;

judging the position of the origin on the screen of the intelligent terminal;

Preferably, the judging module further includes a prompt function real-time judging module, and the real-time judging module specifically operates as follows:

s2-4, prompt function real-time judgment module:

if the user touches the screen by the finger and the finger generates displacement on the screen at the same time, canceling the time, acquiring coordinates a '(x', y ') of the central point of the real-time touch position of the user finger on the original coordinate system, and calculating the distance delta S' between the central point of the real-time touch position of the user finger and the origin O (x, y) of the coordinate system of the functional plug-in unit;

judging a functional area where a central point of a real-time finger touch position of a user is located, and converting coordinates a ' (x ', y ') of the central point of the real-time finger touch position of the user on the touch screen on the original coordinate system into coordinates a on the functional plug-in coordinate system_n(x_n,y_n) (ii) a Will coordinate a_nX in (2)_nSubstituted into Y₁＝-kX,

Respectively calculate y in₁' and y₂’；

if y_n≤y₁' and y_n＞y₂' and x_n ²+y_n ²＞R²Starting to cut into a part of a prompting circle, wherein the cut-in part of the prompting circle gradually becomes larger along with the increase of deltaS', and prompting a user that the function of the function area E is about to be triggered;

the color of the prompt circle is the same as that of the functional area;

the radius of the functional plug-in is the same as the radius R of the circular functional area;

the user's finger may generate a vibratory feedback when triggering any of the functions.

when the screen density is 160ppi, 1dp is 1 px;

when the screen density is 480ppi, 1dp is 3 px.

The invention uses dp as a unit so that the same effect can be shown under different ppis, namely, the functional plug-ins can be shown on the screens of the intelligent terminal devices with different pixel densities.

Advantageous effects

The invention provides a user gesture operation recognition method and a recognition system, wherein a function plug-in coordinate system is established, a function area is divided, the coordinates of a starting point and an end point of a user gesture operation are determined, and the displacement of the user gesture operation is calculated; judging whether a user triggers the function of the function area or not by dividing the function area and calculating the displacement of the endpoint of the gesture operation of the user from the origin of the coordinate system of the function plug-in; the method for judging the user gesture operation function area is simple, so that the user gesture operation not only can achieve the effect of function triggering, but also can achieve the effect of triggering different function areas, and the cost of user gesture recognition is reduced.

Drawings

FIG. 1 is a flow chart of the general steps of a gesture operation recognition method;

FIG. 2 is a functional area division diagram of a gesture operation recognition method;

FIG. 3 is a general flowchart of the determination steps of a gesture operation recognition method;

FIG. 4 is a flow chart of a gesture operation recognition method for real-time determination of prompt function;

fig. 5 is a block diagram of a gesture operation recognizer system.

Detailed Description

The following further describes embodiments of the present invention with reference to the accompanying drawings:

assuming that the screen resolution of the intelligent terminal device applied by the invention is 1080px 1920px, the pixel density is 480ppi, and substituting 480ppi according to the formula dp- (ppi/160) × px to obtain 1 dp-3 px;

example 1

The origin coordinate of the embodiment is O (518,1114), and is on the left side of the screen of the intelligent terminal; initial touch coordinates S (525,1090) of the user during the gesture operation; the touch coordinate a is ended (588,888), resulting in a displacement.

the function plug-in setting step comprises:

s1, establishing a functional plug-in coordinate system:

selecting O (518,1114) on a screen of the intelligent terminal device as an initial position, and establishing an XY axis coordinate system by taking the initial position as an origin;

s2, setting a threshold value:

setting a threshold value comprises setting a displacement threshold value delta X of a trigger function area to be 46dp, setting a displacement threshold value delta F of a trigger prompt function to be 39dp, and setting a trigger time threshold value delta T to be 500 ms; a unit conversion step: substituting 480ppi according to a formula dp- (ppi/160) × to obtain 1 dp-3 px, converting Δ X-46 dp into 138px, and converting Δ F-39 dp into 117 px;

s3, dividing functional areas:

taking R as a radius, substituting 480ppi according to a formula of dp (ppi/160) px to obtain 1dp as 3px, converting 32dp into 96px, taking an origin of the function plug-in coordinate system as a center of a circle, establishing a circle on the function plug-in coordinate system, and establishing Y on the function plug-in coordinate system₁＝-X，Y₂Dividing the function plugin coordinate system into 5 function regions, where:

point set { (X, Y) | X on function plug-in coordinate system²+Y²≤96²，X∈[-96，+96]The area where the plug-in is located is a function area A, and the circular function area part of the function plug-in is white;

the point set { (X, Y) | Y < -X and Y ≦ X and X on the function plug-in coordinate system²+Y²＞96²The region in which X ∈ (- ∞, + ∞) } is the functional region B, which is defined as "cognizant" function,the functional plug-in recognizes that the functional area part is green;

the point set { (X, Y) | Y > -X on the function plug-in coordinate system, Y ≧ X and X²+Y²＞96²The region where X belongs to (- ∞, + ∞) is defined as a functional region C, the functional region C is defined as the function of 'no understanding', and the part of the functional region of the 'no understanding' of the function plug-in is red;

the point set { (X, Y) | Y ≧ X and Y < X and X on the function plug-in coordinate system²+Y²＞96²The region in which X ∈ (0, + ∞) } is the functional region D;

the point set on the function plug-in coordinate system { (X, Y) | Y ≦ -X and Y > X and X²+Y²＞96²The region in which X belongs to (- ∞,0) } is a functional region E;

judging the position of the original point, wherein the original point is positioned at the upper left corner of the screen, so that the original point is positioned at the left side of the central line of the screen of the intelligent terminal, the functional area E has no specific function, and the functional area D is defined as an 'uncertain' function; the color of the 'uncertain' functional area of the functional plug-in is yellow, the non-specific functional area of the functional plug-in is white, the original point of the embodiment is at the upper left corner of the center of the screen, and the functional area E close to the right edge of the screen of the intelligent terminal is inconvenient to operate, so that the functional area E is marked as non-specific functional, which is convenient for a user to operate other functions, and the user is inconvenient to operate because the functional area is at the edge.

s1, an initial step:

acquiring a coordinate O (518,1114) of an origin of the function plug-in coordinate system on the original coordinate system; meanwhile, the user starts timing after starting the touch screen;

s2, judging:

s2-1, a functional area judging step:

Will coordinate a_mX in (2)_mSubstituted into Y₁＝-X,Y₂Calculating y from X₁And y₂；

the initial touch coordinate S (525,1090) of the user in the gesture operation process is obtained; ending touch coordinate a (588,888), displacement is generated, so that the time counting is cancelled, and the central point of the position of the finger of the user at the time of ending touch on the screen is obtained in the original positionCoordinates a (588,888) on the coordinate system; converting a (588,888) into coordinate a on the function plug-in coordinate system_m(588-518,888-1114), so that a_m(70,-226)；

Will coordinate a_mX in (2)_mSubstituted into Y₁＝-X,Y₂Calculating y from X₁And y₂，y₁Has a value of-70, y₂Has a value of 70;

y in the present embodiment_mHas a value of-226, y₁Has a value of-70, y₂Is 70, so y_m＜y₁And y is_m＜y₂And x_m ²+y_m ²＞96²Judging that the functional area where the touch end point is located is a functional area B which is a 'recognition' functional area;

s2-2, function triggering and judging step:

if the Delta S is larger than or equal to a displacement threshold Delta X of a preset trigger function area, judging that the position center point a of the finger of the trigger user at the end of touching the screen is triggered_mThe function of the functional area;

in the present embodiment, the value obtained by converting the displacement threshold Δ X of the preset trigger function region is 138px, and the value Δ S is calculated according to the pythagorean theorem

Therefore, the Δ S is larger than the displacement threshold value Δ X of the preset trigger function area, trigger a_mThe function of the functional area B.

And executing S2-4 prompt function real-time judgment steps while executing the steps of S2-1 and S2-2:

if the user touches the screen with the finger and the finger generates displacement on the screen, canceling the time, acquiring coordinates a '(x', y ') of the central point of the real-time touch position of the user finger on the original coordinate system, and calculating the distance delta S' between the central point of the real-time touch position of the user finger and the origin O (518,1114) of the coordinate system of the functional plug-in unit;

Respectively calculate y in₁' and y₂’；

the color of the prompt circle is the same as that of the functional area.

In this embodiment, when the user is about to trigger the function of the function area B, the middle of the function plug-in cuts into a part of a green circle, the cut-in part of the green prompt circle gradually increases with the increase of Δ S ', and when all the green prompt circles cut into the middle of the function plug-in, the user' S finger leaves the touch screen of the smart terminal to trigger the function of the function area B.

The color of the annular function plug-in corresponds to the distinguishing color of the function touch area; the color of the annular function plug-in is translucent when the function touch area is not used; the design is semi-transparent, so that a user can clearly see patterns on the screen of the intelligent terminal device when the annular functional plug-in is not used;

when a user finger triggers any function, vibration feedback can be generated to prompt the user to trigger a certain function.

Example 2

The origin coordinate of the embodiment is O (518,1114), and is on the left side of the screen of the intelligent terminal; initial touch coordinates S (525,1090) of the user during the gesture operation; the touch coordinate a is finished (525,1090), no displacement is generated, and the long pressing time of the finger of the user is 550 ms.

the function plug-in setting step comprises:

s1, establishing a functional plug-in coordinate system:

selecting O (518,1114) on a screen of the intelligent terminal equipment as an initial position, and establishing an XY axis coordinate system by taking the initial position as an origin;

s2, setting a threshold value:

the setting of the threshold comprises setting a displacement threshold delta X of a trigger function area to be 46dp, setting a displacement threshold delta F of a trigger prompt function to be 39dp, and setting a trigger time threshold delta T to be 500 ms; a unit conversion step: substituting 480ppi according to a formula dp-160 px to obtain 1 dp-3 px, converting Δ X-46 dp into 138px, and converting Δ F-39 dp into 117 px;

s3, dividing functional areas:

the point set { (X, Y) | Y < -X and Y ≦ X and X on the function plug-in coordinate system²+Y²＞96²The region where X ∈ (- ∞, + ∞) } is a functional region B, the functional region B is defined as a "know" function, and the functional region part of the "know" function plug-in is green;

the point set { (X, Y) | Y > -X on the function plug-in coordinate system, Y ≧ X and X²+Y²＞96²The region in which X ∈ (- ∞, + ∞) } is locatedThe domain is a functional area C, the functional area C is defined as a function which is not recognized, and the functional area part which is not recognized by the functional plug-in is red;

s1, an initial step:

obtaining a coordinate O (518,1114) of an origin of the function plug-in coordinate system on the original coordinate system; meanwhile, the user starts timing after starting the touch screen;

s2, judging:

s2-1, a functional area judging step:

if the user touches the screen with a fingerMeanwhile, the finger generates displacement on the screen, time counting is cancelled, and coordinates a (x, y) of the center point of the position of the user finger on the original coordinate system when the user finger finishes touching the screen are obtained; converting a (x, y) into a coordinate a on the function plug-in coordinate system_m(x_m,y_m)；

the initial touch coordinate S (525,1090) of the user in the gesture operation process is obtained; ending the touch coordinate a (525,1090), and not performing the function area judgment step because no displacement is generated;

because the gesture operation of the user does not generate displacement in the embodiment, the steps of S2-1, S2-2 and S2-4 are not executed;

s2-3, a mobile function judging step: if the user does not generate displacement when touching the screen, calculating the time for the user to press the screen of the intelligent terminal for a long time;

if the time is less than the triggering time threshold value delta T for 500ms, triggering the function of the circular functional area A;

if the long-time is greater than or equal to a triggering time threshold value delta T, triggering a moving function; when the mobile function is triggered, the radius of the functional plug-in is amplified by 1.5 to 2 times; amplifying by 1.5-2 times to prompt that the user is in the process of moving the annular function plug-in; the trigger function area moves along the moving direction of the finger of the user;

The long press time of the present embodiment is 550ms, which is greater than 500ms, so the mobile function is triggered; and after the user finishes moving, acquiring a central point of a finger touch position of the user when the user finishes moving, reestablishing an XY axis coordinate system by taking the central point as an original point to form a new functional plug-in coordinate system, and subdividing the functional area on the new functional plug-in coordinate system according to the functional area dividing step.

The user triggers the mobile function, the functional plug-in can be conveniently moved to any position of the screen according to which position of the screen is touched by the finger of the user, the operation of the user is facilitated, and the operation flexibility of the functional plug-in is improved.

Example 3

The origin coordinate of the embodiment is O (518,1114), and is on the left side of the screen of the intelligent terminal; initial touch coordinates S (536, 1123) of the user during the gesture operation; the touch coordinate a is ended (544,1397), and a displacement is generated.

the function plug-in setting step comprises:

s1, establishing a functional plug-in coordinate system:

s2, setting a threshold value:

s3, dividing functional areas:

the point set { (X, Y) | Y > -X on the function plug-in coordinate system, Y ≧ X and X²+Y²＞96²The region in which X ∈ (- ∞, + ∞) } is defined as a functional region C, which is defined as a "do not recognize" function, and the functional plug-in "does not recognize" a part of the functional regionIs red;

s1, an initial step:

acquiring a coordinate 0(518, 1114) of an origin of the function plug-in coordinate system on the original coordinate system; meanwhile, the user starts timing after starting the touch screen;

s2, judging:

s2-1, a functional area judging step:

if the user touches the screen by the finger and the finger generates displacement on the screen at the same time, canceling time timing and acquiring the position of the user finger when the touch on the screen is finishedCoordinates a (x, y) of the center point on the original coordinate system; converting a (x, y) into a coordinate a on the function plug-in coordinate system_m(x_m，y_m)；

Will coordinate a_mX in (2)_mSubstituted into Y₁＝-X，Y₂Calculating y from X₁And y₂；

If x_m ²+y_m ²＜R²Judging that the functional area where the touch end point is located is a circular functional area A;

the initial touch coordinates S (536, 1123) of the user in the gesture operation process are obtained; ending the touch coordinate a (544,1397), generating displacement, canceling time counting, and acquiring the coordinate a (544,1397) of the center point of the position of the finger of the user at the time of ending the touch on the screen on the original coordinate system; converting a (544,1397) into coordinate a on the function plug-in coordinate system_m(544-_m(26,283)；

Will coordinate a_mX in (2)_mSubstituted into Y₁＝-X,Y₂Calculating y from X₁And y₂，y₁Has a value of-26, y₂Has a value of 26;

y in the present embodiment_mHas a value of 283, y₁Has a value of-26, y₂Is 26, so y_m＞y₁And y is_m＞y₂And x_m ²+y_m ²＞96²Judging that the functional area where the touch end point is located is a functional area C which is a functional area which is not recognized;

s2-2, function triggering and judging step:

Therefore, Δ S is larger than the displacement threshold Δ X138px of the preset trigger function region, and trigger a_mThe function of the functional area B.

Respectively calculate y in₁' and y₂’；

the color of the prompt circle is the same as that of the functional area.

The color of the functional plug-in corresponds to the distinguishing color of the functional touch area; the color of the functional insert is translucent when the functional touch area is not used; the pattern on the screen of the intelligent terminal equipment can be clearly seen when the user does not use the functional plug-in;

Variations and modifications to the above-described embodiments may occur to those skilled in the art, which fall within the scope and spirit of the above description. Therefore, the present invention is not limited to the specific embodiments disclosed and described above, and some modifications and variations of the present invention should fall within the scope of the claims of the present invention. Furthermore, although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

Claims

1. A user gesture operation recognition method comprises a function plug-in setting step and a user gesture operation recognition step, is suitable for being executed on an intelligent terminal device through finger touch, an original coordinate system is arranged on a screen of the intelligent terminal device, an original point of the original coordinate system is arranged at an upper left corner endpoint of the screen of the intelligent terminal device, and is characterized in that the function plug-in is arranged on the screen of the intelligent terminal device, and a user performs gesture operation on the function plug-in, wherein:

the function plug-in setting step comprises:

s1, establishing a functional plug-in coordinate system:

s2, setting a threshold value:

s3, dividing functional areas:

set of points on a function plug-in coordinate system

The area is a functional area B;

set of points on a function plug-in coordinate system

The area is a functional area C;

set of points on a function plug-in coordinate system

The area is a functional area D;

set of points on a function plug-in coordinate system

The area is a functional area E;

the value of k is not zero;

s1, an initial step:

s2, judging:

s2-1, a functional area judging step:

Will coordinate a_mX in (2)_mSubstituted into Y₁＝-kX,

Respectively calculate y in₁And y₂；

if y_m＜y₁And y is_m≤y₂And x_m ²+y_m ²＞R²If yes, judging the functional area where the touch end point is located is a functionA region B;

s2-2, function triggering and judging step:

s2-3, a mobile function judging step:

if the long-time is greater than or equal to a triggering time threshold value delta T, triggering a moving function;

after the mobile function is triggered, the trigger function area moves along the movement direction of the finger of the user;

2. The method according to claim 1, wherein, in the original coordinate system, the left boundary of the screen is represented as X-W1, the right boundary of the screen is represented as X-W2, W1< W2; the upper boundary of the screen is represented as Y-H1, the lower boundary of the screen is represented as Y-H2, H1< H2;

if (x '-W1) < R, reset x' ═ W1+ R;

if (W2-x ') < R, reset x' ═ W2-R;

if (y '-H1) < R, then y' is reset to H1+ R;

if (H2-y ') < R, then y' is reset H2-R.

3. The method for recognizing the gesture operation of the user according to claim 1, wherein the step of setting the threshold further comprises setting a trigger prompt function displacement threshold af;

the range of R is [28dp,36dp ];

the range of the displacement threshold value delta X of the trigger function area is [42dp,50dp ];

the range of the trigger time threshold value delta T is 450-550 ms;

the range of the prompt function displacement threshold value delta F is [35dp,43dp ];

the functional plug-in setting step further comprises a unit conversion step of converting dp units of R, DeltaX, DeltaF into px units.

4. The method according to claim 3, wherein the step of dividing the functional area is specifically:

establishing a circle by taking the origin as the center of a circle and R as the radius, and establishing Y on the XY axis coordinate system₁＝-X,Y₂Dividing the function plugin coordinate system into 5 function regions, where:

judging the position of the origin on the screen of the intelligent terminal;

5. The method for recognizing the gesture operation of the user according to claim 4, wherein the displacement threshold value Δ X of the trigger function area is 46 dp; the trigger time threshold value delta T is 500 ms;

the value range of the prompt function displacement threshold value delta F is [35dp,43dp ];

and R is 32 dp.

6. The method according to claim 5, wherein the step of determining further comprises a step of determining in real time a prompt function, and the step of determining in real time specifically comprises:

s2-4, prompting function real-time judging step:

Respectively calculate y in₁' and y₂’；

the color of the prompt circle is the same as that of the functional area.

7. The method for recognizing the gesture operation of the user according to claim 1, wherein the radius of the function plug-in is the same as the radius R of the circular function area;

8. The utility model provides a user gesture operation recognition system, includes function plug-in setting module and user gesture operation recognition module, is applicable to finger touch and carries out on intelligent terminal, is provided with original coordinate system on the intelligent terminal screen, the original point setting of original coordinate system is at the upper left corner extreme point of intelligent terminal screen, its characterized in that, be provided with the function plug-in on the intelligent terminal screen, the user carries out the gesture operation on the function plug-in, wherein:

the function plug-in setting module includes:

s1, creating a functional plug-in coordinate system module:

s2, setting a threshold value:

s3, functional area division module:

set of points on a function plug-in coordinate system

The area is a functional area B;

set of points on a function plug-in coordinate system

The area is a functional area C;

set of points on a function plug-in coordinate system

The area is a functional area D;

set of points on a function plug-in coordinate system

The area is a functional area E;

the value of k is not zero;

the S1 and S3 form a function touch area on the screen of the intelligent terminal device; different functional areas of the functional touch area are distinguished by different colors;

the user gesture operation recognition module comprises:

s1, an initial module:

s2, a judgment module:

s2-1, function area judging module:

Will coordinate a_mX in (2)_mSubstituted into Y₁＝-kX,

Respectively calculate y in₁And y₂；

s2-2, function triggering judgment module:

s2-3, a mobile function judgment module:

9. The system according to claim 8, wherein the threshold setting module further comprises a threshold Δ F for setting a displacement threshold of a trigger prompt function;

the range of R is [28dp,36dp ];

the range of the trigger time threshold value delta T is 450-550 ms;

the functional plug-in setting module also comprises a unit conversion module, wherein the unit conversion module converts dp units of R, delta X and delta F into px units;

on the original coordinate system, it is assumed that the left boundary of the screen is represented as X-W1, the right boundary of the screen is represented as X-W2,

w1< W2; the upper boundary of the screen is represented as Y-H1, the lower boundary of the screen is represented as Y-H2, H1< H2;

if (x '-W1) < R, reset x' ═ W1+ R;

if (W2-x ') < R, reset x' ═ W2-R;

if (y '-H1) < R, then y' is reset to H1+ R;

if (H2-y ') < R, then y' is reset H2-R.

10. The system according to claim 9, wherein the functional region division module is specifically configured to:

judging the position of the origin on the screen of the intelligent terminal;

if the origin is on the left side of the central line of the screen of the intelligent terminal, the functional area D is defined as an uncertain function, and the functional area E has no specific function;

the judging module further comprises a prompt function real-time judging module, and the real-time judging module is specifically operated as follows:

s2-4, prompt function real-time judgment module:

Respectively calculate y in₁' and y₂’；

if y_n≤y₁' and y_n＞y₂' and x_n ²+y_n ²＞R²Starting to cut into a part of a prompting circle, wherein the cut-in part of the prompting circle gradually becomes larger along with the increase of deltaS', and prompting a user that the function of the function area E is about to be triggered; the color of the prompt circle is the same as that of the functional area;