TW202026840A - Operation intention determining method, apparatus, and electronic device thereof - Google Patents

Abstract

An operation intention determining method, apparatus, and electronic device are provided, which are applied to an electronic device provided with a touch area. The method includes receiving a touch operation on the touch area; collecting touch data on a selected pixel block in the touch area by taking an image frame as a time unit, where the touch data includes a pressure value of the pixel block subjected to the touch operation; determining a weight of the pixel block based on the pressure value received by the pixel block; and calculating a centroid of the touch data in each frame by using the weight of the pixel block and the position of the pixel block in the touch area. With the method, the operation intention of the touch operation is determined based on the centroid of the touch data of each frame.

Description

Method, device and electronic equipment for determining operation intention

The present invention relates to the field of computer technology, and more specifically, to a method, device and electronic equipment for determining an operation intention.

With the development of technology, the application of touch-type electronic devices has become more and more extensive, which not only provides convenience for users to operate electronic devices, but also brings better visual effects to users, improves user experience, and increases users’ The stickiness of the device.

The user can realize the interaction with the electronic device (ie, human-computer interaction) through the touch area set on the electronic device. Therefore, how to determine the user's intention to represent the touch operation of the touch area is the most important thing for human-computer interaction. Important.

In view of this, the present invention provides a method, a device and an electronic device for determining an operation intention, so as to realize the determination of the operation intention of a touch operation of the electronic device, which is a problem to be solved.

In view of this, the present invention provides a method, a device and an electronic device for determining an operation intention, so as to realize the determination of the operation intention of a touch operation of the electronic device.

The technical solutions are as follows:

A method for determining operation intention, applied to an electronic device provided with a touch area, includes:

Receiving a touch operation on the touch area, and collecting touch data of the selected pixel block in the touch area with the image frame as a time unit, the touch data including the pressure value of the pixel block under the touch operation;

Determine the weight of the pixel block according to the pressure value of the pixel block;

Use the weight of the pixel block and the position of the pixel block in the touch area to calculate the centroid of each frame of touch data;

The operation intention of the touch operation is determined based on the centroid of the touch data of each frame.

Preferably, determining the weight of the pixel block according to the pressure value of the pixel block includes:

The corresponding relationship between the preset weight and the pressure range is queried, and the weight corresponding to the pressure range to which the pressure value of the pixel block belongs is determined as the weight of the pixel block.

Preferably, the pixel block includes a plurality of pixel sub-blocks, and collecting the pressure value of the pixel block includes collecting the pressure value of each pixel sub-block in the pixel block.

Determine the weight of the pixel block according to the pressure value of the pixel block, including:

The weight of the pixel sub-block is determined according to the pressure value of each pixel sub-block in the pixel block.

Preferably, using the weight of the pixel block and the position of the pixel block in the touch area to calculate the centroid of each frame of touch data includes:

Get the position of each pixel sub-block of each pixel block selected in the touch area in the touch area. The position of the pixel sub-block in the touch area includes the horizontal and vertical coordinates of the pixel sub-block in the touch area. The center formula separately calculates the centroid of each frame of touch data;

The centroid formula is:

為當前幀觸摸數據中第

個像素子塊的權重，

為當前幀觸摸數據中第

個像素子塊的橫座標、

為當前幀觸摸數據中第

個像素子塊的縱座標，

為當前幀觸摸數據的質心橫座標，

為當前幀觸摸數據的質心縱座標。among them,

Is the first touch data in the current frame

The weight of each pixel sub-block,

Is the first touch data in the current frame

The abscissa of each pixel sub-block,

Is the first touch data in the current frame

The ordinate of each pixel sub-block,

Is the centroid and abscissa of the touch data of the current frame,

Is the centroid vertical coordinate of the touch data of the current frame.

Preferably, it also includes:

Obtain the number of image frames collected by receiving the touch operation;

If the number of image frames is less than the first preset threshold, save the collected touch data of each frame;

If the number of image frames is not less than the first preset threshold, save and calculate the collected touch data of each frame, and determine whether the current touch operation exceeds the touch boundary based on the centroid of the touch data of the current frame;

If the touch operation exceeds the touch boundary, stop collecting touch data and output the centroid of each frame of touch data.

Preferably, before determining the operation intention of the touch operation based on the centroid of each frame of touch data, the method further includes:

Judging whether the number of image frames is less than the second preset threshold;

If the number of image frames is less than the second preset threshold, it is determined that the operation intention of the touch operation indicates a click operation, and the second preset threshold is less than the first preset threshold.

Preferably, determining the operation intention of the touch operation based on the centroid of each frame of touch data includes:

Sort the centroids of each frame of touch data collected by the received touch operations according to the order of the touch data collection to obtain the centroid sequence;

Remove the first preset number of centroids that are ranked highest in the centroid sequence, and remove the second preset number of centroids that are ranked lowest in the centroid sequence to obtain the first centroid sequence;

The operation intention of the touch operation is determined based on the first centroid sequence.

Preferably, it also includes:

The first centroid in the first centroid sequence is determined as the starting point, and the end centroid in the first centroid sequence is determined as the ending point, and the number of image frames collected from the starting point to the ending point is defined as the total For the image frame, after receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first distance, and initialize the first distance to zero;

Calculate the second distance between the centroid of the current image frame and the starting point;

Compare whether the second distance is greater than the first distance;

If the second distance is greater than the first distance, update the value of the second distance to the value of the first distance;

If the second distance is not greater than the current first distance, compare the current number of image frames with the total number of image frames to obtain the comparison result;

When the comparison result of the number of image frames meets the first preset condition, and the second distance and the current first distance meet the first preset sub-condition, update the current centroid as the starting point;

When the comparison result of the number of image frames meets the second preset condition, and the second distance and the current first distance meet the second preset sub-condition, update the current centroid as the starting point;

When the comparison result of the number of image frames meets the third preset condition, the current centroid is updated as the end point.

Preferably, it also includes:

Determine the first centroid as the starting point, preset the total number of image frames to be collected for touch operations. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first Three distances, and initialize the third distance to zero;

Calculate the fourth distance between the centroid of the current image frame and the starting point;

Compare whether the fourth distance is greater than the third distance;

If the fourth distance is greater than the third distance, update the value of the third distance to the value of the fourth distance;

If the fourth distance is not greater than the third distance, compare the current number of image frames with the total number of image frames to obtain the comparison result;

When the comparison result of the number of image frames meets the first preset condition, and the third distance and the fourth distance meet the first preset sub-condition, update the current centroid as the starting point;

When the comparison result of the number of image frames meets the second preset condition, and the third distance and the fourth distance meet the second preset sub-condition, update the current centroid as the starting point;

When the comparison result of the number of image frames meets the third preset condition, the current centroid is updated as the end point.

Preferably, it also includes:

Select a centroid before the image frame sequence where the updated end point is located, the ratio of the serial number of the centroid to the total number of image frames meets the fourth preset condition, and the distance between the centroid and the centroid of the previous frame meets the fifth The preset condition updates the center of mass to the end point.

Preferably, determining the operation intention of the touch operation based on the centroid of the touch data includes:

Subtract the abscissa of the starting point from the abscissa of the end point to obtain the abscissa difference;

Subtract the ordinate of the starting point from the ordinate of the end point to obtain the ordinate difference;

If the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth preset condition, it is determined that the operation intention of the touch operation indicates a click operation;

If the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference does not satisfy the sixth preset condition, judge whether the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfy the seventh preset condition;

If the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition, when the abscissa difference is less than 0, the operation intention of the touch operation is determined to indicate the sliding operation; the abscissa difference is not less than At 0, it is determined that the operation intention of the touch operation indicates the sliding operation;

If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not satisfy the seventh preset condition, judge whether the ordinate difference is greater than 0;

If the ordinate difference value is greater than 0, judge whether the absolute value of the ordinate difference value and the absolute value of the abscissa difference meet the eighth preset condition; if the absolute value of the abscissa difference value and the absolute value of the ordinate difference value meet the first Eight preset conditions, determine that the operation intention of the touch operation indicates the left swipe operation, if the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the eighth preset condition, determine the operation intention of the touch operation to indicate the sliding operation ；

If the ordinate difference value is not greater than 0, judge whether the absolute value of the ordinate difference value and the absolute value of the abscissa difference meet the ninth preset condition; if the absolute value of the abscissa difference value and the absolute value of the ordinate difference value satisfy The ninth preset condition is to determine that the operation intention of the touch operation indicates a right-swiping operation. If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the ninth preset condition, the operation intention of the touch operation is determined to indicate an upward sliding operating.

A device for determining an operation intention applied to an electronic device provided with a touch area, including:

The touch operation receiving unit is configured to receive the touch operation on the touch area, and collect the touch data of the selected pixel block in the touch area by using the image frame as a time unit, and the touch data includes the pressure value of the pixel block under the touch operation;

The weight determining unit is used to determine the weight of the pixel block according to the pressure value of the pixel block;

The centroid calculation unit is used to calculate the centroid of each frame of touch data by using the weight of the pixel block and the position of the pixel block in the touch area;

The first operation intention determination unit is configured to determine the operation intention of the touch operation based on the centroid of each frame of touch data.

An electronic device including a touch area, and

The touch operation receiving unit is configured to receive a touch operation on the touch area, and collect touch data of a selected pixel block in the touch area by using the image frame as a time unit, the touch data including the pixel block receiving the touch Operating pressure value;

A weight determining unit, configured to determine the weight of the pixel block according to the pressure value of the pixel block;

The centroid calculation unit is used to calculate the centroid of the touch data in each frame by using the weight of the pixel block and the position of the pixel block in the touch area; and

The first operation intention determination unit is configured to determine the operation intention of the touch operation based on the centroid of the touch data in each frame.

The present invention provides a method, a device and an electronic device for determining an operation intention, which are applied to an electronic device provided with a touch area. The method collects selected pixels in the touch area by using an image frame as a time unit by receiving a touch operation on the touch area The touch data of the block, the touch data includes the pressure value of the pixel block subjected to the touch operation; and the weight of the pixel block is determined according to the pressure value of the pixel block; and then the weight of the pixel block and the position of the pixel block in the touch area are used to calculate the touch of each frame Data centroid mode; realizes the purpose of determining the operation intention of the touch operation based on the centroid of each frame of touch data.

The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

Touch-type electronic devices are more and more widely used, and users can operate the touch-type electronic devices to achieve interaction with the electronic devices (ie, human-computer interaction). In the process of human-computer interaction, the user usually performs a touch operation on the touch area of the electronic device to realize the human-computer interaction with the electronic device.

When determining the operation intention of the touch operation performed by the user on the touch area of the electronic device, it may be implemented based on the operation intention determination method shown in FIG. 1 below. The touch area can be the HOME key or the touch display screen, and of course it can also be any other part of the electronic device for touch operation, such as the side or the back.

Fig. 1 is a flowchart of a method for determining an operation intention provided by an embodiment of the present invention.

As shown in Figure 1, the method includes:

S101. Receive a touch operation on a touch area, and collect touch data of a selected pixel block in the touch area using an image frame as a time unit, where the touch data includes the pressure value of the pixel block under the touch operation;

Referring to FIG. 2, in the embodiment of the present invention, the touch area of the electronic device is divided into several sub-blocks 21, and the selected sub-blocks among the several sub-blocks 21 may be referred to as pixel blocks 22. Receiving the touch operation on the touch area, the touch data of the pixel block 22 in the touch area may be collected by using the image frame as a time unit. The touch data of the pixel block 22 includes the pressure value of the pixel block 22 under the touch operation.

In the embodiment of the present invention, a touch operation on the touch area is received, and a plurality of image frames are collected, and each image frame corresponds to the pressure value of each pixel block 22 in the touch area when the image frame is collected. That is, each image frame corresponds to a frame of touch data, and the frame of touch data is the pressure value of each pixel block 22 in the touch area that is subjected to a touch operation at the moment the image frame is collected.

S102: Determine the weight of the pixel block according to the pressure value suffered by the pixel block.

In the embodiment of the present invention, for a pixel block 22 in a frame of touch data, the weight of the pixel block 22 can be calculated according to the pressure value that the pixel block 22 bears.

In the embodiment of the present invention, the corresponding relationship between the weight and the pressure range may be preset to determine the pressure range to which the pressure value of the pixel block 22 belongs, and the weight corresponding to the determined pressure range is used as the weight of the pixel block 22.

In the embodiment of the present invention, the pixel block may include multiple pixel sub-blocks, and the pressure value borne by the pixel block 22 includes the pressure value borne by each pixel sub-block in the pixel block 22. Correspondingly, the method of determining the weight of the pixel block 22 according to the pressure value of the pixel block 22 includes: for each pixel sub-block in the pixel block 22, the weight of the pixel sub-block is determined according to the pressure value of the pixel sub-block.

The method of determining the weight of the pixel sub-block according to the pressure value of the pixel sub-block can be: preset the corresponding relationship between the weight and the pressure range, and then determine the pressure range to which the pressure value of the pixel sub-block belongs, and compare the determined pressure The weight corresponding to the range is determined as the weight of the pixel sub-block.

For example, a touch area with a size of 96*96 pixels can be divided into 24*12 sub-blocks 21; then 4*4=16 sub-blocks 21 are selected from 24*12 sub-blocks 21, and each selected sub-block 21 Defined as one pixel block 22, there are 16 pixel blocks 22. The manner of selecting 4*4 sub-blocks 21 from 24*12 sub-blocks 21 can be seen in FIG. 2. The sub-block 21 in FIG. 2 can be understood as a pixel block 22 selected from an image.

After the pixel block 22 is selected, the pixel block 22 is divided into a first pixel sub-block and a second pixel sub-block; referring to Figure 3(a), the pixel block 22 contains 4*8 pixels, and the pixel block 22 can be divided into Two 4*4 pixel sub-blocks; referring to Fig. 3(b), the pixel block 22 includes 4*8 pixels, and the pixel block 22 can also be divided into 8 2*2 pixel sub-blocks.

In the embodiment of the present invention, it is possible to classify according to the commonly used touch strength, and correspondingly generate the weight value of the touched pixel block according to the pressing strength level. For example, the maximum value of the commonly used touch strength is 1000, and the strength level is set to 0-15, and the weight value Corresponds to 0~15.

Take each pixel block 22 that is 4X8 pixels and divide it into two 4X4 pixel sub-blocks as an example: the area greater than 0 is the area touched by the finger; if pressed, the small sub-block in the pixel sub-block Set to 1, otherwise set to 0; the data is stored in bits. If the data output is 254, the binary bit is 1111 1110, which means that the pressing level of one pixel sub-block is 15, that is, the weight is 15; the pressing level of the other pixel sub-block is 14, that is The weight is 14.

S103: Calculate the centroid of each frame of touch data by using the weight of the pixel block and the position of the pixel block in the touch area;

In an embodiment of the present invention, for a captured image frame (ie, a frame of touch data), it may be based on that the image frame includes each pixel block 22 in the touch area at the moment the image frame is captured. The pressure value of the touch operation and the position of each pixel block 22 in the touch area are calculated to calculate the centroid of the image frame.

Wherein, using the weight of the pixel block 22 in the touch data and the position of the pixel block 22 in the touch area to calculate the centroid of the touch data, the centroid formula can be used to realize the centroid formula:

為當前幀觸摸數據中第

個像素子塊的權重，

為當前幀觸摸數據中第

個像素子塊的橫座標、

為當前幀觸摸數據中第

個像素子塊的縱座標，

為當前幀觸摸數據的質心橫座標，

為當前幀觸摸數據的質心縱座標。在本發明實施例中，當前幀觸摸數據的質心為（

，

），即（

，

）為當前幀觸摸數據的質心的座標。among them,

Is the first touch data in the current frame

The weight of each pixel sub-block,

Is the first touch data in the current frame

The abscissa of each pixel sub-block,

Is the first touch data in the current frame

The ordinate of each pixel sub-block,

Is the centroid and abscissa of the touch data of the current frame,

Is the centroid vertical coordinate of the touch data of the current frame. In the embodiment of the present invention, the centroid of the touch data of the current frame is (

,

),which is(

,

) Is the coordinates of the centroid of the touch data of the current frame.

S104: Determine an operation intention of the touch operation based on the centroid of the touch data of each frame.

In the embodiment of the present invention, the operation intention of the touch operation can be determined based on the centroid of the collected touch data of each frame.

Fig. 4 is a flowchart of another method for determining an operation intention provided by an embodiment of the present invention.

As shown in Figure 4, the method includes:

S401. Receive a touch operation on a touch area, and collect touch data of a selected pixel block 22 in the touch area by using an image frame as a time unit, where the touch data includes the pressure value of the pixel block 22 subjected to the touch operation;

S402: Acquire the number of image frames collected by receiving the touch operation;

S403: Determine whether the number of image frames is less than the first preset threshold; if the number of image frames is less than the first preset threshold, perform step S404; if the number of image frames is not less than the first preset threshold, perform step S405;

In the embodiment of the present invention, the first preset threshold may be 20 frames. If the number of image frames collected by the touch operation is less than 20 frames, step S404 can be performed; if the number of image frames collected by the touch operation is not When it is less than 20 frames, you can perform step S405.

S404: Save the collected touch data of each frame, and return to step S401;

S405. Save and calculate the collected touch data of each frame, and determine whether the current touch operation exceeds the touch boundary based on the centroid of the touch data of the current frame; if the touch operation exceeds the touch boundary, perform step S406;

In the embodiment of the present invention, for the method of determining the centroid of the touch data of the current frame, please refer to the method of calculating the centroid of the touch data provided in the foregoing embodiment, which is not repeated here.

In the embodiment of the present invention, if the abscissa of the centroid of the touch data of the current frame is within the first threshold range, and the ordinate of the centroid of the touch data of the current frame is within the second threshold range, the determination is based on the touch data of the current frame The centroid of the current touch operation does not exceed the touch boundary; conversely, if the abscissa of the centroid of the current frame of touch data is not within the first threshold range or the ordinate of the centroid of the current frame of touch data is not within the second threshold range When determining that the current touch operation exceeds the touch boundary based on the centroid of the touch data of the current frame.

In the embodiment of the present invention, the first threshold value range and the second threshold value range may be the same or different. For the distribution modulus of the pixel block in FIG. 2, the minimum boundary value is generally 10.5 and the maximum value is 84.5. Therefore, the first The threshold value range is set to be greater than 12 and less than 82; the second threshold value range is set to be greater than 12 and less than 84. The above is only a preferred way of the first threshold range and the second threshold range provided by the embodiment of the present invention. The specific value of the second threshold range can be set by the inventor according to his own needs, and is not limited here.

S406. Stop collecting touch data, and output the centroid of each frame of touch data based on the saved touch data of each frame;

In the embodiment of the present invention, if it is determined that the current touch operation exceeds the touch boundary, the collection of touch data can be stopped, and the centroid of each frame of touch data can be output based on the saved touch data of each frame.

Further, in the embodiment of the present invention, if it is not detected that the current touch operation exceeds the touch boundary, but the touch operation is stopped, the collection of touch data can also be stopped, and based on the saved touch data of each frame, the output of each frame of touch data Centroid.

S407. Determine whether the number of image frames is less than the second preset threshold, and the second preset threshold is less than the first preset threshold; if the number of image frames is less than the second preset threshold, perform step S408; if the number of image frames is not less than For the second preset threshold, perform step S409;

S408: Determine that the operation intention of the touch operation indicates a click operation;

Further, the method for determining a touch intention provided by an embodiment of the present invention may also determine whether the number of image frames is less than a second preset threshold before determining the operation intention of the touch operation based on the centroid of each frame of touch data. If the number is less than the second preset threshold, it is determined that the operation intention of the touch operation indicates a click operation. If the number of image frames is not less than the second preset threshold, step S409 is executed.

In the embodiment of the present invention, the second preset threshold is less than the first preset threshold, and the second preset threshold can be 3 frames. If it is determined that the number of image frames is less than 3 frames, the operation intention of the touch operation can be directly determined as Click Action. The foregoing is only a preferred manner of the second preset threshold provided by the embodiment of the present invention. The specific value of the second preset threshold can be set by the inventor according to his own needs, which is not limited here.

S409: Determine the operation intention of the touch operation based on the centroid of the touch data of each frame.

In the embodiment of the present invention, according to the order of the collected touch data, the centroids of the frame touch data are sequentially output to obtain the movement trajectory of the centroid during the touch operation, and then the operation intention of the touch operation can be determined based on the movement trajectory of the centroid .

In the embodiment of the present invention, before determining the operation intention of the touch operation based on the centroid of each frame of touch data, the centroid of the collected touch data may be further filtered, so as to realize the determination of the touch operation based on the filtered centroid. The purpose of the operation intention is to simplify the calculation and improve the accuracy of the operation intention determination.

5 is a flowchart of a method for determining the operation intention of a touch operation based on the centroid of each frame of touch data according to an embodiment of the present invention.

As shown in Figure 5, the method includes:

S501: Sort the centroid of each frame of touch data collected by the received touch operation according to the order of the touch data collection, to obtain a centroid sequence;

In the embodiment of the present invention, for each frame of touch data saved, the centroid of each frame of touch data is sorted according to the order of collection of each frame of touch data to obtain a centroid sequence, which can be reflected in the touch operation The center of mass movement trajectory in the process.

S502. Eliminate the first preset number of centroids that are ranked highest in the centroid sequence, and eliminate the second preset number of centroids that are lowest ranked in the centroid sequence to obtain the first centroid sequence;

By analyzing the movement trajectory of the center of mass, it is found that when the touch operation is initially performed, the center of mass of the collected touch data will jitter, and when the touch operation ends, the center of mass of the collected touch data will appear tailing. Therefore, in the embodiment of the present invention, the first M frames of touch data and the last N frames of touch data collected during the touch operation are eliminated to reduce the influence of jitter and tailing on the determination of the operation intention.

In the embodiment of the present invention, M frames can be considered as the first preset number, and N frames can be considered as the second preset number; for the case of Figure 3(a), M can be set to 1 and N can be set to 2; For the situation in Figure 3(b), M can be set to 1, and N can be set to any integer between 5 and 8. The above are only the preferred ways of the first preset quantity and the second preset quantity provided by the embodiment of the present invention. The inventors can set the specific content of the first preset quantity and the second preset quantity according to their own needs. There is no limitation here.

S503: Determine an operation intention of the touch operation based on the first centroid sequence.

In the embodiment of the present invention, after the first M centroids in the centroid sequence are eliminated, and the last N centroids in the centroid sequence are eliminated, the first centroid sequence can be obtained, which can then be realized based on the first centroid sequence The determination of the operation intention of the touch operation.

Considering that when half-finger slides, the trajectory of the center of mass will repeat back and forth. After obtaining the first center of mass sequence, the embodiment of the present invention may further judge the inflection point in the first center of mass sequence to optimize the movement of the center of mass. Track.

FIG. 6 is a flowchart of a method for optimizing the movement trajectory of the center of mass according to an embodiment of the present invention.

As shown in Figure 6, the method includes:

S601. Determine the first centroid in the first centroid sequence as the starting point, and determine the end centroid in the first centroid sequence as the ending point, and define the number of image frames collected from the starting point to the ending point Is the total image frame, after receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first distance, and initialize the first distance to zero;

S602: Calculate a second distance between the centroid of the current image frame and the starting point;

S603. Compare whether the second distance is greater than the first distance; if the second distance is greater than the first distance, perform step S604; if the second distance is not greater than the current first distance, perform step S605;

S604: Update the second distance value to the first distance value;

S605: Compare the current number of image frames with the total number of image frames to obtain a comparison result;

S606: When the comparison result of the number of image frames meets the first preset condition, and the second distance and the current first distance meet the first preset sub-condition, update the centroid of the current image frame as the starting point;

In the embodiment of the present invention, the first preset condition may be that the ratio of the current number of image frames to the total number of image frames is less than 70%. The comparison result of the number of image frames indicates the ratio of the current number of image frames to the total number of image frames, and when the ratio is less than 70%, it indicates that the comparison result of the number of image frames meets the first preset condition.

The second distance and the current first distance satisfy the first preset sub-condition, and the second distance may be less than 80% of the current first distance. If the second distance is less than the current first distance*80%, it is considered that the second distance and the current first distance meet the first preset sub-condition, and the starting point of the first centroid sequence is updated to the quality of the current image frame. heart.

In the embodiment of the present invention, when the comparison result of the number of image frames satisfies the first preset condition, and the second distance and the current first distance do not meet the first preset sub-condition, the next image frame adjacent to the current image frame An image frame is updated to the current image frame, and step S602 is returned to;

In the embodiment of the present invention, when the comparison result of the number of image frames meets the first preset condition, and the second distance and the current first distance meet the first preset sub-condition, the centroid of the current image frame is updated to the start After clicking, the next image frame adjacent to the image frame can also be updated as the current image frame, and step S602 is returned to.

S607: When the comparison result of the number of image frames meets the second preset condition, and the second distance and the current first distance meet the second preset sub-condition, update the current centroid as the starting point;

In the embodiment of the present invention, the second preset condition may be that the ratio of the current image frame number to the total image frame number is greater than or equal to 70% and less than 90%. The comparison result of the number of image frames indicates the ratio of the current number of image frames to the total number of image frames. When the ratio is greater than or equal to 70% and not less than 90%, it indicates that the comparison result of the number of image frames meets the second preset condition.

The second distance and the current first distance satisfy the second preset sub-condition, and the second distance may be less than 80% of the current first distance. If the second distance is less than the current first distance*80%, it is considered that the second distance and the current first distance meet the second preset sub-condition, and the starting point of the first centroid sequence is updated to the quality of the current image frame. heart.

Further, after performing step S607, it can also be judged whether the ratio of the current image frame number to the total image frame number is greater than 80%. If so, stop the optimization process of the centroid movement trajectory in the first centroid sequence, based on the current The first centroid sequence determines the operation intention.

Further, if the comparison result of the number of image frames meets the second preset condition, and the second distance and the current first distance do not meet the second preset sub-condition, the next image adjacent to the current image frame The image frame is taken as the current image frame and returns to step S602.

S608: When the comparison result of the number of image frames meets the third preset condition, update the current centroid as the end point.

In the embodiment of the present invention, the third preset condition may be that the ratio of the current number of image frames to the total number of image frames is greater than or equal to 90%. The comparison result of the number of image frames indicates the ratio of the current number of image frames to the total number of image frames, and when the ratio is greater than or equal to 90%, it indicates that the comparison result of the number of image frames meets the third preset condition.

When the comparison result of the number of image frames meets the third preset condition, the centroid of the current image frame is updated to the end point of the first centroid sequence.

In the embodiment of the present invention, the specific values of the first preset condition, the second preset condition, the third preset condition, the first preset sub-condition, and the second preset sub-condition can be set by the inventor according to his needs , It is not limited here.

In the embodiment of the present invention, in addition to optimizing the first centroid sequence to optimize the movement trajectory of the centroid, the execution movement trajectory can also be optimized in the process of collecting operation data. Please refer to FIG. 7 for details.

FIG. 7 is a flowchart of another method for optimizing the movement trajectory of the center of mass provided by an embodiment of the present invention.

As shown in Figure 7, the method includes:

S701. Receive a touch operation on the touch area, collect the touch data of the selected pixel block in the touch area by using the image frame as a time unit, and determine the centroid of the first collected image frame as the starting point, and preset The total number of image frames to be collected for the touch operation. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the third distance, and initialize the third distance to zero;

S702: Calculate the fourth distance between the centroid of the current image frame and the starting point;

S703. Compare whether the fourth distance is greater than the third distance; if the fourth distance is greater than the third distance, perform step S704; if the fourth distance is not greater than the third distance, perform step S705;

S704: Update the value of the third distance to the value of the fourth distance;

S705: Compare the current number of image frames with the total number of image frames to obtain a comparison result;

S706: When the comparison result of the number of image frames meets the first preset condition, and the third distance and the fourth distance meet the first preset sub-condition, update the current centroid as the starting point;

S707: When the comparison result of the number of image frames meets the second preset condition, and the third distance and the fourth distance meet the second preset sub-condition, update the current centroid as the starting point;

S708: When the comparison result of the number of image frames meets the third preset condition, update the centroid of the current image frame as the end point.

Further, in the method for determining the operation intention provided by the embodiment of the present invention, on the basis of the above optimization process of the center of mass movement trajectory, in order to further accurately determine the end point of the center of mass movement trajectory, the above-mentioned center of mass movement trajectory may be optimized. Backtracking to the end point of the center-of-mass movement trajectory, the method is specifically: selecting a center of mass before the image frame sequence where the updated end point is located, and the proportion of the serial number of the center of mass to the total number of image frames conforms to the fourth prediction If the condition is set, and the distance between the centroid and the centroid of the previous frame meets the fifth preset condition, the centroid is updated as the end point.

In the embodiment of the present invention, the updated end point is the centroid of a captured image frame, a target image frame is selected from each image frame captured before the image frame, and the target image frame The ratio of the serial number of the center of mass to the total number of image frames meets the fourth preset condition, and the distance between the center of mass of the target image frame and the center of mass of the image frame collected in the previous frame meets the fifth preset Condition, update the centroid of the target image frame as the end point.

Among them, you can set the serial number of the centroid of each acquired image frame in sequence according to the order in which the image frames are acquired. For example, set the serial number of the centroid of the first acquired image frame to 1, and the acquired Set the serial number of the centroid of the second image frame to 2, and set the serial number of the centroid of the third image frame to 3...and so on; correspondingly, the serial number of the centroid of the target image frame The proportion to the total number of image frames can be understood as the result of dividing the serial number of the centroid of the target image frame by the total number of image frames.

In the embodiment of the present invention, the fourth preset condition may be 7/8. If the ratio of the serial number of the centroid of the target image frame to the total number of image frames is greater than 7/8, the target image frame can be considered The ratio of the serial number of the centroid to the total image frame number meets the fourth preset condition.

In the embodiment of the present invention, the fifth preset condition may be 10. If the distance between the centroid of the target image frame and the centroid of the image frame acquired in the previous frame is greater than 10, the The distance between the centroid and the centroid of the image frame collected in the previous frame satisfies the fifth preset condition.

In order to facilitate the detailed description of an operation intention determination method provided by an embodiment of the present invention, a flow chart of a method for determining the operation intention of a touch operation based on the centroid of each frame of touch data is provided here. For details, please refer to FIG. 8.

As shown in Figure 8, the method includes:

S801. Subtract the abscissa of the starting point from the abscissa of the end point to obtain an abscissa difference;

S802. Subtract the ordinate of the starting point from the ordinate of the end point to obtain the ordinate difference;

S803. Determine whether the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth preset condition, if the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth preset condition. Set the conditions and go to step S804; if the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference does not meet the sixth preset condition, go to step S805;

In the embodiment of the present invention, when the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference is less than 15, it can be considered that the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth The preset condition; otherwise, it is considered that the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference does not meet the sixth preset condition.

S804: Determine the operation intention of the touch operation to indicate a click operation;

S805. Determine whether the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition, execute Step S806: If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the seventh preset condition, go to step S809;

In the embodiment of the present invention, when the absolute value of the abscissa difference is greater than the absolute value of the ordinate difference, it can be considered that the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfy the seventh preset condition; otherwise, It is considered that the absolute value of the abscissa difference and the absolute value of the ordinate difference do not satisfy the seventh preset condition.

S806. Determine whether the abscissa difference is less than 0; when the abscissa difference is less than 0, execute step S807; when the abscissa difference is not less than 0, execute step S808;

S807. Determine the operation intention of the touch operation to indicate an upward sliding operation;

S808. Determine the operation intention of the touch operation to indicate a sliding operation;

S809. Determine whether the ordinate difference is greater than 0; if the ordinate difference is greater than 0, execute step S810; if the ordinate difference is not greater than 0, execute step S813;

S810. Determine whether the absolute value of the ordinate difference and the absolute value of the abscissa satisfy the eighth preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfy the eighth preset condition, execute Step S811: If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the eighth preset condition, go to step S812;

In the embodiment of the present invention, when the absolute value of the ordinate difference is greater than the absolute value of the abscissa difference, it can be considered that the absolute value of the ordinate difference and the absolute value of the abscissa satisfy the eighth preset condition; , The absolute value of the ordinate difference and the absolute value of the abscissa difference do not satisfy the eighth preset condition.

S811. Determine that the operation intention of the touch operation indicates a left swipe operation;

S812. Determine that the operation intention of the touch operation indicates an upward sliding operation;

S813. Determine whether the absolute value of the ordinate difference and the absolute value of the abscissa satisfy the ninth preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfy the ninth preset condition, execute Step S814: If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the ninth preset condition, go to step S815.

In the embodiment of the present invention, when the absolute value of the ordinate difference is greater than the absolute value of the abscissa difference, it can be considered that the absolute value of the ordinate difference and the absolute value of the abscissa difference satisfy the ninth preset condition; , It is considered that the absolute value of the ordinate difference and the absolute value of the abscissa do not satisfy the ninth preset condition.

S814. Determine that the operation intention of the touch operation indicates a right sliding operation;

S815: Determine that the operation intention of the touch operation indicates an upward sliding operation.

The above are only the preferred methods of the sixth preset condition, the seventh preset condition, the eighth preset condition, and the ninth preset condition provided by the embodiments of the present invention. The specific content of the eighth preset condition and the ninth preset condition can be set by the inventor according to his own needs, and is not limited here.

Fig. 9 is a schematic structural diagram of a device for determining an operation intention provided by an embodiment of the present invention.

As shown in Figure 9, the device includes:

The touch operation receiving unit 91 is configured to receive a touch operation on the touch area, and collect touch data of a selected pixel block in the touch area by using an image frame as a time unit, and the touch data includes the pressure value of the pixel block under the touch operation;

The weight determining unit 92 is configured to determine the weight of the pixel block according to the pressure value of the pixel block;

The centroid calculation unit 93 is used to calculate the centroid of each frame of touch data by using the weight of the pixel block and the position of the pixel block in the touch area;

The first operation intention determination unit 94 is configured to determine the operation intention of the touch operation based on the centroid of the touch data of each frame.

In the embodiment of the present invention, the weight determination unit 92 is specifically configured to query the correspondence between the preset weight and the pressure range, and determine the weight corresponding to the pressure range to which the pressure value suffered by the pixel block belongs as the weight of the pixel block.

In the embodiment of the present invention, the pixel block includes a plurality of pixel sub-blocks, the pressure value borne by the collected pixel block includes the pressure value borne by each pixel sub-block in the collected pixel block, and the weight determination unit 92 is specifically configured to perform according to each pixel block The pressure value of each pixel sub-block determines the weight of the pixel sub-block.

In the embodiment of the present invention, the centroid calculation unit 93 includes:

The acquiring unit is used to acquire the position of each pixel sub-block of each pixel block selected in the touch area in the touch area. The position of the pixel sub-block in the touch area includes the abscissa of the pixel sub-block in the touch area and Ordinate

The centroid meter operation element unit 93 is used to calculate the centroid of each frame of touch data separately by adopting the centroid formula. The centroid formula is:

為當前幀觸摸數據中第

個像素子塊的權重，

為當前幀觸摸數據中第

個像素子塊的橫座標、

為當前幀觸摸數據中第

個像素子塊的縱座標，

為當前幀觸摸數據的質心橫坐標，

為當前幀觸摸數據的質心縱坐標。among them,

Is the first touch data in the current frame

The weight of each pixel sub-block,

Is the first touch data in the current frame

The abscissa of each pixel sub-block,

Is the first touch data in the current frame

The ordinate of each pixel sub-block,

Is the abscissa of the centroid of the touch data of the current frame,

Is the ordinate of the centroid of the touch data of the current frame.

Further, the device for determining an operation intention provided by an embodiment of the present invention further includes a touch boundary judgment unit, configured to:

Obtain the number of image frames collected by receiving the touch operation;

If the number of image frames is less than the first preset threshold, save the collected touch data of each frame;

If the number of image frames is not less than the first preset threshold, save and calculate the collected touch data of each frame, and judge whether the current touch operation exceeds the touch boundary based on the centroid of the touch data of the current frame;

If the touch operation exceeds the touch boundary, stop collecting touch data and output the centroid of each frame of touch data.

Further, the apparatus for determining an operation intention provided by an embodiment of the present invention further includes a second operation intention determining unit, configured to:

Judging whether the number of image frames is less than the second preset threshold;

If the number of image frames is less than the second preset threshold, it is determined that the operation intention of the touch operation indicates a click operation, and the second preset threshold is less than the first preset threshold.

An embodiment of the present invention provides a first operation intention determination unit in an operation intention determination device, including:

The centroid sequence acquisition unit is used to sort the centroids of each frame of touch data collected by the received touch operations according to the order of the touch data collection, to obtain the centroid sequence;

The centroid culling unit is used to remove the first preset number of centroids that are the highest in the centroid sequence, and remove the second preset number of centroids that are the lowest in the centroid sequence to obtain the first A sequence of centroids;

The first operation intention determination subunit is configured to determine the operation intention of the touch operation based on the first centroid sequence.

Further, the apparatus for determining an operation intention provided by an embodiment of the present invention further includes a first centroid sequence optimization unit, configured to:

The first centroid in the first centroid sequence is determined as the starting point, and the end centroid in the first centroid sequence is determined as the ending point, and the number of image frames collected from the starting point to the ending point is defined as the total For the image frame, after receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first distance, and initialize the first distance to zero;

Calculate the second distance between the centroid of the current image frame and the starting point;

Compare whether the second distance is greater than the first distance;

If the second distance is greater than the first distance, update the value of the second distance to the value of the first distance;

If the second distance is not greater than the current first distance, compare the current number of image frames with the total number of image frames to obtain the comparison result;

When the comparison result of the number of image frames meets the first preset condition, and the second distance and the current first distance meet the first preset sub-condition, update the current centroid as the starting point;

When the comparison result of the number of image frames meets the second preset condition, and the second distance and the current first distance meet the second preset sub-condition, update the current centroid as the starting point;

When the comparison result of the number of image frames meets the third preset condition, the current centroid is updated as the end point.

Further, the apparatus for determining an operation intention provided by an embodiment of the present invention further includes a second centroid sequence optimization unit, configured to:

Determine the first centroid as the starting point, preset the total number of image frames to be collected for touch operations. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first Three distances, and initialize the third distance to zero;

Calculate the fourth distance between the centroid of the current image frame and the starting point;

Compare whether the fourth distance is greater than the third distance;

If the fourth distance is greater than the third distance, update the value of the third distance to the value of the fourth distance;

If the fourth distance is not greater than the third distance, compare the current number of image frames with the total number of image frames to obtain the comparison result;

When the comparison result of the number of image frames meets the first preset condition, and the third distance and the fourth distance meet the first preset sub-condition, update the current centroid as the starting point;

When the comparison result of the number of image frames meets the second preset condition, and the third distance and the fourth distance meet the second preset sub-condition, update the current centroid as the starting point;

When the comparison result of the number of image frames meets the third preset condition, the current centroid is updated as the end point.

Further, the apparatus for determining an operation intention provided by an embodiment of the present invention further includes a third centroid sequence optimization unit, configured to:

Select a centroid before the image frame sequence where the updated end point is located, the ratio of the serial number of the centroid to the total number of image frames meets the fourth preset condition, and the distance between the centroid and the centroid of the previous frame meets The fifth preset condition updates the center of mass to the end point.

In the embodiment of the present invention, the first operation intention determining unit 94 includes:

The first calculation unit is used to subtract the abscissa of the starting point from the abscissa of the end point to obtain the abscissa difference;

The second calculation unit is used to subtract the ordinate of the starting point from the ordinate of the end point to obtain the ordinate difference;

The first determining unit is configured to determine that the operation intention of the touch operation indicates a click operation if the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth preset condition;

The first judgment unit is used to judge whether the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the sixth preset condition if the sum of the absolute value of the abscissa difference value and the absolute value of the ordinate difference value Meet the seventh preset condition;

The second determining unit is configured to determine that if the absolute value of the abscissa difference value and the absolute value of the ordinate difference value meet the seventh preset condition, when the abscissa difference value is less than 0, determine that the operation intention of the touch operation indicates an upward sliding operation; When the abscissa difference is not less than 0, it is determined that the operation intention of the touch operation indicates a sliding operation;

The second judgment unit is used for judging whether the ordinate difference is greater than 0 if the absolute value of the abscissa difference and the absolute value of the ordinate difference do not satisfy the seventh preset condition;

The third determining unit is used to determine whether the absolute value of the ordinate difference and the absolute value of the abscissa satisfy the eighth preset condition if the ordinate difference is greater than 0; if the absolute value of the abscissa difference and the ordinate difference The absolute value of the difference satisfies the eighth preset condition, and the operation intention of the touch operation is determined to indicate a left swipe operation. If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the eighth preset condition, the touch operation is determined The operation intention indicates the sliding operation;

The fourth determining unit is used for judging whether the absolute value of the ordinate difference and the absolute value of the abscissa satisfy the ninth preset condition if the ordinate difference is not greater than 0; If the absolute value of the coordinate difference meets the ninth preset condition, it is determined that the operation intention of the touch operation indicates a right-swiping operation. If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the ninth preset condition, confirm the touch The operation intention of the operation indicates a sliding operation.

Further, an embodiment of the present invention also provides an electronic device, which includes the operation intention determining apparatus provided in the foregoing embodiment.

The present invention provides a method, a device and an electronic device for determining an operation intention, which are applied to an electronic device provided with a touch area, receive a touch operation on the touch area, and collect the touch of a selected pixel block in the touch area with an image frame as a time unit Data, the touch data includes the pressure value of the pixel block under the touch operation; the weight of the pixel block is determined according to the pressure value of the pixel block; the weight of the pixel block and the position of the pixel block in the touch area are used to calculate the centroid of each frame of touch data; The operation intention of the touch operation is determined based on the centroid of the touch data of each frame.

The above provides a detailed introduction to the method, device, and electronic device for determining the operation intention provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation of the present invention. The description of the above embodiments is only used to help understand the present invention. The method of the invention and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the invention, there will be changes in the specific implementation and the scope of application. In summary, the content of this specification should not be understood as Limitations of the invention.

It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. For the same and similar parts between the various embodiments, refer to each other. can. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method part.

It should also be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations. There is any such actual relationship or order between. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device inherent to a series of elements is included, or is also included in these processes , Methods, articles or equipment inherent elements. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article or equipment that includes the element.

The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined in this document can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown in this text, but should conform to the widest scope consistent with the principles and novel features disclosed in this text.

S101: Receive a touch operation on a touch area, and collect touch data of a selected pixel block in the touch area by using an image frame as a time unit, and the touch data includes the pressure value of the pixel block subjected to the touch operation S102: Determine the weight of the pixel block according to the pressure value of the pixel block S103: Calculate the centroid of each frame of touch data by using the weight of the pixel block and the position of the pixel block in the touch area S104: Determine the operation intention of the touch operation based on the centroid of the touch data of each frame S401: Receive a touch operation on a touch area, and collect touch data of a selected pixel block in the touch area by using an image frame as a time unit, and the touch data includes the pressure value of the pixel block subjected to the touch operation S402: Obtain the number of image frames collected by receiving touch operations S403: The number of image frames is less than the first preset threshold S404: Save the collected touch data of each frame S405: Save and calculate whether the collected touch data of each frame exceeds the touch boundary S406: Stop collecting touch data, and output the centroid of each frame of touch data based on the saved touch data of each frame S407: Whether the number of image frames is less than the second preset threshold S408: Determine the operation intention of the touch operation and indicate the click operation S409: Determine the operation intention of the touch operation based on the centroid of the touch data of each frame S501: Sort the centroid of each frame of touch data collected by the received touch operation according to the order of the touch data collection, to obtain a centroid sequence S502: Eliminate the first preset number of centroids that are ranked highest in the centroid sequence, and eliminate the second preset number of centroids that are ranked lowest in the centroid sequence to obtain the first centroid sequence S503: Determine the operation intention of the touch operation based on the first centroid sequence S601: Determine the first centroid in the first centroid sequence as the start point, and determine the end centroid in the first centroid sequence as the end point, and define the number of image frames collected from the start point to the end point Is the total image frame. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first distance, and initialize the first distance to zero S602: Calculate the second distance between the centroid of the current image frame and the starting point S603: Compare whether the second distance is greater than the first distance S604: Update the second distance value to the first distance value S605: Compare the current number of image frames with the total number of image frames to obtain a comparison result S606: When the comparison result of the number of image frames meets the first preset condition, and the second distance and the current first distance meet the first preset sub-condition, update the centroid of the current image frame as the starting point S607: When the comparison result of the number of image frames meets the second preset condition, and the second distance and the current first distance meet the second preset sub-condition, update the current centroid as the starting point S608: When the comparison result of the number of image frames meets the third preset condition, update the current centroid to the end point S701: Receive a touch operation on the touch area, collect the touch data of the selected pixel block in the touch area using the image frame as a time unit, determine the centroid of the first image frame collected as the starting point, and preset The total number of image frames to be collected by the touch operation. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the third distance, and initialize the third distance to zero S702: Calculate the fourth distance between the centroid of the current image frame and the starting point S703: Compare whether the fourth distance is greater than the third distance S704: Update the value of the third distance to the value of the fourth distance S705: Compare the current number of image frames with the total number of image frames to obtain a comparison result S706: When the comparison result of the number of image frames meets the first preset condition, and the third distance and the fourth distance meet the first preset sub-condition, update the current centroid as the starting point S707: When the comparison result of the number of image frames meets the second preset condition, and the third distance and the fourth distance meet the second preset sub-condition, update the current centroid as the starting point S708: When the comparison result of the number of image frames meets the third preset condition, update the centroid of the current image frame to the end point S801: Subtract the abscissa of the starting point from the abscissa of the end point to obtain the abscissa difference S802: Subtract the ordinate of the starting point from the ordinate of the end point to obtain the ordinate difference S803: The sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth preset condition S804: Determine the operation intention of the touch operation and indicate the click operation S805: Determine whether the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfy the seventh preset condition S806: Determine whether the abscissa difference is less than 0 S807: Determine the operation intention of the touch operation and indicate the sliding operation S808: Determine the operation intention of the touch operation and indicate the slide operation S809: Determine whether the ordinate difference is greater than 0 S810: The absolute value of the ordinate difference and the absolute value of the abscissa satisfy the eighth preset condition S811: Determine the operation intention of the touch operation and indicate the left swipe operation S812: Determine the operation intention of the touch operation and indicate the sliding operation S813: The absolute value of the ordinate difference and the absolute value of the abscissa satisfy the ninth preset condition S814: Determine the operation intention of the touch operation and indicate the right swipe operation S815: Determine the operation intention of the touch operation and indicate the sliding operation 21: sub-block 22: pixel block 91: Touch operation receiving unit 92: Weight determination unit 93: Centroid calculation unit 94: The first operation intention determination unit

FIG. 1 is a flowchart of a method for determining an operation intention provided by an embodiment of the present invention; 2 is a schematic diagram of a pixel block in a touch area provided by an embodiment of the present invention; Figure 3 (a) is a schematic diagram of a pixel block structure provided by an embodiment of the present invention; Fig. 3(b) is a schematic diagram of another pixel block structure provided by an embodiment of the present invention; 4 is a flowchart of another method for determining an operation intention provided by an embodiment of the present invention; 5 is a flowchart of a method for determining the operation intention of a touch operation based on the centroid of each frame of touch data provided by an embodiment of the present invention; FIG. 6 is a flowchart of a method for optimizing the movement trajectory of the center of mass according to an embodiment of the present invention; FIG. 7 is a flowchart of another method for optimizing the movement trajectory of the center of mass according to an embodiment of the present invention; FIG. 8 is a flowchart of a method for determining the operation intention of a touch operation based on the centroid of each frame of touch data according to an embodiment of the present invention; and Fig. 9 is a schematic structural diagram of a device for determining an operation intention provided by an embodiment of the present invention.

S101: Receive a touch operation on a touch area, and collect touch data of a selected pixel block in the touch area by using an image frame as a time unit, and the touch data includes the pressure value of the pixel block subjected to the touch operation

S102: Determine the weight of the pixel block according to the pressure value of the pixel block

S103: Calculate the centroid of each frame of touch data by using the weight of the pixel block and the position of the pixel block in the touch area

S104: Determine the operation intention of the touch operation based on the centroid of the touch data of each frame

Claims (13)

A method for determining an operation intention, applied to an electronic device provided with a touch area, includes: Receiving a touch operation on the touch area, and collecting touch data of a selected pixel block in the touch area by using the image frame as a time unit, the touch data including the pressure value of the pixel block under the touch operation; Determine the weight of the pixel block according to the pressure value of the pixel block; Using the weight of the pixel block and the position of the pixel block in the touch area to calculate the centroid of the touch data in each frame; and The operation intention of the touch operation is determined based on the centroid of the touch data in each frame. The method for determining the operation intention of claim 1, wherein determining the weight of the pixel block according to the pressure value of the pixel block includes: The corresponding relationship between the preset weight and the pressure range is queried, and the weight corresponding to the pressure range to which the pressure value of the pixel block belongs is determined as the weight of the pixel block. The method for determining the operation intention according to claim 2, wherein the pixel block includes a plurality of pixel sub-blocks, and collecting the pressure value of the pixel block includes collecting the pressure value of each pixel sub-block in the pixel block, Determining the weight of the pixel block according to the pressure value of the pixel block includes: The weight of the pixel sub-block is determined according to the pressure value of each pixel sub-block in the pixel block. The method for determining the operation intention according to claim 3, wherein calculating the centroid of each frame of the touch data by using the weight of the pixel block and the position of the pixel block in the touch area includes: obtaining the selected touch area The position of each pixel sub-block of each pixel block in the touch area, the position of the pixel element sub-block in the touch area includes the abscissa and ordinate of the pixel sub-block in the touch area, A centroid formula is used to calculate the centroid of the touch data in each frame; and the centroid formula is:

among them,

Is the first touch data in the current frame

The weight of the pixel sub-block,

Is the first touch data in the current frame

The abscissa of the pixel sub-block,

Is the first touch data in the current frame

The ordinate of the pixel sub-block,

Is the centroid and abscissa of the touch data of the current frame,

Is the centroid vertical coordinate of the touch data of the current frame. The method for determining the operation intention according to claim 1, which further includes: Acquiring an image frame number collected by receiving the touch operation; If the number of image frames is less than a first preset threshold, save the collected touch data of each frame; If the number of image frames is not less than the first preset threshold, save and calculate the collected touch data of each frame, and determine whether the current touch operation exceeds a touch boundary based on the centroid of the touch data of the current frame; and If the touch operation exceeds the touch boundary, stop collecting the touch data, and output the centroid of each frame of touch data. The method for determining the operation intention according to claim 5, wherein, before the operation intention of the touch operation is determined based on the centroid of each frame of touch data, the method further includes: Determine whether the number of image frames is less than a second preset threshold; and If the number of image frames is less than the second preset threshold, it is determined that the operation intention of the touch operation indicates a click operation, and the second preset threshold is less than the first preset threshold. The method for determining the operation intention of claim 1, wherein the determination of the operation intention of the touch operation based on the centroid of each frame of touch data includes: According to the collection sequence of the touch data, sort the centroids of each frame of touch data collected by the touch operation to obtain a centroid sequence; A first preset number of centroids that are ranked first in the centroid sequence are eliminated, and a second preset number of centroids that are ranked lowest in the centroid sequence are eliminated to obtain a first mass. Heart sequence; and The operation intention of the touch operation is determined based on the first centroid sequence. The method for determining the operation intention according to claim 7, which further includes: The first centroid in the first centroid sequence is determined as a starting point, and the end centroid in the first centroid sequence is determined as an ending point, and the graphs collected from the starting point to the ending point are defined The number of image frames is the total image frame. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as a first distance, and initialize the first distance to zero; Calculating a second distance between the centroid of the current image frame and the starting point; Compare whether the second distance is greater than the first distance; If the second distance is greater than the first distance, update the value of the second distance to the value of the first distance; If the second distance is not greater than the current first distance, compare the current number of image frames with the total number of image frames to obtain a comparison result; When the comparison result of the number of image frames meets a first preset condition, and the second distance and the current first distance meet a first preset sub-condition, update the current centroid to the starting point; When the comparison result of the number of image frames satisfies a second preset condition, and the second distance and the current first distance satisfy a second preset sub-condition, update the current centroid as the starting point; and When the comparison result of the number of image frames meets a third preset condition, the current centroid is updated to the end point. The method for determining the operation intention according to claim 1, which further includes: Determine the first centroid as a starting point, preset the total number of image frames that need to be collected by the touch operation, and after receiving the touch operation, define the centroid of the image frame before the current image frame to the starting point The distance is a third distance, and the third distance is initialized to zero; Calculating a fourth distance between the centroid of the current image frame and the starting point; Compare whether the fourth distance is greater than the third distance; If the fourth distance is greater than the third distance, update the value of the third distance to the value of the fourth distance; If the fourth distance is not greater than the third distance, compare the current number of image frames with the total number of image frames to obtain a comparison result; When the comparison result of the number of image frames meets a first preset condition, and the third distance and the fourth distance meet a first preset sub-condition, update the current centroid to the starting point; When the comparison result of the number of image frames meets a second preset condition, and the third distance and the fourth distance meet a second preset sub-condition, update the current centroid to the starting point; and When the comparison result of the number of image frames meets a third preset condition, the current centroid is updated to the end point. The method for determining the operation intention according to claim 8 or 9, which further includes: Select a centroid before the image frame sequence where the end point is updated, the ratio of the serial number of the centroid to the total number of image frames meets a fourth preset condition, and the distance between the centroid and the centroid of the previous frame meets A fifth preset condition updates the center of mass to the end point. The method for determining the operation intention of claim 10, wherein determining the operation intention of the touch operation based on the centroid of the touch range includes: Subtract the abscissa of the starting point from the abscissa of the end point to obtain an abscissa difference; Subtract the ordinate of the starting point from the ordinate of the end point to obtain a ordinate difference; If the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies a sixth preset condition, it is determined that the operation intention of the touch operation indicates a click operation; If the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference does not satisfy the sixth preset condition, it is determined whether the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfy one The seventh precondition; If the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfy the seventh preset condition, when the abscissa difference is less than 0, it is determined that the operation intention of the touch operation indicates a sliding operation; When the abscissa difference is not less than 0, it is determined that the operation intention of the touch operation indicates a sliding operation; If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not satisfy the seventh preset condition, determine whether the ordinate difference is greater than 0; If the ordinate difference value is greater than 0, judge whether the absolute value of the ordinate difference value and the absolute value of the abscissa difference satisfy an eighth preset condition; if the absolute value of the abscissa difference value and the ordinate difference value If the absolute value of the value satisfies the eighth preset condition, it is determined that the operation intention of the touch operation indicates a left swipe operation, if the absolute value of the abscissa difference value and the absolute value of the ordinate difference value do not satisfy the eighth preset condition To determine the operation intention of the touch operation to indicate an upward sliding operation; and If the ordinate difference value is not greater than 0, judge whether the absolute value of the ordinate difference value and the absolute value of the abscissa difference satisfy a ninth preset condition; if the absolute value of the abscissa difference value and the ordinate difference value The absolute value of the difference satisfies the ninth preset condition, and it is determined that the operation intention of the touch operation indicates a right-swiping operation, if the absolute value of the abscissa difference and the absolute value of the ordinate difference do not satisfy the ninth preset Condition, it is determined that the operation intention of the touch operation indicates an upward sliding operation. An operation intention determination device, applied to an electronic device provided with a touch area, includes: A touch operation receiving unit is configured to receive a touch operation on the touch area, and collect touch data of a selected pixel block in the touch area by using the image frame as a time unit. The touch data includes the pixel block receiving the The pressure value of touch operation; A weight determination unit for determining the weight of the pixel block according to the pressure value of the pixel block; A centroid calculation unit for calculating the centroid of the touch data in each frame by using the weight of the pixel block and the position of the pixel block in the touch area; and A first operation intention determination unit, configured to determine the operation intention of the touch operation based on the centroid of the touch data in each frame. An electronic device that contains: A touch area; A touch operation receiving unit is configured to receive a touch operation on the touch area, and collect touch data of a selected pixel block in the touch area by using the image frame as a time unit. The touch data includes the pixel block receiving the The pressure value of touch operation; A weight determination unit for determining the weight of the pixel block according to the pressure value of the pixel block; A centroid calculation unit for calculating the centroid of the touch data in each frame by using the weight of the pixel block and the position of the pixel block in the touch area; and A first operation intention determination unit, configured to determine the operation intention of the touch operation based on the centroid of the touch data in each frame.

Images