TWI796530B - Operation intention determining method, apparatus, and electronic device thereof - Google Patents

Abstract

An operation intention determining method, apparatus, and electronic device are provided, which are applied to an electronic device provided with a touch area. The method includes receiving a touch operation on the touch area; collecting touch data on a selected pixel block in the touch area by taking an image frame as a time unit, where the touch data includes a pressure value of the pixel block subjected to the touch operation; determining a weight of the pixel block based on the pressure value received by the pixel block; and calculating a centroid of the touch data in each frame by using the weight of the pixel block and the position of the pixel block in the touch area. With the method, the operation intention of the touch operation is determined based on the centroid of the touch data of each frame.

Description

Operation intention determination method, device and electronic equipment

The present invention relates to the field of computer technology, and more specifically, to a method, device and electronic equipment for determining an operation intention.

With the development of science and technology, touch-type electronic devices are more and more widely used, which not only provides convenience for users to operate electronic devices, but also brings better visual effects to users, improves user experience, and increases users' awareness of electronic devices. Device stickiness.

The user can interact with the electronic device through the touch area set on the electronic device (that is, human-computer interaction). Therefore, how to determine the intention of the user's touch operation on the touch area is the most important thing for human-computer interaction. important.

In view of this, it is an urgent problem to be solved that the present invention provides an operation intention determination method, device and electronic equipment, so as to realize the determination of the operation intention of the touch operation of the electronic equipment.

In view of this, the present invention provides a method and device for determining an operation intention, and an electronic device, so as to determine the operation intention of a touch operation on the electronic device.

The technical solution is as follows:

A method for determining an operation intention, applied to an electronic device provided with a touch area, comprising:

Receive the touch operation on the touch area, and collect the touch data of the selected pixel block in the touch area with the image frame as the time unit, and the touch data includes the pressure value of the pixel block subjected to the touch operation;

Determine the weight of the pixel block according to the pressure value of the pixel block;

Calculate the centroid of each frame of touch data by using the weight of the pixel block and the position of the pixel block in the touch area;

The operation intention of the touch operation is determined based on the centroid of each frame of touch data.

Preferably, the weight of the pixel block is determined according to the pressure value of the pixel block, including:

Query the correspondence between the preset weight and the pressure range, and determine the weight corresponding to the pressure range to which the pressure value of the pixel block belongs as the weight of the pixel block.

Preferably, the pixel block includes a plurality of pixel sub-blocks, and collecting the pressure value borne by the pixel block includes collecting the pressure value borne by each pixel sub-block in the pixel block.

Determine the weight of the pixel block according to the pressure value of the pixel block, including:

The weight of the pixel sub-block is determined according to the pressure value of each pixel sub-block in the pixel block.

Preferably, the weight of the pixel block and the position of the pixel block in the touch area are used to calculate the centroid of each frame of touch data, including:

Obtain the position of each pixel sub-block in the touch area of each pixel block selected in the touch area. The position of the pixel sub-block in the touch area includes the abscissa and ordinate of the pixel sub-block in the touch area. The centroid formula calculates the centroid of each frame of touch data separately;

The centroid formula is:

為當前幀觸摸數據中第

個像素子塊的權重，

為當前幀觸摸數據中第

個像素子塊的橫座標、

為當前幀觸摸數據中第

個像素子塊的縱座標，

為當前幀觸摸數據的質心橫座標，

為當前幀觸摸數據的質心縱座標。in,

For the current frame touch data

The weight of pixel sub-blocks,

For the current frame touch data

The abscissa of a pixel sub-block,

For the current frame touch data

The vertical coordinates of pixel sub-blocks,

is the abscissa coordinate of the centroid of the touch data in the current frame,

The ordinate of the centroid of the touch data in the current frame.

Preferably, it also includes:

Obtain the number of image frames collected by receiving touch operations;

If the number of image frames is less than the first preset threshold, save the collected touch data of each frame;

If the number of image frames is not less than the first preset threshold, save and calculate each frame of touch data that has been collected, and judge whether the current touch operation exceeds the touch boundary based on the centroid of the touch data of the current frame;

If the touch operation exceeds the touch boundary, stop collecting touch data, and output the centroid of each frame of touch data.

Preferably, before determining the operation intention of the touch operation based on the centroid of each frame of touch data, the method further includes:

judging whether the number of image frames is less than a second preset threshold;

If the number of image frames is less than a second preset threshold, it is determined that the operation intention of the touch operation indicates a click operation, and the second preset threshold is smaller than the first preset threshold.

Preferably, the operation intention of the touch operation is determined based on the centroid of each frame of touch data, including:

According to the collection order of the touch data, sort the centroids of each frame of touch data collected by the received touch operation to obtain a centroid sequence;

Removing the first preset number of centroids that are ranked the highest in the centroid sequence, and removing the second preset number of centroids that are ranked the last in the centroid sequence to obtain the first centroid sequence;

The operation intention of the touch operation is determined based on the first centroid sequence.

Preferably, it also includes:

Determine the first centroid in the first centroid sequence as the start point, and determine the end centroid in the first centroid sequence as the end point, and define the number of image frames collected from the start point to the end point as the total For an image frame, after receiving a touch operation, define the distance from the centroid of an image frame before the current image frame to the starting point as the first distance, and initialize the first distance to zero;

Calculate the second distance between the centroid of the current image frame and the starting point;

compare whether the second distance is greater than the first distance;

If the second distance is greater than the first distance, update the value of the second distance to the value of the first distance;

If the second distance is not greater than the current first distance, compare the current image frame number with the total image frame number to obtain a comparison result;

When the image frame number comparison result meets the first preset condition, and the second distance and the current first distance meet the first preset sub-condition, update the current centroid as the starting point;

When the image frame number comparison result meets the second preset condition, and the second distance and the current first distance meet the second preset sub-condition, update the current centroid as the starting point;

When the image frame number comparison result satisfies the third preset condition, the current centroid is updated as the end point.

Preferably, it also includes:

Determine the first centroid as the starting point, and preset the total number of image frames to be collected by the touch operation. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first Three distances, and initialize the third distance to zero;

Calculate the fourth distance between the centroid of the current image frame and the starting point;

Compare whether the fourth distance is greater than the third distance;

If the fourth distance is greater than the third distance, update the value of the third distance to the value of the fourth distance;

If the fourth distance is not greater than the third distance, compare the current image frame number with the total image frame number to obtain a comparison result;

When the image frame number comparison result meets the first preset condition, and the third distance and the fourth distance meet the first preset sub-condition, update the current centroid as the starting point;

When the image frame number comparison result meets the second preset condition, and the third distance and the fourth distance meet the second preset sub-condition, update the current centroid as the starting point;

When the image frame number comparison result satisfies the third preset condition, the current centroid is updated as the end point.

Preferably, it also includes:

Select a centroid before the image frame sequence where the updated end point is located, the ratio of the serial number of the centroid to the total number of image frames meets the fourth preset condition, and the distance between the centroid and the centroid of the previous frame satisfies the fifth Preset condition, update centroid to end point.

Preferably, determining the operation intention of the touch operation based on the centroid of the touch data includes:

Subtract the abscissa of the starting point from the abscissa of the end point to obtain the difference in abscissa;

Subtract the ordinate of the starting point from the ordinate of the end point to obtain the ordinate difference;

If the sum of the absolute value of the abscissa difference value and the absolute value of the ordinate difference value satisfies the sixth preset condition, it is determined that the operation intention of the touch operation indicates a click operation;

If the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference does not meet the sixth preset condition, determine whether the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition;

If the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition, when the abscissa difference is less than 0, it is determined that the operation intention of the touch operation indicates a sliding operation; when the abscissa difference is not less than When 0, it is determined that the operation intention of the touch operation indicates the slide operation;

If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the seventh preset condition, determine whether the ordinate difference is greater than 0;

If the ordinate difference is greater than 0, judge whether the absolute value of the ordinate difference and the absolute value of the abscissa difference meet the eighth preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the first Eight preset conditions, determine that the operation intention of the touch operation indicates a left-swipe operation, if the absolute value of the difference between the abscissa and the ordinate does not meet the eighth preset condition, determine that the operation intention of the touch operation indicates an up-slide operation ;

If the ordinate difference is not greater than 0, judge whether the absolute value of the ordinate difference and the absolute value of the abscissa difference meet the ninth preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference meet The ninth preset condition is to determine that the operation intention of the touch operation indicates a right slide operation, and if the absolute value of the difference between the abscissa and the ordinate does not meet the ninth preset condition, determine that the operation intention of the touch operation indicates an upward slide operate.

A device for determining an operation intention, applied to an electronic device provided with a touch area, comprising:

The touch operation receiving unit is used to receive the touch operation on the touch area, and collect the touch data of the selected pixel block in the touch area with the image frame as the time unit, and the touch data includes the pressure value of the pixel block subjected to the touch operation;

a weight determining unit, configured to determine the weight of the pixel block according to the pressure value the pixel block bears;

The centroid calculation unit is used to calculate the centroid of each frame of touch data by using the weight of the pixel block and the position of the pixel block in the touch area;

The first operation intention determination unit is configured to determine the operation intention of the touch operation based on the centroid of each frame of touch data.

an electronic device comprising a touch area, and

The touch operation receiving unit is configured to receive a touch operation on the touch area, and collect a touch data of a selected pixel block in the touch area with an image frame as a time unit, and the touch data includes that the pixel block bears the touch Operating pressure value;

a weight determining unit, configured to determine the weight of the pixel block according to the pressure value of the pixel block;

a centroid calculation unit, configured to calculate the centroid of each frame of the touch data by using the weight of the pixel block and the position of the pixel block in the touch area; and

The first operation intention determination unit is configured to determine the operation intention of the touch operation based on the centroid of the touch data in each frame.

The present invention provides a method, device, and electronic equipment for determining an operation intention, which are applied to electronic equipment provided with a touch area. The method collects selected pixels in the touch area with an image frame as a time unit by receiving a touch operation on the touch area. The touch data of the block, the touch data includes the pressure value of the pixel block subjected to the touch operation; and the weight of the pixel block is determined according to the pressure value of the pixel block; and then the weight of the pixel block and the position of the pixel block in the touch area are used to calculate the touch of each frame The centroid mode of the data; realizes the purpose of determining the operation intention of the touch operation based on the centroid of each frame of touch data.

The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Touch-type electronic devices are more and more widely used, and users can operate the touch-type electronic devices to achieve interaction with the electronic devices (ie, human-computer interaction). In the process of realizing the human-computer interaction, usually the user performs a touch operation on the touch area of the electronic device, so as to realize the human-computer interaction with the electronic device.

When determining the operation intention of the touch operation performed by the user on the touch area of the electronic device, it may be implemented based on the manner of determining the operation intention as shown in FIG. 1 below. The touch area can be a HOME key, a touch display screen, or any other part of the electronic device for touch operation, such as the side or the back.

Fig. 1 is a flowchart of a method for determining an operation intention provided by an embodiment of the present invention.

As shown in Figure 1, the method includes:

S101. Receive a touch operation on the touch area, and collect touch data of a selected pixel block in the touch area by taking an image frame as a time unit, and the touch data includes the pressure value of the pixel block subjected to the touch operation;

Referring to FIG. 2 , in the embodiment of the present invention, the touch area of the electronic device is divided into several sub-blocks 21 , and a selected sub-block among the several sub-blocks 21 may be called a pixel block 22 . Upon receiving a touch operation on the touch area, the touch data of the pixel block 22 in the touch area may be collected in image frames as a time unit, and the touch data of the pixel block 22 includes the pressure value of the pixel block 22 subjected to the touch operation.

In the embodiment of the present invention, a touch operation on the touch area is received, and a plurality of image frames are collected, and each image frame corresponds to the pressure value of each pixel block 22 in the touch area subjected to the touch operation at the moment when the image frame is collected. That is, each image frame corresponds to a frame of touch data, and the frame of touch data is the pressure value of the touch operation that each pixel block 22 in the touch area is subjected to when the image frame is captured.

S102. Determine the weight of the pixel block according to the pressure value of the pixel block;

In the embodiment of the present invention, for a pixel block 22 in a frame of touch data, the weight of the pixel block 22 can be calculated according to the pressure value of the pixel block 22 .

In the embodiment of the present invention, the corresponding relationship between the weight and the pressure range can be set in advance, and then the pressure range to which the pressure value of the pixel block 22 belongs is determined, and the weight corresponding to the determined pressure range is used as the weight of the pixel block 22 .

In the embodiment of the present invention, the pixel block may include multiple pixel sub-blocks, and the pressure value borne by the pixel block 22 includes the pressure value borne by each pixel sub-block in the pixel block 22 . Correspondingly, the method of determining the weight of the pixel block 22 according to the pressure value borne by the pixel block 22 includes: for each pixel sub-block in the pixel block 22 , determining the weight of the pixel sub-block according to the pressure value borne by the pixel sub-block.

The method of determining the weight of the pixel sub-block according to the pressure value borne by the pixel sub-block can be: preset the corresponding relationship between the weight and the pressure range, and then determine the pressure range to which the pressure value borne by the pixel sub-block belongs, and the determined pressure The weight corresponding to the range is determined as the weight of the pixel sub-block.

For example, the touch area with a size of 96*96 pixels can be divided into 24*12 sub-blocks 21; then select 4*4=16 sub-blocks 21 from the 24*12 sub-blocks 21, and each selected sub-block 21 Defined as one pixel block 22 , there are 16 pixel blocks 22 . Wherein, the manner of selecting 4*4 sub-blocks 21 from 24*12 sub-blocks 21 can be referred to FIG. 2 , and the sub-block 21 in FIG. 2 can be understood as a pixel block 22 selected from the image.

After the pixel block 22 is selected, the pixel block 22 is divided into a first pixel sub-block and a second pixel sub-block; see Fig. 3(a), the pixel block 22 contains 4*8 pixels, and the pixel block 22 can be divided into Two 4*4 pixel sub-blocks; referring to FIG. 3( b ), the pixel block 22 includes 4*8 pixels, and the pixel block 22 can also be divided into eight 2*2 pixel sub-blocks.

In the embodiment of the present invention, the classification can be performed according to the common force of touch, and the weight value of the touched pixel block is correspondingly generated according to the pressure level. Corresponding to 0~15.

Take each pixel block with 22 or 4X8 pixels, and divide it into two 4X4 pixel sub-blocks as an example: the area greater than 0 is the area touched by a finger; if pressed, the small sub-block in the pixel sub-block Set to 1, otherwise set to 0; data is stored in bits, if the data output is 254, binary 1111 1110, it means that the pressing level of one pixel sub-block is 15, that is, the weight is 15; the pressing level of another pixel sub-block is 14, that is The weight is 14.

S103. Calculate the centroid of each frame of touch data by using the weight of the pixel block and the position of the pixel block in the touch area;

In one embodiment of the present invention, for a captured image frame (that is, a frame of touch data), the image frame may include each pixel block 22 in the touch area at the moment when the image frame is captured The pressure value of the touch operation and the position of each pixel block 22 in the touch area are used to calculate the centroid of the image frame.

Wherein, when using the weight of the pixel block 22 in the touch data and the position of the pixel block 22 in the touch area to calculate the centroid of the touch data, it can be realized by using the centroid formula, and the centroid formula is:

為當前幀觸摸數據中第

個像素子塊的權重，

為當前幀觸摸數據中第

個像素子塊的橫座標、

為當前幀觸摸數據中第

個像素子塊的縱座標，

為當前幀觸摸數據的質心橫座標，

為當前幀觸摸數據的質心縱座標。在本發明實施例中，當前幀觸摸數據的質心為（

，

），即（

，

）為當前幀觸摸數據的質心的座標。in,

For the current frame touch data

The weight of pixel sub-blocks,

For the current frame touch data

The abscissa of a pixel sub-block,

For the current frame touch data

The vertical coordinates of pixel sub-blocks,

is the abscissa coordinate of the centroid of the touch data in the current frame,

The ordinate of the centroid of the touch data in the current frame. In the embodiment of the present invention, the centroid of the current frame touch data is (

,

),Right now(

,

) is the coordinates of the centroid of the touch data in the current frame.

S104. Determine the operation intention of the touch operation based on the centroid of each frame of touch data.

In the embodiment of the present invention, based on the centroid of the collected touch data of each frame, the operation intention of the touch operation can be determined.

Fig. 4 is a flowchart of another method for determining an operation intention provided by an embodiment of the present invention.

As shown in Figure 4, the method includes:

S401. Receive a touch operation on the touch area, and collect touch data of the selected pixel block 22 in the touch area by taking an image frame as a time unit, and the touch data includes the pressure value of the pixel block 22 subjected to the touch operation;

S402. Obtain the number of image frames collected by receiving the touch operation;

S403. Determine whether the number of image frames is less than the first preset threshold; if the number of image frames is less than the first preset threshold, execute step S404; if the number of image frames is not less than the first preset threshold, execute step S405;

In the embodiment of the present invention, the first preset threshold may be 20 frames. If the number of image frames collected by the received touch operation is less than 20 frames, step S404 may be executed; if the number of image frames collected by the received touch operation is less than When it is less than 20 frames, step S405 can be performed.

S404. Save the collected touch data of each frame, and return to step S401;

S405. Save and calculate the collected touch data of each frame, and judge whether the current touch operation exceeds the touch boundary based on the centroid of the current frame touch data; if the touch operation exceeds the touch boundary, perform step S406;

In the embodiment of the present invention, for the method of determining the centroid of the touch data of the current frame, please refer to the method of calculating the centroid of the touch data provided in the above embodiment, and details are not described here.

In the embodiment of the present invention, if the abscissa of the centroid of the touch data of the current frame is within the first threshold range, and the ordinate of the centroid of the touch data of the current frame is within the second threshold range, it is determined based on the touch data of the current frame If the centroid of the current touch operation does not exceed the touch boundary; on the contrary, if the abscissa of the centroid of the touch data of the current frame is not within the first threshold range or the ordinate of the centroid of the touch data of the current frame is not within the second threshold range , it is determined that the current touch operation exceeds the touch boundary based on the centroid of the touch data of the current frame.

In the embodiment of the present invention, the first threshold range and the second threshold range may be the same or different. For the distribution modulus of the pixel block in FIG. The threshold range is set to be greater than 12 and less than 82; the second threshold range is set to be greater than 12 and less than 84. The above is only the preferred mode of the first threshold range and the second threshold range provided by the embodiment of the present invention. Regarding the first threshold range and the second threshold range The specific values of the two threshold ranges can be set by the inventors according to their own needs, and are not limited here.

S406. Stop collecting touch data, and output the centroid of each frame of touch data based on the saved touch data of each frame;

In the embodiment of the present invention, if it is judged that the current touch operation exceeds the touch boundary, the collection of touch data can be stopped, and the centroid of each frame of touch data can be output based on the saved touch data of each frame.

Further, in the embodiment of the present invention, if it is not detected that the current touch operation exceeds the touch boundary, but when the touch operation stops, the collection of touch data can also be stopped, and based on the saved touch data of each frame, output the touch data of each frame Centroid.

S407. Determine whether the number of image frames is less than a second preset threshold, and the second preset threshold is less than the first preset threshold; if the number of image frames is less than the second preset threshold, perform step S408; if the number of image frames is not less than For the second preset threshold, execute step S409;

S408. Determine that the operation intention of the touch operation indicates a click operation;

Furthermore, before a touch intention determination method provided by an embodiment of the present invention determines the operation intention of a touch operation based on the centroid of each frame of touch data, it may also determine whether the number of image frames is less than a second preset threshold, if the image frame If the number is less than the second preset threshold, it is determined that the operation intention of the touch operation indicates a click operation, and if the number of image frames is not less than the second preset threshold, step S409 is performed.

In the embodiment of the present invention, the second preset threshold is smaller than the first preset threshold, and the second preset threshold can be 3 frames. If it is determined that the number of image frames is less than 3 frames, the operation intention of the touch operation can be directly determined as Click Actions. The above is only the preferred mode of the second preset threshold provided by the embodiment of the present invention, and the specific value of the second preset threshold can be set by the inventor according to his own needs, which is not limited here.

S409. Determine the operation intention of the touch operation based on the centroid of each frame of touch data.

In the embodiment of the present invention, according to the order of the collected touch data, the centroid of the frame touch data is sequentially output, and the centroid movement trajectory during the touch operation can be obtained, and then the operation intention of the touch operation can be determined based on the centroid movement trajectory .

In the embodiment of the present invention, before determining the operation intention of the touch operation based on the centroid of each frame of touch data, the centroid of the collected touch data can be further filtered to realize the determination of the touch operation based on the filtered centroid. The purpose of the operation intention, thereby simplifying the amount of calculation, and improving the accuracy of determining the operation intention.

FIG. 5 is a flow chart of a method for determining an operation intention of a touch operation based on the centroid of each frame of touch data provided by an embodiment of the present invention.

As shown in Figure 5, the method includes:

S501. According to the order of touch data collection, sort the centroids of each frame of touch data collected by the received touch operation to obtain a centroid sequence;

In the embodiment of the present invention, for the stored touch data of each frame, the centroids of each frame of touch data are sorted according to the acquisition sequence of each frame of touch data to obtain a centroid sequence, which can be reflected in the touch operation The moving trajectory of the center of mass in the process.

S502. Eliminate a first preset number of centroids that are ranked the highest in the centroid sequence, and remove a second preset number of centroids that are ranked the lowest in the centroid sequence to obtain a first centroid sequence;

By analyzing the movement trajectory of the centroid, it is found that when the touch operation is initially performed, the centroid of the collected touch data will vibrate, and when the touch operation ends, the centroid of the collected touch data will smear. Therefore, the embodiment of the present invention reduces the impact of jitter and smearing on the operation intention determination by eliminating the first M frames of touch data collected during the touch operation and the last N frames of touch data collected.

In the embodiment of the present invention, M frames can be considered as the first preset number, and N frames can be considered as the second preset number; for the situation in Figure 3(a), M can be set to 1, and N can be set to 2; For the situation in Figure 3(b), M can be set to 1, and N can be set to any integer between 5 and 8. The above is only the preferred mode of the first preset number and the second preset number provided by the embodiment of the present invention. Regarding the specific content of the first preset number and the second preset number, the inventor can set them according to his own needs. It is not limited here.

S503. Determine the operation intention of the touch operation based on the first centroid sequence.

In the embodiment of the present invention, after removing the first M centroids in the centroid sequence and removing the last N centroids in the centroid sequence, the first centroid sequence can be obtained, and then based on the first centroid sequence, the Determination of operational intent for a touch operation.

Considering that when the half-finger slides, the trajectory of the center of mass will repeat back and forth, the embodiment of the present invention can further judge the inflection point in the first center of mass sequence after obtaining the first center of mass sequence, so as to optimize the movement of the center of mass track.

FIG. 6 is a flow chart of a method for optimizing a centroid movement trajectory provided by an embodiment of the present invention.

As shown in Figure 6, the method includes:

S601. Determine the first centroid in the first centroid sequence as the start point, and determine the end centroid in the first centroid sequence as the end point, and define the number of image frames collected from the start point to the end point is the total image frame, after receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first distance, and initialize the first distance to zero;

S602. Calculate the second distance between the centroid of the current image frame and the starting point;

S603. Compare whether the second distance is greater than the first distance; if the second distance is greater than the first distance, perform step S604; if the second distance is not greater than the current first distance, perform step S605;

S604. Update the value of the second distance to the value of the first distance;

S605. Comparing the current image frame number and the total image frame number to obtain a comparison result;

S606. When the image frame number comparison result meets the first preset condition, and the second distance and the current first distance meet the first preset sub-condition, update the centroid of the current image frame as the starting point;

In the embodiment of the present invention, the first preset condition may be that the ratio of the number of current image frames to the total number of image frames is less than 70%. The image frame number comparison result indicates the ratio of the current image frame number to the total image frame number, and when the ratio is less than 70%, it means that the image frame number comparison result satisfies the first preset condition.

The second distance and the current first distance satisfy the first preset subcondition, which may be that the second distance is less than 80% of the current first distance. If the second distance is less than the current first distance*80%, it is considered that the second distance and the current first distance meet the first preset sub-condition, and then the starting point of the first centroid sequence is updated to the quality of the current image frame Heart.

In the embodiment of the present invention, when the comparison result of the number of image frames satisfies the first preset condition, and the second distance and the current first distance do not meet the first preset sub-condition, the next image frame adjacent to the current image frame can also be An image frame is updated as the current image frame, and returns to step S602;

In the embodiment of the present invention, when the comparison result of the number of image frames satisfies the first preset condition, and the second distance and the current first distance meet the first preset sub-condition, the centroid of the current image frame is updated to the initial After clicking, the next image frame adjacent to the image frame can also be updated as the current image frame, and the execution returns to step S602.

S607. When the image frame number comparison result meets the second preset condition, and the second distance and the current first distance meet the second preset sub-condition, update the current centroid as the starting point;

In the embodiment of the present invention, the second preset condition may be that the ratio of the current image frame number to the total image frame number is greater than or equal to 70% and less than 90%. The image frame number comparison result indicates the ratio of the current image frame number to the total image frame number, and when the ratio is greater than or equal to 70% and not less than 90%, it means that the image frame number comparison result meets the second preset condition.

The second distance and the current first distance satisfy a second preset subcondition, which may be that the second distance is less than 80% of the current first distance. If the second distance is less than the current first distance*80%, it is considered that the second distance and the current first distance meet the second preset sub-condition, and then the starting point of the first centroid sequence is updated to the quality of the current image frame Heart.

Further, after step S607 is executed, it can also be judged whether the ratio of the current image frame number to the total image frame number is greater than 80%, if so, stop the optimization process of the centroid moving track in the first centroid sequence, based on the current The first sequence of centroids determines operational intent.

Further, if the comparison result of the number of image frames satisfies the second preset condition, and the second distance and the current first distance meet the second preset sub-condition, the next image adjacent to the current image frame can also be The image frame is used as the current image frame and returns to step S602.

S608. When the image frame number comparison result satisfies the third preset condition, update the current centroid as the end point.

In the embodiment of the present invention, the third preset condition may be that the ratio of the current image frame number to the total image frame number is greater than or equal to 90%. The image frame number comparison result indicates the ratio of the current image frame number to the total image frame number, and when the ratio is greater than or equal to 90%, it means that the image frame number comparison result satisfies the third preset condition.

When the image frame number comparison result satisfies the third preset condition, the centroid of the current image frame is updated as the end point of the first centroid sequence.

In the embodiment of the present invention, the inventors can set the specific values of the first preset condition, the second preset condition, the third preset condition, the first preset sub-condition, and the second preset sub-condition according to their own needs. , is not limited here.

In the embodiment of the present invention, in addition to optimizing the first centroid sequence to realize the optimization of the centroid movement trajectory, the execution movement trajectory can also be optimized during the process of collecting operation data, please refer to FIG. 7 for details.

FIG. 7 is a flow chart of another method for optimizing a centroid movement trajectory provided by an embodiment of the present invention.

As shown in Figure 7, the method includes:

S701. Receive a touch operation on the touch area, collect the touch data of the selected pixel block in the touch area with an image frame as the time unit, and determine the centroid of the first image frame collected as the starting point, preset The total number of image frames to be collected by the touch operation. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the third distance, and initialize the third distance to zero;

S702. Calculate the fourth distance between the centroid of the current image frame and the starting point;

S703. Compare whether the fourth distance is greater than the third distance; if the fourth distance is greater than the third distance, perform step S704; if the fourth distance is not greater than the third distance, perform step S705;

S704. Update the numerical value of the third distance to the numerical value of the fourth distance;

S705. Comparing the current image frame number and the total image frame number to obtain a comparison result;

S706. When the image frame number comparison result meets the first preset condition, and the third distance and the fourth distance meet the first preset sub-condition, update the current centroid as the starting point;

S707. When the image frame number comparison result meets the second preset condition, and the third distance and the fourth distance meet the second preset sub-condition, update the current centroid as the starting point;

S708. When the image frame number comparison result satisfies the third preset condition, update the centroid of the current image frame as the end point.

Furthermore, in the method for determining the operation intention provided by the embodiment of the present invention, on the basis of the optimization process of the above-mentioned centroid movement trajectory, in order to further refine the end point of the centroid movement trajectory, it is also possible to optimize the above-mentioned centroid movement trajectory The end point of the centroid moving track is backtracked. The method is specifically: select a centroid before the image frame sequence where the updated end point is located, and the ratio of the serial number of the centroid to the total number of image frames conforms to the fourth preset A condition is set, and the distance between the centroid and the centroid of the previous frame satisfies the fifth preset condition, and the centroid is updated as the end point.

In the embodiment of the present invention, the updated end point is the centroid of an image frame collected, and a target image frame is selected from each image frame collected before the image frame, and the target image frame The ratio of the serial number of the centroid of the target image frame to the total number of image frames meets the fourth preset condition, and the distance between the centroid of the target image frame and the centroid of the image frame collected in the previous frame meets the fifth preset condition condition, update the centroid of the target image frame as the end point.

Among them, the sequence number can be set to the centroid of each image frame collected in turn according to the order of the image frames collected, for example, the sequence number of the centroid of the first image frame collected is set to 1, and the collected image frame The serial number of the centroid of the second image frame is set to 2, and the serial number of the collected third image frame is set to 3...and so on; correspondingly, the serial number of the target image frame The ratio to the total number of image frames can be understood as the result obtained by dividing the serial number of the centroid of the target image frame by the total number of image frames.

In the embodiment of the present invention, the fourth preset condition can be 7/8. If the ratio of the serial number of the centroid of the target image frame to the total number of image frames is greater than 7/8, it can be considered that the target image frame The ratio of the serial number of the centroid to the total number of image frames meets the fourth preset condition.

In the embodiment of the present invention, the fifth preset condition can be 10, if the distance between the centroid of the target image frame and the centroid of the image frame collected in the previous frame is greater than 10, it can be considered that the target image frame The distance between the centroid and the centroid of the image frame collected in the previous frame satisfies the fifth preset condition.

To facilitate a detailed description of a method for determining an operation intention provided by an embodiment of the present invention, a flow chart of a method for determining an operation intention of a touch operation based on the centroid of each frame of touch data is provided here, see FIG. 8 for details.

As shown in Figure 8, the method includes:

S801. Subtract the abscissa of the starting point from the abscissa of the end point to obtain a difference in abscissa;

S802. Subtracting the ordinate of the end point from the ordinate of the starting point to obtain the ordinate difference;

S803, judging whether the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth preset condition, if the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth preset condition If the condition is set, step S804 is executed; if the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference does not meet the sixth preset condition, step S805 is executed;

In the embodiment of the present invention, when the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference is less than 15, it can be considered that the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth The preset condition; otherwise, it is considered that the sum of the absolute value of the difference on the abscissa and the absolute value of the difference on the ordinate does not satisfy the sixth preset condition.

S804. Determine that the operation intention of the touch operation indicates a click operation;

S805. Determine whether the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition, execute Step S806; if the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the seventh preset condition, execute step S809;

In the embodiment of the present invention, when the absolute value of the abscissa difference is greater than the absolute value of the ordinate difference, it can be considered that the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition; otherwise, Then it is considered that the absolute value of the difference on the abscissa and the absolute value of the difference on the ordinate do not satisfy the seventh preset condition.

S806. Determine whether the abscissa difference is less than 0; when the abscissa difference is less than 0, execute step S807; when the abscissa difference is not less than 0, execute step S808;

S807. Determine that the operation intention of the touch operation indicates an upward slide operation;

S808. Determine the operation intention of the touch operation to indicate a slide operation;

S809. Determine whether the ordinate difference is greater than 0; if the ordinate difference is greater than 0, execute step S810; if the ordinate difference is not greater than 0, execute step S813;

S810. Determine whether the absolute value of the ordinate difference and the absolute value of the abscissa difference meet the eighth preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the eighth preset condition, execute Step S811; if the absolute value of the abscissa difference and the absolute value of the ordinate difference do not satisfy the eighth preset condition, execute step S812;

In the embodiment of the present invention, when the absolute value of the ordinate difference is greater than the absolute value of the abscissa difference, it can be considered that the absolute value of the ordinate difference and the absolute value of the abscissa difference meet the eighth preset condition; otherwise , it is considered that the absolute value of the difference on the ordinate and the absolute value of the difference on the abscissa do not satisfy the eighth preset condition.

S811. Determine that the operation intention of the touch operation indicates a left swipe operation;

S812. Determine the operation intention of the touch operation to indicate an upward sliding operation;

S813. Determine whether the absolute value of the ordinate difference and the absolute value of the abscissa difference meet the ninth preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the ninth preset condition, execute Step S814; if the absolute value of the difference on the abscissa and the absolute value of the difference on the ordinate do not satisfy the ninth preset condition, execute step S815.

In the embodiment of the present invention, when the absolute value of the ordinate difference is greater than the absolute value of the abscissa difference, it can be considered that the absolute value of the ordinate difference and the absolute value of the abscissa difference meet the ninth preset condition; otherwise , it is considered that the absolute value of the difference on the ordinate and the absolute value of the difference on the abscissa do not satisfy the ninth preset condition.

S814. Determine that the operation intention of the touch operation indicates a right swipe operation;

S815. Determine that the operation intention of the touch operation indicates an upward swipe operation.

The above are only the preferred modes of the sixth preset condition, the seventh preset condition, the eighth preset condition, and the ninth preset condition provided by the embodiment of the present invention. Regarding the sixth preset condition, the seventh preset condition, the The specific content of the eighth preset condition and the ninth preset condition can be set by the inventor according to his own needs, and is not limited here.

Fig. 9 is a schematic structural diagram of an operation intention determination device provided by an embodiment of the present invention.

As shown in Figure 9, the device includes:

The touch operation receiving unit 91 is configured to receive a touch operation on the touch area, and collect touch data of a selected pixel block in the touch area with an image frame as a time unit, and the touch data includes the pressure value of the pixel block subjected to the touch operation;

A weight determination unit 92, configured to determine the weight of the pixel block according to the pressure value the pixel block bears;

The centroid calculation unit 93 is used to calculate the centroid of each frame of touch data by using the weight of the pixel block and the position of the pixel block in the touch area;

The first operation intention determination unit 94 is configured to determine the operation intention of the touch operation based on the centroid of each frame of touch data.

In the embodiment of the present invention, the weight determining unit 92 is specifically configured to query the preset correspondence between weight and pressure range, and determine the weight corresponding to the pressure range to which the pressure value of the pixel block belongs as the weight of the pixel block.

In the embodiment of the present invention, the pixel block includes a plurality of pixel sub-blocks, and collecting the pressure value borne by the pixel block includes collecting the pressure value borne by each pixel sub-block in the pixel block, and the weight determination unit 92 is specifically configured to The pressure value of each pixel sub-block determines the weight of the pixel sub-block.

In the embodiment of the present invention, the centroid calculation unit 93 includes:

The acquiring unit is configured to acquire the position of each pixel sub-block in the touch area of each selected pixel block in the touch area, the position of the pixel sub-block in the touch area includes the abscissa and the pixel sub-block in the touch area ordinate;

The centroid calculation unit 93 is used to calculate the centroid of each frame of touch data using the centroid formula. The centroid formula is:

為當前幀觸摸數據中第

個像素子塊的權重，

為當前幀觸摸數據中第

個像素子塊的橫座標、

為當前幀觸摸數據中第

個像素子塊的縱座標，

為當前幀觸摸數據的質心橫坐標，

為當前幀觸摸數據的質心縱坐標。in,

For the current frame touch data

The weight of pixel sub-blocks,

For the current frame touch data

The abscissa of a pixel sub-block,

For the current frame touch data

The vertical coordinates of pixel sub-blocks,

is the abscissa coordinate of the centroid of the touch data in the current frame,

It is the ordinate of the centroid of the touch data in the current frame.

Further, the device for determining an operation intention provided by an embodiment of the present invention further includes a touch boundary judging unit, configured to:

Obtain the number of image frames collected by receiving touch operations;

If the number of image frames is less than the first preset threshold, save the collected touch data of each frame;

If the number of image frames is not less than the first preset threshold, save and calculate each frame of touch data that has been collected, and judge whether the current touch operation exceeds the touch boundary based on the centroid of the touch data of the current frame;

If the touch operation exceeds the touch boundary, stop collecting touch data, and output the centroid of each frame of touch data.

Further, an operation intention determination device provided in an embodiment of the present invention further includes a second operation intention determination unit, configured to:

judging whether the number of image frames is less than a second preset threshold;

If the number of image frames is less than a second preset threshold, it is determined that the operation intention of the touch operation indicates a click operation, and the second preset threshold is smaller than the first preset threshold.

A first operation intention determination unit in an operation intention determination device provided in an embodiment of the present invention includes:

The centroid sequence acquisition unit is used to sort the centroids of each frame of touch data collected by the received touch operation according to the order of touch data collection, to obtain the centroid sequence;

The centroid elimination unit is used to eliminate the first preset number of centroids that are ranked the highest in the centroid sequence, and remove the second preset number of centroids that are ranked the last in the centroid sequence to obtain the first a centroid sequence;

The first operation intention determination subunit is configured to determine the operation intention of the touch operation based on the first centroid sequence.

Further, an operation intention determination device provided in an embodiment of the present invention further includes a first centroid sequence optimization unit, configured to:

Determine the first centroid in the first centroid sequence as the start point, and determine the end centroid in the first centroid sequence as the end point, and define the number of image frames collected from the start point to the end point as the total For an image frame, after receiving a touch operation, define the distance from the centroid of an image frame before the current image frame to the starting point as the first distance, and initialize the first distance to zero;

Calculate the second distance between the centroid of the current image frame and the starting point;

compare whether the second distance is greater than the first distance;

If the second distance is greater than the first distance, update the value of the second distance to the value of the first distance;

If the second distance is not greater than the current first distance, compare the current image frame number with the total image frame number to obtain a comparison result;

When the image frame number comparison result meets the first preset condition, and the second distance and the current first distance meet the first preset sub-condition, update the current centroid as the starting point;

When the image frame number comparison result meets the second preset condition, and the second distance and the current first distance meet the second preset sub-condition, update the current centroid as the starting point;

When the image frame number comparison result satisfies the third preset condition, the current centroid is updated as the end point.

Further, an operation intention determination device provided in an embodiment of the present invention further includes a second centroid sequence optimization unit, configured to:

Determine the first centroid as the starting point, and preset the total number of image frames to be collected by the touch operation. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first Three distances, and initialize the third distance to zero;

Calculate the fourth distance between the centroid of the current image frame and the starting point;

Compare whether the fourth distance is greater than the third distance;

If the fourth distance is greater than the third distance, update the value of the third distance to the value of the fourth distance;

If the fourth distance is not greater than the third distance, compare the current image frame number with the total image frame number to obtain a comparison result;

When the image frame number comparison result meets the first preset condition, and the third distance and the fourth distance meet the first preset sub-condition, update the current centroid as the starting point;

When the image frame number comparison result meets the second preset condition, and the third distance and the fourth distance meet the second preset sub-condition, update the current centroid as the starting point;

When the image frame number comparison result satisfies the third preset condition, the current centroid is updated as the end point.

Further, an operation intention determination device provided in an embodiment of the present invention further includes a third centroid sequence optimization unit, configured to:

A centroid before the image frame sequence where the end point of the selected update is located, the ratio of the serial number of the centroid to the total number of image frames meets the fourth preset condition, and the distance between the centroid and the centroid of the previous frame satisfies The fifth preset condition is to update the centroid as the end point.

In the embodiment of the present invention, the first operation intention determination unit 94 includes:

The first calculation unit is used to subtract the abscissa of the starting point from the abscissa of the end point to obtain a difference in abscissa;

The second calculation unit is used to subtract the ordinate of the end point from the ordinate of the starting point to obtain the ordinate difference;

The first determination unit is configured to determine that the operation intention of the touch operation indicates a click operation if the sum of the absolute value of the abscissa difference value and the absolute value of the ordinate difference value satisfies the sixth preset condition;

The first judging unit is used to determine whether the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the sixth preset condition. Satisfy the seventh preset condition;

The second determination unit is configured to determine that the operation intention of the touch operation indicates a sliding operation when the absolute value of the difference in the abscissa and the absolute value of the difference in the ordinate meet the seventh preset condition when the difference in the abscissa is less than 0; When the abscissa difference is not less than 0, it is determined that the operation intention of the touch operation indicates a slide operation;

The second judging unit is used to judge whether the difference in ordinate is greater than 0 if the absolute value of the difference in abscissa and the absolute value of difference in ordinate do not meet the seventh preset condition;

The third determining unit is used to determine whether the absolute value of the ordinate difference and the absolute value of the abscissa difference meet the eighth preset condition if the ordinate difference is greater than 0; if the absolute value of the abscissa difference and the ordinate If the absolute value of the difference satisfies the eighth preset condition, it is determined that the operation intention of the touch operation indicates a left slide operation. If the absolute value of the difference between the abscissa and the ordinate does not meet the eighth preset condition, determine the touch operation The operation intention of indicates the operation of sliding up;

The fourth determination unit is used to determine whether the absolute value of the ordinate difference and the absolute value of the abscissa difference meet the ninth preset condition if the ordinate difference is not greater than 0; if the absolute value of the abscissa difference and the ordinate The absolute value of the coordinate difference satisfies the ninth preset condition, and it is determined that the operation intention of the touch operation indicates a right slide operation. If the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the ninth preset condition, determine that the touch The action intent of the action indicates a swipe up action.

Further, an embodiment of the present invention further provides an electronic device, where the electronic device includes the apparatus for determining an operation intention provided in the above embodiment.

The present invention provides a method, device and electronic device for determining an operation intention, which is applied to an electronic device provided with a touch area, receives a touch operation on the touch area, and collects touches of selected pixel blocks in the touch area with an image frame as a time unit. Data, touch data includes the pressure value of the touch operation of the pixel block; determine the weight of the pixel block according to the pressure value of the pixel block; use the weight of the pixel block and the position of the pixel block in the touch area to calculate the centroid of each frame of touch data; The operation intention of the touch operation is determined based on the centroid of each frame of touch data.

The method, device, and electronic device for determining an operation intention provided by the present invention have been described above in detail. In this paper, specific examples are used to illustrate the principle and implementation of the present invention. The descriptions of the above embodiments are only used to help understand the present invention. The method of the invention and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and application scope. Invention Limitations.

It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. For the same and similar parts in each embodiment, refer to each other, that is, Can. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for the related information, please refer to the description of the method part.

It should also be noted that in this article, relational terms such as first and second etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or operations Any such actual relationship or order exists between. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that elements inherent in a process, method, article, or apparatus comprising a set of elements are included, or are also included as such , method, article or device inherent in the elements. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

S101: Receive a touch operation on the touch area, and collect the touch data of the selected pixel block in the touch area with the image frame as the time unit, the touch data includes the pressure value of the pixel block subjected to the touch operation S102: Determine the weight of the pixel block according to the pressure value that the pixel block bears S103: Utilize the weight of the pixel block and the position of the pixel block in the touch area to calculate the centroid of each frame of touch data S104: Determine the operating intention of the touch operation based on the centroid of each frame of touch data S401: Receive a touch operation on the touch area, and collect the touch data of the selected pixel block in the touch area with the image frame as the time unit, the touch data includes the pressure value of the pixel block subjected to the touch operation S402: Obtain the number of image frames collected by receiving the touch operation S403: The number of image frames is less than the first preset threshold S404: Save the collected touch data of each frame S405: Save and calculate whether each frame of touch data collected exceeds the touch boundary S406: Stop collecting the touch data, and output the centroid of each frame of touch data based on the saved frames of touch data S407: Whether the number of image frames is less than the second preset threshold S408: Determine the operation intention of the touch operation and indicate the click operation S409: Determine the operation intention of the touch operation based on the centroid of each frame of touch data S501: sort the centroids of each frame of touch data collected by the received touch operation according to the order of touch data collection, to obtain a centroid sequence S502: Eliminate the first preset number of centroids that are ranked the highest in the centroid sequence, and remove the second preset number of centroids that are ranked the last in the centroid sequence to obtain the first centroid sequence S503: Determine the operation intention of the touch operation based on the first centroid sequence S601: Determining the first centroid in the first centroid sequence as the starting point, and determining the end centroid in the first centroid sequence as the termination point, defining the number of image frames collected from the starting point to the termination point is the total image frame, after receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the first distance, and initialize the first distance to zero S602: Calculate the second distance between the centroid of the current image frame and the starting point S603: compare whether the second distance is greater than the first distance S604: Updating the value of the second distance to the value of the first distance S605: compare the current image frame number and the total image frame number, and obtain the comparison result S606: When the image frame number comparison result meets the first preset condition, and when the second distance and the current first distance meet the first preset sub-condition, update the centroid of the current image frame as the starting point S607: When the image frame number comparison result meets the second preset condition, and the second distance and the current first distance meet the second preset sub-condition, update the current centroid as the starting point S608: When the image frame number comparison result meets the third preset condition, update the current centroid to the end point S701: Receive a touch operation on the touch area, collect the touch data of the selected pixel block in the touch area with the image frame as the time unit, and determine the centroid of the first image frame collected as the starting point, preset The total number of image frames to be collected by the touch operation. After receiving the touch operation, define the distance from the centroid of the image frame before the current image frame to the starting point as the third distance, and initialize the third distance to zero S702: Calculate the fourth distance between the centroid of the current image frame and the starting point S703: compare whether the fourth distance is greater than the third distance S704: updating the value of the third distance to the value of the fourth distance S705: compare the current image frame number and the total image frame number, and obtain the comparison result S706: When the image frame number comparison result meets the first preset condition, and the third distance and the fourth distance meet the first preset sub-condition, update the current centroid as the starting point S707: When the image frame number comparison result meets the second preset condition, and the third distance and the fourth distance meet the second preset sub-condition, update the current centroid as the starting point S708: When the image frame number comparison result meets the third preset condition, update the centroid of the current image frame to the end point S801: Subtract the abscissa of the starting point from the abscissa of the end point to obtain the difference in abscissa S802: Subtract the ordinate of the end point from the ordinate of the starting point to obtain the ordinate difference S803: The sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference satisfies the sixth preset condition S804: Determine the operation intention of the touch operation and indicate the click operation S805: Judging whether the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition S806: Determine whether the abscissa difference is less than 0 S807: Determine the operation intention of the touch operation to indicate the sliding operation S808: Determine the operation intention of the touch operation to indicate the slide operation S809: judging whether the ordinate difference is greater than 0 S810: The absolute value of the ordinate difference and the absolute value of the abscissa difference meet the eighth preset condition S811: Determine the operation intention of the touch operation to indicate the left slide operation S812: Determine the operation intention of the touch operation to indicate the sliding operation S813: the absolute value of the ordinate difference and the absolute value of the abscissa difference meet the ninth preset condition S814: Determine the operation intention of the touch operation to indicate a right slide operation S815: Determine the operation intention of the touch operation to indicate the sliding operation 21: sub-block 22: Pixel block 91: Touch operation receiving unit 92: Weight determination unit 93: Centroid calculation unit 94: The first operation intention determination unit

FIG. 1 is a flowchart of a method for determining an operation intention provided by an embodiment of the present invention; FIG. 2 is a schematic diagram of pixel blocks in a touch area provided by an embodiment of the present invention; Fig. 3(a) is a schematic diagram of a pixel block structure provided by an embodiment of the present invention; Fig. 3(b) is a schematic diagram of another pixel block structure provided by an embodiment of the present invention; FIG. 4 is a flowchart of another method for determining an operation intention provided by an embodiment of the present invention; Fig. 5 is a flow chart of a method for determining the operation intention of a touch operation based on the centroid of each frame of touch data provided by an embodiment of the present invention; FIG. 6 is a flow chart of a method for optimizing a centroid movement trajectory provided by an embodiment of the present invention; FIG. 7 is a flow chart of another method for optimizing the movement trajectory of the center of mass provided by an embodiment of the present invention; FIG. 8 is a flow chart of a method for determining the operation intention of a touch operation based on the centroid of each frame of touch data provided by an embodiment of the present invention; and Fig. 9 is a schematic structural diagram of an operation intention determination device provided by an embodiment of the present invention.

S101: Receive a touch operation on the touch area, and collect the touch data of the selected pixel block in the touch area with the image frame as the time unit, the touch data includes the pressure value of the pixel block subjected to the touch operation

S102: Determine the weight of the pixel block according to the pressure value that the pixel block bears

S103: Utilize the weight of the pixel block and the position of the pixel block in the touch area to calculate the centroid of each frame of touch data

S104: Determine the operating intention of the touch operation based on the centroid of each frame of touch data

Claims (12)

A method for determining an operation intention, which is applied to an electronic device provided with a touch area, comprising: receiving a touch operation on the touch area, and collecting a touch data of a selected pixel block in the touch area with an image frame as a time unit , the touch data includes the pressure value of the pixel block subjected to the touch operation; determine the weight of the pixel block according to the pressure value of the pixel block; use the weight of the pixel block and the position of the pixel block in the touch area to calculate each Frame the centroid of the touch data; and determine the operation intention of the touch operation based on the centroid of each frame of the touch data, wherein the method also includes: acquiring the number of frames of an image collected by receiving the touch operation; if the figure When the number of image frames is less than a first preset threshold, save the collected frames of touch data; if the number of image frames is not less than the first preset threshold, save and calculate the collected frames of touch data, and based on the current The centroid of the frame touch data determines whether the current touch operation exceeds a touch boundary; and if the touch operation exceeds the touch boundary, stop collecting the touch data, and output the centroid of each frame of touch data. The method for determining the operation intention according to claim 1, wherein determining the weight of the pixel block according to the pressure value of the pixel block includes: Query the correspondence between the preset weight and the pressure range, and determine the weight corresponding to the pressure range to which the pressure value of the pixel block belongs as the weight of the pixel block. The operation intention determination method as described in Claim 2, wherein the pixel block includes a plurality of pixel sub-blocks, and collecting the pressure value borne by the pixel block includes collecting the pressure value borne by each pixel sub-block in the pixel block, according to Determining the weight of the pixel block by the pressure value of the pixel block includes: determining the weight of the pixel sub-block according to the pressure value of each pixel sub-block in the pixel block. The operation intention determination method as described in claim 3, wherein, using the weight of the pixel block and the position of the pixel block in the touch area, calculating the centroid of each frame of the touch data includes: obtaining the selected in the touch area The position of each pixel sub-block of each pixel block in the touch area, the position of the pixel sub-block in the touch area includes the abscissa and ordinate of the pixel sub-block in the touch area, Using a centroid formula to calculate the centroid of the touch data in each frame; and the centroid formula is:

Wherein, weight i _t is the weight of the i- th pixel sub-block in the touch data of the current frame, x _i is the abscissa of the i- th pixel sub-block in the touch data of the current frame, and y _i is the i-th pixel sub-block in the touch data of the current frame The ordinate of the pixel sub-block, M _x is the abscissa of the centroid of the touch data of the current frame, and M _y is the ordinate of the centroid of the touch data of the current frame. The method for determining the operation intention according to claim 1, wherein before determining the operation intention of the touch operation based on the centroid of each frame of touch data, the method further includes: judging whether the number of image frames is less than a second preset threshold ; and if the number of image frames is less than the second preset threshold, determine that the operation intention of the touch operation indicates a click operation, and the second preset threshold is less than the first preset threshold. The method for determining the operation intention according to claim 1, wherein determining the operation intention of the touch operation based on the centroid of each frame of touch data includes: according to the order in which the touch data is collected, the received touch operation is collected The centroids of each frame of touch data are sorted to obtain a centroid sequence; Eliminating a second preset number of centroids to obtain a first centroid sequence; and determining an operation intention of the touch operation based on the first centroid sequence. The operation intention determination method according to claim 6, further comprising: determining the first centroid in the first centroid sequence as a starting point, and determining the end centroid in the first centroid sequence as An end point, define the number of image frames collected from the start point to the end point as the total image frame, after receiving the touch operation, define the distance from the centroid of an image frame before the current image frame to the start point The distance is a first distance, and the first distance is initialized to zero; a second distance between the centroid of the current image frame and the starting point is calculated; Compare whether the second distance is greater than the first distance; if the second distance is greater than the first distance, update the second distance value to the value of the first distance; if the second distance is not greater than the current first distance , compare the current image frame number with the total image frame number, and obtain the comparison result; the image frame number comparison result satisfies a first preset condition, and the second distance and the current first distance satisfy a first preset sub condition, update the current centroid to the starting point; when the image frame number comparison result satisfies a second preset condition, and the second distance and the current first distance satisfy a second preset subcondition, the updating the current centroid to the starting point; and updating the current centroid to the ending point when the image frame number comparison result satisfies a third preset condition. The method for determining the operation intention as described in Claim 1, further comprising: determining the first centroid as a starting point, preset the total number of image frames to be collected by the touch operation, and defining the current The distance from the centroid of an image frame before the image frame to the starting point is a third distance, and the third distance is initialized to zero; calculate a distance between the centroid of the current image frame and the starting point The fourth distance; compare whether the fourth distance is greater than the third distance; if the fourth distance is greater than the third distance, update the value of the third distance to the value of the fourth distance; if the fourth distance is not greater than For the third distance, compare the current image frame number with the total image frame number to obtain a comparison result; When the image frame number comparison result satisfies a first preset condition, and the third distance and the fourth distance meet a first preset subcondition, update the current centroid to the starting point; image frame number comparison When the result satisfies a second preset condition, and the third distance and the fourth distance satisfy a second preset subcondition, update the current centroid to the starting point; and the image frame number comparison result satisfies a first first subcondition When three preset conditions are met, update the current centroid to the end point. The operation intention determination method as described in claim item 7 or 8, which also includes: selecting a centroid before the image frame sequence where the updated end point is located, and the serial number of the centroid is consistent with the proportion of the total number of image frames A fourth preset condition, and the distance between the centroid and the centroid of the previous frame satisfies a fifth preset condition, update the centroid to the end point. The method for determining the operation intention according to claim 9, wherein determining the operation intention of the touch operation based on the centroid of the touch distance includes: subtracting the abscissa of the starting point from the abscissa of the end point to obtain An abscissa difference; subtract the ordinate of the starting point from the ordinate of the end point to obtain a ordinate difference; if the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference If a sixth preset condition is met, it is determined that the operation intention of the touch operation indicates a click operation; if the sum of the absolute value of the abscissa difference and the absolute value of the ordinate difference does not meet the sixth preset condition, determine Whether the absolute value of the abscissa difference and the absolute value of the ordinate difference meet a seventh preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the seventh preset condition, when the abscissa difference is less than 0, determine the operation intention indication of the touch operation Swipe up operation; when the abscissa difference is not less than 0, determine that the operation intention of the touch operation indicates a slide operation; if the absolute value of the abscissa difference and the absolute value of the ordinate difference do not meet the seventh preset Set a condition to judge whether the ordinate difference is greater than 0; if the ordinate difference is greater than 0, judge whether the absolute value of the ordinate difference and the absolute value of the abscissa difference meet an eighth preset condition; if The absolute value of the abscissa difference and the absolute value of the ordinate difference meet the eighth preset condition, and it is determined that the operation intention of the touch operation indicates a left slide operation, if the absolute value of the abscissa difference and the ordinate The absolute value of the difference does not meet the eighth preset condition, determine that the operation intention of the touch operation indicates an upward slide operation; and if the difference in the ordinate is not greater than 0, determine the absolute value of the difference in the ordinate and the abscissa Whether the absolute value of the difference satisfies a ninth preset condition; if the absolute value of the abscissa difference and the absolute value of the ordinate difference meet the ninth preset condition, determine that the operation intention of the touch operation indicates sliding right Operation, if the absolute value of the difference on the abscissa and the absolute value of the difference on the ordinate do not satisfy the ninth preset condition, it is determined that the operation intention of the touch operation indicates an upward slide operation. A device for determining an operation intention, applied to an electronic device provided with a touch area, comprising: a touch operation receiving unit, configured to receive a touch operation on the touch area, and collect images in the touch area by taking an image frame as a time unit A touch data of a selected pixel block, the touch data includes the pressure value of the pixel block subjected to the touch operation; A weight determination unit, used to determine the weight of the pixel block according to the pressure value of the pixel block; a centroid calculation unit, used to use the weight of the pixel block and the position of the pixel block in the touch area to calculate the weight of each frame The centroid of the touch data; a first operation intention determination unit, used to determine the operation intention of the touch operation based on the centroid of the touch data in each frame; and a touch boundary judgment unit, used to obtain and receive the touch operation collected An image frame number; if the image frame number is less than a first preset threshold, save the collected frames of touch data; if the image frame number is not less than the first preset threshold, save and calculate the Collect each frame of touch data, and judge whether the current touch operation exceeds a touch boundary based on the centroid of the current frame touch data; if the touch operation exceeds the touch boundary, stop collecting touch data, and output the centroid of each frame of touch data. An electronic device, comprising: a touch area; a touch operation receiving unit, configured to receive a touch operation on the touch area, and collect a touch data of a selected pixel block in the touch area with an image frame as a time unit , the touch data includes the pressure value of the pixel block subjected to the touch operation; a weight determination unit is used to determine the weight of the pixel block according to the pressure value of the pixel block; a centroid calculation unit is used to use the pixel block weight and the position of the pixel block in the touch area, calculate the centroid of the touch data in each frame; A first operation intention determination unit, used to determine the operation intention of the touch operation based on the centroid of the touch data in each frame; and a touch boundary judgment unit, used to obtain the number of image frames collected by receiving the touch operation; If the image frame number is less than a first preset threshold, save the collected frames of touch data; if the image frame number is not less than the first preset threshold, save and calculate the collected frames of touch data, And judge whether the current touch operation exceeds a touch boundary based on the centroid of the touch data of the current frame; if the touch operation exceeds the touch boundary, stop collecting touch data, and output the centroid of each frame of touch data.

Images