WO2015085874A1 - Method and device for identifying gesture - Google Patents

Method and device for identifying gesture Download PDF

Info

Publication number
WO2015085874A1
WO2015085874A1 PCT/CN2014/092593 CN2014092593W WO2015085874A1 WO 2015085874 A1 WO2015085874 A1 WO 2015085874A1 CN 2014092593 W CN2014092593 W CN 2014092593W WO 2015085874 A1 WO2015085874 A1 WO 2015085874A1
Authority
WO
WIPO (PCT)
Prior art keywords
gesture
contact area
displacement
preset
threshold
Prior art date
Application number
PCT/CN2014/092593
Other languages
French (fr)
Chinese (zh)
Inventor
李航
Original Assignee
华为终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为终端有限公司 filed Critical 华为终端有限公司
Publication of WO2015085874A1 publication Critical patent/WO2015085874A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Definitions

  • the present invention relates to the field of touch screen technologies, and in particular, to a gesture recognition method and apparatus.
  • the touch screen when it recognizes a gesture responsive to the user, it generally determines what operation the user performs on the touch screen according to a preset distance threshold.
  • the threshold values in the X and Y directions are set in advance, the threshold value in the X direction is X0, and the threshold value in the Y direction is Y0, as shown in FIG.
  • the displacement X1 generated by the user's finger in the X direction on the touch screen and The displacement Y1 generated in the Y direction satisfies the following condition: X1 ⁇ X0 and Y1 ⁇ Y0, the user's current operation is recognized as a click operation, and further, in response to the user's click operation; when X1>X0 or Y1>Y0, Then the user's current operation is recognized as a sliding operation, and in response, the user's sliding operation.
  • the distance presets X0 and Y0 thresholds set by the touch screen during the process of recognizing the response to the user are both fixed values.
  • thresholds X0 and Y0 are likely to have defects that are set too small or too large. For example, if the thresholds X0 and Y0 are set small, when the user touches the touch screen, the finger contact area is large (such as a thumb click), and it is easy to generate a large displacement on the touch screen. At this time, the touch screen will cause the user to click.
  • the operation is incorrectly recognized as a sliding operation and cannot respond to the user's click operation; and if the thresholds X0 and Y0 are set too large, the user's hand performance when sliding is deteriorated because the user's finger is required to make a larger on the touch screen.
  • the touch screen can recognize the user's current gesture as a sliding operation, and the user experience is poor.
  • a gesture recognition method and apparatus are provided to improve the accuracy of the touch screen to the user's gesture recognition.
  • a gesture recognition method including:
  • the user's gesture is identified based on the adjusted displacement threshold.
  • the average contact area of the multiple sampling points is compared with a preset contact area threshold, and an initial displacement preset for the recognition gesture is performed according to the comparison result.
  • the threshold is adjusted, including: when the average contact area of the plurality of sampling points is lower than a preset contact area threshold, and the contact area data of the plurality of sampling points is fitted to a straight line form, reducing the initial displacement threshold .
  • the average contact area of the multiple sampling points is compared with a preset contact area threshold, and a position threshold preset for the recognition gesture is determined according to the comparison result. Adjusting, comprising: increasing the initial displacement when the average contact area of the plurality of sampling points is higher than a preset contact area threshold, and the contact area data of the plurality of sampling points is fitted to a quadratic curve form Threshold.
  • the determining, according to the adjusted displacement threshold value, the gesture of the user includes:
  • the gesture is recognized as a sliding operation when the gesture produces a displacement on the touch screen that is higher than the reduced displacement preset.
  • the determining, according to the adjusted displacement threshold, the gesture of the user includes:
  • the gesture is recognized as a sliding operation when the gesture produces a displacement on the touch screen that is higher than the increased displacement preset.
  • a gesture recognition apparatus including:
  • a gesture receiving module configured to receive a gesture input by a user through the touch screen
  • a contact area obtaining module configured to divide the gesture into a plurality of sampling points, and obtain a contact area of each sampling point with the touch screen;
  • a fitting adjustment module configured to compare an average contact area of the plurality of sampling points with a preset contact area threshold, and perform curve fitting on the contact area data of the plurality of sampling points, according to the comparison result and the fitting The result adjusts the initial displacement threshold preset by the recognition gesture;
  • the identification module is configured to identify the gesture of the user according to the displacement threshold after the adjustment.
  • the fitting adjustment module includes:
  • a first fitting unit for providing a first fitting result
  • a first adjusting unit configured to receive the first fitting result, when the first fitting result is: an average contact area of the plurality of sampling points is lower than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to a straight line form, the initial displacement threshold is decreased.
  • the fitting adjustment module includes:
  • a second fitting unit for providing a second fitting result
  • a second adjusting unit configured to receive the second fitting result, when the second fitting result is: an average contact area of the plurality of sampling points is higher than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to the quadratic curve form, the initial displacement threshold is increased.
  • the identifying module includes:
  • a first identifying unit configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than a reduced displacement preset
  • the second identifying unit is configured to recognize the gesture as a sliding operation when the displacement generated by the gesture on the touch screen is higher than the reduced displacement preset.
  • the identifying module includes:
  • a third identifying unit configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than an increased displacement preset
  • a fourth identifying unit configured to recognize the gesture as a sliding operation when a displacement generated by the gesture on the touch screen is higher than an increased displacement preset.
  • the threshold of the contact area between the finger and the touch screen is preset. After the touch screen receives the gesture input by the user, the gesture is divided into multiple sampling points, and the contact area between each sampling point and the touch screen is obtained. Comparing the average contact area of the plurality of sampling points with a preset contact area threshold, and performing curve fitting on the contact area data of the plurality of sampling points to obtain a change trend of the finger and the touch screen contact, according to the The trend of change is to adjust the displacement threshold preset by the recognition gesture to prevent the problem of incorrect recognition of the user gesture and improve the accuracy of the touch screen to the user's gesture recognition.
  • FIG. 1 is a schematic diagram of identifying a user gesture in the prior art
  • FIG. 2 is a schematic flowchart of a gesture recognition method according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram showing a fitting form of an average contact area of a first sampling point according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram showing a fitting form of an average contact area of a second sampling point according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of a gesture recognition apparatus according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a gesture recognition device for implementing user gesture recognition based on a computer system according to an embodiment of the present invention.
  • FIG. 2 is a flowchart of an embodiment of a gesture recognition method according to the present invention.
  • the process flow may specifically include:
  • Step 201 Receive a gesture input by a user through a touch screen
  • the touch screen receives the gesture input by the user and starts to recognize the gesture.
  • Step 202 Divide the gesture into multiple sampling points, and obtain a contact area of each sampling point with the touch screen.
  • the initial displacement threshold preset by the gesture is recognized to perform gesture recognition. Specifically, it is necessary to further combine the change trend of the contact action when the finger contacts the touch screen in the process of generating a displacement on the touch screen by the user's finger, and identify the user gesture.
  • the gesture is first divided into a plurality of sampling points, and the contact area of each sampling point with the touch screen is further acquired.
  • Step 203 Compare an average contact area of the plurality of sampling points with a preset contact area threshold, and perform curve fitting on the contact area data of the plurality of sampling points, and identify the gesture according to the comparison result and the fitting result.
  • the preset initial displacement threshold is adjusted.
  • the contact area threshold of the preset finger and the touch screen is preset, the average value of the contact areas of the plurality of sampling points and the touch screen is calculated, and the average value is compared with the preset contact area threshold to determine whether the average value is Above or below the preset contact area threshold. Then, the contact area data of the plurality of sampling points are curve-fitted to obtain a change trend of the finger and the touch screen. Finally, the initial displacement threshold preset by the recognition gesture is adjusted according to the foregoing comparison result and the fitting result.
  • the initial displacement threshold is used to initially determine whether the user's gesture operation is a click operation or a slide operation.
  • the initial displacement threshold may be adjusted according to the comparison result of the average of the contact area of the plurality of sampling points and the touch screen and the preset contact area threshold, and the curve fitting result.
  • the initial displacement threshold is set to the empirical value, which can be determined according to a certain number of people with different ages, heights, finger sizes and operating habits.
  • the current user's operation may be initially determined to be sliding; when the user's finger displacement is lower than the displacement threshold, the current user's operation may be initially determined to be a click.
  • the contact area threshold corresponding to various integrated chips can be set according to the processing attributes of different integrated chips.
  • Step 204 Identify the gesture of the user according to the displacement threshold after the adjustment.
  • the threshold of the contact area between the finger and the touch screen is preset. After the touch screen receives the gesture input by the user, the gesture is divided into multiple sampling points, and each sampling point is acquired. The contact area of the touch screen compares the average contact area of the plurality of sampling points with a preset contact area threshold, and performs curve fitting on the contact area data of the plurality of sampling points to obtain contact between the finger and the touch screen. According to the change trend, the initial displacement threshold preset by the recognition gesture is adjusted accordingly to prevent the problem of incorrect recognition of the user gesture and improve the accuracy of the touch screen to the user gesture recognition.
  • the average contact area of the plurality of sampling points is compared with a preset contact area threshold, and the initial displacement threshold preset by the recognition gesture is adjusted according to the comparison result, which mainly includes the following forms:
  • the initial displacement threshold is decreased.
  • the gesture is performed by using the index finger. operating. Further, the contact area data of the plurality of sampling points is fitted, and when the fitting result is in the form of a straight line, it means that the user's finger exerts a uniform force on the touch screen, and the gesture is easier to recognize. Therefore, the initial preset initial shift threshold can be reduced, so that the current user gesture is recognized more quickly, and the recognition sensitivity is improved.
  • the current user gesture can be identified, including:
  • the initial displacement threshold is increased.
  • the initial preset initial displacement threshold can be increased, so that the recognition of the current user gesture is more accurate and effective.
  • the current user gesture can be identified, including:
  • the initial displacement threshold set by the touch screen is 16 pixels.
  • the touch screen When the user clicks or slides on the touch screen every time, the touch screen will report a series of gesture sampling points, as follows: Down (0), Move (1), Move (2) ... Move (N-1), Move (N) and Up(N+1).
  • Down (0) is used to indicate the starting point of the user's finger touching the touch screen
  • Up (N+1) is used to indicate the end point of the user's finger last touching the touch screen
  • Move (1) to Move (N) are used to indicate that the user clicks or N sample points during the sliding operation.
  • the value of N depends on the reporting frequency of the touch screen. The higher the frequency, the smaller N is, the lower the frequency is, the larger N is.
  • the reporting frequency is 120 MHz, and the value of N is 5 or 6.
  • the value of the contact area corresponding to the N (samples) and the N sampling points in the click or slide operation are respectively obtained, and the average value of the contact area values corresponding to the sampling points is calculated, and the average value and the preset contact area are calculated.
  • the thresholds are compared.
  • the value defined by each touch screen manufacturer for the preset contact area threshold may be different. The following describes the preset contact area threshold of 100.
  • the displacement threshold for the sliding operation is too large for the user. Therefore, the displacement threshold needs to be reduced.
  • the displacement threshold needs to be increased.
  • the magnitude of the displacement threshold is reduced or increased, which is an empirical value.
  • the method of determining the magnitude of the displacement threshold that is specifically reduced or increased is exemplified below. For example, using a mobile phone with a touch screen size of 4.5 inches (resolution 960*540, pixel density of 1.5), allowing different people to click and slide, and the displacement of the finger on the touch screen during click and slide operations. Statistics, when the statistical results are found: for people who have a small contact area between the finger and the touch screen when clicking or sliding with the index finger, the finger displacement is usually about 6 pixels, the finger displacement is generally smaller than the initial displacement threshold, and the finger displacement is greater than the sliding operation.
  • the finger displacement may be about 20 to 24 pixels, the finger displacement is generally greater than the initial displacement threshold, and the finger displacement is greater than 24 pixels during the sliding operation. Therefore, in order to improve the accuracy of the touch screen to the user's gesture recognition, the displacement threshold of the initial setting may be adaptively adjusted according to the contact area of the user's finger and the touch screen: when the contact area between the finger and the touch screen is small during operation, the initial displacement threshold is Reduced to 6pixel; when the contact area between the finger and the touch screen is large during operation, the initial displacement threshold is increased to 24 pixels.
  • the present invention also provides a gesture recognition apparatus.
  • an embodiment of a gesture recognition apparatus provided by the present invention may specifically include:
  • a gesture receiving module 501 configured to receive a gesture input by a user through a touch screen
  • the contact area obtaining module 502 is configured to divide the gesture into a plurality of sampling points, and obtain a contact area of each sampling point with the touch screen;
  • a fitting adjustment module 503 configured to compare an average contact area of the plurality of sampling points with a preset contact area threshold, and perform curve fitting on the contact area data of the plurality of sampling points, according to the comparison result and the The result adjusts the initial displacement threshold preset by the recognition gesture;
  • the identification module 504 is configured to identify the gesture of the user according to the displacement threshold after the adjustment.
  • the gesture recognition is performed not only according to whether the displacement generated by the finger on the touch screen reaches the initial displacement threshold preset by the recognition gesture. Specifically, it is necessary to further combine the change trend of the contact action when the finger contacts the touch screen in the process of generating a displacement on the touch screen by the user's finger, and identify the user gesture. To obtain a change trend of the contact action when the finger is in contact with the touch screen, the contact area acquisition module 502 is required to divide the gesture into a plurality of sampling points, and further obtain the contact area of each sampling point with the touch screen. The device presets a contact area threshold of the finger and the touch screen.
  • the adjustment module 503 By fitting the adjustment module 503, calculating an average of the contact areas of the plurality of sampling points and the touch screen, and comparing the average value with a preset contact area threshold to determine whether the average value is higher or lower than the preset contact. Area threshold. Then, the contact area data of the plurality of sampling points are curve-fitted to obtain a change trend of the finger and the touch screen. Finally, the initial displacement threshold preset by the recognition gesture is adjusted according to the foregoing comparison result and the fitting result. In the specific implementation process, the initial displacement threshold is set to the empirical value, which can be determined according to a certain number of people with different ages, heights, finger sizes and operating habits. For the contact area threshold, the contact area threshold corresponding to various integrated chips can be set according to the processing attributes of different integrated chips.
  • the contact area threshold of the finger and the touch screen is preset. After the touch screen receives the gesture input by the user, the touch screen divides the gesture into multiple sampling points, and acquires a contact area between each sampling point and the touch screen. Comparing the average contact area of the plurality of sampling points with a preset contact area threshold, and performing curve fitting on the contact area data of the plurality of sampling points to obtain a change trend of the finger and the touch screen contact, according to the The change trend is to adjust the initial displacement threshold preset by the recognition gesture to prevent the problem of incorrect recognition of the user gesture and improve the accuracy of the touch screen to the user gesture recognition.
  • the fitting adjustment module may specifically include:
  • a first fitting unit for providing a first fitting result
  • a first adjusting unit configured to receive the first fitting result, when the first fitting result is: an average contact area of the plurality of sampling points is lower than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to a straight line form, the initial displacement threshold is decreased.
  • the average contact area of the plurality of sampling points when the average contact area of the plurality of sampling points is lower than the preset contact area threshold, it may be determined that the touch area of the user's finger and the touch screen is small, for example, according to the usage habit of most users, using the index finger Gesture operation. Further, the contact area data of the plurality of sampling points is fitted, and when the fitting result is in the form of a straight line, it means that the user's finger exerts a uniform force on the touch screen, and the gesture is easier to recognize. Therefore, the initial preset initial shift threshold can be reduced, so that the current user gesture is recognized more quickly, and the recognition sensitivity is improved.
  • the fitting adjustment module may specifically include:
  • a second fitting unit for providing a second fitting result
  • a second adjusting unit configured to receive the second fitting result, when the second fitting result is: an average contact area of the plurality of sampling points is higher than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to the quadratic curve form, the initial displacement threshold is increased.
  • the average contact area of the plurality of sampling points when the average contact area of the plurality of sampling points is higher than the preset contact area threshold, it may be determined that the touch area of the user's finger and the touch screen is large, for example, using a thumb that is not commonly used by the user to perform a gesture operation. . Further, the contact area data of the plurality of sampling points are fitted. When the fitting result is in the form of a quadratic curve, it indicates that the user's finger exerts a non-uniform force on the touch screen, and the gesture is relatively difficult to recognize. Therefore, the initial preset initial displacement threshold can be increased, so that the recognition of the current user gesture is more accurate and effective.
  • the identification module may specifically include:
  • a first identifying unit configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than a reduced displacement preset
  • a second identifying unit configured to identify the gesture as a sliding operation when a displacement generated by the gesture on the touch screen is higher than a reduced displacement preset
  • a third identifying unit configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than an increased displacement preset
  • a fourth identifying unit configured to recognize the gesture as a sliding operation when a displacement generated by the gesture on the touch screen is higher than an increased displacement preset.
  • the embodiment of the present invention further provides a gesture recognition device for realizing user gesture recognition based on a computer system.
  • the terminal in the embodiment of the present invention may include: a processor 601, a memory 602, a bus 603 and a receiver 604; wherein the processor 601 and the memory 602 are connected to each other by the bus 603; the memory 602 is configured to store a computer to execute an instruction; the receiver is configured to receive a gesture input by a user through a touch screen;
  • the processor 601 executes the computer execution instruction stored by the memory 602, and performs the following operations: dividing the gesture into a plurality of sampling points, and acquiring a contact area of each sampling point with the touch screen; The average contact area of the sampling point is compared with a preset contact area threshold, and the contact area data of the plurality of sampling points are curve-fitted, and the initial displacement threshold preset by the recognition gesture is performed according to the comparison result and the fitting result. Adjusting;
  • the processor may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or the like.
  • CPU central processing unit
  • ASIC application-specific integrated circuit
  • the computer storage medium may store a program, which may include some or all of the steps in various embodiments of the data transmission method provided by the embodiments of the present invention.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or otherwise.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product.
  • the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Disclosed in embodiments of the present invention are a method and device for identifying a gesture. The method for identifying the gesture comprises: receiving the gesture input by a user through a touch screen; dividing the gesture into multiple sample points, and acquiring the contact area between the each sample point and the touch screen; comparing the average contact area of the multiple sample points and a preset contact area threshold, and carrying out a curve fitting for the contact area data of the multiple sample points; adjusting the initial displacement threshold preset for the identified gesture according to the comparing result and the fitting result; and identifying the user's gesture according to the adjusted displacement threshold. The accuracy of the touch screen for identifying the user's gesture is improved through the embodiment of the present invention.

Description

一种手势识别方法及装置Gesture recognition method and device
本申请要求于2013年12月13日提交中国专利局、申请号为201310684417.X、发明名称为“一种手势识别方法及装置”的中国专利申请的优先权,其全部内容通过引用包含于本申请中。The present application claims priority to Chinese Patent Application No. 201310684417.X, entitled "A Hand Gesture Recognition Method and Apparatus" on December 13, 2013, the entire contents of which are hereby incorporated by reference. In the application.
技术领域Technical field
本发明涉及触摸屏技术领域,特别是涉及一种手势识别方法及装置。The present invention relates to the field of touch screen technologies, and in particular, to a gesture recognition method and apparatus.
背景技术Background technique
目前,大部分的智能终端(包括:智能手机、平板电脑等)都是通过用户在触摸屏上操作进行信息交互。为了提高触摸屏操作的准确性,用户对触摸操作的性能要求也越来越高,用户希望在触摸操作的过程中手势滑动的过程越跟手越好,手势点击图标越准确越好。At present, most of the smart terminals (including: smart phones, tablets, etc.) perform information interaction by the user operating on the touch screen. In order to improve the accuracy of the touch screen operation, the performance requirements of the touch operation are also higher and higher, and the user desires that the process of gesture sliding in the process of the touch operation is better, and the more accurate the gesture click icon is, the better.
现有技术中,触摸屏在识别响应用户的手势时,通常按照预先设置的距离阈值来确定用户在触摸屏上进行的是何操作。具体地,预先设定在X和Y方向的阀值,X方向的阈值为X0,Y方向的阈值为Y0,如图1所示,当用户的手指在触摸屏上X方向上产生的位移X1以及在Y方向上产生的位移Y1满足以下条件:X1<X0并且Y1<Y0,则将用户当前的操作识别为点击操作,进而,响应该用户的点击操作;当X1>X0或者Y1>Y0时,则将用户当前的操作识别为滑动操作,进而,响应该用户的滑动操作。In the prior art, when the touch screen recognizes a gesture responsive to the user, it generally determines what operation the user performs on the touch screen according to a preset distance threshold. Specifically, the threshold values in the X and Y directions are set in advance, the threshold value in the X direction is X0, and the threshold value in the Y direction is Y0, as shown in FIG. 1, the displacement X1 generated by the user's finger in the X direction on the touch screen and The displacement Y1 generated in the Y direction satisfies the following condition: X1 < X0 and Y1 < Y0, the user's current operation is recognized as a click operation, and further, in response to the user's click operation; when X1>X0 or Y1>Y0, Then the user's current operation is recognized as a sliding operation, and in response, the user's sliding operation.
现有技术中,触摸屏在识别响应用户的手势过程中设置的距离预置X0和Y0阀值均是固定值。在实际应用的不同场景中,阈值X0和Y0很可能出现设置得过小或过大的缺陷。例如:如果阈值X0和Y0设置较小,当用户在点击触摸屏时手指接触面积较大(比如大拇指点击),容易在触摸屏上产生一个较大位移,此时,将导致触摸屏将用户的该点击操作错误地识别为滑动操作,无法响应用户的点击操作;而如果阀值X0和Y0设置过大,用户在滑动时的跟手性能就会变差,因为需要用户手指在触摸屏上制造更大的位移时,触摸屏才能将用户的当前手势识别为滑动操作,用户体验较差。 In the prior art, the distance presets X0 and Y0 thresholds set by the touch screen during the process of recognizing the response to the user are both fixed values. In different scenarios of practical applications, thresholds X0 and Y0 are likely to have defects that are set too small or too large. For example, if the thresholds X0 and Y0 are set small, when the user touches the touch screen, the finger contact area is large (such as a thumb click), and it is easy to generate a large displacement on the touch screen. At this time, the touch screen will cause the user to click. The operation is incorrectly recognized as a sliding operation and cannot respond to the user's click operation; and if the thresholds X0 and Y0 are set too large, the user's hand performance when sliding is deteriorated because the user's finger is required to make a larger on the touch screen. When the displacement is made, the touch screen can recognize the user's current gesture as a sliding operation, and the user experience is poor.
可见,现有技术中,触摸屏对用户手势的识别普遍具有准确性较差的缺陷,亟待技术人员解决。It can be seen that in the prior art, the recognition of the user's gesture by the touch screen generally has the defect of poor accuracy, which is urgently solved by the technician.
发明内容Summary of the invention
本发明实施例中提供了一种手势识别方法及装置,以提高触摸屏对用户手势识别的准确性。In the embodiment of the present invention, a gesture recognition method and apparatus are provided to improve the accuracy of the touch screen to the user's gesture recognition.
为了解决上述技术问题,本发明实施例公开了如下技术方案:In order to solve the above technical problem, the embodiment of the present invention discloses the following technical solutions:
第一方面,提供一种手势识别方法,包括:In a first aspect, a gesture recognition method is provided, including:
接收用户通过触摸屏输入的手势;Receiving a gesture input by a user through a touch screen;
将所述手势划分为多个采样点,获取每个采样点与所述触摸屏的接触面积;Dividing the gesture into a plurality of sampling points, and acquiring a contact area of each sampling point with the touch screen;
将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,根据比较结果以及拟合结果对识别手势所预置的初始位移阈值进行调整;Comparing the average contact area of the plurality of sampling points with a preset contact area threshold, and performing curve fitting on the contact area data of the plurality of sampling points, and presetting the recognition gesture according to the comparison result and the fitting result The initial displacement threshold is adjusted;
根据调整之后的位移阈值,对所述用户的手势进行识别。The user's gesture is identified based on the adjusted displacement threshold.
结合上述第一方面,在第一种可能的实现方式中,所述将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,根据比较结果对识别手势所预置的初始位移阈值进行调整,包括:当所述多个采样点的平均接触面积低于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为直线形式,则减小所述初始位移阈值。With reference to the first aspect, in a first possible implementation manner, the average contact area of the multiple sampling points is compared with a preset contact area threshold, and an initial displacement preset for the recognition gesture is performed according to the comparison result. The threshold is adjusted, including: when the average contact area of the plurality of sampling points is lower than a preset contact area threshold, and the contact area data of the plurality of sampling points is fitted to a straight line form, reducing the initial displacement threshold .
结合上述第一方面,在第二种可能的实现方式中,所述将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,根据比较结果对识别手势所预置的位置阈值进行调整,包括:当所述多个采样点的平均接触面积高于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为二次曲线形式,则增大所述初始位移阈值。With reference to the foregoing first aspect, in a second possible implementation manner, the average contact area of the multiple sampling points is compared with a preset contact area threshold, and a position threshold preset for the recognition gesture is determined according to the comparison result. Adjusting, comprising: increasing the initial displacement when the average contact area of the plurality of sampling points is higher than a preset contact area threshold, and the contact area data of the plurality of sampling points is fitted to a quadratic curve form Threshold.
结合上述一方面,和第一种可能的实现方式,在第三种可能的实现方式中,所述根据调整之后的位移阈值,对所述用户的手势进行识别,包括: With reference to the foregoing aspect, and the first possible implementation manner, in a third possible implementation manner, the determining, according to the adjusted displacement threshold value, the gesture of the user includes:
当所述手势在所述触摸屏上产生的位移低于减小后的位移预置时,将所述手势识别为点击操作;Recognizing the gesture as a click operation when the displacement generated by the gesture on the touch screen is lower than the reduced displacement preset;
当所述手势在所述触摸屏上产生的位移高于减小后的位移预置时,将所述手势识别为滑动操作。The gesture is recognized as a sliding operation when the gesture produces a displacement on the touch screen that is higher than the reduced displacement preset.
结合上述一方面,和第二种可能的实现方式,在第四种可能的实现方式中,所述根据调整之后的位移阈值,对所述用户的手势进行识别,包括:With reference to the foregoing aspect, and the second possible implementation manner, in a fourth possible implementation manner, the determining, according to the adjusted displacement threshold, the gesture of the user includes:
当所述手势在所述触摸屏上产生的位移低于增大后的位移预置时,将所述手势识别为点击操作;Recognizing the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than an increased displacement preset;
当所述手势在所述触摸屏上产生的位移高于增大后的位移预置时,将所述手势识别为滑动操作。The gesture is recognized as a sliding operation when the gesture produces a displacement on the touch screen that is higher than the increased displacement preset.
第二方面,提供一种手势识别装置,包括:In a second aspect, a gesture recognition apparatus is provided, including:
手势接收模块,用于接收用户通过触摸屏输入的手势;a gesture receiving module, configured to receive a gesture input by a user through the touch screen;
接触面积获取模块,用于将所述手势划分为多个采样点,获取每个采样点与所述触摸屏的接触面积;a contact area obtaining module, configured to divide the gesture into a plurality of sampling points, and obtain a contact area of each sampling point with the touch screen;
拟合调整模块,用于将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,根据比较结果以及拟合结果对识别手势所预置的初始位移阈值进行调整;a fitting adjustment module, configured to compare an average contact area of the plurality of sampling points with a preset contact area threshold, and perform curve fitting on the contact area data of the plurality of sampling points, according to the comparison result and the fitting The result adjusts the initial displacement threshold preset by the recognition gesture;
识别模块,用于根据调整之后的位移阈值,对所述用户的手势进行识别。The identification module is configured to identify the gesture of the user according to the displacement threshold after the adjustment.
结合上述第二方面,在第一种可能的实现方式中,所述拟合调整模块,包括:With reference to the foregoing second aspect, in a first possible implementation, the fitting adjustment module includes:
第一拟合单元,用于提供第一拟合结果;a first fitting unit for providing a first fitting result;
第一调整单元,用于接收所述第一拟合结果,当所述第一拟合结果为:所述多个采样点的平均接触面积低于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为直线形式时,减小所述初始位移阈值。 a first adjusting unit, configured to receive the first fitting result, when the first fitting result is: an average contact area of the plurality of sampling points is lower than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to a straight line form, the initial displacement threshold is decreased.
结合上述第二方面,在第二种可能的实现方式中,所述拟合调整模块,包括:With reference to the foregoing second aspect, in a second possible implementation, the fitting adjustment module includes:
第二拟合单元,用于提供第二拟合结果;a second fitting unit for providing a second fitting result;
第二调整单元,用于接收所述第二拟合结果,当所述第二拟合结果为:所述多个采样点的平均接触面积高于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为二次曲线形式时,增大所述初始位移阈值。a second adjusting unit, configured to receive the second fitting result, when the second fitting result is: an average contact area of the plurality of sampling points is higher than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to the quadratic curve form, the initial displacement threshold is increased.
结合上述第二方面,和第一种可能的实现方式,在第三种可能的实现方式中,所述识别模块,包括:With reference to the foregoing second aspect, and the first possible implementation manner, in a third possible implementation manner, the identifying module includes:
第一识别单元,用于当所述手势在所述触摸屏上产生的位移低于减小后的位移预置时,将所述手势识别为点击操作;a first identifying unit, configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than a reduced displacement preset;
第二识别单元,用于当所述手势在所述触摸屏上产生的位移高于减小后的位移预置时,将所述手势识别为滑动操作。The second identifying unit is configured to recognize the gesture as a sliding operation when the displacement generated by the gesture on the touch screen is higher than the reduced displacement preset.
结合上述第二方面,和第二种可能的实现方式,在第四种可能的实现方式中,所述识别模块,包括:With reference to the foregoing second aspect, and the second possible implementation manner, in a fourth possible implementation manner, the identifying module includes:
第三识别单元,用于当所述手势在所述触摸屏上产生的位移低于增大后的位移预置时,将所述手势识别为点击操作;a third identifying unit, configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than an increased displacement preset;
第四识别单元,用于当所述手势在所述触摸屏上产生的位移高于增大后的位移预置时,将所述手势识别为滑动操作。And a fourth identifying unit, configured to recognize the gesture as a sliding operation when a displacement generated by the gesture on the touch screen is higher than an increased displacement preset.
本发明实施例中,预置手指与接触屏的接触面积阈值,当触摸屏接收到用户输入的手势后,将所述手势划分为多个采样点,获取每个采样点与所述触摸屏的接触面积,将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,以获得手指与触摸屏接触的变化趋势,根据该变化趋势,对识别手势所预置的位移阈值进行相应调整,以防止出现对用户手势错误识别的问题,提高触摸屏对用户手势识别的准确性。In the embodiment of the present invention, the threshold of the contact area between the finger and the touch screen is preset. After the touch screen receives the gesture input by the user, the gesture is divided into multiple sampling points, and the contact area between each sampling point and the touch screen is obtained. Comparing the average contact area of the plurality of sampling points with a preset contact area threshold, and performing curve fitting on the contact area data of the plurality of sampling points to obtain a change trend of the finger and the touch screen contact, according to the The trend of change is to adjust the displacement threshold preset by the recognition gesture to prevent the problem of incorrect recognition of the user gesture and improve the accuracy of the touch screen to the user's gesture recognition.
附图说明 DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it will be apparent to those skilled in the art that In other words, other drawings can be obtained based on these drawings without paying for creative labor.
图1为现有技术中识别用户手势的示意图;1 is a schematic diagram of identifying a user gesture in the prior art;
图2为本发明实施例中手势识别方法的流程示意图;2 is a schematic flowchart of a gesture recognition method according to an embodiment of the present invention;
图3为本发明实施例中第一种采样点的平均接触面积拟合形式示意图;3 is a schematic diagram showing a fitting form of an average contact area of a first sampling point according to an embodiment of the present invention;
图4为本发明实施例中第二种采样点的平均接触面积拟合形式示意图;4 is a schematic diagram showing a fitting form of an average contact area of a second sampling point according to an embodiment of the present invention;
图5为本发明实施例提供的一种手势识别装置示意图;FIG. 5 is a schematic diagram of a gesture recognition apparatus according to an embodiment of the present invention;
图6为本发明实施例提供的一种基于计算机系统实现用户手势识别的手势识别装置示意图。FIG. 6 is a schematic diagram of a gesture recognition device for implementing user gesture recognition based on a computer system according to an embodiment of the present invention.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本发明实施例中的技术方案,并使本发明实施例的上述目的、特征和优点能够更加明显易懂,下面结合附图对本发明实施例中技术方案作进一步详细的说明。The above-mentioned objects, features, and advantages of the embodiments of the present invention will become more apparent and understood. Give further details.
首先,介绍本发明提供的一种手势识别方法。First, a gesture recognition method provided by the present invention is introduced.
参见图2,为本发明提供的一个手势识别方法实施例的流程,处理流程具体可以包括:2 is a flowchart of an embodiment of a gesture recognition method according to the present invention. The process flow may specifically include:
步骤201、接收用户通过触摸屏输入的手势;Step 201: Receive a gesture input by a user through a touch screen;
该步骤中,当用户通过手指接触触摸屏进行操作时,触摸屏接收到用户输入的手势,开始对该手势进行识别。In this step, when the user operates by touching the touch screen with the finger, the touch screen receives the gesture input by the user and starts to recognize the gesture.
步骤202、将所述手势划分为多个采样点,获取每个采样点与所述触摸屏的接触面积。Step 202: Divide the gesture into multiple sampling points, and obtain a contact area of each sampling point with the touch screen.
本发明实施例中,并非仅仅根据手指在触摸屏上产生的位移是否达到 识别手势所预置的初始位移阈值,进行手势识别。具体地,需要进一步结合用户手指在触摸屏上产生位移的过程中,手指与触摸屏接触时接触动作的变化趋势,对用户手势进行识别。In the embodiment of the present invention, it is not only based on whether the displacement generated by the finger on the touch screen is reached. The initial displacement threshold preset by the gesture is recognized to perform gesture recognition. Specifically, it is necessary to further combine the change trend of the contact action when the finger contacts the touch screen in the process of generating a displacement on the touch screen by the user's finger, and identify the user gesture.
由此,如需获得手指与触摸屏接触时接触动作的变化趋势,首先需要将手势划分为多个采样点,并进一步获取每个采样点与所述触摸屏的接触面积。Therefore, if a change trend of the contact action when the finger is in contact with the touch screen is obtained, the gesture is first divided into a plurality of sampling points, and the contact area of each sampling point with the touch screen is further acquired.
步骤203、将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,根据比较结果以及拟合结果对识别手势所预置的初始位移阈值进行调整。Step 203: Compare an average contact area of the plurality of sampling points with a preset contact area threshold, and perform curve fitting on the contact area data of the plurality of sampling points, and identify the gesture according to the comparison result and the fitting result. The preset initial displacement threshold is adjusted.
该实施例中,预置手指与接触屏的接触面积阈值,计算多个采样点与触摸屏的接触面积的平均值,并将该平均值与预置接触面积阈值进行比较,以确定该平均值是否高于或低于该预置接触面积阈值。继而,将多个采样点的接触面积数据进行曲线拟合,以获得手指与触摸屏接触的变化趋势。最终,根据前述比较结果以及拟合结果对识别手势所预置的初始位移阈值进行调整。In this embodiment, the contact area threshold of the preset finger and the touch screen is preset, the average value of the contact areas of the plurality of sampling points and the touch screen is calculated, and the average value is compared with the preset contact area threshold to determine whether the average value is Above or below the preset contact area threshold. Then, the contact area data of the plurality of sampling points are curve-fitted to obtain a change trend of the finger and the touch screen. Finally, the initial displacement threshold preset by the recognition gesture is adjusted according to the foregoing comparison result and the fitting result.
该初始位移阈值用于初步确定用户的手势操作为点击操作还是滑动操作。本发明实施例中,在具体识别过程中,可以根据前述多个采样点与触摸屏的接触面积的平均值与预置接触面积阈值的比较结果,以及曲线拟合结果进行初始位移阈值的相应调整。The initial displacement threshold is used to initially determine whether the user's gesture operation is a click operation or a slide operation. In the embodiment of the present invention, in the specific identification process, the initial displacement threshold may be adjusted according to the comparison result of the average of the contact area of the plurality of sampling points and the touch screen and the preset contact area threshold, and the curve fitting result.
具体实现过程中,初始位移阈值的设置均为经验值,可以根据一定数量具有不同年龄、身高、手指大小及操作习惯的人群进行确定。当用户的手指位移超过该位移阈值时,可以初步确定当前用户的操作为滑动;当用户的手指位移低于该位移阈值时,可以初步确定当前用户的操作为点击。In the specific implementation process, the initial displacement threshold is set to the empirical value, which can be determined according to a certain number of people with different ages, heights, finger sizes and operating habits. When the finger displacement of the user exceeds the displacement threshold, the current user's operation may be initially determined to be sliding; when the user's finger displacement is lower than the displacement threshold, the current user's operation may be initially determined to be a click.
对于接触面积阈值,可以按照不同集成芯片的处理属性,设置与各种集成芯片对应的接触面积阈值。For the contact area threshold, the contact area threshold corresponding to various integrated chips can be set according to the processing attributes of different integrated chips.
步骤204、根据调整之后的位移阈值,对所述用户的手势进行识别。Step 204: Identify the gesture of the user according to the displacement threshold after the adjustment.
本发明实施例中,预置手指与接触屏的接触面积阈值,当触摸屏接收到用户输入的手势后,将所述手势划分为多个采样点,获取每个采样点与 所述触摸屏的接触面积,将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,以获得手指与触摸屏接触的变化趋势,根据该变化趋势,对识别手势所预置的初始位移阈值进行相应调整,以防止出现对用户手势错误识别的问题,提高触摸屏对用户手势识别的准确性。In the embodiment of the present invention, the threshold of the contact area between the finger and the touch screen is preset. After the touch screen receives the gesture input by the user, the gesture is divided into multiple sampling points, and each sampling point is acquired. The contact area of the touch screen compares the average contact area of the plurality of sampling points with a preset contact area threshold, and performs curve fitting on the contact area data of the plurality of sampling points to obtain contact between the finger and the touch screen. According to the change trend, the initial displacement threshold preset by the recognition gesture is adjusted accordingly to prevent the problem of incorrect recognition of the user gesture and improve the accuracy of the touch screen to the user gesture recognition.
本发明实施例中,将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,根据比较结果对识别手势所预置的初始位移阈值进行调整,主要包括以下形式:In the embodiment of the present invention, the average contact area of the plurality of sampling points is compared with a preset contact area threshold, and the initial displacement threshold preset by the recognition gesture is adjusted according to the comparison result, which mainly includes the following forms:
(1)当所述多个采样点的平均接触面积低于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为直线形式,则减小所述初始位移阈值。(1) When the average contact area of the plurality of sampling points is lower than a preset contact area threshold, and the contact area data of the plurality of sampling points is fitted to a straight line form, the initial displacement threshold is decreased.
该种方案中,当多个采样点的平均接触面积低于预置接触面积阈值时,则可确定用户手指与触摸屏的触摸面积较小,例如:按照大多数用户的使用习惯,利用食指进行手势操作。进一步,将多个采样点的接触面积数据进行拟合,当拟合结果为直线形式时,则表示用户手指在触摸屏上施力均匀,较易对该手势进行识别。因此,可以减小初始预置的初始位移阈值,使得更快地识别出当前用户手势,提高识别灵敏度。In this solution, when the average contact area of the plurality of sampling points is lower than the preset contact area threshold, it may be determined that the touch area of the user's finger and the touch screen is small, for example, according to the usage habit of most users, the gesture is performed by using the index finger. operating. Further, the contact area data of the plurality of sampling points is fitted, and when the fitting result is in the form of a straight line, it means that the user's finger exerts a uniform force on the touch screen, and the gesture is easier to recognize. Therefore, the initial preset initial shift threshold can be reduced, so that the current user gesture is recognized more quickly, and the recognition sensitivity is improved.
当减小预置的初始位移阈值之后,即可对当前用户手势进行识别,具体包括:After the preset initial displacement threshold is decreased, the current user gesture can be identified, including:
(a)当所述手势在所述触摸屏上产生的位移低于减小后的位移预置时,将所述手势识别为点击操作;(a) identifying the gesture as a click operation when the gesture produces a displacement on the touch screen that is lower than the reduced displacement preset;
(b)当所述手势在所述触摸屏上产生的位移高于减小后的位移预置时,将所述手势识别为滑动操作。(b) identifying the gesture as a sliding operation when the gesture produces a displacement on the touch screen that is higher than the reduced displacement preset.
(2)当所述多个采样点的平均接触面积高于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为二次曲线形式,则增大所述初始位移阈值。(2) When the average contact area of the plurality of sampling points is higher than a preset contact area threshold, and the contact area data of the plurality of sampling points is fitted in a quadratic curve form, the initial displacement threshold is increased.
该种方案中,当多个采样点的平均接触面积高于预置接触面积阈值时,则可确定用户手指与触摸屏的触摸面积较大,例如:利用大多数用户不常用的拇指进行手势操作。进一步,将多个采样点的接触面积数据进行拟合, 当拟合结果为二次曲线形式时,则表示用户手指在触摸屏上施力并不均匀,比较不容易对该手势进行识别。因此,可以增大初始预置的初始位移阈值,使得对当前用户手势的识别更加准确有效。In this solution, when the average contact area of the plurality of sampling points is higher than the preset contact area threshold, it may be determined that the touch area of the user's finger and the touch screen is large, for example, the gesture operation is performed by using a thumb that is not commonly used by most users. Further, fitting the contact area data of the plurality of sampling points, When the fitting result is in the form of a quadratic curve, it means that the user's finger exerts a non-uniform force on the touch screen, and it is relatively difficult to recognize the gesture. Therefore, the initial preset initial displacement threshold can be increased, so that the recognition of the current user gesture is more accurate and effective.
当增大预置的初始位移阈值之后,即可对当前用户手势进行识别,具体包括:After the preset initial displacement threshold is increased, the current user gesture can be identified, including:
(c)当所述手势在所述触摸屏上产生的位移低于增大后的位移预置时,将所述手势识别为点击操作;(c) recognizing the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than an increased displacement preset;
(d)当所述手势在所述触摸屏上产生的位移高于增大后的位移预置时,将所述手势识别为滑动操作。(d) identifying the gesture as a sliding operation when the gesture produces a displacement on the touch screen that is higher than the increased displacement preset.
为了便于对本发明技术方案的理解,下面通过具体实现方式对上述技术方案进行详细的说明。In order to facilitate the understanding of the technical solutions of the present invention, the above technical solutions are described in detail through specific implementations.
假设触摸屏设置的初始位移阀值为16像素(pixel)。Assume that the initial displacement threshold set by the touch screen is 16 pixels.
当用户每次在触摸屏上进行点击或者滑动操作时,触摸屏都会上报一系列的手势采样点,如下:Down(0)、Move(1)、Move(2)……Move(N-1)、Move(N)以及Up(N+1)。其中,Down(0)用于表示用户手指接触触摸屏的起始点,Up(N+1)用于表示用户手指最后接触触摸屏的终止点,Move(1)~Move(N)用于表示用户点击或者滑动操作过程中的N个采样点。具体地,N的取值取决于触摸屏的报点频率,频率越高,N越小,频率越低,N越大,以报点频率为120MHz为例,N的取值为5或者6。When the user clicks or slides on the touch screen every time, the touch screen will report a series of gesture sampling points, as follows: Down (0), Move (1), Move (2) ... Move (N-1), Move (N) and Up(N+1). Among them, Down (0) is used to indicate the starting point of the user's finger touching the touch screen, Up (N+1) is used to indicate the end point of the user's finger last touching the touch screen, and Move (1) to Move (N) are used to indicate that the user clicks or N sample points during the sliding operation. Specifically, the value of N depends on the reporting frequency of the touch screen. The higher the frequency, the smaller N is, the lower the frequency is, the larger N is. For example, the reporting frequency is 120 MHz, and the value of N is 5 or 6.
在判断是否对与预置的位移预置进行调整时,需要结合Down(0)以及点击或者滑动操作过程中的N个采样点进行判断。When judging whether to adjust the preset displacement preset, it is necessary to combine Down (0) and N sampling points in the click or slide operation to judge.
具体地,获取Down(0)以及点击或者滑动操作过程中的N个采样点分别对应的接触面积数值,计算这些采样点对应的接触面积数值的平均值,并将该平均值与预置接触面积阈值进行比较。每个触摸屏厂家对预置接触面积阈值定义的值可能不同,下面以预置接触面积阈值为100进行说明。Specifically, the value of the contact area corresponding to the N (samples) and the N sampling points in the click or slide operation are respectively obtained, and the average value of the contact area values corresponding to the sampling points is calculated, and the average value and the preset contact area are calculated. The thresholds are compared. The value defined by each touch screen manufacturer for the preset contact area threshold may be different. The following describes the preset contact area threshold of 100.
如果平均接触面积小于100,而且这些采样点拟合的曲线近似于一次函数形式,例如:直线形式y=k,如图3所示。则该种情形表明,当前用户手指与触摸屏的接触面积较小,由此,当前设置的用于确定用户是点击操 作还是滑动操作的位移阈值对于该用户来说,数值偏大。因此,需要将该位移阈值减小。If the average contact area is less than 100, and the curves fitted by these sampling points approximate a linear function form, for example, the straight line form y=k, as shown in FIG. In this case, the contact area between the current user's finger and the touch screen is small, and thus, the currently set is used to determine that the user is a click operation. The displacement threshold for the sliding operation is too large for the user. Therefore, the displacement threshold needs to be reduced.
如果平均接触面积大于100,而且这些采样点拟合的曲线近似于二次函数形式,例如:抛物线形式,如图4所示。则该种情形表明,当前用户手指与触摸屏的接触面积较大,由此,当前设置的用于确定用户是点击操作还是滑动操作的位移阈值对于该用户来说,数值偏小。因此,需要将该位移阈值增大。If the average contact area is greater than 100, and the curves fitted by these sample points approximate the quadratic function form, for example: parabolic form, as shown in Figure 4. In this case, the current user's finger has a large contact area with the touch screen. Therefore, the currently set displacement threshold for determining whether the user is a click operation or a sliding operation is small for the user. Therefore, the displacement threshold needs to be increased.
具体实现过程中,位移阈值具体减小或增大的幅度,均为经验数值。During the specific implementation process, the magnitude of the displacement threshold is reduced or increased, which is an empirical value.
下面举例说明位移阈值具体减小或增大的幅度的确定方法。例如:利用一台触摸屏尺寸为4.5吋的手机(分辨率960*540,像素密度为1.5),让不同的人群进行点击和滑动的操作,对点击和滑动操作中手指在触摸屏上发生的位移进行统计,当统计结果发现:对于用食指进行点击或滑动时手指与触摸屏接触面积较小的人群,手指位移通常在6pixel左右,该手指位移一般小于初始的位移阈值,而滑动操作时,手指位移大于6pixel;对于用大拇指进行点击或滑动时手指与触摸屏接触面积较大的人群,手指位移可能在20~24pixel左右,该手指位移一般大于初始的位移阈值,而滑动操作时,手指位移大于24pixel。由此,为了提高触摸屏对用户手势识别的准确性,可以结合用户手指与触摸屏的接触面积的大小,适应性调整初始设置的位移阈值:当操作中手指与触摸屏接触面积较小时,将初始位移阈值减小为6pixel;当操作中手指与触摸屏接触面积较大时,将初始位移阈值增大为24pixel。The method of determining the magnitude of the displacement threshold that is specifically reduced or increased is exemplified below. For example, using a mobile phone with a touch screen size of 4.5 inches (resolution 960*540, pixel density of 1.5), allowing different people to click and slide, and the displacement of the finger on the touch screen during click and slide operations. Statistics, when the statistical results are found: for people who have a small contact area between the finger and the touch screen when clicking or sliding with the index finger, the finger displacement is usually about 6 pixels, the finger displacement is generally smaller than the initial displacement threshold, and the finger displacement is greater than the sliding operation. 6pixel; for a person who has a large contact area between the finger and the touch screen when clicking or sliding with a thumb, the finger displacement may be about 20 to 24 pixels, the finger displacement is generally greater than the initial displacement threshold, and the finger displacement is greater than 24 pixels during the sliding operation. Therefore, in order to improve the accuracy of the touch screen to the user's gesture recognition, the displacement threshold of the initial setting may be adaptively adjusted according to the contact area of the user's finger and the touch screen: when the contact area between the finger and the touch screen is small during operation, the initial displacement threshold is Reduced to 6pixel; when the contact area between the finger and the touch screen is large during operation, the initial displacement threshold is increased to 24 pixels.
与本发明提供的手势识别方法实施例相对应,本发明还提供了一种手势识别装置。Corresponding to the embodiment of the gesture recognition method provided by the present invention, the present invention also provides a gesture recognition apparatus.
如图5所示,为本发明提供的一种手势识别装置的实施例,该装置具体可以包括:As shown in FIG. 5, an embodiment of a gesture recognition apparatus provided by the present invention may specifically include:
手势接收模块501,用于接收用户通过触摸屏输入的手势;a gesture receiving module 501, configured to receive a gesture input by a user through a touch screen;
接触面积获取模块502,用于将所述手势划分为多个采样点,获取每个采样点与所述触摸屏的接触面积; The contact area obtaining module 502 is configured to divide the gesture into a plurality of sampling points, and obtain a contact area of each sampling point with the touch screen;
拟合调整模块503,用于将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,根据比较结果以及拟合结果对识别手势所预置的初始位移阈值进行调整;a fitting adjustment module 503, configured to compare an average contact area of the plurality of sampling points with a preset contact area threshold, and perform curve fitting on the contact area data of the plurality of sampling points, according to the comparison result and the The result adjusts the initial displacement threshold preset by the recognition gesture;
识别模块504,用于根据调整之后的位移阈值,对所述用户的手势进行识别。The identification module 504 is configured to identify the gesture of the user according to the displacement threshold after the adjustment.
需要说明的是,该装置实施例中,并非仅仅根据手指在触摸屏上产生的位移是否达到识别手势所预置的初始位移阈值,进行手势识别。具体地,需要进一步结合用户手指在触摸屏上产生位移的过程中,手指与触摸屏接触时接触动作的变化趋势,对用户手势进行识别。如需获得手指与触摸屏接触时接触动作的变化趋势,需要通过接触面积获取模块502,将手势划分为多个采样点,并进一步获取每个采样点与所述触摸屏的接触面积。该装置预置手指与接触屏的接触面积阈值。通过拟合调整模块503,计算多个采样点与触摸屏的接触面积的平均值,并将该平均值与预置接触面积阈值进行比较,以确定该平均值是否高于或低于该预置接触面积阈值。继而,将多个采样点的接触面积数据进行曲线拟合,以获得手指与触摸屏接触的变化趋势。最终,根据前述比较结果以及拟合结果对识别手势所预置的初始位移阈值进行调整。具体实现过程中,初始位移阈值的设置均为经验值,可以根据一定数量具有不同年龄、身高、手指大小及操作习惯的人群进行确定。对于接触面积阈值,可以按照不同集成芯片的处理属性,设置与各种集成芯片对应的接触面积阈值。It should be noted that, in the device embodiment, the gesture recognition is performed not only according to whether the displacement generated by the finger on the touch screen reaches the initial displacement threshold preset by the recognition gesture. Specifically, it is necessary to further combine the change trend of the contact action when the finger contacts the touch screen in the process of generating a displacement on the touch screen by the user's finger, and identify the user gesture. To obtain a change trend of the contact action when the finger is in contact with the touch screen, the contact area acquisition module 502 is required to divide the gesture into a plurality of sampling points, and further obtain the contact area of each sampling point with the touch screen. The device presets a contact area threshold of the finger and the touch screen. By fitting the adjustment module 503, calculating an average of the contact areas of the plurality of sampling points and the touch screen, and comparing the average value with a preset contact area threshold to determine whether the average value is higher or lower than the preset contact. Area threshold. Then, the contact area data of the plurality of sampling points are curve-fitted to obtain a change trend of the finger and the touch screen. Finally, the initial displacement threshold preset by the recognition gesture is adjusted according to the foregoing comparison result and the fitting result. In the specific implementation process, the initial displacement threshold is set to the empirical value, which can be determined according to a certain number of people with different ages, heights, finger sizes and operating habits. For the contact area threshold, the contact area threshold corresponding to various integrated chips can be set according to the processing attributes of different integrated chips.
上述装置实施例中,预置手指与接触屏的接触面积阈值,当触摸屏接收到用户输入的手势后,将所述手势划分为多个采样点,获取每个采样点与所述触摸屏的接触面积,将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,以获得手指与触摸屏接触的变化趋势,根据该变化趋势,对识别手势所预置的初始位移阈值进行相应调整,以防止出现对用户手势错误识别的问题,提高触摸屏对用户手势识别的准确性。In the device embodiment, the contact area threshold of the finger and the touch screen is preset. After the touch screen receives the gesture input by the user, the touch screen divides the gesture into multiple sampling points, and acquires a contact area between each sampling point and the touch screen. Comparing the average contact area of the plurality of sampling points with a preset contact area threshold, and performing curve fitting on the contact area data of the plurality of sampling points to obtain a change trend of the finger and the touch screen contact, according to the The change trend is to adjust the initial displacement threshold preset by the recognition gesture to prevent the problem of incorrect recognition of the user gesture and improve the accuracy of the touch screen to the user gesture recognition.
具体实施过程中,所述拟合调整模块,具体可以包括:In the specific implementation process, the fitting adjustment module may specifically include:
第一拟合单元,用于提供第一拟合结果; a first fitting unit for providing a first fitting result;
第一调整单元,用于接收所述第一拟合结果,当所述第一拟合结果为:所述多个采样点的平均接触面积低于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为直线形式时,减小所述初始位移阈值。a first adjusting unit, configured to receive the first fitting result, when the first fitting result is: an average contact area of the plurality of sampling points is lower than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to a straight line form, the initial displacement threshold is decreased.
该种实施方案中,当多个采样点的平均接触面积低于预置接触面积阈值时,则可确定用户手指与触摸屏的触摸面积较小,例如:按照大多数用户的使用习惯,利用食指进行手势操作。进一步,将多个采样点的接触面积数据进行拟合,当拟合结果为直线形式时,则表示用户手指在触摸屏上施力均匀,较易对该手势进行识别。因此,可以减小初始预置的初始位移阈值,使得更快地识别出当前用户手势,提高识别灵敏度。In this embodiment, when the average contact area of the plurality of sampling points is lower than the preset contact area threshold, it may be determined that the touch area of the user's finger and the touch screen is small, for example, according to the usage habit of most users, using the index finger Gesture operation. Further, the contact area data of the plurality of sampling points is fitted, and when the fitting result is in the form of a straight line, it means that the user's finger exerts a uniform force on the touch screen, and the gesture is easier to recognize. Therefore, the initial preset initial shift threshold can be reduced, so that the current user gesture is recognized more quickly, and the recognition sensitivity is improved.
此外,在另一种拟合调整模块的实现方式中,该拟合调整模块具体可以包括:In addition, in another implementation manner of the fitting adjustment module, the fitting adjustment module may specifically include:
第二拟合单元,用于提供第二拟合结果;a second fitting unit for providing a second fitting result;
第二调整单元,用于接收所述第二拟合结果,当所述第二拟合结果为:所述多个采样点的平均接触面积高于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为二次曲线形式时,增大所述初始位移阈值。a second adjusting unit, configured to receive the second fitting result, when the second fitting result is: an average contact area of the plurality of sampling points is higher than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to the quadratic curve form, the initial displacement threshold is increased.
该种实施方案中,当多个采样点的平均接触面积高于预置接触面积阈值时,则可确定用户手指与触摸屏的触摸面积较大,例如:利用大多数用户不常用的拇指进行手势操作。进一步,将多个采样点的接触面积数据进行拟合,当拟合结果为二次曲线形式时,则表示用户手指在触摸屏上施力并不均匀,比较不容易对该手势进行识别。因此,可以增大初始预置的初始位移阈值,使得对当前用户手势的识别更加准确有效。In this embodiment, when the average contact area of the plurality of sampling points is higher than the preset contact area threshold, it may be determined that the touch area of the user's finger and the touch screen is large, for example, using a thumb that is not commonly used by the user to perform a gesture operation. . Further, the contact area data of the plurality of sampling points are fitted. When the fitting result is in the form of a quadratic curve, it indicates that the user's finger exerts a non-uniform force on the touch screen, and the gesture is relatively difficult to recognize. Therefore, the initial preset initial displacement threshold can be increased, so that the recognition of the current user gesture is more accurate and effective.
对于上述拟合调整模块的实现方式,所述识别模块,具体可以包括:For the implementation of the above-mentioned fitting adjustment module, the identification module may specifically include:
第一识别单元,用于当所述手势在所述触摸屏上产生的位移低于减小后的位移预置时,将所述手势识别为点击操作;a first identifying unit, configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than a reduced displacement preset;
第二识别单元,用于当所述手势在所述触摸屏上产生的位移高于减小后的位移预置时,将所述手势识别为滑动操作;a second identifying unit, configured to identify the gesture as a sliding operation when a displacement generated by the gesture on the touch screen is higher than a reduced displacement preset;
第三识别单元,用于当所述手势在所述触摸屏上产生的位移低于增大后的位移预置时,将所述手势识别为点击操作; a third identifying unit, configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than an increased displacement preset;
第四识别单元,用于当所述手势在所述触摸屏上产生的位移高于增大后的位移预置时,将所述手势识别为滑动操作。And a fourth identifying unit, configured to recognize the gesture as a sliding operation when a displacement generated by the gesture on the touch screen is higher than an increased displacement preset.
相应地,本发明实施例还提供了一种基于计算机系统实现用户手势识别的手势识别装置,如图6所示,具体实现中,本发明实施例的终端可以包括:处理器601、存储器602、总线603和接收器604;其中,所述处理器601和存储器602通过所述总线603相互连接;所述存储器602用于存储计算机执行指令;所述接收器用于接收用户通过触摸屏输入的手势;所述处理器601执行所述存储器602存储的所述计算机执行指令,执行如下操作:将所述手势划分为多个采样点,获取每个采样点与所述触摸屏的接触面积;将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,根据比较结果以及拟合结果对识别手势所预置的初始位移阈值进行调整;根据调整之后的位移阈值,对所述用户的手势进行识别。Correspondingly, the embodiment of the present invention further provides a gesture recognition device for realizing user gesture recognition based on a computer system. As shown in FIG. 6 , in a specific implementation, the terminal in the embodiment of the present invention may include: a processor 601, a memory 602, a bus 603 and a receiver 604; wherein the processor 601 and the memory 602 are connected to each other by the bus 603; the memory 602 is configured to store a computer to execute an instruction; the receiver is configured to receive a gesture input by a user through a touch screen; The processor 601 executes the computer execution instruction stored by the memory 602, and performs the following operations: dividing the gesture into a plurality of sampling points, and acquiring a contact area of each sampling point with the touch screen; The average contact area of the sampling point is compared with a preset contact area threshold, and the contact area data of the plurality of sampling points are curve-fitted, and the initial displacement threshold preset by the recognition gesture is performed according to the comparison result and the fitting result. Adjusting; identifying the gesture of the user according to the adjusted displacement threshold.
本发明实施例中,处理器可以是中央处理器(central processing unit,CPU)、专用集成电路(application-specific integrated circuit,ASIC)等。In the embodiment of the present invention, the processor may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or the like.
计算机存储介质可存储有程序,该程序执行时可包括本发明实施例提供的数据传输的方法的各实施例中的部分或全部步骤。所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。The computer storage medium may store a program, which may include some or all of the steps in various embodiments of the data transmission method provided by the embodiments of the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、设备和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。 A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、设备和方法,可以通过其它的方式实现。例如,以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or otherwise.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器(processor)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。The functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应所述以权利要求的保护范围为准。 The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Claims (10)

  1. 一种手势识别方法,其特征在于,包括:A gesture recognition method, comprising:
    接收用户通过触摸屏输入的手势;Receiving a gesture input by a user through a touch screen;
    将所述手势划分为多个采样点,获取每个采样点与所述触摸屏的接触面积;Dividing the gesture into a plurality of sampling points, and acquiring a contact area of each sampling point with the touch screen;
    将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,根据比较结果以及拟合结果对识别手势所预置的初始位移阈值进行调整;Comparing the average contact area of the plurality of sampling points with a preset contact area threshold, and performing curve fitting on the contact area data of the plurality of sampling points, and presetting the recognition gesture according to the comparison result and the fitting result The initial displacement threshold is adjusted;
    根据调整之后的位移阈值,对所述用户的手势进行识别。The user's gesture is identified based on the adjusted displacement threshold.
  2. 根据权利要求1所述的方法,其特征在于,所述将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,根据比较结果对识别手势所预置的初始位移阈值进行调整,包括:The method according to claim 1, wherein the comparing the average contact area of the plurality of sampling points with a preset contact area threshold, and adjusting an initial displacement threshold preset by the recognition gesture according to the comparison result ,include:
    当所述多个采样点的平均接触面积低于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为直线形式,则减小所述初始位移阈值。When the average contact area of the plurality of sampling points is lower than a preset contact area threshold, and the contact area data of the plurality of sampling points is fitted to a straight line form, the initial displacement threshold is decreased.
  3. 根据权利要求1所述的方法,其特征在于,所述将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,根据比较结果对识别手势所预置的位置阈值进行调整,包括:The method according to claim 1, wherein the comparing the average contact area of the plurality of sampling points with a preset contact area threshold, and adjusting a position threshold preset by the recognition gesture according to the comparison result, include:
    当所述多个采样点的平均接触面积高于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为二次曲线形式,则增大所述初始位移阈值。When the average contact area of the plurality of sampling points is higher than a preset contact area threshold, and the contact area data of the plurality of sampling points is fitted in a quadratic curve form, the initial displacement threshold is increased.
  4. 根据权利要求2所述的方法,其特征在于,所述根据调整之后的位移阈值,对所述用户的手势进行识别,包括:The method according to claim 2, wherein the identifying the gesture of the user according to the adjusted displacement threshold comprises:
    当所述手势在所述触摸屏上产生的位移低于减小后的位移预置时,将所述手势识别为点击操作;Recognizing the gesture as a click operation when the displacement generated by the gesture on the touch screen is lower than the reduced displacement preset;
    当所述手势在所述触摸屏上产生的位移高于减小后的位移预置时,将所述手势识别为滑动操作。The gesture is recognized as a sliding operation when the gesture produces a displacement on the touch screen that is higher than the reduced displacement preset.
  5. 根据权利要求3所述的方法,其特征在于,所述根据调整之后的位移阈值,对所述用户的手势进行识别,包括:The method according to claim 3, wherein the identifying the gesture of the user according to the displacement threshold after the adjustment comprises:
    当所述手势在所述触摸屏上产生的位移低于增大后的位移预置时,将所述手势识别为点击操作;Recognizing the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than an increased displacement preset;
    当所述手势在所述触摸屏上产生的位移高于增大后的位移预置时,将所述手势识别为滑动操作。 The gesture is recognized as a sliding operation when the gesture produces a displacement on the touch screen that is higher than the increased displacement preset.
  6. 一种手势识别装置,其特征在于,包括:A gesture recognition device, comprising:
    手势接收模块,用于接收用户通过触摸屏输入的手势;a gesture receiving module, configured to receive a gesture input by a user through the touch screen;
    接触面积获取模块,用于将所述手势划分为多个采样点,获取每个采样点与所述触摸屏的接触面积;a contact area obtaining module, configured to divide the gesture into a plurality of sampling points, and obtain a contact area of each sampling point with the touch screen;
    拟合调整模块,用于将所述多个采样点的平均接触面积与预置接触面积阈值进行比较,并将所述多个采样点的接触面积数据进行曲线拟合,根据比较结果以及拟合结果对识别手势所预置的初始位移阈值进行调整;a fitting adjustment module, configured to compare an average contact area of the plurality of sampling points with a preset contact area threshold, and perform curve fitting on the contact area data of the plurality of sampling points, according to the comparison result and the fitting The result adjusts the initial displacement threshold preset by the recognition gesture;
    识别模块,用于根据调整之后的位移阈值,对所述用户的手势进行识别。The identification module is configured to identify the gesture of the user according to the displacement threshold after the adjustment.
  7. 根据权利要求6所述的装置,其特征在于,所述拟合调整模块,包括:The apparatus according to claim 6, wherein the fitting adjustment module comprises:
    第一拟合单元,用于提供第一拟合结果;a first fitting unit for providing a first fitting result;
    第一调整单元,用于接收所述第一拟合结果,当所述第一拟合结果为:所述多个采样点的平均接触面积低于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为直线形式时,减小所述初始位移阈值。a first adjusting unit, configured to receive the first fitting result, when the first fitting result is: an average contact area of the plurality of sampling points is lower than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to a straight line form, the initial displacement threshold is decreased.
  8. 根据权利要求6所述的装置,其特征在于,所述拟合调整模块,包括:The apparatus according to claim 6, wherein the fitting adjustment module comprises:
    第二拟合单元,用于提供第二拟合结果;a second fitting unit for providing a second fitting result;
    第二调整单元,用于接收所述第二拟合结果,当所述第二拟合结果为:所述多个采样点的平均接触面积高于预置接触面积阈值,且所述多个采样点的接触面积数据拟合为二次曲线形式时,增大所述初始位移阈值。a second adjusting unit, configured to receive the second fitting result, when the second fitting result is: an average contact area of the plurality of sampling points is higher than a preset contact area threshold, and the plurality of samplings When the contact area data of the point is fitted to the quadratic curve form, the initial displacement threshold is increased.
  9. 根据权利要求7所述的装置,其特征在于,所述识别模块,包括:The device according to claim 7, wherein the identification module comprises:
    第一识别单元,用于当所述手势在所述触摸屏上产生的位移低于减小后的位移预置时,将所述手势识别为点击操作;a first identifying unit, configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than a reduced displacement preset;
    第二识别单元,用于当所述手势在所述触摸屏上产生的位移高于减小后的位移预置时,将所述手势识别为滑动操作。The second identifying unit is configured to recognize the gesture as a sliding operation when the displacement generated by the gesture on the touch screen is higher than the reduced displacement preset.
  10. 根据权利要求8所述的装置,其特征在于,所述识别模块,包括:The device according to claim 8, wherein the identification module comprises:
    第三识别单元,用于当所述手势在所述触摸屏上产生的位移低于增大后的位移预置时,将所述手势识别为点击操作;a third identifying unit, configured to identify the gesture as a click operation when a displacement generated by the gesture on the touch screen is lower than an increased displacement preset;
    第四识别单元,用于当所述手势在所述触摸屏上产生的位移高于增大后的位移预置时,将所述手势识别为滑动操作。 And a fourth identifying unit, configured to recognize the gesture as a sliding operation when a displacement generated by the gesture on the touch screen is higher than an increased displacement preset.
PCT/CN2014/092593 2013-12-13 2014-11-29 Method and device for identifying gesture WO2015085874A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310684417.XA CN104714675B (en) 2013-12-13 2013-12-13 A kind of gesture identification method and device
CN201310684417.X 2013-12-13

Publications (1)

Publication Number Publication Date
WO2015085874A1 true WO2015085874A1 (en) 2015-06-18

Family

ID=53370611

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/092593 WO2015085874A1 (en) 2013-12-13 2014-11-29 Method and device for identifying gesture

Country Status (2)

Country Link
CN (1) CN104714675B (en)
WO (1) WO2015085874A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111624572A (en) * 2020-05-26 2020-09-04 京东方科技集团股份有限公司 Human hand and human gesture recognition method and device

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105302467B (en) * 2015-11-05 2018-10-23 网易(杭州)网络有限公司 Touch control operation identifies and response method, device and game control method, device
CN107256124B (en) * 2017-04-21 2023-01-10 海信视像科技股份有限公司 Electronic whiteboard touch control method and device
CN107894861A (en) * 2017-10-31 2018-04-10 广州视源电子科技股份有限公司 Touch screen control method and device and intelligent terminal
CN108829475B (en) * 2018-05-29 2021-08-17 北京小米移动软件有限公司 UI drawing method, device and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101963863A (en) * 2010-09-30 2011-02-02 华为终端有限公司 User touch operation mode self-adapting method and device
CN102722254A (en) * 2012-06-20 2012-10-10 清华大学深圳研究生院 Method and system for location interaction
CN102968267A (en) * 2011-08-30 2013-03-13 三星电子株式会社 Mobile terminal and method of operating a user interface therein
CN103092498A (en) * 2011-11-07 2013-05-08 联想(北京)有限公司 Method and device for determining response mode and electronic device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101963863A (en) * 2010-09-30 2011-02-02 华为终端有限公司 User touch operation mode self-adapting method and device
CN102968267A (en) * 2011-08-30 2013-03-13 三星电子株式会社 Mobile terminal and method of operating a user interface therein
CN103092498A (en) * 2011-11-07 2013-05-08 联想(北京)有限公司 Method and device for determining response mode and electronic device
CN102722254A (en) * 2012-06-20 2012-10-10 清华大学深圳研究生院 Method and system for location interaction

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111624572A (en) * 2020-05-26 2020-09-04 京东方科技集团股份有限公司 Human hand and human gesture recognition method and device
US11797098B2 (en) 2020-05-26 2023-10-24 Boe Technology Group Co., Ltd. Methods for recognizing human hand and hand gesture from human, and display apparatus

Also Published As

Publication number Publication date
CN104714675A (en) 2015-06-17
CN104714675B (en) 2017-12-05

Similar Documents

Publication Publication Date Title
CN108021259B (en) False touch prevention method and electronic equipment
KR101455145B1 (en) User touch operation mode adaptive method and device
JP6543273B2 (en) Touch point recognition method and apparatus
CN109428969B (en) Edge touch method and device of double-screen terminal and computer readable storage medium
US9007314B2 (en) Method for touch processing and mobile terminal
WO2015085874A1 (en) Method and device for identifying gesture
US10884611B2 (en) Method and apparatus for controlling touch screen of terminal, and terminal
CN108920066B (en) Touch screen sliding adjustment method and device and touch equipment
WO2016145883A1 (en) Screen control method, terminal and computer storage medium
CN105487809A (en) Terminal control method and device
US20150286283A1 (en) Method, system, mobile terminal, and storage medium for processing sliding event
CN108874234B (en) Touch identification method and device and touch display device
CN108108117B (en) Screen capturing method and device and terminal
CN105892927A (en) Mobile terminal control method and device
CN104881225A (en) Control method and device for adjusting bar
CN108279848B (en) Display method and electronic equipment
JP2018531564A6 (en) Method, apparatus and system for obtaining video data and computer-readable storage medium
JP2018531564A (en) Method, apparatus and system for obtaining video data and computer-readable storage medium
CN107656677B (en) Method for adjusting position of application icon, storage medium and mobile terminal
CN104898880A (en) Control method and electronic equipment
TW201344557A (en) Apparatus and method for automatically controlling display screen density
CN106547381B (en) A kind of method and apparatus of mobile terminal false-touch prevention
CN114402280A (en) Screen parameter adjusting method and device and terminal equipment
CN106126087A (en) A kind of based on the display picture approach of intelligent terminal and the device with touch screen
CN104866210A (en) Touch screen control method and device and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14869885

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14869885

Country of ref document: EP

Kind code of ref document: A1