WO2018041250A1 - 触控操作的识别方法及装置 - Google Patents

触控操作的识别方法及装置 Download PDF

Info

Publication number
WO2018041250A1
WO2018041250A1 PCT/CN2017/100275 CN2017100275W WO2018041250A1 WO 2018041250 A1 WO2018041250 A1 WO 2018041250A1 CN 2017100275 W CN2017100275 W CN 2017100275W WO 2018041250 A1 WO2018041250 A1 WO 2018041250A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
value
touch operation
smart device
preset
Prior art date
Application number
PCT/CN2017/100275
Other languages
English (en)
French (fr)
Inventor
邱晨
姚建江
熊林强
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2018041250A1 publication Critical patent/WO2018041250A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04105—Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position

Definitions

  • the present application relates to the field of electronic technologies, and in particular, to a method and an apparatus for identifying a touch operation.
  • a coupling capacitor can be formed between the finger and the touch screen, so that the current from the electrodes on the four sides of the touch screen flows to the contact point of the finger and the touch screen, and the smart device can be based on the four sides. Calculating the position of the contact point on the touch screen, so that the smart device can perform corresponding actions according to the position of the contact point, for example, starting the application corresponding to the application icon displayed at the touch point. .
  • the smart device in the related art can only recognize the position of the contact point that is touched by the touch operation, and the recognition manner of the touch operation is relatively simple.
  • the present application provides a method and device for identifying a touch operation.
  • the technical solution is as follows:
  • the first aspect provides a method for identifying a touch operation, where the method can be applied to a smart device, where the smart device includes a touch screen, and the method includes:
  • the smart device After receiving the touch operation, acquires touch data generated by the touch operation, and the touch data may include: receiving a capacitance value of the touch screen after the touch operation, and the touch operation generates the touch screen The pressure value and the acceleration value generated by the smart device by the touch operation; afterwards, the smart device can identify the type of the touch operation according to the acquired touch data, and the type of the touch operation may include knuckle touch Or non-finger joint touch.
  • the smart device can recognize that the type of the touch operation refers to joint touch or non-finger joint touch according to the acquired touch data, thereby enriching the smart device's recognition of the touch operation.
  • the method enables the user to perform different ways of touching the smart device through different types of touch operations, thereby improving the flexibility of the user to control the smart device through the touch operation.
  • the type of the touch operation is determined according to the touch data, including: determining whether the touch data meets a condition of the touch of the knuckle; and determining the touch operation when the touch data meets the condition of the touch of the knuckle
  • the type of the touch operation is knuckle touch; when the touch data does not satisfy the condition of the knuckle touch, the type of the touch operation is determined to be a non-finger joint
  • the touch control may include: the capacitance value of the touch screen is within a preset capacitance range, the pressure value is within a preset pressure range, and the acceleration value is within a preset acceleration range.
  • the touch data acquired by the smart device includes not only the capacitance value of the touch screen, but also the pressure value detected by the pressure sensor and the acceleration value detected by the acceleration sensor.
  • the type of the touch data is rich, so the touch operation is recognized according to the touch data. The accuracy of the type is higher.
  • the acquiring, by the smart device, the touch data generated by the touch operation may include: acquiring touch data within a preset time period after receiving the touch operation; and identifying the type of the touch operation
  • the method further includes: performing feature extraction on the capacitance value, the pressure value, and the acceleration value acquired in the preset time period, respectively, to obtain an eigenvalue of the capacitance value, an eigenvalue of the pressure value, and a characteristic of the acceleration value.
  • the yoke touch condition further includes: the characteristic value of the capacitance value is in a first preset range, the characteristic value of the pressure value is in a second preset range, and the characteristic value of the acceleration value is in the third Within the preset range.
  • the feature value extracted by the smart device may include at least one of a peak value, a mean value, a variance, an extreme point number, a change frequency, and a signal energy.
  • the effective information in the touch data can be extracted, and the redundant information in the touch data is removed, so the efficiency and accuracy of the touch operation type are recognized according to the extracted feature value.
  • the rate is higher.
  • the process of performing feature extraction on the capacitance value, the pressure value, and the acceleration value obtained by the smart device in the preset time period may include:
  • the specific process of obtaining the touch data generated by the touch operation may include:
  • the touch data further includes: coordinates of the touch point of the touch operation on the touch screen; after the type of the touch operation is identified according to the touch data, the method may further include: according to the touch The coordinates of the point and the type of the touch operation perform the action indicated by the touch operation.
  • the non-finger joint touch may include any one of a nail touch, a finger touch, and a stylus touch.
  • the smart device can not only identify the location of the touch point affected by the touch operation, but also identify the specific type of the touch operation, thereby enriching the smart device's recognition of the touch operation.
  • the method allows the user to control the smart device in different ways through different types of touch operations, thereby improving the flexibility of controlling the smart device through the touch operation.
  • the present application provides an identification device for a touch operation, which can be applied to a smart device, the smart device includes a touch screen, and the identification device of the touch operation includes at least one module, and the at least one module is used for The method for identifying a touch operation provided by the above first aspect is implemented.
  • another touch operation identifying device comprising: a processor, a memory and a bus; the bus is for connecting the processor and the memory, and the processor is configured to execute the stored in the memory
  • the program may include the method of identifying the touch operation provided by the first aspect.
  • a computer readable storage medium in a fourth aspect, storing instructions for causing a computer to perform the touch provided by the first aspect when the computer readable storage medium is run on a computer The method of identification of the operation.
  • a computer program product comprising instructions for causing a computer to perform the method of identifying a touch operation provided by the first aspect described above is provided when the computer program product is run on a computer.
  • the smart device After receiving the touch operation, the smart device can acquire the touch data generated by the touch operation, and identify, according to the touch data, whether the type of the touch operation refers to joint touch or non-finger joint touch, compared to In the related art, only the position of the touch point operated by the touch operation can be identified.
  • the identification method enriches the smart device's recognition mode for the touch operation, so that the user can control the smart device in different ways through different types of touch operations. , which improves the flexibility of controlling the smart device through touch operation.
  • FIG. 1 is a structural diagram of a smart device according to an embodiment of the present invention.
  • FIG. 2 is a schematic structural diagram of a device for identifying a touch operation according to an embodiment of the present invention
  • 3-1 is a flowchart of a method for identifying a touch operation according to an embodiment of the present invention
  • 3-2 is a waveform diagram of an acceleration value of a smart device according to an embodiment of the present invention.
  • 3-3 is a schematic diagram of a distribution of capacitance values of a touch screen according to an embodiment of the present invention.
  • 3-4 is a schematic diagram of distribution of capacitance values of another touch screen according to an embodiment of the present invention.
  • 3-5 are waveform diagrams of acceleration values of another smart device according to an embodiment of the present invention.
  • FIG. 3-6 are schematic diagrams showing distributions of capacitance values of still another touch screen according to an embodiment of the present invention.
  • 3-7 are flowcharts of a method for processing touch data by a smart device according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of another identification device for touch operation according to an embodiment of the present invention.
  • the smart device may include a touch screen 10, a pressure sensor 20 disposed on a side of the touch screen 10 away from the display plane, and configured in the smart device.
  • the touch screen 10 is configured to receive a touch operation of the user, and the pressure sensor 20 is configured to detect a pressure value acting on the touch screen 10, and the acceleration sensor 30 is configured to detect the smart
  • the signal processing module 40 is capable of acquiring the touch value of the touch screen, the pressure value, and the touch value, and identifying the type of the touch operation according to the touch data.
  • FIG. 2 is a schematic structural diagram of an identification device for touch operation according to an exemplary embodiment of the present application.
  • the device can be applied to the smart device shown in FIG.
  • the identification device of the touch operation may include: at least one processor 201 (for example, a CPU), at least one network interface 202 or other communication interface, a memory 203, and at least one communication bus 204. To achieve connection communication between these devices.
  • the processor 201 is configured to execute an executable module, such as a computer program, stored in the memory 203, and the functions of the processor 201 are the same as or similar to those of the signal processing module 40 of FIG.
  • the memory 203 may include a high speed random access memory (RAM: Random Access Memory), and may also include a non-volatile memory such as at least one disk memory.
  • RAM Random Access Memory
  • the communication connection between the smart device and at least one other network element is implemented by at least one network interface 202 (which may be wired or wireless), for example, an Internet, a wide area network, a local network, a metropolitan area network, or the like may be used.
  • the memory 203 stores a program 2031
  • the processor 201 can execute the program 2031 to implement the following method for identifying a touch operation.
  • the embodiment of the present invention provides a method for identifying a touch operation.
  • the method can be applied to the smart device shown in FIG. 1 .
  • the method may include:
  • Step 101 The smart device receives the touch operation through the touch screen. Go to step 102.
  • the touch screen may be a capacitive screen.
  • the smart device can receive the capacitive screen through the capacitive screen. Touch operation.
  • Step 102 The smart device determines whether the amount of change in the capacitance value of the touch screen is within a preset variation range after receiving the touch operation.
  • step 103 is performed; when the amount of change is not within the preset variation range, the identification process of the touch operation is ended.
  • the smart device may be preset.
  • the smart device detects that the capacitance value of the touch screen changes, the smart device can determine whether the change amount is within the preset change range. If the preset change range is performed, perform the step. 103, the identification of the type of the touch operation is started; if the change amount is not within the preset change range, the smart device may determine that the touch operation is a misoperation, and end the recognition process of the touch operation. Therefore, the probability of the smart device misidentifying the misoperation is effectively reduced, and the misidentification of the misoperation is avoided to occupy excessive memory resources.
  • the preset change range may be set according to the actual application scenario of the smart device, the physical structure of the smart device, and the type of the touch screen.
  • the specific scope of the preset change range is not limited in the embodiment of the present invention.
  • Step 103 The smart device acquires touch data within a preset time period after receiving the touch operation. Go to step 104.
  • the touch data may include: a capacitance value of the touch screen after receiving the touch operation, and the touch operation is the touch The pressure value generated by the screen and the acceleration value generated by the smart device by the touch operation.
  • the smart device can be provided with a pressure sensor and an acceleration sensor, the smart device can obtain the pressure value generated by the touch operation on the touch screen, and obtain the touch operation by using the acceleration sensor.
  • the acceleration value generated by the smart device since the touch data generated by the touch operation is not fixed, but changes with time, the smart device may be used to improve the recognition accuracy when the touch operation is recognized according to the touch data.
  • the touch data in the preset time period is obtained after the touch operation is received, and the preset time period may be a preset detection time length in the smart device.
  • FIG. 3-2 is the acceleration value a of the smart device collected by the acceleration sensor.
  • the smart device can acquire the acceleration value collected by the acceleration sensor from time t1 to time t1+0.5. That is, the data shown in the dashed box in Figure 3-2.
  • the capacitance value of the touch screen acquired by the smart device may include the capacitance value of each pixel on the display screen of the smart device.
  • 3-3 is a schematic diagram showing a plane distribution of capacitance values of respective pixel points on a touch screen according to an embodiment of the present invention, wherein an x-axis arrow direction may be a gate line scanning direction of the display screen, and a y-axis arrow direction may be a display.
  • the scanning direction of the data line of the screen, the plane where the x-axis and the y-axis are located may be the plane of the display screen or the touch screen of the smart device, and the depth of the color in the figure is used to indicate the size of the capacitance value, wherein the darker the color (ie, the more the filling pattern The smaller the area capacitance value is, the larger the capacitance value is in the area where the color is lighter.
  • Figure 3-4 is a schematic diagram of a three-dimensional distribution of capacitance values of pixels on a touch screen.
  • the direction of the x-axis arrow can be the raster scan direction of the smart device display screen
  • the direction of the y-axis arrow can be the display.
  • the data line scanning direction of the screen, the plane where the x-axis and the y-axis are located may be the plane of the display screen of the smart device or the touch screen, and the z-axis is used to indicate the magnitude of the capacitance value.
  • Step 104 The smart device determines whether the touch data satisfies a condition of finger joint touch.
  • step 105 When the touch data meets the condition of the knuckle touch, step 105 is performed; when the touch data does not satisfy the condition of the knuckle touch, step 106 is performed.
  • the condition of the knuckle touch includes: the capacitance value of the touch screen is within a preset capacitance range, the pressure value is within a preset pressure range, and the acceleration value is within a preset acceleration range.
  • the smart device may store a preset capacitance range, a preset pressure range, and a preset acceleration range, and the preset range may be obtained according to a machine learning algorithm.
  • the touch screen of the smart device can be subjected to multiple touch experiments, each time using a finger joint of the finger, other parts of the finger (such as a nail or a finger pad) or a stylus to touch the touch screen, and then detecting each touch After the operation, the touch screen has the size of the touch data such as the capacitance value, the pressure value and the acceleration value, and finally classifies and counts the touch data generated by the knuckle touch operation and the non-finger joint touch operation to determine each type of touch. Control the range of touch data generated by the operation.
  • the change waveforms of the acceleration generated by the smart device and the capacitance value of the touch screen of the smart device after the knuckle touch can be respectively shown in FIG. 3-2 and FIG. 3-4, FIG. 3-5 and FIG.
  • the change waveform of the acceleration generated by the smart device and the capacitance value distribution of the touch screen can be respectively used for the finger touch. Comparing Figure 3-2 with Figure 3-5, compared with the finger touch, the knuckle touch makes the acceleration value generated by the smart device change a lot, and the frequency of change is higher; compare Figure 3-4 and Figure 3-6 It can be seen that the touch panel has a larger capacitance value after receiving the knuckle touch than the finger touch. It can be seen that there is a certain difference between the touch data generated by different types of touch operations. According to the machine learning algorithm, the range of touch data generated by each type of touch operation can be accurately counted.
  • the range of the touch data is, for example, when the touch operation is finger joint touch, the capacitance value of the touch screen is in the range [C1, C2], and the pressure value generated by the touch control on the touch screen is The range is [P1, P2], and the knuckle touch operation causes the range of acceleration values generated by the smart device to be [A1, A2].
  • the finger joint touch condition can be: the capacitance value of the touch screen is within the preset capacitance range [C1, C2], the pressure value is within the preset pressure range [P1, P2], and the acceleration value is in advance. Set the acceleration range [A1, A2].
  • the preset capacitance range, the preset pressure range, and the acceleration range vary according to different internal structures of the smart device and types of sensors set in the smart device, so The preset capacitance range, the preset pressure range, and the specific numerical range of the acceleration range are not limited.
  • Step 105 The smart device determines that the type of the touch operation is finger joint touch. Go to step 107.
  • the smart device determines that the touch data meets the condition of the haptic touch, it can be determined that the type of the touch operation is knuckle touch.
  • the non-finger joint touch may include any one of a nail touch, a finger touch, and a stylus touch.
  • the touch data acquired by the smart device includes: a capacitance value C2, a pressure value p1, and an acceleration value A2, wherein p1 is greater than P1 and smaller than P2, the smart device may determine that the touch data satisfies the condition of the knuckle touch, and Determine the type of touch operation as finger joint touch.
  • Step 106 The smart device determines that the type of the touch operation is non-finger joint touch. Go to step 107.
  • the smart device may determine that the touch data does not satisfy the knuckle touch condition, and determine that the type of the touch operation is In addition, the smart device can further determine that the type of the touch operation is specifically a finger touch according to the range of the touch data shown in Table 1.
  • the smart device may further identify a specific type of non-finger joint touch according to the acquired touch data, that is, the smart device may recognize the nail touch according to the touch data. Finger touch and stylus touch.
  • the smart device can store the range of the touch data corresponding to the touch operation of different types as shown in Table 1, when the smart device acquires the touch data generated by the touch operation, The type of the touch operation can be directly determined according to the range in which the acquired touch data is located.
  • Step 107 The smart device performs an action indicated by the touch operation according to the coordinates of the touch point and the type of the touch operation.
  • the touch data acquired by the smart device may further include the coordinates of the touch point on the touch screen, and the touch screen may perform the touch operation on the touch screen.
  • the extremely current flows to the point of contact between the finger and the touch screen, so the smart device can calculate the coordinates of the contact point on the touch screen according to the proportion and intensity of the current emitted by the electrodes on the four sides.
  • the smart device may also record an action indicated by each type of touch operation.
  • the action indicated by the finger touch is an application corresponding to the application icon displayed at the touch touch point, and the knuckle touches the The indicated action is to take a screenshot of the display. Therefore, after the smart device determines the coordinates of the touch point and the type of the touch operation, the action indicated by the touch operation may be performed. For example, if the smart device recognizes that the received touch operation is the knuckle touch, Then, according to the knuckle touch, the display screen of the smart device may be screened, or the image of the touch point area to which the touch operation is applied may be screenshotd.
  • the smart device may further perform the touch data in the process of determining whether the touch data meets the condition of the knuckle touch. Processing, the processing specifically includes the following steps:
  • Step 1041 The smart device performs feature extraction on the capacitance value, the pressure value, and the acceleration value acquired in the preset time period, respectively, to obtain an eigenvalue of the capacitance value, an eigenvalue of the pressure value, and a characteristic value of the acceleration value.
  • the feature value may include at least one of a peak value, a mean value, a variance, an extreme point number, a change frequency, and a signal energy.
  • the smart device may separately calculate a peak value and a mean value of the touch screen capacitance value in the preset time period and a peak value of the pressure value in the preset time period for the acquired touch data. And the mean, as well as the peak and mean values of the acceleration values over a preset time period.
  • Step 1042 The smart device preprocesses the capacitance value, the pressure value, and the acceleration value acquired in the preset time period.
  • the pre-processing may include at least one of down sampling and filtering.
  • the capacitor value, the pressure value, and the acceleration value may be downsampled according to a preset downsampling frequency to reduce the amount of calculation, improve the processing efficiency of the data, and then filter the downsampled data (for example, Low-pass filtering or Gaussian filtering) to filter out noise in the touch data, and therefore, the pre-processing operation can improve efficiency and accuracy in identifying the type of touch operation according to the touch data.
  • Step 1043 The smart device performs feature extraction on the pre-processed capacitance value, the pressure value, and the acceleration value, respectively.
  • the smart device may further perform feature extraction on the pre-processed touch data to extract feature values of the pre-processed touch data. That is, in the embodiment of the present invention, the smart device may separately extract the feature values of the original touch data and the feature values of the pre-processed touch data, and combine the two types of feature values to perform the touch operation type. Identification to further improve the accuracy of recognition. Therefore, the condition of the knuckle touch referenced by the smart device when determining the type of the touch operation may further include: the feature value of the capacitance value is within a first preset range, and the feature value of the pressure value is in the second Within the preset range, and the characteristic value of the acceleration value is within the third preset range.
  • the first preset range, the second preset range, and the third preset range are also obtained according to a machine learning algorithm through a large amount of experimental data.
  • the touch screen of the smart device may be subjected to multiple touch experiments to detect touch data such as capacitance value, pressure value, and acceleration value of the touch screen after each touch operation.
  • touch data such as capacitance value, pressure value, and acceleration value of the touch screen after each touch operation.
  • the size of the touch data is then extracted from the touch data generated by the knuckle touch operation and the non-finger joint touch operation, and then the feature data is extracted after preprocessing the touch data, and finally the two types of feature values are obtained.
  • each of the first preset range, the second preset range, and the third preset range may include two sub-ranges, that is, a sub-range in which the feature values of the pre-processed touch data are located, and The sub-range in which the feature values of the touch data that have not been pre-processed are located.
  • the smart device may use an algorithm such as a decision tree or a random forest in the pattern recognition algorithm to identify the type of the touch operation according to the feature value of the touch data, which is not limited in the embodiment of the present invention.
  • an algorithm such as a decision tree or a random forest in the pattern recognition algorithm to identify the type of the touch operation according to the feature value of the touch data, which is not limited in the embodiment of the present invention.
  • the first preset range, the second preset range, and the third preset range are different according to different internal structures of the smart device and types of sensors set in the smart device. There are variations, so the specific numerical ranges of the first preset range, the second preset range, and the third preset range are not limited.
  • step 102 to step 107 may be implemented by the signal processing module 40 in the smart device shown in FIG. 1 or may be performed by the processor 201 in the identification device of the touch operation shown in FIG. 2 . achieve.
  • the embodiment of the present invention provides a method for recognizing a touch operation.
  • the smart device can acquire touch data generated by the touch operation, and according to The touch data identifies whether the type of the touch operation refers to the joint touch or the non-finger joint touch.
  • the recognition mode of the touch operation enables the user to control the smart device in different ways through different types of touch operations, thereby improving the flexibility of controlling the smart device through the touch operation.
  • the embodiment of the present invention provides a device for identifying a touch operation, which can be applied to a smart device.
  • the smart device includes a touch screen. As shown in FIG. 4, the device can include:
  • the receiving module 301 can be used to implement the method in step 101 in the embodiment shown in FIG. 3-1.
  • the acquiring module 302 is configured to acquire touch data generated by the touch operation, where the touch data includes: a capacitance value of the touch screen after receiving the touch operation, a pressure value generated by the touch operation on the touch screen, and the touch Controlling the acceleration value generated by the smart device.
  • the identification module 303 is configured to identify the type of the touch operation according to the touch data, and the type of the touch operation includes an knuckle touch or a non-finger joint touch.
  • the smart device is provided with a pressure sensor and an acceleration sensor
  • the touch data includes: a capacitance value of the touch screen, the pressure value, and the acceleration value
  • the identification module 303 is specifically configured to perform the implementation shown in FIG. 3-1. The method shown in steps 104 to 106 in the example.
  • the obtaining module 302 is further configured to implement the method in step 103 in the embodiment shown in FIG. 3-1.
  • the apparatus may further include:
  • the feature extraction module 304 can be used to implement the method shown in steps 1041 to 1043 in the embodiment shown in FIGS. 3-7.
  • the obtaining module 302 is further configured to implement the method in step 102 in the embodiment shown in FIG. 3-1.
  • the touch data further includes: coordinates of the touch point of the touch operation on the touch screen; and referring to FIG. 4, the device may further include:
  • the execution module 305 can be used to implement the method shown in step 107 in the embodiment shown in FIG. 3-1.
  • Each of the above modules may be implemented based on a device or a combination of a CPU, an FPGA, etc., and the specific method is a prior art (for example, the CPU reads the code of the memory to complete the functions of the modules), and details are not described herein.
  • the present application provides a touch operation identification device.
  • the smart device can acquire touch data generated by the touch operation, and identify the touch according to the touch data.
  • the type of operation refers to the joint touch or the non-finger joint touch.
  • the recognition method enriches the smart device's recognition method for the touch operation.
  • the user can control the smart device in different ways through different types of touch operations, thereby improving the flexibility of controlling the smart device through the touch operation.
  • the above embodiments it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof.
  • software it may be implemented in whole or in part in the form of a computer program product comprising one or more computer instructions.
  • the computer program instructions When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present invention are generated in whole or in part.
  • the computer can be a general purpose computer, a computer network, or other programmable device.
  • the computer instructions can be stored in a readable storage medium of a computer or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be from a website site, computer, server or data
  • the center transmits to another website site, computer, server, or data center by wire (eg, coaxial cable, fiber optic, digital subscriber line) or wireless (eg, infrared, wireless, microwave, etc.).
  • the computer readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or the like that includes one or more available media.
  • the usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium, or a semiconductor medium (eg, a solid state hard disk) or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

一种触控操作的识别方法及装置，属于电子技术领域。该方法可以应用于智能设备中，该智能设备包括触摸屏（10），该智能设备通过触摸屏（10）接收触控操作后，可以获取由该触控操作所产生的触摸数据，并根据该触摸数据，识别该触控操作的类型，该触控操作的类型包括指关节触控或者非指关节触控；其中，该触摸数据包括：接收到该触控操作后该触摸屏的电容值、该触控操作对该触摸屏产生的压力值和该触控操作使该智能设备产生的加速度值。相较于相关技术中只能识别触控操作所作用的接触点的位置，该方法丰富了智能设备对触控操作的识别方式，从而提高了通过触控操作对智能设备进行控制时的灵活性。

Description

触控操作的识别方法及装置
本申请要求于2016年9月5日提交中国专利局、申请号为201610809256.6、发明名称为“触控操作的识别方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及电子技术领域，特别涉及一种触控操作的识别方法及装置。
背景技术
随着科学技术的发展，越来越多的智能设备中开始采用触摸屏，使得用户可以方便的通过触控操作对智能设备进行控制。
相关技术中，当用户的手指靠近或者接触触摸屏的表面时，手指和触摸屏之间可以形成一个耦合电容，使得触摸屏四边的电极发出的电流流向手指与触摸屏的接触点，智能设备可以根据该四边的电极发出的电流的比例及强弱程度，计算出接触点在触摸屏上的位置，以便智能设备可以根据该接触点的位置执行相应的动作，例如启动触摸点处显示的应用图标所对应的应用程序。
但是，相关技术中的智能设备接收到触控操作后，只能对该触控操作作用的接触点的位置进行识别，对该触控操作的识别方式较为单一。
发明内容
为了解决相关技术中对触控操作的识别方式较为单一的问题，本申请提供了一种触控操作的识别方法及装置。所述技术方案如下：
第一方面，提供了一种触控操作的识别方法，该方法可以应用于智能设备中，该智能设备包括触摸屏，该方法包括：
智能设备通过该触摸屏接收触控操作后，获取由该触控操作所产生的触摸数据，该触摸数据可以包括：接收到该触控操作后该触摸屏的电容值、该触控操作对该触摸屏产生的压力值和该触控操作使该智能设备产生的加速度值；之后，智能设备可以根据该获取到的触摸数据，识别该触控操作的类型，该触控操作的类型可以包括指关节触控或者非指关节触控。
本发明实施例所示的方案，由于智能设备可以根据获取到的触摸数据，识别该触控操作的类型是指关节触控还是非指关节触控，因此丰富了智能设备对触控操作的识别方式，使得用户可以通过不同类型的触控操作对智能设备进行不同方式的触控，从而提高了用户通过触控操作对智能设备进行控制时的灵活性。
可选的，根据该触摸数据，识别该触控操作的类型，包括：判断该触摸数据是否满足指关节触控的条件；当该触摸数据满足指关节触控的条件时，确定该触控操作的类型为指关节触控；当该触摸数据不满足指关节触控的条件时，确定该触控操作的类型为非指关节 触控；其中，该指关节触控的条件可以包括：该触摸屏的电容值处于预设电容范围内，该压力值处于预设压力范围内，且该加速度值处于预设加速度范围内。
智能设备所获取的触摸数据不仅包括触摸屏的电容值，还包括压力传感器检测到的压力值以及加速度传感器检测到的加速度值，该触摸数据的类型较为丰富，因此根据该触摸数据识别触控操作的类型时的准确度较高。
可选的，智能设备获取由该触控操作所产生的触摸数据，具体可以包括：获取在接收到该触控操作后，预设时间段内的触摸数据；在该识别该触控操作的类型之前，该方法还包括：分别对该预设时间段内获取到的电容值、压力值和加速度值进行特征提取，得到该电容值的特征值、该压力值的特征值和该加速度值的特征值；该指关节触控的条件还包括：该电容值的特征值处于第一预设范围内，该压力值的特征值处于第二预设范围内，且该加速度值的特征值处于第三预设范围内。其中，该智能设备提取的特征值可以包括：峰值、均值、方差、极值点数量、变化频率和信号能量中的至少一种。
由于对触摸数据进行特征提取后，能够提取出该触摸数据中的有效信息，去除该触摸数据中的冗余信息，因此根据该提取的特征值对触控操作的类型进行识别时的效率和准确率较高。
可选的，智能设备分别对该预设时间段内获取的电容值、压力值和加速度值进行特征提取的过程具体可以包括：
分别对该预设时间段内获取的电容值、压力值和加速度值进行预处理；分别对预处理后的该电容值、该压力值和该加速度值进行特征提取；其中，该预处理包括降采样和滤波中的至少一种。降采样和滤波后再进行特征提取，可以滤除原始触摸数据中的噪声，还可以降低特征提取时的计算量。
可选的，获取由该触控操作所产生的触摸数据的具体过程可以包括：
判断在接收到该触控操作后，该触摸屏的电容值的变化量是否处于预设变化范围内；当该变化量处于预设变化范围内时，获取由该触控操作所产生的触摸数据。只有当触摸屏的电容值的变化量处于预设变化范围内时，智能设备才触发对该触控操作进行识别的流程，降低了误触发的概率，避免误触发占用过多内存资源。
可选的，该触摸数据还包括：该触控操作作用在该触摸屏上的触摸点的坐标；在该根据该触摸数据，识别该触控操作的类型之后，该方法还可以包括：根据该触摸点的坐标以及该触控操作的类型，执行该触控操作所指示的动作。
可选的，该非指关节触控可以包括指甲触控、指腹触控和触控笔触控中的任一种。
本发明实施例所示的方案，智能设备不仅可以识别出触控操作所作用的触摸点的位置，还可以识别出该触控操作的具体类型，因此丰富了智能设备对该触控操作的识别方式，使得用户可以通过不同类型的触控操作对智能设备进行不同方式的控制，从而提高了通过触控操作对智能设备进行控制时的灵活性。
第二方面，本申请提供了一种触控操作的识别装置，该装置可以应用于智能设备中，该智能设备包括触摸屏，该触控操作的识别装置包括至少一个模块，该至少一个模块用于实现上述第一方面所提供的触控操作的识别方法。
第三方面，提供了另一种触控操作的识别装置，该装置可以包括：处理器，存储器和总线；该总线用于连接该处理器和该存储器，该处理器用于执行该存储器中存储的程序，该程序可以包括第一方面所提供的触控操作的识别方法。
第四方面，提供了一种计算机可读存储介质，该计算机可读存储介质中存储有指令，当该计算机可读存储介质在计算机上运行时，使得计算机执行上述第一方面所提供的触控操作的识别方法。
第五方面，提供了一种包含指令的计算机程序产品，当该计算机程序产品在计算机上运行时，使得计算机执行上述第一方面所提供的触控操作的识别方法。
上述本发明实施例第二到第五方面所获得的技术效果与第一方面中对应的技术手段所获得的技术效果近似，在这里不再赘述。
综上所述，本发明实施例提供的技术方案带来的有益效果是：
智能设备在接收到触控操作后，可以获取由该触控操作所产生的触摸数据，并根据该触摸数据识别该触控操作的类型是指关节触控还是非指关节触控，相较于相关技术中只能识别触控操作所作用的接触点的位置，该识别方法丰富了智能设备对触控操作的识别方式，使得用户可以通过不同类型的触控操作对智能设备进行不同方式的控制，从而提高了通过触控操作对智能设备进行控制时的灵活性。
附图说明
图1是本发明实施例提供的一种智能设备的架构图；
图2是本发明实施例提供的一种触控操作的识别装置的结构示意图；
图3-1是本发明实施例提供的一种触控操作的识别方法的流程图；
图3-2是本发明实施例提供的一种智能设备的加速度值的波形图；
图3-3为本发明实施例提供的一种触摸屏的电容值的分布示意图；
图3-4是本发明实施例提供的另一种触摸屏的电容值的分布示意图；
图3-5是本发明实施例提供的另一种智能设备的加速度值的波形图；
图3-6是本发明实施例提供的又一种触摸屏的电容值的分布示意图；
图3-7是本发明实施例提供的一种智能设备对触摸数据进行处理的方法流程图；
图4是本发明实施例提供的另一种触控操作的识别装置的结构示意图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚，下面将结合附图对本申请实施方式作进一步地详细描述。
图1是本发明实施例提供的一种智能设备的架构图，如图1所示，该智能设备可以包括触摸屏10、设置在该触摸屏10远离显示平面一侧的压力传感器20、设置在该智能设备中的加速度传感器30以及信号处理模块40。其中触摸屏10用于接收用户的触控操作，压力传感器20用于检测作用在该触摸屏10上的压力值，该加速度传感器30用于检测该智能 设备的加速度值，该信号处理模块40能够获取该触摸屏的电容值、该压力值以及该加速度值等触摸数据，并根据该触摸数据对触控操作的类型进行识别。
请参考图2，其示出了本申请示例性实施例涉及的一种触控操作的识别装置的结构示意图。该装置可以应用于图1所示的智能设备中。如图2所示，该触控操作的识别装置可以包括：至少一个处理器201(例如CPU)，至少一个网络接口202或者其他通信接口，存储器203和至少一个通信总线204，该通信总线204用于实现这些装置之间的连接通信。处理器201用于执行存储器203中存储的可执行模块，例如计算机程序，并且该处理器201的功能与图1中信号处理模块40的功能相同或相似。存储器203可能包含高速随机存取存储器(RAM：RandomAccess Memory)，也可能还包括非不稳定的存储器(non-volatile memory)，例如至少一个磁盘存储器。通过至少一个网络接口202(可以是有线或者无线)实现该智能设备与至少一个其他网元之间的通信连接，例如可以使用互联网，广域网，本地网，城域网等。
在一些实施方式中，存储器203存储了程序2031，处理器201可以执行该程序2031来实现下述触控操作的识别方法。
本发明实施例提供了一种触控操作的识别方法，该方法可以应用于图1所示的智能设备中，参考图3-1，该方法可以包括：
步骤101、智能设备通过触摸屏接收触控操作。执行步骤102。
在本发明实施例中，该触摸屏可以为电容屏，当用户通过手指的指腹、指甲或者指关节等部位接近、触摸或者敲击该电容屏时，该智能设备可以通过该电容屏接收到该触控操作。
步骤102、智能设备判断在接收到该触控操作后，该触摸屏的电容值的变化量是否处于预设变化范围内。
当该变化量处于预设变化范围内时，执行步骤103；当该变化量不处于预设变化范围内时，结束对该触控操作的识别流程。
智能设备通过触摸屏接收到触控操作后，由于人体和触摸屏之间可以形成耦合电容，从而使得电容屏的电容值发生变化，在本发明实施例中，为了避免误触发，智能设备中可以预先设置有触发门限值(即该预设变化范围)，智能设备检测到触摸屏的电容值发生变化时，可以判断该变化量是否处于该预设变化范围，若处于该预设变化范围，则执行步骤103，即开始对该触控操作的类型进行识别；若该变化量不处于该预设变化范围，则智能设备可以确定该触控操作为误操作，并结束对该触控操作的识别流程，从而有效降低了智能设备对误操作进行误识别的概率，避免对该误操作的误识别占用过多的内存资源。
在实际应用中，该预设变化范围可以根据该智能设备的实际应用场景、智能设备的实体结构以及该触摸屏的类型进行设置，本发明实施例对该预设变化范围的具体范围不做限定。
步骤103、智能设备获取在接收到该触控操作后，预设时间段内的触摸数据。执行步骤104。
该触摸数据可以包括：接收到该触控操作后该触摸屏的电容值、该触控操作对该触摸 屏产生的压力值和该触控操作使该智能设备产生的加速度值。
参考图1可知，由于该智能设备中可以设置有压力传感器和加速度传感器，因此该智能设备可以通过该压力传感器获取该触控操作对触摸屏产生的压力值，并通过该加速度传感器获取该触控操作使该智能设备产生的加速度值。此外，由于触控操作所产生的触摸数据并不是固定不变的，而是随着时间变化的，因此，为了提高根据该触摸数据对该触控操作进行识别时的识别精度，该智能设备可以获取在接收到该触控操作后，预设时间段内的触摸数据，该预设时间段可以为该智能设备中预先设置好的检测时长。
示例的，假设该检测时长为0.5秒，则该智能设备可以获取接收到该触控操作后，0.5秒内的触摸数据，图3-2为加速度传感器所采集到的智能设备的加速度值a随时间t变化的曲线图，参考图3-2，若该智能设备在t1时刻接收到触控操作，则该智能设备可以获取t1时刻至t1+0.5时刻内，加速度传感器所采集到的加速度值，也即是，图3-2中虚线框内所示的数据。
需要说明的是，在本发明实施例中，该智能设备所获取的触摸屏的电容值可以包括智能设备显示屏上每个像素点的电容值。图3-3为本发明实施例提供的一种触摸屏上各个像素点的电容值的平面分布示意图，其中，x轴箭头方向可以为该显示屏的栅线扫描方向，y轴箭头方向可以为显示屏的数据线扫描方向，该x轴和y轴所在平面可以为该智能设备的显示屏或者触摸屏的平面，图中颜色的深浅用于指示电容值的大小，其中颜色越深(即填充图案越密集)的区域电容值越小，颜色越浅的区域的电容值越大。图3-4为一种触摸屏上各像素点的电容值的立体分布示意图，图3-4中，x轴箭头方向可以为智能设备显示屏的栅线扫描方向，y轴箭头方向可以为该显示屏的数据线扫描方向，x轴和y轴所在平面可以为该智能设备的显示屏或者触摸屏的平面，z轴用于指示电容值的大小。
步骤104、智能设备判断该触摸数据是否满足指关节触控的条件。
当该触摸数据满足指关节触控的条件时，执行步骤105；当该触摸数据不满足指关节触控的条件时，执行步骤106。其中，该指关节触控的条件包括：该触摸屏的电容值处于预设电容范围内，该压力值处于预设压力范围内，且该加速度值处于预设加速度范围内。
在本发明实施例中，该智能设备中可以存储有预设电容范围、预设压力范围和预设加速度范围，上述预设范围可以是根据机器学习算法得到的。例如，可以对智能设备的触摸屏进行多次触控实验，每次分别采用手指的指关节、手指的其他部位(例如指甲或指腹)或者触控笔对触摸屏进行触摸，然后检测每次触控操作后，触摸屏的电容值、压力值以及加速度值等触摸数据的大小，最后对指关节触控操作和非指关节触控操作所产生的触摸数据进行分类和统计，确定出每种类型的触控操作所产生的触摸数据所处的范围。
示例的，图3-2和图3-4所示的可以分别为指关节触控使智能设备产生的加速度的变化波形以及指关节触控后智能设备触摸屏的电容值分布，图3-5和图3-6所示的可以分别为指腹触控使智能设备产生的加速度的变化波形以及触摸屏的电容值分布。对比图3-2和图3-5可知，相较于指腹触控，指关节触控使智能设备产生的加速度值的变化幅度较大，变化的频率较高；对比图3-4和图3-6可知，相较于指腹触控，接收到指关节触控后，触摸屏的电容值较大。由此可知，不同类型的触控操作所产生的触摸数据之间存在一定差异，根据机器学习算法，可以较为准确的统计出每种类型的触控操作所产生的触摸数据所处的范围。
在本发明实施例中，该智能设备中可以存储有如表1所示的不同类型的触控操作所对 应的触摸数据所处的范围，例如，触控操作为指关节触控时，触摸屏的电容值所处的范围为[C1，C2]，该指关节触控操作对触摸屏所产生的压力值的范围为[P1，P2]，该指关节触控操作使智能设备所产生的加速度值的范围为[A1，A2]。根据表1可知，该指关节触控的条件可以为：触摸屏的电容值处于预设电容范围[C1，C2]内，压力值处于预设压力范围[P1，P2]内，且加速度值处于预设加速度范围[A1，A2]内。
表1
Figure PCTCN2017100275-appb-000001
需要说明的是，在实际应用中，该预设电容范围、预设压力范围以及该加速度范围，根据智能设备的内部结构的不同以及智能设备中设置的各传感器的类型的不同而有变化，因此对该预设电容范围、预设压力范围以及该加速度范围的具体数值范围不做限定。
步骤105、智能设备确定该触控操作的类型为指关节触控。执行步骤107。
当智能设备判断出该触摸数据满足指关节触控的条件时，则可以确定该触控操作的类型为指关节触控。其中，该非指关节触控可以包括指甲触控、指腹触控和触控笔触控中的任一种。示例的，若智能设备获取的触摸数据包括：电容值C2，压力值p1和加速度值A2，其中p1大于P1且小于P2，则该智能设备可以确定该触摸数据满足指关节触控的条件，并确定该触控操作的类型为指关节触控。
步骤106、智能设备确定该触控操作的类型为非指关节触控。执行步骤107。
当该触摸数据不满足指关节触控的条件时，确定该触控操作的类型为非指关节触控。示例的，若智能设备获取的触摸数据包括：电容值C3，压力值P3和加速度值A3，则该智能设备可以确定该触摸数据不满足指关节触控条件，并确定该触控操作的类型为非指关节触控，此外，该智能设备还可以根据表1所示的触摸数据所处的范围，进一步确定该触控操作的类型具体为指腹触控。
需要说明的是，在本发明实施例中，该智能设备根据获取的触摸数据还可以进一步识别非指关节触控的具体类型，也即是，该智能设备可以根据触摸数据识别出指甲触控、指腹触控和触控笔触控等。
需要说明的是，由于智能设备中可以存储有如表1所示的，不同类型的触控操作所对应的触摸数据所处的范围，因此当智能设备获取到触控操作所产生的触摸数据后，可以根据该获取的触摸数据所处的范围，直接确定该触控操作的类型。
步骤107、智能设备根据触摸点的坐标以及该触控操作的类型，执行该触控操作所指示的动作。
在本发明实施例中，该智能设备所获取的触摸数据中还可以包括该触控操作作用在该触摸屏上的触摸点的坐标，由于用户对触摸屏执行触控操作时，可以使得触摸屏四边的电 极发出的电流流向手指与触摸屏的接触点，因此智能设备可以根据该四边的电极发出的电流的比例及强弱程度，计算出接触点在触摸屏上的坐标。
该智能设备中还可以记录有每种类型的触控操作所指示的动作，例如，指腹触控所指示的动作为启动触摸点处所显示的应用图标对应的应用程序，指关节触控所述指示的动作为对显示屏进行截屏。因此，智能设备确定触摸点的坐标以及该触控操作的类型后，即可执行该触控操作所指示的动作，示例的，若智能设备识别出接收到的触控操作为指关节触控，则可以根据该指关节触控，对智能设备的显示屏进行截屏，或者对该触控操作所作用的触摸点区域的图像进行截图。
在本申请另一种可选的实施例中，参考图3-7，上述步骤104中，智能设备判断该触摸数据是否满足指关节触控的条件的过程中，还可以对该触摸数据进行进一步的处理，该处理过程具体包括以下步骤：
步骤1041、智能设备分别对该预设时间段内获取到的电容值、压力值和加速度值进行特征提取，得到该电容值的特征值、该压力值的特征值和该加速度值的特征值。
其中，该特征值可以包括：峰值、均值、方差、极值点数量、变化频率和信号能量中的至少一种。由于对触摸数据进行特征提取后，能够提取出该触摸数据中的有效信息，去除冗余信息，该提取的特征值能够较好的反映出触摸数据的特点，因此智能设备根据提取的特征值对触控操作的类型进行识别，可以提高对触控操作的类型进行识别时的效率和准确率。
示例的，假设该提取的特征值包括峰值和均值，则对于获取到的触摸数据，该智能设备可以分别计算预设时间段内触摸屏电容值的峰值和均值、预设时间段内压力值的峰值和均值，以及预设时间段内加速度值的峰值和均值。
步骤1042、智能设备分别对该预设时间段内获取的电容值、压力值和加速度值进行预处理。
在本发明实施例中，该预处理可以包括降采样和滤波中的至少一种。例如，可以按照预设的降采样频率，分别对该电容值、压力值和加速度值进行降采样，以减少计算量，提高数据的处理效率，然后再对降采样后的数据进行滤波(例如，低通滤波或者高斯滤波)，以滤除该触摸数据中的噪声，因此，通过该预处理操作可以提高根据触摸数据识别触控操作的类型时的效率和准确率。
步骤1043、智能设备分别对预处理后的该电容值、该压力值和该加速度值进行特征提取。
进一步的，智能设备还可以对预处理后的触摸数据进行特征提取，以提取该预处理后的触摸数据的特征值。也即是，在本发明实施例中，该智能设备可以分别提取原始触摸数据的特征值，以及经过预处理后的触摸数据的特征值，并综合该两种类型的特征值进行触控操作类型的识别，以进一步提高识别的准确率。因此，此时智能设备确定该触控操作的类型时所参考的指关节触控的条件还可以包括：该电容值的特征值处于第一预设范围内，该压力值的特征值处于第二预设范围内，且该加速度值的特征值处于第三预设范围内。
其中，该第一预设范围、第二预设范围和第三预设范围也是根据机器学习的算法，通过大量实验数据，统计得到的。示例的，参考上述步骤104，可以对智能设备的触摸屏进行多次触控实验，检测每次触控操作后，触摸屏的电容值、压力值以及加速度值等触摸数据 的大小，然后先对指关节触控操作和非指关节触控操作所产生的触摸数据进行特征提取，之后在对该触摸数据进行预处理后再进行特征提取，最后对两种类型的特征值进行分类和统计，确定出每种类型的触控操作所对应的特征值(包括预处理后的触摸数据的特征值以及未经过预处理的触摸数据的特征值)所处的范围。因此，该第一预设范围、第二预设范围和第三预设范围中的每个预设范围可以包括两个子范围，即预处理后的触摸数据的特征值所处的子范围，以及未经过预处理的触摸数据的特征值所处的子范围。
在实际应用中，智能设备根据触摸数据的特征值识别触控操作的类型时具体可以采用模式识别算法中的决策树或随机森林等算法，本发明实施例对此不做限定。
需要说明的是，在实际应用中，该第一预设范围、第二预设范围和第三预设范围，根据智能设备的内部结构的不同以及智能设备中设置的各传感器的类型的不同而有变化，因此对该第一预设范围、第二预设范围和第三预设范围的具体数值范围不做限定。
上述步骤102至步骤107所示的方法具体可以由图1所示的智能设备中的信号处理模块40来实现，或者，可以由图2所示的触控操作的识别装置中的处理器201来实现。
还需要说明的是，本发明实施例提供的触控操作的识别方法的步骤的先后顺序可以进行适当调整，步骤也可以根据情况进行相应增减，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化的方法，都应涵盖在本申请的保护范围之内，因此不再赘述。
综上所述，本发明实施例提供了一种触控操作的识别方法，在该方法中，智能设备在接收到触控操作后，可以获取由该触控操作所产生的触摸数据，并根据该触摸数据识别该触控操作的类型是指关节触控还是非指关节触控，相较于相关技术中只能识别触控操作所作用的接触点的位置，该识别方法丰富了智能设备对触控操作的识别方式，使得用户可以通过不同类型的触控操作对智能设备进行不同方式的控制，从而提高了通过触控操作对智能设备进行控制时的灵活性。
本发明实施例提供了一种触控操作的识别装置，该装置可以应用于智能设备中，该智能设备包括触摸屏，如图4所示，该装置可以包括：
接收模块301，可以用于实现图3-1所示实施例中步骤101中的方法。
获取模块302，用于获取由该触控操作所产生的触摸数据，该触摸数据包括：接收到该触控操作后该触摸屏的电容值、该触控操作对该触摸屏产生的压力值和该触控操作使该智能设备产生的加速度值。
识别模块303，用于根据该触摸数据，识别该触控操作的类型，该触控操作的类型包括指关节触控或者非指关节触控。
可选的，该智能设备中设置有压力传感器和加速度传感器，该触摸数据包括：该触摸屏的电容值、该压力值和该加速度值；该识别模块303具体用于执行图3-1所示实施例中步骤104至步骤106所示的方法。
可选的，该获取模块302还可以用于实现图3-1所示实施例中步骤103中的方法。参考图4，该装置还可以包括：
特征提取模块304，可以用于实现图3-7所示实施例中步骤1041至步骤1043所示的方法。
可选的，该获取模块302还可以用于实现图3-1所示实施例中步骤102中的方法。
进一步的，该触摸数据还包括：该触控操作作用在该触摸屏上的触摸点的坐标；参考图4，该装置还可以包括：
执行模块305，可以用于实现图3-1所示实施例中步骤107所示的方法。
上述各个模块可以基于CPU、FPGA等器件或组合来实现，具体方法为现有技术(例如，CPU读取存储器的代码来完成这些模块具有的功能)，这里不进行赘述。
综上所述，本申请提供了一种触控操作的识别装置，智能设备在接收到触控操作后，可以获取由该触控操作所产生的触摸数据，并根据该触摸数据识别该触控操作的类型是指关节触控还是非指关节触控，相较于相关技术中只能识别触控操作所作用的接触点的位置，该识别方法丰富了智能设备对触控操作的识别方式，使得用户可以通过不同类型的触控操作对智能设备进行不同方式的控制，从而提高了通过触控操作对智能设备进行控制时的灵活性。
在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现，所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本发明实施例所述的流程或功能。所述计算机可以是通用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机的可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质(例如，软盘、硬盘、磁带)、光介质，或者半导体介质(例如固态硬盘)等。
以上所述仅为本申请的可选实施例，并不用以限制本申请，凡在本申请的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本申请的保护范围之内。

Claims (14)

  1. 一种触控操作的识别方法，其特征在于，应用于智能设备中，所述智能设备包括触摸屏，所述方法包括：
    通过所述触摸屏接收触控操作；
    获取由所述触控操作所产生的触摸数据，所述触摸数据包括：接收到所述触控操作后所述触摸屏的电容值、所述触控操作对所述触摸屏产生的压力值和所述触控操作使所述智能设备产生的加速度值；
    根据所述触摸数据，识别所述触控操作的类型，所述触控操作的类型包括指关节触控或者非指关节触控。
  2. 根据权利要求1所述的方法，其特征在于，所述根据所述触摸数据，识别所述触控操作的类型，包括：
    判断所述触摸数据是否满足指关节触控的条件；
    当所述触摸数据满足指关节触控的条件时，确定所述触控操作的类型为指关节触控；
    当所述触摸数据不满足指关节触控的条件时，确定所述触控操作的类型为非指关节触控；
    其中，所述指关节触控的条件包括：所述触摸屏的电容值处于预设电容范围内，所述压力值处于预设压力范围内，且所述加速度值处于预设加速度范围内。
  3. 根据权利要求2所述的方法，其特征在于，所述获取由所述触控操作所产生的触摸数据，包括：
    获取在接收到所述触控操作后，预设时间段内的触摸数据；
    在所述识别所述触控操作的类型之前，所述方法还包括：
    分别对所述预设时间段内获取到的电容值、压力值和加速度值进行特征提取，得到所述电容值的特征值、所述压力值的特征值和所述加速度值的特征值；
    所述指关节触控的条件还包括：
    所述电容值的特征值处于第一预设范围内，所述压力值的特征值处于第二预设范围内，且所述加速度值的特征值处于第三预设范围内。
  4. 根据权利要求3所述的方法，其特征在于，所述分别对所述预设时间段内获取的电容值、压力值和加速度值进行特征提取，包括：
    分别对所述预设时间段内获取的电容值、压力值和加速度值进行预处理；
    分别对预处理后的所述电容值、所述压力值和所述加速度值进行特征提取；
    其中，所述预处理包括降采样和滤波中的至少一种。
  5. 根据权利要求1所述的方法，其特征在于，所述获取由所述触控操作所产生的触摸数据，包括：
    判断在接收到所述触控操作后，所述触摸屏的电容值的变化量是否处于预设变化范围内；
    当所述变化量处于预设变化范围内时，获取由所述触控操作所产生的触摸数据。
  6. 根据权利要求1至5任一所述的方法，其特征在于，所述触摸数据还包括：
    所述触控操作作用在所述触摸屏上的触摸点的坐标；
    在所述根据所述触摸数据，识别所述触控操作的类型之后，所述方法还包括：
    根据所述触摸点的坐标以及所述触控操作的类型，执行所述触控操作所指示的动作。
  7. 一种触控操作的识别装置，其特征在于，应用于智能设备中，所述智能设备包括触摸屏，所述装置包括：
    接收模块，用于通过所述触摸屏接收触控操作；
    获取模块，用于获取由所述触控操作所产生的触摸数据，所述触摸数据包括：接收到所述触控操作后所述触摸屏的电容值、所述触控操作对所述触摸屏产生的压力值和所述触控操作使所述智能设备产生的加速度值；
    识别模块，用于根据所述触摸数据，识别所述触控操作的类型，所述触控操作的类型包括指关节触控或者非指关节触控。
  8. 根据权利要求7所述的装置，其特征在于，所述智能设备中设置有压力传感器和加速度传感器；所述识别模块，还用于：
    判断所述触摸数据是否满足指关节触控的条件；
    当所述触摸数据满足指关节触控的条件时，确定所述触控操作的类型为指关节触控；
    当所述触摸数据不满足指关节触控的条件时，确定所述触控操作的类型为非指关节触控；
    其中，所述指关节触控的条件包括：所述触摸屏的电容值处于预设电容范围内，所述压力值处于预设压力范围内，且所述加速度值处于预设加速度范围内。
  9. 根据权利要求8所述的装置，其特征在于，所述获取模块，还用于：
    获取在接收到所述触控操作后，预设时间段内的触摸数据；
    所述装置还包括：
    特征提取模块，用于分别对所述预设时间段内获取到的电容值、压力值和加速度值进行特征提取，得到所述电容值的特征值、所述压力值的特征值和所述加速度值的特征值；
    所述指关节触控的条件还包括：
    所述电容值的特征值处于第一预设范围内，所述压力值的特征值处于第二预设范围内，且所述加速度值的特征值处于第三预设范围内。
  10. 根据权利要求9所述的装置，其特征在于，所述特征提取模块，还用于：
    分别对所述预设时间段内获取的电容值、压力值和加速度值进行预处理；
    分别对预处理后的所述电容值、所述压力值和所述加速度值进行特征提取；
    其中，所述预处理包括降采样和滤波中的至少一种。
  11. 根据权利要求7所述的装置，其特征在于，所述获取模块，还用于：
    判断在接收到所述触控操作后，所述触摸屏的电容值的变化量是否处于预设变化范围内；
    当所述变化量处于预设变化范围内时，获取由所述触控操作所产生的触摸数据。
  12. 根据权利要求7至11任一所述的装置，其特征在于，所述触摸数据还包括：所述触控操作作用在所述触摸屏上的触摸点的坐标；
    所述装置还包括：
    执行模块，用于根据所述触摸点的坐标以及所述触控操作的类型，执行所述触控操作所指示的动作。
  13. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储有指令，当所述计算机可读存储介质在计算机上运行时，使得计算机执行权利要求1至6任一所述的触控操作的识别方法。
  14. 一种包含指令的计算机程序产品，其特征在于，当所述计算机程序产品在计算机上运行时，使得计算机执行权利要求1至6任一所述的触控操作的识别方法。
PCT/CN2017/100275 2016-09-05 2017-09-01 触控操作的识别方法及装置 WO2018041250A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610809256.6 2016-09-05
CN201610809256.6A CN106445120A (zh) 2016-09-05 2016-09-05 触控操作的识别方法及装置

Publications (1)

Publication Number Publication Date
WO2018041250A1 true WO2018041250A1 (zh) 2018-03-08

Family

ID=58165460

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/100275 WO2018041250A1 (zh) 2016-09-05 2017-09-01 触控操作的识别方法及装置

Country Status (2)

Country Link
CN (1) CN106445120A (zh)
WO (1) WO2018041250A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111665985A (zh) * 2020-05-29 2020-09-15 西安芯海微电子科技有限公司 触控采样控制方法、装置、终端和存储介质

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106445120A (zh) * 2016-09-05 2017-02-22 华为技术有限公司 触控操作的识别方法及装置
CN109907850B (zh) * 2017-12-13 2021-08-27 东莞市沃伦电子科技有限公司 可水洗触摸控制的护理装置
CN110617914B (zh) * 2019-08-30 2022-01-11 华为技术有限公司 一种压电传感器的信号校正方法及电子设备
CN112286392A (zh) * 2020-10-29 2021-01-29 北京小米移动软件有限公司 触控屏的触控检测方法及装置、存储介质
CN112434594A (zh) * 2020-11-19 2021-03-02 维沃移动通信有限公司 手套佩戴检测方法、装置、手套及可读存储介质
CN112445410B (zh) * 2020-12-07 2023-04-18 北京小米移动软件有限公司 触控事件识别方法、装置及计算机可读存储介质
CN112445405B (zh) * 2020-12-10 2022-06-03 北京小米移动软件有限公司 触发操作的类型检测方法及装置、电子设备、存储介质
CN114911401B (zh) * 2021-02-08 2024-06-25 华为技术有限公司 电子设备及其触摸操作的分析方法和可读介质
CN113919390A (zh) * 2021-09-29 2022-01-11 华为技术有限公司 一种识别触摸操作的方法及电子设备
CN117389454A (zh) * 2022-07-01 2024-01-12 荣耀终端有限公司 指关节操作的识别方法及电子设备
CN116737290A (zh) * 2022-09-30 2023-09-12 荣耀终端有限公司 指关节敲击事件的识别方法及电子设备
CN117991919A (zh) * 2022-10-31 2024-05-07 广州视源电子科技股份有限公司 触控物识别方法、触控设备及存储介质
CN116225274A (zh) * 2023-04-28 2023-06-06 荣耀终端有限公司 触控操作的识别方法、装置、电子设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104049728A (zh) * 2013-03-15 2014-09-17 Lg电子株式会社 电子设备及其控制方法
US20160026320A1 (en) * 2013-03-25 2016-01-28 Qeexo, Co. Method and apparatus for classifying finger touch events on a touchscreen
CN105320436A (zh) * 2015-07-07 2016-02-10 崔景城 一种以手指关节敲击屏幕来触发截屏的方法
CN105630239A (zh) * 2015-12-24 2016-06-01 小米科技有限责任公司 操作检测方法及装置
CN106445120A (zh) * 2016-09-05 2017-02-22 华为技术有限公司 触控操作的识别方法及装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100677613B1 (ko) * 2005-09-09 2007-02-02 삼성전자주식회사 멀티미디어 기기의 동작을 제어하는 방법 및 그 장치
JP4941450B2 (ja) * 2008-10-20 2012-05-30 パナソニック株式会社 入力装置および入力方法
CN103258171B (zh) * 2012-02-20 2016-03-02 中国移动通信集团公司 防止移动终端触摸屏误触控的方法、装置以及移动终端
CN102945097A (zh) * 2012-11-22 2013-02-27 广东欧珀移动通信有限公司 触摸屏防干扰的方法及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104049728A (zh) * 2013-03-15 2014-09-17 Lg电子株式会社 电子设备及其控制方法
US20160026320A1 (en) * 2013-03-25 2016-01-28 Qeexo, Co. Method and apparatus for classifying finger touch events on a touchscreen
CN105320436A (zh) * 2015-07-07 2016-02-10 崔景城 一种以手指关节敲击屏幕来触发截屏的方法
CN105630239A (zh) * 2015-12-24 2016-06-01 小米科技有限责任公司 操作检测方法及装置
CN106445120A (zh) * 2016-09-05 2017-02-22 华为技术有限公司 触控操作的识别方法及装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111665985A (zh) * 2020-05-29 2020-09-15 西安芯海微电子科技有限公司 触控采样控制方法、装置、终端和存储介质
CN111665985B (zh) * 2020-05-29 2024-04-12 西安芯海微电子科技有限公司 触控采样控制方法、装置、终端和存储介质

Also Published As

Publication number Publication date
CN106445120A (zh) 2017-02-22

Similar Documents

Publication Publication Date Title
WO2018041250A1 (zh) 触控操作的识别方法及装置
JP6337156B2 (ja) 静電容量プロフィールを使用するバイオメトリックをベースにしたセキュリティのための方法および装置
KR102118408B1 (ko) 터치 감지 디바이스에서 터치 동작을 수행하는 방법
JP5520336B2 (ja) タッチパネルの縁部把持検知方法およびそのタッチパネルの縁部把持検知方法に関するデバイス
JP5709228B2 (ja) 情報処理装置、情報処理方法及びプログラム
US20160062456A1 (en) Method and apparatus for live user recognition
US10126858B2 (en) Touch display device and touch method thereof
WO2018082011A1 (zh) 活体指纹识别方法及装置
JP2013531305A (ja) タッチイベントの判定方法およびタッチ感応装置
WO2020156033A1 (zh) 指纹验证方法及相关装置
CN105303174B (zh) 指纹录入方法及装置
US20170371485A1 (en) Stroke continuation for dropped touches on electronic handwriting devices
US9158381B2 (en) Multi-resolution gesture recognition
US20190332858A1 (en) Method and device for identifying wrist, method for identifying gesture, electronic equipment and computer-readable storage medium
TW201608485A (zh) 電容式觸控裝置及其物件辨識方法
CN112906563A (zh) 一种动态手势识别方法、装置、系统及可读存储介质
KR102065912B1 (ko) 압력 감지를 이용한 사용자 인증 영상 획득 장치 및 방법
KR101281461B1 (ko) 영상분석을 이용한 멀티 터치 입력 방법 및 시스템
WO2016145827A1 (zh) 终端的控制方法及装置
WO2016082215A1 (zh) 一种移动屏幕界面的方法及终端
TW201911113A (zh) 指紋辨識裝置、方法及電腦程式產品
CN103227864A (zh) 一种检测图像边缘的方法和移动终端
Dehankar et al. Using AEPI method for hand gesture recognition in varying background and blurred images
TW201248456A (en) Identifying contacts and contact attributes in touch sensor data using spatial and temporal features
JP2021034016A (ja) 電子装置、該電子装置で指紋映像を処理する方法、及び記録媒体

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17845552

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17845552

Country of ref document: EP

Kind code of ref document: A1