WO2018209865A1 - 多点触摸的手势识别方法、装置、触摸屏终端及存储介质 - Google Patents

多点触摸的手势识别方法、装置、触摸屏终端及存储介质 Download PDF

Info

Publication number
WO2018209865A1
WO2018209865A1 PCT/CN2017/103266 CN2017103266W WO2018209865A1 WO 2018209865 A1 WO2018209865 A1 WO 2018209865A1 CN 2017103266 W CN2017103266 W CN 2017103266W WO 2018209865 A1 WO2018209865 A1 WO 2018209865A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
gesture
event
type
rotation
Prior art date
Application number
PCT/CN2017/103266
Other languages
English (en)
French (fr)
Inventor
罗吉童
Original Assignee
广州视源电子科技股份有限公司
广州视臻信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视臻信息科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2018209865A1 publication Critical patent/WO2018209865A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Definitions

  • the present invention relates to the field of touch screen technologies, and in particular, to a multi-touch gesture recognition method and apparatus, a touch screen terminal, and a storage medium.
  • Touch screen terminals equipped with touch screens have been widely used in applications such as touch screen mobile phones, tablet computers, teaching whiteboards, and touch screen televisions.
  • the user can directly touch on the touch screen, and the touch screen terminal can recognize the gesture information corresponding to the touch action, and then execute an operation instruction corresponding to the gesture information, thereby more directly implementing human-computer interaction.
  • multi-touch generally includes: two-finger movement, reduction, enlargement and rotation.
  • the touch screen terminal can easily recognize the gesture information of the two fingers for zooming out or zooming in, and can quickly and accurately respond to the operation instruction corresponding to the gesture information.
  • the touch screen terminal when the screen size of the touch screen terminal is large (can be understood as a screen larger than 7 inches), the user may perform a multi-point translation operation with a change in the angle formed by the contact connection. At this time, the touch screen terminal is very The gesture information may be mistakenly recognized as a rotation gesture and in response to an erroneous operation instruction, thereby affecting the accuracy of the touch screen gesture recognition, thereby reducing the user experience of the touch screen terminal.
  • Embodiments of the present invention provide a multi-touch gesture recognition method, device, touch screen terminal, and storage
  • the medium can effectively solve the problem that the large-size touch screen terminal cannot accurately and efficiently recognize the gesture information in the multi-touch.
  • an embodiment of the present invention provides a multi-touch gesture recognition method, including:
  • the multi-touch gesture information is determined according to the event type, and the operation instruction corresponding to the gesture information is executed; otherwise, the buffer operation of performing the gesture event is returned.
  • an embodiment of the present invention provides a multi-touch gesture recognition apparatus, including:
  • An event buffering module configured to monitor a user's multi-touch to the touch screen terminal, and cache the currently formed gesture event of the multi-touch;
  • a quantity accumulation module configured to determine an event type to which the gesture event belongs, and accumulate the number of caches corresponding to the event type
  • a first execution module configured to determine gesture information of the multi-touch according to the event type when the number of buffers of an event type reaches a corresponding cumulative threshold, and execute an operation instruction corresponding to the gesture information
  • the second execution module is configured to return to the event cache module to re-execute when the number of caches of an event type does not reach the corresponding cumulative threshold.
  • an embodiment of the present invention provides a touch screen terminal, including:
  • Touch screen for inputting information during human-computer interaction
  • One or more processors are One or more processors;
  • a storage device for storing one or more programs
  • the one or more programs are executed by the one or more processors, such that the one or more processors implement the multi-touch gesture recognition method provided by the embodiments of the present invention.
  • an embodiment of the present invention provides a computer readable storage medium, where a computer program is stored, and when the program is executed by the processor, the multi-touch gesture recognition method provided by the embodiment of the present invention is implemented.
  • the user touches the multi-touch of the touch screen terminal, and caches the currently formed gesture event of the multi-touch; and then determines the event to which the gesture event belongs.
  • Type and accumulate the number of caches corresponding to the type of event. Then, if the number of caches of an event type reaches the corresponding cumulative threshold first, the multi-touch gesture information is determined according to the event type, and the operation instruction corresponding to the gesture information may be executed; otherwise, the buffer of the gesture event may be directly returned. The operation is repeated.
  • the multi-touch gesture recognition method, the device, the touch screen terminal and the storage medium can accurately and efficiently implement the multi-touch by adopting a method for determining the type of the event of the cached gesture event and the number of buffers according to the event type to reach the corresponding cumulative threshold.
  • the gesture information recognition effectively improves the accuracy of gesture recognition when the large-size touch screen terminal is multi-touch, and better improves the user experience of the touch screen terminal in practical applications.
  • FIG. 1 is a schematic flowchart of a multi-touch gesture recognition method according to Embodiment 1 of the present invention
  • FIG. 2 is a schematic flowchart of a multi-touch gesture recognition method according to Embodiment 2 of the present invention
  • FIG. 2b is a reason analysis diagram of a cache gesture event according to Embodiment 2 of the present invention.
  • FIG. 2c and FIG. 2d are diagrams showing an example of determining an event type for a gesture event according to Embodiment 2 of the present invention.
  • FIG. 3 is a structural block diagram of a multi-touch gesture recognition apparatus according to Embodiment 3 of the present invention.
  • FIG. 4 is a schematic structural diagram of hardware of a touch screen terminal according to Embodiment 4 of the present invention.
  • FIG. 1 is a schematic flowchart of a multi-touch gesture recognition method according to a first embodiment of the present invention.
  • the method is applicable to a situation in which a user touches a touch gesture on a touch screen terminal, and the method may be a multi-touch gesture.
  • the identification device is executed, wherein the device can be implemented by software and/or hardware and is generally integrated on a touch screen terminal.
  • the touch screen terminal may specifically be an electronic device having a touch screen interaction function, such as a mobile phone, a tablet computer, or a notebook.
  • This embodiment preferably sets the touch screen terminal to have a multi-touch function.
  • a touch screen terminal having a larger screen size when the touch gesture recognition is performed based on the existing gesture recognition method for multi-touch, it is difficult to accurately recognize the gesture information corresponding to the multi-touch on the large-size touch screen.
  • the multi-touch gesture recognition method provided by the embodiment can be accurately and quickly displayed in a large-size screen. Determining the gesture information corresponding to the multi-touch effectively improves the recognition efficiency of the multi-touch by the touch screen terminal.
  • a multi-touch gesture recognition method provided by Embodiment 1 of the present invention includes the following operations:
  • the multi-touch is specifically understood to be that at least two touch points are simultaneously touched on the touch screen of the touch screen terminal, and the touch point may specifically refer to a touch sensing point disposed in the touch screen, which may be Touch sensing occurs when it is touched.
  • the present embodiment can monitor whether there are multiple touch points on the touch screen terminal that are simultaneously touched by the sensing device disposed in the touch screen, thereby implementing monitoring of the multi-touch operation performed by the user.
  • this step can be detected by the sensing device disposed in the touch screen, and two touch points are present on the touch screen, and the touch sensing is performed, and the monitoring result is determined to be the user.
  • Multi-touch operation is being performed on the touch screen terminal.
  • the one-time multi-touch operation in this embodiment may specifically refer to the entire process from when the user's multiple fingers press the touch screen to the end of all the fingers leaving the touch screen.
  • the first change of the touch point corresponding to the user's finger when moving on the touch screen is referred to as a gesture event formed in the multi-touch, wherein the gesture event includes the original touch point corresponding to the finger.
  • the entire change process corresponding to the new touch point of the finger Therefore, the present embodiment can be considered to include a plurality of gesture events during the entire multi-touch process from the finger touching the screen to the finger leaving the screen.
  • the gesture event formed by the user's finger currently moving may be regarded as the gesture event currently formed in the multi-touch.
  • the existing gesture recognition method acquires the gesture information corresponding to the currently formed gesture event in real time (such as a zoom gesture, a zoom gesture, a pan gesture, and a rotation hand). Potential, etc., and execute the corresponding operational instructions in real time.
  • the step first caches the currently formed gesture event when the multi-touch is used, so as to determine the gesture information corresponding to the entire multi-touch more accurately.
  • the embodiment may cache the currently formed gesture event in a preset event buffer.
  • the step first determines the type of the event to which the gesture event belongs, and then accumulates the number of buffers corresponding to the determined event type. Specifically, the step is to first analyze the moving trajectory feature in the gesture event, and then determine the event type to which the gesture event belongs according to the moving trajectory feature, where the event type can be specifically understood as the information type of the gesture information corresponding to the gesture event.
  • the event type in this embodiment may have a zoom type, an enlargement type, a translation type, a rotation type, and the like.
  • the gesture information corresponding to the event type includes: a zoom gesture, a zoom gesture, a pan gesture, and a rotation gesture.
  • the step may further accumulate the number of buffers of the event type to which the gesture event belongs, and is used to count the number of buffers that the gesture event belonging to the event type has in the set event buffer. It can be understood that, before buffering the gesture event in the multi-touch process, the embodiment initializes the number of caches corresponding to each event type to 0. In the subsequent event type determination, if it is determined that the gesture event belongs to After the event type, the number of caches corresponding to the event type is increased by one.
  • the corresponding cumulative threshold is specifically understood as a cumulative threshold corresponding to each event type, and the accumulated thresholds may be used as a cumulative threshold of the number of caches of the respective event types, where the embodiment An initial cumulative threshold may be preferentially set for each event type. Thereafter, the cumulative recognition threshold corresponding to each event type may be heuristically adjusted according to the gesture recognition result of each multi-touch. It should be noted that the cumulative thresholds of the event types in this embodiment may be equal or may not be equal.
  • the event type that reaches the cumulative threshold is used as the event type of the multi-touch, and the event type can be used.
  • the corresponding gesture information is determined as the multi-touch gesture information, and the operation instruction corresponding to the gesture information is executed correspondingly, thereby implementing multi-touch gesture recognition, and simultaneously implementing corresponding operations on the recognized gesture information. It should be noted that, after determining the gesture information of the multi-touch, if a new gesture event is still formed by the multi-touch, the event type of the newly formed gesture event is no longer determined (equivalent to directly ignoring the newly formed gesture event). The event type is continued, and the corresponding operation instruction is executed according to the determined gesture information, thereby further reducing the computational complexity of the gesture recognition while ensuring the accuracy of the gesture.
  • the gesture information recognition of the multi-touch may be determined as a pan gesture according to the translation type, and the operation corresponding to the pan gesture may be performed. instruction.
  • the step is not rushed to execute the operation instruction corresponding to the multi-touch, but returns to S101 to continue monitoring multiple points. Touch, simultaneously cache the newly formed gesture event again, and loop through the subsequent S102 and S103 until the number of caches of an event type reaches the first To the corresponding cumulative threshold.
  • a multi-touch gesture recognition method firstly monitors a multi-touch of a user on a touch screen terminal, and caches a gesture event currently formed by the multi-touch; and then determines an event type to which the gesture event belongs. And accumulate the number of caches corresponding to the type of event. Then, if the number of caches of an event type reaches the corresponding cumulative threshold first, the event type is determined as the multi-touch gesture information, and the operation instruction corresponding to the gesture information may be executed; otherwise, the gesture event may be directly returned. The cache operation is repeated.
  • a part of the gesture event can be cached first, and the gesture information of the multi-touch can be more accurately determined according to the type of the event to which the gesture event belongs, and the gesture information of the multi-touch is accurately and efficiently realized, thereby effectively improving the large-size touch screen.
  • the accuracy of gesture recognition when the terminal is multi-touch is better to improve the user experience of the touch screen terminal in practical applications.
  • FIG. 2 is a schematic flowchart of a multi-touch gesture recognition method according to Embodiment 2 of the present invention.
  • the second embodiment of the present invention is optimized based on the foregoing embodiment.
  • the event type optimization includes: a rotation type and a translation type; correspondingly, the embodiment determines the event type to which the gesture event belongs.
  • And accumulating the number of caches corresponding to the event type is specifically optimized to: determine, according to a preset event type, a policy type, whether the event type to which the gesture event belongs is a rotation type or a translation type; if the gesture event belongs to a rotation type, And accumulating the number of buffers corresponding to the rotation type; if the gesture event belongs to a translation type, accumulating the number of buffers corresponding to the translation type.
  • the embodiment further determines that the multi-touch gesture information is determined according to the event type if the number of caches of an event type reaches the corresponding cumulative threshold first, and the optimization is: if the number of caches of the rotation type reaches Rotating the cumulative threshold and the number of buffers for the translation type is not up to To the translation cumulative threshold, determining a rotation gesture corresponding to the rotation type as the gesture information of the multi-touch; if the number of buffers of the translation type reaches a translation accumulation threshold and the number of buffers of the rotation type does not reach the rotation accumulation
  • the threshold is determined by the panning gesture corresponding to the pan type as the multi-touch gesture information.
  • the embodiment further includes: if the gesture information of the multi-touch is a pan gesture, and the translation cumulative threshold and the rotation cumulative threshold both satisfy the corresponding threshold range, based on the first adjustment rule Updating the translation cumulative threshold and the rotation cumulative threshold; if the multi-touch gesture information is a rotation gesture and the translation accumulation threshold and the rotation accumulation threshold both satisfy a corresponding threshold range, updating the translation based on the second adjustment rule Cumulative threshold and rotation cumulative threshold.
  • the embodiment further includes: clearing the number of buffers corresponding to the event types.
  • a multi-touch gesture recognition method provided by Embodiment 2 of the present invention specifically includes the following operations:
  • the sensing device disposed in the touch screen can monitor whether there is at least two touch points on the touch screen terminal, and the touch sensing occurs, and the touch sensing manner occurs at the at least two points to determine that the user is performing more on the touch screen terminal.
  • Point touch after that, if the touch point corresponding to each finger of the user is currently monitored, it may be determined that the multi-touch is currently forming a gesture event, and the gesture event is changed from the corresponding original touch point to the user's finger For the entire process of the corresponding new touch point, this step needs to cache the gesture event.
  • FIG. 2b is a reason analysis diagram of a cache gesture event in the second embodiment of the present invention.
  • One of the reasons for the gesture event buffering at the start of multi-touch is that when the screen size of the touch screen terminal is too large, when the user touches on the touch screen, the two-point touch based on two fingers shown in FIG. 2b is taken as an example.
  • the movement path of the two fingers on the screen is two arcs (each arc can be regarded as a movement track corresponding to one finger), and as can be seen from FIG.
  • one arc 20 formed is shorter than the other An arc 21, in this case, in some parts of the two arcs, there must be two line segments parallel to the touch point line (such as line segment 22 and line segment 23 in Figure 2b, line segment 22 can be regarded as a gesture
  • line segment 22 can be regarded as a gesture
  • the line connecting the two original touch points in the event, the line segment 23 can be regarded as the connection of two new touch points in the gesture event.
  • the event type of the gesture event can be determined to be a pan.
  • Type and the gesture information corresponding to the translation type can be considered as a pan gesture; and in other parts, there must be two line segments where the touch point connection forms an angle (such as line segment 24 and line segment 25 in FIG.
  • connection of two original touch points in the piece, the line segment 25 can be regarded as the connection of two new touch points in the gesture event), and at this time, the event of the other gesture event can be determined according to the existing gesture recognition method.
  • the type of rotation of the type, and the gesture information corresponding to the rotation type can be considered as a rotation gesture.
  • the existing gesture recognition method not only recognizes the above-mentioned pan type and performs panning in real time.
  • the operation command of the gesture when the above-described rotation type is recognized, executes an operation instruction of the rotation gesture in real time, thereby deviating from the user's touch intention. Therefore, this step first performs buffering of the gesture event to determine which type of gesture information the user's touch operation prefers when determining the presence of the rotation type according to the plurality of cached gesture events.
  • S202 Determine a policy according to a preset event type, and determine whether the event type to which the gesture event belongs is a rotation type or a translation type.
  • the event type includes a translation type and a rotation type, whereby
  • the set translation type determination method and the rotation type determination method may be combined as an event type determination strategy to determine whether the currently cached gesture event is specifically a translation type or a rotation type. It should be noted that, if this step determines that the gesture event does not satisfy the translation type and does not satisfy the rotation type, the event type to which the gesture event belongs may be ignored, and the cache number of the event type may be ignored.
  • the embodiment determines a policy according to a preset event type, and determines whether the event type to which the gesture event belongs is a rotation type or a translation type, and is specifically optimized to: determine a starting touch point and a current touch that constitute the gesture event. Point; if each of the initial touch points has the same displacement direction when moving to the corresponding current touch point, it is determined that the gesture event belongs to a translation type; otherwise, when each of the initial touch points forms a connection line with each current touch point When the connection line is formed to have an angle, it is determined that the gesture event belongs to a rotation type.
  • the original touch point constituting the gesture event may be determined as the start touch point; and the new touch point in the gesture event may be determined as the current touch point.
  • the number of the starting touch points and the current touch points are equal, and is equivalent to the number of fingers used by the user when performing multi-touch.
  • FIG. 2c and FIG. 2d are diagrams showing an example of event type determination for a gesture event according to Embodiment 2 of the present invention, wherein the multi-touch of the user in FIG. 2c and FIG. 2d belongs to two-point touch, that is, based on two fingers. touch.
  • the gesture event can be determined as the translation type.
  • the gesture event is not the translation type (the displacement directions of the respective start touch points are different from the corresponding current touch points)
  • the start of each of the start touch points in the gesture event as shown in FIG. 2d occurs.
  • the line 27 and the current touch point form a connection 28 At a certain rotation angle ⁇ , it can be determined at this time that the gesture event is a rotation type.
  • the event type of the currently cached gesture event is determined to be a rotation type based on the above steps, the corresponding number of buffers when the event type is the rotation type is incremented by one.
  • the event type of the currently cached gesture event is determined to be a pan type based on the operation of S202, the number of buffers corresponding to the event type of the pan type may be increased by one.
  • the initial value of the number of buffers corresponding to each event type may be 0, and then after listening to the multi-touch operation, no matter where the cached gesture event belongs.
  • the type of event, the number of caches of the event type to which it is added, is incremented by one based on the current value.
  • a corresponding cumulative threshold is set for the number of buffers of each event type.
  • the rotation cumulative threshold may be determined as a cumulative threshold corresponding to the number of buffers of the rotation type;
  • the translation cumulative threshold is determined as an accumulated threshold of the number of buffers corresponding to the translation type.
  • the initial values may be preferably but not limited to 5 and 6, respectively, and are not limited to the rotation.
  • the cumulative thresholds can be dynamically adjusted for the gesture recognition result of the multi-touch according to the embodiment.
  • the specific values of the rotation cumulative threshold and the translation cumulative threshold used in this step may be actually selected according to the actual application. Illustratively, if the gesture recognition method provided in this embodiment is applied for the first time in the multi-touch operation, the specific value may be selected. It is a preset initial value; in the historical multi-touch operation, the method provided by the embodiment is used for gesture recognition, and the specific value may be a dynamically adjusted adjustment value.
  • the gesture recognition method provided by the embodiment performs multi-touch gesture recognition, in theory, only the number of buffers of one event type should first reach the corresponding cumulative threshold. This step can be understood as the rotation number of the rotation type reaches the rotation cumulative threshold first. At this time, the rotation gesture corresponding to the rotation type may be determined as the gesture information of the multi-touch operation, and then the subsequent operation may be implemented by S208.
  • this step can be understood that the number of buffers of the translation type first reaches the translation accumulation threshold.
  • the translation gesture corresponding to the translation type can be determined as the gesture information of the multi-touch operation, and then can be implemented through S208. Operation.
  • the embodiment when the number of buffers of at least two event types reaches the corresponding cumulative threshold, the embodiment returns to S201 to cache the newly formed gesture event, the event type determination, and the cache number determination operation. Finally, the gesture information corresponding to the event type with a higher number of buffers in the at least two event types is determined to determine the gesture information of the multi-touch.
  • a corresponding operation instruction is set for each gesture information.
  • an operation instruction corresponding to the gesture information may be executed to implement information interaction between the user and the touch screen terminal.
  • the embodiment performs a clear operation on the current number of buffers corresponding to each event type, so as to avoid the influence of the current cache number on subsequent gesture recognition, thereby ensuring the accuracy of subsequent gesture recognition.
  • the multi-touch gesture information is a pan gesture and the translation accumulation threshold and the rotation accumulation threshold both satisfy a corresponding threshold range, updating the translation accumulation threshold and the rotation accumulation threshold based on the first adjustment rule.
  • the embodiment may dynamically adjust the translation cumulative threshold and the rotation cumulative threshold required by the embodiment according to the determination result of the gesture information, so as to be used for subsequent gesture recognition. operating.
  • the reason for dynamically adjusting the accumulated thresholds is that, since the present embodiment needs to buffer some of the gesture events at the start of multi-touch, if the number of cached gesture events is too large, that is, the set cumulative thresholds are too large, Then, the user will obviously perceive that the touch screen terminal has no action execution when starting multi-touch, thereby affecting the user experience of the touch screen terminal; if the accumulated thresholds are too small, there is a possibility that the recognized gesture information is inaccurate. Therefore, the embodiment introduces a heuristic method, and dynamically adjusts the cumulative threshold corresponding to each event type according to the usage habit of the user.
  • the embodiment before performing the dynamic adjustment of the cumulative threshold, the embodiment first sets the phase for each accumulated threshold.
  • the corresponding threshold range that is, the corresponding upper limit cumulative threshold and the lower limit cumulative threshold are set for each accumulated threshold to ensure that the dynamic adjustment of each accumulated threshold is within the threshold range, thereby preventing the user from using a large amount of corresponding event types.
  • the touch screen terminal After the gesture information is suddenly changed to the gesture information of another event type, the touch screen terminal has a slow response.
  • the threshold range of the translation type and the rotation type are preferably set to 3 to 15, that is, the upper limit cumulative threshold is 15 and the lower limit cumulative threshold is 3.
  • the updating the translation cumulative threshold and the rotation cumulative threshold based on the first adjustment rule have multiple implementation manners.
  • one implementation manner may be expressed as: after determining that the current multi-touch gesture information is a pan gesture, the translation cumulative threshold may be subtracted from the current value by the first set value according to the current gesture information. a new panning cumulative threshold, and a rotation totaling threshold may be added from the current value to the second set value to obtain a new rotating cumulative threshold, wherein the first set value and the second set value may both be 1, can also be an integer that is actually set greater than 1.
  • another implementation manner may be expressed as: determining that the current multi-touch gesture information is a pan gesture, and also determining that the historical multi-touch gesture information is a pan gesture multiple times (may be 2 times, 3 times) After more or more, the current values of the translational cumulative threshold and the rotational cumulative threshold are also adjusted based on the adjustment method in the above implementation.
  • the gesture information of the multi-touch is a rotation gesture and the translation accumulation threshold and the rotation accumulation threshold both satisfy the corresponding threshold range, the translation accumulation threshold and the rotation accumulation threshold are updated based on the second adjustment rule.
  • the updating the translation cumulative threshold and the rotation cumulative threshold based on the second adjustment rule also have various implementation manners.
  • one of the implementation manners may be: after determining that the current multi-touch gesture information is a rotation gesture, the translation cumulative threshold may be added to the third set value from the current value according to the current rotation gesture to obtain a new one.
  • the panning cumulative threshold at the same time, can also be rotated
  • the rotation cumulative threshold is subtracted from the current value by the fourth set value, and a new rotation cumulative threshold is obtained, wherein the third set value and the fourth set value may both be 1, and both may be actually set greater than An integer of 1.
  • another implementation manner may be expressed as: determining that the current multi-touch gesture information is a rotation gesture, and also determining that the historical multi-touch gesture information is a rotation gesture multiple times (may be 2 times, 3 times) After more or more, the current value of the translational cumulative threshold and the rotational cumulative threshold may also be adjusted based on the adjustment method in the above implementation.
  • the present embodiment also provides an implementation effect of the above-mentioned multi-touch gesture recognition method in a practical application scenario.
  • the application scenario may preferably be a smart interaction tablet with a 55-inch touch screen. (Touch screen terminal); the picture browsing function of the smart interactive tablet supports multi-touch picture rotation and picture translation.
  • the smart interaction tablet does not use the gesture recognition method of the embodiment, the smart interaction tablet not only recognizes the pan gesture but also recognizes the rotation gesture and performs the rotation gesture during the multi-touch process in which the user performs the image panning.
  • the operation instructions which change the direction in which the image is viewed.
  • the gesture recognition method of the present embodiment is used in the smart interaction tablet, when the user performs multi-touch of the picture panning, only the gesture information of the multi-touch is recognized as a pan gesture, and only the pan gesture is performed. Operation instructions. It can be seen that the gesture recognition method of the present embodiment better solves the problem of recognizing the pan gesture as a rotation gesture in the multi-touch of the user's picture shifting compared to the existing gesture recognition method.
  • a multi-touch gesture recognition method provided by the second embodiment of the present invention embodies the determining operation of the event type to which the gesture event belongs, and further determines the determination operation of the multi-touch gesture information. At the same time, the optimization increases the event types.
  • the dynamic adjustment operation of the cumulative threshold also optimizes the clearing operation that increases the number of buffers for each event type. With this method, the cumulative threshold of the event type can be dynamically adjusted according to the usage habit of the user, so that the user can not accurately detect the slow execution of the terminal, and is accurate and efficient.
  • the gesture information recognition of the multi-touch operation on the large-size touch screen terminal effectively improves the accuracy of the gesture recognition when the large-size touch screen terminal is multi-touch, and the user experience of the touch screen terminal in the actual application is better improved.
  • FIG. 3 is a structural block diagram of a multi-touch gesture recognition apparatus according to Embodiment 3 of the present invention.
  • the apparatus is adapted for use in identifying a user's touch gesture on a touch screen terminal, the apparatus being operative by software and/or hardware and generally integrated on a touch screen terminal.
  • the apparatus includes an event cache module 31, a quantity accumulation module 32, a first execution module 33, and a second execution module 34.
  • the event cache module 31 is configured to monitor a multi-touch of the touch screen terminal by the user, and cache the currently formed gesture event of the multi-touch;
  • the quantity accumulation module 32 is configured to determine an event type to which the gesture event belongs, and accumulate the number of caches corresponding to the event type;
  • the first execution module 33 is configured to determine gesture information of the multi-touch according to the event type when the number of buffers of an event type reaches a corresponding cumulative threshold, and execute an operation instruction corresponding to the gesture information;
  • the second execution module 34 is configured to return to the event cache module to re-execute when the number of caches of an event type does not reach the corresponding cumulative threshold.
  • the device first listens to the multi-touch of the touch screen terminal by the event cache module 31, and caches the currently formed gesture event of the multi-touch; and then determines the event to which the gesture event belongs by the quantity accumulation module 32. Type, and accumulate the number of caches corresponding to the event type; And then, by the first execution module 33, when the number of buffers of an event type reaches a corresponding cumulative threshold, determining the gesture information of the multi-touch according to the event type, and executing an operation instruction corresponding to the gesture information; The execution module 34 returns to the event cache module to re-execute when the number of buffers of an event type does not reach the corresponding cumulative threshold.
  • a multi-touch gesture recognition apparatus can accurately and efficiently implement multi-touch by adopting a method of determining an event type of a cached gesture event and a cache number according to an event type to reach a corresponding cumulative threshold first.
  • the gesture information recognition effectively improves the accuracy of gesture recognition when the large-size touch screen terminal is multi-touch, and better improves the user experience of the touch screen terminal in practical applications.
  • the event type includes a rotation type and a translation type
  • the quantity accumulation module 32 includes:
  • a type determining unit configured to determine a policy according to a preset event type, and determine whether the event type to which the gesture event belongs is a rotation type or a translation type;
  • a first accumulating unit configured to accumulate the number of buffers corresponding to the rotation type when the gesture event belongs to a rotation type
  • a second accumulating unit configured to accumulate the number of buffers corresponding to the translation type when the gesture event belongs to a translation type.
  • type determining unit is specifically configured to:
  • Determining a starting touch point and a current touch point constituting the gesture event if each of the start touch points has the same displacement direction when moving to the corresponding current touch point, determining that the gesture event belongs to a translation type; otherwise, when each When the connection line formed by the start touch point has an angle corresponding to the line formed by each current touch point, it is determined that the gesture event belongs to the rotation type.
  • the first execution module 33 is specifically configured to:
  • the number of caches of the rotation type reaches a rotation accumulation threshold and the number of buffers of the translation type does not reach the translation accumulation threshold, determining a rotation gesture corresponding to the rotation type as the gesture information of the multi-touch, and executing the An operation instruction corresponding to the gesture information; if the number of buffers of the translation type reaches a translation accumulation threshold and the number of buffers of the rotation type does not reach the rotation accumulation threshold, determining a translation gesture corresponding to the translation type as the multiple point Touching gesture information and executing an operation instruction corresponding to the gesture information.
  • the device is also optimized to include:
  • a first adjustment module 35 configured to: when the gesture information of the multi-touch is a translation type, and the translation accumulation threshold and the rotation accumulation threshold both satisfy a corresponding threshold range, update the translation cumulative threshold based on the first adjustment rule Rotation cumulative threshold;
  • a second adjustment module 36 configured to: when the gesture information of the multi-touch is a rotation type, and the translation cumulative threshold and the rotation cumulative threshold satisfy the corresponding threshold range, update the translation cumulative threshold based on the second adjustment rule Rotate the cumulative threshold.
  • the device has been optimized to increase:
  • the quantity clearing module 37 is configured to clear the number of buffers corresponding to each event type after executing the operation instruction corresponding to the gesture information.
  • a touch screen terminal provided by Embodiment 4 of the present invention includes: a touch screen 41, a processor 42 and a storage device 43, wherein The touch screen 41 is used for information input during human-computer interaction.
  • the processor may be one or more.
  • a processor 42 is taken as an example.
  • the touch screen 41 in the touch screen terminal may be connected to the processor 42 and the storage device 43 respectively through a bus or other manner, and the processor 42 and The storage device 43 is also connected by a bus or other means, and the connection by a bus is taken as an example in FIG.
  • the touch screen terminal can interact with the user's information through the response of the touch screen.
  • the processor 42 in the touch screen terminal can monitor the multi-touch of the user on the touch screen 41, and the processor 42 can accurately identify the corresponding gesture information according to the gesture event formed by the multi-touch, in addition, The gesture event formed when the touch is made can also be cached to the storage device 43 to implement caching of the gesture event.
  • the storage device 43 in the touch screen terminal is used as a computer readable storage medium for storing one or more programs, and the program may be a software program, a computer executable program, and a module, such as multi-touch in the embodiment of the present invention.
  • the program instruction/module corresponding to the gesture recognition method (for example, the module in the multi-touch gesture recognition apparatus shown in FIG. 3 includes: an event buffer module 31, a quantity accumulation module 32, a first execution module 33, and a second Execution module 34).
  • the processor 42 executes various function applications and data processing of the touch screen terminal by executing software programs, instructions, and modules stored in the storage device 43, that is, a gesture recognition method for multi-touch in the above method embodiment.
  • the storage device 43 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the device, etc. In the example, a gesture event formed by multi-touch, etc.). Further, the storage device 43 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some examples, storage device 43 may further include a memory remotely located relative to processor 42 for remote storage The device can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the program when one or more programs included in the touch screen terminal are executed by the one or more processors 42, the program performs the following operations:
  • the embodiment of the present invention further provides a computer readable storage medium, where the computer program is stored, and the program is implemented by the control device to implement the multi-touch gesture recognition method provided by the first embodiment or the second embodiment of the present invention.
  • the method includes: monitoring a multi-touch of a touch screen terminal by a user, buffering a currently formed gesture event of the multi-touch; determining an event type to which the gesture event belongs, and accumulating a cache amount corresponding to the event type; The number of caches of the event type first reaches the corresponding cumulative threshold, and the gesture information of the multi-touch is determined according to the event type, and the operation instruction corresponding to the gesture information is executed; otherwise, the buffer operation of performing the gesture event is returned.
  • the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. .
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer.
  • Read-Only Memory (ROM), Random Access Memory (RAM), Flash memory (FLASH), hard disk or optical disk, etc. includes instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments of the present invention.

Abstract

一种多点触摸的手势识别方法、装置、触摸屏终端及存储介质，该方法包括：监听用户对触摸屏终端的多点触摸，缓存多点触摸当前形成的手势事件（S101）；确定手势事件所属的事件类型，并累加所述事件类型对应的缓存数量（S102）；如果存在一个事件类型的缓存数量率先达到对应累计阈值，则根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；否则，返回执行手势事件的缓存操作（S103）。利用该方法，能够准确高效地实现多点触摸的手势信息识别，有效的提高了大尺寸触摸屏终端多点触摸时手势识别的准确度，更好的提高了触摸屏终端在实际应用中的用户体验。

Description

多点触摸的手势识别方法、装置、触摸屏终端及存储介质 技术领域
本发明涉及触摸屏技术领域，尤其涉及多点触摸的手势识别方法、装置、触摸屏终端及存储介质。
背景技术
安装有触摸屏的触摸屏终端在应用领域上已得到广泛的使用，如触屏手机、平板电脑、教学白板以及触屏电视等等。一般地，用户可以直接在触摸屏上进行触摸，触摸屏终端能够识别该触摸动作对应的手势信息，然后执行对应于该手势信息的操作指令，由此更直接了当的实现了人机交互。
随着触摸屏技术的发展以及用户触屏需求的不断增加，对触摸屏的多点触控已逐渐进入大众视野，目前，多点触控大致包括：双手指的移动、缩小、放大以及旋转等。一般情况下，触摸屏终端很容易识别双手指进行缩小或放大的手势信息并可以快速准确的响应手势信息对应的操作指令。此外，现有的手势识别中通常判定两根手指的触点连线在触摸过程中是否存在角度变化，并在判定存在角度变化时将手势信息确定为旋转操作。
然而，当触摸屏终端的屏幕尺寸较大时(可理解为大于7寸的屏幕)时，用户进行多点平移操作时也会夹杂着触点连线所形成角度的变化，此时，触摸屏终端很可能会错误的将该手势信息识别为旋转手势，并响应错误的操作指令，由此影响了触摸屏手势识别的准确度，从而降低触摸屏终端的用户体验。
发明内容
本发明实施例提供了多点触摸的手势识别方法、装置、触摸屏终端及存储 介质，能够有效解决大尺寸触摸屏终端不能准确高效识别多点触摸中手势信息的问题。
一方面，本发明实施例提供了一种多点触摸的手势识别方法，包括：
监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件；
确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量；
如果存在一个事件类型的缓存数量率先达到对应累计阈值，则根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；否则，返回执行手势事件的缓存操作。
另一方面，本发明实施例提供了一种多点触摸的手势识别装置，包括：
事件缓存模块，用于监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件；
数量累计模块，用于确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量；
第一执行模块，用于当存在一个事件类型的缓存数量达到对应累计阈值时，根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；
第二执行模块，用于当不存在一个事件类型的缓存数量达到对应累计阈值时，返回所述事件缓存模块重新执行。
又一方面，本发明实施例提供了一种触摸屏终端，包括：
触摸屏，用于人机交互时的信息输入；
一个或多个处理器；
存储装置，用于存储一个或多个程序；
所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现本发明实施例提供的多点触摸的手势识别方法。
再一方面，本发明实施例提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现本发明实施例提供的多点触摸的手势识别方法。
在上述多点触摸的手势识别方法、装置、触摸屏终端及存储介质中，首先监听用户对触摸屏终端的多点触摸，并缓存该多点触摸当前形成的手势事件；然后确定该手势事件所属的事件类型，并累加所属事件类型对应的缓存数量。之后，如果存在一个事件类型的缓存数量率先达到对应累计阈值，则根据该事件类型确定该多点触摸的手势信息，并可执行该手势信息对应的操作指令；否则，可直接返回手势事件的缓存操作重复执行。上述多点触摸的手势识别方法、装置、触摸屏终端及存储介质，能够采用确定所缓存手势事件的事件类型以及根据事件类型的缓存数量率先达到对应累计阈值的方式，准确高效地实现了多点触摸的手势信息识别，有效的提高了大尺寸触摸屏终端多点触摸时手势识别的准确度，更好的提高了触摸屏终端在实际应用中的用户体验。
附图说明
图1为本发明实施例一提供的一种多点触摸的手势识别方法的流程示意图；
图2a为本发明实施例二提供的一种多点触摸的手势识别方法的流程示意图；
图2b为本发明实施例二中缓存手势事件的原因分析图；
图2c和图2d为本发明实施例二对手势事件进行事件类型判定的示例展示图；
图3为本发明实施例三提供的一种多点触摸的手势识别装置的结构框图；
图4为本发明实施例四提供的一种触摸屏终端的硬件结构示意图。
具体实施方式
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本发明，而非对本发明的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本发明相关的部分而非全部结构。
实施例一
图1为本发明实施例一提供的一种多点触摸的手势识别方法的流程示意图，该方法适用于对用户在触摸屏终端上的触摸手势进行识别的情况，该方法可以由多点触摸的手势识别装置执行，其中该装置可由软件和/或硬件实现，并一般集成在具有触摸屏终端上。
在本实施例中，所述触摸屏终端具体可以是手机、平板电脑、笔记本等具有触屏交互功能的电子设备。本实施例优选地设定所述触摸屏终端具备多点触摸功能。一般地，对于具有较大屏幕尺寸的触摸屏终端而言，基于现有针对多点触摸的手势识别方法进行触摸手势识别时，很难准确地在大尺寸触摸屏上识别出多点触摸对应的手势信息，尤其是多点的平移手势和旋转手势。然而，根据本实施例提供的多点触摸的手势识别方法，可以准确快速的在大尺寸屏幕中 确定多点触摸对应的手势信息，有效提高了触摸屏终端对多点触摸的识别效率。
如图1所示，本发明实施例一提供的一种多点触摸的手势识别方法，包括如下操作：
S101、监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件。
在本实施例中，所述多点触摸具体可理解为触摸屏终端的触摸屏上至少存在两个触摸点被同时触摸，所述触摸点具体可指设置于触摸屏中的触摸感应点，可在用户对其进行触摸时出现触摸感应。
具体地，本实施可通过触摸屏中设置的感应器件来监测触摸屏终端上是否存在多个触摸点被同时触摸，由此实现对用户所进行多点触摸操作的监听。示例性地，如果用户采用两根手指同时触摸按压屏幕，则本步骤通过设置于触摸屏中的感应器件可监测到触摸屏上存在两个触摸点同时出现触摸感应，此时可确定其监听结果为用户正在对触摸屏终端进行多点触摸操作。
需要说明的是，本实施例中的一次多点触摸操作具体可指：从用户的多个手指按下触摸屏开始，到所有手指离开触摸屏结束的整个过程。同时，本实施例可以将用户手指在触摸屏上移动时所对应触摸点的一次改变称为在多点触摸中形成的一次手势事件，其中，该手势事件包含了由对应于手指的原触摸点到对应于该手指的新触摸点的整个改变过程。因此，本实施例可认为从手指触摸屏幕到手指离开屏幕的整个多点触摸过程中包含了多个手势事件。
在本实施例中，可以将用户手指当前移动后形成的手势事件看作所述多点触摸中当前形成的手势事件。一般地，现有手势识别方法会实时获取当前所形成的手势事件对应的手势信息(如放大手势、缩小手势、平移手势以及旋转手 势等)，并实时执行相应的操作指令。
上述的现有方法尽管保证了操作指令的实时执行，但无法保证操作指令对应的操作结果为用户期望的操作结果。因此，本步骤在监听到存在多点触摸后，首先缓存多点触摸时当前形成的手势事件，以用于后续更精准的确定整个多点触摸对应的手势信息。具体地，本实施例可以将当前形成的手势事件缓存在预先设定的事件缓存区中。
S102、确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量。
在本实施例中，本步骤首先判定手势事件所属的事件类型，之后累加统计所确定事件类型对应的缓存数量。具体地，本步骤首先分析该手势事件中的移动轨迹特征，然后根据该移动轨迹特征确定手势事件所属的事件类型，其中，所述事件类型具体可理解为该手势事件对应的手势信息的信息类型，本实施例中所述事件类型可以有缩放类型、放大类型、平移类型以及旋转类型等，同时，与所述事件类型相对的手势信息包括了：缩放手势、放大手势、平移手势以及旋转手势。
然后，本步骤还可对该手势事件所属事件类型的缓存数量进行累加，以用于统计属于上述事件类型的手势事件在设定的事件缓存区中具有的缓存个数。可以理解的是，在对多点触摸过程中的手势事件进行缓存前，本实施例将各事件类型对应的缓存个数初始化为0，在之后的事件类型确定中，如果确定了手势事件所属的事件类型后，就将所属事件类型对应缓存个数累计加1。
S103、如果存在一个事件类型的缓存数量率先达到对应累计阈值，则根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指 令；否则，返回执行S101。
在本实施例中，所述对应累计阈值具体可理解为对应于各事件类型的累计阈值，所述各累计阈值具体可作为相应各事件类型的缓存个数的累计临界值，其中，本实施例可优先为各事件类型设置一个初始的累计阈值，之后，可根据每次多点触摸的手势识别结果，启发式的调整各事件类型对应的累计阈值。需要说明的是，本实施例中各事件类型的累计阈值可以相等，也可以不等。
具体地，本步骤可以在任一事件类型的缓存数量率先达到对应的累计临界值(对应累计阈值)时，将达到累计临界值的事件类型作为该多点触摸的事件类型，且可以将该事件类型对应的手势信息确定为该多点触摸的手势信息，并可相应执行该手势信息对应的操作指令，由此实现多点触摸的手势识别，同时实现对所识别手势信息的相应操作。需要说明的是，在确定所述多点触摸的手势信息后，如果多点触摸仍有新的手势事件形成，则不再判定新形成手势事件的事件类型(相当于直接忽略新形成手势事件的事件类型)，而是根据已确定的手势信息继续执行相应的操作指令，由此在保证手势别准确度的前提下还更好地节省了手势识别的运算复杂度。
示例性地，假设平移类型(任一事件类型)的缓存数量率先达到了对应累计阈值，则可根据平移类型将多点触摸的手势信息识别确定为平移手势，并可执行该平移手势对应的操作指令。
此外，如果缓存于事件缓存区中各手势事件所属事件类型的缓存数量均没有达到对应累计阈值，则本步骤并不急于执行多点触摸可能对应的操作指令，而是返回S101，继续监听多点触摸，同时再次对当前新形成的手势事件进行缓存，并循环执行后续S102和S103，直至存在一个事件类型的缓存数量率先达 到对应累计阈值。
本发明实施例一提供的一种多点触摸的手势识别方法，首先监听用户对触摸屏终端的多点触摸，并缓存该多点触摸当前形成的手势事件；然后确定该手势事件所属的事件类型，并累加所属事件类型对应的缓存数量。之后，如果存在一个事件类型的缓存数量率先达到对应累计阈值，则将该事件类型确定为该多点触摸的手势信息，并可执行该手势信息对应的操作指令；否则，可直接返回手势事件的缓存操作重复执行。利用该方法，能够首先缓存一部分手势事件，以及根据手势事件所属的事件类型更准确的判定多点触摸的手势信息，准确高效地实现了多点触摸的手势信息识别，有效的提高了大尺寸触摸屏终端多点触摸时手势识别的准确度，更好的提高了触摸屏终端在实际应用中的用户体验。
实施例二
图2a为本发明实施例二提供的一种多点触摸的手势识别方法的流程示意图。本发明实施例二以上述实施例为基础进行优化，在本实施例中，所述事件类型优化包括了：旋转类型和平移类型；相应的，本实施例将确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量具体优化为：根据预设的事件类型判定策略，确定所述手势事件所属的事件类型是旋转类型还是平移类型；如果所述手势事件属于旋转类型，则累加所述旋转类型对应的缓存数量；如果所述手势事件属于平移类型，则累加所述平移类型对应的缓存数量。
进一步地，本实施例还将如果存在一个事件类型的缓存数量率先达到对应累计阈值，则根据该事件类型确定所述多点触摸的手势信息，具体优化为：如果所述旋转类型的缓存数量达到旋转累计阈值且所述平移类型的缓存数量未达 到平移累计阈值，则将所述旋转类型对应的旋转手势确定为所述多点触摸的手势信息；如果所述平移类型的缓存数量达到平移累计阈值且所述旋转类型的缓存数量未达到旋转累计阈值，则将所述平移类型对应的平移手势确定为所述多点触摸的手势信息。
在上述优化的基础上，本实施例还优化包括了：如果所述多点触摸的手势信息为平移手势且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围，则基于第一调整规则更新所述平移累计阈值和旋转累计阈值；如果所述多点触摸的手势信息为旋转手势且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围，则基于第二调整规则更新所述平移累计阈值和旋转累计阈值。
此外，本实施例在所述执行所述手势信息对应的操作指令之后，进一步优化包括了：将所述各事件类型对应的缓存数量清零。
如图2所示，本发明实施例二提供的一种多点触摸的手势识别方法，具体包括如下操作：
S201、监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件。
示例性地，可通过设置于触摸屏中的感应器件监听触摸屏终端上是否同时存在至少两个触摸点出现了触摸感应，并在所述至少两个点出现触摸感应式确定用户正在对触摸屏终端进行多点触摸；之后，如果当前监听到用户各手指所对应触摸点的发生了改变，则可确定多点触摸在当前形成了手势事件，且该手势事件为用户各手指从所对应原触摸点变化到所对应新触摸点的整个过程，本步骤需要缓存该手势事件。
图2b为本发明实施例二中缓存手势事件的原因分析图，在本实施例中，在 多点触摸开始时进行手势事件缓存的其中一个原因在于：当触摸屏终端的屏幕尺寸过大时，用户在触摸屏上进行触摸时，以图2b中所示的基于两根手指的两点触摸为例，两根手指在屏幕上的移动轨迹为两条圆弧(每条圆弧可看作一根手指对应的移动轨迹)，且由图2b可以看出，所形成的一条圆弧20短于另一条圆弧21，此种情况下，在两条圆弧的某些局部，必然存在触摸点连线平行的两条线段(如图2b中的线段22和线段23，线段22可看作一个手势事件中两个原触摸点的连线，线段23可看作该手势事件中两个新触摸点的连线)，此时，根据现有的手势识别方法可确定该手势事件的事件类型为平移类型，且可认为该平移类型对应的手势信息为平移手势；而在另一些局部，又必然存在触摸点连线形成夹角的两条线段(如图2b中的线段24和线段25，线段24可看作另一个手势事件中两个原触摸点的连线，线段25可看作该手势事件中两个新触摸点的连线)，此时，根据现有的手势识别方法可确定上述另一件手势事件的事件类型的旋转类型，且可认为该旋转类型对应的手势信息为旋转手势。
由此，根据现有的手势识别方法处理上述情况时，即使用户进行上述两点触摸的意图在于实现平移手势对应的操作，但现有的手势识别方法不仅实时识别出上述的平移类型以及执行平移手势的操作指令，还在识别出上述的旋转类型时，实时执行旋转手势的操作指令，由此偏离了用户的触摸意图。因此，本步骤首先进行手势事件的缓存，以根据所缓存的多个手势事件在确定存在旋转类型时，判断用户的触摸操作更倾向于哪一种手势信息。
S202、根据预设的事件类型判定策略，确定所述手势事件所属的事件类型是旋转类型还是平移类型。
在本实施例中，具体优选所述事件类型包括平移类型和旋转类型，由此， 本步骤可以将设定的平移类型判定方法以及旋转类型判定方法相结合作为事件类型判定策略，以确定当前所缓存的手势事件具体为平移类型还是旋转类型。需要说明的是，如果本步骤判定该手势事件既不满足平移类型，又不满足旋转类型，则可忽略该手势事件具体所属的事件类型，同时可忽略所属事件类型的缓存数量累加。
进一步地，本实施例将根据预设的事件类型判定策略，确定所述手势事件所属的事件类型是旋转类型还是平移类型，具体优化为：确定构成所述手势事件的起始触摸点以及当前触摸点；如果各起始触摸点移动到相应当前触摸点时具有的位移方向均相同，则确定所述手势事件属于平移类型；否则，当各起始触摸点所形成连线与各当前触摸点所形成连线对应存在角度时，确定所述手势事件属于旋转类型。
在本实施例中，可以将构成该手势事件的原触摸点确定为所述起始触摸点；同时可将该手势事件中的新触摸点确定为当前触摸点。其中，所述起始触摸点以及当前触摸点的个数对应相等，且等同于用户进行多点触摸时所使用手指的具有个数。
图2c和图2d为本发明实施例二对手势事件进行事件类型判定的示例展示图，其中，图2c以及图2d中的用户的多点触摸均属于两点触摸，即，基于两根手指进行触摸。如图2c所示，当手势事件中的各起始触摸点25移动到对应当前触摸点26时具有的水平位移Δx以及垂直位移Δy均为同方向时，此时可判定该手势事件为平移类型。此外，如果基于上述判断确定手势事件不为平移类型(各起始触摸点与对应当前触摸点的位移方向不同)，且出现了如图2d所示的手势事件中各起始触摸点所形成连线27与各当前触摸点所形成连线28存 在一定的旋转角度α，此时可判定为该手势事件为旋转类型。
S203、如果所述手势事件属于旋转类型，则累加所述旋转类型对应的缓存数量。
示例性地，如果基于上述步骤确定当前所缓存的手势事件的事件类型为旋转类型时，则将事件类型为旋转类型时对应的缓存数量加1。
S204、如果所述手势事件属于平移类型，则累加所述平移类型对应的缓存数量。
同样，如果基于S202的操作，确定当前所缓存的手势事件的事件类型为平移类型时，则可将事件类型为平移类型时对应的缓存数量加1。
可以理解是，在监听到触摸屏存在多点触摸之前，可优选设定各事件类型所对应缓存数量的初始值均为0，之后监听到进入多点触摸操作后，无论所缓存的手势事件属于哪种事件类型，所属事件类型的缓存数量会在当前值的基础上累计加1。
S205、如果所述旋转类型的缓存数量达到旋转累计阈值且所述平移类型的缓存数量未达到平移累计阈值，则将所述旋转类型对应的旋转手势确定为所述多点触摸的手势信息，之后执行S208。
本实施例分别对各事件类型的缓存数量设定相应的累计临界值，具体地，本实施例可将所述旋转累计阈值确定为所述旋转类型的缓存数量对应的累计临界值；还可以将所述平移累计阈值确定为所述平移类型对应缓存数量的累计临界值。
需要说明的是，本实施例可优选的为所述旋转累计阈值以及平移累计阈值设定相应的初始值，其初始值可分别优选但不限定为5和6，同时也不限定旋 转累计阈值以及平移累计阈值是否相等；之后可根据本实施例对多点触摸的手势识别结果动态调整各累计阈值。本步骤中所采用旋转累计阈值以及平移累计阈值的具体值可根据实际应用进行实际选择，示例性的，假设多点触摸操作中首次应用本实施例提供的手势识别方法，则可选择其具体值为预先设定的初始值；当历史的多点触摸操作中已采用本实施例提供的方法进行手势识别，其具体值可以是动态调整后的调整值。
基于本实施例提供的手势识别方法进行多点触摸的手势识别时，理论上应该只有一个事件类型的缓存数量率先达到对应累计阈值，本步骤可理解为旋转类型的缓存数量率先达到旋转累计阈值，此时，可将与旋转类型相对应的旋转手势确定为该次多点触摸操作的手势信息，之后可通过S208实现后续的操作。
S206、如果所述平移类型的缓存数量达到平移累计阈值且所述旋转类型的缓存数量未达到旋转累计阈值，则将所述平移类型对应的平移手势确定为所述多点触摸的手势信息，之后执行S208。
具体地，本步骤可理解为平移类型的缓存数量率先达到平移累计阈值，此时，可将与平移类型相对应的平移手势确定为该次多点触摸操作的手势信息，之后可通过S208实现后续的操作。
需要说明的是，当本实施例出现至少两个事件类型的缓存数量同时达到对应累计阈值时，本实施例将返回S201对新形成的手势事件进行缓存、所属事件类型确定以及缓存数量判定操作，最终将上述至少两个事件类型中缓存数量较高的事件类型对应的手势信息确定多点触摸的手势信息。
S207、如果所述平移类型的缓存数量和旋转类型的缓存数量均未达到对应累计阈值，则返回执行S201。
本实施例在确定各事件类型的缓存数量均没有达到对应累计阈值时，需要返回S201重新执行后续操作。
S208、执行手势信息对应的操作指令，并将所述各事件类型对应的缓存数量清零。
本实施例为各手势信息设定了相应的操作指令，在确定多点触摸的手势信息后，就可以执行该手势信息对应的操作指令，以实现用户与触摸屏终端的信息交互。此外，本实施例在执行手势信息的操作指令后，对各事件类型当前对应的缓存数量进行清零操作，以避免当前缓存数量对后续手势识别的影响，进而保证后续手势识别的准确度。
S209、如果所述多点触摸的手势信息为平移手势且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围，则基于第一调整规则更新所述平移累计阈值和旋转累计阈值。
本实施例在确定多点触摸的手势信息并执行相应的操作指令后，可以根据手势信息的确定结果，动态调整本实施例所需的平移累计阈值以及旋转累计阈值，以用于后续的手势识别操作。
其动态调整各累计阈值的原因在于：由于本实施例需要将多点触摸开始时的部分手势事件缓存起来，如果所缓存手势事件的数量过多，即，所设定的各累计阈值过大，则用户将明显感知到开始多点触摸时触摸屏终端没有动作执行，由此同样影响触摸屏终端的用户体验；如果所设定各累计阈值过小，则有存在所识别手势信息不准确的可能。由此，本实施例引入一种启发式方法，根据用户的使用习惯动态调整各事件类型对应的累计阈值。
此外，在进行累计阈值的动态调整前，本实施例首先为各累计阈值设置相 应的阈值范围，即，为各累计阈值设定相应的上限累计阈值和下限累计阈值，以保证各累计阈值的动态调整处于该阈值范围内，由此可以防止用户大量使用某一事件类型对应的手势信息后，突然改用另一事件类型的手势信息时触摸屏终端存在响应过慢的情况。本实施例将平移类型以及旋转类型的阈值范围均优选设定为3～15，即，相当于上限累计阈值均为15，下限累计阈值均为3。
在本实施例中，所述基于第一调整规则更新所述平移累计阈值和旋转累计阈值，存在多种实现方式。示例性地，其中一种实现方式可表示为：在确定当前多点触摸的手势信息为平移手势后，可以只根据当前的手势信息将平移累计阈值由当前值减去第一设定值，获得新的平移累计阈值，同时，还可以将旋转累计阈值由当前值加上第二设定值，获得新的旋转累计阈值，其中，所述第一设定值以及第二设定值均可以是1，也均可以是实际设定的大于1的整数。
此外，另一种实现方式可表示为：在确定当前多点触摸的手势信息为平移手势，且也确定历史多点触摸的手势信息为平移手势的次数达到多次(可以是2次、3次或更多次)后，也基于上述实现方式中的调整方法调整平移累计阈值以及旋转累计阈值的当前值。
S210、如果所述多点触摸的手势信息为旋转手势且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围，则基于第二调整规则更新所述平移累计阈值和旋转累计阈值。
在本实施例中，所述基于第二调整规则更新所述平移累计阈值和旋转累计阈值，同样存在多种实现方式。具体地，其中一种实现方式可表示为：在确定当前多点触摸的手势信息为旋转手势后，可以只根据当前的旋转手势将平移累计阈值由当前值加上第三设定值，获得新的平移累计阈值，同时，还可以将旋 转累计阈值由当前值减去第四设定值，获得新的旋转累计阈值，其中，所述第三设定值以及第四设定值均可以是1，也均可以是实际设定的大于1的整数。
此外，另一种实现方式可表示为：在确定当前多点触摸的手势信息为旋转手势，且也确定历史多点触摸的手势信息为旋转手势的次数达到多次(可以是2次、3次或更多次)后，同样可以基于上述实现方式中的调整方法调整平移累计阈值以及旋转累计阈值的当前值。
在上述实施例的基础上，本实施例还给出了上述所提供多点触摸的手势识别方法在实际应用场景下的实现效果，首先，该应用场景可优选为具有55寸触摸屏的智能交互平板(触摸屏终端)；该智能交互平板的图片浏览功能支持多点触摸的图片旋转和图片平移。具体地，在该智能交互平板没有使用本实施例的手势识别方法时，用户进行图片平移的多点触摸过程中，智能交互平板不仅识别到平移手势，还可能识别到旋转手势，并执行旋转手势的操作指令，从而改变了图像的浏览方向。然而，如果在智能交互平板中使用本实施上述的手势识别方法，在用户进行图片平移的多点触摸时，仅会将该多点触摸的手势信息识别位平移手势，同时仅会执行平移手势的操作指令。可以看出，相比于现有的手势识别方法，在用户的图片平移的多点触摸中，本实施例手势识别方法更好的解决了将平移手势识别为旋转手势的问题。
本发明实施例二提供的一种多点触摸的手势识别方法，具体化了手势事件所属事件类型的确定操作，还具体化了多点触摸手势信息的确定操作，同时，优化增加了各事件类型累计阈值的动态调整操作，还优化增加了各事件类型缓存数量的清零操作。利用该方法，能够根据用户的使用习惯启发式的动态调整事件类型的累计阈值，使得在用户感知不到终端执行迟缓的前提下，准确高效 的实现大尺寸触摸屏终端上多点触摸操作的手势信息识别，有效的提高了大尺寸触摸屏终端多点触摸时手势识别的准确度，更好的提高了触摸屏终端在实际应用中的用户体验。
实施例三
图3为本发明实施例三提供的一种多点触摸的手势识别装置的结构框图。该装置适用于对用户在触摸屏终端上的触摸手势进行识别的情况，该装置可由软件和/或硬件实现，并一般集成在具有触摸屏终端上。如图3所示，该装置包括：事件缓存模块31、数量累计模块32、第一执行模块33以及第二执行模块34。
其中，事件缓存模块31，用于监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件；
数量累计模块32，用于确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量；
第一执行模块33，用于当存在一个事件类型的缓存数量达到对应累计阈值时，根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；
第二执行模块34，用于当不存在一个事件类型的缓存数量达到对应累计阈值时，返回所述事件缓存模块重新执行。
在本实施例中，该装置首先通过事件缓存模块31监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件；然后通过数量累计模块32确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量；之 后通过第一执行模块33当存在一个事件类型的缓存数量达到对应累计阈值时，根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；最终通过第二执行模块34当不存在一个事件类型的缓存数量达到对应累计阈值时，返回所述事件缓存模块重新执行。
本发明实施例三提供的一种多点触摸的手势识别装置，能够采用确定所缓存手势事件的事件类型以及根据事件类型的缓存数量率先达到对应累计阈值的方式，准确高效地实现了多点触摸的手势信息识别，有效的提高了大尺寸触摸屏终端多点触摸时手势识别的准确度，更好的提高了触摸屏终端在实际应用中的用户体验。
进一步地，所述事件类型包括旋转类型和平移类型；
相应的，数量累计模块32，包括：
类型确定单元，用于根据预设的事件类型判定策略，确定所述手势事件所属的事件类型是旋转类型还是平移类型；
第一累加单元，用于当所述手势事件属于旋转类型时，累加所述旋转类型对应的缓存数量；
第二累加单元，用于当所述手势事件属于平移类型时，累加所述平移类型对应的缓存数量。
进一步地，所述类型确定单元，具体用于：
确定构成所述手势事件的起始触摸点以及当前触摸点；如果各起始触摸点移动到相应当前触摸点时具有的位移方向均相同，则确定所述手势事件属于平移类型；否则，当各起始触摸点所形成连线与各当前触摸点所形成连线对应存在角度时，确定所述手势事件属于旋转类型。
在上述优化的基础上，第一执行模块33，具体用于：
如果所述旋转类型的缓存数量达到旋转累计阈值且所述平移类型的缓存数量未达到平移累计阈值，则将所述旋转类型对应的旋转手势确定为所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；如果所述平移类型的缓存数量达到平移累计阈值且所述旋转类型的缓存数量未达到旋转累计阈值，则将所述平移类型对应的平移手势确定为所述多点触摸的手势信息，并执行所述手势信息对应的操作指令。
进一步地，该装置还优化包括了：
第一调整模块35，用于当所述多点触摸的手势信息为平移类型且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围时，基于第一调整规则更新所述平移累计阈值和旋转累计阈值；
第二调整模块36，用于当所述多点触摸的手势信息为旋转类型且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围时，基于第二调整规则更新所述平移累计阈值和旋转累计阈值。
此外，该装置还优化增加了：
数量清零模块37，用于在执行所述手势信息对应的操作指令之后，将所述各事件类型对应的缓存数量清零。
实施例四
图4为本发明实施例四提供的一种触摸屏终端的硬件结构示意图，如图4所示，本发明实施例四提供的触摸屏终端，包括：触摸屏41，处理器42和存储装置43，其中，触摸屏41用于人机交互时的信息输入。该触摸屏终端中的 处理器可以是一个或多个，图4中以一个处理器42为例，所述触摸屏终端中的触摸屏41可以通过总线或其他方式分别与处理器42和存储装置43连接，且处理器42和存储装置43也通过总线或其他方式连接，图4中以通过总线连接为例。
可以理解的是，触摸屏终端可以通过触摸屏的响应实现与用户的信息交互。在本实施例中，触摸屏终端中的处理器42可以监听用户在触摸屏41上的多点触摸，处理器42还可以根据多点触摸所形成的手势事件准确识别所对应的手势信息，此外，多点触摸时所形成的手势事件还可以缓存至存储装置43，以实现手势事件的缓存。
该触摸屏终端中的存储装置43作为一种计算机可读存储介质，可用于存储一个或多个程序，所述程序可以是软件程序、计算机可执行程序以及模块，如本发明实施例中多点触摸的手势识别方法对应的程序指令/模块(例如，附图3所示的多点触摸的手势识别装置中的模块，包括：事件缓存模块31、数量累计模块32、第一执行模块33以及第二执行模块34)。处理器42通过运行存储在存储装置43中的软件程序、指令以及模块，从而执行触摸屏终端的各种功能应用以及数据处理，即实现上述方法实施例中多点触摸的手势识别方法。
存储装置43可包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序；存储数据区可存储根据设备的使用所创建的数据等(如上述实施例中多点触摸所形成的手势事件等)。此外，存储装置43可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中，存储装置43可进一步包括相对于处理器42远程设置的存储器，这些远程存储 器可以通过网络连接至设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
并且，当上述触摸屏终端所包括一个或者多个程序被所述一个或者多个处理器42执行时，程序进行如下操作：
监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件；确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量；如果存在一个事件类型的缓存数量率先达到对应累计阈值，则根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；否则，返回执行手势事件的缓存操作。
此外，本发明实施例还提供一种计算机可读存储介质，其上存储有计算机程序，该程序被控制装置执行时实现本发明实施例一或实施例二提供的多点触摸的手势识别方法，该方法包括：监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件；确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量；如果存在一个事件类型的缓存数量率先达到对应累计阈值，则根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；否则，返回执行手势事件的缓存操作。
通过以上关于实施方式的描述，所属领域的技术人员可以清楚地了解到，本发明可借助软件及必需的通用硬件来实现，当然也可以通过硬件实现，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如计算机的软盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、 闪存(FLASH)、硬盘或光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述的方法。
注意，上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解，本发明不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此，虽然通过以上实施例对本发明进行了较为详细的说明，但是本发明不仅仅限于以上实施例，在不脱离本发明构思的情况下，还可以包括更多其他等效实施例，而本发明的范围由所附的权利要求范围决定。

Claims (10)

  1. 一种多点触摸的手势识别方法，其特征在于，包括：
    监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件；
    确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量；
    如果存在一个事件类型的缓存数量率先达到对应累计阈值，则根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；否则，返回执行手势事件的缓存操作。
  2. 根据权利要求1所述的方法，其特征在于，所述事件类型包括旋转类型和平移类型；
    相应的，所述确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量，包括：
    根据预设的事件类型判定策略，确定所述手势事件所属的事件类型是旋转类型还是平移类型；
    如果所述手势事件属于旋转类型，则累加所述旋转类型对应的缓存数量；
    如果所述手势事件属于平移类型，则累加所述平移类型对应的缓存数量。
  3. 根据权利要求2所述的方法，其特征在于，所述根据预设的事件类型判定策略，确定所述手势事件所属的事件类型是旋转类型还是平移类型，包括：
    确定构成所述手势事件的起始触摸点以及当前触摸点；
    如果各起始触摸点移动到相应当前触摸点时具有的位移方向均相同，则确定所述手势事件属于平移类型；否则，
    当各起始触摸点所形成连线与各当前触摸点所形成连线对应存在角度时，确定所述手势事件属于旋转类型。
  4. 根据权利要求2或3所述的方法，其特征在于，所述如果存在一个事件类型的缓存数量率先达到对应累计阈值，则根据该事件类型确定所述多点触摸的手势信息，包括：
    如果所述旋转类型的缓存数量达到旋转累计阈值且所述平移类型的缓存数量未达到平移累计阈值，则将所述旋转类型对应的旋转手势确定为所述多点触摸的手势信息；
    如果所述平移类型的缓存数量达到平移累计阈值且所述旋转类型的缓存数量未达到旋转累计阈值，则将所述平移类型对应的平移手势确定为所述多点触摸的手势信息。
  5. 根据权利要求4所述的方法，其特征在于，还包括：
    如果所述多点触摸的手势信息为平移手势且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围，则基于第一调整规则更新所述平移累计阈值和旋转累计阈值；
    如果所述多点触摸的手势信息为旋转手势且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围，则基于第二调整规则更新所述平移累计阈值和旋转累计阈值。
  6. 根据权利要求1所述的方法，其特征在于，在所述执行所述手势信息对应的操作指令之后，还包括：
    将所述各事件类型对应的缓存数量清零。
  7. 一种多点触摸的手势识别装置，其特征在于，包括：
    事件缓存模块，用于监听用户对触摸屏终端的多点触摸，缓存所述多点触摸当前形成的手势事件；
    数量累计模块，用于确定所述手势事件所属的事件类型，并累加所述事件类型对应的缓存数量；
    第一执行模块，用于当存在一个事件类型的缓存数量达到对应累计阈值时，根据该事件类型确定所述多点触摸的手势信息，并执行所述手势信息对应的操作指令；
    第二执行模块，用于当不存在一个事件类型的缓存数量达到对应累计阈值时，返回所述事件缓存模块重新执行。
  8. 根据权利要求7所述的装置，其特征在于，所述事件类型包括旋转类型和平移类型；
    相应的，该装置还包括：
    第一调整模块，用于当所述多点触摸的手势信息为平移类型且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围时，基于第一调整规则更新所述平移累计阈值和旋转累计阈值；
    第二调整模块，用于当所述多点触摸的手势信息为旋转类型且所述平移累计阈值及旋转累计阈值均满足对应的阈值范围时，基于第二调整规则更新所述平移累计阈值和旋转累计阈值。
    数量清零模块，用于在执行所述手势信息对应的操作指令之后，将所述各事件类型对应的缓存数量清零。
  9. 一种触摸屏终端，其特征在于，包括：
    触摸屏，用于人机交互时的信息输入；
    一个或多个处理器；
    存储装置，用于存储一个或多个程序；
    所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如权利要求1-6中任一项所述的多点触摸的手势识别方法。
  10. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现如权利要求1-6中任一项所述的多点触摸的手势识别方法。
PCT/CN2017/103266 2017-05-18 2017-09-25 多点触摸的手势识别方法、装置、触摸屏终端及存储介质 WO2018209865A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710354798.3A CN107168636B (zh) 2017-05-18 2017-05-18 多点触摸的手势识别方法、装置、触摸屏终端及存储介质
CN201710354798.3 2017-05-18

Publications (1)

Publication Number Publication Date
WO2018209865A1 true WO2018209865A1 (zh) 2018-11-22

Family

ID=59815787

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/103266 WO2018209865A1 (zh) 2017-05-18 2017-09-25 多点触摸的手势识别方法、装置、触摸屏终端及存储介质

Country Status (2)

Country Link
CN (1) CN107168636B (zh)
WO (1) WO2018209865A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI709894B (zh) * 2019-12-23 2020-11-11 大陸商北京集創北方科技股份有限公司 手勢特徵處理方法及利用其之觸控模組

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107168636B (zh) * 2017-05-18 2020-05-12 广州视源电子科技股份有限公司 多点触摸的手势识别方法、装置、触摸屏终端及存储介质
CN110347324A (zh) * 2019-06-05 2019-10-18 广州朗国电子科技有限公司 快捷方式调用方法、装置、存储介质及会议一体机
CN113064545B (zh) * 2021-05-18 2022-04-29 清华大学 一种手势识别方法及系统
CN113485570B (zh) * 2021-06-17 2023-12-05 深圳软牛科技有限公司 多人书写方法、装置、计算机可读存储介质及终端设备
CN117193619A (zh) * 2021-08-25 2023-12-08 网易（杭州）网络有限公司 虚拟场景的显示比例的控制方法、介质和设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101853133A (zh) * 2010-05-31 2010-10-06 中兴通讯股份有限公司 一种自动识别手势的方法及移动终端
CN103092483A (zh) * 2013-02-05 2013-05-08 华为终端有限公司 用户界面上的触摸操作方法与移动终端
CN103246389A (zh) * 2012-02-03 2013-08-14 三星电子株式会社 操作多点触摸面板的方法和支持该方法的终端
US20140028578A1 (en) * 2012-07-27 2014-01-30 Richard H. Dinh Touch gesture with visible point of interaction on a touch screen
CN105912211A (zh) * 2016-04-12 2016-08-31 广东欧珀移动通信有限公司 指令输入方法及装置
CN107168636A (zh) * 2017-05-18 2017-09-15 广州视源电子科技股份有限公司 多点触摸的手势识别方法、装置、触摸屏终端及存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI467463B (zh) * 2011-05-27 2015-01-01 Asustek Comp Inc 具觸控式螢幕的電腦系統及其手勢的處理方法
CN102799299B (zh) * 2011-05-27 2015-11-25 华硕电脑股份有限公司 具触控式屏幕的电脑系统及其手势的处理方法
KR20130052753A (ko) * 2011-08-16 2013-05-23 삼성전자주식회사 터치스크린을 이용한 어플리케이션 실행 방법 및 이를 지원하는 단말기

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101853133A (zh) * 2010-05-31 2010-10-06 中兴通讯股份有限公司 一种自动识别手势的方法及移动终端
CN103246389A (zh) * 2012-02-03 2013-08-14 三星电子株式会社 操作多点触摸面板的方法和支持该方法的终端
US20140028578A1 (en) * 2012-07-27 2014-01-30 Richard H. Dinh Touch gesture with visible point of interaction on a touch screen
CN103092483A (zh) * 2013-02-05 2013-05-08 华为终端有限公司 用户界面上的触摸操作方法与移动终端
CN105912211A (zh) * 2016-04-12 2016-08-31 广东欧珀移动通信有限公司 指令输入方法及装置
CN107168636A (zh) * 2017-05-18 2017-09-15 广州视源电子科技股份有限公司 多点触摸的手势识别方法、装置、触摸屏终端及存储介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI709894B (zh) * 2019-12-23 2020-11-11 大陸商北京集創北方科技股份有限公司 手勢特徵處理方法及利用其之觸控模組

Also Published As

Publication number Publication date
CN107168636A (zh) 2017-09-15
CN107168636B (zh) 2020-05-12

Similar Documents

Publication Publication Date Title
WO2018209865A1 (zh) 多点触摸的手势识别方法、装置、触摸屏终端及存储介质
JP5793625B2 (ja) ズーム処理を制御する方法及び電子装置
US20170123590A1 (en) Touch Point Recognition Method and Apparatus
US20190302984A1 (en) Method and device for controlling a flexible display device
US7870496B1 (en) System using touchscreen user interface of a mobile device to remotely control a host computer
US8446383B2 (en) Information processing apparatus, operation prediction method, and operation prediction program
US9384711B2 (en) Speculative render ahead and caching in multiple passes
US9430067B2 (en) Device and method for touch detection on a display panel
TWI450128B (zh) 手勢偵測方法、手勢偵測系統及電腦可讀取儲存媒體
WO2020010911A1 (zh) 分屏显示的处理方法、装置、存储介质及电子设备
US11693544B2 (en) Mobile terminal display picture control method, apparatus, and device and storage medium
KR20160077122A (ko) 부동 또는 공중 조작 처리 방법 및 장치
US11175823B2 (en) Method and apparatus for controlling terminal device using gesture control function, and non-transitory computer-readable storage medium
US20150286283A1 (en) Method, system, mobile terminal, and storage medium for processing sliding event
WO2014019478A1 (en) Method and mobile terminal device for image operation
WO2021092768A1 (zh) 触摸事件的处理方法、装置、移动终端及存储介质
CN104731496A (zh) 解锁方法与电子装置
US20180181257A1 (en) Method for user interface of foldable display apparatus
US9727151B2 (en) Avoiding accidental cursor movement when contacting a surface of a trackpad
CN105320316B (zh) 一种触摸屏的去抖动方法、装置及终端
WO2017101340A1 (zh) 多点触控调整视频窗口的方法及设备
WO2021088865A1 (zh) 手势操作方法和设备
CN105183353B (zh) 用于触控设备的多点触控输入方法
US10061438B2 (en) Information processing apparatus, information processing method, and program
WO2017148027A1 (zh) 一种桌面图标整理方法及智能终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17909944

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10.07.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17909944

Country of ref document: EP

Kind code of ref document: A1