CN109656457A - Refer to touch control method, device, equipment and computer readable storage medium more - Google Patents

Refer to touch control method, device, equipment and computer readable storage medium more Download PDF

Info

Publication number
CN109656457A
CN109656457A CN201710936886.4A CN201710936886A CN109656457A CN 109656457 A CN109656457 A CN 109656457A CN 201710936886 A CN201710936886 A CN 201710936886A CN 109656457 A CN109656457 A CN 109656457A
Authority
CN
China
Prior art keywords
frame
group
finger contact
touch
finger
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710936886.4A
Other languages
Chinese (zh)
Other versions
CN109656457B (en
Inventor
谭登峰
郭昱
佘二永
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zen-Ai Technology Co Ltd
Original Assignee
Beijing Zen-Ai Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zen-Ai Technology Co Ltd filed Critical Beijing Zen-Ai Technology Co Ltd
Priority to CN201710936886.4A priority Critical patent/CN109656457B/en
Publication of CN109656457A publication Critical patent/CN109656457A/en
Application granted granted Critical
Publication of CN109656457B publication Critical patent/CN109656457B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04104—Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger

Abstract

The present invention provides one kind and refers to touch control method, device, equipment and computer readable storage medium more, and the method includes receiving the touch information for each frame finger contact that user inputs on the first touch screen；Clustering is carried out to the finger contact in each frame, obtains multiple groups finger contact；Track the movement of each group of finger contact；When the moving direction of the multiple groups finger contact, movement speed and when meeting preset condition at a distance from starting point, the touch-control for responding the multiple groups finger contact executes corresponding operation.Technical solution provided in an embodiment of the present invention can obtain correctly referring to contact track more, and improve recognition efficiency and precision, so as to accurately respond the touch control operation of user.

Description

Refer to touch control method, device, equipment and computer readable storage medium more
Technical field
The present invention relates to touch-control interaction technique field more particularly to a kind of more finger touch control methods based on screen interaction, dress It sets, equipment and computer readable storage medium.
Background technique
When touch objects move on the touchscreen, during multi-point touch, directly contact cannot be carried out one-to-one Exact correlation, therefore it is unable to get correct contact track, and recognition efficiency and precision are lower, cause touch screen accurate Respond the touch control operation of user.
Summary of the invention
In view of this, the embodiment of the invention provides one kind to refer to touch control method, device, equipment and computer-readable storage more Medium.
In a first aspect, the embodiment of the invention provides one kind to refer to touch control method more, which comprises
Receive the touch information for each frame finger contact that user inputs on the first touch screen；
Clustering is carried out to the finger contact in each frame, obtains multiple groups finger contact；
Track the movement of each group of finger contact；
When the moving direction of the multiple groups finger contact, movement speed and when meeting preset condition at a distance from starting point, The touch-control for responding the multiple groups finger contact executes corresponding operation.
In some embodiments, more finger touch control methods, comprising:
The coordinate information for obtaining finger contact in each frame is clustered using DBSCAN and is calculated according to the coordinate information Any one in method, K value clustering algorithm, system clustering algorithm or minimum range clustering algorithm is to the finger in each frame Contact carries out Clustering, obtains multiple groups finger contact.
In some embodiments, more finger touch control methods, further includes:
Each group of finger contact is numbered so that each finger contact be assigned a unique group number and each Finger contact possesses unique ID number；
Calculate the cluster centre coordinate of each group of finger contact；
For nth frame, each group for obtaining the cluster centre coordinate of each group of finger contact in N-1 frame in nth frame is pre- Cluster centre coordinate is surveyed, the cluster centre coordinate and the prediction cluster centre coordinate of each group of finger contact in nth frame are compared The distance between, the group number of the smallest two groups of finger contacts of distance in the two is tracked as identical, wherein N is more than or equal to 4 Integer；For nth frame, each of N-1 frame finger contact is obtained in each of nth frame finger and predicts contact, than Compared in nth frame finger contact and the finger predict contact, the ID of the smallest finger contact of distance in the two is numbered into tracking It is identical；
Judge to possess in consecutive frame in the group of identical group number and numbers identical finger contact with the presence or absence of at least one ID, if In the presence of, then judge described in possess the group of identical group number as continuous group；If it does not exist, then possessing the group of identical group number described in judgement is Discontinuous group；
According to the cluster centre coordinate continuously organized for possessing identical group number in nth frame and first frame, the company in nth frame is obtained The moving direction of the cluster centre of continuous group, movement speed and at a distance from starting point, when the moving direction, movement speed and with rise When the distance of initial point meets preset condition, responds the touch-control continuously organized and execute corresponding operation.
In some embodiments, more finger touch control methods, comprising:
For the second frame, calculate in first frame and the second frame distance between cluster centre coordinate, by cluster centre coordinate away from Group number from the smallest two groups of finger contacts is tracked as identical；
For the second frame, the distance between finger contact in first frame and the second frame is calculated, then by the spacing of finger contact ID number from the smallest two finger contacts is tracked as identical；
For third frame, according to the cluster centre coordinate of each group of finger contact in front cross frame and inter frame temporal interval, obtain The speed of the cluster centre of each group of finger contact in the second frame, according to the speed of the cluster centre of each group of finger contact, Obtain each group prediction cluster centre coordinate of the cluster centre coordinate of each group of finger contact in the second frame in third frame；
For third frame, according to the coordinate information of each finger contact in front cross frame and inter frame temporal interval, the is obtained The speed of each finger contact in two frames obtains each finger touching in the second frame according to the speed of each finger contact Point predicts contact in each of third frame finger.
In some embodiments, the tracking of more finger contacts, comprising:
For nth frame, according to the cluster centre coordinate of each group of finger contact in preceding N-1 frame and inter frame temporal interval, obtain The velocity and acceleration for obtaining the cluster centre of each group of finger contact in N-1 frame, according in the cluster of each group of finger contact The velocity and acceleration of the heart, each group in nth frame of cluster centre coordinate for obtaining each group of finger contact in N-1 frame are pre- Survey cluster centre coordinate；
For nth frame, according to the coordinate information of each finger contact and inter frame temporal interval in preceding N-1 frame, the is obtained The velocity and acceleration of each finger contact in N-1 frame obtains N- according to the velocity and acceleration of each finger contact Each finger contact predicts contact in each of nth frame finger in 1 frame.
In some embodiments, the trackings for referring to contact more, further includes:
As N > 4, for nth frame, according to the cluster centre coordinate and inter frame temporal of each group of finger contact in preceding N-1 frame Interval obtains the first derivative values of the speed, acceleration of the cluster centre of each group of finger contact and acceleration in N-1 frame, According to the first derivative values of the speed, acceleration of the cluster centre of each group of finger contact and acceleration, obtain every in N-1 frame Each group prediction cluster centre coordinate of the cluster centre coordinate of one group of finger contact in nth frame；
For nth frame, according to the coordinate information of each finger contact and inter frame temporal interval in preceding N-1 frame, the is obtained The first derivative values of the speed, acceleration of each finger contact and acceleration in N-1 frame, according to the speed of each finger contact It spends, the first derivative values of acceleration and acceleration, each finger contact is in each of nth frame hand in acquisition N-1 frame Refer to prediction contact.
In some embodiments, more finger touch control methods, further includes:
When nth frame the cluster centre continuously organized moving direction within the scope of default moving direction, movement speed When within the scope of default movement speed and at a distance from starting point within the scope of pre-determined distance, judge that the continuous group of satisfaction is pre- If condition, responds the touch-control continuously organized and execute corresponding operation；Or the cluster centre continuously organized when nth frame Moving direction judges the company within the scope of default moving direction and when being within the scope of pre-determined distance at a distance from starting point Continuous group meets preset condition, responds the touch-control continuously organized and executes corresponding operation；Or when the described of nth frame is continuously organized When cluster centre is within the scope of pre-determined distance at a distance from starting point, judge that described continuous group meets preset condition, responds institute It states the touch-control continuously organized and executes corresponding operation.
In some embodiments, the nth frame is last frame.
It is in some embodiments, described to refer to touch control method more, further includes:
When possessing the group of identical group number described in judging discontinuously to organize, described discontinuous group is deleted.
In some embodiments, more finger touch control methods, further includes:
The touch-control for responding the multiple groups finger contact, by the picture material of the first touch-control screen display or preset Related information output with the picture material of the first touch-control screen display supplies the second touch screen to show, or
The touch-control for responding the multiple groups finger contact, by the picture material of the first touch-control screen display or preset Related information output with the picture material of the first touch-control screen display is shown simultaneously for the first touch screen and the second touch screen.
In some embodiments, more finger touch control methods also include:
It is all satisfied when the moving direction of the cluster centre of only one group finger contact, movement speed and at a distance from starting point When preset condition, the touch-control for responding this group of finger contact executes corresponding operation；Or
It is all satisfied when the moving direction of the cluster centre of at least two groups finger contact, movement speed and at a distance from starting point When preset condition, according to the priority that each group of finger contact is set, the touch-control for responding the multiple groups finger contact is executed accordingly Operation.
In some embodiments, more finger touch control methods, further includes:
The touch-control for responding the multiple groups finger contact will be described according to the moving direction of the cluster centre continuously organized The picture material of first touch-control screen display is preset defeated with the related information of the picture material of the first touch-control screen display It is shown out for the second touch screen of corresponding moving direction.
Second aspect, the embodiment of the invention provides one kind to refer to touch device more, and described device includes:
Receiving unit, for receiving the touch information for each frame finger contact that user inputs on the first touch screen；
Cutting unit obtains multiple groups finger contact for carrying out Clustering to each frame finger contact；
Tracking cell, for tracking the movement of each group of finger contact；
Execution unit, for when the moving direction of the multiple groups finger contact, movement speed and at a distance from starting point it is equal When meeting preset condition, the touch-control for responding the multiple groups finger contact executes corresponding operation.
The third aspect, the embodiment of the invention provides a kind of for referring to that the equipment of touch-control, the equipment include memory more And processor, wherein
The memory is for storing executable program code；
The processor is for reading the executable program code stored in the memory to execute described in first aspect More finger touch control methods.
Fourth aspect, the embodiment of the invention provides a kind of computer readable storage mediums, including instruction, when it is being calculated When being run on machine, so that the computer executes more finger touch control methods described in first aspect.
It is provided in an embodiment of the present invention to refer to touch control method, device, equipment and computer readable storage medium more, by will be every Finger contact in one frame is divided into multiple groups, then tracks the movement of each group of finger contact, when the movement of multiple groups finger contact Direction, movement speed and when meeting preset condition at a distance from starting point, the touch-control of response multiple groups finger contact executes corresponding Operation.Technical solution provided in an embodiment of the present invention can obtain correctly referring to contact track more as a result, and improve identification effect Rate and precision, so as to accurately respond the touch control operation of user.
Detailed description of the invention
Fig. 1 is the flow diagram provided by one embodiment of the present invention for more referring to touch control method.
Fig. 2 is the schematic diagram being split in one embodiment of the invention to the finger contact in a frame.Fig. 3
It is the flow diagram for more finger touch control methods that another embodiment of the present invention provides.
Fig. 4 a to Fig. 4 c is the schematic diagram for the tracking each group of finger contact movement that another embodiment of the present invention provides.
Fig. 5 shows the schematic diagram of a scenario of the screen interactive system of further embodiment of this invention offer.
Fig. 6 be another of the invention embodiment provide by the first touch screen picture material or related information output supply The schematic diagram that second touch screen is shown.
Fig. 7 is the structural schematic diagram for more finger touch devices that further embodiment of this invention provides.
Fig. 8 is the schematic diagram for more finger touch control devices that another embodiment of the present invention provides.
Specific embodiment
Below in conjunction with the specific embodiment technical solution that present invention be described in more detail.It should be appreciated that being described herein as Specific embodiment be only used to explain the present invention, be not intended to limit the present invention.
Fig. 1 is please referred to, Fig. 1 is the flow diagram provided by one embodiment of the present invention for more referring to touch control method.This method Include:
S11: each frame finger contact touch information is received.
Dawn known to those skilled in the art, when user carries out referring to touch-control on Touch Screen more, the finger of user The touch information of contact can for example be collected in various ways by screen and the incidental sensor of screen, as currently known Resistance type touch control screen, capacitance type touch control screen, induction touch screen, infrared frame type touch screen, surface acoustic wave type touch-control Screen, what optical touch screen etc. was shown.It passs at any time, sensor can continue to be acquired touch-control, each frame of acquisition Touch information can be sent to processor, and processor receives each frame touch information.
The touch-control can be the touch-control directly contacted, be also possible to the touch-control of off screen, at this time for example by capturing screen Preceding gesture operation captures the touch-control of respective frame.The Touch Screen for example may include optical touch screen etc..
The Touch Screen can also include for example such as sub-screen: the screen can directly display image (such as LCD display), Or do not show image (such as wall, cloth curtain), information is projected on screen by projection device and is shown, screen surface is disposed with Infrared light curtain and thermal camera.When carrying out touch-control on the screen, the light distribution of the infrared light curtain at touch point will be because of touch-control Behavior and change, such as part infrared light at touch point by touch-control finger is reflected off screen or because of the work of touch-control finger With screen is transmitted through, infrared camera shoots the infrared image including touch point, captures the touch-control input of user, namely acquisition Touch information is passed at any time, and thermal camera can acquire multiframe touch information, and each frame touch information can be sent to place Device is managed, processor receives each frame touch information.
The Touch Screen can also include for example such as sub-screen: the screen can directly display image (such as LCD display) Or do not show image (such as wall, cloth curtain), information is projected on screen by projection device and is shown, screen surface is disposed with Infrared light curtain in screen surface or has been disposed about thermal camera.It is infrared at touch point when carrying out touch-control on the screen The light distribution of light curtain will change because of touch-control behavior, such as the part infrared light at touch point is reflected off by touch-control finger Screen or because the effect of touch-control finger is transmitted through screen, infrared camera shoots the infrared image including touch point, and capture is used The touch-control at family inputs, namely acquisition touch information, passs at any time, thermal camera can acquire multiframe touch information, each Frame touch information can be sent to processor, and processor receives each frame touch information.
In addition to the above, there are also various screen touch technologies and Touch Screens for the prior art, in view of these technologies Widely it is known by a person skilled in the art that herein that explanation is not unfolded one by one.
S12: Clustering is carried out to the finger contact in each frame, obtains multiple groups finger contact.
In this step, processor analyzes it after receiving the touch information of each frame finger contact, can obtain each The coordinate information of each finger contact in frame.The coordinate information of each finger contact is inputted later, can use DBSCAN Any one in clustering algorithm, K value clustering algorithm, system clustering algorithm or minimum range clustering algorithm is by the hand in each frame Refer to that contact carries out Clustering.It can be appropriately arranged with some conditions when cluster, such as limit the maximum number of points of every cluster less than five, And number of class etc., it is accordingly clustered in view of according to the position of point, and carry out coefficient adjustment, waiting has been art technology Known to personnel, therefore explanation is not unfolded to these algorithms herein.
Referring to Fig. 2, Fig. 2 is to carry out Clustering or segmentation to the finger contact in a frame in one embodiment of the invention Schematic diagram.The case where including 13 finger contacts is illustratively shown in a frame in Fig. 2, by the experiment of inventor, is adopted The grouping effect reached when being grouped with DBSCAN clustering algorithm to finger contact is best, is clustered in Fig. 2 using DBSCAN 13 finger contacts in one frame are divided into a, b, c, d totally 4 groups by algorithm.
It is understood that when there is the finger of multiple people to carry out touch-control on touch screen, it can be by multiple people in touch-control Finger contact cluster on screen is divided into different groups, and so as to everyone finger contact of synchronized tracking, what is handled in this way is good It is in avoiding in the prior art carrying out a pile point in each frame whole according to the relationship between adjacent two frames finger contact The identification mistake problem low with recognition efficiency caused by volume tracing.
S13: the movement of each group of finger contact is tracked.
In this step, each group of finger contact is matched first, then again to each of each group hand after matching Refer to that contact is tracked, so as to track the movement of each group of finger contact.
S14: meet when the moving direction of the multiple groups finger contact, movement speed and at a distance from starting point preset condition When, the touch-control for responding the multiple groups finger contact executes corresponding operation.
In this step, by track each group of finger contact motion conditions, when certain group finger contact moving direction, Movement speed and when meeting preset condition at a distance from starting point, the touch-control for responding this group of finger contact executes corresponding operation.
For example, if having in present frame the moving direction of one group of finger contact, movement speed and at a distance from starting point it is equal Meet preset condition, then the touch-control for responding this group of finger contact executes corresponding operation.It herein, can be in advance in touchpad device In store it is some meet corresponding touch control operation when preset condition, to carry out different behaviour to the picture material shown in touch screen Make or controls, such as: the operation or control to the picture material shown in touch screen includes being moved to left to image, being right The layout etc. of shifting, amplification, diminution, deletion, mark, writing, page turning or adjustment image on touch screen, is only for example herein It is bright.
Another example is: expiring when there are the moving direction of finger contact more than two, movement speed and at a distance from starting point When sufficient preset condition, only allow to respond the touch-control of wherein one group of finger contact, in order to avoid cause the confusion for more referring to touch-control.
Another example is: expiring when there are the moving direction of finger contact more than two, movement speed and at a distance from starting point When sufficient preset condition, it is not responding to the touch-control of any group of finger contact, in order to avoid cause the confusion for more referring to touch-control.
In another example expiring when there are the moving direction of finger contact more than two, movement speed and at a distance from starting point When sufficient preset condition, priority can be arranged to the response of finger contact more than two, according to the excellent of different groups of finger contacts First grade sequence successively responds corresponding touch control operation.
In another example expiring when there are the moving direction of finger contact more than two, movement speed and at a distance from starting point When sufficient preset condition, priority can be arranged to the response of finger contact more than two, when the finger contact of high priority bank Touch-control when being responded, the touch-control of other group of finger contact can only be ignored, and avoid confusion.
When using mostly finger touch control method provided in an embodiment of the present invention, it can obtain correctly referring to contact track, and mention more High recognition efficiency and precision, so as to accurately respond the touch control operation of user.
Referring to Fig. 3, Fig. 3 is the flow diagram for more finger touch control methods that another embodiment of the present invention provides.The party Method includes:
S21: the touch information for each frame finger contact that user inputs on the first touch screen is received.
S22: Clustering is carried out to the finger contact in each frame, obtains multiple groups finger contact.
S23: being numbered each group of finger contact so that each finger contact be assigned a unique group number and Each finger contact possesses unique ID number.
In this step, when the finger contact in each frame is divided into multiple groups, each group of finger contact is marked, so that In each frame, each group of finger contact possesses unique group number and each finger contact possesses unique ID number.In difference In frame, the ID number of each finger contact will not change, but with the movement of finger, each finger in grouping The assigned group number in contact may change.
S24: the cluster centre coordinate of each group of finger contact is calculated.
In this step, the cluster of each group of finger contact can be obtained according to the coordinate information of finger contact in each group Centre coordinate.Such as: the coordinate of each finger contact respectively (X11, Y11), (X12, Y12), (X13, Y13) in a certain group, then The cluster centre coordinate of the group is
S25: for nth frame, the cluster centre coordinate for obtaining each group of finger contact in N-1 frame is every in nth frame One group of prediction cluster centre coordinate compares the cluster centre coordinate and prediction cluster of each group of finger contact in nth frame The group number of the smallest two groups of finger contacts of distance in the two is tracked as identical, wherein N is big by the distance between centre coordinate In the integer for being equal to 4.
For the 4th frame and later frame, according to the cluster centre coordinate and frame of each group of finger contact in previous frame Between time interval, the movement speed and acceleration of each group of finger contact cluster centre can be obtained, according to each group of finger The movement speed and acceleration of contact cluster centre can obtain the cluster centre coordinate of each group of finger contact in the next frame Each group of prediction cluster centre coordinate, will coordinate and prediction the distance between cluster centre coordinate be most in the minds of cluster in nth frame Small group is judged as identical group number.
Further, in some embodiments, for third frame, according in front cross frame each group of finger contact it is poly- Class centre coordinate and inter frame temporal interval, can obtain the movement speed of the cluster centre of each group of finger contact, according to each The movement speed of group finger contact cluster centre and inter frame temporal interval, can obtain each group cluster center in third frame Group cluster each in third frame center is compared by each group of prediction cluster centre coordinate with the prediction cluster centre, with The prediction cluster centre thinks that group number is identical apart from the smallest one group.
Further, in some embodiments, for the second frame, can calculate and first frame between cluster centre coordinate Distance, then judge the group number of the smallest two groups of finger contacts of cluster centre coordinate distance to be identical.In some embodiments, also Whether within a preset range may determine that minimum range in described the two, if it does, then judge cluster centre coordinate away from Group number from the smallest two groups of finger contacts is identical.
Please refer to attached drawing below to further illustrate.A to Fig. 4 c referring to figure 4., Fig. 4 a to Fig. 4 c be the present invention another The schematic diagram for the tracking each group of finger contact movement that embodiment provides.With each group finger contact of second frame into the 4th frame For be illustrated, while for clarity, be not illustrated here the finger contact in each group, each group is only illustrated with circle.Its In, a (1), b (1), c (1) respectively indicate the position signal of a group, b group and c group finger contact in the second frame in Fig. 4 a Figure, in fig. 4b, dotted portion a (1), b (1), c (1) respectively indicate a group, b group and c group finger contact in the second frame Position, bold portion a (2), b (2), c (2) respectively indicate the position of a group, b group and c group finger contact in third frame It sets, in Fig. 4 c, dotted portion a (2), b (2), c (2) respectively indicate a group, b group and c group finger contact in third frame Position, bold portion a (3), b (3), c (3) respectively indicate the position of a group, b group and c group finger contact in the 4th frame It sets, chain-dotted line part b0 indicates the position of prediction cluster centre coordinate of the b group finger contact in the 4th frame.Below with reference to figure 4a to Fig. 4 c come illustrate track b group finger contact movement the case where.
In the second frame according to complete with the minimum range in first frame between the cluster centre coordinate of each group of finger contact At the matching of each group of finger contact, for third frame or the 4th frame, if continued according to each group of finger in consecutive frame Minimum range between the cluster centre coordinate of contact carries out the matching between group and group, then will appear the feelings of erroneous matching Condition.For example, for the 4th frame, c referring to figure 4., due to c in b group finger contact b (2) in third frame and the 4th frame The distance h of group finger contact c (3) is minimum, if continue according to each group of finger contact in consecutive frame cluster centre coordinate it Between minimum range carry out the matching between group and group, then will appear b group finger contact b (2) in third frame mistakenly The case where matching is group finger contact (3) c c in the 4th frame.Therefore, in order to improve the tracking accuracy between group and group, this hair The bright finger contact later for third frame and third frame, using following tracking:
The frame later for third frame, please refers to Fig. 4 c, according to the cluster of first frame b group finger contact into third frame Centre coordinate and sampling interval can determine the movement speed and acceleration of the cluster centre of b group finger contact, according to described Movement speed and acceleration can obtain prediction cluster centre coordinate b0 (such as Fig. 4 c of the b group finger contact in the 4th frame in turn Shown in chain-dotted line part), calculate the 4th frame in each group of finger contact cluster centre coordinate and prediction cluster centre The distance between coordinate b0 has found that the cluster centre coordinate distance of b group finger contact b (3) in the 4th frame predicts cluster centre The distance of b0 is minimum, therefore b (3) in the 4th frame is organized finger contact matching and is mentioned for b group so as to avoid erroneous matching High tracking accuracy.
For third frame, according to the cluster centre coordinate of each group of finger contact in front cross frame and inter frame temporal interval, obtain The speed of the cluster centre of each group of finger contact in the second frame, according to the speed of the cluster centre of each group of finger contact, Obtain each group prediction cluster centre coordinate of the cluster centre coordinate of each group of finger contact in the second frame in third frame；It Compare the cluster centre coordinate and the distance between the prediction cluster centre coordinate of each group of finger contact in third frame afterwards, The group number of the smallest two groups of finger contacts of distance in the two is tracked as identical.
S26: it for nth frame, obtains each of N-1 frame finger contact and is predicted in each of nth frame finger Contact compares the finger contact in nth frame and finger prediction contact, the ID of the smallest finger contact of distance in the two is compiled It number is tracked as identical.
In this step, in the tracking of each finger contact in each group and step S25 to each group with Track method is similar, can refer to step S25 and is understood that details are not described herein again.
Complete to the tracking of each group of finger contact in each frame after, to the finger contact in each group carry out with Track determines in the group of identical group number that whether at least there is an ID numbers identical finger contact, if it is present illustrating the group In have finger touch always, to judge that the group is continuous group, the tracking to touch-control is achieved in, if it does not exist, then explanation User has been likely to occur during touch-control lifts finger the case where frameing out completely, will hereinafter retouch in detail It states.
S27: judge to possess in consecutive frame in the group of identical group number and number identical finger touching with the presence or absence of at least one ID Point, and if it exists, possessing the group of identical group number described in then judging is continuous group, executes step S28；If it does not exist, then described in interpretation The group for possessing identical group number is discontinuous group, executes step S29.
In this step, due to user during finger touch it is possible that finger lifts or hand leaves touch-control The case where screen, therefore, in adjacent two frame, if there are at least one ID to number identical finger touching for identical group of the inside of group number Point judges the group for continuous group；If there is no ID to number identical finger contact for identical group of the inside of group number, illustrate that the group is The group of removal or the group newly increased judge the group for discontinuous group.
In order to make it easy to understand, referring to Fig. 2, it is assumed that three fingers for being 1,2,3 comprising ID in a group in first frame Contact, if including ID in a group in the second frame is that any one ID or any two ID or three ID includes in 1,2,3 When, judge a group for effective group；If not include ID in a group in the second frame be any one ID in 1,2,3, a is judged Group is discontinuous group.
In some embodiments, as N > 4, for nth frame, according in preceding N-1 frame in the cluster of each group of finger contact Heart coordinate and inter frame temporal interval obtain the speed, acceleration and acceleration of the cluster centre of each group of finger contact in N-1 frame The first derivative values of degree, according to the first derivative values of the speed, acceleration of the cluster centre of each group of finger contact and acceleration, Obtain each group prediction cluster centre coordinate of the cluster centre coordinate of each group of finger contact in N-1 frame in nth frame.
For nth frame, according to the coordinate information of each finger contact and inter frame temporal interval in preceding N-1 frame, the is obtained The first derivative values of the speed, acceleration of each finger contact and acceleration in N-1 frame, according to the speed of each finger contact It spends, the first derivative values of acceleration and acceleration, each finger contact is in each of nth frame hand in acquisition N-1 frame Refer to prediction contact.
After obtaining prediction cluster centre coordinate and finger prediction contact, remaining processing is as previously mentioned, be omitted herein.This It place can more accurately estimated finger contact or cluster centre be in the next frame by considering the first derivative values of acceleration Predict that cluster centre coordinate and finger predict contact.
S28: according to the cluster centre coordinate of finger contact in continuous group that possesses identical group number in nth frame and first frame, The moving direction of the cluster centre continuously organized of nth frame, movement speed are obtained and at a distance from starting point, when this is continuously organized The moving direction of cluster centre within the scope of default moving direction, movement speed is within the scope of default movement speed and and starting point Distance when being within the scope of pre-determined distance, judge that described continuous group meets preset condition, respond the touch-control continuously organized and hold Row corresponding operation；Or when the cluster centre continuously organized moving direction within the scope of default moving direction and with starting When the distance of point is within the scope of pre-determined distance, judge that described continuous group meets preset condition, responds the touch-control continuously organized Execute corresponding operation；Or when the cluster centre continuously organized is within the scope of pre-determined distance at a distance from starting point, sentence Break described continuous group and meet preset condition, responds the touch-control continuously organized and execute corresponding operation.
In this step, it is assumed that in a certain continuous group of nth frame the coordinate of finger contact be respectively (X11, Y11), (X12, Y12), (X13, Y13), then the cluster centre coordinate continuously organized be Possess finger contact in the group of identical group number in first frame with this continuous group Coordinate is respectively (X01, Y01), (X02, Y02), (X03, Y03), then possesses the group of identical group number in first frame with this continuous group Cluster centre coordinate be This of nth frame is continuous The alternate position spike that the cluster centre of group possesses the cluster centre of the group of identical group number into first frame with this continuous group is Δ X=X- X0, Δ Y=Y-Y0, for nth frame for first frame, moving direction is L=Δ X/ Δ Y, is at a distance from starting pointMovement speed is V=Δ Y/t, wherein t is the time interval for acquiring first frame to acquisition nth frame.When The moving direction L of a certain cluster centre continuously organized is within the scope of default moving direction, with starting point distance R in default movement In distance range and when movement speed V is within the scope of default movement speed, judge that a certain continuous group meets preset condition.
In the present embodiment using the cluster centre continuously organized in nth frame into first frame the cluster centre continuously organized it is vertical The alternate position spike calculating speed of coordinate in further embodiments can also be using cluster centre continuously organized in nth frame to the The alternate position spike of the abscissa for the cluster centre that this in one frame is continuously organized carrys out calculating speed, or continuously organized using this in nth frame Cluster centre the distance between cluster centre continuously organized into first frame carrys out calculating speed.
In other embodiments of the invention, the nth frame is last frame, i.e., at the end of the touch control operation of user, Judge whether the continuous group in last frame meets preset condition, the finger touch responded in continuous group if meeting executes phase The operation answered.
In the present embodiment, the finger touch responded in continuous group executes corresponding operation, a kind of possible embodiment Being in response to the touch-control continuously organized will show in the output of the picture material of the first touch-control screen display for the second touch screen, Or it is shown preset with the associated information output of display content on first touch screen for the second touch screen, wherein The associated information can be the contents such as text, picture, table, video, web page interlinkage.Specifically, processor can be by The picture material of one touch-control screen display transfers pre-stored related information and is sent to multi-screen splicing processor, by multi-screen Picture signal content or related information are sent to the second touch screen by splicing device, only show picture material by the second touch screen Or related information；Or picture signal content or related information are sent to the first touch screen and second by multi-screen splicing processor Touch screen shows picture material or related information by the first touch screen and the second touch screen simultaneously.
In the description of the above various embodiments, for convenient for illustrating it is understood that introducing multi-screen splicing processor: by multi-screen Splicing device by the first touch screen picture material or related information be sent to the second touch screen or the first touch screen and Second touch screen.It will be appreciated by those skilled in the art that the function of the multi-screen splicing processor is also desirably integrated into In processor, the correlation function of multi-screen splicing processor is realized by processor.
In other embodiments of the invention, correspondence can also be executed according to the moving direction for the cluster centre continuously organized Operation, the corresponding control information of moving direction of cluster centre that can be continuously organized in processor memory storage in advance herein.Example Such as: assuming that the upper left corner of touch screen is coordinate origin, orientation right direction is the positive direction of X-axis, and left direction is the losing side of X-axis To upward direction is the positive direction of Y-axis, and in downward direction for the negative direction of Y-axis, the moving direction for the cluster centre continuously organized is opposite In X-axis slope be K, then when 0 ° of K≤45 ° <, indicate finger upward sliding, by the first touch screen picture material or pass Connection information is shown in the second touch screen above the first touch screen；When 45 ° 135 ° of < K <, indicate that finger is slided to the left It is dynamic, by the first touch screen picture material or related information be shown in second touch screen on the first touch screen left side； When 225 ° of 135 °≤K <, indicate finger slide downward, by the first touch screen picture material or related information show in place In the second touch screen below the first touch screen；When 315 ° of 225 °≤K <, indicate that finger slides to the right, by the first touch-control Picture material or related information in screen are shown in the second touch screen on the right of the first touch screen.
It should be noted that foregoing description is merely exemplary the movement illustrated according to the cluster centre continuously organized Direction, the picture material or related information triggered on the first touch screen are shown on the second touch screen of corresponding moving direction.? In practical application, the second touching which direction picture material or related information in the first touch screen of setting are shown in can customize On control screen.
It, can also be opposite according to the abscissa for the cluster centre continuously organized in nth frame in other embodiments of the invention In the moving direction Δ X of the abscissa of the cluster centre of the corresponding group of first frame, or according to the cluster centre continuously organized in nth frame Ordinate determine relative to the moving direction Δ Y of the ordinate of the cluster centre of first frame corresponding group by the first touch screen Picture material or related information are shown on second touch screen in which direction.Such as: as Δ X > 0, indicate that finger is slided to the right It is dynamic, by the first touch screen picture material or related information show on the second touch screen on the right of the first touch screen；As Δ X When < 0, indicate finger slide to the left, by the first touch screen picture material or related information show on the first touch screen left side The second touch screen on；As Δ Y > 0, finger upward sliding is indicated, by the picture material or related information on the first touch screen It is shown on the second touch screen above the first touch screen；As Δ Y < 0, finger slide downward is indicated, it will be on the first touch screen Picture material or related information be shown on the second following touch screen of the first touch screen.
S29: discontinuous group is deleted.
In this step, hand may be all detached from during touch-control by the first touch screen due to user, in this feelings Condition judges the group where finger contact for discontinuous group, by the discontinuous group of deletion.
In other of the invention embodiments, when judge a certain group discontinuously to organize when, can not also be discontinuous group to this It is handled.
When using mostly finger touch control method provided in an embodiment of the present invention, it can obtain correctly referring to contact track, and mention more High recognition efficiency and precision, so as to accurately respond the touch control operation of user.
Technical solution provided in an embodiment of the present invention, a kind of possible application scenarios are applied in multi-screen ganged technology. Multi-screen ganged technology refers to that two or more high definition touch display systems are hardware platform, the multi-screen connection based on interactive application Dynamic display systems, may be selected one in more high definition touch display systems is main panel curtain, passes through touch-control main control The other screens of screen linkage control show more abundant exhibition method for user.Show the multiple objects of content point, such as text Word, picture, video etc. bring completely new interaction for user and show form.However, existing multi-screen ganged technology can only pass through Other screens of touch-control main control screen linkage control, cannot achieve the interaction between other screens.Therefore, realize other screens it Between interaction so that it is a urgent problem to be solved that picture display mode is more abundant.
It is illustrated below with reference to Fig. 5 and refers to that touch control method is applied to multi-screen ganged system for provided in an embodiment of the present invention more Application scenarios when system.
Referring to figure 5., Fig. 5 shows the schematic diagram of a scenario of the screen interactive system of further embodiment of this invention offer.It should Screen interactive system include: the first touch screen m1 and the second touch screen m2, infrared laser g1 and g2, infrared camera b1 and B2, processor s and multi-screen splicing processor.Wherein, the first touch screen m1 and the second touch screen m2 is for showing image, Ke Yitong It crosses multi-screen splicing device to be stitched together, but spatially separated can dispose；Infrared laser g1 and g2 are used to form flat In the light curtain of the first touch screen m1 and the second touch screen m2, the number of infrared laser mutually can be all row with the number of touch screen 2,2 infrared lasers g1 and g2 are respectively arranged at the top of the first touch screen m1 and the second touch screen m2；Infrared camera B1 and b2 is used to acquire each frame image of finger contact of the user on the first touch screen m1, the touching of the first touch screen m1 and second Control screen m2 is located in the angular field of view of infrared camera b1 and b2, can set the number of infrared camera to and touch screen Number is identical, is 2.When infrared laser g1 and g2 are opened, it is formed in parallel with the first touch screen m1's and the second touch screen m2 Surface and lasing area in homogeneous thickness.When user touches on the first touch screen m1, actually in the first touch-control The optical signal of finger contact is formd on screen m1, then, infrared camera b1 shoots the finger contact on the first touch screen m1 Each frame image, each frame image of shooting is sent to processor s by infrared camera b1 later.Processor s is by each frame figure Finger contact as in is divided into multiple groups, tracks the motion conditions of each group of finger contact respectively, when a certain group of finger contact Moving direction, movement speed and when meeting preset condition at a distance from starting point, then processor s responds the touching of this group of finger contact Control executes corresponding operation, by multi-screen splicing processor by picture material on the first touch screen m1 or preset with the first touch-control The related information output of picture material on screen m1 is shown for the second touch screen m2, or supplies the first touch screen m1 and the second touch-control Screen m2 is shown simultaneously.
Referring to Fig. 6, Fig. 6 be another of the invention embodiment provide by the picture material or association on the first touch screen The schematic diagram that information output is shown for the second touch screen.User carries out referring to touch-control on the first touch screen m1 more, when multiple groups finger The moving direction of contact, movement speed and when meeting preset condition at a distance from starting point, by the image on the first touch screen m1 Content (or preset related information with the picture material on the first touch screen m1) is shown on the second touch screen m2.
When using mostly finger touch control method provided in an embodiment of the present invention, it can obtain correctly referring to contact track, and mention more High recognition efficiency and precision, so as to accurately respond the touch control operation of user.It can be realized multi-screen ganged technology simultaneously Interaction between middle multi-screen, so that image display pattern is more abundant.
More finger touch control methods that one embodiment provides, further embodiment of this invention also mention in order to better understand the present invention More finger touch devices are supplied.Wherein, the meaning of noun refers to that the method for touch-control is identical with above-mentioned more, and specific implementation details can refer to Explanation in embodiment of the method.
Referring to Fig. 7, Fig. 7 is the structural schematic diagram for more finger touch devices that further embodiment of this invention provides.The dress It sets including acquisition unit 31, cutting unit 32, tracking cell 33 and execution unit 34.
Wherein, acquisition unit 31 is used to receive the touch-control letter for each frame finger contact that user inputs on the first touch screen Breath；Cutting unit 32 is used to carry out Clustering to each frame finger contact, obtains multiple groups finger contact；Tracking cell 33 For tracking the movement of each group of finger contact；Execution unit 34 is used for the moving direction when the multiple groups finger contact, movement Speed and be all satisfied at a distance from starting point preset condition or in which some or certain two combinations when meeting preset condition, The touch-control for responding the multiple groups finger contact executes corresponding operation.
In a kind of possible embodiment, cutting unit 32 is used to obtain the coordinate letter of finger contact in each frame Breath is clustered according to the coordinate information using DBSCAN clustering algorithm, K value clustering algorithm, system clustering algorithm or minimum range Any one in algorithm carries out Clustering to the finger contact in each frame, obtains multiple groups finger contact.
In a kind of possible embodiment, each group of finger contact that tracking cell 33 is used to obtain cutting unit 32 into Row number, so that each finger contact is assigned a unique group number and each finger contact possesses unique ID number； The cluster centre coordinate for calculating each group of finger contact obtains the cluster of each group of finger contact in N-1 frame for nth frame Each group prediction cluster centre coordinate of the centre coordinate in nth frame, in the cluster for comparing each group of finger contact in nth frame The distance between heart coordinate and the prediction cluster centre coordinate, by the group number of the smallest two groups of finger contacts of distance in the two with Track is identical, wherein N is the integer more than or equal to 4；For nth frame, each of N-1 frame finger contact is obtained in N Each of frame finger predicts contact, compares the finger contact in nth frame and finger prediction contact, by distance in the two The ID number of the smallest finger contact is tracked as identical, judges to possess in consecutive frame in the group of identical group number with the presence or absence of at least one A ID numbers identical finger contact, and if it exists, possesses the group of identical group number described in then judging as continuous group；If it does not exist, then Possess the group of identical group number described in judging as discontinuous group.Judge the moving direction of the cluster centre continuously organized, speed and away from From whether preset condition is met, if it is satisfied, then responding the touch-control continuously organized executes corresponding operation.
In further embodiments, the touch-control that execution unit 34 is used to respond the multiple groups finger contact will be described first The picture material of touch-control screen display is shown with the related information output of the display content of the first touch screen for the second touch screen.
Specifically, it is all satisfied when the moving direction of only one group of cluster centre, movement speed and at a distance from starting point When preset condition, the touch-control that execution unit 34 responds this group of finger contact executes corresponding operation；Alternatively, working as at least two groups finger The moving direction of contact, movement speed and when being all satisfied preset condition at a distance from starting point, execution unit 34 is according to each group The priority of finger contact setting, the touch-control for responding the multiple groups finger contact execute corresponding operation；Alternatively, working as at least two groups The moving direction of cluster centre, movement speed and when being all satisfied preset condition at a distance from starting point, execution unit 34 not into Any response of row, in order to avoid cause touch-control chaotic.
Refer to touch device more provided by the embodiment of the present invention, belongs to same structure with more finger touch control methods described above Think, any method for referring to more and providing in touch control method embodiment can be run on touch device referring to more, implemented Journey is detailed in the embodiment for more referring to touch control method, and details are not described herein again.
For mostly finger touch device provided in an embodiment of the present invention, each functional unit be can integrate in a processing core In piece, it is also possible to each unit and physically exists alone, can also be integrated in two or more units in a module.On It states integrated module both and can take the form of hardware realization, can also be realized in the form of the functional module of software.It is described If integrated unit is realized and when sold or used as an independent product in the form of software function module, also can store In a computer readable storage medium, the medium of the storage is for example read-only memory, disk or CD etc..
When using mostly finger touch device provided in an embodiment of the present invention, it can obtain correctly referring to contact track, and mention more High recognition efficiency and precision, so as to accurately respond the touch control operation of user.
Fig. 8 is please referred to, Fig. 8 is the schematic diagram for more finger touch control devices that another embodiment of the present invention provides.Knot Close state refer to touch control method at least part can by for refer to touch control device 400 realize, the equipment 400 include handle Device 41, memory 42 and bus 43.
In some instances, which can also include input equipment 401, input port 402, output Port 403 and output equipment 404.Wherein, input port 402, processor 41, memory 42 and output port 403 are logical Cross the interconnection of bus 43, input equipment 401 and output equipment 404 are respectively by input port 402 and output port 403 and total Line 43 connects, and then connect with the other assemblies of equipment 400.It should be noted that output interface and input interface here It can be indicated with I/O interface.Specifically, input equipment 401 is received from external input information, and passes through input port 402 Input information is transmitted to processor 41；Processor 41 believes input based on the computer executable instructions stored in memory 42 Breath is handled to generate output information, and output information is temporarily or permanently stored in memory 42, then by defeated Output information is transmitted to output equipment 404 by exit port 403；Output information is output to the outside of equipment by output equipment 403.
Above-mentioned memory 42 includes the mass storage for data or instruction.For example it rather than limits, memory 42 may include HDD, floppy disk drive, flash memory, CD, magneto-optic disk, tape or universal serial bus (USB) driver or two Or more the above combination.In a suitable case, memory 42 may include removable or non-removable (or fixed) Medium.In a suitable case, memory 42 can be inside or outside equipment.In a particular embodiment, memory 42 is Non-volatile solid state memory.In a particular embodiment, memory 42 includes read-only memory (ROM).In a suitable case, The ROM can be the ROM of masked edit program, programming ROM (PROM), erasable PROM (EPROM), electric erasable PROM (EEPROM), electrically-alterable ROM (EAROM) or the combination of flash memory or two or more the above.
Bus 43 includes hardware, software or both, and the component of equipment 400 is coupled to each other together.For example rather than Limitation, bus 43 may include accelerated graphics port (AGP) or other graphics bus, enhancing Industry Standard Architecture (EISA) bus, Front side bus (FSB), super transmission (HT) interconnection, the interconnection of Industry Standard Architecture (ISA) bus, infinite bandwidth, low pin count (LPC) Bus, memory bus, micro- channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) Bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association part (VLB) bus or other suitable buses Or the combination of two or more the above.In a suitable case, bus 43 may include one or more buses 43.To the greatest extent Specific bus has been described and illustrated in the pipe embodiment of the present invention, but the present invention considers any suitable bus or interconnection.
When realizing the more finger touch control methods for combining Fig. 1 description by equipment 400 shown in Fig. 8, input equipment 401 is received The touch information of each frame finger contact of input of the user on the first touch screen, in a particular embodiment, with output equipment Connected I/O interface may include hardware, software or both, provide the communication between equipment 400 and one or more I/O equipment One or more interfaces.One or more of these I/O equipment allow the communication between people and equipment 400.For example and Unrestricted, I/O equipment may include video camera.In a suitable case, I/O interface may include one or more devices or can permit Perhaps processor 41 drives the software driver of one or more of these I/O equipment.The processor 41 is based on storing in memory 42 Computer executable instructions, divide the finger contact in each frame, obtain multiple groups finger contact, track each group of finger The movement of contact meets when the moving direction of the multiple groups finger contact, movement speed and at a distance from starting point preset condition When, the touch-control for responding the multiple groups finger contact executes corresponding operation.
According to some embodiments, a kind of computer readable storage medium is provided, may include instruction, when it is in computer When upper operation, computer can be made to execute above-mentioned more finger touch control methods.
Therefore, the computer readable storage medium, each frame finger inputted on the first touch screen by receiving user The touch information of contact carries out Clustering to the finger contact in each frame, obtains multiple groups finger contact, tracks each The movement of group finger contact meets in advance when the moving direction of the multiple groups finger contact, movement speed and at a distance from starting point If when condition, the touch-control for responding the multiple groups finger contact executes corresponding operation.It can obtain correctly referring to contact track more, And recognition efficiency and precision are improved, it can obtain correctly referring to contact so as to accurately respond the touch control operation of user more Track, and recognition efficiency and precision are improved, so as to accurately respond the touch control operation of user.
In some instances, a kind of computer program product comprising instruction is provided, when run on a computer, So that computer executes above-mentioned more finger touch control methods.
In some instances, a kind of computer program is provided, when run on a computer, so that computer executes Above-mentioned more finger touch control methods.
In the examples described above, it can be realized wholly or partly by software, hardware, firmware or any combination thereof. When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program produces Product include one or more computer instructions.When loading on computers and executing the computer program instructions, whole or portion Ground is divided to generate according to process or function described in the embodiment of the present invention.The computer can be general purpose computer, dedicated computing Machine, computer network or other programmable devices.The computer instruction can store in computer readable storage medium In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center User's line (DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or Data center is transmitted.The computer readable storage medium can be any usable medium that computer can access or It is comprising data storage devices such as one or more usable mediums integrated server, data centers.The usable medium can be with It is magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard disk Solid State Disk (SSD)) etc..
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or replace It changes, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with right It is required that protection scope subject to.

Claims (10)

1. a kind of refer to touch control method more, which is characterized in that the described method includes:
Receive the touch information for each frame finger contact that user inputs on the first touch screen；
Clustering is carried out to the finger contact in each frame, obtains multiple groups finger contact；
Track the movement of each group of finger contact；
When the moving direction of the multiple groups finger contact, movement speed and when meeting preset condition at a distance from starting point, response The touch-control of the multiple groups finger contact executes corresponding operation.
2. according to claim 1 refer to touch control method more characterized by comprising
The coordinate information for obtaining finger contact in each frame, according to the coordinate information, using DBSCAN clustering algorithm, K It is worth any one in clustering algorithm, system clustering algorithm or minimum range clustering algorithm to the finger contact in each frame Clustering is carried out, multiple groups finger contact is obtained.
3. according to claim 1 refer to touch control method more characterized by comprising
Each group of finger contact is numbered, so that each finger contact is assigned a unique group number and each finger Contact possesses unique ID number；
Calculate the cluster centre coordinate of each group of finger contact；
For nth frame, the cluster centre coordinate for obtaining each group of finger contact in N-1 frame is poly- in each group of prediction of nth frame Class centre coordinate compares in nth frame between the cluster centre coordinate and the prediction cluster centre coordinate of each group of finger contact Distance, the group number of the smallest two groups of finger contacts of distance in the two is tracked as identical, wherein N be it is whole more than or equal to 4 Number；For nth frame, each of N-1 frame finger contact is obtained in each of nth frame finger and predicts contact, is compared Finger contact and the finger in nth frame predict contact, and the ID number of the smallest finger contact of distance in the two is tracked as It is identical；
Judge to possess in consecutive frame in the group of identical group number and number identical finger contact with the presence or absence of at least one ID, if depositing , then judge described in possess the group of identical group number as continuous group；If it does not exist, then possess the group of identical group number described in judging as not Continuous group；
According to the cluster centre coordinate continuously organized for possessing identical group number in nth frame and first frame, this continuous group is obtained in nth frame The moving direction of cluster centre, movement speed and at a distance from starting point, when the moving direction, movement speed and and starting point Distance when meeting preset condition, respond the touch-control continuously organized and execute corresponding operation.
4. according to claim 3 refer to touch control method more characterized by comprising
For the second frame, distance between cluster centre coordinate is calculated in first frame and the second frame, most by cluster centre coordinate distance The group number of two groups of small finger contacts is tracked as identical；
For the second frame, the distance between finger contact in first frame and the second frame is calculated, then most by distance between finger contact The ID number of two small finger contacts is tracked as identical；
For third frame, according to the cluster centre coordinate of each group of finger contact in front cross frame and inter frame temporal interval, the is obtained The speed of the cluster centre of each group of finger contact in two frames is obtained according to the speed of the cluster centre of each group of finger contact Each group prediction cluster centre coordinate of the cluster centre coordinate of each group of finger contact in third frame in second frame；
The second frame is obtained according to the coordinate information of each finger contact in front cross frame and inter frame temporal interval for third frame In the speed of each finger contact obtain each finger contact in the second frame and exist according to the speed of each finger contact Each of third frame finger predicts contact.
5. the tracking of more finger contacts described in any one of -4 according to claim 1, which is characterized in that for nth frame, According to the cluster centre coordinate of each group of finger contact in preceding N-1 frame and inter frame temporal interval, each group of hand in N-1 frame is obtained Refer to that the velocity and acceleration of the cluster centre of contact is obtained according to the velocity and acceleration of the cluster centre of each group of finger contact Obtain each group prediction cluster centre coordinate of the cluster centre coordinate of each group of finger contact in N-1 frame in nth frame；
N-1 frame is obtained according to the coordinate information of each finger contact and inter frame temporal interval in preceding N-1 frame for nth frame In the velocity and acceleration of each finger contact obtained in N-1 frame according to the velocity and acceleration of each finger contact Each finger contact predicts contact in each of nth frame finger.
6. the tracking of more finger contacts described in any one of -4 claims according to claim 1, which is characterized in that when When N > 4, for nth frame, according to the cluster centre coordinate of each group of finger contact in preceding N-1 frame and inter frame temporal interval, obtain The first derivative values of the speed, acceleration of the cluster centre of each group of finger contact and acceleration in N-1 frame, according to each group The speed, acceleration of the cluster centre of finger contact and the first derivative values of acceleration obtain each group of finger touching in N-1 frame Each group prediction cluster centre coordinate of the cluster centre coordinate of point in nth frame；
N-1 frame is obtained according to the coordinate information of each finger contact and inter frame temporal interval in preceding N-1 frame for nth frame In the speed, acceleration of each finger contact and the first derivative values of acceleration, according to the speed of each finger contact, plus The first derivative values of velocity and acceleration obtain each finger contact in N-1 frame and predict in each of nth frame finger Contact.
7. more finger touch control methods described in any one of -4 claims according to claim 1, which is characterized in that work as nth frame The cluster centre continuously organized moving direction within the scope of default moving direction, movement speed is in default movement speed model When in enclosing and at a distance from starting point within the scope of pre-determined distance, judge that described continuous group meets preset condition, described in response The touch-control continuously organized executes corresponding operation；Or when the moving direction of the cluster centre continuously organized of nth frame is being preset Within the scope of moving direction and when being within the scope of pre-determined distance at a distance from starting point, judge that the continuous group of satisfaction presets item Part responds the touch-control continuously organized and executes corresponding operation；Or when the cluster centre continuously organized of nth frame and starting When the distance of point is within the scope of pre-determined distance, judge that described continuous group meets preset condition, responds the touch-control continuously organized Execute corresponding operation.
8. more finger touch control methods described in any one of -4 claims according to claim 1, which is characterized in that the N Frame is last frame.
9. more finger touch control methods described in any one of -4 claims according to claim 1, which is characterized in that described in judgement When the group for possessing identical group number is discontinuous group, described discontinuous group is deleted.
10. more finger touch control methods described in any one of -4 claims according to claim 1, which is characterized in that response institute The touch-control for stating multiple groups finger contact, will be in the picture material of the first touch-control screen display or preset and the first touch screen The related information output of the picture material of display supplies the second touch screen to show, or
The touch-control for responding the multiple groups finger contact, by the picture material of the first touch-control screen display or preset with the The related information output of the picture material of one touch-control screen display is shown simultaneously for the first touch screen and the second touch screen.
CN201710936886.4A 2017-10-10 2017-10-10 Multi-finger touch method, device, equipment and computer readable storage medium Active CN109656457B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710936886.4A CN109656457B (en) 2017-10-10 2017-10-10 Multi-finger touch method, device, equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710936886.4A CN109656457B (en) 2017-10-10 2017-10-10 Multi-finger touch method, device, equipment and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN109656457A true CN109656457A (en) 2019-04-19
CN109656457B CN109656457B (en) 2021-10-29

Family

ID=66108811

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710936886.4A Active CN109656457B (en) 2017-10-10 2017-10-10 Multi-finger touch method, device, equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN109656457B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110212907A (en) * 2019-06-13 2019-09-06 深圳秋田微电子股份有限公司 A kind of knob control method, condenser type knob and electrical equipment
CN110309023A (en) * 2019-06-20 2019-10-08 佛吉亚好帮手电子科技有限公司 Vehicle device touch screen off line detection method
WO2021167312A1 (en) * 2020-02-19 2021-08-26 주식회사 픽셀스코프 Touch recognition method and device having lidar sensor
CN113434068A (en) * 2021-05-28 2021-09-24 北京信和时代科技有限公司 Control method and device for suspension shortcut menu, electronic equipment and storage medium
CN113485579A (en) * 2021-06-30 2021-10-08 东莞市小精灵教育软件有限公司 Finger stable frame detection method and device and computer readable storage medium
CN114253417A (en) * 2021-12-02 2022-03-29 Tcl华星光电技术有限公司 Multi-touch-point identification method and device, computer readable medium and electronic equipment
WO2023272639A1 (en) * 2021-06-30 2023-01-05 东莞市小精灵教育软件有限公司 Stable finger frame detection method and computer-readable storage medium
TWI824723B (en) * 2022-09-16 2023-12-01 大陸商北京集創北方科技股份有限公司 Finger tracking correction method, electronic chip and information processing device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622120A (en) * 2011-01-31 2012-08-01 宸鸿光电科技股份有限公司 Touch path tracking method of multi-point touch control panel
CN103389799A (en) * 2013-07-24 2013-11-13 清华大学深圳研究生院 Method for tracking motion trail of fingertip
CN103885707A (en) * 2014-02-27 2014-06-25 四川长虹电器股份有限公司 Multi-touch technology based human-computer interaction method and remote controller
CN106527917A (en) * 2016-09-23 2017-03-22 北京仁光科技有限公司 Multi-finger touch operation identification method for screen interactive system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622120A (en) * 2011-01-31 2012-08-01 宸鸿光电科技股份有限公司 Touch path tracking method of multi-point touch control panel
CN103389799A (en) * 2013-07-24 2013-11-13 清华大学深圳研究生院 Method for tracking motion trail of fingertip
CN103885707A (en) * 2014-02-27 2014-06-25 四川长虹电器股份有限公司 Multi-touch technology based human-computer interaction method and remote controller
CN106527917A (en) * 2016-09-23 2017-03-22 北京仁光科技有限公司 Multi-finger touch operation identification method for screen interactive system

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110212907A (en) * 2019-06-13 2019-09-06 深圳秋田微电子股份有限公司 A kind of knob control method, condenser type knob and electrical equipment
CN110212907B (en) * 2019-06-13 2023-06-02 深圳秋田微电子股份有限公司 Knob control method, capacitive knob and electrical equipment
CN110309023A (en) * 2019-06-20 2019-10-08 佛吉亚好帮手电子科技有限公司 Vehicle device touch screen off line detection method
CN110309023B (en) * 2019-06-20 2022-11-15 佛吉亚歌乐电子(丰城)有限公司 Off-line detection method for touch screen of vehicle machine
WO2021167312A1 (en) * 2020-02-19 2021-08-26 주식회사 픽셀스코프 Touch recognition method and device having lidar sensor
US11868567B2 (en) 2020-02-19 2024-01-09 Pixelscope Inc. Touch recognition method and device having LiDAR sensor
CN113434068A (en) * 2021-05-28 2021-09-24 北京信和时代科技有限公司 Control method and device for suspension shortcut menu, electronic equipment and storage medium
CN113485579A (en) * 2021-06-30 2021-10-08 东莞市小精灵教育软件有限公司 Finger stable frame detection method and device and computer readable storage medium
WO2023272639A1 (en) * 2021-06-30 2023-01-05 东莞市小精灵教育软件有限公司 Stable finger frame detection method and computer-readable storage medium
CN114253417A (en) * 2021-12-02 2022-03-29 Tcl华星光电技术有限公司 Multi-touch-point identification method and device, computer readable medium and electronic equipment
CN114253417B (en) * 2021-12-02 2024-02-02 Tcl华星光电技术有限公司 Multi-touch point identification method and device, computer readable medium and electronic equipment
TWI824723B (en) * 2022-09-16 2023-12-01 大陸商北京集創北方科技股份有限公司 Finger tracking correction method, electronic chip and information processing device

Also Published As

Publication number Publication date
CN109656457B (en) 2021-10-29

Similar Documents

Publication Publication Date Title
CN109656457A (en) Refer to touch control method, device, equipment and computer readable storage medium more
US8452057B2 (en) Projector and projection control method
US11334169B2 (en) Systems and methods for content-aware selection
TWI569171B (en) Gesture recognition
US20110115814A1 (en) Gesture-controlled data visualization
TWI450128B (en) Gesture detecting method, gesture detecting system and computer readable storage medium
US20140298244A1 (en) Portable device using touch pen and application control method using the same
CN109656393A (en) Refer to tracking, device, equipment and the computer readable storage medium of contact more
CN109144304A (en) At least one display window distributing adjustment and touch-control automatic calibrating method and system
US9639167B2 (en) Control method of electronic apparatus having non-contact gesture sensitive region
KR102125212B1 (en) Operating Method for Electronic Handwriting and Electronic Device supporting the same
US10228794B2 (en) Gesture recognition and control based on finger differentiation
US20150205483A1 (en) Object operation system, recording medium recorded with object operation control program, and object operation control method
KR20150145677A (en) Method, system and non-transitory computer-readable recording medium for providing user interface
CN104798014B (en) Subregion switching based on posture
WO2014021005A1 (en) Image processing system, image processing method, and program
CN109999506A (en) The interaction control method and device, storage medium, electronic equipment of object event
WO2016018518A1 (en) Optical tracking of a user-guided object for mobile platform user input
US11301124B2 (en) User interface modification using preview panel
CN109101173A (en) Screen layout&#39;s control method, device, equipment and computer readable storage medium
CN110162257A (en) Multiconductor touch control method, device, equipment and computer readable storage medium
CN102722239A (en) Non-contact control method of mobile device
CN104281381A (en) Apparatus and method for controlling of user interface equipped touch screen
US11093128B2 (en) Touch control system and touch control method of display screen, and electronic device
CN110147169A (en) At least one display window distributing adjustment and touch-control automatic calibrating method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant