CN109656393A - Refer to tracking, device, equipment and the computer readable storage medium of contact more - Google Patents
Refer to tracking, device, equipment and the computer readable storage medium of contact more Download PDFInfo
- Publication number
- CN109656393A CN109656393A CN201710936883.0A CN201710936883A CN109656393A CN 109656393 A CN109656393 A CN 109656393A CN 201710936883 A CN201710936883 A CN 201710936883A CN 109656393 A CN109656393 A CN 109656393A
- Authority
- CN
- China
- Prior art keywords
- frame
- group
- finger contact
- contact
- finger
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04104—Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
Abstract
The invention discloses the trackings that one kind refers to contact more comprising receives the touch information of each frame finger contact；Clustering is carried out to each frame finger contact, obtains multiple groups finger contact；The cluster centre coordinate and the distance between the prediction cluster centre coordinate for comparing each group of finger contact in nth frame, the group number of the smallest two groups of finger contacts of distance in the two are tracked as identical；And compare the finger contact in nth frame and finger prediction contact, the ID number of the smallest finger contact of distance in the two is tracked as identical；Judge to possess in consecutive frame in the group of identical group number and number identical finger contact with the presence or absence of at least one ID, and if it exists, possesses the group of identical group number described in then judging as continuous group；If it does not exist, then possess the group of identical group number described in judging as discontinuous group.Using technical solution provided by the invention, multiconductor tracking can be realized, tracking accuracy is high and tracking velocity is fast.
Description
Technical field
The present invention relates to technical field of touch control, and in particular to a kind of tracking, device, equipment and calculating for more referring to contact
Machine readable storage medium storing program for executing.
Background technique
It, cannot be directly to the contact in two frame of front and back during multi-point touch when touch objects move on the touchscreen
One-to-one association is carried out, thus is unable to get contact track, recognition efficiency and accuracy of identification are lower.
Summary of the invention
In view of this, referring to the tracking of contact, equipment the embodiment of the invention provides one kind more and storage can be read and be situated between
Matter.
On the one hand, the embodiment of the invention provides the trackings that one kind refers to contact more, comprising:
Receive the touch information of each frame finger contact；
Clustering is carried out to each frame finger contact, obtains multiple groups finger contact；
Each group of finger contact is numbered, so that each finger contact is assigned a unique group number and each
A finger contact possesses unique ID number；
Calculate the cluster centre coordinate of each group of finger contact；
For nth frame, each group of the cluster centre coordinate of each group of finger contact in N-1 frame in nth frame is obtained
It predicts cluster centre coordinate, compares the cluster centre coordinate and the prediction cluster centre of each group of finger contact in nth frame
The group number of the smallest two groups of finger contacts of distance in the two is tracked as identical by the distance between coordinate, wherein N be greater than etc.
In 4 integer；
For nth frame, each of N-1 frame finger contact is obtained in each of nth frame finger and predicts contact,
Compare finger contact in nth frame and finger prediction contact, by the ID number of the smallest finger contact of distance in the two with
Track is identical.
Judge to possess in consecutive frame in the group of identical group number and numbers identical finger contact with the presence or absence of at least one ID, if
In the presence of, then judge described in possess the group of identical group number as continuous group；If it does not exist, then possessing the group of identical group number described in judgement is
Discontinuous group.
Second aspect, the embodiment of the invention provides the tracking device that one kind refers to contact more, described device includes:
Receiving unit, for receiving the touch information of each frame finger contact；
Cutting unit obtains multiple groups finger contact for carrying out Clustering to each frame finger contact；
Numbered cell, for each group of finger contact to be numbered, so that each finger contact is assigned one only
One group number and each finger contact possess unique ID number；
Computing unit, for calculating the cluster centre coordinate of each group of finger contact；
First tracking cell, for for the second frame, calculating in first frame and the second frame distance between cluster centre coordinate,
The group number of the smallest two groups of finger contacts of cluster centre coordinate distance is tracked as identical；
Second tracking cell, for obtaining the cluster centre coordinate of each group of finger contact in N-1 frame for nth frame
The each group of prediction cluster centre coordinate in nth frame, compare each group of finger contact in nth frame cluster centre coordinate and
The group number of the smallest two groups of finger contacts of distance in the two is tracked as phase by the distance between described prediction cluster centre coordinate
Together, wherein N is the integer more than or equal to 4；
Third tracking cell will for calculating the distance between finger contact in first frame and the second frame for the second frame
The ID number of the smallest two finger contacts of distance is tracked as identical between finger contact；4th tracking cell, for for N
Frame obtains each of N-1 frame finger contact in each of nth frame finger and predicts contact, compares the hand in nth frame
Refer to that contact is predicted in contact and the finger, the ID number of the smallest finger contact of distance in the two is tracked as identical；
Judging unit is numbered with the presence or absence of at least one ID in the group for judging to possess in consecutive frame identical group number identical
Finger contact, and if it exists, possess the group of identical group number described in then judging as continuous group；If it does not exist, then possess described in judgement
The group of identical group number is discontinuous group.
The third aspect, the embodiment of the invention provides a kind of for referring to that the equipment of contact tracking, the equipment include depositing more
Reservoir and processor, wherein
The memory is for storing executable program code；
The processor is for reading the executable program code stored in the memory to execute described in first aspect
More finger contacts tracking.
Fourth aspect, the embodiment of the invention provides a kind of computer readable storage mediums, including instruction, when it is being calculated
When being run on machine, so that the computer executes the tracking of more finger contacts described in first aspect.
Tracking, device, equipment and the read/write memory medium provided in an embodiment of the present invention for more referring to contact, by right
More finger contacts are grouped, and then are tracked to each of each group of finger contact and each group finger contact.By
This, the present invention can be realized multiconductor tracking, and tracking accuracy is high and tracking velocity is fast.
Detailed description of the invention
Fig. 1 is the flow diagram of the tracking provided by one embodiment of the present invention for more referring to contact.
Fig. 2 is the schematic diagram being split in one embodiment of the invention to the finger contact in a frame.
Fig. 3 a to Fig. 3 c is the schematic diagram of tracking provided by one embodiment of the present invention each group of finger contact movement.
Fig. 4 is the structural schematic diagram of the tracking device for more finger contacts that another embodiment of the present invention provides.
Fig. 5 is the schematic diagram of the tracking equipment for more finger contacts that another embodiment of the present invention provides.
Specific embodiment
Below in conjunction with the specific embodiment technical solution that present invention be described in more detail.It should be appreciated that being described herein as
Specific embodiment be only used to explain the present invention, be not intended to limit the present invention.
Fig. 1 is please referred to, Fig. 1 is the flow diagram of the tracking provided by one embodiment of the present invention for more referring to contact.
This method comprises:
S11: the touch information of each frame finger contact is received.
Dawn known to those skilled in the art, when user carries out referring to touch-control on Touch Screen more, the finger of user
The touch information of contact can for example be collected in various ways by screen and the incidental sensor of screen, as currently known
Resistance type touch control screen, capacitance type touch control screen, induction touch screen, infrared frame type touch screen, surface acoustic wave type touch-control
Screen, what optical induction type touch screen etc. was shown.It passs at any time, sensor can continue to be acquired touch-control, acquisition
Each frame touch information can be sent to processor, and processor receives each frame touch information.
The touch-control can be the touch-control directly contacted, be also possible to the touch-control of off screen, at this time for example by capturing screen
Preceding gesture operation captures the touch-control of respective frame.The Touch Screen for example may include optical touch screen etc..
The Touch Screen can also include for example such as sub-screen: the screen can directly display image (such as LCD display),
Or do not show image (such as wall, cloth curtain), information is projected on screen by projection device and is shown, screen surface is disposed with
Infrared light curtain and thermal camera.When carrying out touch-control on the screen, the light distribution of the infrared light curtain at touch point will be because of touch-control
Behavior and change, such as part infrared light at touch point by touch-control finger is reflected off screen or because of the work of touch-control finger
With screen is transmitted through, infrared camera shoots the infrared image including touch point, captures the touch-control input of user, namely acquisition
Touch information is passed at any time, and thermal camera can acquire multiframe touch information, and each frame touch information can be sent to place
Device is managed, processor receives each frame touch information.
In addition to the above, there are also various screen touch technologies and Touch Screens for the prior art, in view of these technologies
Widely it is known by a person skilled in the art that herein that explanation is not unfolded one by one.
S12: Clustering is carried out to each frame finger contact, obtains multiple groups finger contact.
In this application, it after processor receives the touch information of each frame finger contact, analyzes it, obtains finger
The coordinate information of contact.The coordinate information for inputting each finger contact later is calculated using DBSCAN clustering algorithm, K value cluster
Any one in method, system clustering algorithm or minimum range clustering algorithm carries out cluster point to the finger contact in each frame
Group.It can be appropriately arranged with some conditions when cluster, such as limit the maximum number of points of every cluster less than five and the number of class etc.
Deng, in view of accordingly being clustered according to the position of point, and coefficient adjustment is carried out, waits being well known to those skilled in the art, therefore
Explanation is not unfolded to these algorithms herein.
Referring to Fig. 2, Fig. 2 is that the finger contact in a certain frame is grouped or is divided in one embodiment of the invention
Schematic diagram.The case where including 13 finger contacts is illustratively shown in a frame in Fig. 2, by the experiment of inventor, is used
The grouping effect that DBSCAN clustering algorithm reaches when carrying out Clustering to finger contact is best, is poly- using DBSCAN in Fig. 2
13 finger contacts in one frame are divided into a, b, c, d totally 4 groups by class algorithm.
It is understood that when there is the finger of multiple people to carry out touch-control on touch screen, it can be by multiple people in touch-control
Finger contact cluster on screen is divided into different groups, and so as to everyone finger contact of synchronized tracking, what is handled in this way is good
It is in avoiding in the prior art carrying out a pile point in each frame whole according to the relationship between adjacent two frames finger contact
The identification mistake problem low with recognition efficiency caused by volume tracing.
S13: being numbered each group of finger contact so that each finger contact be assigned a unique group number and
Each finger contact possesses unique ID number.
In this step, when the finger contact in each frame is divided into multiple groups, each group of finger contact is marked, so that
In each frame, each group of finger contact possesses unique group number and each finger contact possesses unique ID number.In difference
In frame, the ID number of each finger contact will not change, but with the movement of finger, each finger in grouping
The assigned group number in contact may change.
Step S14: the cluster centre coordinate of each group of finger contact is calculated.
In this step, the cluster of each group of finger contact can be obtained according to the coordinate information of finger contact in each group
Centre coordinate.Such as: the coordinate of finger contact is respectively (X11, Y11), (X12, Y12), (X13, Y13) in a certain group, then should
The cluster centre coordinate of finger contact is in group
S15: for nth frame, the cluster centre coordinate for obtaining each group of finger contact in N-1 frame is each in nth frame
The prediction cluster centre coordinate of group compares the cluster centre coordinate and prediction cluster of each group of finger contact in nth frame
The group number of the smallest two groups of finger contacts of distance in the two is tracked as identical, wherein N is big by the distance between centre coordinate
In the integer for being equal to 4.
For the 4th frame and later frame, due to each group of finger contact matched completion in previous frame, according to preceding
The time interval of the cluster centre coordinate of each group of finger contact and interframe in N-1 frame, it is poly- can to obtain each group of finger contact
The movement speed and acceleration at class center can be obtained according to the movement speed of each group of finger contact cluster centre and acceleration
The cluster centre coordinate of each group of finger contact each group of prediction cluster centre coordinate in the next frame, will cluster in nth frame
The smallest group of the distance between centre coordinate and prediction cluster centre coordinate is judged as identical group number.
It further, in some embodiments, can be according to each group of finger contact in front cross frame for third frame
Cluster centre coordinate and inter frame temporal interval, the movement speed of the cluster centre of each group of finger contact can be obtained, according to
The movement speed of each group of finger contact cluster centre and inter frame temporal interval, can obtain each group cluster center in third frame
In each group of prediction cluster centre coordinate, group cluster each in third frame center and the prediction cluster centre are compared
Compared with thinking that group number is identical apart from the smallest one group with the prediction cluster centre.
Further, in some embodiments, for the second frame, can calculate and first frame between cluster centre coordinate
Distance, select the two in minimum range, judge the group number of the smallest two groups of finger contacts of cluster centre coordinate distance for phase
Together.In some embodiments, it can further limit, if the minimum range in the two is within a preset range, judge to cluster
Group number of the centre coordinate apart from the smallest two groups of finger contacts is identical.
It is further illustrated below with reference to attached drawing.A to Fig. 3 c referring to figure 3., Fig. 3 a to Fig. 3 c are one implementation of the present invention
The schematic diagram for the tracking each group of finger contact movement that example provides.By taking each group finger contact of second frame into the 4th frame as an example
It is illustrated, while for clarity, be not illustrated here the finger contact in each group, each group is only illustrated with circle.Wherein, scheme
A (1), b (1), c (1) respectively indicate the position view of a group, b group and c group in the second frame in 3a, in fig 3b, empty
Line part a (1), b (1), c (1) respectively indicate the position of a group, b group and c group in the second frame, bold portion a (2), b
(2), c (2) respectively indicates the position of a group, b group and c group in third frame, in figure 3 c, dotted portion a (2), b (2), c
(2) position of a group, b group and c group in third frame is respectively indicated, bold portion a (3), b (3), c (3) respectively indicate
The position of a group, b group and c group in four frames, chain-dotted line part b0 indicate prediction cluster centre of the b group in the 4th frame
Coordinate.Illustrate the case where tracking the movement of b group below with reference to Fig. 3 a to Fig. 3 c.
In the second frame according to complete with the minimum range in first frame between the cluster centre coordinate of each group of finger contact
At the matching of each group of finger contact, for third frame or the 4th frame, if continued according to each group of finger in consecutive frame
Minimum range between the cluster centre coordinate of contact carries out the matching between group and group, then will appear the feelings of erroneous matching
Condition.For example, for the 4th frame, c referring to figure 3., due to c in b group finger contact b (2) in third frame and the 4th frame
The distance h of group finger contact c (3) is minimum, if continue according to each group of finger contact in consecutive frame cluster centre coordinate it
Between minimum range carry out the matching between group and group, then will appear b group finger contact b (2) in third frame mistakenly
The case where matching is group finger contact (3) c c in the 4th frame.Therefore, in order to improve the tracking accuracy between group and group, this hair
The bright finger contact later for third frame and third frame, is respectively adopted following tracking:
The frame later for third frame: please referring to Fig. 3 c, according to the seat of first frame cluster centre of b group into third frame
Mark and acquisition interval determine the movement speed and acceleration at b group cluster center, in turn according to the movement speed and acceleration
Prediction cluster centre coordinate b0 (chain-dotted line part as illustrated in figure 3 c) of the b group finger contact in the 4th frame can be obtained,
Calculate the distance between cluster centre coordinate and the prediction cluster centre coordinate b0 of each group of finger contact in the 4th frame, discovery
The distance of the cluster centre coordinate distance prediction cluster centre coordinate b0 of b group finger contact b (3) is minimum in 4th frame, therefore
B (3) in 4th frame is organized into finger contact matching and improves tracking accuracy for b group so as to avoid erroneous matching.
For third frame, according to the cluster centre coordinate of each group of finger contact in front cross frame and inter frame temporal interval, obtain
The speed of the cluster centre of each group of finger contact in the second frame, according to the speed of the cluster centre of each group of finger contact,
Obtain each group prediction cluster centre coordinate of the cluster centre coordinate of each group of finger contact in the second frame in third frame；It
Compare the cluster centre coordinate and the distance between the prediction cluster centre coordinate of each group of finger contact in third frame afterwards,
The group number of the smallest two groups of finger contacts of distance in the two is tracked as identical.
S16: it for nth frame, obtains each of N-1 frame finger contact and is predicted in each of nth frame finger
Contact compares the finger contact in nth frame and finger prediction contact, the ID of the smallest finger contact of distance in the two is compiled
It number is tracked as identical.
In this step, in the tracking of each finger contact in each group and step S15 to each group with
Track method is similar, can refer to step S15 and is understood that details are not described herein again.
S17: judge to possess in consecutive frame in the group of identical group number and number identical finger touching with the presence or absence of at least one ID
Point, and if it exists, possess the group of identical group number described in then judging as continuous group；If it does not exist, then possess identical group number described in judgement
Group be discontinuous group.
In this step, complete to the tracking of all finger contacts after, to the finger contact in each group carry out with
Track determines in the group of identical group number that whether at least there is an ID numbers identical finger contact, if it is present illustrating the group
In have finger touch always, to judge that the group is continuous group, be achieved in the tracking to touch-control；If it does not exist, then explanation
User has been likely to occur one group of finger during touch-control and has lifted situations such as frameing out completely.
In some embodiments, as N > 4, for nth frame, can according in preceding N-1 frame each group of finger contact it is poly-
Class centre coordinate and inter frame temporal interval, obtain N-1 frame in each group of finger contact cluster centre speed, acceleration and
The first derivative values of acceleration are led according to the single order of the speed, acceleration of the cluster centre of each group of finger contact and acceleration
Numerical value obtains each group prediction cluster centre of the cluster centre coordinate of each group of finger contact in N-1 frame in nth frame and sits
Mark；And N- is obtained according to the coordinate information of each finger contact and inter frame temporal interval in preceding N-1 frame for nth frame
The first derivative values of the speed, acceleration of each finger contact and acceleration in 1 frame, according to the speed of each finger contact
It spends, the first derivative values of acceleration and acceleration, each finger contact is in each of nth frame hand in acquisition N-1 frame
Refer to prediction contact.Obtain prediction cluster centre coordinate and finger prediction contact after, it is remaining processing as previously mentioned, herein from
Slightly.Herein, by considering the first derivative values of acceleration, it can more accurately expect finger contact or cluster centre at next frame
In prediction cluster centre coordinate and finger predict contact.
When using the tracking provided in an embodiment of the present invention for more referring to contact, multiconductor tracking, while energy can be realized
Enough improve tracking accuracy and speed.
Referring to Fig. 4, Fig. 4 is the structural representation of the tracking device for more finger contacts that another embodiment of the present invention provides
Figure.Described device includes receiving unit 21, cutting unit 22, numbered cell 23, computing unit 24, the second tracking cell 26 and
Four tracking cell 28.
Wherein, receiving unit 21 is used to receive the touch information of each frame finger contact；Cutting unit 22 is used for described
Finger contact in each frame carries out Clustering, obtains multiple groups finger contact；Numbered cell 23 is used to touch each group of finger
Point is numbered, so that each finger contact is assigned a unique group number and each finger contact possesses unique ID and compiles
Number；Computing unit 24 is used to calculate the cluster centre coordinate of each group of finger contact；First tracking cell 25 is used for for second
Frame calculates in first frame and the second frame distance between cluster centre coordinate, by the smallest two groups of fingers of cluster centre coordinate distance
The group number of contact is tracked as identical；Second tracking cell 26 is used to obtain each group of finger contact in N-1 frame for nth frame
Each group prediction cluster centre coordinate of the cluster centre coordinate in nth frame, compare each group of finger contact in nth frame
The distance between cluster centre coordinate and the prediction cluster centre coordinate, by the smallest two groups of finger contacts of distance in the two
Group number is tracked as identical, wherein N is the integer more than or equal to 4；4th tracking cell 28 is used to calculate first for the second frame
The distance between finger contact in frame and the second frame, by the ID of the smallest two finger contacts of distance between finger contact number with
Track is identical.
Wherein, cutting unit 22 is used to obtain the coordinate information of finger contact in each frame, is believed according to the coordinate
Breath, using any one in DBSCAN clustering algorithm, K value clustering algorithm, system clustering algorithm or minimum range clustering algorithm
Divide the finger contact in each frame, obtains multiple groups finger contact.
Second tracking cell 26 is used for for nth frame, according to the cluster centre coordinate of each group of finger contact in preceding N-1 frame
And inter frame temporal interval, the velocity and acceleration of the cluster centre of each group of finger contact in N-1 frame is obtained, according to each group
The velocity and acceleration of the cluster centre of finger contact, the cluster centre coordinate for obtaining each group of finger contact in N-1 frame exist
Each group of prediction cluster centre coordinate in nth frame.
4th tracking cell 28 is used for for nth frame, according to the coordinate information and frame of each finger contact in preceding N-1 frame
Between time interval, obtain N-1 frame in each finger contact velocity and acceleration, according to the speed of each finger contact
And acceleration, obtain N-1 frame in each finger contact each of nth frame finger predict contact.
Refer to the tracking device of contact, the tracking with more finger contacts described above provided by the embodiment of the present invention more
Belong to same design, times provided in the tracking embodiment for more referring to contact can be provided on the tracking device for more referring to contact
A kind of method, specific implementation process are detailed in the embodiment for more referring to the tracking of contact, and details are not described herein again.
When using the tracking device provided in an embodiment of the present invention for more referring to contact, multiconductor tracking, while energy can be realized
Enough improve tracking accuracy and speed.
Referring to figure 5., Fig. 5 is the schematic structure of the tracking equipment for more finger contacts that another embodiment of the present invention provides
Figure.In conjunction with the above-mentioned tracking for more referring to contact at least part can by for referring to that the tracking equipment 300 of contact is realized more,
The equipment 300 includes processor 31, memory 32 and bus 33.
In some instances, the equipment 300 can also include input equipment 301, input port 302, output port 303,
And output equipment 304.Wherein, input port 302, processor 31, memory 32 and output port 303 pass through bus 33
It is connected with each other, input equipment 301 and output equipment 303 are connected by input port 302 and output port 303 and bus 33 respectively
It connects, and then is connect with the other assemblies of equipment 300.It should be noted that output interface and input interface here can also be used
I/O interface indicates.Specifically, input equipment 301 is received from external input information, such as touch information, and passes through input
Port 302 is transmitted to processor 31 for information is inputted；Processor 31 is based on the computer executable instructions stored in memory 32
Input information is handled to generate output information, such as track identification tracks situation, output information is interim or permanent
Ground stores in memory 32, and output information is then transmitted to output equipment 303 by output port 303；Output equipment 303
Output information is output to the outside of equipment.
Above-mentioned memory 32 includes the mass storage for data or instruction.For example it rather than limits, memory
32 may include HDD, floppy disk drive, flash memory, CD, magneto-optic disk, tape or universal serial bus (USB) driver or two
Or more the above combination.In a suitable case, memory 32 may include removable or non-removable (or fixed)
Medium.In a suitable case, memory 32 can be inside or outside equipment.In a particular embodiment, memory 32 is
Non-volatile solid state memory.In a particular embodiment, memory 32 includes read-only memory (ROM).In a suitable case,
The ROM can be the ROM of masked edit program, programming ROM (PROM), erasable PROM (EPROM), electric erasable PROM
(EEPROM), electrically-alterable ROM (EAROM) or the combination of flash memory or two or more the above.
Bus 33 includes hardware, software or both, and the component of equipment 300 is coupled to each other together.For example rather than
Limitation, bus 33 may include accelerated graphics port (AGP) or other graphics bus, enhancing Industry Standard Architecture (EISA) bus,
Front side bus (FSB), super transmission (HT) interconnection, the interconnection of Industry Standard Architecture (ISA) bus, infinite bandwidth, low pin count (LPC)
Bus, memory bus, micro- channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X)
Bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association part (VLB) bus or other suitable buses
Or the combination of two or more the above.In a suitable case, bus 33 may include one or more buses 33.To the greatest extent
Specific bus has been described and illustrated in the pipe embodiment of the present invention, but the present invention considers any suitable bus or interconnection.
When realizing the tracking for combining more finger contacts of Fig. 1 description by equipment 300 shown in fig. 5, input equipment
301 receive the touch information of each frame finger contact, and in a particular embodiment, the I/O interface being connected with output equipment can wrap
Hardware, software or both are included, one or more interfaces of the communication between equipment 300 and one or more I/O equipment are provided.It lifts
It for example rather than limits, I/O equipment may include video camera.The processor 31 is executable based on the computer stored in memory 32
Instruction, in each frame finger contact carry out Clustering, obtain multiple groups finger contact, to each group of finger contact into
Row number, so that each finger contact is assigned a unique group number and each finger contact possesses unique ID number,
Track the group number of each group of finger contact and the ID number of each finger contact in each group respectively, realize mostly finger contact with
Track.
According to some embodiments, a kind of computer readable storage medium is provided, may include instruction, when it is in computer
When upper operation, computer can be made to execute the tracking of above-mentioned more finger contacts.
In some instances, a kind of computer program product comprising instruction is provided, when run on a computer,
So that computer executes the tracking of above-mentioned more finger contacts.
In some instances, a kind of computer program is provided, when run on a computer, so that computer executes
The tracking of above-mentioned more finger contacts.
In the examples described above, it can be realized wholly or partly by software, hardware, firmware or any combination thereof.
When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program produces
Product include one or more computer instructions.When loading on computers and executing the computer program instructions, whole or portion
Ground is divided to generate according to process or function described in the embodiment of the present invention.The computer can be general purpose computer, dedicated computing
Machine, computer network or other programmable devices.The computer instruction can store in computer readable storage medium
In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer
Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center
User's line (DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or
Data center is transmitted.The computer readable storage medium can be any usable medium that computer can access or
It is comprising data storage devices such as one or more usable mediums integrated server, data centers.The usable medium can be with
It is magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard disk
Solid State Disk (SSD)) etc..
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or replace
It changes, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with right
It is required that protection scope subject to.
Claims (10)
1. a kind of tracking for more referring to contact, which is characterized in that the described method includes:
Receive the touch information of each frame finger contact；
Clustering is carried out to each frame finger contact, obtains multiple groups finger contact；
Each group of finger contact is numbered, so that each finger contact is assigned a unique group number and each hand
Refer to that contact possesses unique ID number；
Calculate the cluster centre coordinate of each group of finger contact；
For nth frame, each group prediction of the cluster centre coordinate of each group of finger contact in N-1 frame in nth frame is obtained
Cluster centre coordinate compares the cluster centre coordinate and the prediction cluster centre coordinate of each group of finger contact in nth frame
The distance between, the group number of the smallest two groups of finger contacts of distance in the two is tracked as identical, wherein N is more than or equal to 4
Integer；
For nth frame, each of N-1 frame finger contact is obtained in each of nth frame finger and predicts contact, is compared
Finger contact and the finger in nth frame predict contact, and the ID number of the smallest finger contact of distance in the two is tracked as
It is identical；
Judge to possess in consecutive frame in the group of identical group number and number identical finger contact with the presence or absence of at least one ID, if depositing
, then judge described in possess the group of identical group number as continuous group；If it does not exist, then possess the group of identical group number described in judging as not
Continuous group.
2. the tracking according to claim 1 for more referring to contact characterized by comprising
The coordinate information for obtaining finger contact in each frame, according to the coordinate information, using DBSCAN clustering algorithm, K
It is worth any one in clustering algorithm, system clustering algorithm or minimum range clustering algorithm to the finger contact in each frame
Clustering is carried out, multiple groups finger contact is obtained.
3. the tracking according to claim 1 for more referring to contact, which is characterized in that
For the second frame, distance between cluster centre coordinate is calculated in first frame and the second frame, most by cluster centre coordinate distance
The group number of two groups of small finger contacts is tracked as identical；
For the second frame, the distance between finger contact in first frame and the second frame is calculated, distance between finger contact is minimum
Two finger contacts ID number be tracked as it is identical.
4. the tracking according to claim 3 for more referring to contact, which is characterized in that for third frame, according to front cross frame
In each group of finger contact cluster centre coordinate and inter frame temporal interval, obtain the cluster of each group of finger contact in the second frame
The speed at center obtains in the second frame the poly- of each group of finger contact according to the speed of the cluster centre of each group of finger contact
Each group prediction cluster centre coordinate of the class centre coordinate in third frame；
The second frame is obtained according to the coordinate information of each finger contact in front cross frame and inter frame temporal interval for third frame
In the speed of each finger contact obtain each finger contact in the second frame and exist according to the speed of each finger contact
Each of third frame finger predicts contact.
5. the tracking according to claim 1,2,3 or 4 for more referring to contact, which is characterized in that for nth frame, according to
The cluster centre coordinate of each group of finger contact and inter frame temporal interval in preceding N-1 frame obtain each group of finger touching in N-1 frame
The velocity and acceleration of the cluster centre of point obtains the according to the velocity and acceleration of the cluster centre of each group of finger contact
Each group prediction cluster centre coordinate of the cluster centre coordinate of each group of finger contact in nth frame in N-1 frame；
N-1 frame is obtained according to the coordinate information of each finger contact and inter frame temporal interval in preceding N-1 frame for nth frame
In the velocity and acceleration of each finger contact obtained in N-1 frame according to the velocity and acceleration of each finger contact
Each finger contact predicts contact in each of nth frame finger.
6. the tracking according to claim 1,2,3 or 4 for more referring to contact, which is characterized in that as N > 4, for N
Frame obtains each in N-1 frame according to the cluster centre coordinate of each group of finger contact in preceding N-1 frame and inter frame temporal interval
The speed, acceleration of the cluster centre of group finger contact and the first derivative values of acceleration, according to the poly- of each group of finger contact
The speed, acceleration at class center and the first derivative values of acceleration obtain the cluster centre of each group of finger contact in N-1 frame
Each group prediction cluster centre coordinate of the coordinate in nth frame；
N-1 frame is obtained according to the coordinate information of each finger contact and inter frame temporal interval in preceding N-1 frame for nth frame
In the speed, acceleration of each finger contact and the first derivative values of acceleration, according to the speed of each finger contact, plus
The first derivative values of velocity and acceleration obtain each finger contact in N-1 frame and predict in each of nth frame finger
Contact.
7. a kind of tracking device of mostly finger contact, which is characterized in that described device includes:
Receiving unit, for receiving the touch information of each frame finger contact；
Cutting unit obtains multiple groups finger contact for carrying out Clustering to each frame finger contact；
Numbered cell, for each group of finger contact to be numbered, so that each finger contact is assigned one uniquely
Group number and each finger contact possess unique ID number；
Computing unit, for calculating the cluster centre coordinate of each group of finger contact；
First tracking cell will gather for for the second frame, calculating in first frame and the second frame distance between cluster centre coordinate
Group number of the class centre coordinate apart from the smallest two groups of finger contacts is tracked as identical；
Second tracking cell, for obtaining the cluster centre coordinate of each group of finger contact in N-1 frame in N for nth frame
Each group of prediction cluster centre coordinate in frame compares the cluster centre coordinate of each group of finger contact in nth frame and described
Predict the distance between cluster centre coordinate, the group number of the smallest two groups of finger contacts of distance in the two is tracked as it is identical,
In, N is the integer more than or equal to 4；
Third tracking cell, for the distance between finger contact in first frame and the second frame being calculated, by finger for the second frame
The ID number of the smallest two finger contacts of distance is tracked as identical between contact；
4th tracking cell, for obtaining each of N-1 frame finger contact in each of nth frame for nth frame
Finger predicts contact, compares the finger contact in nth frame and finger prediction contact, the smallest finger of distance in the two is touched
The ID number of point is tracked as identical；
Judging unit numbers identical hand with the presence or absence of at least one ID in the group for judging to possess in consecutive frame identical group number
Refer to contact, and if it exists, possess the group of identical group number described in then judging as continuous group；If it does not exist, then possess described in judgement identical
The group of group number is discontinuous group.
8. the tracking device according to claim 7 for more referring to contact, which is characterized in that
Second tracking cell is used for for nth frame, according to the cluster centre coordinate of each group of finger contact in preceding N-1 frame
And inter frame temporal interval, the velocity and acceleration of the cluster centre of each group of finger contact in N-1 frame is obtained, according to each group
The velocity and acceleration of the cluster centre of finger contact, the cluster centre coordinate for obtaining each group of finger contact in N-1 frame exist
Each group of prediction cluster centre coordinate in nth frame；
4th tracking cell is used for for nth frame, according to the coordinate information and frame of each finger contact in preceding N-1 frame
Between time interval, obtain N-1 frame in each finger contact velocity and acceleration, according to the speed of each finger contact
And acceleration, obtain N-1 frame in each finger contact each of nth frame finger predict contact.
9. a kind of for referring to the equipment of contact tracking, which is characterized in that the equipment includes memory and processor more, wherein
The memory is for storing executable program code；The processor is for reading the executable journey stored in the memory
Sequence code is with the tracking of more finger contacts described in any one of perform claim requirement 1 to 4.
10. a kind of computer readable storage medium, which is characterized in that including instruction, when run on a computer, so that institute
Computer is stated to execute such as the tracking described in any one of claims 1 to 6 for more referring to contact.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710936883.0A CN109656393A (en) | 2017-10-10 | 2017-10-10 | Refer to tracking, device, equipment and the computer readable storage medium of contact more |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710936883.0A CN109656393A (en) | 2017-10-10 | 2017-10-10 | Refer to tracking, device, equipment and the computer readable storage medium of contact more |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109656393A true CN109656393A (en) | 2019-04-19 |
Family
ID=66108809
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710936883.0A Pending CN109656393A (en) | 2017-10-10 | 2017-10-10 | Refer to tracking, device, equipment and the computer readable storage medium of contact more |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109656393A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110309023A (en) * | 2019-06-20 | 2019-10-08 | 佛吉亚好帮手电子科技有限公司 | Vehicle device touch screen off line detection method |
| CN113069756A (en) * | 2020-01-03 | 2021-07-06 | 北京小米移动软件有限公司 | Touch signal control method, touch signal control device and storage medium |
| CN113485579A (en) * | 2021-06-30 | 2021-10-08 | 东莞市小精灵教育软件有限公司 | Finger stable frame detection method and device and computer readable storage medium |
| CN114253417A (en) * | 2021-12-02 | 2022-03-29 | Tcl华星光电技术有限公司 | Multi-touch-point identification method and device, computer readable medium and electronic equipment |
| TWI824723B (en) * | 2022-09-16 | 2023-12-01 | 大陸商北京集創北方科技股份有限公司 | Finger tracking correction method, electronic chip and information processing device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693025A (en) * | 2011-03-21 | 2012-09-26 | 中国科学院软件研究所 | Touch finger identification method for multi-touch interaction system |
| CN103389799A (en) * | 2013-07-24 | 2013-11-13 | 清华大学深圳研究生院 | Method for tracking motion trail of fingertip |
| JP2014147063A (en) * | 2013-01-21 | 2014-08-14 | Keypoint Technologies (Uk) Ltd | Text input method and apparatus |
| CN106527917A (en) * | 2016-09-23 | 2017-03-22 | 北京仁光科技有限公司 | Multi-finger touch operation identification method for screen interactive system |
| CN106569630A (en) * | 2016-09-30 | 2017-04-19 | 南京仁光电子科技有限公司 | Method for detecting number of touch control system screen contacts |
-
2017
- 2017-10-10 CN CN201710936883.0A patent/CN109656393A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693025A (en) * | 2011-03-21 | 2012-09-26 | 中国科学院软件研究所 | Touch finger identification method for multi-touch interaction system |
| JP2014147063A (en) * | 2013-01-21 | 2014-08-14 | Keypoint Technologies (Uk) Ltd | Text input method and apparatus |
| CN103389799A (en) * | 2013-07-24 | 2013-11-13 | 清华大学深圳研究生院 | Method for tracking motion trail of fingertip |
| CN106527917A (en) * | 2016-09-23 | 2017-03-22 | 北京仁光科技有限公司 | Multi-finger touch operation identification method for screen interactive system |
| CN106569630A (en) * | 2016-09-30 | 2017-04-19 | 南京仁光电子科技有限公司 | Method for detecting number of touch control system screen contacts |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110309023A (en) * | 2019-06-20 | 2019-10-08 | 佛吉亚好帮手电子科技有限公司 | Vehicle device touch screen off line detection method |
| CN110309023B (en) * | 2019-06-20 | 2022-11-15 | 佛吉亚歌乐电子(丰城)有限公司 | Off-line detection method for touch screen of vehicle machine |
| CN113069756A (en) * | 2020-01-03 | 2021-07-06 | 北京小米移动软件有限公司 | Touch signal control method, touch signal control device and storage medium |
| CN113485579A (en) * | 2021-06-30 | 2021-10-08 | 东莞市小精灵教育软件有限公司 | Finger stable frame detection method and device and computer readable storage medium |
| CN114253417A (en) * | 2021-12-02 | 2022-03-29 | Tcl华星光电技术有限公司 | Multi-touch-point identification method and device, computer readable medium and electronic equipment |
| CN114253417B (en) * | 2021-12-02 | 2024-02-02 | Tcl华星光电技术有限公司 | Multi-touch point identification method and device, computer readable medium and electronic equipment |
| TWI824723B (en) * | 2022-09-16 | 2023-12-01 | 大陸商北京集創北方科技股份有限公司 | Finger tracking correction method, electronic chip and information processing device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109656393A (en) | Refer to tracking, device, equipment and the computer readable storage medium of contact more | |
| US20220383535A1 (en) | Object Tracking Method and Device, Electronic Device, and Computer-Readable Storage Medium | |
| CN109656457A (en) | Refer to touch control method, device, equipment and computer readable storage medium more | |
| TWI569171B (en) | Gesture recognition | |
| US8773377B2 (en) | Multi-pass touch contact tracking | |
| US9746975B2 (en) | Capacitive measurement processing for mode changes | |
| US20160004380A1 (en) | Method of performing a touch action in a touch sensitive device | |
| JP2017529582A (en) | Touch classification | |
| EP2673691A2 (en) | Prediction-based touch contact tracking | |
| TW201324236A (en) | Gesture detecting method, gesture detecting system and computer readable storage medium | |
| CN105955525B (en) | Touch track tracking, device and display equipment | |
| CN104885051A (en) | Multi-touch symbol recognition | |
| WO2017067164A1 (en) | Method and apparatus for recognising multi-finger closing or opening gesture and terminal device | |
| US20120124526A1 (en) | Method for continuing a function induced by a multi-touch gesture on a touchpad | |
| WO2014160425A1 (en) | Proximity sensing | |
| US11023076B2 (en) | Touch panel input item correction in accordance with angle of deviation | |
| EP3427139B1 (en) | Electronic device and input processing method thereof | |
| CN110764652A (en) | Infrared touch screen and touch point prediction method thereof | |
| CN103823583A (en) | Method and device for processing multi-point touch information | |
| CN109101173A (en) | Screen layout's control method, device, equipment and computer readable storage medium | |
| CN105892895A (en) | Multi-finger sliding gesture recognition method and device as well as terminal equipment | |
| US20160283017A1 (en) | Hybrid detection for a capacitance input device | |
| CN110162257A (en) | Multiconductor touch control method, device, equipment and computer readable storage medium | |
| CN105190516A (en) | Detection of pan and scaling during multi-finger touch interactions | |
| CN103513762A (en) | Operating method using user gesture and digital device thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190419 |
|
| RJ01 | Rejection of invention patent application after publication |