CN107066944B - A kind of localization method and device of Fingers root - Google Patents
A kind of localization method and device of Fingers root Download PDFInfo
- Publication number
- CN107066944B CN107066944B CN201710128264.9A CN201710128264A CN107066944B CN 107066944 B CN107066944 B CN 107066944B CN 201710128264 A CN201710128264 A CN 201710128264A CN 107066944 B CN107066944 B CN 107066944B
- Authority
- CN
- China
- Prior art keywords
- finger
- finger tip
- point
- line segment
- rectangle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
- G06V40/113—Recognition of static hand signs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
- G06V40/11—Hand-related biometrics; Hand pose recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Image Analysis (AREA)
Abstract
The present invention provides the localization method and device of a kind of Fingers root, this method comprises: obtaining the hand outline information in present image, the hand outline information includes palm profile, finger contours and finger tip；For each finger tip, using the finger tip as starting point, determine through the corresponding finger contours of the finger tip to the ray of the bottom of the palm profile；The ray and the intersection point of the bottom of palm profile to the line segment between the finger tip are determined as the corresponding line segment of the finger tip；Centered on the set point on the corresponding line segment of the finger tip, determine that a default rectangle with preset length and predetermined width, the long side of default rectangle line segment corresponding with the finger tip are orthogonal；According to the number of edge pixel point in the default rectangle, determine in the default rectangle whether include the corresponding finger of the finger tip finger root.The present invention provides the technical solutions of accurate positioning Fingers root.
Description
Technical field
The present invention relates to technical field of hand gesture recognition more particularly to a kind of localization methods and device of Fingers root.
Background technique
Human-computer interaction has become an important component of people's daily life, especially in recent years, with calculating
The fast development of machine technology, the human-computer interaction technology based on gesture identification have become research hotspot.Gesture identification defines one
A little gestures, computer control computer by identifying different mobile phones.The mode of gesture control computer with it is other
The mode of control computer compares, and has the characteristics that naturality, terseness and rich, direct.
For gesture identification, key technology is how to efficiently extract the position of finger fingertip, the centre of the palm in the picture
It sets, extracts the process in the centre of the palm, finger fingertip at present are as follows: extract the hand profile in present image first, the hand profile packet
Include: palm profile, stretching finger contours；Then the width and height of palm are determined, it is true according to the width of palm and height
Make position of the palm in present image；Position of the centre of the palm in present image is determined later, and according in present image
Position of the extreme point as finger fingertip in present image.
Although in the prior art can the accurate extraction palm centre of the palm and finger tip, thus using extraction the centre of the palm and refer to
Point carries out gesture identification, and still, manpower is podomere system more than one, and each finger has multiple joints, therefore, the difference of articulations digitorum manus
Bending degree can also cause a degree of influence to gesture identification, refer in particular to root, if it is possible to accurately determine to refer to that root exists
Position in image, it will promote the accuracy of gesture identification, but there are no the skills that positioning refers to root in the prior art
Art scheme.
Summary of the invention
The present invention provides the localization method and device of a kind of Fingers root, provides the skill of accurate positioning Fingers root
Art scheme, so as to be contributed to a certain extent the promotion of the accuracy of gesture identification.
A kind of localization method of Fingers root, comprising:
Obtain present image in hand outline information, the hand outline information include palm profile, finger contours with
And finger tip；
For each finger tip, using the finger tip as starting point, determine through the corresponding finger contours of the finger tip to the palm profile
Bottom ray；
It is corresponding that the ray with the intersection point of the bottom of palm profile to the line segment between the finger tip is determined as the finger tip
Line segment；
Centered on the set point on the corresponding line segment of the finger tip, determine that one is default with preset length and predetermined width
Rectangle, the long side of default rectangle line segment corresponding with the finger tip are orthogonal；
According to the number of edge pixel point in the default rectangle, whether determine in the default rectangle comprising the finger tip pair
The finger root for the finger answered.
In the method, each finger tip is located on the central axes of corresponding finger contours, then using the finger tip as starting point, determines
Through the corresponding finger contours of the finger tip to the ray of the bottom of the palm profile, specifically include:
Using the finger tip as starting point, the bottom of the central axes through the corresponding finger contours of the finger tip, Xiang Suoshu palm profile is done
Ray.
The embodiment of the present invention is that the accuracy for referring to root positioning can be improved according to ray is done with the central axes of finger contours
In the method, the set point to the bottom of line segment length and the ray and palm profile between the finger tip
Intersection point to the line segment length between the set point ratio within the set range.
In the method, determine in the default rectangle whether include the corresponding finger of the finger tip finger root, specifically include:
Determine the corresponding external envelope rectangle of the default rectangle；
Edge detection is carried out to the pixel in the external envelope rectangle according to default edge detection algorithm；
Using the central point of default rectangle as starting point, according to mean shift clustering algorithm, in the default rectangle
Edge pixel point is clustered；
Determine the edge pixel point number that the mean shift clustering algorithm clusters；
Calculate the ratio of the pixel total number in the edge pixel point number and the default rectangle；
According to the ratio and preset threshold, the finger root of the corresponding finger of the finger tip is determined.
The embodiment of the present invention, the edge pixel point number obtained according to clustering algorithm account for pixel total number in default rectangle
Ratio determination refer to root.
In the method, according to the ratio and preset threshold, the finger root of the corresponding finger of the finger tip is determined, it is specific to wrap
It includes:
Judge whether the ratio is greater than the preset threshold；
If so, the edge pixel point number for being included according to every row in the default rectangle determines the corresponding finger of the finger tip
Finger root；
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute on the corresponding line segment of the finger tip
Centered on set point, determine that one has the step of default rectangle of preset length and predetermined width.
In the embodiment of the present invention, when ratio is not more than preset threshold, set point is chosen again and determines default rectangle, from
And re-start the positioning for referring to root.
In the method, the edge pixel point number for being included according to every row in the default rectangle determines that the finger tip is corresponding
Finger finger root, specifically include:
For every row pixel in the default rectangle, the number of continuous boundary pixel in the row pixel is determined；
Extract the number maximum value of continuous boundary pixel in the row pixel；
According to descending suitable of the number maximum value of continuous boundary pixel in each row pixel in the default rectangle
Sequence chooses setting number row pixel；
Every row pixel of selection is linked in sequence, the corresponding line segment of every row pixel chosen；
Judge that whether corresponding with the finger tip the corresponding line segment of the every row pixel line segment chosen be orthogonal；
If so, determining that the default rectangle is the finger root of the corresponding finger of the finger tip.
The embodiment of the present invention, the accuracy for the Fingers root that can further orient.
The method, further includes:
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute on the corresponding line segment of the finger tip
Centered on set point, determine that one has the step of default rectangle of preset length and predetermined width.
The embodiment of the present invention, the accuracy for the Fingers root that can further orient.
The present invention also provides a kind of positioning devices of Fingers root, comprising:
Acquiring unit, for obtaining the hand outline information in present image, the hand outline information includes palm wheel
Wide, finger contours and finger tip；
First determination unit, using the finger tip as starting point, is determined through the corresponding finger wheel of the finger tip for being directed to each finger tip
Ray of the exterior feature to the bottom of the palm profile；
Second determination unit, for the intersection point of the bottom of the ray and palm profile is true to the line segment between the finger tip
It is set to the corresponding line segment of the finger tip；
Third determination unit, for centered on the set point on the corresponding line segment of the finger tip, determining that one has default length
The default rectangle of degree and predetermined width, the long side of default rectangle line segment corresponding with the finger tip are orthogonal；
4th determination unit determines the default rectangle for the number according to edge pixel point in the default rectangle
In whether include the corresponding finger of the finger tip finger root.
In described device, each finger tip is located on the central axes of corresponding finger contours, then first determination unit, tool
Body is used for:
Using the finger tip as starting point, the bottom of the central axes through the corresponding finger contours of the finger tip, Xiang Suoshu palm profile is done
Ray.
In described device, the set point to the bottom of line segment length and the ray and palm profile between the finger tip
Intersection point to the line segment length between the set point ratio within the set range.
In described device, the 4th determination unit is specifically used for:
Determine the corresponding external envelope rectangle of the default rectangle；
Edge detection is carried out to the pixel in the external envelope rectangle according to default edge detection algorithm；
Using the central point of default rectangle as starting point, according to mean shift clustering algorithm, in the default rectangle
Edge pixel point is clustered；
Determine the edge pixel point number that the mean shift clustering algorithm clusters；
Calculate the ratio of the pixel total number in the edge pixel point number and the default rectangle；
According to the ratio and preset threshold, the finger root of the corresponding finger of the finger tip is determined.
In described device, the 4th determination unit according to the ratio and preset threshold, is determining that the finger tip is corresponding
Finger finger root when, be specifically used for:
Judge whether the ratio is greater than the preset threshold；
If so, the edge pixel point number for being included according to every row in the default rectangle determines the corresponding finger of the finger tip
Finger root；
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute on the corresponding line segment of the finger tip
Centered on set point, determine that one has the step of default rectangle of preset length and predetermined width.
In described device, the 4th determination unit is in the edge pixel point for being included according to every row in the default rectangle
When number determines the finger root of the corresponding finger of the finger tip, it is specifically used for:
For every row pixel in the default rectangle, the number of continuous boundary pixel in the row pixel is determined；
Extract the number maximum value of continuous boundary pixel in the row pixel；
According to descending suitable of the number maximum value of continuous boundary pixel in each row pixel in the default rectangle
Sequence chooses setting number row pixel；
Every row pixel of selection is linked in sequence, the corresponding line segment of every row pixel chosen；
Judge that whether corresponding with the finger tip the corresponding line segment of the every row pixel line segment chosen be orthogonal；
If so, determining that the default rectangle is the finger root of the corresponding finger of the finger tip.
In described device, the 4th determination unit is also used to:
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute on the corresponding line segment of the finger tip
Centered on set point, determine that one has the step of default rectangle of preset length and predetermined width.
Using the localization method and device of Fingers root provided in an embodiment of the present invention, have the advantages that due to
Refer to root zone domain in edge pixel point number it is relatively more, relatively concentration, using palm profile, finger contours and finger fingertip into
Row geometrical analysis determines the corresponding default rectangle of each finger, and being determined according to the number of edge pixel point in default rectangle should
Whether include the finger root of finger in default rectangle, to provide the technical solution of accurate positioning Fingers root.
Detailed description of the invention
Fig. 1 is the localization method flow chart of Fingers root provided in an embodiment of the present invention；
Fig. 2 is hand outline information schematic diagram provided in an embodiment of the present invention；
Whether it includes the method flow diagram for referring to root that Fig. 3 is in the default rectangle of determination provided in an embodiment of the present invention；
Fig. 4 is the method flow diagram provided in an embodiment of the present invention for being determined according to ratio and preset threshold and referring to root；
Fig. 5 presets the edge pixel point number that every row includes in rectangle by basis provided in an embodiment of the present invention and determines this
The method flow diagram of the finger root of the corresponding finger of finger tip；
Fig. 6 is the positioning device schematic diagram of Fingers root provided in an embodiment of the present invention.
Specific embodiment
The method and device of the positioning of Fingers root provided by the invention is carried out with reference to the accompanying drawings and examples more detailed
Carefully illustrate.
The embodiment of the present invention provides a kind of localization method of Fingers root, as shown in Figure 1, comprising:
Step 101, the hand outline information in present image is obtained, the hand outline information includes palm profile, hand
Finger wheel exterior feature and finger tip.
Specifically, existing hard recognition algorithm, which can be used, determines hand outline information in present image.It determines
Hand outline information can be as shown in Figure 2, wherein the corresponding region of point 1- point 5 is finger tip.Fig. 2 is only the left hand hand determined
The citing of profile information.
Step 102, it for each finger tip, using the finger tip as starting point, determines through the corresponding finger contours of the finger tip described in
The ray of the bottom of palm profile.
Specifically, part of the bottom of palm profile for palm profile and arm geometry handover, preferably straight line, such as
Line segment D in Fig. 1 is the bottom of palm profile.For each finger tip identified, using the finger tip as starting point, determine through the finger tip
Ray of the corresponding finger contours to the bottom of palm profile.Wherein, the corresponding finger of each finger tip, that is, correspond to a finger
Profile, for example, the corresponding finger contours of left middle finger are left hand middle finger profile.
Step 103, the intersection point of the bottom of the ray and palm profile is determined as this to the line segment between the finger tip to refer to
The corresponding line segment of point.
Specifically, the L1-L5 in the corresponding line segment of each finger tip such as Fig. 2, wherein L1 is the corresponding line segment of thumb tip, L2
For the corresponding line segment of index finger tip, L3 is the corresponding line segment of middle fingertip, and L4 is the corresponding line segment of nameless finger tip, and L5 is little finger of toe
The corresponding line segment of finger tip.
Step 104, centered on the set point on the corresponding line segment of the finger tip, determine that one has preset length and default width
The default rectangle of degree, the long side of default rectangle line segment corresponding with the finger tip are orthogonal.
Step 105, according to the number of edge pixel point in the default rectangle, determine in the default rectangle whether include
The finger root of the corresponding finger of the finger tip.
Specifically, predefining the set point on the corresponding line segment of each finger tip, and it is directed to each finger tip, with the finger tip pair
Centered on the set point on line segment answered, the default rectangle with preset length and predetermined width is determined, the default rectangle
Long side line segment corresponding with the finger tip it is orthogonal, it is preferable that preset length be the corresponding finger contours of the finger tip width, preset
Width is the half of the width of the corresponding finger contours of the finger tip, wherein the width of finger contours can calculate in the following manner:
The width value for taking multiple positions of finger contours, calculates the mean value of the width value of multiple positions, the width as the finger contours.
For example, as shown in Fig. 2, the default rectangle wherein determined centered on the set point R2 on the corresponding line segment L2 of index finger tip
(rectangle that the solid line in Fig. 2 is formed) A2, wherein the long side line segment L2 corresponding with index finger tip of default rectangle A2 is orthogonal.
When it is implemented, being determined according to the number of edge pixel point in the default rectangle determined on the corresponding line segment of finger tip
In default rectangle whether include the corresponding finger of the finger tip finger root.
The embodiment of the present invention utilizes palm wheel since the number of edge pixel point in finger root zone domain is relatively more, relatively concentrates
Wide, finger contours and finger fingertip carry out geometrical analysis, determine the corresponding default rectangle of each finger, and according to default rectangle
The number of middle edge pixel point determine in the default rectangle whether include finger finger root, to provide accurate positioning hand
Refer to the technical solution of root.
Preferably, each finger tip is located on the central axes of corresponding finger contours, then using the finger tip as starting point, determines through being somebody's turn to do
The corresponding finger contours of finger tip are specifically included to the ray of the bottom of the palm profile:
Using the finger tip as starting point, the bottom of the central axes through the corresponding finger contours of the finger tip, Xiang Suoshu palm profile is done
Ray.
Wherein, the central axes of finger contours be a finger tip be bottom direction from starting point to palm profile straight line, it is specific real
Shi Shi, preferably each finger tip are located at the center of corresponding finger contours, that is, are located at the central axes of corresponding finger contours
On, at this point, the bottom of the central axes through the corresponding finger contours of the finger tip, Xiang Suoshu palm profile is done using the finger tip as starting point
Ray takes the finger tip to the corresponding ray in central axes of the corresponding finger contours of the finger tip of palm profile bottom direction, from
And the ray and the intersection point of the bottom of palm profile to the line segment between the finger tip are further determined as the corresponding line of the finger tip
Section.
It is that the accuracy for referring to root positioning can be improved according to ray is done with the central axes of finger contours in this preferred embodiment.
Preferably, friendship of the set point to the bottom of line segment length and the ray and palm profile between the finger tip
Point arrives the ratio of the line segment length between the set point within the set range.
Specifically, can empirically determined setting range, for example setting range can be [0.55,0.7], or its
Its range, here without limitation.Preferably, setting range is [0.66~0.67].This determining ratio is within the set range
Mode is only a kind of embodiment, as another embodiment, the set point between the finger tip line segment length and institute
The ratio for stating intersection point to the line segment length between the set point of the bottom of ray and palm profile is equal to preset value, preferably
Ground, the preset value are 4/6, i.e., the finger of usual people and the ratio of palm are 4:6.
As illustrated in fig. 2, it is assumed that set point R2 to the line segment length between index finger tip be P1, the corresponding line segment of index finger tip
Line segment length between the intersection point Q2 to set point R2 of bottom palm is P2, then P1/P2 within the set range, alternatively, P1/P2
=4/6.
Utilize the embodiment of the present invention, it may be determined that position of the set point on the line segment on the corresponding line segment of finger tip, thus
To determine that default rectangle provides foundation.
Preferably, it determines in the default rectangle and whether includes the finger root of the corresponding finger of the finger tip, as shown in figure 3, having
Body includes:
Step 201, the corresponding external envelope rectangle of the default rectangle is determined.
Specifically, determining that the process of external envelope rectangle can be found in the prior art, it is not described herein, for example, in Fig. 2
Dashed rectangle be Fig. 2 in default rectangle external envelope rectangle.Wherein it is determined that external envelope rectangle in long side and palm wheel
Any row pixel in image where wide is parallel (straight line parallel connecting with by any row pixel), external envelope
Short side in rectangle is parallel with the either rank pixel in the image where palm profile (to be connect with by either rank pixel
The straight line parallel arrived).
Step 202, edge detection is carried out to the pixel in the external envelope rectangle according to default edge detection algorithm.
Specifically, default edge detection algorithm can be Sobel edge detection algorithm, or existing other edges
Detection algorithm, here without limitation, when carrying out edge detection using Sobel edge detection algorithm, to preset the center of rectangle
The Sobel edge detection in external enclosure rectangle region centered on (set point i.e. on the corresponding line segment of finger tip), to divide outer
Edge pixel point and non-edge pixels point in enclosure rectangle region.
Step 203, it using the central point for presetting rectangle as starting point, according to mean shift clustering algorithm, is preset to described
Edge pixel point in rectangle is clustered.
Step 204, the edge pixel point number that the mean shift clustering algorithm clusters is determined.
Specifically, calculating the total number Sum of pixel in default rectanglep 2 ix, (set with presetting the central point of rectangle
Point) it is starting point, to preset the restrained boundary that the half of the width (i.e. predetermined width) of rectangle is mean shift clustering algorithm,
Edge pixel point in default rectangle is clustered, the edge pixel point number that mean shift clustering algorithm clusters is obtained
Sume(the edge pixel point number i.e. in restrained boundary).
Step 205, the ratio of the pixel total number in the edge pixel point number and the default rectangle is calculated.
Specifically, determining the total number Sum for the pixel for including in default rectanglepix, and calculate Sume/Sumpix。
Step 206, according to the ratio and preset threshold, the finger root of the corresponding finger of the finger tip is determined.
In practical application, Fingers root portion edge pixel point comparatively dense, ratio Sume/SumpixDefault rectangle can be embodied
In, the edge pixel point in the most intensive region of edge pixel point accounts for the ratio of total pixel in default rectangle, thus according to this
Ratio compared with preset threshold, judge in default rectangle whether include the corresponding finger of finger tip finger root.The embodiment of the present invention,
The ratio determination that the edge pixel point number obtained according to clustering algorithm accounts for pixel total number in default rectangle refers to root.
Preferably, according to the ratio and preset threshold, the finger root of the corresponding finger of the finger tip is determined, as shown in figure 4,
Include:
Step 301, judge whether the ratio is greater than the preset threshold, if so, executing step 302, otherwise, execute
Step 303.
Step 302, the edge pixel point number for being included according to every row in the default rectangle determines that the finger tip is corresponding
The finger root of finger.
Step 303, the set point on the corresponding line segment of the finger tip is chosen again, and is executed on the corresponding line segment of the finger tip
Set point centered on, determine that one has the step of default rectangle of preset length and predetermined width.
Specifically, again since step 104, executing the present invention in the case where ratio is not more than preset threshold and implementing
The finger root location method that example provides.It should be noted that the initial set point on the corresponding line segment of each finger tip is to choose in advance
Alright, specific selection mode is seen above, and is not described herein.In practical application scene, following manner can be used, again
Choose the set point on the corresponding line segment of the finger tip:
The set point that first time is chosen slides set distance to finger tip direction on the corresponding line segment of the finger tip；It will sliding
Set point afterwards is as the set point chosen again；And/or
The set point that first time is chosen slides set distance to volar direction on the corresponding line segment of the finger tip；It will sliding
Set point afterwards is as the set point chosen again.
Preferably, set distance is the half of the predetermined width of default rectangle, or other values do not limit here
It is fixed.
The embodiment of the present invention illustrate in default rectangle in the case where ratio is not more than preset threshold there is no finger root, this
When suitably slide default rectangle (choosing set point again) to finger tip or to volar direction, and again to default after sliding
Rectangle carries out marginal point cluster, to identify the finger root of the corresponding finger of finger tip.
Preferably, the edge pixel point number for being included according to every row in the default rectangle determines the corresponding hand of the finger tip
The finger root of finger, as shown in figure 5, specifically including:
Step 401, for every row pixel in the default rectangle, continuous boundary pixel in the row pixel is determined
Number.
Specifically, determining continuously occur edge pixel point in the row pixel for every row pixel in default rectangle
Number, continuously occur in the row pixel edge pixel point number may also may be for one it is multiple, for example, false
If one-row pixels point include 1,2,3,4,5,6,7,8, wherein 1 and 2 be edge pixel point, 3 be non-edge pixels point, 4,5,6,7
It is edge pixel point with 8, then the number of continuous boundary pixel is respectively as follows: 2 and 5 in the row pixel.
Step 402, the number maximum value of continuous boundary pixel in the row pixel is extracted.
Specifically, extracting for every row pixel in default rectangle and continuously occurring edge pixel point in the row pixel
Number maximum value, continue to use the example above, in upper example the maximum value of the number of one-row pixels point be 5.To obtain every row picture
Continuously occurs the maximum value of the number of edge pixel point in vegetarian refreshments.
Step 403, according to the number maximum value of continuous boundary pixel in each row pixel in the default rectangle by big
To small sequence, setting number row pixel is chosen.
When it is implemented, setting number can may be other numerical value for 3, here without limitation.
Step 404, every row pixel of selection is linked in sequence, the corresponding line segment of every row pixel chosen.
Specifically, from left to right or be from right to left sequentially connected the row pixel for the every row pixel chosen,
Obtain the corresponding line segment of row pixel.
Step 405, judge that whether corresponding with the finger tip the corresponding line segment of the every row pixel line segment chosen be orthogonal, if
It is to execute step 406, otherwise, executes step 407.
Step 406, determine that the default rectangle is the finger root of the corresponding finger of the finger tip.
Step 407, the set point on the corresponding line segment of the finger tip is chosen again, and is executed on the corresponding line segment of the finger tip
Set point centered on, determine that one has the step of default rectangle of preset length and predetermined width.
It include being determined in the case that a plurality of line segment corresponding with finger tip is orthogonal when presetting in rectangle in the embodiment of the present invention
Include the finger root of the corresponding finger of the finger tip in the default rectangle, otherwise, chooses set point again and determine default rectangle, and from
Centered on the set point on the corresponding line segment of the finger tip, the step of a default rectangle with preset length and predetermined width is determined
It is rapid to start, re-start the positioning of Fingers root.It can be further improved the accuracy for the Fingers root oriented in this way.
The same inventive concept of localization method based on the Fingers root provided with foregoing invention embodiment, the present invention are implemented
Example also provides a kind of positioning device of Fingers root, as shown in Figure 6, comprising:
Acquiring unit 601, for obtaining the hand outline information in present image, the hand outline information includes palm
Profile, finger contours and finger tip；
First determination unit 602, using the finger tip as starting point, is determined through the corresponding hand of the finger tip for being directed to each finger tip
Ray of the finger wheel exterior feature to the bottom of the palm profile；
Second determination unit 603, for by the intersection point of the bottom of the ray and palm profile to the line between the finger tip
Section is determined as the corresponding line segment of the finger tip；
Third determination unit 604, for centered on the set point on the corresponding line segment of the finger tip, determine one have it is default
The default rectangle of length and predetermined width, the long side of default rectangle line segment corresponding with the finger tip are orthogonal；
4th determination unit 605 determines the default square for the number according to edge pixel point in the default rectangle
In shape whether include the corresponding finger of the finger tip finger root.
Preferably, in described device, each finger tip is located on the central axes of corresponding finger contours, then described first determines
Unit is specifically used for:
Using the finger tip as starting point, the bottom of the central axes through the corresponding finger contours of the finger tip, Xiang Suoshu palm profile is done
Ray.
Preferably, in described device, the set point to the line segment length and the ray and palm wheel between the finger tip
The intersection point of wide bottom to the line segment length between the set point ratio within the set range.
Preferably, in described device, the 4th determination unit is specifically used for:
Determine the corresponding external envelope rectangle of the default rectangle；
Edge detection is carried out to the pixel in the external envelope rectangle according to default edge detection algorithm；
Using the central point of default rectangle as starting point, according to mean shift clustering algorithm, in the default rectangle
Edge pixel point is clustered；
Determine the edge pixel point number that the mean shift clustering algorithm clusters；
Calculate the ratio of the pixel total number in the edge pixel point number and the default rectangle；
According to the ratio and preset threshold, the finger root of the corresponding finger of the finger tip is determined.
Preferably, in described device, the 4th determination unit determines that this refers to according to the ratio and preset threshold
When the finger root of the corresponding finger of point, it is specifically used for:
Judge whether the ratio is greater than the preset threshold；
If so, the edge pixel point number for being included according to every row in the default rectangle determines the corresponding finger of the finger tip
Finger root；
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute on the corresponding line segment of the finger tip
Centered on set point, determine that one has the step of default rectangle of preset length and predetermined width.
Preferably, in described device, the 4th determination unit is according to the side that every row is included in the default rectangle
When edge pixel number determines the finger root of the corresponding finger of the finger tip, it is specifically used for:
For every row pixel in the default rectangle, the number of continuous boundary pixel in the row pixel is determined；
Extract the number maximum value of continuous boundary pixel in the row pixel；
According to descending suitable of the number maximum value of continuous boundary pixel in each row pixel in the default rectangle
Sequence chooses setting number row pixel；
Every row pixel of selection is linked in sequence, the corresponding line segment of every row pixel chosen；
Judge that whether corresponding with the finger tip the corresponding line segment of the every row pixel line segment chosen be orthogonal；
If so, determining that the default rectangle is the finger root of the corresponding finger of the finger tip.
Preferably, in described device, the 4th determination unit is also used to:
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute on the corresponding line segment of the finger tip
Centered on set point, determine that one has the step of default rectangle of preset length and predetermined width.
Using the localization method and device of Fingers root provided in an embodiment of the present invention, have the advantages that due to
Refer to root zone domain in edge pixel point number it is relatively more, relatively concentration, using palm profile, finger contours and finger fingertip into
Row geometrical analysis determines the corresponding default rectangle of each finger, and being determined according to the number of edge pixel point in default rectangle should
Whether include the finger root of finger in default rectangle, to provide the technical solution of accurate positioning Fingers root.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Although preferred embodiments of the present invention have been described, it is created once a person skilled in the art knows basic
Property concept, then additional changes and modifications may be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as
It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (14)
1. a kind of localization method of Fingers root characterized by comprising
The hand outline information in present image is obtained, the hand outline information includes palm profile, finger contours and refers to
Point；
For each finger tip, using the finger tip as starting point, determine through the corresponding finger contours of the finger tip to the bottom of the palm profile
The ray in portion；
The ray and the intersection point of the bottom of palm profile to the line segment between the finger tip are determined as the corresponding line segment of the finger tip；
Centered on the set point on the corresponding line segment of the finger tip, a default square with preset length and predetermined width is determined
Shape, the long side of default rectangle line segment corresponding with the finger tip are orthogonal；
According to the number of edge pixel point in the default rectangle, determine whether corresponding comprising the finger tip in the default rectangle
The finger root of finger.
2. the method as described in claim 1, which is characterized in that each finger tip is located on the central axes of corresponding finger contours,
Then using the finger tip as starting point, determine through the corresponding finger contours of the finger tip to the ray of the bottom of the palm profile, it is specific to wrap
It includes:
Using the finger tip as starting point, ray is done in the bottom of the central axes through the corresponding finger contours of the finger tip, Xiang Suoshu palm profile.
3. the method as described in claim 1, which is characterized in that the set point between the finger tip line segment length with it is described
The intersection point of the bottom of ray and palm profile to the line segment length between the set point ratio within the set range.
4. the method as described in claim 1, which is characterized in that determine whether corresponding comprising the finger tip in the default rectangle
The finger root of finger, specifically includes:
Determine the corresponding external envelope rectangle of the default rectangle；
Edge detection is carried out to the pixel in the external envelope rectangle according to default edge detection algorithm, determines the external envelope
Edge pixel point and non-edge pixels point in rectangle；
Using the central point for presetting rectangle as starting point, according to mean shift clustering algorithm, the external envelope rectangle is located at
Edge pixel point in the default rectangle is clustered；
Determine the edge pixel point number that the mean shift clustering algorithm clusters；
Calculate the ratio of the pixel total number in the edge pixel point number and the default rectangle；
According to the ratio and preset threshold, the finger root of the corresponding finger of the finger tip is determined.
5. method as claimed in claim 4, which is characterized in that according to the ratio and preset threshold, determine the finger tip pair
The finger root for the finger answered, specifically includes:
Judge whether the ratio is greater than the preset threshold；
If so, the edge pixel point number for being included according to every row in the default rectangle determines the finger of the corresponding finger of the finger tip
Root；
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute with the setting on the corresponding line segment of the finger tip
Centered on point, determine that one has the step of default rectangle of preset length and predetermined width.
6. method as claimed in claim 5, which is characterized in that according to the edge pixel that every row is included in the default rectangle
Point number determines the finger root of the corresponding finger of the finger tip, specifically includes:
For every row pixel in the default rectangle, the number of continuous boundary pixel in the row pixel is determined；
Extract the number maximum value of continuous boundary pixel in the row pixel；
According to the sequence that the number maximum value of continuous boundary pixel in each row pixel in the default rectangle is descending, choosing
Take setting number row pixel；
Every row pixel of selection is linked in sequence, the corresponding line segment of every row pixel chosen；
Judge that whether corresponding with the finger tip the corresponding line segment of the every row pixel line segment chosen be orthogonal；
If so, determining that the default rectangle is the finger root of the corresponding finger of the finger tip.
7. method as claimed in claim 6, which is characterized in that further include:
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute with the setting on the corresponding line segment of the finger tip
Centered on point, determine that one has the step of default rectangle of preset length and predetermined width.
8. a kind of positioning device of Fingers root characterized by comprising
Acquiring unit, for obtaining the hand outline information in present image, the hand outline information includes palm profile, hand
Finger wheel exterior feature and finger tip；
First determination unit, for being directed to each finger tip, using the finger tip as starting point, determination is arrived through the corresponding finger contours of the finger tip
The ray of the bottom of the palm profile；
Second determination unit, for the intersection point of the bottom of the ray and palm profile to be determined as to the line segment between the finger tip
The corresponding line segment of the finger tip；
Third determination unit, for centered on the set point on the corresponding line segment of the finger tip, determine one have preset length and
The default rectangle of predetermined width, the long side of default rectangle line segment corresponding with the finger tip are orthogonal；
4th determination unit, for the number according to edge pixel point in the default rectangle, determining in the default rectangle is
The no finger root comprising the corresponding finger of the finger tip.
9. device as claimed in claim 8, which is characterized in that each finger tip is located on the central axes of corresponding finger contours,
Then first determination unit, is specifically used for:
Using the finger tip as starting point, ray is done in the bottom of the central axes through the corresponding finger contours of the finger tip, Xiang Suoshu palm profile.
10. device as claimed in claim 8, which is characterized in that the set point between the finger tip line segment length and institute
State the intersection point of the bottom of ray and palm profile to the line segment length between the set point ratio within the set range.
11. device as claimed in claim 8, which is characterized in that the 4th determination unit is specifically used for:
Determine the corresponding external envelope rectangle of the default rectangle；
Edge detection is carried out to the pixel in the external envelope rectangle according to default edge detection algorithm, determines the external envelope
Edge pixel point and non-edge pixels point in rectangle；
Using the central point for presetting rectangle as starting point, according to mean shift clustering algorithm, the external envelope rectangle is located at
Edge pixel point in the default rectangle is clustered；
Determine the edge pixel point number that the mean shift clustering algorithm clusters；
Calculate the ratio of the pixel total number in the edge pixel point number and the default rectangle；
According to the ratio and preset threshold, the finger root of the corresponding finger of the finger tip is determined.
12. device as claimed in claim 11, which is characterized in that the 4th determination unit is according to the ratio and in advance
If threshold value, when determining the finger root of the corresponding finger of the finger tip, it is specifically used for:
Judge whether the ratio is greater than the preset threshold；
If so, the edge pixel point number for being included according to every row in the default rectangle determines the finger of the corresponding finger of the finger tip
Root；
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute with the setting on the corresponding line segment of the finger tip
Centered on point, determine that one has the step of default rectangle of preset length and predetermined width.
13. device as claimed in claim 12, which is characterized in that the 4th determination unit is according in the default rectangle
When the edge pixel point number that every row is included determines the finger root of the corresponding finger of the finger tip, it is specifically used for:
For every row pixel in the default rectangle, the number of continuous boundary pixel in the row pixel is determined；
Extract the number maximum value of continuous boundary pixel in the row pixel；
According to the sequence that the number maximum value of continuous boundary pixel in each row pixel in the default rectangle is descending, choosing
Take setting number row pixel；
Every row pixel of selection is linked in sequence, the corresponding line segment of every row pixel chosen；
Judge that whether corresponding with the finger tip the corresponding line segment of the every row pixel line segment chosen be orthogonal；
If so, determining that the default rectangle is the finger root of the corresponding finger of the finger tip.
14. device as claimed in claim 13, which is characterized in that the 4th determination unit is also used to:
If it is not, choosing the set point on the corresponding line segment of the finger tip again, and execute with the setting on the corresponding line segment of the finger tip
Centered on point, determine that one has the step of default rectangle of preset length and predetermined width.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710128264.9A CN107066944B (en) | 2017-03-06 | 2017-03-06 | A kind of localization method and device of Fingers root |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710128264.9A CN107066944B (en) | 2017-03-06 | 2017-03-06 | A kind of localization method and device of Fingers root |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107066944A CN107066944A (en) | 2017-08-18 |
| CN107066944B true CN107066944B (en) | 2019-11-05 |
Family
ID=59621639
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710128264.9A Active CN107066944B (en) | 2017-03-06 | 2017-03-06 | A kind of localization method and device of Fingers root |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107066944B (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009054878A2 (en) * | 2007-09-11 | 2009-04-30 | University Of Florida Research Foundation | Compositions and methods for the treatment of neoplasia |
| CN104346829A (en) * | 2013-07-29 | 2015-02-11 | 中国农业机械化科学研究院 | Three-dimensional color reconstruction system and method based on PMD (photonic mixer device) cameras and photographing head |
| AU2014308899B2 (en) * | 2013-08-22 | 2020-11-19 | E. I. Du Pont De Nemours And Company | Methods for producing genetic modifications in a plant genome without incorporating a selectable transgene marker, and compositions thereof |
| CN104102347A (en) * | 2014-07-09 | 2014-10-15 | 东莞万士达液晶显示器有限公司 | Fingertip positioning method and fingertip positioning terminal |
| CN105835051B (en) * | 2016-04-26 | 2018-06-12 | 江南大学 | The underactuated manipulator of Dual-motors Driving Collaborative Control |
-
2017
- 2017-03-06 CN CN201710128264.9A patent/CN107066944B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107066944A (en) | 2017-08-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9135503B2 (en) | Fingertip tracking for touchless user interface | |
| US9104242B2 (en) | Palm gesture recognition method and device as well as human-machine interaction method and apparatus | |
| KR102118408B1 (en) | Method of performing a touch action in a touch sensitive device | |
| US8934673B2 (en) | Image processing method and apparatus for detecting target | |
| US8638987B2 (en) | Image-based hand detection apparatus and method | |
| CN109829368B (en) | Palm feature recognition method and device, computer equipment and storage medium | |
| CN103294996A (en) | 3D gesture recognition method | |
| EP3514724B1 (en) | Depth map-based heuristic finger detection method | |
| KR20170030613A (en) | Touch classification | |
| KR20140123900A (en) | Gesture recognition apparatus, gesture recognition method, electronic decive, control program and recording medium | |
| EP2458528A2 (en) | Image processing apparatus and method, and program | |
| CN103984928A (en) | Finger gesture recognition method based on field depth image | |
| CN103353935A (en) | 3D dynamic gesture identification method for intelligent home system | |
| CN103065134A (en) | Fingerprint identification device and method with prompt information | |
| TWI528271B (en) | Method, apparatus and computer program product for polygon gesture detection and interaction | |
| CN103996019A (en) | System and method used for detecting and tracking a plurality of portions on an object | |
| CN103870071A (en) | Touch source identification method and system | |
| WO2016149985A1 (en) | Direction control method, direction control system and terminal | |
| She et al. | A real-time hand gesture recognition approach based on motion features of feature points | |
| CN102831408A (en) | Human face recognition method | |
| CN105389541A (en) | Fingerprint image recognition method and device | |
| CN111492407B (en) | System and method for map beautification | |
| CN106650554A (en) | Static hand gesture identification method | |
| CN107229928B (en) | Mobile terminal palm print acquisition method and system for auxiliary positioning | |
| CN104809483B (en) | Realize the method and system of any direction text writing row cutting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180508 Address after: 100085 Haidian District, Beijing, Shanghai Information Industry Base Development Road 15, 1 buildings. Applicant after: BEIJING SUMAVISION TECHNOLOGIES CO., LTD. Address before: 100085, 6 floor, 1 building, No. 1, Shanghai East Road, Haidian District, Beijing, 602, -6023 Applicant before: Beijing poly chat network technology Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |