CN102521567A - Human-computer interaction fingertip detection method, device and television - Google Patents

Human-computer interaction fingertip detection method, device and television Download PDF

Info

Publication number
CN102521567A
CN102521567A CN2011103881055A CN201110388105A CN102521567A CN 102521567 A CN102521567 A CN 102521567A CN 2011103881055 A CN2011103881055 A CN 2011103881055A CN 201110388105 A CN201110388105 A CN 201110388105A CN 102521567 A CN102521567 A CN 102521567A
Authority
CN
China
Prior art keywords
pixel value
area
finger tip
pixel
circle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011103881055A
Other languages
Chinese (zh)
Other versions
CN102521567B (en
Inventor
张登康
邵诗强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TCL Corp
Original Assignee
TCL Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TCL Corp filed Critical TCL Corp
Priority to CN 201110388105 priority Critical patent/CN102521567B/en
Publication of CN102521567A publication Critical patent/CN102521567A/en
Application granted granted Critical
Publication of CN102521567B publication Critical patent/CN102521567B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Collating Specific Patterns (AREA)
  • Image Analysis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The invention is applicable to human-computer interaction and provides a human-computer interaction fingertip detection method, a device and a television. The method comprises the following steps of: acquiring an area of interest from inputted video image frames, and extracting binary motion information and binary skin-color information from the area of interest; dividing a palm region according to the binary motion information and the binary skin-color information, and acquiring a binary image containing the palm region; acquiring the central coordinate of the palm region in the binary image, and drawing a circle by taking the central coordinate as the center of the circle and the length of a preset radius of the circle as a radius, wherein the length of the preset radius of the circle is determined according to a preset initial length and a preset iteration step size; and acquiring the pixel values of pixels on a circular path, and carrying out fingertip detection according to the acquired pixel values. With the adoption of the embodiment of the invention, the accuracy in the detection of fingertips can be improved, and the scope of application can be enlarged.

Description

A kind of finger tip detection method, device and televisor of man-machine interaction
Technical field
The invention belongs to field of human-computer interaction, relate in particular to a kind of finger tip detection method, device and televisor of man-machine interaction.
Background technology
Along with the development of mode identification technology, increasing man-machine interaction product has appearred on the market, this man-machine interaction product through the identification user finger tip and position, utilize the position of finger tip to realize man-machine interaction, for example icon click, menu affirmation etc.
Existing finger tip detection method mainly is to carry out finger tip through the mark on data glove or the finger tip to detect, because this method need increase additional hardware, so cost is too high, and user's finger also is difficult to flexible motion, makes troubles to the user; And do not carry out the method that finger tip detects the contour accuracy of gesture is not had relatively high expectations through the mark on the finger tip; Often can only obtain the approximate location of finger tip; If use this method to detect the finger tip of many fingers; The position of then detecting is not accurate enough, and the scope of application is less, and is difficult to adapt to various system platforms and occasion.
Summary of the invention
The embodiment of the invention provides a kind of finger tip detection method of man-machine interaction, is intended to solve existing finger tip detection method in the inaccurate problem in the existing detection position of finger tip that detects many fingers.
The embodiment of the invention is achieved in that a kind of finger tip detection method of man-machine interaction, and said method comprises the steps:
Obtain the area-of-interest of the video frame image of input, extract the binaryzation movable information and the binaryzation colour of skin information of said area-of-interest;
Divide palm area according to binaryzation movable information and binaryzation colour of skin information, obtain the bianry image that comprises said palm area;
Obtain the centre coordinate of palm area in the said bianry image, and be the center of circle with said centre coordinate, preset radius of circle length is that radius is justified, and said radius of circle length is confirmed according to preset initial length and preset iteration step length;
Obtain the pixel value of pixel on the round path, and detect finger tip according to the pixel value that obtains.
Another purpose of the embodiment of the invention is to provide a kind of finger tip pick-up unit of man-machine interaction, and said device comprises:
The area-of-interest acquiring unit is used to obtain the area-of-interest of the video frame image of input, extracts the binaryzation movable information and the binaryzation colour of skin information of said area-of-interest;
The palm area acquiring unit is used for dividing palm area according to binaryzation movable information and binaryzation colour of skin information, obtains the bianry image that comprises said palm area;
Circle path acquiring unit; Be used for obtaining the centre coordinate of said bianry image palm area; And be the center of circle with said centre coordinate, preset radius of circle length is that radius is justified, said radius of circle length is confirmed according to preset initial length and preset iteration step length;
The finger tip detecting unit is used to obtain the pixel value of pixel on the round path, and detects finger tip according to the pixel value that obtains.
Another purpose of the embodiment of the invention is to provide a kind of televisor that comprises the finger tip pick-up unit of above-mentioned man-machine interaction.
The embodiment of the invention is through obtaining the area-of-interest of video image series; And obtain binaryzation movable information and binaryzation colour of skin information according to this area-of-interest; Comprise the bianry image of palm area according to the binaryzation movable information that obtains and the information extraction of the binaryzation colour of skin, detect user's finger tip again from the bianry image that comprises palm area that extracts.Because the embodiment of the invention is through combining binaryzation movable information and binaryzation colour of skin information to divide the bianry image that palm area is extracted palm area; Therefore can effectively reject the interference of type area of skin color in the background, make the palm area of extraction more accurate, thereby improve the accuracy of inspection finger tip; And in the process that detects finger tip; Need not also can correctly detect finger tip directly over the finger sensing, enlarged range of application.
Description of drawings
Fig. 1 is the process flow diagram of the finger tip detection method of the man-machine interaction that provides of first embodiment of the invention;
Fig. 2 is the area-of-interest figure that confirms in the finger tip detection method of the man-machine interaction that provides of second embodiment of the invention;
Fig. 3 is the binaryzation movable information figure that is converted to according to Fig. 2 in the finger tip detection method of the man-machine interaction that provides of second embodiment of the invention;
Fig. 4 is the binaryzation colour of skin hum pattern that obtains according to the colour of skin information translation of the HSV color space of Fig. 2 in the finger tip detection method of the man-machine interaction that provides of second embodiment of the invention;
Fig. 5 comprises the palm area binary map according to what Fig. 3 and Fig. 4 obtained in the finger tip detection method of the man-machine interaction that provides of third embodiment of the invention;
Fig. 6 is that a plurality of subregions of in the finger tip detection method of the man-machine interaction that provides of third embodiment of the invention Fig. 5 being divided are carried out the binary map that obtains after the binary conversion treatment again;
Fig. 7 has increased round path binary map in the finger tip detection method of the man-machine interaction that provides of fourth embodiment of the invention on the basis of Fig. 6;
Fig. 8 is the process flow diagram of the finger tip detection method of the man-machine interaction that provides of fifth embodiment of the invention;
Fig. 9 is the structural representation of the finger tip pick-up unit of the man-machine interaction that provides of sixth embodiment of the invention;
Figure 10 is the structural representation of the finger tip pick-up unit of the man-machine interaction that provides of seventh embodiment of the invention;
Figure 11 is the structural representation of the finger tip pick-up unit of the man-machine interaction that provides of eighth embodiment of the invention;
Figure 12 is the structural representation of the finger tip pick-up unit of the man-machine interaction that provides of nineth embodiment of the invention;
Figure 13 is the structural representation of the finger tip pick-up unit of the man-machine interaction that provides of tenth embodiment of the invention;
Figure 14 is the structural representation of the finger tip pick-up unit of the man-machine interaction that provides of eleventh embodiment of the invention.
Embodiment
In order to make the object of the invention, technical scheme and advantage clearer,, the present invention is further elaborated below in conjunction with accompanying drawing and embodiment.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
The embodiment of the invention is extracted movable information and colour of skin information according to the area-of-interest that obtains, and merges this movable information and colour of skin information to obtain the bianry image that comprises hand region, from the bianry image that comprises hand region, detects the finger tip of finger again.
It is a kind of that the embodiment of the invention provides: finger tip detection method, device and the televisor of man-machine interaction.
Said method comprises: obtain the area-of-interest of the video frame image of input, extract the binaryzation movable information and the binaryzation colour of skin information of said area-of-interest;
Divide palm area according to binaryzation movable information and binaryzation colour of skin information, obtain the bianry image that comprises said palm area;
Obtain the centre coordinate of palm area in the said bianry image, and be the center of circle with said centre coordinate, preset radius of circle length is that radius is justified, and said radius of circle length is confirmed according to preset initial length and preset iteration step length;
Obtain the pixel value of pixel on the round path, and detect finger tip according to the pixel value that obtains.
Said device comprises: the area-of-interest acquiring unit, be used to obtain the area-of-interest of the video frame image of input, and extract the binaryzation movable information and the binaryzation colour of skin information of said area-of-interest;
The palm area acquiring unit is used for dividing palm area according to binaryzation movable information and binaryzation colour of skin information, obtains the bianry image that comprises said palm area;
Circle path acquiring unit; Be used for obtaining the centre coordinate of said bianry image palm area; And be the center of circle with said centre coordinate, preset radius of circle length is that radius is justified, said radius of circle length is confirmed according to preset initial length and preset iteration step length;
The finger tip detecting unit is used to obtain the pixel value of pixel on the round path, and detects finger tip according to the pixel value that obtains.
Said equipment comprises: a kind of televisor that comprises the finger tip pick-up unit of above-mentioned man-machine interaction.
The embodiment of the invention is through obtaining the area-of-interest of video image series; And obtain binaryzation movable information and binaryzation colour of skin information according to this area-of-interest; Comprise the bianry image of palm area according to the binaryzation movable information that obtains and the information extraction of the binaryzation colour of skin, detect user's finger tip again from the bianry image that comprises palm area that extracts.Because the embodiment of the invention is through combining binaryzation movable information and binaryzation colour of skin information to divide the bianry image that palm area is extracted palm area; Therefore can effectively reject the interference of type area of skin color in the background, make the palm area of extraction more accurate, thereby improve the accuracy of inspection finger tip; And in the process that detects finger tip; Need not also can correctly detect finger tip directly over the finger sensing, enlarged range of application.
For technical scheme of the present invention is described, describe through specific embodiment below.
Embodiment one:
Fig. 1 shows the process flow diagram of the finger tip detection method of the man-machine interaction that first embodiment of the invention provides; In the present embodiment; Extract movable information and colour of skin information according to the area-of-interest that obtains; Merge this movable information and colour of skin information to obtain the bianry image that comprises hand region, from the bianry image that comprises hand region, detect the finger tip of finger again.Details are as follows:
Step S11 obtains the area-of-interest of the video frame image of input, extracts the binaryzation movable information and the binaryzation colour of skin information of this area-of-interest.
In the embodiment of the invention; The video frame image of input is mainly coloured image; After the area-of-interest that has obtained video frame image, according to the motion feature of area-of-interest, binaryzation movable information and the binaryzation colour of skin information that features of skin colors extracts this area-of-interest respectively.
Step S12 divides palm area according to binaryzation movable information and binaryzation colour of skin information, obtains the bianry image that comprises this palm area.
In the present embodiment, palm positional information and the binaryzation colour of skin information of utilizing the binaryzation movable information to obtain are separated with palm area, obtain comprising two-value (0, the 1) image of this palm area.
Step S13 obtains the centre coordinate of palm area in the bianry image, and is the center of circle with this centre coordinate, and preset radius of circle length is that radius is justified, and this radius of circle length is confirmed according to preset initial length and preset iteration step length.
Step S14 obtains the pixel value of pixel on the round path, and detects finger tip according to the pixel value that obtains.
In the present embodiment, confirm preset radius of circle according to preset initial length and iteration step length.With this preset radius of circle and the centre coordinate of palm area is that justify in the center of circle, and obtains the pixel value of the pixel on the round round path of doing, and judges according to the pixel value that obtains whether the corresponding position of this pixel value is finger tip again.
In first embodiment of the invention; Obtain the area-of-interest of video image series; And obtain binaryzation movable information and binaryzation colour of skin information according to this area-of-interest; Comprise the bianry image of palm area according to the binaryzation movable information that obtains and the information extraction of the binaryzation colour of skin, detect user's finger tip again from the bianry image that comprises palm area that extracts.Because the embodiment of the invention is through combining binaryzation movable information and binaryzation colour of skin information to divide the bianry image that palm area is extracted palm area; Therefore can effectively reject the interference of type area of skin color in the background, make the palm area of extraction more accurate, thereby improve the accuracy that detects finger tip; And in the process that detects finger tip; Need not also can correctly detect finger tip directly over the finger sensing, enlarged range of application.
Embodiment two:
Second embodiment of the invention is mainly done more at large to describe to the step S11 of embodiment one, and all the other steps are identical with embodiment's one, repeat no more here.
Wherein step S11 is specially:
A1, confirm the area-of-interest of video frame image.
In the present embodiment; Video image series to input delimited an area-of-interest, such as, when the color video frequency image series of input comprises all characteristics of people; According to man-machine interaction is the situation of carrying out the corresponding command according to people's fingertip motions; The area-of-interest of then delimiting is generally that to have got rid of the colour of skin information zone different with palm colour of skin information and colour of skin information identical with palm colour of skin information but be static zone, such as, the area-of-interest of delimitation can be regional for the entire arms that comprises the motion finger tip; This arm regions has been got rid of human face region and another arm regions, and is specifically as shown in Figure 2.
A2, convert the area-of-interest of video frame image into gray level image, and adopt the three-frame difference method to detect the motion target area of gray level image, extract the binaryzation movable information according to this motion target area again.
In the present embodiment; Area-of-interest to video frame image converts gray level image into; Utilize all continuous three frame video images of this gray level image to carry out the three-frame difference method again, to detect the region of variation of moving target itself, the greyscale image transitions that will detect the region of variation of moving target itself at last is a bianry image; And from this bianry image extraction binaryzation movable information, this binaryzation movable information comprises the positional information of palm area etc.Wherein, area-of-interest is specifically as shown in Figure 3 according to the binaryzation movable information image that the region of variation of moving target itself is converted to.
A3, the preset conversion formula of basis convert the area-of-interest that obtains into hue saturation value HSV color space from the RGB rgb color space, extract the colour of skin information of this HSV color space, again according to this colour of skin information extraction binaryzation colour of skin information.
In the present embodiment, HSV color space model be by tone (Hue, H), color saturation (Saturation; S), and brightness value (Value, V) base attribute of 3 colors is described the color of object; H representes the position of spectral color of living in, and scope is [0,360]; S is a ratio value, and scope is [0,1], and it representes the ratio between the maximum purity of purity and this color of selected color; V representes the bright degree of color, and scope is [0,1].The HSV color space belongs to non-linear color representation space, and its saturation degree and colourity can reflect the color attributes of target accurately, and consistent to the perception of color with human body.According to preset conversion formula, convert the video image of importing into the HSV color space from rgb color space, the formula of conversion is specially:
Figure BDA0000113809270000071
Figure BDA0000113809270000072
V＝max(r，g，b)
Wherein, r, g, b are respectively the value of a pixel on R, G, B component.
Further, mainly concentrate on this characteristic of red area according to the skin tone of human body, there is following relation: r＞g＞b in this characteristic in image, in view of the above above-mentioned conversion formula is simplified to reduce calculated amount, and the formula of wherein simplifying is:
S = r - b r
H = ( b - g ) * π / 3 r - b
V＝r
After the colour of skin information of having obtained the HSV color space, be bianry image information with this colour of skin information translation, to extract binaryzation colour of skin information, wherein, specifically as shown in Figure 4 according to the binaryzation colour of skin frame of the colour of skin information translation of area-of-interest.
In the second embodiment of the invention, at first obtain the area-of-interest of inputted video image frame, and obtain binaryzation movable information and binaryzation colour of skin information from this area-of-interest.Obtain the binaryzation movable information owing to adopt the three-frame difference method; Adopt preset conversion formula to obtain binaryzation colour of skin information; Therefore can guarantee that two value informations that obtain are more accurate, so follow-up according to binaryzation colour of skin information and binaryzation movable information division palm area.
Embodiment three:
Third embodiment of the invention is mainly done more at large to describe to the step S12 of embodiment one, and all the other steps are identical with embodiment one or embodiment's two, repeat no more here.
Wherein step S12 is specially:
B1, divide palm area, obtain the corresponding bianry image of palm area according to binaryzation movable information and binaryzation colour of skin information.
In the present embodiment, confirm palm area, improve the accuracy of the palm area of confirming in conjunction with binaryzation movable information that obtains and binaryzation colour of skin information.
Wherein, the bianry image of the palm area correspondence of obtaining is as shown in Figure 5, in Fig. 5; Use white expression palm area, use black to represent other zones, show that therefore the pixel value in the palm area is 1; Other regional pixel values are 0, certainly, also can use black to represent palm area; Use other zones of white expression, do not limit here, present embodiment uses white expression palm area.
B2, the bianry image that the palm area of dividing is corresponding are divided into a plurality of subregions, and a plurality of subregions of dividing are carried out morphology handle.
In the present embodiment; Because the existence of noise; A plurality of isolated zonules and little gap often appear in the bianry image that therefore comprises palm area; It is exactly to eliminate isolated zonule that occurs and the little gap of filling appearance that this bianry image that comprises palm area is carried out the morphology processing; And the morphology of the isolated zonule that eliminate to occur is handled and is called corrosion, fills the closely spaced morphology that occurs and handles and be called expansion, expands and the processing procedure of corrosion is the process of the part in image or the image and predefined nuclear being carried out convolution algorithm.
Wherein, the bianry image that the palm area of dividing is corresponding is divided into a plurality of subregions, and a plurality of subregions execution morphology processed steps of dividing are specially:
C1, according to the needs of actual conditions, the bianry image that comprises palm area that obtains is divided into preset a plurality of subregions, and a plurality of subregions of dividing is carried out binary conversion treatment again.In the present embodiment, as required, the bianry image that comprises palm area that obtains is divided into a plurality of subregions, with this palm area gridding.Such as, be divided into N * N sub regions, then the size of each subregion is: the length/N of the length=palm area of subregion; Wide/the N of the wide=palm area of subregion.Preset number of pixels threshold value; Judge that subregion interior pixel value is whether 1 number of pixels is greater than preset number of pixels threshold value; When being 1 number of pixels, this subregion is judged to be a pixel in subregion interior pixel value, and the pixel value that defines this pixel is 1 greater than preset number of pixels threshold value; Otherwise the pixel value that defines this pixel is 0.In bianry image, pixel value is that 1 zone is a white, and pixel value is that 0 zone is a black.Wherein, Fig. 6 carries out the binary map that obtains after the binary conversion treatment again for a plurality of subregions that the bianry image of Fig. 5 is divided.
C2, adopt predefined nuclear to eliminate the soliton zone of palm area, perhaps fill the little gap of palm area, the soliton zone of this palm area and the little gap of palm area are the subregion of carrying out again after the binary conversion treatment.In the present embodiment; The expansion during predefine morphology is handled and the nuclear of corrosion, generally, the nuclear of expansion and the nuclear of corrosion are filled squares or the disks that a centre has RP; The nuclear size of this expansion and the nuclear size of corrosion are greater than all subregion of dividing; When regarding all subregion as a pixel, the nuclear size of the nuclear of this expansion size and corrosion is greater than a pixel, otherwise is difficult to eliminate preferably or fill all subregion of division.
Present embodiment is example with RP at a RC foursquare nuclear, and all subregion is expanded or corrosion treatment.Wherein, the step of all subregion being carried out expansion process is: adopt the canny operator to detect the profile of palm, the largest connected territory that obtains palm judges in the largest connected territory of this palm whether have the gap, if exist, then uses predefined nuclear to fill this gap.In the present embodiment, the gap that exists in the largest connected territory of palm is the pixel value zone different with other area pixel values, and when being white such as the most of zone at palm, the gap in the palm is the zone of black.Use predefined nuclear to fill this black region, then the pixel value in gap is become 1 from 0, thereby the interior pixel value of the pixel value that makes the gap and palm area is identical, has realized the filling in gap.The step of all subregion being carried out corrosion treatment is: judge whether the largest connected overseas of palm exists the soliton zone, if exist, then use predefined nuclear to eliminate this soliton zone.In the present embodiment, the zone of soliton zone for protruding outside the palm border.
In the third embodiment of the invention; Handle carrying out morphology according to the palm area of binaryzation movable information and the division of binaryzation colour of skin information; This morphology is handled through the palm binary image being carried out grid dividing, filling up cavity or the soliton zone of eliminating the palm area protrusion of dividing of the palm area of division, has optimized the palm profile, has strengthened the characteristic of unique point on the profile; Particularly strengthened the unique point of fingertip area; Make fingertip area more obvious, thereby improved accuracy, the continuity of dividing palm area, and the accuracy rate of finger tip detection.
Embodiment four:
Fourth embodiment of the invention is mainly done more at large to describe to step S13 and the step S14 of embodiment one, and all the other steps are identical with embodiment one or embodiment two or embodiment's three, repeat no more here.
Step S13 wherein obtains the centre coordinate of palm area in the bianry image, and is the center of circle with this centre coordinate, and preset radius of circle length is that radius is justified, and this radius of circle length is confirmed to be specially according to preset initial length and preset iteration step length:
D1, confirm the circle centre coordinate: the pixel value of point by point scanning palm area, confirm the centre coordinate of palm area according to pixel value and pixel value position.
In the present embodiment; Obtain coordinate and this pixel corresponding pixel value of palm area interior pixel, and the centre coordinate of confirming palm area according to coordinate and this pixel corresponding pixel value of the pixel of obtaining, such as; According to formula confirm palm area centre coordinate (x, y):
x = Σ I ( i , j ) * i Σi
y = Σ I ( i , j ) * j Σj
Wherein, I (i, j)For coordinate position in the image is that (i, pixel value j), x and y are respectively the x component and the y component of the centre coordinate of palm area.
D2, confirm radius of circle length: the radius of circle length of present embodiment can be through preset initial length with the iteration step length addition or subtract each other definite through presetting initial length and iteration step length.
Further, preset initial length can be the minimum rectangular length in the largest connected territory that comprises palm area.
D3, justify: in the present embodiment according to circle centre coordinate and radius of circle length; Centre coordinate with palm area is the center of circle; Preset radius of circle length is that radius is justified, and specifically as shown in Figure 7, the center of circle O of the circle among this Fig. 7 is the centre coordinate of the palm area of Fig. 6.
Step S14 wherein obtains the pixel value of pixel on the round path, and detects finger tip according to the pixel value that obtains and be specially:
In the present embodiment, after obtaining circle, obtain the pixel value of pixel on the round path, and detect finger tip according to the pixel value that obtains.
E1, obtain the pixel value of pixel on the round path one by one;
E2, it is 1 o'clock at the pixel value that obtains; Whether the pixel value of judging the left and right sides neighbor of this pixel all is 0; The pixel value that at pixel value is the left and right sides neighbor of 1 pixel all is 0 o'clock (zone on every side all is blank); The subregion of judging this pixel place is a finger tip, if not, judges that the subregion at this pixel place is not a finger tip;
E3, be 0 o'clock, continue to obtain the pixel value of the next pixel on the round path, till the pixel value that obtains all pixels on the round path at the pixel value that obtains.
Certainly, present embodiment is to detect finger tip with 1 expression palm area, also can detect finger tip with 0 expression palm area, specifically detects step and above-mentioned similar, repeats no more here.
Further, be that the pixel value of the left and right sides neighbor of 1 pixel is 0 o'clock all at pixel value, the subregion of judging this pixel place is that the step of finger tip is specially:
The pixel value that at pixel value is the left and right sides neighbor of 1 pixel all is 0 o'clock, is that 1 pixel is the center with pixel value, and preset expansion multiple is expanded, and the zone after will expanding is divided into 4 zones; Detect the pixel value of 4 regional interior pixels, if the pixel value of one of them regional interior pixel all is 1, and the pixel value of all the other regional pixels is 0, judges that then the central area in the zone after expanding is a finger tip.For example, preset expansion multiple is 9, and then the area size after the expansion becomes 9 * 9 zone, and the pixel value that is in the pixel of 9 * 9 regional centers is 1, satisfies above-mentioned condition like this pixel, judges that then the corresponding zone of this pixel is a finger tip.
In the present embodiment, judge whether to be finger tip, further improved the accurate rate that finger tip detects through enlarging surveyed area.
Embodiment five:
Fig. 8 shows the finger tip detection method flow process of the man-machine interaction that fifth embodiment of the invention provides, and adopts the method for present embodiment can detect all finger tips that the user carries out man-machine interaction, and details are as follows:
Wherein the step S11 with embodiment one is identical with step S12 respectively with step S22 for step S21, repeats no more here.
Step S23 obtains the centre coordinate of palm area in the bianry image, and is the center of circle with this centre coordinate, and preset initial length is that radius is justified.
In the present embodiment, preset initial length can be the minimum rectangular length in the largest connected territory that comprises palm area, also can be for the minimum rectangular length in the largest connected territory that comprises palm area half the, do not limit here.
Step S24 obtains the pixel value of pixel on the round path, and detects finger tip according to the pixel value that obtains.
In the present embodiment, concrete finger tip detection method and embodiment's three is identical, repeats no more here.
Step S25 confirms next radius of circle according to preset iteration step length and preset initial length, the difference of length and preset length threshold value of judging this next one radius of circle whether in preset range, if, execution in step S26, otherwise, execution in step S27.
In the present embodiment; Suppose that preset initial length is the minimum rectangular length that comprises the largest connected territory of palm area; Then can initial length that should be preset and preset iteration step length be subtracted each other confirming next radius of circle, and whether the difference of length and preset length threshold value of judging this next one radius of circle is in preset range.Wherein, the preset length threshold value is for more than or equal to 0 and smaller or equal to the number of the minimum rectangular length in the largest connected territory that comprises palm area.
Certainly, when preset initial length was worth for other, radius of circle also can be confirmed by preset initial length and preset iteration step length addition, repeat no more here.
Step S26 is the center of circle with the centre coordinate of palm area, and next radius of circle is that radius is justified, and forwards step S24 to.
In the present embodiment, confirm to be radius with this next one radius of circle after the next radius of circle according to step S25, the centre coordinate of palm area is that justify in the center of circle.
Step S27 stops finger tip and detects.
In the present embodiment,,, then stop to detect finger tip such as detecting apart from the center of palm area length less than 1/4th the largest connected territory that comprises palm area if detected the scope not far apart from the center of palm area.
In embodiments of the present invention, iteration changes radius of circle length justify again, and according to the pixel detection finger tip on the round path of the circle of doing again, the execution above-mentioned steps that circulates, thus can accurately detect a plurality of finger tips.
Further, after the step that stops the finger tip detection, further comprise step S28:
Step S28 rejects the unreasonable finger tip that has been judged to be finger tip.
Wherein, the step of rejecting the unreasonable finger tip be judged to be finger tip is specially:
F1, judge the subregion be judged to be finger tip and the left and right sides adjacent area of this subregion distance whether all greater than the distance threshold of presetting, wherein, the left and right sides adjacent area of this subregion and the pixel value of the pixel between this subregion are 0.
F2, when the distance of adjacent area is all greater than preset distance threshold in the left and right sides of the subregion that is judged to be finger tip and this subregion, reject the finger tip that this has been judged to be finger tip; Otherwise, keep the finger tip that has been judged to be finger tip.
In the present embodiment, the zone that is judged to be finger tip is judged again, rejected erroneous judgement and be the zone of finger tip, make that the finger tip that keeps is more accurate, improve the accuracy rate that finger tip detects.
Embodiment six:
Fig. 9 shows the structure of the finger tip pick-up unit of the man-machine interaction that sixth embodiment of the invention provides, and for the ease of explanation, only shows the part relevant with the embodiment of the invention.
The finger tip pick-up unit of this man-machine interaction can be used for through the various information processing terminals wired or wireless network Connection Service device; Pocket computing machine (Pocket Personal Computer for example; PPC), computing machine, televisor, notebook computer etc.; Can be to run on the unit that software unit, hardware cell or software and hardware in these terminals combine, also can be used as independently, suspension member be integrated in these terminals or runs in the application system at these terminals, wherein:
Area-of-interest acquiring unit 81 is used to obtain the area-of-interest of the video frame image of input, extracts the binaryzation movable information and the binaryzation colour of skin information of this area-of-interest.
Palm area acquiring unit 82 is used for dividing palm area according to binaryzation movable information and binaryzation colour of skin information, obtains the bianry image that comprises this palm area.
Circle path acquiring unit 83 is used for obtaining the centre coordinate of this bianry image palm area, and is the center of circle with this centre coordinate, and preset radius of circle length is that radius justify, and this radius of circle length is definite according to preset initial length and iteration step length of presetting.
Finger tip detecting unit 84 is used to obtain the pixel value of pixel on the round path, and detects finger tip according to the pixel value that obtains.
The finger tip pick-up unit of the man-machine interaction that the embodiment of the invention six provides can use in the finger tip detection method that previous embodiment one provides, and details are referring to the description of the foregoing description one.
In sixth embodiment of the invention; Obtain the area-of-interest of video image series; And obtain binaryzation movable information and binaryzation colour of skin information according to this area-of-interest; Comprise the bianry image of palm area according to the binaryzation movable information that obtains and the information extraction of the binaryzation colour of skin, detect user's finger tip again from the bianry image that comprises palm area that extracts.Because the embodiment of the invention is through combining binaryzation movable information and binaryzation colour of skin information to divide the bianry image that palm area is extracted palm area; Therefore can effectively reject the interference of type area of skin color in the background, make the palm area of extraction more accurate, thereby improve the accuracy of inspection finger tip; And in the process that detects finger tip; Need not also can correctly detect finger tip directly over the finger sensing, enlarged range of application.
Embodiment seven:
Figure 10 shows the structural representation of the finger tip pick-up unit of the man-machine interaction that seventh embodiment of the invention provides, the main refinement of present embodiment area-of-interest acquiring unit 81, remaining element is identical with embodiment five, repeats no more here:
This area-of-interest acquiring unit 81 comprises: area-of-interest delimited module 811, extraction of motion information module 812 and colour of skin information extraction modules 813.
This area-of-interest delimited the area-of-interest that module 811 is used for confirming video frame image.
Extraction of motion information module 812 is used for converting the area-of-interest of video frame image into gray level image, and adopts the three-frame difference method to detect the motion target area of gray level image, extracts the binaryzation movable information according to this motion target area again.
Colour of skin information extraction modules 813 converts the area-of-interest that obtains into hue saturation value HSV color space from the RGB rgb color space according to preset conversion formula; Extract the colour of skin information of this HSV color space, again according to this colour of skin information extraction binaryzation colour of skin information.
In the present embodiment, preset conversion formula is following:
Figure BDA0000113809270000151
Figure BDA0000113809270000152
V＝max(r，g，b)
Wherein, r, g, b are respectively the value of a pixel on R, G, B component.
Further, mainly concentrate on this characteristic of red area according to the skin tone of human body, there is following relation: r＞g＞b in this characteristic in image, in view of the above above-mentioned conversion formula is reduced to:
S = r - b r
H = ( b - g ) * π / 3 r - b
V＝r
The finger tip pick-up unit of the man-machine interaction that the embodiment of the invention seven provides can use in the finger tip detection method that previous embodiment two provides, and details are referring to the description of the foregoing description two.
In the seventh embodiment of the invention,, adopt preset conversion formula to obtain binaryzation colour of skin information, therefore can guarantee that two value informations that obtain are more accurate owing to adopt the three-frame difference method to obtain the binaryzation movable information.
Embodiment eight:
Figure 11 shows the structural representation of the finger tip pick-up unit of the man-machine interaction that eighth embodiment of the invention provides, the main refinement of present embodiment palm area acquiring unit 82, remaining element and embodiment five or embodiment six phase with, repeat no more here:
This palm area acquiring unit 82 comprises: two-value palm area determination module 821 and denoising module 822.
Two-value palm area determination module 821 is used for dividing palm area according to binaryzation movable information and binaryzation colour of skin information.
Denoising module 822 is used for the bianry image that the palm area of dividing is corresponding and is divided into a plurality of subregions, and a plurality of subregions of dividing carried out morphology handle.
The finger tip pick-up unit of the man-machine interaction that the embodiment of the invention eight provides can use in the finger tip detection method that previous embodiment three provides, and details are referring to the description of the foregoing description three.
In the present embodiment; Because the existence of noise; A plurality of isolated zonules and little gap often appear in the bianry image that therefore comprises palm area, and it is exactly to eliminate isolated zonule that occurs and the little gap of filling appearance that this bianry image that comprises palm area is carried out the morphology processing.At first, the bianry image that comprises palm area that obtains is divided into preset a plurality of subregions, and a plurality of subregions of dividing are carried out binary conversion treatment again according to the needs of actual conditions; Adopt predefined nuclear to eliminate the soliton zone of palm area again, perhaps fill the little gap of palm area, the soliton zone of this palm area and the little gap of palm area are the subregion of carrying out again after the binary conversion treatment.Generally, the nuclear of expansion and the nuclear of corrosion are filled squares or the disks that a centre has RP, and the nuclear size of this expansion and the nuclear size of corrosion are greater than all subregion of dividing.
Embodiment nine:
Figure 12 shows the structural representation of the finger tip pick-up unit of the man-machine interaction that nineth embodiment of the invention provides, the main refinement of present embodiment round path acquiring unit 83, remaining element and embodiment five or embodiment six or embodiment seven are identical, repeat no more here:
This circle path acquiring unit 83 comprises: radius of circle determination module 831, center of circle determination module 832, circle path determination module 833.
Radius of circle determination module 831 is used for confirming radius of circle length through preset initial length and iteration step length addition, or subtracts each other definite radius of circle length through preset initial length and iteration step length.
In the present embodiment, confirm radius of circle length according to preset initial length and iteration step length.Wherein, the initial length of presetting can be made as the minimum rectangular length in the largest connected territory that comprises palm area.
Center of circle determination module 832 is used for the pixel value of point by point scanning palm area, confirms the centre coordinate of palm area according to the pixel value that obtains and pixel value position.
In the present embodiment; Obtain coordinate and this pixel corresponding pixel value of palm area interior pixel, and the centre coordinate of confirming palm area according to coordinate and this pixel corresponding pixel value of the pixel of obtaining, such as; According to formula confirm palm area centre coordinate (x, y):
x = Σ I ( i , j ) * i Σi
y = Σ I ( i , j ) * j Σj
Wherein, I (i, j)For coordinate position in the image is that (i, pixel value j), x and y are respectively the x component and the y component of the centre coordinate of palm area.
Circle path determination module 833, the centre coordinate that is used for palm area is the center of circle, is that radius is justified with this radius of circle length of confirming.
The finger tip pick-up unit of the man-machine interaction that the embodiment of the invention nine provides can use in the finger tip detection method that previous embodiment four provides, and details are referring to the description of the foregoing description four.
In the nineth embodiment of the invention, going out radius of circle length according to preset initial length and iteration step length iteration, is that justify at the center with this radius of circle length and palm area, so that the subsequent detection finger tip.
Embodiment ten:
Figure 13 shows the structural representation of the finger tip pick-up unit of the man-machine interaction that tenth embodiment of the invention provides; The main refinement of present embodiment finger tip detecting unit 84; Remaining element and embodiment five or embodiment six or embodiment seven or embodiment eight are identical, repeat no more here:
This finger tip detecting unit 84 comprises pixel value acquisition module 841, the first finger tip judge module 842, the second finger tip judge module 843.
Pixel value acquisition module 841 is used for obtaining one by one the pixel value of pixel on the round path.
It is 1 o'clock that the first finger tip judge module 842 is used at the pixel value that obtains; Whether the pixel value of judging the left and right sides neighbor of this pixel all is 0; The pixel value that at pixel value is the left and right sides neighbor of 1 pixel is 0 o'clock all, judges that the subregion at this pixel place is a finger tip.
In the present embodiment, being that the pixel value of the left and right sides neighbor of 1 pixel all is 0 o'clock at pixel value, is that 1 pixel is the center with pixel value, and preset expansion multiple is expanded, and the zone after will expanding is divided into 4 zones; Detect the pixel value of 4 regional interior pixels, if the pixel value of one of them regional interior pixel all is 1, and the pixel value of all the other regional pixels is 0, judges that then the central area in the zone after expanding is a finger tip.For example, suppose that preset expansion multiple is 9, then the area size after the expansion becomes 9 * 9 zone, and the pixel value that is in the pixel of 9 * 9 regional centers is 1, satisfies above-mentioned condition like this pixel, judges that then the corresponding zone of this pixel is a finger tip.
It is 0 o'clock that trigger module 843 is used at the pixel value that obtains, and triggers the pixel value that said pixel value acquisition module 841 continues to obtain the next pixel on the round path, till the pixel value that obtains all pixels on the round path.
Certainly, present embodiment is to detect finger tip with 1 expression palm area, also can detect finger tip with 0 expression palm area, specifically detects step and above-mentioned similar, repeats no more here.
In the present embodiment,, thereby improved the accurate rate that finger tip detects through the expansion surveyed area.The finger tip pick-up unit of the man-machine interaction that the embodiment of the invention ten provides can use in the finger tip detection method that previous embodiment four provides, and details are referring to the description of the foregoing description four.
Embodiment 11:
Figure 14 shows the structural representation of the finger tip pick-up unit of the man-machine interaction that eleventh embodiment of the invention provides, and for the ease of explanation, only shows the part relevant with present embodiment:
In the embodiment of the invention; The finger tip pick-up unit of man-machine interaction also comprises: region distance judging unit 85 is rejected unit 86 with finger tip; Other unit of the finger tip pick-up unit of this man-machine interaction are identical with embodiment five or embodiment six or embodiment seven or embodiment eight or embodiment's nine, repeat no more here.
Whether region distance judging unit 85 is used to judge the distance of left and right sides adjacent area of the subregion that has been judged to be finger tip and this subregion all greater than preset distance threshold, and the left and right sides adjacent area of this subregion and the pixel value of the pixel between this subregion are 0.
When finger tip is rejected distance that unit 86 is used for the adjacent area in the left and right sides of the subregion that is judged to be finger tip and this subregion all greater than the distance threshold preset, reject the finger tip that this has been judged to be finger tip.
In eleventh embodiment of the invention, the zone that is judged to be finger tip is judged again, reject erroneous judgement and be the zone of finger tip, make that the finger tip that keeps is more accurate, improve the accuracy rate that finger tip detects.
The finger tip pick-up unit of the man-machine interaction that the embodiment of the invention 11 provides can use in the finger tip detection method that previous embodiment five provides, and details are referring to the description of the foregoing description five.
The finger tip pick-up unit of the man-machine interaction that the embodiment of the invention provides is through obtaining the area-of-interest of video image series; And obtain binaryzation movable information and binaryzation colour of skin information according to this area-of-interest; Comprise the bianry image of palm area according to the binaryzation movable information that obtains and the information extraction of the binaryzation colour of skin, detect user's finger tip again from the bianry image that comprises palm area that extracts.Because the embodiment of the invention is through combining binaryzation movable information and binaryzation colour of skin information to divide the bianry image that palm area is extracted palm area; Therefore can effectively reject the interference of type area of skin color in the background, make the palm area of extraction more accurate, thereby improve the accuracy of inspection finger tip; And in the process that detects finger tip; Need not also can correctly detect finger tip directly over the finger sensing, enlarged range of application.
The embodiment of the invention also provides a kind of televisor at last, and this televisor comprises the finger tip pick-up unit of man-machine interaction.Wherein, the detailed structure of the finger tip pick-up unit of man-machine interaction no longer repeats at this referring to the associated description of the foregoing description five to embodiment ten.
The above is merely preferred embodiment of the present invention, not in order to restriction the present invention, all any modifications of within spirit of the present invention and principle, being done, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.

Claims (13)

1. the finger tip detection method of a man-machine interaction is characterized in that, said method comprises the steps:
Obtain the area-of-interest of the video frame image of input, extract the binaryzation movable information and the binaryzation colour of skin information of said area-of-interest;
Divide palm area according to binaryzation movable information and binaryzation colour of skin information, obtain the bianry image that comprises said palm area;
Obtain the centre coordinate of palm area in the said bianry image, and be the center of circle with said centre coordinate, preset radius of circle length is that radius is justified, and said radius of circle length is confirmed according to preset initial length and preset iteration step length;
Obtain the pixel value of pixel on the round path, and detect finger tip according to the pixel value that obtains.
2. the method for claim 1 is characterized in that, the said area-of-interest that obtains the video frame image of input extracts the binaryzation movable information of said area-of-interest and the step of binaryzation colour of skin information and is specially:
Confirm the area-of-interest of video frame image;
Convert the area-of-interest of video frame image into gray level image, and adopt the three-frame difference method to detect the motion target area of gray level image, extract the binaryzation movable information according to said motion target area again;
Conversion formula according to preset converts the area-of-interest that obtains into hue saturation value HSV color space from the RGB rgb color space, extracts the colour of skin information of said HSV color space, again according to said colour of skin information extraction binaryzation colour of skin information.
3. the method for claim 1 is characterized in that, said according to binaryzation movable information and binaryzation colour of skin information division palm area, the step of obtaining the bianry image that comprises said palm area is specially:
Divide palm area according to binaryzation movable information and binaryzation colour of skin information;
The bianry image that the palm area of dividing is corresponding is divided into a plurality of subregions, and a plurality of subregions of dividing is carried out morphology handle.
4. method as claimed in claim 3 is characterized in that, the said bianry image that the palm area of dividing is corresponding is divided into a plurality of subregions, and a plurality of subregions execution morphology processed steps of dividing are specially:
The bianry image that comprises palm area that obtains is divided into preset a plurality of subregions, and a plurality of subregions of dividing are carried out binary conversion treatment again;
Adopt predefined nuclear to eliminate the soliton zone of palm area, perhaps fill the little gap of palm area.
5. according to claim 1 or claim 2 method; It is characterized in that; The said centre coordinate that obtains radius of circle length and palm area; And be the center of circle with said centre coordinate, the radius of circle length of obtaining is that radius is justified, the step that said radius of circle length is confirmed according to preset initial length and preset iteration step length is specially:
Radius of circle length is confirmed in initial length and iteration step length addition through preset, or subtracts each other definite radius of circle length through preset initial length and iteration step length;
The pixel value of point by point scanning palm area is confirmed the centre coordinate of palm area according to the pixel value that obtains and pixel value position;
Centre coordinate with palm area is the center of circle, is that radius is justified with the said radius of circle length of confirming.
6. the method for claim 1 is characterized in that, the said pixel value that obtains pixel on the round path, and be specially according to the step that the pixel value that obtains detects finger tip:
Obtain the pixel value of pixel on the round path one by one;
At the pixel value that obtains is 1 o'clock, judges whether the pixel value of the left and right sides neighbor of said pixel all is 0, is that the pixel value of the left and right sides neighbor of 1 pixel is 0 o'clock all at pixel value, judges that the subregion at said pixel place is a finger tip;
At the pixel value that obtains is 0 o'clock, continues to obtain the pixel value of the next pixel on the round path, till the pixel value that obtains all pixels on the round path.
7. method as claimed in claim 6 is characterized in that, said is that the pixel value of the left and right sides neighbor of 1 pixel is 0 o'clock all at pixel value, and the subregion of judging said pixel place is after the step of finger tip, further comprises the steps:
Whether the distance of judging the subregion be judged to be finger tip and the left and right sides adjacent area of said subregion is all greater than the distance threshold of presetting, and the left and right sides adjacent area of said subregion and the pixel value of the pixel between the said subregion are 0;
When the distance of adjacent area is all greater than preset distance threshold in the left and right sides of subregion that is judged to be finger tip and said subregion, reject the said finger tip that has been judged to be finger tip.
8. the finger tip pick-up unit of a man-machine interaction is characterized in that, said device comprises:
The area-of-interest acquiring unit is used to obtain the area-of-interest of the video frame image of input, extracts the binaryzation movable information and the binaryzation colour of skin information of said area-of-interest;
The palm area acquiring unit is used for dividing palm area according to binaryzation movable information and binaryzation colour of skin information, obtains the bianry image that comprises said palm area;
Circle path acquiring unit; Be used for obtaining the centre coordinate of said bianry image palm area; And be the center of circle with said centre coordinate, preset radius of circle length is that radius is justified, said radius of circle length is confirmed according to preset initial length and preset iteration step length;
The finger tip detecting unit is used to obtain the pixel value of pixel on the round path, and detects finger tip according to the pixel value that obtains.
9. device as claimed in claim 8 is characterized in that, said palm area acquiring unit comprises:
Two-value palm area determination module is used for dividing palm area according to binaryzation movable information and binaryzation colour of skin information;
The denoising module is used for the bianry image that the palm area of dividing is corresponding and is divided into a plurality of subregions, and a plurality of subregions of dividing carried out morphology handle.
10. device as claimed in claim 8 is characterized in that, said round path acquiring unit comprises:
The radius of circle determination module is used for confirming radius of circle length through preset initial length and iteration step length addition, or subtracts each other definite radius of circle length through preset initial length and iteration step length;
Center of circle determination module is used for the pixel value of point by point scanning palm area, confirms the centre coordinate of palm area according to the pixel value that obtains and pixel value position;
Circle path determination module, the centre coordinate that is used for palm area is the center of circle, is that radius is justified with the said radius of circle length of confirming.
11. device as claimed in claim 8 is characterized in that, said finger tip detecting unit comprises:
The pixel value acquisition module is used for obtaining one by one the pixel value of pixel on the round path;
The first finger tip judge module; Being used at the pixel value that obtains is 1 o'clock; Whether the pixel value of judging the left and right sides neighbor of said pixel all is 0, is that the pixel value of the left and right sides neighbor of 1 pixel is 0 o'clock all at pixel value, judges that the subregion at said pixel place is a finger tip;
Trigger module, being used at the pixel value that obtains is 0 o'clock, triggers the pixel value that said pixel value acquisition module continues to obtain the next pixel on the round path, till the pixel value that obtains all pixels on the round path.
12. device as claimed in claim 8 is characterized in that, also comprises:
The region distance judging unit, whether the distance of left and right sides adjacent area that is used to judge the subregion that has been judged to be finger tip and said subregion is all greater than preset distance threshold, and the left and right sides adjacent area of said subregion and the pixel value of the pixel between this subregion are 0;
Finger tip is rejected the unit, and the distance that is used for the adjacent area in the left and right sides of the subregion that is judged to be finger tip and this subregion is rejected the finger tip that this has been judged to be finger tip during all greater than the distance threshold preset.
13. a televisor is characterized in that, said televisor comprises the finger tip pick-up unit of the described man-machine interaction of 8 to 12 each claims.
CN 201110388105 2011-11-29 2011-11-29 Human-computer interaction fingertip detection method, device and television Expired - Fee Related CN102521567B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110388105 CN102521567B (en) 2011-11-29 2011-11-29 Human-computer interaction fingertip detection method, device and television

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110388105 CN102521567B (en) 2011-11-29 2011-11-29 Human-computer interaction fingertip detection method, device and television

Publications (2)

Publication Number Publication Date
CN102521567A true CN102521567A (en) 2012-06-27
CN102521567B CN102521567B (en) 2013-10-23

Family

ID=46292478

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110388105 Expired - Fee Related CN102521567B (en) 2011-11-29 2011-11-29 Human-computer interaction fingertip detection method, device and television

Country Status (1)

Country Link
CN (1) CN102521567B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105095838A (en) * 2014-05-20 2015-11-25 中国移动通信集团广东有限公司 Target detection method and device
CN107341811A (en) * 2017-06-20 2017-11-10 上海数迹智能科技有限公司 The method that hand region segmentation is carried out using MeanShift algorithms based on depth image
WO2018113259A1 (en) * 2016-12-22 2018-06-28 深圳光启合众科技有限公司 Method and device for acquiring target object, and robot
CN108229391A (en) * 2018-01-02 2018-06-29 京东方科技集团股份有限公司 Gesture identifying device and its server, gesture recognition system, gesture identification method
CN108921828A (en) * 2018-06-15 2018-11-30 湖南科技大学 Not significant weld joint recognition method under a kind of complex scene
WO2019076230A1 (en) * 2017-10-19 2019-04-25 Boe Technology Group Co., Ltd. Method for controlling terminal apparatus, apparatus for controlling terminal apparatus, and computer-program product
CN111639562A (en) * 2020-05-15 2020-09-08 圣点世纪科技股份有限公司 Intelligent positioning method for palm region of interest
CN112232332A (en) * 2020-12-17 2021-01-15 四川圣点世纪科技有限公司 Non-contact palm detection method based on video sequence

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101694694A (en) * 2009-10-22 2010-04-14 上海交通大学 Finger identification method used in interactive demonstration system
CN101807114A (en) * 2010-04-02 2010-08-18 浙江大学 Natural interactive method based on three-dimensional gestures
US20100329509A1 (en) * 2009-06-30 2010-12-30 National Taiwan University Of Science And Technology Method and system for gesture recognition
CN102200834A (en) * 2011-05-26 2011-09-28 华南理工大学 television control-oriented finger-mouse interaction method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100329509A1 (en) * 2009-06-30 2010-12-30 National Taiwan University Of Science And Technology Method and system for gesture recognition
CN101694694A (en) * 2009-10-22 2010-04-14 上海交通大学 Finger identification method used in interactive demonstration system
CN101807114A (en) * 2010-04-02 2010-08-18 浙江大学 Natural interactive method based on three-dimensional gestures
CN102200834A (en) * 2011-05-26 2011-09-28 华南理工大学 television control-oriented finger-mouse interaction method

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105095838A (en) * 2014-05-20 2015-11-25 中国移动通信集团广东有限公司 Target detection method and device
CN105095838B (en) * 2014-05-20 2019-09-17 中国移动通信集团广东有限公司 A kind of object detection method and device
WO2018113259A1 (en) * 2016-12-22 2018-06-28 深圳光启合众科技有限公司 Method and device for acquiring target object, and robot
US11127151B2 (en) 2016-12-22 2021-09-21 Shen Zhen Kuang-Chi Hezhong Technology Ltd Method and device for acquiring target object, and robot
CN107341811B (en) * 2017-06-20 2020-11-13 上海数迹智能科技有限公司 Method for segmenting hand region by using MeanShift algorithm based on depth image
CN107341811A (en) * 2017-06-20 2017-11-10 上海数迹智能科技有限公司 The method that hand region segmentation is carried out using MeanShift algorithms based on depth image
US11402918B2 (en) 2017-10-19 2022-08-02 Boe Technology Group Co., Ltd. Method for controlling terminal apparatus, apparatus for controlling terminal apparatus, and computer-program product
WO2019076230A1 (en) * 2017-10-19 2019-04-25 Boe Technology Group Co., Ltd. Method for controlling terminal apparatus, apparatus for controlling terminal apparatus, and computer-program product
CN108229391A (en) * 2018-01-02 2018-06-29 京东方科技集团股份有限公司 Gesture identifying device and its server, gesture recognition system, gesture identification method
CN108921828B (en) * 2018-06-15 2022-04-22 湖南科技大学 Method for identifying insignificant weld joint in complex scene
CN108921828A (en) * 2018-06-15 2018-11-30 湖南科技大学 Not significant weld joint recognition method under a kind of complex scene
CN111639562A (en) * 2020-05-15 2020-09-08 圣点世纪科技股份有限公司 Intelligent positioning method for palm region of interest
CN111639562B (en) * 2020-05-15 2023-06-20 圣点世纪科技股份有限公司 Intelligent positioning method for palm region of interest
CN112232332A (en) * 2020-12-17 2021-01-15 四川圣点世纪科技有限公司 Non-contact palm detection method based on video sequence
CN112232332B (en) * 2020-12-17 2021-04-13 四川圣点世纪科技有限公司 Non-contact palm detection method based on video sequence

Also Published As

Publication number Publication date
CN102521567B (en) 2013-10-23

Similar Documents

Publication Publication Date Title
CN102521567B (en) Human-computer interaction fingertip detection method, device and television
US10372226B2 (en) Visual language for human computer interfaces
CN105469113B (en) A kind of skeleton point tracking method and system in two-dimensional video stream
CN107272883B (en) Gesture preprocessing of video streams using tagged regions
US20120243733A1 (en) Moving object detecting device, moving object detecting method, moving object detection program, moving object tracking device, moving object tracking method, and moving object tracking program
CN103679145A (en) Automatic gesture recognition method
CN108596944A (en) A kind of method, apparatus and terminal device of extraction moving target
CN104809387A (en) Video image gesture recognition based non-contact unlocking method and device
CN106203326B (en) A kind of image processing method, device and mobile terminal
EP3336749A1 (en) Fingerprint image recognition method, apparatus, and terminal
EP2725458A1 (en) Information processing device, input control method, and input control program
CN104766354B (en) The method and mobile terminal that a kind of augmented reality is drawn
CN105260720A (en) Fingerprint identification method and device
CN104932683A (en) Game motion sensing control method based on vision information
CN109920018A (en) Black-and-white photograph color recovery method, device and storage medium neural network based
CN112906550A (en) Static gesture recognition method based on watershed transformation
US20140169625A1 (en) Image processing apparatus, method, and storage medium
Nikam et al. Bilingual sign recognition using image based hand gesture technique for hearing and speech impaired people
CN106774846A (en) Alternative projection method and device
Hartanto et al. Real time hand gesture movements tracking and recognizing system
Rokade et al. Spelled sign word recognition using key frame
CN102855025B (en) Optical multi-touch contact detection method based on visual attention model
CN108205641A (en) Images of gestures processing method and processing device
CN104200460A (en) Image registration method based on images characteristics and mutual information
US9704030B2 (en) Flesh color detection condition determining apparatus, and flesh color detection condition determining method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20131023

CF01 Termination of patent right due to non-payment of annual fee