CN109799928A - Project the acquisition methods and system of user's finger parameter in touch tablet - Google Patents
Project the acquisition methods and system of user's finger parameter in touch tablet Download PDFInfo
- Publication number
- CN109799928A CN109799928A CN201711135967.0A CN201711135967A CN109799928A CN 109799928 A CN109799928 A CN 109799928A CN 201711135967 A CN201711135967 A CN 201711135967A CN 109799928 A CN109799928 A CN 109799928A
- Authority
- CN
- China
- Prior art keywords
- finger
- user
- error image
- profile
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a kind of acquisition methods and system for projecting user's finger parameter in touch tablet, it include: the present image for shooting projection plane, top view and contrast images to present image do difference operation and obtain error image, whether judge in error image comprising user's finger profile, if it is, the user's finger profile in error image is extracted, two-dimensional coordinate of each point on error image on user's finger profile is decoded, determines the principal direction and finger pulp width a of user's finger；According to principal direction, the finger tip point P of user's finger profile distalmost end is determinedfWith plane central axes, the N number of point made even on the central axes of face is reference point, P in calculating difference imagefWith the three-dimensional coordinate of N number of reference point；According to PfUser's finger parameter P is calculated with the three-dimensional coordinate of N number of reference pointiThree-dimensional coordinate.Based on method of the invention, solve the problems, such as on projection touch tablet user how controlling cursor.
Description
Technical field
The present invention relates to field of human-computer interaction, in particular to the acquisition methods of user's finger parameter in a kind of projection touch tablet
And system.
Background technique
So far from invention on computer, people and how more natural, the more convenient interaction of machine are always that people are exploring
Hot spot direction.Traditional man-machine interaction mode such as keyboard, mouse etc. are to be handed over using external hardware equipment with machine
Mutually.
With the development of human-computer interaction technology and terminal device, portable intelligent device becomes must can not in people's life
Few product, such as smart phone, tablet computer etc..Requirement because of smart machine to portability causes equipment to become small, passes
The man-machine interaction mode of system is not portable enough, cannot be suitble to interaction scenarios of today, and a variety of novel interactive modes are answered
It uses on various portable intelligent devices, such as touch screen, gesture and voice etc..
But there is also corresponding defects for existing human-computer interaction technology, such as in the smaller and smaller equipment of touch screen,
Interactive interface is also smaller and smaller, and the interaction technique of touch screen just cannot achieve.On the other hand, nowadays gesture interaction can only realize ratio
Better simply interactive mode, and the robustness of interactive voice method under noisy environment is bad, is also unfavorable for protecting privacy.Cause
This, the research and development of new portable human-computer interaction technology are extremely urgent.
Summary of the invention
The present invention provides a kind of acquisition methods and system for projecting user's finger parameter in touch tablet, increases human-computer interaction
Interactive interface, can based on the user's finger parameter that image is quickly obtained, the position and track of real-time tracing user's finger, into
And solve the problems, such as user's controlling cursor on projection touch tablet.
The present invention provides a kind of acquisition methods for projecting user's finger parameter in touch tablet, and user's finger parameter is that touching is sentenced
Breakpoint PiThree-dimensional coordinate (xPi,yPi,HPi), this method comprises:
Step A-1: shooting the present image of projection plane, and projection plane is simultaneously color coding structural light and touch tablet
Projection plane, top view and contrast images to present image do difference operation and obtain error image, and contrast images are user hand
Whether the top view for referring to projection plane when not entering projection plane, judge in error image comprising user's finger profile, if it is
Execute step A-2；
Step A-2: the user's finger profile in error image is extracted, each point is in differential chart on decoding user's finger profile
As upper two-dimensional coordinate, according to user's finger profile and its two-dimensional coordinate, determine that the principal direction of user's finger profile and finger pulp are wide
Spend a；
Step A-3: according to principal direction, the finger tip point P of user's finger profile distalmost end is determinedf, enable and pass through finger tip point PfMaster
Straight line on direction is the plane central axes of user's finger profile, and the N number of point made even on the central axes of face is reference point, is based on color
Coding structural light three-dimensional measurement of coordinates principle, P in calculating difference imagefWith the three-dimensional coordinate of N number of reference point；
Step A-4: according to N number of reference point and PfThree-dimensional coordinate, utilize least square method to calculate user's finger and bow
The elevation angleAccording toCalculate current PiHeightPiAnd PfDistance on axis in the planesAccording to PfTwo-dimensional coordinate, DpAnd plane central axes obtain PiXPiAnd yPi。。
The present invention also provides a kind of acquisition systems of user's finger parameter in projection touch tablet, and user's finger parameter is touching
Judge point PiThree-dimensional coordinate (xPi,yPi,HPi), which includes:
Shooting module: shooting the present image of projection plane, and projection plane is simultaneously color coding structural light and touch tablet
Projection plane, top view and contrast images to present image do difference operation and obtain error image, and contrast images are user
Whether the top view of projection plane when finger does not enter projection plane judge in error image comprising user's finger profile, if
It is to execute profile decoding and analysis module；
Profile decoding and analysis module: extracting the user's finger profile in error image, decodes every on user's finger profile
Two-dimensional coordinate of a point on error image determines the master of user's finger profile according to user's finger profile and its two-dimensional coordinate
Direction and finger pulp width a；
Edge analysis module 2: according to principal direction, the finger tip point P of user's finger profile distalmost end is determinedf, enable and pass through finger tip
Point PfPrincipal direction on straight line be user's finger profile plane central axes, the N number of point made even on the central axes of face be reference point,
Based on color coding structural light three-dimensional measurement of coordinates principle, P in calculating difference imagefWith the three-dimensional coordinate of N number of reference point；
User's finger parameter calculating module: according to N number of reference point and PfThree-dimensional coordinate, utilize least square method calculate
The pitch angle of user's fingerAccording toCalculate current PiHeightPiAnd PfIn the planes
Distance on axisAccording to PfTwo-dimensional coordinate, DpAnd plane central axes obtain PiXPiAnd yPi。
Color coding structural light three-dimensional coordinate measuring system of the application based on miniaturization need to only measure PiThree-dimensional sit
Mark, can quickly judge whether user's finger is touched with projection plane, real-time tracing PiPosition and track, can obtain
User's finger operate cursor movement, solve the problems, such as projection touch tablet on user how controlling cursor.In addition, the present invention adopts
With the interactive mode controlling cursor of projection touch tablet, the interactive interface of human-computer interaction is increased, is not limited by the size of touch screen,
Device miniaturization can meet the needs of convenient and fast human-computer interaction.
Detailed description of the invention
Fig. 1 is the schematic diagram of color coding structural light of the present invention；
Fig. 2 is color coding structural light three-dimensional measurement of coordinates schematic diagram；
Fig. 3 is finger model structure chart of the present invention；
Fig. 4 is the acquisition methods embodiment of user's finger parameter in present invention projection touch tablet；
Fig. 5 is the top view for shooting image when user's finger of the present invention enters projection plane；
Fig. 6 is binaryzation error image schematic diagram of the present invention；
Fig. 7 is the schematic diagram of longest two straight lines on the user's finger profile of Fig. 6；
Fig. 8 present invention projects the acquisition system embodiment of user's finger parameter in touch tablet.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, right in the following with reference to the drawings and specific embodiments
The present invention is described in detail.
Carrying out three-dimensional measurement using the colouring information of light is a kind of new measuring method.Structure light image is carried out color
Color coding, when coded image projects to testee surface, due to the modulation by body surface height, coded image occurs
Deformation can obtain the elevation information of physical surface by the way that the coded image of deformation is decoded and is calculated.
Color coding structural light measuring system, including projector and camera, wherein projector color coding structure
Light, camera shoot image of the testee under color coding structural light.Using Zhang Zhengyou calibration method to projector and camera shooting
Head is demarcated, to obtain the inside and outside parameter and spatial relation between the two of camera and projector.It is calibrated
Color coding structural light measuring system can be used to the three-dimensional measurement of object, and measurement accuracy can achieve pixel scale.
Fig. 1 is the color coding structural light that the present invention uses, including two kinds of colors, aubergine and cyan, using de
Bruijn coding.It selects to be the reason of both, cyan (grey in corresponding diagram 1) and aubergine are (black in corresponding diagram 1
Color) it is all very big in camera blue channel numerical value, the two coloration difference is obvious, and the color phase of both colors and application on human skin
Difference is larger, is easy to extract.Color structure light is encoded using de Bruijn, two kinds of colors respectively indicate 0 and 1, and every 8
For a cycle, period interior coding is 11101000, using continuous three codings it may determine that any coding is in a cycle
In position.
After camera shoots image, 3 channel RGB figure is saved as in the form of picture element matrix to the image of camera shooting
Picture chooses each frame image the numerical value of channel B therein, carries out binary conversion treatment to the numerical value of channel B, can clearly show
Existing fringe position.HSV format-pattern is converted by rgb format image again, it is big using the numerical value in the chrominance channel in HSV image
It is small, judge striped color, image is decoded according to striped color, i.e., it can be judged in a week using the color of continuous three stripe
Interim position, compares the vertical and horizontal fringe position where based on each pixel, and decoding obtains the number of each pixel, then root
According to pixel in camera digital picture coordinate position obtain the current two-dimensional plane coordinate of the pixel.
Fig. 2 is color coding structural light three-dimensional measurement of coordinates schematic diagram, the O in Fig. 2lAnd OrIt is camera and projector
Optical center, OlAnd OrLine be baseline, two planes are the imaging plane of camera and projector, e respectivelylAnd erIt is O respectivelyl
Subpoint and O on projector imaging planerSubpoint in camera imaging plane.It is true that image is shot according to camera
Determine pixel PlPosition in camera digital picture coordinate and pixel number, PlIt is the imaging point of measured point P, according to
PlPixel number determine the pixel number project digital image coordinate position Pr, and then two are obtained from OlAnd Or
Issue ray, OlPlAnd OrPr, intersection point of two rays under world coordinate system is exactly P point, by OlPlAnd OrPrLinear equation is found out
The three-dimensional coordinate of its intersection point P point.
The present invention is based on principles above, three-dimensional information of the measurement user's finger in color coding structural light projection plane.
In order to quickly judge the relative position of user's finger and projection plane, the invention proposes user's finger parameter, tools
Body is touching judgement point Pi.Wherein, PiSelection gist is the finger model of the application setting.
As shown in figure 3, finger model is the composite structure of a cylindroid and an a quarter ball, cylindroid representative refers to
Abdomen, cylindroid cross section are ellipse, and a quarter ball represents finger tip, is smoothly connected among two solids.Enable elliptical length
Axis (finger pulp width) is a, then elliptical short axle is 0.75a, the radius 0.5a of a quarter ball.PiPoint corresponds in finger model
The center of circle of finger tip.By the 3rd figure of Fig. 3 it is found that no matter finger tip where is touched with projection plane, touch points and PiVertical range
It is all the radius 0.5a of a quarter ball, therefore when measurement obtains PiThe height H of pointpi> 0.5a (is put down on the basis of projection plane
Face) when, then it can determine that user's finger is not touched with projection plane, conversely, then user's finger is in touching state.
Choose PiAs user's finger parameter, calculation amount needed for very big reduction positioning user's finger, when saving processing
Between, the real-time monitoring suitable for projection touch tablet.
The application calculates P in real timeiThree-dimensional coordinate, can real-time tracing user's finger position and track, and then obtain use
The movement of family finger manipulation cursor, solve the problems, such as projection touch tablet on user how controlling cursor.
The corresponding relationship of finger and cursor is mainly influenced by two kinds of movements, and one is the movements of finger, and one is fingers
The variation of posture.And when the variation in finger movement and posture, PiWill be with changing therewith, therefore P can be selected completelyiGeneration
Corresponding relationship is established for user's finger and cursor, it is only necessary to track PiPosition, can correspond to obtain user it is corresponding to cursor
Operation.
Such as: the Rule of judgment of mouse-click may be configured as: lay a finger on, HpiThe duration of≤0.5a less than 0.2 second,
HpiP when≤0.5aiContinuous dislocation distance is less than 5mm, then is determined as single-click operation.
The Rule of judgment of double click may be configured as: twice, the mouse-click operating time is less than continuous mouse-click twice
0.5 second, P when mouse-click twiceiContinuous dislocation distance is less than 1.5cm, is determined as double click operation.
The Rule of judgment of mouse drag may be configured as: mouse, which is in, on display interface can pull position, carry out touching defensive position
Finger is constantly in touching state, and continuous multiple frames are subjected to displacement, and tracks PiTrack, track correspond to the dragging track of cursor, even
First frame after continuous touching discharges drag operation when not touching.
Principle and P based on above color coding structural light measurement three-dimensional coordinateiDefinition, Fig. 4 gives throwing of the present invention
The flow chart of the acquisition methods of user's finger parameter in shadow touch tablet, wherein user's finger parameter is touching judgement point PiThree-dimensional
Coordinate (xPi,yPi,HPi), method includes the following steps:
Step A-1 (S101): shooting the present image of projection plane, and projection plane is simultaneously color coding structural light and touching
The projection plane of template, top view and contrast images to present image do difference operation and obtain error image, and contrast images are
Whether the top view of projection plane when user's finger does not enter projection plane judge in error image comprising user's finger profile,
If it is execution step A-2.
It should be noted that color coding structural light three-dimensional measuring system has been subjected to calibration before step A-1.
The homography matrix that the present invention is calculated using calibrated projector and camera, camera is shot
Present image and contrast images project into corresponding top view.After present image is converted to top view, decoding top view is obtained
The two-dimensional coordinate of the two-dimensional coordinate of the pixel arrived, i.e. corresponding pixel points on a projection plane.
Further, error image is obtained to the difference operation that does of the top view of present image and contrast images, it is specific to wrap
It includes: the top view of present image being converted to the first two-dimensional matrix of corresponding pixel points, contrast images are converted into respective pixel
Second two-dimensional matrix of point, does difference operation to the first two-dimensional matrix and second two-dimensional matrix and obtains the third of error image
Third two-dimensional matrix is converted to error image by two-dimensional matrix.
Error image can observe apparent user's finger as shown in figure 5, if user's finger enters projection plane
Deformation area.
Judge whether user's finger enters it is possible to further the similarity based on deformation area profile and user's finger profile
Projection plane.
Alternatively, the area in deformation area in error image is obtained, if the ratio of the area of the area and projection plane in deformation area
Value is more than preset value, and such as 0.1%, then determine in error image comprising user's finger profile.
Step A-2 (S102): extracting the user's finger profile in error image, decodes each point on user's finger profile and exists
Two-dimensional coordinate on error image determines the principal direction and finger pulp of user's finger according to user's finger profile and its two-dimensional coordinate
Width a.
Wherein, extracting the user's finger profile in error image includes: that default size is chosen on third two-dimensional matrix
Window, the pixel mean value of all pixels point will be greater than the pixel of threshold value as threshold value on third two-dimensional matrix in calculation window
Pixel value be revised as presetted pixel maximum value, by third two-dimensional matrix be less than or equal to threshold value pixel pixel value modify
For presetted pixel minimum value, the modified third two-dimensional matrix is converted into binaryzation error image, it is poor based on binaryzation
Value image zooming-out goes out user's finger profile.
For example, presetted pixel maximum value to be set as to the pixel value of white, presetted pixel minimum value is set as to the pixel of black
Value, by binary conversion treatment, available binaryzation error image as shown in FIG. 6.
Step A-3 (S103): according to principal direction, the finger tip point P of user's finger profile distalmost end is determinedf, enable and pass through finger tip
Point PfPrincipal direction on straight line be user's finger plane central axes, a point of N (N > 1) made even on the central axes of face be reference
Point is based on color coding structural light three-dimensional measurement of coordinates principle, P in calculating difference imagefWith the three-dimensional coordinate of N number of reference point.
Wherein, according to user's finger profile and its two-dimensional coordinate, the principal direction and finger pulp width a packet of user's finger are determined
It includes: longest two straight lines on user's finger profile is found using Hough transformation, as shown in fig. 7, taking the angle of two included angle of straight line
Bisector direction is the principal direction of user's finger, takes the average value of distance between two straight lines for the finger pulp width a of user's finger,
The radius that finger tip model can correspondingly be obtained is 0.5a.
Step A-4 (S104): N number of reference point and P are based onfThree-dimensional coordinate, utilize least square method with calculate user hand
The pitch angle of finger
Wherein, lkFor reference point k on error image with PfDistance, can be obtained by error image, can also be by each
X, the y-coordinate value of point are calculated, hkHeight for reference point k apart from projection plane.
According to pitch angleCalculate current PiHighlyWith error image (projection plane)
On, PiAnd PfDistance on axis in the planesAccording to PfTwo-dimensional coordinate and DpAnd plane axis
Line obtains the x of PiPiAnd yPi。
In the present invention, step A-4 may be replaced by step B-4:
Step B-4: according to PfWith the three-dimensional coordinate of N number of reference point, three-dimensional central axes are fitted, three-dimensional central axes is translated and makes
PfOn three-dimensional central axes, PiFor on three-dimensional central axes with PfAt a distance of the point of 0.5a.
In the present invention, the fitting of three-dimensional central axes uses least square method, can also use other fitting algorithms, this hair
It is bright without limitation
As shown in figure 8, the invention also includes a kind of acquisition system of user's finger parameter in projection touch tablet,
The system includes:
Shooting module: shooting the present image of projection plane, and projection plane is simultaneously color coding structural light and touch tablet
Projection plane, top view and contrast images to present image do difference operation and obtain error image, and contrast images are user
Whether the top view of projection plane when finger does not enter projection plane judge in error image comprising user's finger profile, if
It is to execute profile decoding and analysis module；
Profile decoding and analysis module: extracting the user's finger profile in the error image, decodes user's finger profile
Two-dimensional coordinate of the upper each point on error image determines user's finger profile according to user's finger profile and its two-dimensional coordinate
Principal direction and finger pulp width a；
Edge analysis module 2: according to principal direction, the finger tip point P of user's finger profile distalmost end is determinedf, enable and pass through finger tip
Point PfPrincipal direction on straight line be user's finger profile plane central axes, the N number of point made even on the central axes of face be reference point,
Based on color coding structural light three-dimensional measurement of coordinates principle, P in calculating difference imagefWith the three-dimensional coordinate of N number of reference point；
User's finger parameter calculating module: according to N number of reference point and PfThree-dimensional coordinate, utilize least square method calculate
The pitch angle of user's fingerAccording toCalculate current PiHeightPiAnd PfIn the planes
Distance on axisAccording to PfTwo-dimensional coordinate, DpAnd plane central axes obtain PiXPiAnd yPi。
Further, the content of user's finger parameter calculating module can be replaced user's finger parameter calculating module 2.
User's finger parameter calculating module 2: according to PfWith the three-dimensional coordinate of N number of reference point, it is fitted three-dimensional central axes, translation
Three-dimensional central axes make PfOn three-dimensional central axes, PiFor on three-dimensional central axes with PfAt a distance of the point of 0.5a.
Further, in shooting module, the difference operation that does of top view and contrast images to present image obtains difference
Value image includes: the first two-dimensional matrix that the top view of present image is converted to corresponding pixel points, and contrast images are converted to
Second two-dimensional matrix of corresponding pixel points does difference operation to the first two-dimensional matrix and the second two-dimensional matrix and obtains error image
Third two-dimensional matrix is converted to the error image by third two-dimensional matrix.
Further, in shooting module, judge in error image whether to include: acquisition difference comprising user's finger profile
The area in deformation area in image determines institute if the ratio of the area of the area and projection plane in deformation area is more than preset value
It states in error image comprising user's finger profile.
Further, in profile decoding and analysis module, the user's finger profile extracted in the error image includes:
The window of default size is chosen on third two-dimensional matrix, the pixel mean value conduct of all pixels point in calculation window
The pixel value for being greater than the pixel of threshold value on third two-dimensional matrix is revised as presetted pixel maximum value, by third two dimension by threshold value
The pixel value of pixel on matrix less than or equal to threshold value is revised as presetted pixel minimum value, by modified third two-dimensional matrix
Binaryzation error image is converted to, user's finger profile is extracted based on binaryzation error image.
Further, in profile decoding and analysis module, according to user's finger profile and its two-dimensional coordinate, user hand is determined
The principal direction and finger pulp width a of finger includes:
Longest two straight lines on the user's finger profile are found using Hough transformation, take the angle of two included angle of straight line flat
Separated time direction is the principal direction of user's finger, takes the average value of distance between two straight lines for the finger pulp width a of user's finger.
The color coding structural light measuring device of the application can use Miniaturization Design, both may be mounted at existing shifting
In dynamic intelligent terminal, independent expansible equipment may be designed in.
It should be noted that the embodiment for projecting the acquisition system of user's finger parameter in touch tablet of the invention, with throwing
The embodiment principle of the acquisition methods of user's finger parameter is identical in shadow touch tablet, and related place can mutual reference.
Color coding structural light three-dimensional coordinate measuring system of the application based on miniaturization need to only measure PiThree-dimensional sit
Mark, can quickly judge whether user's finger is touched with projection plane, real-time tracing PiPosition and track, can obtain
User's finger operate cursor movement, solve the problems, such as projection touch tablet on user how controlling cursor.In addition, the present invention adopts
With the interactive mode controlling cursor of projection touch tablet, the interactive interface of human-computer interaction is increased, is not limited by the size of touch screen,
Device miniaturization can meet the needs of convenient and fast human-computer interaction.
The foregoing is merely illustrative of the preferred embodiments of the present invention, not to limit scope of the invention, it is all
Within the spirit and principle of technical solution of the present invention, any modification, equivalent substitution, improvement and etc. done should be included in this hair
Within bright protection scope.
Claims (10)
1. the acquisition methods of user's finger parameter in a kind of projection touch tablet, which is characterized in that the user's finger parameter is touching
Touch judgement point PiThree-dimensional coordinate (xPi,yPi,HPi), which comprises
Step A-1: shooting the present image of projection plane, and the projection plane is simultaneously color coding structural light and touch tablet
Projection plane, top view and contrast images to the present image do difference operation and obtain error image, the contrast images
The top view of projection plane when not entering the projection plane for user's finger, judge in the error image whether include
User's finger profile, if it is execution step A-2；
Step A-2: extracting the user's finger profile in the error image, decodes on the user's finger profile each point in institute
The two-dimensional coordinate on error image is stated, according to the user's finger profile and its two-dimensional coordinate, determines the master of user's finger profile
Direction and finger pulp width a；
Step A-3: according to the principal direction, the finger tip point P of the user's finger profile distalmost end is determinedf, enable and pass through finger tip point Pf
Principal direction on straight line be the user's finger profile plane central axes, take N number of point on the plane central axes for ginseng
Examination point is based on color coding structural light three-dimensional measurement of coordinates principle, calculates P in the error imagefWith the three-dimensional of N number of reference point
Coordinate；
Step A-4: according to N number of reference point and PfThree-dimensional coordinate, utilize least square method with calculate user's finger pitch angleAccording to describedCalculate current PiHeightPiAnd PfIn the planes on axis
DistanceAccording to the PfTwo-dimensional coordinate, DpAnd plane central axes obtain PiXPiAnd yPi。
It is described to the present image 2. the method according to claim 1, wherein in the step A-1
The difference operation that does of top view and contrast images obtains error image and includes:
The first two-dimensional matrix that the top view of the present image is converted to corresponding pixel points, the contrast images are converted to
Second two-dimensional matrix of corresponding pixel points does difference operation to first two-dimensional matrix and second two-dimensional matrix and obtains institute
The third two-dimensional matrix is converted to the error image by the third two-dimensional matrix for stating error image.
3. the method according to claim 1, wherein in the step A-1, the judgement error image
In whether comprising user's finger profile include:
The area in deformation area in the error image is obtained, if the area of the area in the deformation area and the projection plane
Ratio is more than preset value, then determines in the error image comprising user's finger profile.
4. described to extract in the error image according to the method described in claim 2, it is characterized in that, in the step A-2
User's finger profile include:
The window that default size is chosen on the third two-dimensional matrix, calculates the pixel mean value of all pixels point in the window
As threshold value, the pixel value that the pixel of threshold value is greater than on the third two-dimensional matrix is revised as presetted pixel maximum value, it will
The pixel value of pixel on the third two-dimensional matrix less than or equal to threshold value is revised as presetted pixel minimum value, by the modification
Third two-dimensional matrix afterwards is converted to binaryzation error image, extracts user hand finger wheel based on the binaryzation error image
It is wide.
5. described according to the user hand finger wheel the method according to claim 1, wherein in the step A-2
Wide and its two-dimensional coordinate, determines the principal direction of user's finger and finger pulp width a includes:
Longest two straight lines on the user's finger profile are found using Hough transformation, take the angle of two included angle of straight line flat
Separated time direction is the principal direction of user's finger, takes the average value of distance between two straight lines for the finger pulp width of user's finger
a。
6. the acquisition system of user's finger parameter in a kind of projection touch tablet, which is characterized in that the user's finger parameter is touching
Touch judgement point PiThree-dimensional coordinate (xPi,yPi,HPi), the system comprises:
Shooting module: shooting the present image of projection plane, and the projection plane is simultaneously color coding structural light and touch tablet
Projection plane, top view and contrast images to the present image do difference operation and obtain error image, the comparison diagram
Top view as not entering the projection plane when projection plane for user's finger, judges whether wrap in the error image
Profile containing user's finger, if it is the decoding of execution profile and analysis module；
Profile decoding and analysis module: the user's finger profile in the error image is extracted, the user's finger profile is decoded
Two-dimensional coordinate of the upper each point on the error image determines user according to the user's finger profile and its two-dimensional coordinate
The principal direction and finger pulp width a of finger contours；
Edge analysis module 2: according to the principal direction, the finger tip point P of the user's finger profile distalmost end is determinedf, enable by referring to
Cusp PfPrincipal direction on straight line be the user's finger profile plane central axes, take N number of on the plane central axes
Point is reference point, is based on color coding structural light three-dimensional measurement of coordinates principle, calculates P in the error imagefWith N number of reference point
Three-dimensional coordinate；
User's finger parameter calculating module: according to N number of reference point and PfThree-dimensional coordinate, utilize least square method with calculate user
The pitch angle of fingerAccording to describedCalculate current PiHeight PiAnd PfIn plane
Distance on central axesAccording to the PfTwo-dimensional coordinate, DpAnd plane central axes obtain Pi's
xPiAnd yPi。
7. system according to claim 6, which is characterized in that described to the present image in the shooting module
The difference operation that does of top view and contrast images obtains error image and includes:
The first two-dimensional matrix that the top view of the present image is converted to corresponding pixel points, the contrast images are converted to
Second two-dimensional matrix of corresponding pixel points does difference operation to first two-dimensional matrix and second two-dimensional matrix and obtains institute
The third two-dimensional matrix is converted to the error image by the third two-dimensional matrix for stating error image.
8. system according to claim 6, which is characterized in that in the shooting module, the judgement error image
In whether comprising user's finger profile include:
The area in deformation area in the error image is obtained, if the area of the area in the deformation area and the projection plane
Ratio is more than preset value, then determines in the error image comprising user's finger profile.
9. system according to claim 7, which is characterized in that in the profile decoding and analysis module, the extraction institute
The user's finger profile stated in error image includes:
The window that default size is chosen on the third two-dimensional matrix, calculates the pixel mean value of all pixels point in the window
As threshold value, the pixel value that the pixel of threshold value is greater than on the third two-dimensional matrix is revised as presetted pixel maximum value, it will
The pixel value of pixel on the third two-dimensional matrix less than or equal to threshold value is revised as presetted pixel minimum value, by the modification
Third two-dimensional matrix afterwards is converted to binaryzation error image, extracts user hand finger wheel based on the binaryzation error image
It is wide.
10. system according to claim 6, which is characterized in that described according to the use in the profile decoding and analysis module
Family finger contours and its two-dimensional coordinate, determine the principal direction of user's finger and finger pulp width a includes:
Longest two straight lines on the user's finger profile are found using Hough transformation, take the angle of two included angle of straight line flat
Separated time direction is the principal direction of user's finger, takes the average value of distance between two straight lines for the finger pulp width of user's finger
a。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711135967.0A CN109799928B (en) | 2017-11-16 | 2017-11-16 | Method and system for acquiring user finger parameters in projection touch panel |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711135967.0A CN109799928B (en) | 2017-11-16 | 2017-11-16 | Method and system for acquiring user finger parameters in projection touch panel |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109799928A true CN109799928A (en) | 2019-05-24 |
| CN109799928B CN109799928B (en) | 2022-06-17 |
Family
ID=66555334
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711135967.0A Active CN109799928B (en) | 2017-11-16 | 2017-11-16 | Method and system for acquiring user finger parameters in projection touch panel |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109799928B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110559660A (en) * | 2019-08-02 | 2019-12-13 | 福州智永信息科技有限公司 | method and medium for mouse-to-object drag in Unity3D scene |
| CN117115926A (en) * | 2023-10-25 | 2023-11-24 | 天津大树智能科技有限公司 | Human body action standard judging method and device based on real-time image processing |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101308012A (en) * | 2008-05-29 | 2008-11-19 | 上海交通大学 | Double monocular white light three-dimensional measuring systems calibration method |
| CN102508574A (en) * | 2011-11-09 | 2012-06-20 | 清华大学 | Projection-screen-based multi-touch detection method and multi-touch system |
| CN103383731A (en) * | 2013-07-08 | 2013-11-06 | 深圳先进技术研究院 | Projection interactive method and system based on fingertip positioning and computing device |
| CN104315996A (en) * | 2014-10-20 | 2015-01-28 | 四川大学 | Method for realizing fourier transform profilometry by using binary encoding strategy |
-
2017
- 2017-11-16 CN CN201711135967.0A patent/CN109799928B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101308012A (en) * | 2008-05-29 | 2008-11-19 | 上海交通大学 | Double monocular white light three-dimensional measuring systems calibration method |
| CN102508574A (en) * | 2011-11-09 | 2012-06-20 | 清华大学 | Projection-screen-based multi-touch detection method and multi-touch system |
| CN103383731A (en) * | 2013-07-08 | 2013-11-06 | 深圳先进技术研究院 | Projection interactive method and system based on fingertip positioning and computing device |
| CN104315996A (en) * | 2014-10-20 | 2015-01-28 | 四川大学 | Method for realizing fourier transform profilometry by using binary encoding strategy |
Non-Patent Citations (1)
| Title |
|---|
| SEN LI等: "Bare-finger Projector-Camera-Touchpad (PCT) HCI", 《IEEE INTERNATIONAL SSYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 2017)》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110559660A (en) * | 2019-08-02 | 2019-12-13 | 福州智永信息科技有限公司 | method and medium for mouse-to-object drag in Unity3D scene |
| CN110559660B (en) * | 2019-08-02 | 2022-05-17 | 宝宝巴士股份有限公司 | Method and medium for mouse-to-object drag in Unity3D scene |
| CN117115926A (en) * | 2023-10-25 | 2023-11-24 | 天津大树智能科技有限公司 | Human body action standard judging method and device based on real-time image processing |
| CN117115926B (en) * | 2023-10-25 | 2024-02-06 | 天津大树智能科技有限公司 | Human body action standard judging method and device based on real-time image processing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109799928B (en) | 2022-06-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106598227B (en) | Gesture identification method based on Leap Motion and Kinect | |
| CN102508574B (en) | Projection-screen-based multi-touch detection method and multi-touch system | |
| TWI454968B (en) | Three-dimensional interactive device and operation method thereof | |
| CN103544472B (en) | A kind of processing method and processing unit based on images of gestures | |
| CN102096471B (en) | Human-computer interaction method based on machine vision | |
| JP6044426B2 (en) | Information operation display system, display program, and display method | |
| CN102508578B (en) | Projection positioning device and method as well as interaction system and method | |
| WO2011123845A2 (en) | A computing device interface | |
| CN108388341B (en) | Man-machine interaction system and device based on infrared camera-visible light projector | |
| CN103955316B (en) | A kind of finger tip touching detecting system and method | |
| Dai et al. | Touchscreen everywhere: On transferring a normal planar surface to a touch-sensitive display | |
| CN109145802A (en) | More manpower gesture man-machine interaction methods and device based on Kinect | |
| CN109242760B (en) | Face image processing method and device and electronic equipment | |
| CN109799928A (en) | Project the acquisition methods and system of user's finger parameter in touch tablet | |
| Hartanto et al. | Real time hand gesture movements tracking and recognizing system | |
| Titlee et al. | A novel design of an intangible hand gesture controlled computer mouse using vision based image processing | |
| WO2024044084A1 (en) | Systems and methods for augmented reality viewing based on directly mapped point cloud overlays | |
| Xu et al. | Bare hand gesture recognition with a single color camera | |
| CN113807191B (en) | Non-invasive visual test script automatic recording method | |
| Wang et al. | A six-degree-of-freedom virtual mouse based on hand gestures | |
| Reza et al. | Real time mouse cursor control based on bare finger movement using webcam to improve HCI | |
| Cheng et al. | Fingertip-based interactive projector–camera system | |
| Vančo et al. | Gesture identification for system navigation in 3D scene | |
| CN102929434B (en) | Optical projection system and its image treatment method | |
| Hartmann et al. | A virtual touchscreen with depth recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |