CN1904806A - System and method of contactless position input by hand and eye relation guiding - Google Patents

Abstract

The invention relates to a discontact location input system and method guided by hand and eye. It includes two CCD video cameras, a large scale display terminal, a computer installed plural image acquisition card. The system uses platform labeling module to label video camera parameter. The location input method includes following steps: full automation video camera demarcating, hand and eye location gathering, and demarcating target point solving. The invention is based on computer vision technology, and has the advantages of visual, accurate and real time.

Description

The contactless position input system and the method for hand, eye relation guiding

Technical field

The present invention relates to a kind of dimensional visual measurement system and method, the contactless position input system and the method for particularly a kind of hand, eye relation guiding.

Background technology

The position input system is a kind of of computer entry device, theoretically, and any input that need all need positional information with the occasion that computing machine carries out interactive operation.At present, the most frequently used position input equipment is Genius mouse and touch-screen, and this kind equipment requires user and equipment to keep in touch in use, has therefore fettered user's activity space.Be not easy to retrain under the occasion of user's activity, such as exhibition and some industrial occasions, it is inconvenient even impossible using contact position input system.

Replacing the existing contact input mode with the contactless position input mode will be that the user provides unconfined input to experience, and the ease for use of enhanced system, the interactive and enjoyment used are the effective means that promotes the digital product added value.Yet this class The Application of Technology is also fewer at present, only trials mainly concentrate on two classes: a class is that existing Genius mouse is transformed, the stube cable of Genius mouse and main frame is replaced with infrared or radiofrequency signal, make the location input device of hand-held.This class technology has been broken away from the constraint of cable to the user, but because the input of positional information need realize by the roll mouse ball, for distance indicating target user far away (as the visitor in the exhibition, they often are required to watch displaying outside certain distance), this input mode is not directly perceived and coarse; Another kind of technology is used SMD position transducer, some pieces of sensors is positioned on some position (as finger) of user's health, realizes the input of positional information by the special exercise of induction human body.This method can realize position input intuitively, but owing to need user's wearable sensors, application flexibility has been subjected to influence.This two classes technology reality still requires the user to contact input equipment, therefore from the strict sense, is not real contactless position input system.

Summary of the invention

The object of the present invention is to provide the position input system and the method for a kind of hand, eye relation guiding, utilize binocular vision technology to realize to the real-time follow-up and accurate location of user's finger with eyes, and judge the target location that its finger is indicated, thereby realize non-contacting, position input intuitively.

For achieving the above object, design of the present invention is:

The contactless position input system of hand, eye relation guiding, by two ccd video cameras (1), a display terminal (2), a computing machine (3) that is equipped with the multichannel image capture card is formed, and plane reference template (4) is used for calibrating camera parameters.Wherein, computing machine (3) is connected with video camera (1) by image pick-up card and is connected with display terminal (2) by display card, is provided with a cover automatic calibrating procedure of video camera and a cover indicating positions routine analyzer in the computing machine (3).System of the present invention characteristics are:

Two ccd video cameras (1) use assembles configuration formation binocular vision system, plane reference template (4) is made of two concentric circless and four rectilinear figures by the center of circle and circumference in equal parts that accurate Drawing on the one flat plate goes out, the automatic calibrating procedure of video camera can be realized full-automatic, high-precision camera parameters demarcation, the indicating positions routine analyzer can be exported the position coordinates of indication point in real time, and display terminal can be the space object of large screen projector, displaying sand table or stereoscopic model and arbitrary shape etc.

The contactless position input method of hand of the present invention, eye relation guiding adopts said system to realize having following characteristics:

1. binocular vision system is demarcated after the equipment installation and is once got final product;

2. utilize the binocular vision principle to calculate the volume coordinate of object point, realize non-contacting, real-time position measurement;

3. use the detection of people's face, human eye location and finger locating algorithm and target tracking algorism, the human body privileged site in the image sequence is followed the tracks of;

4. from people's physiological characteristic,, judge the target location that finger is indicated with the straight line of central point between connecting two and finger tip boresight as the people;

5. with different environments for use abstract be one group of environmental parameter, can adapt to different application by revising environmental parameter.

According to above-mentioned inventive concept, the present invention adopts following technical proposals:

The contactless position input system of a kind of hand, eye relation guiding, by two ccd video cameras, a large-scale display terminal, a table apparatus is made up of the computing machine of multichannel image capture card, and computing machine is connected with video camera by image pick-up card and is connected with large-scale display terminal by display card.It is characterized in that: described two ccd video cameras are fixed in user's dead ahead to assemble configuration mode, and the installation site need guarantee that ccd video camera visual field, the left and right sides all covers the front of user's health first half; There is a plane reference template timing signal to place the visual field of two ccd video cameras; The image that described computing machine is gathered calibrating template according to two ccd video cameras carries out camera parameters and demarcates; Remove calibrating template during systematic survey, computing machine is found the solution and the export target point coordinate promptly contactless input indicating positions coordinate according to the camera parameters of default environmental parameter, demarcation and the image that contains user's hand, eye of camera acquisition.

Above-mentioned plane reference template is made of two concentric circless and four rectilinear figures by the center of circle and circumference in equal parts that accurate Drawing on the smooth flat board goes out.

Above-mentioned large-scale display terminal is large screen projector or shows sand table or stereoscopic model or space object.

The contactless position input method of a kind of hand, eye relation guiding, adopt the contactless position input system of hand, eye relation guiding, it is characterized in that concrete job step is: after two ccd video cameras and a plane reference Template Location are installed, the automatic calibrating procedure of computer starting one cover video camera, according to the image of the plane reference template of gathering, carry out camera parameters and demarcate; Default environmental parameter is set up display terminal place plane equation; During system works, remove calibrating template, computer starting one cover indicating positions routine analyzer contains the image of user's hand, eye according to default environmental parameter, camera calibration parameter and first frame that reads in camera acquisition, finds the solution and export the indicating positions point coordinate; Then read in next frame and contain the image of user's hand, eye, find the solution and export the indicating positions point coordinate, so circulation realizes the tracking of indicating positions.

The automatic calibrating procedure of above-mentioned video camera has following steps:

The extraction of feature point for calibration, with the intersection point of the radial alignment of drawing on the plane reference template and circumference as feature point for calibration: the image that reads in the plane reference template, extract the sample point of circle and the drop shadow curve of straight line on the video camera imaging face respectively, the drop shadow curve of circle is oval, the projection of straight line still is a straight line, the sample point that uses elliptic equation and straight-line equation to extract respectively with least square fitting, two set of equations of simultaneous match solve intersecting point coordinate oval and straight line;

Camera parameters calibrated and calculated: according to the intersecting point coordinate of trying to achieve, calculate video camera external parameter---rotation matrix R and motion vector T, try to achieve intrinsic parameters of the camera then---focal distance f and lens distortion coefficient k.

Above-mentioned indicating positions routine analyzer has following steps: read in the image that a frame contains the camera acquisition of user's hand, eye; Locate point coordinate Pe and forefinger finger tip coordinate Pf in the eyes respectively; The boresight of the straight line of eyes mid point and finger tip as the people will be connected, judge the target location of finger indication: utilize and demarcate good camera parameters, mid point and four system of equations of finger tip point difference simultaneous to the eyes line, solve three-dimensional coordinate Pe (X separately, Y, Z) and Pf (X, X, Z), Pe connects, the space line equation of Pf according to the environmental parameter of pre-input, is set up the space plane equation on plane, display terminal place, to connect Pe, indicating positions impact point coordinate is found the solution and exported to the space line equation of Pf and the space plane equations simultaneousness at display terminal place; Read in the next frame image, repeated for two steps, realize the indicating positions tracking.

The present invention compared with prior art has following conspicuous outstanding substantive distinguishing features and remarkable advantage:

1. use video camera as sensor, realized real contactless position input.

2. considered people's physiological property,, made the mode of position input meet people's custom, thereby need not the user is carried out special training, reached intuitive and accurate purpose with hand, eye position relation guiding system identification people's indicating target.

3. environment for use had stronger adaptability.The detection of human body privileged site and track algorithm have guaranteed the steady operation of system under complex background, therefore the background of using the district are arranged there is not specific (special) requirements; Parameterized environment is provided with function, and system can be conveniently used among the multiple different environment.

4. camera calibration is easy, accurate.Native system only need be demarcated a video camera when mounted and get final product, what calibrating template used is the lower and portable plane template of cost, the unique point that circular symmetric distributes helps to reduce the radially influence of image deformation to calculating, calibrating procedure in the computing machine can be finished extracted with high accuracy, coupling, and whole evaluation works such as parametric solution of template characteristic point automatically, need not artificial intervention.

The present invention can realize directly perceived, accurate, real-time contactless position input.

Description of drawings

Fig. 1 is the structural representation of one embodiment of the invention.

Fig. 2 is camera calibration template and the scaling method synoptic diagram that Fig. 1 example is used.

Fig. 3 is the optical schematic diagram of the twin camera of Fig. 1 example.

Fig. 4 is that the video camera mark of Fig. 1 example is decided the process flow diagram of program automatically, and wherein figure (a) is the feature point extraction process flow diagram, and figure (b) is the calculation of parameter process flow diagram.

Fig. 5 is the process flow diagram of the indicating positions routine analyzer of Fig. 1 example.

Embodiment

A preferred embodiment accompanying drawings of the present invention is as follows:

Referring to Fig. 1, Fig. 2, the contactless position input system of this hand, eye relation guiding, by two ccd video cameras (1), a display terminal (2), a computing machine (3) that is equipped with the multichannel image capture card is formed, and plane reference template (4) is used for calibrating camera parameters.Wherein, computing machine (3) is connected with video camera (1) by image pick-up card and is connected with display terminal (2) by display card, is provided with a cover automatic calibrating procedure of video camera and a cover indicating positions routine analyzer in the computing machine (3).

Contactless position input method of the present invention is implemented by the contactless position input system of above-mentioned hand, eye relation guiding, and its step is as follows:

Before the use, two video cameras are fixed in user's dead ahead in the mode of assembling configuration, the installation site need guarantee that the left and right cameras visual field all covers the front of user's health first half, referring to Fig. 1.

After installation, carry out the camera parameters staking-out work, referring to Fig. 2.Calibrating template (4) is placed among the visual field of video camera (1), by computing machine (3) images acquired and use the automatic calibrating procedure of its built-in video camera to demarcate.

The optical principle of twin camera as shown in Figure 3, wherein, two lens focus and distortion factors of assembling the video camera of configuration are respectively f1, k1 and f2, k2; O1, o1 and O2, o2 are respectively their camera lens photocentre and focus; XYZ is a world coordinate system, x ₁y ₁z ₁With x ₂y ₂z ₂It is camera coordinate system; (Xw, Yw Zw) are the coordinate of object point P under world coordinate system, (x1 _i, y1 _i) and (x2 _i, y2 _i) be respectively the P o'clock subpoint coordinate on two camera plane.The purpose of camera calibration is exactly to determine inner parameter f (focal length), k (lens distortion coefficient) and the external parameter of two video cameras respectively $R=\left[\begin{array}{ccc}{r}_1& r_2& r_3\\ r_4& r_5& r_6\\ r_7& r_8& r_9\end{array}\right]$ (rotation matrix), $T=\left[\begin{array}{c}{T}_x\\ T_y\\ T_z\end{array}\right]$ (motion vector).Automatically the algorithm of calibrating procedure is divided into two parts:

First is the extraction of feature point for calibration, referring to Fig. 4 (a).As shown in Figure 2, the present invention uses the intersection point of radial alignment section that template surface draws and circumference as feature point for calibration, for realizing high-precision feature point extraction, and the method for having used Flame Image Process to combine here with the characteristic curve match.

Extract the sample point of circle and the drop shadow curve of straight line on the video camera imaging plane at first respectively, because the drop shadow curve of circle still is a straight line for the drop shadow curve of ellipse straight line, therefore the sample point that uses elliptic equation (1) and straight-line equation (2) to extract with least square fitting respectively:

Ax ²+Bxy+Cy ²+Dx+Ey+1＝0 (1)

y＝mx+b (2)

Two set of equations that simultaneous simulates, the intersecting point coordinate (X that solves _Fi, Y _Fi) promptly be the unique point image coordinate of sub-pixel precision.

Second portion is a calculation of parameter, referring to Fig. 4 (b).Calculation of parameter utilizes the unique point coordinate of obtaining previously to finish in two steps.

The first step:

1, establishes unique point (X _Fi, Y _Fi) corresponding world coordinates is (X _Wi, Y _Wi), (X _c, Y _c) be the picture centre coordinate, (N _x, N _y) be that video camera is as the last pixel number of planar unit distance.Calculate

X _di＝(X _fi-X _c)/N _x (3)

Y _di＝(Y _fi-Y _c)/N _y

2, to each unique point point P _i, list an equation, this N of simultaneous equation

$\left[\begin{array}{ccccc}{x}_{\mathrm{wi}}{Y}_{\mathrm{di}}& y_{\mathrm{wi}}{Y}_{\mathrm{di}}& Y_{\mathrm{di}}& {-x}_{\mathrm{wi}}{X}_{\mathrm{di}}& -y_{\mathrm{wi}}{X}_{\mathrm{di}}\end{array}\right]\&CenterDot;\left[\begin{array}{c}{\mathrm{<figure-callout\; id="1"\; label="r"\; filenames="A20061002948300112.png"\; state="\{\{state\}\}">r</figure-callout>}}_1/{\mathrm{<figure-callout\; id="2"\; label="T\; y\; r"\; filenames="A20061002948300111.png"\; state="\{\{state\}\}">T</figure-callout>}}_y& \\ r_{}{}_2/T_y\\ T_x/{\mathrm{<figure-callout\; id="4"\; label="T\; y\; r"\; filenames="A20061002948300111.png,A20061002948300112.png"\; state="\{\{state\}\}">T</figure-callout>}}_y& \\ r_{}{}_4/T_y\\ r_5/T_y\end{array}\right]=X_{\mathrm{di}}---\left(4\right)$

I=1 in the formula, 2 ..., N utilizes least square method to find the solution this overdetermined equation group (N＞5), can get following variable:

r ₁′＝r ₁/T _y r ₂′＝r ₂/T _y T _x′＝T _x/T _y r ₄′＝r ₄/T _y r ₅′＝r ₅/T _y

3, utilize the orthogonality of R to calculate T _yAnd r ₁～r ₉, can obtain:

${{\mathrm{<figure-callout\; id="2"\; label="T\; y"\; filenames="A20061002948300111.png"\; state="\{\{state\}\}">T</figure-callout>}}_y}^2=\frac{S_r-{[S_r^2-4{({\mathrm{<figure-callout\; id="1"\; label="r"\; filenames="A20061002948300112.png"\; state="\{\{state\}\}">r</figure-callout>}}_1^{\&prime;}{r}_5^{\&prime;}-{\mathrm{<figure-callout\; id="4"\; label="r"\; filenames="A20061002948300111.png,A20061002948300112.png"\; state="\{\{state\}\}">r</figure-callout>}}_4^{\&prime;}{\mathrm{<figure-callout\; id="2"\; label="r"\; filenames="A20061002948300111.png"\; state="\{\{state\}\}">r</figure-callout>}}_2^{\&prime;})}^2]}^{1/2}}{2{({\mathrm{<figure-callout\; id="1"\; label="r"\; filenames="A20061002948300112.png"\; state="\{\{state\}\}">r</figure-callout>}}_1^{\&prime;}{r}_5^{\&prime;}-{\mathrm{<figure-callout\; id="4"\; label="r"\; filenames="A20061002948300111.png,A20061002948300112.png"\; state="\{\{state\}\}">r</figure-callout>}}_4^{\&prime;}{\mathrm{<figure-callout\; id="2"\; label="r"\; filenames="A20061002948300111.png"\; state="\{\{state\}\}">r</figure-callout>}}_2^{\&prime;})}^2}---\left(5\right)$

S wherein _r=r ₁ ^{' 2}+ r ₂ ^{' 2}+ r ₄ ^{' 2}+ r ₅ ^{' 2}, T _ySymbol can utilize imaging geometry to determine.

Utilize orthogonality and right-handed system characteristic (is right-handed system corresponding to world coordinates) can calculate R

$R=\left[\begin{array}{ccc}{r}_1& r_2& {(1-{{\mathrm{<figure-callout\; id="1"\; label="r"\; filenames="A20061002948300112.png"\; state="\{\{state\}\}">r</figure-callout>}}_1}^2-{{\mathrm{<figure-callout\; id="2"\; label="r"\; filenames="A20061002948300111.png"\; state="\{\{state\}\}">r</figure-callout>}}_2}^2)}^{1/2}\\ r_4& r_5& S{(1-{{\mathrm{<figure-callout\; id="4"\; label="r"\; filenames="A20061002948300111.png,A20061002948300112.png"\; state="\{\{state\}\}">r</figure-callout>}}_4}^2-{r_5}^2)}^{1/2}\\ r_7& r_8& r_9\end{array}\right]$ Or $R=\left[\begin{array}{ccc}{r}_1& r_2& -{(1-{{\mathrm{<figure-callout\; id="1"\; label="r"\; filenames="A20061002948300112.png"\; state="\{\{state\}\}">r</figure-callout>}}_1}^2-{{\mathrm{<figure-callout\; id="2"\; label="r"\; filenames="A20061002948300111.png"\; state="\{\{state\}\}">r</figure-callout>}}_2}^2)}^{1/2}\\ r_4& r_5& -S{(1-{{\mathrm{<figure-callout\; id="4"\; label="r"\; filenames="A20061002948300111.png,A20061002948300112.png"\; state="\{\{state\}\}">r</figure-callout>}}_4}^2-{r_5}^2)}^{1/2}\\ -r_7& -r_8& r_9\end{array}\right]$

S=-sgn[r in the formula ₁r ₄+ r ₂r ₅], r ₇, r ₈, r ₉Can obtain by preceding two multiplication crosses of going of matrix.Specifically choose which R, can determine by trial method.

Second step is to each unique point P _iCalculate:

y _i＝r ₄x _wi+r ₅y _wi+T _y

z _i＝r ₁x _wi+r ₂y _wi+T _z

If w _i=r ₇x _Wi+ r ₈y _Wi, do not consider lens distortion earlier, then

$\left[\begin{array}{cc}{y}_i& -(Y_f-Y_c)/N_y\end{array}\right]\&CenterDot;\left[\begin{array}{c}f\\ T_z\end{array}\right]=(Y_f-Y_c)w_i/N_y---\left(6\right)$

Separate this equation (i=1,2 ..., N) can obtain the T of effective focal length f and translation vector T respectively _zComponent, and hypothesis k=0 are done initial the exploration with these values, utilize optimized Algorithm to find the solution following Nonlinear System of Equations:

$Y(1+{\mathrm{kr}}^2)=f\frac{r_4{x}_{\mathrm{wi}}+r_5{y}_{\mathrm{wi}}+T_y}{r_7{x}_{\mathrm{wi}}+r_8{y}_{\mathrm{wi}}+T_z}---\left(7\right)$

$X(1+{\mathrm{kr}}^2)=f\frac{r_1{x}_{\mathrm{wi}}+r_2{y}_{\mathrm{wi}}+T_x}{r_7{x}_{\mathrm{wi}}+r_8{y}_{\mathrm{wi}}+T_z}$

Can solve: f, T _z, k exact value.

After camera calibration is good, starts the indicating positions routine analyzer on the computing machine (3) and environmental parameter is set, system promptly starts working.With reference to Fig. 5, the course of work of indicating positions routine analyzer is as follows:

1, (size is the red component I among the M * N) to computed image _n(x, vertical Gray Projection y) $\mathrm{PV}\left(x\right)=\underset{y=1}{\overset{N}{\mathrm{\&Sigma;}}}I(x,y),$ Get the left and right sides border of the border, the left and right sides at the protruding peak of curve PV as people's face; Use the edge grouping algorithm, and the accurate image coordinate Pe that locatees the position of eyes and calculate eyes line mid point in human face region (x, y);

2, judge the approximate region of finger according to people's physiological structure, in this zone, use colour of skin extraction algorithm to isolate the template finger of binaryzation, white pixel in this template point carried out fitting a straight line and obtains foremost coordinate Pf (x is y) as the finger tip point coordinate;

3, according to image-forming principle, spatial point (X, Y, Z) left and right cameras as the projection on the plane (x1, y1) with (x2, y2) satisfy respectively:

(x ₁r ₁₇-f ₁r ₁₁)X+(x ₁r ₁₈-f ₁r ₁₂)Y+(x ₁r ₁₉-f ₁r ₁₃)Z＝f ₁T _1x-x ₁T _1z

(x ₁r ₁₇-f ₁r ₁₄)X+(x ₁r ₁₈-f ₁r ₁₅)Y+(x ₁r ₁₉-f ₁r ₁₆)Z＝f ₁T _1y-y ₁T _1z

With

(x ₂r ₂₇-f ₂r ₂₁)X+(x ₂r ₂₈-f ₂r ₂₂)Y+(x ₂r ₂₉-f ₂r ₂₃)Z＝f ₂T _2x-x ₂T _2z

(x ₂r ₂₇-f ₂r ₂₄)X+(x ₂r ₂₈-f ₂r ₂₅)Y+(x ₂r ₂₉-f ₂r ₂₆)Z＝f ₂T _2y-y ₂T _2z

Utilize to demarcate good camera parameters, the mid point and the finger tip point of eyes line distinguished above-mentioned four system of equations of simultaneous, solve separately three-dimensional coordinate Pe (X, Y, Z) and Pf (X, Y, Z).According to the environmental parameter of pre-input, set up the space plane equation on display terminal (2) plane, place, and with the space line equations simultaneousness that is connected Pe, Pf, (X, Y Z), are exactly the indicated impact point coordinate of people to solve intersection point Pt;

4, use block matching algorithm to follow the tracks of the next frame image I _N+1(x, y) in Pe, the match point of Pf, circulation execution in step 3,4, thereby incessantly export target point coordinate Pt (X, Y, Z).

Claims (6)

1. the contactless position input system of a hand, eye relation guiding, by two ccd video cameras (1), a large-scale display terminal (2), one table apparatus has the computing machine (3) of multichannel image capture card to form, and computing machine (3) is connected with video camera (1) by image pick-up card and is connected with large-scale display terminal (2) by display card; It is characterized in that:

1) described two ccd video cameras (1) are fixed in user's dead ahead to assemble configuration mode, and the installation site need guarantee that left and right sides ccd video camera (1) visual field all covers the front of user's health first half;

2) there is a plane reference template (4) to place the visual field of two ccd video cameras (1) in the demarcation before use; The image that described computing machine (3) is gathered calibrating template (4) according to two ccd video cameras (1) carries out camera parameters and demarcates; During systematic survey, remove calibrating template (4), computing machine (3) is found the solution and the export target point coordinate promptly contactless input indicating positions coordinate according to the camera parameters of default environmental parameter, demarcation and the image that contains user's hand, eye of camera acquisition.

2. the contactless position input system of hand according to claim 1, eye relation guiding is characterized in that described plane reference template (4) is made of two concentric circless and four rectilinear figures by the center of circle and circumference in equal parts that accurate Drawing on the smooth flat board goes out.

3. the contactless position input system of hand according to claim 1, eye relation guiding is characterized in that described large-scale display terminal (2) is large screen projector or displaying sand table or stereoscopic model or space object.

4. the contactless position input method of a hand, eye relation guiding adopts the contactless position input system of the described hand of claim 1, eye relation guiding, it is characterized in that concrete job step is:

1. after two ccd video cameras (1) and a plane reference Template Location were installed, computing machine (3) started the automatic calibrating procedure of a cover video camera, according to the image of the plane reference template (4) of gathering, carried out camera parameters and demarcated;

2. default environmental parameter is set up display terminal (2) place plane equation;

3. during systematic survey, remove calibrating template (4), computing machine (3) starts a cover indicating positions routine analyzer, according to default environmental parameter, camera calibration parameter with read in the image that first frame that video camera (1) gathers contains user's hand, eye, finds the solution and export the indicating positions point coordinate; Then read in next frame and contain the image of user's hand, eye, find the solution and export the indicating positions point coordinate, so circulation realizes the tracking of indicating positions.

5. the contactless position input method of hand according to claim 4, eye relation guiding is characterized in that the automatic calibrating procedure of described video camera has following steps:

1. the extraction of feature point for calibration, the radial alignment of go up drawing with plane reference template (4) and the intersection point of circumference are as feature point for calibration:

A) read in the image of plane reference template (4),

B) extract the sample point of circle and the drop shadow curve of straight line on the video camera imaging face respectively, the drop shadow curve of circle is oval, and the projection of straight line still is a straight line,

C) sample point that uses elliptic equation and straight-line equation to extract respectively with least square fitting, two set of equations of simultaneous match solve intersecting point coordinate oval and straight line;

2. camera parameters calibrated and calculated:

A) according to the intersecting point coordinate of trying to achieve, calculate video camera external parameter---rotation matrix R and motion vector T,

B) try to achieve intrinsic parameters of the camera then---focal distance f and lens distortion coefficient k.

6. the contactless position input method of hand according to claim 4, eye relation guiding is characterized in that described indicating positions routine analyzer has following steps:

1. read in a frame and contain the image that the video camera (1) of user's hand, eye is gathered;

2. locate point coordinate Pe and forefinger finger tip coordinate Pf in the eyes respectively;

3. will connect the boresight of the straight line of eyes mid point and finger tip, judge the target location of finger indication as the people:

A) utilize to demarcate good camera parameters, the mid point and the finger tip point of eyes line distinguished four system of equations of simultaneous, solve separately three-dimensional coordinate Pe (X, Y, Z) and Pf (X, Y, Z),

B) the connect space line equation of Pe, Pf,

C) according to the environmental parameter of pre-input, set up the space plane equation on display terminal (2) plane, place,

D) will connect the space line equation of Pe, Pf and the space plane equations simultaneousness at display terminal place, find the solution and export indicating positions impact point coordinate;

4. read in the next frame image, 2.～3. repeating step realizes the indicating positions tracking.

Images