CN103294173A - Remote control system based on user actions and method thereof - Google Patents

Abstract

The invention discloses a remote control system based on user actions and a remote control method thereof. The system comprises a display, a first image acquisition unit and a second image acquisition unit which are used for continuously acquiring user images, an image recognition unit, and a cursor position acquisition unit used for acquiring a cursor position coordinate, wherein the image recognition unit is used for recognizing the two-eye midpoint position of a user and the fingertip position from a signal of a user image; and an intersection point coordinate of a connecting straight line between the two-eye midpoint position and the fingertip point and a display plane of the display is obtained by the cursor position acquisition unit according to the first image acquisition unit, the second image acquisition unit, the two-eye midpoint position and the fingertip position, and the intersection point coordinate is taken as the cursor position coordinate. The remote control system based on the user actions and the method thereof can simulate actions of remote control operation of the user.

Description

Telechirics and method thereof based on user's action

Technical field

The present invention relates to a kind of telechirics and method thereof, particularly relate to a kind of telechirics and method thereof based on user's action.

Background technology

Along with development of science and technology, increasing electronic product appears in the middle of people's the life, for example air conditioner, televisor etc.Just also therefore, also occur more and more telepilots that are used for these electronic products of control in people's life, and telepilot has just like become one of device indispensable in the life.

In addition the function that possesses of existing televisor from strength to strength, intelligent TV for example, it also has the function of online except having existing function of watching various wired and wireless channel programs.Relatively, its corresponding telepilot is compared to the telepilot of existing televisor, and function is also numerous and diverse more, therefore may cause user's puzzlement, that is to say that the user can't intuitively find the function of wanting rapidly on telepilot.

On the other hand, body sense technology the technology of the function of some similar telepilots appearred in recent years, for example.Be example with the Kinect that Microsoft was released, it detects the action of human body by the colour camera on the relevant apparatus and 3D depth transducer, and in other words, this technology also can be used to replace the function of prior remote controller.

Yet the shortcoming of above-mentioned body sense technology is, video camera and sensor must capture the image of the action of user's whole body, just have preferable detecting accuracy, thereby make the user may be under the state of standing, even, the environment that also must stand in enough broadnesses is beneficial to stretch limbs, captures the image of its action for video camera and sensor.

Summary of the invention

The object of the present invention is to provide a kind of telechirics based on user's action.

The present invention is based on the telechirics of user's action, comprise a display, one first image capture element, one second image capture element, an image identification unit, and a cursor position obtains the unit.

The front of this display comprises that a peripheral part and is by the display plane of this circumference branch encirclement.

This first image capture element and this second image capture element are arranged at the peripheral part of this display, and lay respectively at left side and the right side of the display plane of this display, and be positioned on the same surface level, be used for capturing user's image constantly and producing corresponding signal.Wherein this first and second image capture interelement defines a horizontal line and at a distance of a horizontal range.

This image identification unit is used for the signal from this user's image, picks out the fingertip location of the finger tip of two point midways of user and at least one sensing display.

This cursor position obtains unit and is used for according to the relative position relation between this first image capture element, the second image capture element, two point midways and fingertip location, obtain the intersecting point coordinate of the display plane of connection straight line between these two point midways and fingertip location and this display, with as a cursor position coordinate.

Another object of the present invention is to provide a kind of remote control thereof based on user's action.Should be based on the remote control thereof of user's action, comprise following steps: (a) provide one to comprise a display, one first image capture element, one second image capture element, one image identification unit and a cursor position obtain the telechirics based on user's action of unit, wherein the front of this display comprises that a peripheral part and is by the display plane of this circumference branch encirclement, this first and second image capture element is arranged at the peripheral part of this display and lays respectively at left side and the right side of the display plane of this display, and be positioned on the same surface level, this first and second image capture interelement defines a horizontal line and at a distance of a horizontal range; (b) this first and second image capture element captures user's image constantly and produces corresponding signal; (c) this image identification unit is used for the signal from this user's image, picks out the fingertip location of the finger tip of two point midways of user and at least one sensing display; And (d) this cursor position obtains unit and is used for according to the relative position relation between this first image capture element, the second image capture element, two point midways and fingertip location, obtain the intersecting point coordinate of the display plane of connection straight line between these two point midways and fingertip location and this display, with as a cursor position coordinate.

Beneficial effect of the present invention is: by two point midways and the fingertip location that picks out the user, and obtain this cursor position coordinate according to two point midways and fingertip location, just can simulate the behavior of user's remote controller further.

Description of drawings

Fig. 1 is a system diagram, and the preferred embodiment of the telechirics that the present invention is based on user's action is described;

Fig. 2 is a process flow diagram, and the remote control thereof based on user's action of corresponding this preferred embodiment is described;

Fig. 3 is a synoptic diagram, and two point midways of user of this preferred embodiment and the relative position of display are described;

Fig. 4 is a synoptic diagram, and user's the fingertip location of this preferred embodiment and the relative position of display are described;

Fig. 5 is a synoptic diagram, and the user's of this preferred embodiment two point midways, fingertip location is described, and is connected the intersection point that straight line intersects at the display plane of display between two point midways of user and fingertip location.

Embodiment

The present invention is described in detail below in conjunction with drawings and Examples.

Consult Fig. 1, Fig. 2, Fig. 3, the preferred embodiment that the present invention is based on the telechirics 1 of user's action comprises a display 11, one first image capture element 12, one second image capture element 13, an image identification unit 14, and a cursor position obtains unit 15.This cursor position obtains unit 15 and comprises that an angle information obtains module 151 and a cursor coordinates computing module 152.In this preferred embodiment, this display 11 is televisors.This first image capture element 12 and the second image capture element 13 be charge coupled cell (Charge Coupled Device, CCD) or CMOS (Complementary Metal Oxide Semiconductor) (Complementary Metal Oxide Semiconductor, CMOS) wherein one.It is to implement with software mode that this image identification unit 14 obtains unit 15 with this cursor position, and it implements aspect is the computer program of the corresponding program of interior storage.After the processor (not shown) of this display 11 loads this program and execution, can finish the function that this image identification unit 14 and this cursor position obtain unit 15.

The front of this display 11 comprises display plane 112 (see figure 3)s that a peripheral part 111 and is surrounded by this peripheral part 111.

This first image capture element 12 and this second image capture element 13 are arranged at the peripheral part 111 of this display 11, and lay respectively at left side and the right side of the display plane 112 of this display 11, and are positioned on the same surface level.Wherein this first image capture element 12 and 13 of the second image capture elements define a horizontal line L and at a distance of a horizontal range X.This horizontal line L is the straight line that this first image capture element 12 and this second image capture element 13 are formed by connecting, and this horizontal range X is the length of this horizontal line L.

What deserves to be mentioned is that in this preferred embodiment, the initial point of a coordinate system is located at the position of this first image capture element 12.Positive x direction of principal axis is for pointing to the direction of the second image capture element 13 from initial point.Positive y direction of principal axis is the direction directly over pointing to from initial point.Positive z direction of principal axis is the direction of pointing out this display plane 112,, points to the user's in the place ahead that is positioned at these display 11 fronts direction that is.In brief, the coordinate of this first image capture element 12 is (0,0,0), the coordinate of this second image capture element 13 is (X, 0,0), and the surface level of the formed display plane 112 perpendicular to this display 11 of this horizontal line L certainly, is considered as the X ﹠amp of Y=0 in the whole coordinate system; The Z axial plane.

Below cooperate remote control thereof and an exemplary applications based on user's action, obtain module 151 at above-mentioned this first image capture element 12, the second image capture element 13, image identification unit 14, angle information, reach the interaction of 152 of cursor coordinates computing modules, explanation further.

At first, after the user who is positioned at the place ahead in these display 11 fronts started this display 11, this first image capture element 12 and the second image capture element 13 also came into operation.

Shown in step S21, this first image capture element 12 and the second image capture element 13 capture user's image constantly, and produce corresponding signal.

Shown in step S22, the signal that this image identification unit 14 is used for according to this user's image picks out the fingertip location B (see figure 4) of the finger tip of two point midway A (see figure 3)s of user and at least one sensing display 11.In this preferred embodiment, this image identification unit 14 is the fingertip location B of identification one finger tip only, but the also fingertip location of a plurality of finger tips of identification of this image identification unit 14 certainly, and it is disclosed to be not limited to this preferred embodiment.Wherein the coherent video identification technique of identification people face and limbs is to be familiar with this field person can understand easily, so do not give unnecessary details at this.

Shown in step S23, the angle information that this cursor position obtains unit 15 obtains module 151 according to the relative position relation (see figure 4) between this first image capture element 12, the second image capture element 13 and fingertip location B, obtains to represent the one first intersegmental angle theta of connecting line between this horizontal line L and this first image capture element 12 and fingertip location B ₁, represent the one second intersegmental angle theta of connecting line between this horizontal line L and this second image capture element 13 and fingertip location B ₂, represent this surface level P and one the 3rd intersegmental angle theta of the connecting line of this fingertip location B between the subpoint M on this horizontal line L and this fingertip location B ₃

The angle information that this cursor position obtains unit 15 obtains module 151 also according to this first image capture element 12, the second image capture element 13, and the relative position relation (see figure 3) of two point midway A, obtain to represent one the 4th intersegmental angle theta of connecting line between this horizontal line L and this first image capture element 12 and two point midway A ₄, represent one the 5th intersegmental angle theta of connecting line between this horizontal line L and this second image capture element 13 and two point midway A ₅, and represent this surface level P and one the 6th intersegmental angle theta of the connecting line of this two point midway A between the subpoint N on this horizontal line L and this two point midway A ₆

Shown in step S24, the cursor coordinates computing module 152 that this cursor position obtains unit 15 is used for according to this horizontal range X, and this angle information obtains first angle theta that module 151 obtains ₁, second angle theta ₂, the 3rd angle theta ₃, the 4th angle theta ₄, the 5th angle theta ₅And the 6th angle theta ₆, this cursor position coordinate of computing.

What deserves to be mentioned is, after this cursor coordinates computing module 152 calculates the relative coordinate of these two point midway A and this fingertip location B respectively earlier, calculate this cursor position coordinate more accordingly.Below will illustrate further at the details of this this cursor position coordinate of cursor coordinates computing module 152 computings.

The relative coordinate of two point midways:

Consult Fig. 3, at first, suppose that these two point midway A are positioned at this surface level below, this first image capture element 12 and the distance of these two point midway A between the subpoint N on this horizontal line L are X ₃, this second image capture element 13 and the distance of these two point midway A between the subpoint N on this horizontal line L are X ₄, that is to say this horizontal range X=X ₃+ X ₄

The distance of supposing these two point midway A and subpoint N is Z ₄, the vertical range of these two point midway A and this surface level is Y ₂, these two point midway A extend to the point of this surface level and the distance of subpoint N is Z ₅, that is, the relative coordinate of these two point midway A is (X ₃,-Y ₂, Z ₅).

Can be pushed away by trigonometric function, $\tan {\mathrm{\θ}}_4=\frac{Z_4}{X_3},$ $\tan {\mathrm{\θ}}_5=\frac{Z_4}{X_4}.$

So $\tan {\mathrm{\θ}}_4{X}_3=Z_4=\tan {\mathrm{\θ}}_5{X}_4=\tan {\mathrm{\θ}}_5(X-X_3)=\tan {\mathrm{\θ}}_{5}X-\tan {\mathrm{\θ}}_5{X}_3;$

$=>\tan {\mathrm{\θ}}_4{X}_3+\tan {\mathrm{\θ}}_5{X}_3=\tan {\mathrm{\θ}}_{5}X=X_3(\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5);$

$=>X_3=X\frac{\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5}.$

Again, $Z_4=\tan {\mathrm{\θ}}_4{X}_3=X\frac{\tan {\mathrm{\θ}}_4\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5};$

By trigonometric function as can be known, $\tan {\mathrm{\θ}}_6=\frac{Y_2}{Z_5},$ $\sin {\mathrm{\θ}}_6=\frac{Y_2}{Z_4}.$

So, $\tan {\mathrm{\θ}}_6{Z}_5=Y_2=\sin {\mathrm{\θ}}_6{Z}_4;$

$=>Z_5=\frac{\sin {\mathrm{\θ}}_6}{\tan {\mathrm{\θ}}_6}{Z}_4=\frac{\sin {\mathrm{\θ}}_6}{\tan {\mathrm{\θ}}_6}\left(X\right)\left(\frac{\tan {\mathrm{\θ}}_4\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5}\right);$

$=>Z_5=X\frac{\sin {\mathrm{\θ}}_6\tan {\mathrm{\θ}}_4\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_6(\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5)}.$

And $Y_2=\sin {\mathrm{\θ}}_6{Z}_4=\sin {\mathrm{\θ}}_6\left(X\frac{\tan {\mathrm{\θ}}_4\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5}\right)=X\frac{\sin {\mathrm{\θ}}_6\tan {\mathrm{\θ}}_4\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5}.$

By above formula can be in the hope of the relative coordinate of these two point midway A

$(X\frac{\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5},-X\frac{\sin {\mathrm{\θ}}_6\tan {\mathrm{\θ}}_4\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5},X\frac{\sin {\mathrm{\θ}}_6\tan {\mathrm{\θ}}_4\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_6(\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5)}).$

The relative coordinate of fingertip location:

Consult Fig. 4, at first, suppose that this fingertip location B is positioned at this surface level below, this first image capture element 12 and the distance of this fingertip location B between the subpoint M on this horizontal line L are X ₁, this second image capture element 13 and the distance of this fingertip location B between the subpoint M on this horizontal line L are X ₂, that is to say this horizontal range X=X ₁+ X ₂

The distance of supposing this fingertip location B and subpoint M is Z ₁, the vertical range of this fingertip location B and this surface level is Y ₁, this fingertip location B extends to the point of this surface level and the distance of subpoint M is Z ₂, that is, the relative coordinate of this fingertip location B is (X ₁,-Y ₁, Z ₂).

Can be pushed away by trigonometric function, $\tan {\mathrm{\θ}}_1=\frac{Z_1}{X_1},$ $\tan {\mathrm{\θ}}_2=\frac{Z_1}{X_2}.$

So $Z_1=\tan {\mathrm{\θ}}_1{X}_1\tan {\mathrm{\θ}}_2{X}_2=\tan {\mathrm{\θ}}_2(X-X1)=\tan {\mathrm{\θ}}_{2}x-\tan {\mathrm{\θ}}_2{X}_1;$

$=>\tan {\mathrm{\θ}}_{2}X=\tan {\mathrm{\θ}}_1{X}_1+\tan {\mathrm{\θ}}_2{X}_1=X_1(\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2);$

$=>X_1=X\frac{\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2}.$

Again, $Z_1=\tan {\mathrm{\θ}}_1{X}_1=\tan {\mathrm{\θ}}_1\frac{\tan {\mathrm{\θ}}_{2}X}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2}=X\frac{\tan {\mathrm{\θ}}_1\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2};$

By trigonometric function as can be known, $\tan {\mathrm{\θ}}_3=\frac{Y_1}{Z_2},$ $\sin {\mathrm{\θ}}_3=\frac{Y_1}{Z_1}.$

So, $\tan {\mathrm{\θ}}_3{Z}_2=Y_1=\sin {\mathrm{\θ}}_3{Z}_1;$

$=>Z_2=\frac{\sin {\mathrm{\θ}}_3}{\tan {\mathrm{\θ}}_3}{Z}_1=\frac{\sin {\mathrm{\θ}}_3}{\tan {\mathrm{\θ}}_3}\left(X\right)\left(\frac{\tan {\mathrm{\θ}}_1\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2}\right);$

$=>Z_2=X\frac{\sin {\mathrm{\θ}}_3\tan {\mathrm{\θ}}_1\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_3(\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2)}.$

And $Y_1=\sin {\mathrm{\θ}}_3{Z}_1=\sin {\mathrm{\θ}}_3\left(X\right)\left(\frac{\tan {\mathrm{\θ}}_1\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2}\right)=X\frac{\sin {\mathrm{\θ}}_3\tan {\mathrm{\θ}}_1\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2}.$

By above formula can be in the hope of the relative coordinate of this fingertip location B

$(X\frac{\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2},-X\frac{\sin {\mathrm{\θ}}_3\tan {\mathrm{\θ}}_1\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2},X\frac{\sin {\mathrm{\θ}}_3\tan {\mathrm{\θ}}_1\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_3(\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2)}).$

The cursor position coordinate:

Consult Fig. 5, after calculating the relative coordinate of the relative coordinate of this two point midway A and this fingertip location B respectively, the intersection point of then supposing the display plane 112 of connection straight line between these two point midway A and fingertip location B and this display 11 is C, and the relative coordinate that this cursor position coordinate is intersection point C, and its coordinate figure is (E, F, 0).The distance of supposing these two point midway A and this fingertip location B in addition is L ₁, the distance of this fingertip location B and intersection point C is L ₂

By L ₁With L ₂Relativeness can push away L ₁With L ₂Ratio is as follows:

$Z_5-\left\{(Z_5-0)\frac{L_1}{L_1+L_2}\right\}=Z_2=Z_5-\left(\frac{Z_5{L}_1}{L_1+L_2}\right);$

$=>Z_5-Z_2=\frac{Z_5{L}_1}{L_1+L_2};$

$=>(Z_5-Z_2)(L_1+L_2)=Z_5{L}_1;$

$=>Z_5{L}_1+Z_5{L}_2-Z_2{L}_1-Z_2{L}_2=Z_5{L}_1;$

$=>L_2(Z_5-Z_2)=Z_2{L}_1;$

$=>L_2=\frac{Z_2{L}_1}{Z_5-Z_2};$

$=>\frac{L_2}{L_1}=\frac{Z_2}{Z_5-Z_2}.$

By L ₁With L ₂Ratio can push away:

$X_3-\left\{(X_3-E)\frac{L_1}{L_1+L_2}\right\}=X_1;$

$=>X_3-\left\{\frac{X_3{L}_1-{\mathrm{EL}}_1}{L_1+L_2}\right\}=X_1=\frac{X_3{L}_1+X_3{L}_2-X_3{L}_1+{\mathrm{EL}}_1}{L_1+L_2};$

$=>X_1{L}_1+X_1{L}_2=X_3{L}_1+X_3{L}_2-X_3{L}_1+{\mathrm{EL}}_1;$

$=>{\mathrm{EL}}_1=X_1{L}_1+X_1{L}_2-X_3{L}_2;$

$=>E=\frac{X_1{L}_1+X_1{L}_2-X_3{L}_2}{L_1}=X_1+\frac{L_2(X_1-X_3)}{L_1}=X_1+\frac{Z_2(X_1-X_3)}{Z_5-Z_2}.$

By L ₁With L ₂Ratio can also push away:

$-Y_2-\left\{(-Y_2-F)\frac{L_1}{L_1+L_2}\right\}=-Y_1;$

$=>-Y_2-\left\{\frac{-Y_2{L}_1-{\mathrm{FL}}_1}{L_1+L_2}\right\}=-Y_1=\frac{-Y_2{L}_1-Y_2{L}_2+Y_2{L}_1+{\mathrm{FL}}_1}{L_1+L_2};$

$=>-Y_1{L}_1-Y_1{L}_2=-Y_2{L}_1-Y_2{L}_2+Y_2{L}_1+{\mathrm{FL}}_1;$

$=>{\mathrm{FL}}_1=Y_2{L}_1+Y_2{L}_2-Y_2{L}_1-Y_1{L}_1-Y_1{L}_2;$

$=>F=\frac{Y_2{L}_2-Y_1{L}_2-Y_1{L}_1}{L_1}=-Y_1+\frac{L_2(Y_2-Y_1)}{L_1}=-Y_1+\frac{Z_2(Y_2-Y_1)}{Z_5-Z_2}.$

By above formula as can be known, the value of the relative coordinate of this intersection point C is $(X_1+\frac{Z_2(X_1-X_3)}{Z_5-Z_2},$

$-Y_1+\frac{Z_2(Y_2-Y_1)}{Z_5-Z_2},0).$

What deserves to be mentioned is, when these two point midway A or this fingertip location B horizontal projection during to the first quartile of this coordinate system and second quadrant, the Y-axis coordinate figure of its relative coordinate be on the occasion of, for example, these two point midway A horizontal projections are during to first quartile, and its relative coordinate is (X, Y, Z); When these two point midway A or this fingertip location B horizontal projection during to the third quadrant of this coordinate system and fourth quadrant, the Y-axis coordinate figure of its relative coordinate is negative value, and for example, this fingertip location B horizontal projection is during to fourth quadrant, its relative coordinate be (X ,-Y, Z).In this preferred embodiment, these two point midway A or this fingertip location B horizontal projection are to the fourth quadrant of this coordinate system, so the Y-axis coordinate figure of its relative coordinate is negative value, and the Z axial coordinate value perseverance of this cursor position coordinate is zero.

Similarly, when these two point midway A or this fingertip location B horizontal projection during to second quadrant of this coordinate system and third quadrant, the X-axis coordinate figure of its relative coordinate is negative value, for example, during these two point midway A horizontal projection to the second quadrants, its relative coordinate is (X, Y, Z).The wherein first quartile of this coordinate system, second quadrant, third quadrant, and fourth quadrant is defined as and is familiar with this field person and can understands easily, so do not give unnecessary details at this.

Then, after this cursor coordinates computing module 152 calculates the relative coordinate of this intersection point C, this display 11 can according to this relative coordinate present a patterned cursor in this display plane 112 for user's reference.And the user also can carry out further action according to this patterned cursor, for example chooses or confirms etc. instruction.Only further the corresponding relation between action and dependent instruction is to be familiar with this field person can understand easily, and non-emphasis of the present invention, does not therefore give unnecessary details at this.

By above explanation as can be known, the present invention is by two point midways that calculate the user, the relative coordinate of fingertip location, and the relative coordinate of the intersection point of the display plane that is connected straight line and display between computing user's two point midways and fingertip location further, this design has following effect:

One. can simulate the behavior that the hand-held remote controller of user points to display exactly.

Two. the user does not need the telepilot of operating function complexity, need not stand on enough big space action yet.

Claims (8)

1. telechirics based on user action, comprise: a display, one first image capture element and one second image capture element, wherein the front of this display comprises that a peripheral part and is by the display plane of this circumference branch encirclement, this first image capture element and this second image capture element are arranged at the peripheral part of this display, and lay respectively at left side and the right side of the display plane of this display, and be positioned on the same surface level, be used for capturing user's image constantly and producing corresponding signal, wherein this first and second image capture interelement defines a horizontal line and at a distance of a horizontal range; It is characterized in that: should also comprise an image identification unit and cursor position acquisition unit based on the telechirics of user's action, wherein this image identification unit is used for the signal from this user's image, pick out the fingertip location of the finger tip of two point midways of user and at least one sensing display, this cursor position obtains the unit and is used for according to this first image capture element, the second image capture element, relative position relation between two point midways and fingertip location, obtain the intersecting point coordinate of the display plane of connection straight line between these two point midways and fingertip location and this display, with as a cursor position coordinate.

2. the telechirics based on user action according to claim 1, it is characterized in that: this cursor position obtains the unit and comprises that an angle information obtains module, be used for according to this first image capture element, the second image capture element, relative position relation between two point midways and fingertip location, obtain to represent the one first intersegmental angle of connecting line between this horizontal line and this first image capture element and fingertip location, represent the one second intersegmental angle of connecting line between this horizontal line and this second image capture element and fingertip location, represent one the 3rd intersegmental angle of this surface level and this fingertip location connecting line between the subpoint on this horizontal line and this fingertip location, represent one the 4th intersegmental angle of connecting line between this horizontal line and this first image capture element and two point midways, represent one the 5th intersegmental angle of connecting line between this horizontal line and this second image capture element and two point midways, and represent this surface level and one the 6th intersegmental angle of the connecting line of this two point midways between the subpoint on this horizontal line and this two point midways.

3. the telechirics based on user action according to claim 2, it is characterized in that: this cursor position obtains the unit and also comprises a cursor coordinates computing module, be used for obtaining first angle, second angle, the 3rd angle, the 4th angle, the 5th angle and the 6th angle that module obtains, this cursor position coordinate of computing according to this horizontal range and this angle information.

4. the telechirics based on user action according to claim 3, it is characterized in that: the position of being located at this first image capture element when the initial point of a coordinate system, positive x direction of principal axis is for pointing to the direction of the second image capture element from initial point, positive y direction of principal axis is the direction directly over pointing to from initial point, and positive z direction of principal axis is when pointing out the direction of this display plane, and this cursor position coordinate is $(X_1+\frac{(X_1-X_3)\×Z_2}{Z_5-Z_2},-Y_1+\frac{(Y_2-Y_1)\×Z_2}{Z_5-Z_2},0),$ Wherein:

$X_1=\frac{X\×\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2};$

$Y_1=X\frac{\tan {\mathrm{\θ}}_1\×\tan {\mathrm{\θ}}_2\×\sin {\mathrm{\θ}}_3}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2};$

$Z_2=X\frac{\tan {\mathrm{\θ}}_1\×\tan {\mathrm{\θ}}_2\×\sin {\mathrm{\θ}}_3}{\tan {\mathrm{\θ}}_3(\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2)};$

$X_3=\frac{X\×\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5};$

$Y_2=X\frac{\tan {\mathrm{\θ}}_4\×\tan {\mathrm{\θ}}_5\×\sin {\mathrm{\θ}}_6}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5};$

$Z_5=X\frac{\tan {\mathrm{\θ}}_4\×\tan {\mathrm{\θ}}_5\×\sin {\mathrm{\θ}}_6}{\tan {\mathrm{\θ}}_6(\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5)};$

Wherein: θ ₁Be this first angle; θ ₂Be this second angle; θ ₃Be the 3rd angle; θ ₄Be the 4th angle; θ ₅Be the 5th angle; θ ₆Be the 6th angle; X is this horizontal range.

5. remote control thereof based on user action is characterized in that: should comprise following steps based on remote control thereof of user's action:

(a) provide one to comprise a display, one first image capture element, one second image capture element, one image identification unit and a cursor position obtain the telechirics based on user's action of unit, wherein the front of this display comprises that a peripheral part and is by the display plane of this circumference branch encirclement, this first image capture element and the second image capture element are arranged at the peripheral part of this display and lay respectively at left side and the right side of the display plane of this display, and be positioned on the same surface level, this first and second image capture interelement defines a horizontal line and at a distance of a horizontal range;

(b) this first and second image capture element captures user's image constantly and produces corresponding signal;

(c) this image identification unit is used for the signal from this user's image, picks out the fingertip location of the finger tip of two point midways of user and at least one sensing display;

(d) this cursor position obtains unit and is used for according to the relative position relation between this first image capture element, the second image capture element, two point midways and fingertip location, obtain the intersecting point coordinate of the display plane of connection straight line between these two point midways and fingertip location and this display, with as a cursor position coordinate.

6. the remote control thereof based on user action according to claim 5, it is characterized in that: should (d) step comprise, the angle information that this cursor position obtains the unit obtains module according to this first image capture element, the second image capture element, relative position relation between two point midways and fingertip location, obtain to represent the one first intersegmental angle of connecting line between this horizontal line and this first image capture element and fingertip location, represent the one second intersegmental angle of connecting line between this horizontal line and this second image capture element and fingertip location, represent one the 3rd intersegmental angle of this surface level and this fingertip location connecting line between the subpoint on this horizontal line and this fingertip location, represent one the 4th intersegmental angle of connecting line between this horizontal line and this first image capture element and two point midways, represent one the 5th intersegmental angle of connecting line between this horizontal line and this second image capture element and two point midways, and represent this surface level and one the 6th intersegmental angle of the connecting line of this two point midways between the subpoint on this horizontal line and this two point midways.

7. the remote control thereof based on user action according to claim 6, it is characterized in that: the cursor coordinates computing module that this cursor position obtains the unit is used for obtaining first angle, second angle, the 3rd angle, the 4th angle, the 5th angle and the 6th angle that module obtains, this cursor position coordinate of computing according to this horizontal range and this angle information.

8. the remote control thereof based on user action according to claim 7, it is characterized in that: should (d) step comprise, be located at the position of this first image capture element when the initial point of a coordinate system, positive x direction of principal axis is for pointing to the direction of the second image capture element from initial point, positive y direction of principal axis is the direction directly over pointing to from initial point, and positive z direction of principal axis is when pointing out the direction of this display plane, and this cursor position coordinate is $(X_1+\frac{(X_1-X_3)\×Z_2}{Z_5-Z_2},-Y_1+\frac{(Y_2-Y_1)\×Z_2}{Z_5-Z_2},0),$ Wherein:

$X_1=\frac{X\×\tan {\mathrm{\θ}}_2}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2};$

$Y_1=X\frac{\tan {\mathrm{\θ}}_1\×\tan {\mathrm{\θ}}_2\×\sin {\mathrm{\θ}}_3}{\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2};$

$Z_2=X\frac{\tan {\mathrm{\θ}}_1\×\tan {\mathrm{\θ}}_2\×\sin {\mathrm{\θ}}_3}{\tan {\mathrm{\θ}}_3(\tan {\mathrm{\θ}}_1+\tan {\mathrm{\θ}}_2)};$

$X_3=\frac{X\×\tan {\mathrm{\θ}}_5}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5};$

$Y_2=X\frac{\tan {\mathrm{\θ}}_4\×\tan {\mathrm{\θ}}_5\×\sin {\mathrm{\θ}}_6}{\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5};$

$Z_5=X\frac{\tan {\mathrm{\θ}}_4\×\tan {\mathrm{\θ}}_5\×\sin {\mathrm{\θ}}_6}{\tan {\mathrm{\θ}}_6(\tan {\mathrm{\θ}}_4+\tan {\mathrm{\θ}}_5)};$

Wherein, θ ₁Be this first angle; θ ₂Be this second angle; θ ₃Be the 3rd angle; θ ₄Be the 4th angle; θ ₅Be the 5th angle; θ ₆Be the 6th angle; X is this horizontal range.

Images