CN201853210U - Planar multi-point touch control device based on optical sensing - Google Patents

Abstract

The utility model relates to a planar multi-point touch control device based on an optical sensor, which comprises three or more optical sensing receivers and a bracket; the three or more optical sensing receivers are respectively mounted on the bracket, and then the bracket provided with the optical sensing receivers is mounted in front or at the rear of a display screen; and the optical sensing receivers are connected with a computer in a wired or wireless way. The planar multi-point touch control device has the following advantages: 1, the multi-point recognition and treatment of the device are more accurate than those of other multi-point touch realizing ways; 2, error points and virtual points during the multi-point treatment can be effectively prevented.

Description

Plane multiple point touching control device based on optical sensing

Technical field

The utility model relates to a kind of plane multiple point touching control device based on optical sensing.

Background technology

Development along with multi-point touch, in this year, the multi-point touch implementation has had bigger development and improvement, but because people are to the also raising day by day of requirement of multi-point touch, in order to adapt to demands of social development, the utility model proposes another multi-point touch implementation on the basis that original multi-point touch implementation is constantly explored.

Summary of the invention

A kind of plane touch control device based on optical sensor of doing on the multi-point touch implementation further to improve and providing is being provided now the purpose of this utility model, the utility model can utilize biocular systems to carry out three-dimensional reconstruction realization plane and accurately locate, and reaches the accurate identification of multiple spot.

The technical solution of the utility model is:

Plane multiple point touching control device based on optical sensing, comprise three or three above optical sensing receivers and a support, it is characterized in that: the above optical sensing receivers of three or three are rack-mount respectively, the support that the installation of optical sensing receiver will be installed again is installed in the place ahead or the rear of display screen, and the optical sensing receiver links to each other with computing machine by wired or wireless.

Described optical sensing receiver is the visible light receiver, as camera, camera or laser pickoff, or the non-visible light receiver: infrared thermoviewer, infrared remote receiver or ultrasonic receiver.

The utlity model has following advantage:

1, in the identification of multiple spot with handle more accurate than other multi-point touch implementations;

2, can effectively prevent the overdue and terrible point of multiple spot in handling.

Description of drawings

Fig. 1 is an example structure synoptic diagram of the present utility model.

Fig. 2 is another example structure synoptic diagram of the present utility model.

Fig. 3 is a kind of example principle schematic of the present utility model.

Fig. 4 is the another kind of example principle schematic of the utility model.

Fig. 5 is for solving multiple spot problem synoptic diagram.

Fig. 6 is general biocular systems principle schematic.

Embodiment

Below in conjunction with accompanying drawing the utility model is described in detail:

As shown in Figure 1, 2, the utility model is rack-mount respectively with three optical sensing receivers, it also can be the rear that the place ahead that support that the optical sensing receiver installs is installed in display screen will be installed again, and the optical sensing receiver links to each other with computing machine by wired or wireless.Described optical sensing receiver is the visible light receiver, as camera, camera or laser pickoff, or the non-visible light receiver: infrared thermoviewer, infrared remote receiver or ultrasonic receiver.

As shown in Figure 6, following coordinate derivation formula is arranged: (this example is the optical sensing receiver with the video camera, also is applicable to the optical sensor of other types) for biocular systems

After demarcating, we can obtain the inside and outside parameter of left and right cameras, and are specific as follows:

The intrinsic parameter of left side video camera: focal distance f l, and the real image centre coordinate (ul0, vl0)

The outer parameter of left side video camera: rotation matrix Rl, translation vector Tl

The intrinsic parameter of right video camera: focal distance f r, and the real image centre coordinate (ur0, vr0)

The outer parameter of right video camera: rotation matrix Rr, translation vector Tr

But it should be noted that the outer parameter of the left and right cameras that obtains this moment all is for the world coordinate system of setting in the calibration process separately.In order to determine the three-dimensional coordinate of spatial point in the binocular visual field, we need be accustomed to according to human vision, and left and right cameras is unified under same world coordinate system.

Suppose that now left video camera photocentre is the world coordinates initial point, promptly the observer is in left video camera photocentre position, and then right camera coordinate system or-xryrzr and the world coordinate system o-xyz of this moment can be expressed as by space conversion matrix [R T]:

$\left(1.1\right),\left(\begin{array}{c}{x}_r\\ y_r\\ z_r\end{array}\right)=\left(\mathrm{R\; T}\right)\left(\begin{array}{c}x\\ y\\ z\\ 1\end{array}\right)=\left(\begin{array}{cccc}{r}_1& r_2& r_3& t_x\\ r_4& r_5& r_6& t_y\\ r_7& r_8& r_9& t_z\end{array}\right)\left(\begin{array}{c}x\\ y\\ z\\ 1\end{array}\right)$

R wherein, T is respectively rotation matrix and the translation vector of left and right cameras with respect to same world coordinate system.Because

Xl=Rlxw+Tl, xr=Rrxw+Tr, cancellation xw obtains xr=RrRl-1xl+Tr-RrRl-1Tl.So far, the incidence matrix of left and right cameras [R T] obtains, wherein R=RrRl-1; T=Tr-RrRl-1Tl.

We can obtain certain spatial point P the computer picture coordinate (u, v) and world coordinates (Xw, Yw, the Zw) relation between, we can obtain the extraction formula of the spatial point three-dimensional coordinate under the binocular vision convolution (1.1), it is as follows specifically to derive:

1) the left and right cameras intrinsic parameter that demarcation is obtained is the substitution matrix respectively

$\mathrm{Al}=\left(\begin{array}{ccc}\mathrm{fl}/\mathrm{<figure-callout\; id="0"\; label="dx"\; filenames="HDA0000023792020000032.png"\; state="\{\{state\}\}">dx</figure-callout>}& 0& {\mathrm{<figure-callout\; id="0"\; label="ul"\; filenames="HDA0000023792020000032.png"\; state="\{\{state\}\}">ul</figure-callout>}}_0\\ 0& \mathrm{fl}/\mathrm{<figure-callout\; id="0"\; label="dy\; vl"\; filenames="HDA0000023792020000032.png"\; state="\{\{state\}\}">dy</figure-callout>}& {\mathrm{vl}}_{}{}_0\\ 0& 0& 1\end{array}\right)$ $\mathrm{Ar}=\left(\begin{array}{ccc}\mathrm{fr}/\mathrm{<figure-callout\; id="0"\; label="dx"\; filenames="HDA0000023792020000032.png"\; state="\{\{state\}\}">dx</figure-callout>}& 0& {\mathrm{<figure-callout\; id="0"\; label="ur"\; filenames="HDA0000023792020000032.png"\; state="\{\{state\}\}">ur</figure-callout>}}_0\\ 0& \mathrm{fr}/\mathrm{<figure-callout\; id="0"\; label="dy\; vr"\; filenames="HDA0000023792020000032.png"\; state="\{\{state\}\}">dy</figure-callout>}& {\mathrm{vr}}_{}{}_0\\ 0& 0& 1\end{array}\right)---\left(1.2\right)$

Wherein, dx, dy are respectively image at x, the size of unit picture element on the y direction.

For example, CCD chip imaging area size is 4.8x3.6mm, and the image resolution ratio size is the 768x576 pixel, then:

2) world coordinates of establishing space point P is (Xw, Yw, Zw) (the world coordinate system initial point is left video camera photocentre); Subpoint on the left and right cameras image be respectively (ul, vl), (ur, vr).Obtain following two groups of matrix equations:

$\mathrm{zl}\left(\begin{array}{c}\mathrm{ul}\\ \mathrm{vl}\\ 1\end{array}\right)=\mathrm{Hl}\&times;\left(\begin{array}{c}\mathrm{Xw}\\ \mathrm{Yw}\\ \mathrm{Zw}\end{array}\right);$ $\mathrm{zr}\left(\begin{array}{c}\mathrm{ur}\\ \mathrm{vr}\\ 1\end{array}\right)=\mathrm{Hr}\&times;\left(\begin{array}{c}\mathrm{Xw}\\ \mathrm{Yw}\\ \mathrm{Zw}\end{array}\right)---\left(1.3\right)$

Wherein,

$\mathrm{Hl}=\mathrm{Al}\&times;E=\left(\begin{array}{cccc}{\mathrm{hl}}_{11}& {\mathrm{hl}}_{12}& {\mathrm{hl}}_{13}& {\mathrm{hl}}_{14}\\ {\mathrm{hl}}_{21}& {\mathrm{hl}}_{22}& {\mathrm{hl}}_{23}& {\mathrm{hl}}_{24}\\ {\mathrm{hl}}_{31}& {\mathrm{hl}}_{32}& {\mathrm{hl}}_{33}& {\mathrm{hl}}_{34}\end{array}\right);$ $E=\left(\begin{array}{cccc}1& 0& 0& 0\\ 0& 1& 0& 0\\ 0& 0& 1& 0\\ 0& 0& 0& 1\end{array}\right)---\left(1.4\right)$

$\mathrm{Hr}=\mathrm{Ar}\&times;\left(\begin{array}{cc}R& T\end{array}\right)=\left(\begin{array}{cccc}{\mathrm{hr}}_{11}& {\mathrm{hr}}_{12}& {\mathrm{hr}}_{13}& {\mathrm{hr}}_{14}\\ {\mathrm{hr}}_{21}& {\mathrm{hr}}_{22}& {\mathrm{hr}}_{23}& {\mathrm{hr}}_{24}\\ {\mathrm{hr}}_{31}& {\mathrm{hr}}_{32}& {\mathrm{hr}}_{33}& {\mathrm{hr}}_{34}\end{array}\right)---\left(1.5\right)$

Here the institute of Hl and Hr is important is known, formula (1.5) is launched and cancellation zl respectively, and zr can get:

(u ₁hl ₃₁-hl ₁₁)X _w+(u ₁hl ₃₂-hl ₁₂)Y _w+(u ₁hl ₃₃-hl ₁₃)Z _w＝hl ₁₄-u ₁hl ₃₄

(v ₁hl ₃₁-hl ₂₁)X _w+(v ₁hl ₃₂-hl ₂₂)Y _w+(v ₁hl ₃₃-hl ₂₃)Z _w＝hl ₂₄-v ₁hl ₃₄

(u ₂hr ₃₁-hr ₁₁)X _w+(u ₂hr ₃₂-hr ₁₂)Y _w+(u ₂hr ₃₃-hr ₁₃)Z _w＝hr ₁₄-u ₂hr ₃₄

(v ₂hr ₃₁-hr ₂₁)X _w+(v ₂hr ₃₂-hr ₂₂)Y _w+(v ₂hr ₃₃-hr ₂₃)Z _w＝hr ₂₄-v ₂hr ₃₄ (1.6)

Get $M=\left(\begin{array}{ccc}{u}_1{\mathrm{hl}}_{31}-{\mathrm{hl}}_{11}& u_1{\mathrm{hl}}_{32}-{\mathrm{hl}}_{12}& u_1{\mathrm{hl}}_{33}-{\mathrm{hl}}_{13}\\ v_1{\mathrm{hl}}_{31}-{\mathrm{hl}}_{11}& v_1{\mathrm{hl}}_{32}-{\mathrm{hl}}_{22}& v_1{\mathrm{hl}}_{33}-{\mathrm{hl}}_{23}\\ u_2{\mathrm{hr}}_{31}-{\mathrm{hr}}_{11}& u_2{\mathrm{hr}}_{32}-{\mathrm{hr}}_{12}& u_2{\mathrm{hr}}_{33}-{\mathrm{hr}}_{13}\\ v_2{\mathrm{hr}}_{31}-{\mathrm{hr}}_{11}& v_2{\mathrm{hr}}_{32}-{\mathrm{hr}}_{22}& v_2{\mathrm{hr}}_{33}-{\mathrm{hr}}_{23}\end{array}\right);$ $U=\left(\begin{array}{c}{\mathrm{hl}}_{14}-u_1{\mathrm{hl}}_{34}\\ {\mathrm{hl}}_{24}-v_1{\mathrm{hl}}_{34}\\ {\mathrm{hr}}_{14}-u_2{\mathrm{hr}}_{34}\\ {\mathrm{hr}}_{24}-v_2{\mathrm{hr}}_{34}\end{array}\right),$

M (Xw Yw Zw)=U, utilize least square method to calculate the three-dimensional coordinate of extraterrestrial target point P under the world coordinate system that is initial point with left video camera photocentre:

$\left(\begin{array}{c}\mathrm{Xw}\\ \mathrm{Yw}\\ \mathrm{Zw}\end{array}\right)={(M^{\&prime;}\&times;M)}^{-1}\&times;M^{\&prime;}\&times;U---\left(3.31\right)$

Because we only require coordinate information in one plane, promptly on our platform, as long as know the coordinate of Xw and Zw, give up to fall the Yw of error maximum.

The utility model will be further described in conjunction with the accompanying drawings.

As shown in Figure 3, the utility model is by three optical sensing receivers and a support, the length and width of support are not waited, three optical sensing receivers are installed in respectively on three angles of square support, the support that the installation of optical sensing receiver will be installed during use again is installed in the place ahead of display screen, the optical sensing receiver links to each other with computing machine by wired or wireless, and described optical sensing receiver can be among camera, camera, laser pickoff, infrared thermoviewer, infrared remote receiver, the ultrasonic receiver any one.

In the situation of present embodiment, for being covered, images acquired information controls screen surface, and the imaging angle that need ask each optical sensing receiver is greater than 90 degree.Optical sensing receiver one and two is formed a biocular systems I, and optical sensing receiver two and three is formed biocular systems II.

By calculating, in binocular I, can draw 1. 2. 3. 4. four point coordinate values, in binocular II, draw 1. 2. 5. 6. four point coordinate values, by the comparison of value, equal reservation, 1. unequal rejecting so can draw 2. two true point coordinate.

As shown in Figure 4, the utility model is by three optical sensing receivers and a support, three optical sensing receivers are placed as shown in the figure, the support that the installation of optical sensing receiver will be installed during use again is installed in the place ahead of display screen, the optical sensing receiver links to each other with computing machine by wired or wireless, and described optical sensing receiver can be among camera, camera, laser pickoff, infrared thermoviewer, infrared remote receiver, the ultrasonic receiver any one.

In the situation of present embodiment, for being covered, images acquired information controls screen surface, need ask imaging angle 90 degree of one, three two optical sensing receiver.Optical sensing receiver two adopts the wide-angle imaging head, imaging angle 180 degree, and the volume coordinate position calculation of operation object is similar to Example 1.

As shown in Figure 5, when 2 determine after, for initiate point, owing to there are differences on the time, we only need find new adding point imaging in each optical sensing receiver, try to achieve the coordinate of this new adding point then according to the binocular principle, in like manner for four points, five points, perhaps multiple spot more, all adopt temporal differences to mate, can draw the multiple spot coordinate.

Claims (3)

1. based on the plane multiple point touching control device of optical sensing, comprise three or three above optical sensing receivers and a support, it is characterized in that: the above optical sensing receivers of three or three are rack-mount respectively, the support that the installation of optical sensing receiver will be installed again is installed in the place ahead or the rear of display screen, and the optical sensing receiver links to each other with computing machine by wired or wireless.

2. the plane multiple point touching control device based on optical sensing according to claim 1 is characterized in that: described optical sensing receiver is visible light receiver or non-visible light receiver.

3. the plane multiple point touching control device based on optical sensing according to claim 2, it is characterized in that: described optical sensing receiver is camera, camera, laser pickoff, infrared thermoviewer, infrared remote receiver or ultrasonic receiver.

Images