CN102012773B - Method and equipment for operating interfaces by utilizing airflows - Google Patents

Abstract

The invention discloses a method and equipment for operating interfaces by utilizing airflows to solve the problems of large occupied resource amount of an internal memory and complicated technological realization in the prior art when a control operation is carried out to the interfaces by utilizing souffle. In the method, an equipment screen is divided into a plurality of zones in advance, and a plurality of sensors capable of sensing the directions of the airflows are arranged around the screen. The method comprises the following steps of: receiving the directions of the airflows reflected by the screen, sensed by each sensor, and determining the straight paths of reflective positions on the screen from each sensor to each airflow and the intersection point of the straight paths according to the airflow direction sensed by each sensor; respectively calculating the space distance between the intersection point and the feature point of each screen zone and determining the positions of the screen zones corresponding to the smallest space distance on the screen as the reflective positions of the airflows on the screen; and carrying out operation control to an user interface displayed in the screen according to the reflective positions of the airflows on the screen.

Description

Utilize air-flow that method of operating and equipment thereof are carried out in the interface

Technical field

The present invention relates to the communications field, relate in particular to a kind of air-flow that utilizes method of operating and equipment thereof are carried out in the interface.

Background technology

In operating system, user interface is one of direct embodiment of man-machine interaction.The operating efficiency of user interface is directly connected to the effect of man-machine interaction.If the operating user interface process is complicated, the operating system delay of response tends to reduce operating system to user's the attractive force and the availability of system itself; On the contrary, operating process is simple and easy effectively, highly sensitive then can to improve user's service efficiency, strengthens satisfaction of users.Existing keyboard operation mode the single problem of user experience occurred, even under some environment, can't satisfy the requirement of man-machine interaction because its interactive mode is fixed.

On the other hand, along with the development of man-machine interaction, more and more new technology limb assisting actions and gesture begin to substitute the traditional key-press operation gradually, like touch-screen, multiple point touching, gravity sensing etc., have greatly improved the efficient of man-machine interaction.But mostly these new technologies are the support for gesture, and in field of human-computer interaction, sound and air-flow can pass to machine with information effectively as typical human body information output, by accomplishing the action that the people specifies its completion after the machine processing.Especially when people's limbs can't go machine operated, other controls then seemed particularly important alternately.

At present; Utilize bruit can effectively control the user interface of PC, the method described in the paper of delivering at 07 year UIST ' 07 like the Shwetak N.Patel and Gregory D.Abowd of Georgia science and engineering computing machine institute " BLUI:Low-cost Localized Blowable User Interfaces " captures the huge sound that air blowing causes through Mike; Through after the machine learning; Control as incident and to choose, icon moves, and rolls screen etc.This method is that the screen periphery in user interface is no more than in the distance of 10cm and establishes a Mike as receiving sensor; When the user blows to screen; Produce reflection behind the air-flow contact screen, for the bruit that the zones of different from screen reflects, the phase place of the received bruit of sensor is different with intensity; Can obtain distinct sound signals thus from each screen area, thereby for training category set to provide the foundation.

The flow process of its described user interface control method is as shown in Figure 1, and concrete steps are following:

Step 101, with user interface screen be divided into n the zone;

Step 102, user blow to screen, and Mike receives this bruit, obtain voice signal;

Step 103, through SD-FFT (Sparse Data Fast Fourier Transform, discrete Fourier transformation in short-term) conversion, with voice signal by time-domain signal S (t) be transformed to frequency domain signal X (f, t);

Step 104, utilize PCA (Principal Comonents Analysis, principal component analysis (PCA)) algorithm extract X (arthmetic statement is following for f, the eigenwert in t):

X (f t) can be expressed as:

$X=\left[\begin{array}{cccc}{x}_{11}& x_{12}& \mathrm{\Λ}& x_{1p}\\ x_{21}& x_{22}& \mathrm{\Λ}& x_{2p}\\ M& M& M& M\\ x_{n1}& x_{n2}& \mathrm{\Λ}& x_{\mathrm{np}}\end{array}\right]...\left(1\right)$

Calculate covariance matrix:

$R=\left[\begin{array}{cccc}{r}_{11}& r_{12}& \mathrm{\Λ}& r_{1p}\\ r_{21}& r_{22}& \mathrm{\Λ}& r_{2p}\\ M& M& M& M\\ r_{p1}& r_{p2}& \mathrm{\Λ}& r_{\mathrm{pp}}\end{array}\right]...\left(2\right)$

Wherein, r _Ij(i, j=1,2 ..., p) be former variable x _iWith x _jRelated coefficient, r _Ij=r _Ji, its computing formula is:

$r_{\mathrm{ij}}=\frac{\underset{k=1}{\overset{n}{\mathrm{\Σ}}}(x_{\mathrm{ki}}-{\stackrel{\‾}{x}}_i)(x_{\mathrm{kj}}-{\stackrel{\‾}{x}}_j)}{\sqrt{\underset{k=1}{\overset{n}{\mathrm{\Σ}}}{(x_{\mathrm{ki}}-{\stackrel{\‾}{x}}_i)}^2\underset{k=1}{\overset{n}{\mathrm{\Σ}}}{(x_{\mathrm{ki}}-{\stackrel{\‾}{x}}_j)}^2}}...\left(3\right)$

Separate secular equation | λ I-R|=0, obtain eigenwert with Jacobi method, by size series arrangement, i.e. λ ₁>=λ ₂>=Λ,>=λ _p>=0;

Obtain corresponding to eigenvalue respectively _iProper vector e _i(i=1,2, Λ p), requires || e _i||=1, promptly $\underset{j=1}{\overset{p}{\mathrm{\Σ}}}{e}_{\mathrm{Ij}}^2=1,$ E wherein _IjRepresent vectorial e _iJ component.

Calculate the major component contribution rate

$\frac{{\mathrm{\λ}}_i}{\underset{k=1}{\overset{p}{\mathrm{\Σ}}}{\mathrm{\λ}}_k},(i=\mathrm{1,2},\mathrm{\Λ},p)\·\·\·\left(4\right)$

And contribution rate of accumulative total

$\frac{\underset{k=1}{\overset{i}{\mathrm{\Σ}}}{\mathrm{\λ}}_k}{\underset{k=1}{\overset{p}{\mathrm{\Σ}}}{\mathrm{\λ}}_k},(i=\mathrm{1,2},\mathrm{\Λ},p)\·\·\·\left(5\right)$

Choosing contribution rate of accumulative total is major component greater than preceding m the eigenwert of threshold value a.Calculate major component load:

$l_{\mathrm{ij}}=p(z_i,x_j)=\sqrt{{\mathrm{\λ}}_i}{e}_{\mathrm{ij}},(i,j=\mathrm{1,2},\mathrm{\Λ},p)\·\·\·\left(6\right)$

Obtain X (f, the principal component vector of m t) is:

$\left\{\begin{array}{c}{z}_1=l_{11}{x}_1+l_{12}{x}_2+\mathrm{\Λ}+l_{1p}{x}_p\\ z_2=l_{21}{x}_1+l_{22}{x}_2+\mathrm{\Λ}+l_{2p}{x}_p\\ M\\ z_m=l_{m1}{x}_1+l_{m2}{x}_2+\mathrm{\Λ}+l_{\mathrm{mp}}{x}_p\end{array}\right.\·\·\·\left(7\right)$

With (7) formula Z=LX matrix of coefficients L as eigenwert.

The eigenwert L that step 105, utilization calculate carries out KNN (k nearest-neighbors) algorithm and differentiates, and with the position that the source of determining bruit belongs to, the differentiation process is following:

After being admitted to the differentiation process by differentiation eigenwert L; In training set (training set is the set of the eigenwert L of N experiment); Choose k the vector nearest through the compute euclidian distances value with L; Through differentiating the quantity that this k vector comes from each regional characteristic value collection in the training set, differentiate and the regional location that eigenwert L belongs to, of region, the source output of this regional location as bruit.

Step 106, after obtaining zone position information, operating system can be controlled user interface according to this positional information and choose, icon moves, and rolls operations such as screen.

Inventor of the present invention finds that there is following defective in the scheme of this prior art:

On the one hand, the calculated amount of algorithm and complexity are higher.In this method, be o (n*m) (n is the zoning number, and m is the training set sample number in each zone) to the algorithm complex of Euclidean distance, calculated amount is bigger; Therefore, the memory requirements of this method application device is bigger, for the internal memory small device; SRT in the practical operation is also just corresponding longer; Cause interface operation slow, reduce the satisfaction of user experience, so this method is difficult to be applied to the less mobile phone operation platform of dominant frequency.

On the other hand; Because the resolution at interface is to be directly proportional with the number of zoning, interface, and the calculated amount of this method is big, the EMS memory occupation degree is high; Should not divide more screen area; Therefore, this method can't further improve the degree of accuracy of interface operation under the situation that guarantees certain system response speed; And because it can not divide more screen area; Cause the area in single zone bigger; Thereby in preparatory training process; Import air-flow information and number of samples in the training set that is accumulated to is also just corresponding more by the user, store these sample datas and also need take more memory headroom, thereby further strengthened demand device memory.

Also have on the one hand; The preparatory training process of this method is to form training set by user's input information as sample and accomplish in the equipment back of coming into operation; So the initial stage of user when using this interface control system; Because of the input sample number seldom; The eigenvector accuracy that makes training in advance obtain is very low, thereby causes system to use the sensitivity at initial stage and accuracy also just very low the user, must experience certain adaptation time and certain operational ton and can reach and make the user use purpose smoothly.

In sum, the above-mentioned technology of utilizing bruit that the pc user interface is controlled, calculation of complex, EMS memory occupation amount are bigger, are not suitable for being applied to data-handling capacity and the limited portable terminal of memory size.

Summary of the invention

The embodiment of the invention provides a kind of air-flow that utilizes that method of operating and terminal device are carried out in the interface, the problem of big, the complicated technology realization of memory source occupancy when utilizing bruit that control operation is carried out at the interface in order to solve prior art.

The technical scheme that the embodiment of the invention provides comprises:

A kind of method of utilizing air-flow control operation user interface, device screen is divided into a plurality of zones in advance, and screen periphery is provided with a plurality of sensors that can the perception airflow direction, and the method comprising the steps of:

Receive each sensor senses to the direction of the air-flow that screen reflected, according to the airflow direction that each sensor senses arrives, determine the straight line path of each sensor, and the intersection point of said straight line path to the reflection position of this air-flow on screen;

Calculate the space length between the unique point of said intersection point and each screen area respectively; And wherein the reflection position of this air-flow on screen confirmed as in the position of the minimum space pairing screen area of distance on this screen; Wherein, The quantity of intersection point is that

is individual; The unique point quantity of each screen area is that

is individual, and N is the quantity of said sensor;

According to the reflection position of the air-flow of determining on screen, the user interface that shows in the screen is controled.

A kind of equipment that utilizes air-flow control operation user interface comprises:

A plurality of sensors that can the perception airflow direction are arranged on screen periphery;

Intersection point is confirmed the unit; Be used to receive each sensor senses to the direction of the air-flow that screen reflected; According to the airflow direction that each sensor senses arrives, determine the straight line path of each sensor to the reflection position of this air-flow on screen, and the intersection point of said straight line path;

Position determination unit; Be used for calculating respectively the space length between the unique point of said intersection point and each screen area; And wherein the reflection position of this air-flow on screen confirmed as in the position of the minimum space pairing screen area of distance on this screen; Wherein, The quantity of intersection point is that

is individual; The unique point quantity of each screen area is that

is individual, and N is the quantity of said sensor;

The interface control unit is used for according to the reflection position of air-flow on screen of determining the user interface that shows in the screen being controled.

In the embodiment of the invention; Through screen periphery a plurality of airflow-direction sensors are set at equipment; Utilize the airflow direction of its perception to determine the straight line path of each sensor to the reflection position of air-flow on screen; And the intersection point of per two straight line paths, and then confirm space length between the two according to the unique point coordinate of intersecting point coordinate and each screen area respectively, utilize the high more principle of the more little similarity of space length; Thereby determine the reflection position of air-flow on screen according to the space length size; With use Mike's perceives sound signal in the prior art and carry out the screen area location technology and compare because the signal of airflow-direction sensor institute perception is the signal relevant with the position, so can simplifies location algorithm and reduce the consumption of memory source; Unique point coordinate owing to the screen area in the embodiment of the invention is preset in the terminal device again; Therefore can reduce the storage space of the required sample of training screen area unique point process; Therefore, be applicable to the equipment that processing power and storage space are all limited, like portable terminal.Then can improve the quantity of screen area for other equipment, and then improve the screen bearing accuracy.

Description of drawings

Fig. 1 is the schematic flow sheet of user interface control method in the prior art;

Fig. 2 A is an embodiment of the invention portable terminal external structure synoptic diagram;

Fig. 2 B is an embodiment of the invention portable terminal inner structure synoptic diagram;

Fig. 3 utilizes the schematic flow sheet of air-flow control user interface for the embodiment of the invention;

Fig. 4 is the received airflow direction synoptic diagram of embodiment of the invention sensor.

Embodiment

To the deficiency of user interface being carried out the technology existence of control operation according to user's behavior of blowing at present; The embodiment of the invention is provided with a plurality of airflow-direction sensors at the screen periphery of terminal device and gathers the airflow direction signal; And reply confirms that the method that air-flow acts on the position (to call the air flow source position in the following text) on the terminal device screen improves mutually, thereby shortcut calculation, reduces the use of memory source.

In the embodiment of the invention; Screen periphery at terminal device is provided with the airflow-direction sensor array, and airflow-direction sensor quantity wherein is no less than 2, and the number of airflow-direction sensor is many more; The position judgment that air-flow is affacted on the screen is accurate more, and the corresponding calculated amount is also big more.Each airflow-direction sensor can be fixed on screen periphery in the array, be preferably in screen around be arranged with airflow-direction sensor.

In the embodiment of the invention, need with the screen divider of terminal device a plurality of zones also.Can determine the region quantity divided according to the different needs to manipulation accuracy, the number of regions of division is many more, and the location positioning degree of accuracy of air flow source is high more, but the corresponding calculated amount is also big more.According to a plurality of zones that mark off, also need in terminal device, store each regional eigenvector in advance.

The embodiment of the invention is based on airflow-direction sensor perception airflow direction, thereby to the principle that user interface is carried out control operation is:

Each airflow-direction sensor that is provided with on the terminal device can the perception air-flow direction; In given coordinate system; The position of each airflow-direction sensor can be represented with coordinate parameters; The airflow direction of each airflow-direction sensor institute perception can be represented with angle parameter; Therefore can obtain the straight line path with the coordinate of each airflow-direction sensor and the air-flow angle of this sensor institute perception; Per two straight line paths intersect at an intersection point; The coordinate of this intersection point can calculate; If N sensor arranged then individual intersection point is arranged at most, this

scope that individual intersection point surrounded is exactly the air flow source scope of pneumatic sensor institute perception.Because it is not a point but a scope that air-flow affacts on the screen; Again owing to reasons such as the characteristic of air-flow and sensor errors; This

scope that individual intersection point surrounded is not necessarily in the ready-portioned in advance zone of screen; Therefore might cover a plurality of zones, need further to come accurately air flow source position, location according to these intersecting point coordinates and unique point that each is regional.

Each zone has

Individual unique point, each regional unique point set can be expressed as [X _i, Y _i] (i=0,1 ...), wherein X, Y are characteristic point coordinates.When confirming the air flow source position; Can obtain space length each other according to the coordinate of each intersection point and the characteristic point coordinates that each is regional; Because space length can be represented both similarities; Distance is similar more closely more, therefore can determine the most similar zone through the space length that calculates, thereby should confirm as the position that air flow source belongs in the position, zone.

Be example with the portable terminal shown in Fig. 2 A, Fig. 2 B below, specify the implementation of the embodiment of the invention.

Respectively be provided with an airflow-direction sensor around the screen of the portable terminal shown in Fig. 2 A, as shown in the figure, comprise sensor (A, B, C, D), screen evenly is divided into 24 zones, there are 6 unique points in each zone.

The structure of this portable terminal can comprise storage unit 201 shown in Fig. 2 B, wherein preserve each regional unique point coordinate, and the set of the unique point that each is regional can be expressed as [X _i, Y _i] (i=1,2 ..., 6).The functional unit of confirming the air flow source position according to the airflow direction of airflow-direction sensor perception can comprise: intersection point is confirmed unit 202, metrics calculation unit 203, position determination unit 204; These functional units can be realized by software, are configured among the CPU or other processors of portable terminal.In addition, also comprise interface control unit 205, the user interface in the screen of this unit controls portable terminal.

Use the portable terminal shown in Fig. 2 A, Fig. 2 B, the flow process of utilizing air-flow that the user interface in this mobile terminal screen is operated can be as shown in Figure 3, and concrete steps are following:

Step 301, when air-flow acts on the mobile terminal screen, sensor (C D) perceives airflow direction information and send to intersection point and confirm unit 202 for A, B, sensor (A, B, C, D) the airflow direction information of institute's perception is expressed as signal X respectively ₁(t), X ₂(t), X ₃(t), X ₄(t).

Step 302, intersection point confirm that unit 202 determines the angle of the airflow direction of each sensor institute perception with respect to given coordinate system according to the signal that receives; Then; According to the angle of determining and each sensor coordinate with respect to given coordinate system; Determine the straight line path of the coordinate position of each sensor respectively, and then determine the intersecting point coordinate of per two straight line paths to the air flow source position of its perception.

As shown in Figure 4, corresponding to sensor (A, B, C, straight line path D) is respectively a, b, c, d, its intersection point comprises: the intersection point O of a and d ₁, b and d intersection point O ₂, the intersection point O of b and c ₃, c and d intersection point O ₄, a and c intersection point O ₅, a and b intersection point O ₆, can obtain following straight-line equation:

$\left\{\begin{array}{c}{\mathrm{\α}}_{1}x+y={\mathrm{\α}}_1{x}_A+y_A\\ {\mathrm{\α}}_{2}x+y={\mathrm{\α}}_2{x}_B+y_B\\ {\mathrm{\α}}_{3}x+y={\mathrm{\α}}_3{x}_C+y_C\\ {\mathrm{\α}}_{4}x+y={\mathrm{\α}}_4{x}_D+y_D\end{array}\right....\left(8\right)$

Wherein, α ₁, α ₂, α ₃, α ₄Represent sensor (A, B, C, the air-flow angle that D) is perceived, the i.e. angle of straight line path a, b, c, d respectively; (x _A, y _A), (x _B, y _B), (x _C, y _C), (x _D, y _D) represent sensor (A, B, C, D) coordinate of position respectively.

Can calculate 6 intersecting point coordinates of a, b, c, d by (8) formula, that is:

$\left\{\begin{array}{c}{O}_1:(\frac{{\mathrm{\α}}_4{x}_D-{\mathrm{\α}}_1{x}_A}{{\mathrm{\α}}_4-{\mathrm{\α}}_1},\frac{{\mathrm{\α}}_4{y}_A-{\mathrm{\α}}_1{y}_D}{{\mathrm{\α}}_4-{\mathrm{\α}}_1})\\ O_2:(\frac{{\mathrm{\α}}_4{x}_D-{\mathrm{\α}}_2{x}_B}{{\mathrm{\α}}_4-{\mathrm{\α}}_2},\frac{{\mathrm{\α}}_4{y}_B-{\mathrm{\α}}_2{y}_D}{{\mathrm{\α}}_4-{\mathrm{\α}}_2})\\ O_3:(\frac{{\mathrm{\α}}_3{x}_C-{\mathrm{\α}}_2{x}_B}{{\mathrm{\α}}_3-{\mathrm{\α}}_2},\frac{{\mathrm{\α}}_3{y}_B-{\mathrm{\α}}_2{y}_C}{{\mathrm{\α}}_3-{\mathrm{\α}}_2})\\ O_4:(\frac{{\mathrm{\α}}_4{x}_D-{\mathrm{\α}}_3{x}_C}{{\mathrm{\α}}_4-{\mathrm{\α}}_3},\frac{{\mathrm{\α}}_4{y}_C-{\mathrm{\α}}_3{y}_D}{{\mathrm{\α}}_4-{\mathrm{\α}}_3})\\ O_5:(\frac{{\mathrm{\α}}_3{x}_C-{\mathrm{\α}}_1{x}_A}{{\mathrm{\α}}_3-{\mathrm{\α}}_1},\frac{{\mathrm{\α}}_3{y}_A-1_2{y}_C}{{\mathrm{\α}}_3-{\mathrm{\α}}_1})\\ O_6:(\frac{{\mathrm{\α}}_2{x}_B-{\mathrm{\α}}_1{x}_A}{{\mathrm{\α}}_2-{\mathrm{\α}}_1},\frac{{\mathrm{\α}}_2{y}_A-{\mathrm{\α}}_1{y}_B}{{\mathrm{\α}}_2-{\mathrm{\α}}_1})\end{array}\right....\left(9\right)$

Step 305, metrics calculation unit 203 are according to these intersecting point coordinates, and each regional unique point coordinate, and the position of determining air flow source belongs to which zone in the screen area that portable terminal divides in advance.

In this step,, can each intersecting point coordinate be expressed as the location estimation matrix of following input air-flow reflection spot on screen for convenience of calculation:

$[X,Y]=\left[\begin{array}{ccc}(x_{\mathrm{AB}},y_{\mathrm{AB}})& (x_{\mathrm{AC}},y_{\mathrm{AC}})& (x_{\mathrm{AD}},y_{\mathrm{AD}})\\ 0& (x_{\mathrm{BC}},y_{\mathrm{BC}})& (x_{\mathrm{BD}},y_{\mathrm{BD}})\\ 0& 0& (x_{\mathrm{CD}},y_{\mathrm{CD}})\end{array}\right]...\left(10\right)$

Wherein, (x _AB, y _AB), (x _AC, y _AC), (x _AD, y _AD), (x _BC, y _BC), (x _BD, y _BD), (x _CD, y _CD) represent the coordinate of each intersection point respectively.

Then, utilize location estimation matrix shown in (10) formula and the formed eigenvector [X of unique point coordinate that each is regional _i, Y _i] (i=1 ... 6) carry out matrix operation, (Euclidean distance, ED), each regional correspondence obtains an ED value to calculate Euclidean distance between each intersection point and each the regional individual features point.If the intersection point set is [O ₁, O ₂, O ₃, O ₄, O ₅, O ₆], regional k (k=1 ..., 24) feature point set be combined into [P ₁, P ₂, P ₃, P ₄, P ₅, P ₆], then:

${\mathrm{ED}}_k=\sqrt{\underset{i=1}{\overset{6}{\mathrm{\Σ}}}{(O_i-P_i)}^2}...\left(11\right)$

Wherein, O _i-P _iExpression O _iAnd P _iSpace length between 2 can pass through O _iAnd P _iCoordinate Calculation draw.

The minimum value The corresponding area in all ED distance values is chosen in step 306, definite unit 204, zone, as the reflector space (be air flow source position) of air-flow on screen.

Step 307, interface control unit 205 carry out the interface control operation according to determining the air flow source position.

In the step 305 of above-mentioned flow process, between calculating location estimated matrix and the eigenvector that each is regional apart from the time, also available other distance calculating methods realize that it is preferred version that the embodiment of the invention is selected Euclidean distance for use.

In the step 307 of above-mentioned flow process, the interface control operation of carrying out can comprise:

The icon selection operation: certain zone in the interface is confirmed as the air-flow reflector space, and air-flow in this locational continuous action time the time threshold t greater than default ₁The time, should the zone in corresponding icon choose;

Icon moves: after icon is selected, smoothly drops down onto regional j by regional i, then makes the icon of choosing move to the j zone by the i segment smoothing if judge the air-flow reflection position, and i wherein, j=1,2 ..., N;

The screen page turning is switched: when the air-flow reflector space of determining does not have selectable icons, and when judging the air-flow reflector space thereafter and smoothly dropping down onto zone, the screen leftmost side by current region i, then user interface takes over seamlessly page up by current page; In like manner, smoothly drop down onto screen rightmost side when zone if judge the air-flow reflector space by current region i, then user interface takes over seamlessly down one page by current page, i=1 wherein, and 2 ..., N.In like manner, also definable is defined as screen page turning switching mode: when the air-flow reflector space smoothly dropped down onto zone, screen top side by current region i, then user interface took over seamlessly page up by current page; When the air-flow reflector space smoothly dropped down onto zone, screen lower side by current region i, then user interface took over seamlessly down one page by current page.

Owing in the actual environment for use of equipment, may receive the interference of irrelevant air-flow or noise air-flow; The technical scheme that the embodiment of the invention provides can further be made improvement; On the basis of the foregoing description, increase the filtering interference signals operation; After confirming that at intersection point unit 202 receives the signal of each sensor transmission, carry out processing such as filtering, remove the undesired signal that disturbing flow produces.

In the embodiment of the invention, each regional unique point coordinate can be stored in the terminal device in advance on the terminal device, also can in the use of terminal device, train each regional unique point gradually.Preferably, the embodiment of the invention is carried out the C-mean cluster for N＞=500 sample in each regional training set before terminal device dispatches from the factory, thereby obtains each regional unique point set.

In sum; In the embodiment of the invention; Because the airflow direction that uses airflow-direction sensor to come the perception terminal screen to be reflected, estimate the air-flow reflector space that surrounds by a plurality of intersection point according to the airflow direction of each sensor institute perception, calculate the ED distance between each regional unique point of these intersection points and screen then; Thereby orient the zone under the air-flow reflector space, and then determine the position of air-flow reflection spot.Can find out that the embodiment of the invention is lower to the request memory of equipment, calculated amount is less, therefore not only can be used for the bigger equipment of memory capacity such as computing machine, also can be used for internal memory small device such as portable terminal, realizes interface control.Because the technical scheme that the embodiment of the invention provided utilizes the effect of air-flow that the interface is controlled; Not limited by other environmental factors such as sound; Therefore in a riot of sound environment, still can keep reacting more accurately and higher sensitivity, therefore alleviate and utilized aspirant to carry out the problem that interface control is subject to noise jamming in the prior art.

Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, belong within the scope of claim of the present invention and equivalent technologies thereof if of the present invention these are revised with modification, then the present invention also is intended to comprise these changes and modification interior.

Claims (10)

1. a method of utilizing air-flow control operation user interface is characterized in that, device screen is divided into a plurality of zones in advance, and screen periphery is provided with a plurality of sensors that can the perception airflow direction, and the method comprising the steps of:

Receive each sensor senses to the direction of the air-flow that screen reflected, according to the airflow direction that each sensor senses arrives, determine the straight line path of each sensor, and the intersection point of said straight line path to the reflection position of this air-flow on screen;

Calculate the space length between the unique point of said intersection point and each screen area respectively; And wherein the reflection position of this air-flow on screen confirmed as in the position of the minimum space pairing screen area of distance on this screen; Wherein, The quantity of intersection point is that

is individual; The unique point quantity of each screen area is that

is individual, and N is the quantity of said sensor;

According to the reflection position of the air-flow of determining on screen, the user interface that shows in the screen is controled.

2. the method for claim 1 is characterized in that, for each screen area in said each screen area, calculates the space length between the unique point of said intersection point and this screen area, is specially:

According to the unique point coordinate of said intersecting point coordinate and this screen area, respectively to each intersection point, calculate space length between this intersection point and this intersection point characteristic of correspondence point square;

Add up to the space length of each intersection point calculation square;

Accumulation result is carried out square root calculation, obtain the space length between the unique point of each intersection point and this screen area.

3. the method for claim 1 is characterized in that, according to the reflection position of the air-flow of determining on screen, the interface in the screen is operated, and comprising:

If the reflection position of in official hour, being determined all is a same position, and on this position selectable icons is arranged, then choose this locational icon;

As if the zone of the reflection position of being determined at the appointed time, and do not have selectable icons on the reflection position, then carry out the interface page turn over operation from screen area smooth transformation a to screen edge.

4. method as claimed in claim 3; It is characterized in that; After choosing icon, if the follow-up reflection position of the determining screen area smooth transformation corresponding from this icon position be to other screen areas, then selected icon is followed moving of reflection position and is moved.

5. like each described method of claim 1-4, it is characterized in that, said sensor disperse to be arranged on said screen around.

6. an equipment that utilizes air-flow control operation user interface is characterized in that, comprising:

A plurality of sensors that can the perception airflow direction are arranged on screen periphery;

Intersection point is confirmed the unit; Be used to receive each sensor senses to the direction of the air-flow that screen reflected; According to the airflow direction that each sensor senses arrives, determine the straight line path of each sensor to the reflection position of this air-flow on screen, and the intersection point of said straight line path;

Position determination unit; Be used for calculating respectively the space length between the unique point of said intersection point and each screen area; And wherein the reflection position of this air-flow on screen confirmed as in the position of the minimum space pairing screen area of distance on this screen; Wherein, The quantity of intersection point is that is individual; The unique point quantity of each screen area is that

is individual, and N is the quantity of said sensor;

The interface control unit is used for according to the reflection position of air-flow on screen of determining the user interface that shows in the screen being controled.

7. equipment as claimed in claim 6 is characterized in that, said position determination unit is for each screen area in said each screen area, when calculating the space length between the unique point of said intersection point and this screen area:

According to the unique point coordinate of said intersecting point coordinate and this screen area, respectively to each intersection point, calculate space length between this intersection point and this intersection point characteristic of correspondence point square;

Add up to the space length of each intersection point calculation square;

Accumulation result is carried out square root calculation, obtain the space length between the unique point of each intersection point and this screen area.

8. equipment as claimed in claim 6 is characterized in that, the operation that said interface control unit carries out the interface in the screen comprises:

If the reflection position of in official hour, being determined all is a same position, and on this position selectable icons is arranged, then choose this locational icon;

As if the zone of the reflection position of being determined at the appointed time, and do not have selectable icons on the reflection position, then carry out the interface page turn over operation from screen area smooth transformation a to screen edge.

9. equipment as claimed in claim 8; It is characterized in that; After icon is chosen in said interface control unit, if the follow-up reflection position of the determining screen area smooth transformation corresponding from this icon position then makes selected icon follow moving and moving of reflection position to other screen areas.

10. like each described equipment of claim 6-9, it is characterized in that, said sensor disperse to be arranged on said screen around.

Images