CN102955564B - The operational approach of a kind of terminal and terminal - Google Patents
The operational approach of a kind of terminal and terminal Download PDFInfo
- Publication number
- CN102955564B CN102955564B CN201110247241.2A CN201110247241A CN102955564B CN 102955564 B CN102955564 B CN 102955564B CN 201110247241 A CN201110247241 A CN 201110247241A CN 102955564 B CN102955564 B CN 102955564B
- Authority
- CN
- China
- Prior art keywords
- color label
- coordinate
- terminal screen
- time
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
- G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
- G06F3/0321—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses the operational approach of a kind of terminal and terminal, by using photographic head to catch the change in location of the multiple color labels not in contact with terminal screen, the identification technology utilizing terminal determines the change in location of multiple color label, thus satisfied the imposing a condition of change in location according to each color label, perform corresponding operation on a terminal screen。Due to the embodiment of the present invention provide scheme in multiple color labels not in contact with mobile terminal screen, it is achieved be similar to the operation of touch screen, be user-friendly to, be absent from simultaneously existing touch screen operation time can block the problem showing content on terminal screen。Further, in the scheme that the embodiment of the present invention provides, owing to complicated finger identification problem is converted into the simple colour recognition problem to different colours label, the amount of calculation of terminal recognition finger trace is decreased, it is possible to improve the operational efficiency of terminal。
Description
Technical field
The present invention relates to field of terminal technology, particularly relate to operational approach and the terminal of a kind of terminal。
Background technology
Along with the development of terminal technology, terminals many at present all starts to support the man-machine interaction modes such as such as input through keyboard, touch screen input, phonetic entry。In interactive process, major part can use the information input operation of the complete paired terminal of finger, one type is to realize finger touch input by touch screen, touch screen by finger (or felt pen) and realize the input operation to terminal, support single-point and Random seismic field, use simple and convenient, but, when using touch screen input, meeting shield portions screen during finger contact screen, affect the user's overall viewing to showing content on terminal screen。
Summary of the invention
Embodiments provide operational approach and the terminal of a kind of terminal, in order to realize when not contacting terminal screen, the purpose that the information on terminal screen is operated。
The operational approach of a kind of terminal that the embodiment of the present invention provides, including:
The multiple color labels not in contact with terminal screen that monitoring user uses respectively change in location before terminal camera；Described each color label is distinguished by different colours；
When the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, perform corresponding operation on a terminal screen。
The embodiment of the present invention additionally provides a kind of terminal, including:
Monitoring modular, is used for the multiple color labels not in contact with terminal screen monitoring user's use respectively change in location before terminal camera；Described each color label is distinguished by different colours；
Operation executing module, for when the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, performs corresponding operation on a terminal screen。
The operational approach of a kind of terminal that the embodiment of the present invention provides and terminal, by using photographic head to catch the change in location of the multiple color labels not in contact with terminal screen, the identification technology utilizing terminal determines the change in location of multiple color label, thus satisfied the imposing a condition of change in location according to each color label, perform corresponding operation on a terminal screen。Due to the embodiment of the present invention provide scheme in multiple color labels not in contact with mobile terminal screen, it is achieved be similar to the operation of touch screen, be user-friendly to, be absent from simultaneously existing touch screen operation time can block the problem showing content on terminal screen。Further, in the scheme that the embodiment of the present invention provides, owing to complicated finger identification problem is converted into the simple colour recognition problem to different colours label, the amount of calculation of terminal recognition finger trace is decreased, it is possible to improve the operational efficiency of terminal。
Accompanying drawing explanation
One of flow chart of operational approach of terminal that Fig. 1 provides for the embodiment of the present invention；
The two of the flow chart of the operational approach of the terminal that Fig. 2 provides for the embodiment of the present invention；
The schematic diagram of the terminal screen that Fig. 3 provides for the embodiment of the present invention；
The three of the flow chart of the operational approach of the terminal that Fig. 4 provides for the embodiment of the present invention；
The structural representation of the terminal that Fig. 5 provides for the embodiment of the present invention。
Detailed description of the invention
Below in conjunction with accompanying drawing, the operational approach of a kind of terminal and the detailed description of the invention of terminal that provide the embodiment of the present invention are described in detail。
The operational approach of a kind of terminal that the embodiment of the present invention provides, as it is shown in figure 1, idiographic flow includes:
S101, the multiple color labels not in contact with terminal screen that monitoring user uses respectively change in location before terminal camera；Wherein, each color label is distinguished by different colours；
S102, when the change in location of each color label meets and imposes a condition, according to imposing a condition of pre-setting and the corresponding relation between each operation, perform corresponding operation on a terminal screen。
In said method, the color label of different colours can be pasted onto on multiple finger by user, it is also possible to arranges different color labels on each finger of the glove used, and specific implementation is likely to have multiple, does not limit concrete to adopt which kind of mode at this。
In embodiments of the present invention, terminal can be such as mobile phone, the mobile terminal of notebook etc, it is also possible to is the fixed terminal of conventional PC etc, does not limit at this。
It is preferred that before performing above-mentioned steps S101, in addition it is also necessary to carry out performing following step and enable the terminal to identify each color label, as in figure 2 it is shown, comprise the steps:
S201, terminal send the instruction identifying color label；Wherein, this instruction instruction user moves each color label one by one, until photographic head photographs the appointment position that each color label moves on terminal screen；
S202, when the color label shot by photographic head be positioned at appointment position time, it is determined that specify position color；
S203, the color specifying position being determined by out, identify this color label；
S204, judge whether to have identified whole color label, if it is, perform step S205；If it does not, perform step S202；
S205, send terminate identify color label instruction。
Wherein, in above-mentioned steps S201, the instruction identifying color label sent can adopt the mode of well known to a person skilled in the art, for instance pop-up dialogue box on a terminal screen, to point out user to carry out color label identification operation, is not specifically limited at this。
After terminal sends the instruction identifying color label, user is by observing the image of the color label of photographic head shooting on a terminal screen, appointment position on the image incoming terminal screen of color label, then stop mobile color label, in order to terminal completes the identification operation of this color label。Appointment position on terminal screen, it is possible to the square frame at the center of employing terminal screen as shown in Figure 3 realizes, as it is shown on figure 3, the size of square frame and concrete particular location on a terminal screen are all set in advance。Terminal can be determined by the color of appointment position and identify current color label, for instance when the color determined in square frame is for time red, the color identifying i-th label is redness。
Preferably, performing after above-mentioned steps S202 or simultaneously, when can also exceed Preset Time (such as 2 seconds) in current color label appointment position on a terminal screen, it is also possible to the initial area Ai of record current color label external matrix on a terminal screen0。
Above-mentioned steps S201～S205 was carried out one time before when terminal screen is operated by each user, it is only necessary to use color label to perform once before terminal screen is operated first time user。
Preferably, in the method that the embodiment of the present invention provides, step S102 monitors multiple color label change in location before photographic head respectively, in the specific implementation, can pass through color label coordinate in three directions is monitored realization, detailed process as shown in Figure 4, comprises the steps:
S401, monitor each color label coordinate Zs in terminal screeni；
In embodiments of the present invention, each color label coordinate Zs in terminal screeniValue can only be two one of values set, the defining method of its value is: first determine the area Ai of the boundary rectangle that t color label shows on a terminal screent, then by the area Ai of the boundary rectangle of color labeltWith the initial area Ai set0Compare:
Work as Ait> Ai0Time, it is determined that this color label coordinate Zs in terminal screeniFor numerical value one A set, for instance can value be 0 (can certainly value be 1, at this for value for 0), represent that this color label is close to photographic head, the state being similar in prior art finger contact touch screen；
Work as Ait≤Ai0Time, it is determined that this color label coordinate Zs in terminal screeniFor numerical value two B set, for instance can be 1 (can certainly value be 0, at this for value for 1), represent that this color label is away from photographic head, be similar in prior art finger and be not in contact with the state of touch screen。
All will to work as Ai in embodiment of the present invention as explained belowt> Ai0Time determine coordinate ZsiIt is 0, works as Ait≤Ai0Time determine coordinate ZsiBe 1 it is example explanation。
S402, determine whether terminal current operation status is continuous input pattern；If so, step S403 is performed, if it is not, perform step S404；
S403, as the coordinate Zs of the color label monitorediFrom 1 become 0 time, start to continue to record by this color label coordinate Xs in terminal screeniAnd YsiThe coordinate sequence Sp of compositioni, until the coordinate Zs of this color labeliFrom 0 become 1 time stop record；
S404, as the coordinate Zs of color labeliWhen changing, record this color label current time coordinate Xs in terminal screeniAnd Ysi。
Wherein, the coordinate Xs in terminal screen of each color label in step S403 or S404iAnd YsiCan be determined by following manner:
First determine color label coordinate Xc in the image that photographic head obtainsiAnd Yci, this coordinate can be defined as the central point of the boundary rectangle of this color label coordinate in the image that photographic head obtains；
Then this color label coordinate Xs in terminal screen can be calculated according to following formulaiAnd Ysi:
Xsi=Sw × Xci/ Cw, Ysi=Sh × Yci/ Ch；
In above formula, the width of Sw and Sh respectively terminal screen and height, the width of the image that Cw and Ch respectively photographic head obtains and height。
Step S102 in the method that the embodiment of the present invention provides is when the change in location of each color label meets and imposes a condition, according to imposing a condition of pre-setting and the corresponding relation between each operation, perform corresponding operation on a terminal screen, can comprising multiple situation, a point situation illustrates one by one below。
The first situation: terminal judges current operation status is continuous input pattern, it will judge whether to only exist the coordinate Zs of a color labeli0 is become, if it is, the coordinate sequence Sp of this color label will be performed to show on a terminal screen from 1iThe operation of point。
The second situation: terminal judges current operation status is discontinuous input pattern, it will judge the coordinate Zs of color label within the time of setting (such as 1 second)iBecome the number of 0 from 1, the difference of the number by judging, accordingly again to coordinate ZsiFrom 1 become 0 color label change in location meet condition judge, and according to the corresponding relation between the condition pre-set and each operation, terminal performs corresponding operation, for instance the operations such as click, slip, convergent-divergent and rotation, specifically includes following several:
1, the coordinate Zs only existing a color label within the setting time is judgediThe situation of 0 is become from 1:
Determine the coordinate Zs of color labeliFrom 1 become 0 time coordinate Xsi1And Ysi1, and the coordinate Zs of this color labeliFrom 0 become 1 time coordinate Xsi2And Ysi2, make the following judgment, carry out operation accordingly when the condition is satisfied:
When meeting | Xsi1-Xsi2| < Tc and | Ysi1-Ysi2| during the condition of < Tc, terminal screen is performed clicking operation；Wherein, Tc represents the stabilization threshold value of the clicking operation of setting, it is preferable that its value could be arranged to 10；
When meeting Xsi2-Xsi1<-Tm and | Xsi2-Xsi1| > | Ysi2-Ysi1| condition time, terminal screen is performed slide to the left；Wherein, Tm represents the stabilization threshold value of the slide of setting, it is preferable that its value could be arranged to 30；
When meeting Xsi2-Xsi1> Tm and | Xsi2-Xsi1| > | Ysi2-Ysi1| condition time, terminal screen is performed slide to the right；
When meeting Ysi2-Ysi1<-Tm and | Ysi2-Ysi1| > | Xsi2-Xsi1| condition time, to terminal screen perform upward sliding operation；
When meeting Ysi2-Ysi1> Tm and | Ysi2-Ysi1| > | Xsi2-Xsi1| condition time, terminal screen is carried out slide downward operation；
2, judge setting the time memory coordinate Zs at two color labelsiThe situation of 0 is become from 1:
Determine the coordinate Zs when two color labelsiAll from 1 become 0 time, they distance Dis on a terminal screen1；Coordinate Zs when two color labelsiAll from 0 become 1 time, they distance Dis on a terminal screen2；
When meeting Dis2> Dis1During condition, terminal screen is performed amplifieroperation；
When meeting Dis2< Dis1During condition, terminal screen is performed reduction operation。
Determine the coordinate Zs when two color labelsiAll from 1 become 0 time, they on a terminal screen be connected after formed straight line Line1；Coordinate Zs when two color labelsiAll from 0 become 1 time, they on a terminal screen be connected after formed straight line Line2；
When meeting Line2Relative to Line1The anglec of rotation condition more than 0 time, perform to turn clockwise operation to terminal screen；
When meeting Line2Relative to Line1The anglec of rotation condition less than 0 time, terminal screen is performed rotation process counterclockwise。
3, judge setting the time memory coordinate Zs at two or more color labeliThe situation of 0 is become from 1:
Determine the coordinate Zs when two or more color labeliAll from 1 become 0 time, the center of gravity of the external contact zone that they form on a terminal screen is to the distance sum Sum of two or more color label coordinate points1；Coordinate Zs when two or more color labeliAll from 0 become 1 time, the center of gravity of the external contact zone that they form on a terminal screen is to the distance sum Sum of two or more color label coordinate points2；
When meeting Sum2> Sum1Condition time, to terminal screen perform amplifieroperation；
When meeting Sum2< Sum1Condition time, to terminal screen perform reduction operation。
Determine the coordinate Zs when two or more color labeliAll from 1 become 0 time, the external contact zone Poly that they form on a terminal screen1；Coordinate Zs when two or more color labeliAll from 0 become 1 time, the external contact zone Poly that they form on a terminal screen2；
When meeting Poly2Relative to Poly1The anglec of rotation condition more than 0 time, perform to turn clockwise operation to terminal screen；
When meeting Poly2Relative to Poly1The anglec of rotation condition less than 0 time, terminal screen is performed rotation process counterclockwise。
It is preferred that in three kinds of above-mentioned situations, before terminal screen is performed operation, it is also possible to the change in location of each color label is carried out shake identification, filters some maloperations caused due to shake, specifically, it is possible to be accomplished by:
Determine that color label is at coordinate ZsiFrom 1 become 0 time the area Ai of boundary rectangle1, at coordinate ZsiFrom 0 become 1 time the area Ai of boundary rectangle2；Coordinate ZsiFrom 0 become 1 time time value Pi1, coordinate ZsiFrom 1 become 0 time time value Pi2；
Judge whether each color label meets | Ai1-Ai2|×|Pi1-Pi2| the condition of < Td, wherein Td represents the stabilization threshold value of setting；
If so, it is judged as that this color label is shaken, ignores the change in location of its generation, and do not perform any operation on a terminal screen；If it is not, be judged as that this color label is shaken, above-mentioned various situation is turned to judge whether the change in location of this color label meets the step imposed a condition。
Based on same inventive concept, the embodiment of the present invention additionally provides a kind of terminal, and owing to the principle of this terminal solution problem is similar to the operational approach of aforementioned a kind of terminal, therefore the enforcement of this terminal may refer to the enforcement of method, repeats part and repeats no more。
A kind of terminal that the embodiment of the present invention provides, as it is shown in figure 5, include:
Monitoring modular 501, is used for the multiple color labels not in contact with terminal screen monitoring user's use respectively change in location before terminal camera；Wherein, each color label is distinguished by different colours；
Operation executing module 502, for when the change in location of each color label meets and imposes a condition, according to imposing a condition of pre-setting and the corresponding relation between each operation, performs corresponding operation on a terminal screen。
Further, the above-mentioned terminal that the embodiment of the present invention provides, as it is shown in figure 5, also include: identification module 503, for sending the instruction identifying color label；Wherein, this instruction instruction user moves each color label one by one, until photographic head photographs the appointment position that each color label moves on terminal screen；When the i-th color label shot by photographic head is positioned at appointment position, it is determined that specify the color of position；The color specifying position being determined by out, identifies i-th color label。
It is preferred that the monitoring modular 501 in the terminal of embodiment of the present invention offer, as it is shown in figure 5, specifically include:
First monitoring submodule 5011, for monitoring i-th color label coordinate Zs in terminal screeni；Wherein, coordinate ZsiFor A or B；
State determines submodule 5012, is used for determining whether terminal current operation status is continuous input pattern；
Second monitoring submodule 5013, being used in terminal current operation status is continuous input pattern, and as the coordinate Zs of i-th color labeliFrom B become A time, start to continue to record by i-th color label coordinate Xs in terminal screeniAnd YsiThe coordinate sequence Sp of compositioni, until the coordinate Zs of i-th color labeliRecord is stopped when becoming B from A；
3rd monitoring submodule 5014, being used in terminal current operation status is discontinuous input pattern, and the coordinate Zs of i-th color labeliWhen changing, record i-th color label current time coordinate Xs in terminal screeniAnd Ysi。
It is preferred that the operation executing module 502 in the terminal that provides of the embodiment of the present invention, specifically for being continuous input pattern in terminal current operation status, and meet as the coordinate Zs that there is i-th color label in each color labeliWhen becoming the condition of A from B, perform displaing coordinate sequence Sp on a terminal screeniThe operation of point。
It is preferred that the operation executing module 502 in the terminal that provides of the embodiment of the present invention, specifically for being discontinuous input pattern in terminal current operation status, and there is the coordinate Zs of i-th color labeliFrom B become A, perform:
When the change in location of color label meets | Xsi1-Xsi2| < Tc and | Ysi1-Ysi2| during the condition of < Tc, terminal screen is performed clicking operation；
When the change in location of color label meets Xsi2-Xsi1<-Tm and | Xsi2-Xsi1| > | Ysi2-Ysi1| condition time, terminal screen is performed slide to the left；
When the change in location of color label meets Xsi2-Xsi1> Tm and | Xsi2-Xsi1| > | Ysi2-Ysi1| condition time, terminal screen is performed slide to the right；
When the change in location of color label meets Ysi2-Ysi1<-Tm and | Ysi2-Ysi1| > | Xsi2-Xsi1| condition time, to terminal screen perform upward sliding operation；
When the change in location of color label meets Ysi2-Ysi1> Tm and | Ysi2-Ysi1| > | Xsi2-Xsi1| condition time, terminal screen is carried out slide downward operation；
In above formula, Xsi1And Ysi1Represent the coordinate Zs of i-th color label respectivelyiFrom B become A time x-axis coordinate and y-axis coordinate, Xsi2And Ysi2Represent the coordinate Zs of i-th color label respectivelyiFrom A become B time x-axis coordinate and y-axis coordinate, Tc represents the stabilization threshold value of the clicking operation of setting, and Tm represents the stabilization threshold value of the slide of setting。
It is preferred that the operation executing module 502 in the terminal that provides of the embodiment of the present invention, specifically for being discontinuous input pattern in terminal current operation status, and there is the coordinate Zs of two color labelsiFrom B become A:
Dis is met between two color labels2> DDis1Condition time, to terminal screen perform amplifieroperation；
Dis is met between two color labels2< Dis1Condition time, to terminal screen perform reduction operation；
In above formula, Dis1Represent the coordinate Zs of two color labelsiAll from B become A time, two color labels distance on a terminal screen；Dis2Represent the coordinate Zs of two color labelsiAll from A become B time, two color labels distance on a terminal screen；
Line is met between two color labels2Relative to Line1The anglec of rotation condition more than 0 time, perform to turn clockwise operation to terminal screen；
Line is met between two color labels2Relative to Line1The anglec of rotation condition less than 0 time, terminal screen is performed rotation process counterclockwise；
In above formula, Line1Represent the coordinate Zs of two color labelsiFrom B become A time, the straight line that two color labels are formed after being connected on a terminal screen；Line2Represent the coordinate Zs of two color labelsiFrom A become B time, the straight line that two color labels are formed after being connected on a terminal screen。
It is preferred that the operation executing module 502 in the terminal that provides of the embodiment of the present invention, specifically for being discontinuous input pattern when terminal current operation status, and there is the coordinate Zs of two or more color labeliAll from B become A:
Sum is met between two or more color label2> Sum1Condition time, to terminal screen perform amplifieroperation；
Sum is met between two or more color label2< Sum1Condition time, to terminal screen perform reduction operation；
In above formula, Sum1Represent the coordinate Zs of two or more color labeliFrom B become A time, the center of gravity of the external contact zone that two or more color label forms on a terminal screen is to the distance sum of two or more color label coordinate points；Sum2Represent the coordinate Zs of two or more color labeliFrom A become B time, the center of gravity of the external contact zone that two or more color label forms on a terminal screen is to the distance sum of two or more color label coordinate points；
When meeting following condition between two or more color label, perform to turn clockwise operation: Poly to terminal screen2Relative to Poly1The anglec of rotation more than 0；
When meeting following condition between two or more color label, terminal screen is performed rotation process counterclockwise: Poly2Relative to Poly1The anglec of rotation less than 0；
In above formula, Poly1Represent the coordinate Zs of two or more color labeliFrom B become A time, the external contact zone that two or more color label forms on a terminal screen；Poly2Represent the coordinate Zs of two or more color labeliFrom A become B time, the external contact zone that two or more color label forms on a terminal screen。
It is preferred that the operation executing module 502 in the terminal of embodiment of the present invention offer, it is additionally operable to judge whether each color label meets following condition: | Ai1-Ai2|×|Pi1-Pi2| < Td；If so, judge that this color label is shaken, ignore the change in location of its generation, and do not perform any operation on a terminal screen；If it is not, judge that this color label is shaken, turn to whether each change in location judging this color label meets the step imposed a condition；
Wherein, Ai1Represent that i-th color label is at coordinate ZsiFrom B become A time the area of boundary rectangle, Ai2Represent that i-th color label is at coordinate ZsiFrom A become B time the area of boundary rectangle, Pi1Represent the coordinate Zs of i-th color labeliFrom B become A time time point, Pi2Represent the coordinate Zs of i-th color labeliFrom A become B time time point, Td represents the stabilization threshold value of setting。
The operational approach of a kind of terminal that the embodiment of the present invention provides and terminal, by using photographic head to catch the change in location of the multiple color labels not in contact with terminal screen, the identification technology utilizing terminal determines the change in location of multiple color label, thus satisfied the imposing a condition of change in location according to each color label, perform corresponding operation on a terminal screen。Due to the embodiment of the present invention provide scheme in multiple color labels not in contact with mobile terminal screen, it is achieved be similar to the operation of touch screen, be user-friendly to, be absent from simultaneously existing touch screen operation time can block the problem showing content on terminal screen。Further, in the scheme that the embodiment of the present invention provides, owing to complicated finger identification problem is converted into the simple colour recognition problem to different colours label, the amount of calculation of terminal recognition finger trace is decreased, it is possible to improve the operational efficiency of terminal。
Obviously, the present invention can be carried out various change and modification without deviating from the spirit and scope of the present invention by those skilled in the art。So, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification。
Claims (19)
1. the operational approach of a terminal, it is characterised in that including:
The multiple color labels not in contact with terminal screen that monitoring user uses respectively change in location before terminal camera；Each color label is distinguished by different colours；
When the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, perform corresponding operation on a terminal screen；
Wherein, the described change in location when described each color label meets when imposing a condition, and according to the corresponding relation imposed a condition described in pre-setting and between each operation, before performing corresponding operation on a terminal screen, also includes:
Judge whether described each color label meets following condition: | Ai1-Ai2|×|Pi1-Pi2| < Td；
If so, judge that this color label is shaken, ignore the change in location of its generation, and do not perform any operation on a terminal screen；
If it is not, judge that this color label is shaken, turn to whether the change in location judging this color label meets the step imposed a condition；
Wherein, ZsiRepresent i-th color label coordinate in terminal screen, described ZsiValue be A or B；Ai1Represent that i-th color label is at coordinate ZsiFrom B become A time the area of boundary rectangle, Ai2Represent that i-th color label is at coordinate ZsiFrom A become B time the area of boundary rectangle, Pi1Represent the coordinate Zs of i-th color labeliFrom B become A time time point, Pi2Represent the coordinate Zs of i-th color labeliFrom A become B time time point, Td represents the stabilization threshold value of setting, and wherein, the value of described i is not more than total number of the plurality of color label。
2. the method for claim 1, it is characterised in that before the described respectively change in location before terminal camera of the multiple color labels not in contact with terminal screen that monitoring user uses, described method also includes:
Send the instruction identifying color label；Wherein, described instruction instruction user moves each color label one by one, until photographic head photographs the appointment position that each color label moves on terminal screen；
When the i-th color label shot by photographic head is positioned at described appointment position, it is determined that the color of described appointment position；
The color of the described appointment position being determined by out, identifies described i-th color label。
3. the method for claim 1, it is characterised in that the described respectively multiple color labels not in contact with terminal screen that monitoring user uses change in location before terminal camera, specifically includes:
Monitoring i-th color label coordinate Zs in terminal screeni；
Determine whether terminal current operation status is continuous input pattern；
If so, then as the coordinate Zs of the described i-th color label monitorediFrom B become A time, start to continue to record by described i-th color label coordinate Xs in terminal screeniAnd YsiThe coordinate sequence Sp of compositioni, until the coordinate Zs of described i-th color labeliRecord is stopped when becoming B from A；
If it is not, then as the coordinate Zs of described i-th color labeliWhen changing, record described i-th color label current time coordinate Xs in terminal screeniAnd Ysi。
4. method as claimed in claim 3, it is characterised in that described i-th color label coordinate Zs in terminal screeni, determined by following manner:
Determine the area Ai of the boundary rectangle that i-th color label described in t shows on a terminal screent；Described t is any arithmetic number；
By the area Ai of described boundary rectangletWith the initial area Ai set0Compare；
Work as Ait>Ai0Time, it is determined that i-th color label coordinate Zs in terminal screeniFor A；
Work as Ait≤Ai0Time, it is determined that i-th color label coordinate Zs in terminal screeniFor B。
5. method as claimed in claim 3, it is characterised in that described i-th color label coordinate Xs in terminal screeniAnd Ysi, determined by following manner:
Determine described i-th color label coordinate Xc in the image that photographic head obtainsiAnd Yci；
Described i-th color label coordinate Xs in terminal screen is calculated according to following formulaiAnd Ysi:
Xsi=Sw × Xci/ Cw, Ysi=Sh × Yci/ Ch；
In above formula, the width of Sw and Sh respectively terminal screen and height, the width of the image that Cw and Ch respectively photographic head obtains and height。
6. method as claimed in claim 5, it is characterised in that described determine described i-th color label coordinate Xc in the image that photographic head obtainsiAnd Yci, specifically include:
Calculate the central point of boundary rectangle of the described i-th color label coordinate in the image that photographic head obtains；
The coordinate of the central point of described boundary rectangle is defined as described i-th color label coordinate Xc in the image that photographic head obtainsiAnd Yci。
7. method as claimed in claim 3, it is characterized in that, when the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, perform corresponding operation on a terminal screen, specifically include:
Terminal current operation status is continuous input pattern, and meets as the coordinate Zs that there is i-th color label in each color labeliWhen becoming the condition of A from B, perform on a terminal screen to show described coordinate sequence SpiThe operation of point。
8. method as claimed in claim 3, it is characterized in that, when the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, perform corresponding operation on a terminal screen, specifically include:
It is discontinuous input pattern in terminal current operation status, and there is the coordinate Zs of i-th color labeliFrom B become A, perform:
When the change in location of described color label meets | Xsi1-Xsi2| < Tc and | Ysi1-Ysi2| < during the condition of Tc, terminal screen is performed clicking operation；
When the change in location of described color label meets Xsi2-Xsi1<-Tm and | Xsi2-Xsi1|>|Ysi2-Ysi1| condition time, terminal screen is performed slide to the left；
When the change in location of described color label meets Xsi2-Xsi1> Tm and | Xsi2-Xsi1|>|Ysi2-Ysi1| condition time, terminal screen is performed slide to the right；
When the change in location of described color label meets Ysi2-Ysi1<-Tm and | Ysi2-Ysi1|>|Xsi2-Xsi1| condition time, to terminal screen perform upward sliding operation；
When the change in location of described color label meets Ysi2-Ysi1> Tm and | Ysi2-Ysi1|>|Xsi2-Xsi1| condition time, terminal screen is carried out slide downward operation；
In above formula, Xsi1And Ysi1Represent the coordinate Zs of described i-th color label respectivelyiFrom B become A time x-axis coordinate and y-axis coordinate, Xsi2And Ysi2Represent the coordinate Zs of described i-th color label respectivelyiFrom A become B time x-axis coordinate and y-axis coordinate, Tc represents the stabilization threshold value of the clicking operation of setting, and Tm represents the stabilization threshold value of the slide of setting。
9. method as claimed in claim 3, it is characterized in that, when the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, perform corresponding operation on a terminal screen, specifically include:
It is discontinuous input pattern in terminal current operation status, and there is the coordinate Zs of two color labelsiFrom B become A:
Dis is met between said two color label2>Dis1Condition time, to terminal screen perform amplifieroperation；
Dis is met between said two color label2<Dis1Condition time, to terminal screen perform reduction operation；
In above formula, Dis1Represent the coordinate Zs of said two color labeliAll from B become A time, said two color label distance on a terminal screen；Dis2Represent the coordinate Zs of said two color labeliAll from A become B time, said two color label distance on a terminal screen。
10. method as claimed in claim 3, it is characterized in that, when the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, perform corresponding operation on a terminal screen, specifically include:
It is discontinuous input pattern in terminal current operation status, and there is the coordinate Zs of two color labelsiFrom B become A:
Line is met between said two color label2Relative to Line1The anglec of rotation condition more than 0 time, perform to turn clockwise operation to terminal screen；
Line is met between said two color label2Relative to Line1The anglec of rotation condition less than 0 time, terminal screen is performed rotation process counterclockwise；
In above formula, Line1Represent the coordinate Zs of said two color labeliFrom B become A time, said two color label on a terminal screen be connected after formed straight line；Line2Represent the coordinate Zs of said two color labeliFrom A become B time, said two color label on a terminal screen be connected after formed straight line。
11. method as claimed in claim 3, it is characterized in that, when the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, perform corresponding operation on a terminal screen, specifically include:
When terminal current operation status is discontinuous input pattern, and there is the coordinate Zs of two or more color labeliAll from B become A:
Sum is met between the above color label of said two2>Sum1Condition time, to terminal screen perform amplifieroperation；
Sum is met between the above color label of said two2<Sum1Condition time, to terminal screen perform reduction operation；
In above formula, Sum1Represent the coordinate Zs of the above color label of said twoiFrom B become A time, the center of gravity of the external contact zone that the above color label of said two forms on a terminal screen is to the distance sum of the above color label coordinate points of said two；Sum2Represent the coordinate Zs of the above color label of said twoiFrom A become B time, the center of gravity of the external contact zone that the above color label of said two forms on a terminal screen is to the distance sum of the above color label coordinate points of said two。
12. method as claimed in claim 3, it is characterized in that, when the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, perform corresponding operation on a terminal screen, specifically include:
When terminal current operation status is discontinuous input pattern, and there is the coordinate Zs of two or more color labeliAll from B become A:
Poly is met between the above color label of said two2Relative to Poly1The anglec of rotation condition more than 0 time, perform to turn clockwise operation to terminal screen；
Poly is met between the above color label of said two2Relative to Poly1The anglec of rotation condition less than 0 time, terminal screen is performed rotation process counterclockwise；
In above formula, Poly1Represent the coordinate Zs of the above color label of said twoiFrom B become A time, the external contact zone that the above color label of said two forms on a terminal screen；Poly2Represent the coordinate Zs of the above color label of said twoiFrom A become B time, the external contact zone that the above color label of said two forms on a terminal screen。
13. a terminal, it is characterised in that including:
Monitoring modular, is used for the multiple color labels not in contact with terminal screen monitoring user's use respectively change in location before terminal camera；Each color label is distinguished by different colours；
Operation executing module, for when the change in location of described each color label meets and imposes a condition, according to the corresponding relation imposed a condition described in pre-setting and between each operation, performs corresponding operation on a terminal screen；
Described operation executing module, is additionally operable to judge whether described each color label meets following condition: | Ai1-Ai2|×|Pi1-Pi2| < Td；
If so, judge that this color label is shaken, ignore the change in location of its generation, and do not perform any operation on a terminal screen；
If it is not, judge that this color label is shaken, turn to whether the change in location judging this color label meets the step imposed a condition；
Wherein, ZsiRepresent i-th color label coordinate in terminal screen, described ZsiValue be A or B；Ai1Represent that i-th color label is at coordinate ZsiFrom B become A time the area of boundary rectangle, Ai2Represent that i-th color label is at coordinate ZsiFrom A become B time the area of boundary rectangle, Pi1Represent the coordinate Zs of i-th color labeliFrom B become A time time point, Pi2Represent the coordinate Zs of i-th color labeliFrom A become B time time point, Td represents the stabilization threshold value of setting, and wherein, the value of described i is not more than total number of the plurality of color label。
14. terminal as claimed in claim 13, it is characterised in that also include:
Identification module, for sending the instruction identifying color label；Wherein, described instruction instruction user moves each color label one by one, until photographic head photographs the appointment position that each color label moves on terminal screen；When the i-th color label shot by photographic head is positioned at described appointment position, it is determined that the color of described appointment position；The color of the described appointment position being determined by out, identifies described i-th color label。
15. terminal as claimed in claim 13, it is characterised in that described monitoring modular specifically includes:
First monitoring submodule, for monitoring i-th color label coordinate Zs in terminal screeni；
State determines submodule, is used for determining whether terminal current operation status is continuous input pattern；
Second monitoring submodule, being used in terminal current operation status is continuous input pattern, and as the coordinate Zs of described i-th color labeliFrom B become A time, start to continue to record by described i-th color label coordinate Xs in terminal screeniAnd YsiThe coordinate sequence Sp of compositioni, until the coordinate Zs of described i-th color labeliRecord is stopped when becoming B from A；
3rd monitoring submodule, being used in terminal current operation status is discontinuous input pattern, and the coordinate Zs of described i-th color labeliWhen changing, record described i-th color label current time coordinate Xs in terminal screeniAnd Ysi。
16. terminal as claimed in claim 15, it is characterised in that described operation executing module, specifically for being continuous input pattern in terminal current operation status, and meet as the coordinate Zs that there is i-th color label in each color labeliWhen becoming the condition of A from B, perform on a terminal screen to show described coordinate sequence SpiThe operation of point。
17. terminal as claimed in claim 15, it is characterised in that described operation executing module, specifically for being discontinuous input pattern in terminal current operation status, and there is the coordinate Zs of i-th color labeliFrom B become A, perform:
When the change in location of described color label meets | Xsi1-Xsi2| < Tc and | Ysi1-Ysi2| < during the condition of Tc, terminal screen is performed clicking operation；
When the change in location of described color label meets Xsi2-Xsi1<-Tm and | Xsi2-Xsi1|>|Ysi2-Ysi1| condition time, terminal screen is performed slide to the left；
When the change in location of described color label meets Xsi2-Xsi1> Tm and | Xsi2-Xsi1|>|Ysi2-Ysi1| condition time, terminal screen is performed slide to the right；
When the change in location of described color label meets Ysi2-Ysi1<-Tm and | Ysi2-Ysi1|>|Xsi2-Xsi1| condition time, to terminal screen perform upward sliding operation；
When the change in location of described color label meets Ysi2-Ysi1> Tm and | Ysi2-Ysi1|>|Xsi2-Xsi1| condition time, terminal screen is carried out slide downward operation；
In above formula, Xsi1And Ysi1Represent the coordinate Zs of described i-th color label respectivelyiFrom B become A time x-axis coordinate and y-axis coordinate, Xsi2And Ysi2Represent the coordinate Zs of described i-th color label respectivelyiFrom A become B time x-axis coordinate and y-axis coordinate, Tc represents the stabilization threshold value of the clicking operation of setting, and Tm represents the stabilization threshold value of the slide of setting。
18. terminal as claimed in claim 15, it is characterised in that described operation executing module, specifically for being discontinuous input pattern in terminal current operation status, and there is the coordinate Zs of two color labelsiFrom B become A:
Dis is met between said two color label2>Dis1Condition time, to terminal screen perform amplifieroperation；
Dis is met between said two color label2<Dis1Condition time, to terminal screen perform reduction operation；
In above formula, Dis1Represent the coordinate Zs of said two color labeliAll from B become A time, said two color label distance on a terminal screen；Dis2Represent the coordinate Zs of said two color labeliAll from A become B time, said two color label distance on a terminal screen；
Line is met between said two color label2Relative to Line1The anglec of rotation condition more than 0 time, perform to turn clockwise operation to terminal screen；
Line is met between said two color label2Relative to Line1The anglec of rotation condition less than 0 time, terminal screen is performed rotation process counterclockwise；
In above formula, Line1Represent the coordinate Zs of said two color labeliFrom B become A time, said two color label on a terminal screen be connected after formed straight line；Line2Represent the coordinate Zs of said two color labeliFrom A become B time, said two color label on a terminal screen be connected after formed straight line。
19. terminal as claimed in claim 15, it is characterised in that described operation executing module, specifically for being discontinuous input pattern when terminal current operation status, and there is the coordinate Zs of two or more color labeliAll from B become A:
Sum is met between the above color label of said two2>Sum1Condition time, to terminal screen perform amplifieroperation；
Sum is met between the above color label of said two2<Sum1Condition time, to terminal screen perform reduction operation；
In above formula, Sum1Represent the coordinate Zs of the above color label of said twoiFrom B become A time, the center of gravity of the external contact zone that the above color label of said two forms on a terminal screen is to the distance sum of the above color label coordinate points of said two；Sum2Represent the coordinate Zs of the above color label of said twoiFrom A become B time, the center of gravity of the external contact zone that the above color label of said two forms on a terminal screen is to the distance sum of the above color label coordinate points of said two；
When meeting following condition between the above color label of said two, perform to turn clockwise operation: Poly to terminal screen2Relative to Poly1The anglec of rotation more than 0；
When meeting following condition between the above color label of said two, terminal screen is performed rotation process counterclockwise: Poly2Relative to Poly1The anglec of rotation less than 0；
In above formula, Poly1Represent the coordinate Zs of the above color label of said twoiFrom B become A time, the external contact zone that the above color label of said two forms on a terminal screen；Poly2Represent the coordinate Zs of the above color label of said twoiFrom A become B time, the external contact zone that the above color label of said two forms on a terminal screen。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110247241.2A CN102955564B (en) | 2011-08-25 | 2011-08-25 | The operational approach of a kind of terminal and terminal |
| PCT/CN2012/080096 WO2013026364A1 (en) | 2011-08-25 | 2012-08-14 | Method for operating terminal and the terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110247241.2A CN102955564B (en) | 2011-08-25 | 2011-08-25 | The operational approach of a kind of terminal and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102955564A CN102955564A (en) | 2013-03-06 |
| CN102955564B true CN102955564B (en) | 2016-06-22 |
Family
ID=47745933
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110247241.2A Active CN102955564B (en) | 2011-08-25 | 2011-08-25 | The operational approach of a kind of terminal and terminal |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102955564B (en) |
| WO (1) | WO2013026364A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103631441B (en) * | 2013-12-03 | 2016-08-17 | 福建联迪商用设备有限公司 | The jamming-proof method and device of touch screen on electronic signature equipment |
| CN110621214A (en) * | 2017-02-01 | 2019-12-27 | 合意骨科有限公司 | System and method for monitoring physical therapy and rehabilitation using a user interface |
| CN109920079B (en) * | 2018-12-18 | 2021-03-23 | 国网浙江桐乡市供电有限公司 | Safety configuration data collection method for power equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1977238A (en) * | 2004-06-29 | 2007-06-06 | 皇家飞利浦电子股份有限公司 | Method and device for preventing staining of a display device |
| CN101581966A (en) * | 2008-05-16 | 2009-11-18 | 英业达股份有限公司 | Method and system for operating personal computer by utilizing action recognition |
| CN102135839A (en) * | 2010-01-22 | 2011-07-27 | 联想(北京)有限公司 | Terminal and input method thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8933892B2 (en) * | 2007-11-19 | 2015-01-13 | Cirque Corporation | Touchpad combined with a display and having proximity and touch sensing capabilities to enable different functions or interfaces to be displayed |
-
2011
- 2011-08-25 CN CN201110247241.2A patent/CN102955564B/en active Active
-
2012
- 2012-08-14 WO PCT/CN2012/080096 patent/WO2013026364A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1977238A (en) * | 2004-06-29 | 2007-06-06 | 皇家飞利浦电子股份有限公司 | Method and device for preventing staining of a display device |
| CN101581966A (en) * | 2008-05-16 | 2009-11-18 | 英业达股份有限公司 | Method and system for operating personal computer by utilizing action recognition |
| CN102135839A (en) * | 2010-01-22 | 2011-07-27 | 联想(北京)有限公司 | Terminal and input method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2013026364A1 (en) | 2013-02-28 |
| CN102955564A (en) | 2013-03-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104898952B (en) | A kind of terminal split screen implementation method and terminal | |
| CN103294366B (en) | A kind of screen unlock method and electronic equipment | |
| CN102667701B (en) | The method revising order in touch screen user interface | |
| CN102446032B (en) | Information input method and terminal based on camera | |
| CN104969163A (en) | Display method and device of application interface and electronic device | |
| CN110083278A (en) | Electronic equipment and its method | |
| CN100561414C (en) | A kind of portable terminal hand-written inputting method, device and portable terminal | |
| CN102855648B (en) | A kind of image processing method and device | |
| CN105190523A (en) | Method and apparatus for displaying user interface through sub device that is connectable with portable electronic device | |
| CN105653071A (en) | Information processing method and electronic device | |
| CN106775692B (en) | Component editing method and electronic equipment | |
| CN108845752A (en) | touch operation method, device, storage medium and electronic equipment | |
| JP2012018644A (en) | Information processor, information processing method and program | |
| CN102955564B (en) | The operational approach of a kind of terminal and terminal | |
| CN112148168A (en) | Icon moving method and device and electronic equipment | |
| KR20140141305A (en) | A mobile phone to separate screen and controlling method thereof | |
| CN106462352B (en) | A kind of processing method, device and the terminal of fingerprint event | |
| CN113703631A (en) | Writing control method and device, electronic equipment and storage medium | |
| CN104699535B (en) | A kind of information processing method and electronic equipment | |
| CN105824534A (en) | Information processing method and electronic equipment | |
| CN109085983A (en) | Method of controlling operation thereof, device, storage medium and electronic equipment | |
| CN103345454A (en) | Peripheral device connection method of mobile terminal | |
| CN113031817B (en) | Multi-touch gesture recognition method and false touch prevention method | |
| Lakshmi et al. | A novel air writing recognition system using Raspberry Pi for the control and interaction of digital systems | |
| CN112287708A (en) | Near Field Communication (NFC) analog card switching method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |