CN101526861B - Recognition of mouse gesture, and method for perfoming relevant order according to recognition results - Google Patents
Recognition of mouse gesture, and method for perfoming relevant order according to recognition results Download PDFInfo
- Publication number
- CN101526861B CN101526861B CN2008100266527A CN200810026652A CN101526861B CN 101526861 B CN101526861 B CN 101526861B CN 2008100266527 A CN2008100266527 A CN 2008100266527A CN 200810026652 A CN200810026652 A CN 200810026652A CN 101526861 B CN101526861 B CN 101526861B
- Authority
- CN
- China
- Prior art keywords
- mouse
- motion track
- line
- degree
- connecting line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a method for recognizing the mouse gesture and performing the corresponding instruction according to the recognition result. The method comprises following steps: step one, recording a moving track of the mouse; step two, calculating the distance of the moving track of the mouse, and if the distance is less than a set value, returning to perform the step one; step three, converting a rectangular coordinate of the moving track of the mouse into a polar coordinate, differentiating and classifying an angle of the track polar coordinate as one of eight areas, and performing corresponding settable instructions; and step four, removing the record of the moving track of the mouse or performing the step one after the moving track of the mouse is subtracted from the set value, wherein the eight areas are at the degrees of N*4522.5, and N is selected from 0, 1, 2, 3, 4, 5, 6 and 7. The mouse has the advantages that the moving track of the mouse is identified by using the rectangular coordinate and the polar coordinate, the identifying accuracy is improved, and the operation gesture characteristics of a user on operating the mouse can continuously or discontinuously perform the corresponding set instructions.
Description
Technical field
The present invention relates to a kind of identification of mouse gestures and carry out the method for corresponding instruction, can remove to carry out corresponding setting command according to the operating gesture characteristic that the user operates mouse according to recognition result.
Background technology
At present, mouse gestures (Mouse Gestures) is as a kind of mouse enhancement function, more and more widely is applied in the Internet-browser improving the service efficiency of browser, and the trend in expanding application other softwares in the computer operating system is arranged.Like StrokeIt mouse gestures software, Avantfind mouse gestures plug-in unit, Opera mouse gestures software, red fox (Firefox) mouse gestures plug-in unit, the TT of Tengxun gesture software etc. the mouse gestures subsidiary function is provided all.The operation of those mouse gestures is substantially as follows: after pressing a certain button (being generally right mouse button) of mouse, pull and unclamp button after mouse marks certain particular track, program can be carried out corresponding instruction manipulation after promptly discerning this particular track.
And for example Chinese invention patent open source literature CN1790262A discloses a kind of method of the operation of computer software being controlled based on mouse track data; This method system is through starting a mouse movement subroutine; Catch the movable information of mouse and write down the motion trace data of said mouse by this mouse movement subroutine; Up to this mouse stop motion; Movement locus sample with said motion trace data and self storage compares then, if be complementary, then said mouse movement subroutine is sent to host process and carried out the operational order that is associated with this movement locus sample; If be not complementary, then seizure is carried out in continuation, recording step is closed up to the mouse movement subroutine.
Yet because the restriction of mouse motion track design accuracy, and computing machine still remains to be improved to the accuracy of mouse track identification, and therefore, present mouse gestures is also fairly simple; Again, present mouse gestures function all is merely instruction manipulation of the corresponding execution of a mouse motion track, is unfavorable for further enlarging its range of application.
Summary of the invention
One object of the present invention is to the problems referred to above, provides a kind of and can operate the method that the operating gesture characteristic of mouse removes to carry out continuously corresponding setting command according to the user.
Another object of the present invention is to provide a kind of can operate the method that the operating gesture characteristic of mouse is removed the corresponding setting command of discontinuous execution according to the user.
For reaching first purpose of the present invention, technical scheme of the present invention is following: a kind of identification of mouse gestures is also carried out the method for corresponding instruction according to recognition result, is made up of following steps:
Step 1, record mouse motion track;
Step 2, computing mouse motion track distance are if this distance is then returned execution in step one less than a setting value;
Step 3, with mouse motion track rectangular coordinate convert to polar coordinates and with the angle of these track polar coordinates distinguish belong to into eight zones of polar coordinates one of them; But and carry out corresponding setting command; Wherein, These eight zones are that N takes advantage of 45 degree plus-minuss, 22.5 degree, and N takes from 0,1,2,3,4,5,6 and 7;
After the record of step 4, the record of removing this mouse motion track or this mouse motion track deducts above-mentioned setting value, execution in step one.
Further, can and close step through button trigger event startup.This button trigger event can be from arbitrary mousebutton or arbitrary keyboard.
For reaching another object of the present invention, technical scheme of the present invention is following: a kind of identification of mouse gestures is also carried out the method for corresponding instruction according to recognition result, is to utilize a mousebutton, is made up of following steps:
Step 1, this button arrive step 4 otherwise execution in step five by next execution in step two;
Step 2: record mouse motion track;
Step 3, computing mouse motion track distance are if this distance is less than setting value execution in step one then;
Step 5, according to this in proper order buffer contents carry out corresponding setting command;
For the mouse motion track described in above-mentioned two technical schemes; The present invention system lets it be based upon on the polar coordinate system; And it is defined: this mouse motion track can be a line, and this line comprises the integral multiple that an a starting point and a terminating point and angle are 45 degree; Or can be connected to form successively by at least two lines, each bar line all comprise integral multiple that an a starting point and a terminating point and angle be 45 degree, and the terminating point of last line overlap with the starting point of a back line.
When the mouse motion track is a line; The characteristic of this line can contain ↑, ↓, ←, →, in
and
any; Wherein this arrow is represented the terminating point of motion track, and another end points is represented the starting point of motion track.Further, a said line can contain two lines back and forth.
When the mouse motion track is connected with second connecting line when forming by first connecting line; This two link to each other wiring characteristic can to contain
or
or the two wire clamp angle that is connected be 45 degree, 90 degree, 135 degree or 180 degree; (as shown in Figure 5); Wherein the terminating point of second connecting line is represented the terminating point of motion track, and the starting point of first connecting line is represented the starting point of motion track.Further, the line characteristic of the terminating point of first connecting line in the two continuous wiring contains two lines back and forth.
When the mouse motion track is connected when forming by first connecting line, second connecting line and the 3rd connecting line successively; The characteristic of this three-phase connecting line can be as shown in Figure 6 but be not limited to form shown in Figure 6; The terminating point of the 3rd connecting line is represented the terminating point of motion track, and the starting point of this first connecting line is represented the starting point of motion track.
The length of above-mentioned each line is confirmed by modifiable setting value, can set the setting value of each line of forming the mouse track distance arbitrarily, makes the personalized requirement that in using the mouse gestures process, can satisfy the user.
The described step of above-mentioned two technical schemes is executed in mouse, or computing machine.
Beneficial effect of the present invention is to utilize rectangular coordinate system and polar coordinate system to come the mouse motion track is carried out identification, has improved the identification accuracy, and then can remove the corresponding setting command of continuous or discontinuous execution according to the operating gesture characteristic that the user operates mouse.
For enabling further to understand technical characterictic of the present invention and technology contents, see also following about embodiment of the present invention and accompanying drawing, yet appended graphic only provide reference and the explanation usefulness, be not to be used for the present invention is limited.
Description of drawings
Fig. 1 is that polar angular regions according to the invention is divided synoptic diagram;
Fig. 2 is the process flow diagram of the embodiment of the invention 1 said continuous mode;
Fig. 3 is the process flow diagram of the embodiment of the invention 2 said non-continuous modes;
Fig. 4 is the synoptic diagram that mouse motion track according to the invention is a line;
Fig. 5 is the synoptic diagram that mouse motion track according to the invention is two lines;
Fig. 6 is the synoptic diagram that mouse motion track according to the invention is three lines.
Embodiment
At first, be that the characteristic of mouse motion track is carried out like delimit to implementing mouse gestures of the present invention: be based upon on the polar coordinate system; This mouse motion track is a line, and this line comprises the integral multiple that an a starting point and a terminating point and angle are 45 degree; Or be connected to form successively by at least two lines; Each bar line all comprise integral multiple that an a starting point and a terminating point and angle be 45 degree, and the terminating point of last line overlap with the starting point of a back line; Article one, the starting point of line is the starting point of mouse motion track, and the terminating point of the last item line is the terminating point of mouse motion track.Because the actual mouse motion track that pulls out of user possibly perfection obtain straight line or integral multiple 45 degree angle lines hardly, is arc etc. like arc, sweep and angle, therefore, the present invention has carried out area dividing to the angle of polar coordinate system, and is as shown in Figure 1.
In O-X polar coordinate system shown in Figure 1; Take advantage of 45 degree plus-minuss, 22.5 degree (N takes from 0,1,2,3,4,5,6 and 7) to mark off 0 degree, 45 degree, 90 degree, 135 degree, 180 degree, 225 degree, 270 degree and 315 degree totally eight angular regions by N; The angle of a line of the track that meaning is promptly pulled out as the user (like 10 degree) is for falling into a certain angular regions (regional like 0 degree); Then the angle of this line should be the expressed angle of this angular regions (promptly 0 spends but not 10 degree); So, then can correct the track angle offset issue in the actual use.And the starting point of each mouse motion track should overlap with limit O, and meaning is that starting point is regarded as limit O.
As shown in Figures 2 and 3, for the present invention is based on the process flow diagram of the corresponding command function of the continuous or discontinuous execution of mouse motion track, accomplish execution in step of the present invention according to this two process flow diagram gesture feature identification program of can writing.This gesture feature identification program can form the mouse gestures device or can under main device operation system, carry out in mouse apparatus; The user can call out this gesture feature identification program through trigger event; Be positioned on the mouse or the startup function key of keyboard as one, this enabling signal is called out and is carried out gesture feature identification program, and this gesture feature identification program contains the function of setting; It is any button on mouse or the keyboard that the user can set this trigger event; The user also can set trigger event carry out the classification of corresponding set of options function be single or continuously identification carry out, the user can set the function of mousebutton set of options, promptly different mousebutton same gesture characteristic and carry out different corresponding set of options functions; The user can preestablish the displacement that its mouse moves gesture feature; Be distance, carry out and set this displacement continuously hour when trigger event is set at one, the user can carry out the user easily fast and set corresponding function; Like mouse quadruple linkage upper right corner direction setting is that enlarging function, quadruple linkage lower left corner direction setting are reduction capability; Then the user presses the mouse quadruple linkage upper right corner and moves mouse and then accomplish and amplify or enlarging function continuously, presses the mouse quadruple linkage lower left corner and moves mouse and then accomplish and dwindle or reduction capability continuously, and promptly vector 45 degree gesture feature function settings are enlarging function; The gesture feature identification program is executed in main device operation system or mouse gestures device; When trigger event mouse quadruple linkage is that true time begins to levy and distinguishes the mouse displacement characteristic, when displacement characteristic met, the gesture feature identification program was then seen rolling code on ctrl key and the mouse roller of keyboard off and is reached above-mentioned enlarging function.The present invention also provides a setting interface; And the user can see through the corresponding function of this interface setting button and gesture feature easily; Its function such as multimedia key, document treatment combination key, records handling combination, document editing and processing Macintosh, network browsing key or can be the user and make up any mouse and keyboard key; The user is rolling mouse and carry out the function of corresponding set of options fast easily; One track shows that can point out this gesture feature identification program of user is in commission, shows track during like above-mentioned continuous enlarging function rolling mouse, when the identification gesture feature is that true time is then removed and shown that track sees rolling code on ctrl key and the mouse roller of keyboard simultaneously off; When the user continues rolling mouse, then repeat above-mentioned action, decontrol the mouse quadruple linkage up to the user.
Embodiment 1
At first, suppose that needs amplify the mouse gestures operation of a picture continuously, the mouse gestures of a picture of this amplification is characterized as: Dist=20 pixel of shift length setting value, angle are 45 degree.Opening as the operator under the state of picture browsing program; Press the mouse quadruple linkage of trigger event; Then to upper right side (promptly) towing mouse; Have a track display reminding user this moment, and after mouse had moved 20 pixels (fastening through simple relatively X and Y displacement size and positive and negative acquisition displacement at rectangular coordinate), the instruction of last rolling code of promptly exporting ctrl key and the mouse roller of a keyboard made the picture amplification once; If unclamp the mouse quadruple linkage after the operator continues to move 40 pixels continuously, then picture will amplify twice and finish the mouse gestures execution in step more continuously.
With reference to a Line Mouse motion track pattern as shown in Figure 4; Can realize carrying out continuously the pairing execution command of mouse gestures through any setting shift length setting value; Like the continuous amplification of the moving forward and backward continuously of webpage in the browser, picture with dwindle the continuous opening and closing with application program; The continuous increase of sound or dwindle, or the like.
Embodiment 2
Discontinuous operator scheme of the present invention is following: suppose that the user need open a computer program (like music player) and carry out a certain function (like the playing function of music player) of this computer program; Then the user can be with reference to two Line Mouse motion track patterns as shown in Figure 5, through the corresponding execution function of each bar line is set: set mouse to left (vector is 180 degree) for opening music player; Set on the mouse and move (vector is 90 degree) for starting the playing function of music player; Setting the mouse quadruple linkage is trigger event.Then when the user press the mouse quadruple linkage and pull that mouse is moved to the left and move up again after unclamp the mouse quadruple linkage, then playing function will opened and start to music player automatically.
Certainly; Also can come 3 difference in functionalitys of the corresponding execution of a mouse motion track are set with reference to three Line Mouse motion track patterns as shown in Figure 6; This three-phase connecting line is connected successively and is formed by first connecting line, second connecting line and the 3rd the connecting line connecting line of arrow (promptly with); The terminating point of the 3rd connecting line is represented the terminating point of motion track, and the starting point of this first connecting line is represented the starting point of motion track.The enforcement principle of its gesture no longer repeats with above-mentioned examples of implementation.
The above is merely the part specific embodiment that the present invention can realize, right creation spirit of the present invention is not limited thereto, and anyly is familiar with this art in field according to the invention, can think easily and variation or modification.Like the shape of holding and rectifying within the gesture feature symbol; But the Macintosh application combination of its correspondence adding SHIFT, CTRL, the variation of ALT key and the button prompting of pressing, decontroling such as symbol distortion, auditory tone cues or the like all can be encompassed within the scope of patent protection of the present invention.
Claims (12)
1. the identification of a mouse gestures and carry out the method for corresponding instruction according to recognition result is characterized in that, is made up of following steps:
Step 1, record mouse motion track;
Step 2, computing mouse motion track distance are if this distance is then returned execution in step one less than a setting value;
Step 3, with mouse motion track rectangular coordinate convert to polar coordinates and with the angle of these track polar coordinates distinguish belong to into eight zones of polar coordinates one of them; But and carry out corresponding setting command; Wherein, These eight zones are that N takes advantage of 45 degree plus-minuss, 22.5 degree, and N takes from 0,1,2,3,4,5,6 and 7;
After the record of step 4, the record of removing this mouse motion track or this mouse motion track deducts above-mentioned setting value, execution in step one.
2. method according to claim 1 is characterized in that, starts and closes step through a button trigger event.
3. the identification of a mouse gestures and carry out the method for corresponding instruction according to recognition result is to utilize a mousebutton, it is characterized in that, is made up of following steps:
Step 1, this button arrive step 4 otherwise execution in step five by next execution in step two;
Step 2: record mouse motion track;
Step 3, computing mouse motion track distance are if this distance is less than setting value execution in step one then;
Step 4, with mouse motion track rectangular coordinate convert to polar coordinates and with the angle of these track polar coordinates distinguish belong to into eight zones of polar coordinates one of them; And this numerical value is stored into a buffer zone (Buffer) in proper order; And the record of mouse motion track deducts above-mentioned setting value; These eight zones are that N takes advantage of 45 degree plus-minuss, 22.5 degree, and N takes from 0,1,2,3,4,5,6 and 7;
Step 5, according to this in proper order buffer contents carry out corresponding setting command;
Step 6, the record of removing this mouse motion track and buffer zone in proper order, execution in step one.
4. according to the arbitrary described method of claim 1 to 3, it is characterized in that said mouse motion track is a line, this line comprises the integral multiple that an a starting point and a terminating point and angle are 45 degree; Or be connected to form successively by at least two lines, each bar line all comprise integral multiple that an a starting point and a terminating point and angle be 45 degree, and the terminating point of last line overlap with the starting point of a back line.
6. method according to claim 4 is characterized in that, a said line contains two lines back and forth.
7. method according to claim 4; It is characterized in that; Said mouse motion track is connected with second connecting line by first connecting line and forms; The characteristic of these two continuous wiring contains
or
; Or two be connected the wire clamp angle be 45 the degree, 90 the degree, 135 the degree or 180 the degree; Wherein the terminating point of second connecting line is represented the terminating point of motion track, and the starting point of first connecting line is represented the starting point of motion track.
8. method according to claim 7 is characterized in that, the line characteristic of the terminating point of first connecting line in the said two continuous wiring contains two lines back and forth.
9. method according to claim 4; It is characterized in that; Said mouse motion track is connected successively with the 3rd connecting line by first connecting line, second connecting line and forms; The terminating point of the 3rd connecting line is represented the terminating point of motion track, and the starting point of this first connecting line is represented the starting point of motion track.
10. according to the arbitrary described method of claim 4 to 9, it is characterized in that the length of said each line is confirmed by modifiable setting value.
11., it is characterized in that said button is arbitrary button of mouse according to claim 2 or 3 described methods.
12. according to claim 1 or 3 described methods, it is characterized in that, said step be executed in mouse or computing machine.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2008100266527A CN101526861B (en) | 2008-03-06 | 2008-03-06 | Recognition of mouse gesture, and method for perfoming relevant order according to recognition results |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2008100266527A CN101526861B (en) | 2008-03-06 | 2008-03-06 | Recognition of mouse gesture, and method for perfoming relevant order according to recognition results |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101526861A CN101526861A (en) | 2009-09-09 |
CN101526861B true CN101526861B (en) | 2012-01-18 |
Family
ID=41094741
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2008100266527A Expired - Fee Related CN101526861B (en) | 2008-03-06 | 2008-03-06 | Recognition of mouse gesture, and method for perfoming relevant order according to recognition results |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101526861B (en) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101739173A (en) * | 2009-12-11 | 2010-06-16 | 北京洲洋伟业信息技术有限公司 | Method for sensing mouse action by combining movement locus identification |
CN101825960B (en) * | 2010-04-23 | 2012-07-18 | 潘天华 | Method for realizing computer function control based on three-point state information of mouse |
CN102402361B (en) * | 2010-09-08 | 2015-08-12 | 腾讯科技(深圳)有限公司 | Motion track based on mouse carries out the method and apparatus controlled on computers |
TW201227393A (en) * | 2010-12-31 | 2012-07-01 | Acer Inc | Method for unlocking screen and executing application program |
CN102955562A (en) * | 2011-08-22 | 2013-03-06 | 幻音科技(深圳)有限公司 | Input method and input system |
CN102662581B (en) * | 2012-03-31 | 2015-06-24 | 北京奇虎科技有限公司 | Method and system for performing control by mouse input |
CN104731935B (en) * | 2012-03-31 | 2019-07-26 | 北京奇虎科技有限公司 | The method and system controlled are inputted with mouse |
CN103577495B (en) * | 2012-08-09 | 2019-02-26 | 腾讯科技(深圳)有限公司 | The gesture operation method and device of browser |
JP5590511B2 (en) * | 2012-09-19 | 2014-09-17 | カシオ計算機株式会社 | FUNCTION DRIVE DEVICE, FUNCTION DRIVE METHOD, AND FUNCTION DRIVE PROGRAM |
CN102902483B (en) * | 2012-09-29 | 2015-04-29 | 广东欧珀移动通信有限公司 | Sliding touch method of touch screen |
CN106325702B (en) * | 2015-07-08 | 2021-01-08 | 腾讯科技(深圳)有限公司 | Method and device for recognizing mouse gestures |
CN108681409B (en) * | 2018-04-09 | 2021-06-18 | 金陵科技学院 | Method for calculating motion track of mouse |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006228126A (en) * | 2005-02-21 | 2006-08-31 | Canon Inc | Image processing device |
CN101408824A (en) * | 2008-11-18 | 2009-04-15 | 广东威创视讯科技股份有限公司 | Method for recognizing mouse gesticulation |
-
2008
- 2008-03-06 CN CN2008100266527A patent/CN101526861B/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006228126A (en) * | 2005-02-21 | 2006-08-31 | Canon Inc | Image processing device |
CN101408824A (en) * | 2008-11-18 | 2009-04-15 | 广东威创视讯科技股份有限公司 | Method for recognizing mouse gesticulation |
Non-Patent Citations (1)
Title |
---|
曾灿升.指点江山若等闲 用StrokeIt鼠标手势指挥系统.《电脑爱好者》.2006,(第14期),34-35. * |
Also Published As
Publication number | Publication date |
---|---|
CN101526861A (en) | 2009-09-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101526861B (en) | Recognition of mouse gesture, and method for perfoming relevant order according to recognition results | |
JP2022062064A (en) | Real-time handwriting recognition management | |
EP2941756B1 (en) | Rendering augmented reality based on foreground object | |
JP6007497B2 (en) | Image projection apparatus, image projection control apparatus, and program | |
US6029214A (en) | Input tablet system with user programmable absolute coordinate mode and relative coordinate mode segments | |
EP2306270B1 (en) | Character input method and system | |
CA2501118A1 (en) | Method of combining data entry of handwritten symbols with displayed character data | |
US20120200540A1 (en) | Utilization of temporal and spatial parameters to enhance the writing capability of an electronic device | |
CN102053768A (en) | Device and method for realizing character editing on touch equipment | |
CN101833413A (en) | Signal conditioning package, animation method and program | |
CN104657062A (en) | Graph editing method and electronic device | |
CN105144033A (en) | Extending interactive inputs via sensor fusion | |
TW201303788A (en) | Image segmentation methods and image segmentation methods systems | |
EP2770443B1 (en) | Method and apparatus for making contents through writing input on touch screen | |
KR102373021B1 (en) | Global special effect conversion method, conversion device, terminal equipment and storage medium | |
CN104850264B (en) | The detection control method and system of diversified gesture operation on a kind of Trackpad | |
CN109074224A (en) | For the method for insertion character and corresponding digital device in character string | |
CN104932828A (en) | Information processing method and electronic equipment | |
US20170249505A1 (en) | Method and system for character insertion in a character string | |
WO2004097722A1 (en) | Hand-written character input device and hand-written character input processing method | |
EP2965181B1 (en) | Enhanced canvas environments | |
TW201317843A (en) | Virtual mouse driving apparatus and virtual mouse simulation method | |
US7742095B2 (en) | Information processing apparatus, method and storage medium | |
Zhang et al. | A virtual keyboard implementation based on finger recognition | |
Yin et al. | CamK: Camera-based keystroke detection and localization for small mobile devices |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C17 | Cessation of patent right | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120118 Termination date: 20130306 |