CN104317390A - Method and system for replacing mouse operation by multiple gestures based on virtual machine of mobile terminal - Google Patents
Method and system for replacing mouse operation by multiple gestures based on virtual machine of mobile terminal Download PDFInfo
- Publication number
- CN104317390A CN104317390A CN201410494173.3A CN201410494173A CN104317390A CN 104317390 A CN104317390 A CN 104317390A CN 201410494173 A CN201410494173 A CN 201410494173A CN 104317390 A CN104317390 A CN 104317390A
- Authority
- CN
- China
- Prior art keywords
- screen
- mobile client
- gesture
- virtual machine
- mouse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Abstract
The invention discloses a method and a system for replacing mouse operation by multiple gestures based on a virtual machine of a mobile terminal and relates to the field of virtual machines. The method comprises the following steps of 1, capturing gesture operation by using a mobile client; 2, judging whether the gesture operation accords with a gesture event, if so, entering a step 3, and if not, displaying the current page; 3, acquiring corresponding mouse operation according to the gesture event and positioning a coordinate of the generated mouse operation according to a coordinate of the generated gesture operation; 4, sending the mouse operation and the coordinate to a background server; 5, sending the received data to the virtual machine of the mobile client by using the background server; 6, executing operation by using the virtual machine of the mobile client according to the received data, and sending the operating process and a result to the background server in real time; 7, displaying the real-time operating process and result sent by the background server on the current page by using the mobile client. The method and the system solve the problem of poor user experience effect of the mouse operation on the virtual machine of the mobile client in the prior art.
Description
Technical field
The present invention relates to virtual machine field, particularly relate to one and substitute mouse operation method and system based on the many gestures of mobile terminal virtual machine.
Background technology
System on mobile device, as Android, IOS do not need external mouse, and realize operation in touch screen mode, all operations of such mouse needs to use many gestures or other modes to substitute.
Certainly also can demonstrate mouse icon in the virtual machine in mobile client to go forward side by side line operate, but so mutual very inconvenient, be also not suitable with the operating habit of mobile client.So need new method to substitute the operation of mouse.
Mouse action mode on present mobile client virtual machine is mainly divided into three kinds:
(1), by providing several button to select mouse action mode; Button is used to select mouse action, although seem convenient, more directly perceived, but adopt a lot of buttons, a lot of places of mobile client virtual machine desktop can be taken, shelter from the DESKTOP INFORMATION that some are very crucial sometimes, this method can bring Consumer's Experience weak effect, in addition, because do not utilize the contact action of mobile device, the operating habit of current mobile device user is not met yet;
(2), dummy machine system inside directly shows mouse, and coordinate gesture to operate, this display aspect is closer to true computer system; But when user needs to carry out a certain mouse action in certain position, need first by mouse drag to ad-hoc location, then carrying out specific mouse action, can not accomplish that mouse catches rapidly mouse action position along with the operating position of user, the Consumer's Experience weak effect of this method;
(3), not show mouse, use many gestures to substitute mouse action completely;
Do not show mouse, use many gestures to substitute mouse action completely, also the technical scheme of this patent just.The defect of above two kinds of technical schemes can be solved well.First, the program takes full advantage of the touch screen event of mobile device, and adopts the gesture modeling scheme close to true mouse action, meets the operating habit of user.In addition, user is without the need to dragging mouse, and only need wanting the position of carrying out mouse action directly to carry out mouse action, virtual machine will respond mouse action, accomplishes convenient and swift veritably.
Summary of the invention
The object of the present invention is to provide one to substitute mouse operation method and system based on the many gestures of mobile terminal virtual machine, thus solve the foregoing problems existed in prior art.
To achieve these goals, the technical solution used in the present invention is as follows:
One substitutes mouse operation method based on the many gestures of mobile terminal virtual machine, and the method comprises the following steps:
S1, mobile client catch the gesture operation data of user at current page;
S2, according to described data, judge whether described gesture operation meets gesture event, if met, enter S3, if do not met, display current page;
S3, mobile client obtain corresponding mouse action according to described gesture event, and according to the coordinate setting that described gesture operation occurs, the coordinate of described mouse action occur;
Corresponding mouse action and coordinate that described mouse action occurs are sent to background server with data mode by S4, mobile client;
The data received are sent to mobile client virtual machine by S5, background server;
The data that S6, described mobile client virtual machine foundation receives, executable operations, and operating process and operating result are sent to background server in real time;
The described true-time operation process received and operating result are passed to described mobile client by S7, background server, and described mobile client will receive true-time operation process and operating result is presented on current page.
Preferably, before step S1, there is mobile client setting gesture event, the step of described gesture event analog mouse operation, concrete steps are as follows:
S1-1, when user is single give directions hit any one position of mobile client screen time, mobile client determination mouse moves to this position;
The corresponding operating of S1-2, setting gesture event analog mouse, by the left button single-click operation singly referring to the gesture event analog mouse clicking screen; With the left double click operation singly referring to the gesture event analog mouse double-clicking screen; The right-click operation of the gesture event analog mouse of screen is pressed with Dan Zhichang; Drag operation is pinned with the left button of the gesture event analog mouse singly referring to translation screen; With the drag operation of gesture event analog mouse singly referring to slip screen; By two zoom operations referring to the gesture event simulated screen of mediating screen; With the operation of the gesture event simulation translation screen of two finger translation screen.
Preferably, in step S2, judge that the criterion whether described gesture operation meets described gesture event is:
1., judge whether described gesture operation is the gesture event singly referring to click screen, if singly refer to that the time touching touch screen point is less than 1s, then confirm that described gesture operation is the gesture event singly referring to click screen; Otherwise, then confirm that described gesture operation is the gesture event of Dan Zhichang by screen;
2., judge whether described gesture operation is the gesture event singly referring to double-click screen, the touch screen point that first time clicks screen is no more than 20 pixels with the distance clicking the touch screen point of screen for the second time, and the time interval of described twice single-click operation is less than 0.5 second, then confirm that described gesture operation is the gesture event singly referring to double-click screen; Otherwise, confirm that described gesture operation is the gesture event singly referring to click screen for twice;
3., judge whether described gesture operation is the gesture event of Dan Zhichang by screen, singly refer to that the touch screen point touched is constant, and be greater than 1s to touching the time terminated from touching, then confirm that described gesture operation is the gesture event of Dan Zhichang by screen; Otherwise, confirm that described gesture operation is the gesture event singly referring to click screen;
4., judge whether described gesture operation is the gesture event singly referring to translation screen, if singly refer to that the time touching touch screen point is less than 1s, and the starting point of touch screen is different from the terminal of touch screen, then confirm that described gesture operation is the gesture event singly referring to translation screen; Otherwise, confirm that described gesture operation is the gesture event singly referring to click screen;
5., judge whether described gesture operation is the gesture event singly referring to slip screen, to singly referring to slip EOS from singly referring to slip screen, if singly refer to that the Y-coordinate of the touch screen point of slip EOS is greater than the Y-coordinate singly referring to the touch screen point that slip screen starts, then confirm that described gesture operation is the gesture operation of the slide downward page; If singly refer to that the Y-coordinate of the touch screen point of slip EOS is less than the Y-coordinate singly referring to the touch screen point that slip screen starts, then confirm describedly singly to refer to that slip screen is the gesture operation of the upward sliding page;
6., judge whether described gesture operation is two gesture event referring to mediate screen, when two finger touch screen, calculate the distance S that two refer to the touch screen point be positioned on screen, refer in moving process two, if two refer to that the distance of the touch screen point be positioned on screen changes, and the distance value changed is greater than S, then confirm that described gesture operation is two gesture event referring to mediate; Otherwise, then confirm that described gesture operation is two gesture event referring to translation.
Preferably, in step S3, there is the coordinate of described mouse action in location according to the coordinate of the described gesture operation of generation, specifically realizes as follows:
S3-1, obtain the coordinate of described gesture operation on mobile client screen;
S3-2, the resolution ratio of described coordinate by the screen of the described mobile client virtual machine page and mobile client to be mapped on the virtual machine page, to obtain the coordinate of described mouse action on the described virtual machine page;
Preferably, before step S3-1, there are following steps:
Mobile client obtains the resolution of the mobile client virtual machine page, then according to the resolution of the screen of described mobile client, obtain the resolution ratio of the screen of the described mobile client virtual machine page and mobile client, the described mobile client virtual machine page is pressed the resolution Zoom display of the screen of described mobile client on described mobile client screen.
Preferably, in step S4, the coordinate of corresponding mouse action and the described mouse action of generation is first packaged into packet by described mobile client, and then by described Packet Generation to background server.
Preferably, in step S4, described mobile client is communicated by RDP with background server.
Preferably, in step S6, described mobile client virtual machine is to the processing data packets received, and concrete grammar is:
After the packet received decompresses by described mobile client virtual machine, obtain described mouse action and the coordinate of described mouse action occurs, according to described mouse action and the coordinate that described mouse action occurs, executable operations, and in real time operating process and operating result are sent to background server.
One substitutes mouse action system based on the many gestures of mobile terminal virtual machine, and described system comprises: background server, mobile client and mobile client virtual machine; Described mobile client is communicated by RDP with described background server, and described mobile client virtual machine is communicated by virtual device interface with described background server;
Described background server, be responsible for the data that the described mobile client of reception sends over, and described data are sent to described mobile client virtual machine, simultaneously, the operating process that the described mobile client virtual machine of responsible reception sends over and operating result data, and described operating process and operating result data are passed to described mobile client;
Described mobile client comprises: gesture setup unit, seizure judging unit, data cell and display unit; Described gesture setup unit, is responsible for setting gesture event and simulates corresponding mouse action; Described seizure judging unit, is responsible for the gesture operation be captured on mobile client screen and also judges whether the gesture operation of catching meets gesture event; Described data cell, is responsible for the data storing described mobile client and the transmission of described background server; Described display unit, is responsible for the data received in display data cell;
Described mobile client virtual machine comprises: data cell, data processing unit and performance element;
Described data cell, is responsible for storing the data of described mobile client virtual machine and the transmission of described background server and the data of described mobile client virtual machine executable operations; Described data processing unit, is responsible for processing the data received in data cell; Performance element, according to the result of data processing unit, performs corresponding operating, and operating process and operating result is sent to data cell.
The invention has the beneficial effects as follows:
Present invention achieves a kind of harmonized programme goes the many gestures of use realized in mobile client virtual machine to substitute mouse all operations, be independent of VME operating system on method, do not need to do adaptation according to virtual machine, any content provided in VME operating system is not provided yet.
The present invention takes full advantage of the touch screen event of mobile device, meets the use habit of user.Owing to adopting the scheme without mouse display, user also without the need on screen dry first by mouse drag to the position wanting to operate, only need carry out mouse action wanting the position of operation, bringing to user very large easy to use.
Accompanying drawing explanation
Fig. 1 is the process flow diagram substituting the method for mouse action based on the many gestures of mobile terminal virtual machine;
Fig. 2 is the schematic diagram substituting the system of mouse action based on the many gestures of mobile terminal virtual machine.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with accompanying drawing, the present invention is further elaborated.Should be appreciated that embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
With reference to Fig. 1, embodiment 1, one substitutes mouse operation method based on the many gestures of mobile terminal virtual machine, comprises the following steps:
S1, mobile client catch the gesture operation of user at current page;
S2, judge whether described gesture operation meets gesture event, if met, enter S3, if do not met, display current page;
S3, mobile client obtain corresponding mouse action according to described gesture event, and according to the coordinate setting that described gesture operation occurs, the coordinate of described mouse action occur;
There is the coordinate of described mouse action in described location, specifically realizes as follows:
S3-1, obtain the coordinate of described gesture operation on mobile client screen;
S3-2, the resolution ratio of described coordinate by the screen of the described mobile client virtual machine page and mobile client to be mapped on the virtual machine page, to obtain the coordinate of described mouse action on the described virtual machine page;
S4, communicated by RDP, corresponding mouse action and coordinate that described mouse action occurs are sent to background server by mobile client;
The coordinate of corresponding mouse action and the described mouse action of generation is first packaged into packet by described mobile client, and then by described Packet Generation to background server
S5, by virtual device interface, the data received are sent to mobile client virtual machine by background server;
S6, described mobile client virtual machine are according to the data received, and executable operations, then by true-time operation process and result, sends to background server by virtual device interface;
Described mobile client virtual machine is to the processing data packets received, and concrete grammar is:
After the packet received decompresses by described mobile client virtual machine, obtain described mouse action and the coordinate of described mouse action occurs, according to described mouse action and the coordinate that described mouse action occurs, executable operations, and the process of executable operations and execution result are sent to background server in real time;
S7, background server by described true-time operation process and result, are communicated by RDP again, pass to described mobile client, and the result receiving executable operations is presented on current page by described mobile client.
Wherein, before step S1, there is mobile client setting gesture event, described gesture event analog mouse operation, concrete operations are:
S1-1, when user is single give directions hit any one position of mobile client screen time, mobile client determination mouse moves to this position;
The corresponding operating of S1-2, setting gesture event analog mouse;
Wherein, by the single-click operation singly referring to the gesture event analog mouse clicking screen; With the left double click operation singly referring to the gesture event analog mouse double-clicking screen; The right button operation of the gesture event analog mouse of screen is pressed with Dan Zhichang; Drag operation is pinned with the left button of the gesture event analog mouse singly referring to translation screen; With the drag operation of event simulation mouse singly referring to slip screen; By two zoom operations referring to the gesture event simulated screen of mediating screen; With the operation of the gesture event simulation translation screen of two finger translation screen.
In embodiments, mobile client catches user at the gesture operation of current page is singly refer to double-click the chat software icon on mobile client screen.
Present embodiment, in step S2, described gesture operation double-clicks screen for singly referring to, the touch screen point that first time clicks screen is no more than 20 pixels with the distance clicking the touch screen point of screen for the second time, and the time interval of described twice single-click operation is less than 0.5 second, then confirm described singly refer to double-click screen operator be singly refer to double-click gesture event, then perform start described chat software.Described mobile client shows the start-up course of described chat software and starts result.
In the present embodiment step S3, described gesture operation occurs on mobile client screen, and the coordinate of described gesture operation is the coordinate of described gesture operation touch point on mobile client screen; Described mouse action occurs on the mobile virtual machine page, and the coordinate of described mouse action is the coordinate of described mouse action touch point on the mobile client virtual machine page.
In the present embodiment step S3, before step S3-1, there are following steps:
Mobile client obtains the resolution of the mobile client virtual machine page, then according to the resolution of the screen of described mobile client, obtain the resolution ratio of the screen of the described mobile client virtual machine page and mobile client, the described mobile client virtual machine page is pressed the resolution Zoom display of the screen of described mobile client on described mobile client screen.
In the present embodiment step S2, the described criterion judging whether described gesture operation meets described gesture event is:
1., judge whether described gesture operation is the gesture event singly referring to click screen, if singly refer to that the time touching touch screen point is less than 1s, then confirm that described gesture operation is the gesture event singly referring to click screen; Otherwise, then confirm that described gesture operation is the gesture event of Dan Zhichang by screen;
2., judge whether described gesture operation is the gesture event singly referring to double-click screen, the touch screen point that first time clicks screen is no more than 20 pixels with the distance clicking the touch screen point of screen for the second time, and the time interval of described twice single-click operation is less than 0.5 second, then confirm that described gesture operation is the gesture event singly referring to double-click screen; Otherwise, confirm that described gesture operation is the gesture event singly referring to click screen for twice;
3., judge whether described gesture operation is the gesture event of Dan Zhichang by screen, singly refer to that the touch screen point touched is constant, and be greater than 1s to touching the time terminated from touching, then confirm that described gesture operation is the gesture event of Dan Zhichang by screen; Otherwise, confirm that described gesture operation is the gesture event singly referring to click screen;
4., judge whether described gesture operation is the gesture event singly referring to translation screen, if singly refer to that the time touching touch screen point is less than 1s, and the starting point of touch screen is different from the terminal of touch screen, then confirm that described gesture operation is the gesture event singly referring to translation screen; Otherwise, confirm that described gesture operation is the gesture event singly referring to click screen;
5., judge whether described gesture operation is the gesture event singly referring to slip screen, to singly referring to slip EOS from singly referring to slip screen, if singly refer to that the Y-coordinate of the touch screen point of slip EOS is greater than the Y-coordinate singly referring to the touch screen point that slip screen starts, then confirm that described gesture operation is the gesture operation of the slide downward page; If singly refer to that the Y-coordinate of the touch screen point of slip EOS is less than the Y-coordinate singly referring to the touch screen point that slip screen starts, then confirm describedly singly to refer to that slip screen is the gesture operation of the upward sliding page;
6., judge whether described gesture operation is two gesture event referring to mediate screen, when two finger touch screen, calculate the distance S that two refer to the touch screen point be positioned on screen, refer in moving process two, if two refer to that the distance of the touch screen point be positioned on screen changes, and the distance value changed is greater than S, then confirm that described gesture operation is two gesture event referring to mediate; Otherwise, then confirm that described gesture operation is two gesture event referring to translation.
With reference to Fig. 2, embodiment 2, one substitutes mouse action system based on the many gestures of mobile terminal virtual machine, comprising: background server, mobile client virtual machine and mobile client; Described mobile client is communicated by RDP with described background server, and described mobile client virtual machine is communicated by virtual device interface with described background server;
Described mobile client comprises: gesture setup unit, seizure judging unit, data cell and display unit; Described gesture setup unit, is responsible for setting gesture event and simulates corresponding mouse action; Described seizure judging unit, is responsible for the gesture operation be captured on mobile client screen and also judges whether the gesture operation of catching meets gesture event; Described data cell, is responsible for the data storing described mobile client and the transmission of described background server; Described display unit, is responsible for the data received in display data cell;
Described background server, be responsible for the data that the described mobile client of reception sends over, and described data are sent to described mobile client virtual machine, simultaneously, the operating process that the described mobile client virtual machine of responsible reception sends over and operating result data, and described operating process and operating result data are passed to described mobile client;
Described mobile client virtual machine comprises: data cell, data processing unit and performance element;
Described data cell, is responsible for storing the data of described mobile client virtual machine and the transmission of described background server and the data of described mobile client virtual machine executable operations; Described data processing unit, is responsible for processing the data received in data cell; Performance element, according to the result of data processing unit, performs corresponding operating, and operating process and operating result is sent to data cell.
With reference to Fig. 2, illustrate for: data have been sent to background server end from cloud desktop mobile client by RDP.After background server receives data, then virtual machine is sent to carry out data processing by VDI (virtual device interface).The operation of mouse belongs to data input.
Virtual machine will process and needed the data shown to send to background server by VDI, after background server receives display data, send to cloud desktop mobile client by RDP again, mobile client receive display according to this after, data are presented at client.
By adopting technique scheme disclosed by the invention, obtain effect useful as follows:
The present invention takes full advantage of the touch screen event of mobile device, and adopts the gesture modeling scheme close to true mouse action, meets the operating habit of user.In addition, user is without the need to dragging mouse, and only need wanting the position of carrying out mouse action directly to carry out mouse action, virtual machine will respond mouse action, accomplishes convenient and swift veritably.
The above is only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications also should look protection scope of the present invention.
Claims (9)
1. substitute a mouse operation method based on the many gestures of mobile terminal virtual machine, it is characterized in that, the method comprises the following steps:
S1, mobile client catch the gesture operation data of user at current page;
S2, according to described data, judge whether described gesture operation meets gesture event, if met, enter S3, if do not met, display current page;
S3, mobile client obtain corresponding mouse action according to described gesture event, and according to the coordinate setting that described gesture operation occurs, the coordinate of described mouse action occur;
Corresponding mouse action and coordinate that described mouse action occurs are sent to background server with data mode by S4, mobile client;
The data received are sent to mobile client virtual machine by S5, background server;
The data that S6, described mobile client virtual machine foundation receives, executable operations, and operating process and operating result are sent to background server in real time;
The true-time operation process received and operating result are passed to described mobile client by S7, background server, and described mobile client will receive described true-time operation process and operating result is presented on current page.
2. substitute mouse operation method based on the many gestures of mobile terminal virtual machine according to claim 1, it is characterized in that, before step S1, there is the operation of mobile client setting gesture event analog mouse, concrete steps are as follows:
S1-1, when user is single give directions hit any one position of mobile client screen time, mobile client determination mouse moves to this position;
The corresponding operating of S1-2, setting gesture event analog mouse, by the left button single-click operation singly referring to the gesture event analog mouse clicking screen; With the left double click operation singly referring to the gesture event analog mouse double-clicking screen; The right-click operation of the gesture event analog mouse of screen is pressed with Dan Zhichang; Drag operation is pinned with the left button of the gesture event analog mouse singly referring to translation screen; With the drag operation of gesture event analog mouse singly referring to slip screen; By two zoom operations referring to the gesture event simulated screen of mediating screen; With the operation of the gesture event simulation translation screen of two finger translation screen.
3. substitute mouse operation method based on the many gestures of mobile terminal virtual machine according to claim 1, it is characterized in that, in step S2, judge that the basis for estimation whether described gesture operation meets described gesture event is specially:
Judge whether described gesture operation is the gesture event singly referring to click screen, if singly refer to that the time touching touch screen point is less than 1s, then confirm that described gesture operation is the gesture event singly referring to click screen; Otherwise, then confirm that described gesture operation is the gesture event of Dan Zhichang by screen;
Judge whether described gesture operation is the gesture event singly referring to double-click screen, the touch screen point that first time clicks screen is no more than 20 pixels with the distance clicking the touch screen point of screen for the second time, and the time interval of described twice single-click operation is less than 0.5 second, then confirm that described gesture operation is the gesture event singly referring to double-click screen; Otherwise, confirm that described gesture operation is the gesture event singly referring to click screen for twice;
Judge whether described gesture operation is the gesture event of Dan Zhichang by screen, singly refer to that the touch screen point touched is constant, and be greater than 1s to touching the time terminated from touching, then confirm that described gesture operation is the gesture event of Dan Zhichang by screen; Otherwise, confirm that described gesture operation is the gesture event singly referring to click screen;
Judge whether described gesture operation is the gesture event singly referring to translation screen, if singly refer to that the time touching touch screen point is less than 1s, and the starting point of touch screen is different from the terminal of touch screen, then confirm that described gesture operation is the gesture event singly referring to translation screen; Otherwise, confirm that described gesture operation is the gesture event singly referring to click screen;
Judge whether described gesture operation is the gesture event singly referring to slip screen, to singly referring to slip EOS from singly referring to slip screen, if singly refer to that the Y-coordinate of the touch screen point of slip EOS is greater than the Y-coordinate singly referring to the touch screen point that slip screen starts, then confirm that described gesture operation is the gesture operation of the slide downward page; If singly refer to that the Y-coordinate of the touch screen point of slip EOS is less than the Y-coordinate singly referring to the touch screen point that slip screen starts, then confirm describedly singly to refer to that slip screen is the gesture operation of the upward sliding page;
Judge whether described gesture operation is two gesture event referring to mediate screen, when two finger touch screen, calculate the distance S that two refer to the touch screen point be positioned on screen, refer in moving process two, if two refer to that the distance of the touch screen point be positioned on screen changes, and the distance value after changing is greater than S, then confirm that described gesture operation is two gesture event referring to mediate; Otherwise, then confirm that described gesture operation is two gesture event referring to translation.
4. substitute mouse operation method based on the many gestures of mobile terminal virtual machine according to claim 1, it is characterized in that, in step S3, there is the coordinate of described mouse action in location according to the coordinate of the described gesture operation of generation, specifically realizes as follows:
S3-1, obtain the coordinate of described gesture operation on mobile client screen;
S3-2, the resolution ratio of described coordinate by the screen of the described mobile client virtual machine page and mobile client to be mapped on the virtual machine page, to obtain the coordinate of described mouse action on the described virtual machine page.
5. substitute mouse operation method based on the many gestures of mobile terminal virtual machine according to claim 4, it is characterized in that, before step S3-1, there are following steps:
Mobile client obtains the resolution of the mobile client virtual machine page, then according to the resolution of the screen of described mobile client, obtain the resolution ratio of the screen of the described mobile client virtual machine page and mobile client, the described mobile client virtual machine page is pressed the resolution Zoom display of the screen of described mobile client on described mobile client screen.
6. substitute mouse operation method based on the many gestures of mobile terminal virtual machine according to claim 1, it is characterized in that, in step S4, described mobile client is communicated by RDP with background server.
7. substitute mouse operation method based on the many gestures of mobile terminal virtual machine according to claim 1, it is characterized in that, in step S4, the coordinate of corresponding mouse action and the described mouse action of generation is first packaged into packet by described mobile client, and then by described Packet Generation to background server.
8. substitute mouse operation method based on the many gestures of mobile terminal virtual machine according to claim 7, it is characterized in that, step S6, concrete grammar is:
Described mobile client virtual machine receives the packet that described background server sends over, after decompression, obtain described mouse action and the coordinate of described mouse action occurs, according to described mouse action and the coordinate that described mouse action occurs, executable operations, and in real time operating process and operating result are sent to background server.
9. substitute a mouse action system based on the many gestures of mobile terminal virtual machine, it is characterized in that, described system comprises: background server, mobile client and mobile client virtual machine; Described mobile client is communicated by RDP with described background server, and described mobile client virtual machine is communicated by virtual device interface with described background server;
Described background server, be responsible for the data that the described mobile client of reception sends over, and described data are sent to described mobile client virtual machine, simultaneously, the operating process that the described mobile client virtual machine of responsible reception sends over and operating result data, and described operating process and operating result data are passed to described mobile client;
Described mobile client comprises: gesture setup unit, seizure judging unit, data cell and display unit; Described gesture setup unit, is responsible for setting gesture event and simulates corresponding mouse action; Described seizure judging unit, is responsible for the gesture operation be captured on mobile client screen and also judges whether the gesture operation of catching meets gesture event; Described data cell, is responsible for the data storing described mobile client and the transmission of described background server; Described display unit, is responsible for the data received in display data cell;
Described mobile client virtual machine comprises: data cell, data processing unit and performance element;
Described data cell, is responsible for storing the data of described mobile client virtual machine and the transmission of described background server and the data of described mobile client virtual machine executable operations; Described data processing unit, is responsible for processing the data received in data cell; Performance element, according to the result of data processing unit, performs corresponding operating, and operating process and operating result is sent to data cell.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410494173.3A CN104317390A (en) | 2014-09-24 | 2014-09-24 | Method and system for replacing mouse operation by multiple gestures based on virtual machine of mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410494173.3A CN104317390A (en) | 2014-09-24 | 2014-09-24 | Method and system for replacing mouse operation by multiple gestures based on virtual machine of mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104317390A true CN104317390A (en) | 2015-01-28 |
Family
ID=52372629
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410494173.3A Pending CN104317390A (en) | 2014-09-24 | 2014-09-24 | Method and system for replacing mouse operation by multiple gestures based on virtual machine of mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104317390A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105988572A (en) * | 2015-02-16 | 2016-10-05 | 株式会社理光 | Method for operating device by using mobile terminal to simulate mouse, mobile terminal and demonstration system |
| CN106909293A (en) * | 2015-12-22 | 2017-06-30 | 深圳富泰宏精密工业有限公司 | The method and electronic installation of analog mouse operation |
| CN107229409A (en) * | 2017-05-24 | 2017-10-03 | 中兴通讯股份有限公司 | The operating method and device of remote virtual desktop system |
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| CN108108211A (en) * | 2017-11-20 | 2018-06-01 | 福建天泉教育科技有限公司 | A kind of method and terminal that remote interaction is carried out in virtual reality scenario |
| CN109885236A (en) * | 2019-02-25 | 2019-06-14 | 合肥谐桐科技有限公司 | The method for interacting formula operation with remote system desktop is realized based on mobile device |
| CN110174946A (en) * | 2019-05-16 | 2019-08-27 | 上海达龙信息科技有限公司 | Mouse action analogy method, simulation system, storage medium and electronic equipment |
| CN110496388A (en) * | 2019-08-22 | 2019-11-26 | 上海达龙信息科技有限公司 | Remote desktop mouse emulation method, simulation system, medium and electronic equipment |
| CN112131076A (en) * | 2020-09-17 | 2020-12-25 | 上海上讯信息技术股份有限公司 | Method, equipment and system for acquiring mouse operation event information |
| CN113467618A (en) * | 2021-07-16 | 2021-10-01 | 支付宝(杭州)信息技术有限公司 | Method and device for collecting sliding gesture |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102810023A (en) * | 2011-06-03 | 2012-12-05 | 联想(北京)有限公司 | Gesture recognition method and terminal equipment |
| CN102866848A (en) * | 2012-09-13 | 2013-01-09 | 电子科技大学 | Method for controlling cloud classroom intelligent pointer based on wifi |
| CN103076918A (en) * | 2012-12-28 | 2013-05-01 | 深圳Tcl新技术有限公司 | Remote control method and system based on touch terminal |
| CN103345406A (en) * | 2013-06-21 | 2013-10-09 | 中国科学院深圳先进技术研究院 | System and method for achieving cloud virtual mobile terminal of intelligent mobile terminal |
| CN103607452A (en) * | 2013-11-19 | 2014-02-26 | 北京云巢动脉科技有限公司 | Method, device and system for acquiring virtual machine terminal data |
-
2014
- 2014-09-24 CN CN201410494173.3A patent/CN104317390A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102810023A (en) * | 2011-06-03 | 2012-12-05 | 联想(北京)有限公司 | Gesture recognition method and terminal equipment |
| CN102866848A (en) * | 2012-09-13 | 2013-01-09 | 电子科技大学 | Method for controlling cloud classroom intelligent pointer based on wifi |
| CN103076918A (en) * | 2012-12-28 | 2013-05-01 | 深圳Tcl新技术有限公司 | Remote control method and system based on touch terminal |
| CN103345406A (en) * | 2013-06-21 | 2013-10-09 | 中国科学院深圳先进技术研究院 | System and method for achieving cloud virtual mobile terminal of intelligent mobile terminal |
| CN103607452A (en) * | 2013-11-19 | 2014-02-26 | 北京云巢动脉科技有限公司 | Method, device and system for acquiring virtual machine terminal data |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105988572A (en) * | 2015-02-16 | 2016-10-05 | 株式会社理光 | Method for operating device by using mobile terminal to simulate mouse, mobile terminal and demonstration system |
| CN106909293A (en) * | 2015-12-22 | 2017-06-30 | 深圳富泰宏精密工业有限公司 | The method and electronic installation of analog mouse operation |
| CN107229409A (en) * | 2017-05-24 | 2017-10-03 | 中兴通讯股份有限公司 | The operating method and device of remote virtual desktop system |
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| CN108108211A (en) * | 2017-11-20 | 2018-06-01 | 福建天泉教育科技有限公司 | A kind of method and terminal that remote interaction is carried out in virtual reality scenario |
| CN109885236A (en) * | 2019-02-25 | 2019-06-14 | 合肥谐桐科技有限公司 | The method for interacting formula operation with remote system desktop is realized based on mobile device |
| CN109885236B (en) * | 2019-02-25 | 2021-06-25 | 电科云(北京)科技有限公司 | Method for realizing interactive operation with remote system desktop based on mobile equipment |
| CN110174946A (en) * | 2019-05-16 | 2019-08-27 | 上海达龙信息科技有限公司 | Mouse action analogy method, simulation system, storage medium and electronic equipment |
| CN110496388A (en) * | 2019-08-22 | 2019-11-26 | 上海达龙信息科技有限公司 | Remote desktop mouse emulation method, simulation system, medium and electronic equipment |
| CN112131076A (en) * | 2020-09-17 | 2020-12-25 | 上海上讯信息技术股份有限公司 | Method, equipment and system for acquiring mouse operation event information |
| CN113467618A (en) * | 2021-07-16 | 2021-10-01 | 支付宝(杭州)信息技术有限公司 | Method and device for collecting sliding gesture |
| CN113467618B (en) * | 2021-07-16 | 2024-04-23 | 支付宝(杭州)信息技术有限公司 | Method and device for acquiring sliding gesture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104317390A (en) | Method and system for replacing mouse operation by multiple gestures based on virtual machine of mobile terminal | |
| US9436369B2 (en) | Touch interface for precise rotation of an object | |
| CN109032390B (en) | Handwriting data caching method, device, equipment and storage medium | |
| CN111857457A (en) | Cloud mobile phone control method and device, electronic equipment and readable storage medium | |
| CN104850341B (en) | A kind of application icon display methods of mobile terminal and mobile terminal | |
| JP2015153420A (en) | Multitask switching method and system and electronic equipment having the same system | |
| CN103631893B (en) | A kind of browser control method and browser | |
| CN104144184A (en) | Method for controlling far-end device and electronic devices | |
| WO2012003799A1 (en) | Method and device for window object inertial movement | |
| WO2013050652A1 (en) | Methods, apparatus and computer program products to determine user interface orientation | |
| CN103324348A (en) | Windows desktop control method based on intelligent mobile terminals | |
| CN108228020B (en) | Information processing method and terminal | |
| JPWO2013118373A1 (en) | Image processing apparatus, image processing method, and program | |
| WO2014019478A1 (en) | Method and mobile terminal device for image operation | |
| CN102819391B (en) | System and method of multi-point touch gesture feedback system with concurrency under multiple scenes | |
| CN105430468A (en) | Remote control method and device for television set-top box | |
| CN104063128A (en) | Information processing method and electronic equipment | |
| US11803248B2 (en) | Gesture operation method, apparatus, device and medium | |
| CN102331872A (en) | Method and device for achieving effect of middle mouse button on touch screen | |
| CN110493018A (en) | A kind of group chat creation method and device | |
| CN102662511A (en) | Method and terminal for carrying out control operation through touch screen | |
| CN105094344B (en) | Fixed terminal control method and device | |
| CN104346095B (en) | A kind of information processing method and electronic equipment | |
| CN103150116A (en) | RDP-based method for magnification display of cloud desktop | |
| CN102855076B (en) | The control method of touch-screen and device, mobile terminal device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150128 |