CN103220339A - Method, device and system for displaying cursor path in remote operation - Google Patents
Method, device and system for displaying cursor path in remote operation Download PDFInfo
- Publication number
- CN103220339A CN103220339A CN2013101008720A CN201310100872A CN103220339A CN 103220339 A CN103220339 A CN 103220339A CN 2013101008720 A CN2013101008720 A CN 2013101008720A CN 201310100872 A CN201310100872 A CN 201310100872A CN 103220339 A CN103220339 A CN 103220339A
- Authority
- CN
- China
- Prior art keywords
- cursor
- track
- information
- moves
- date
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to the technical field of network data communication, in particular to a method, a device and a system for displaying a cursor path in remote operation. The method comprises the following steps of calculating a predicted time interval according to frame interval time and transmission delay time of a remote device; receiving the information of cursor movement on the remote device, and generating statistical data of the cursor path; predicting the cursor path in the predicted time interval according to the statistical data and the latest received information of cursor movement; and carrying out calculus of interpolation on the predicted cursor path by utilizing the latest received information of cursor movement, and displaying the cursor path after the calculus of interpolation. According to the embodiment of the invention, the cursor path, displayed on a local device, operated by the remote device is more fluent and natural, and smooth and fluent cursor path and quick respond still can be provided even under the condition that the hardware and network transmission environment is not ideal, so that the user experience of remote operation can be greatly improved.
Description
Technical field
The present invention relates to the network data communication technical field, relate in particular to cursor track display packing, device and system in a kind of remote operation.
Background technology
Along with popularizing of network, realize having become possibility for the control of long-range electronic equipment by network.So-called Long-distance Control, typically refer to administrative staff are in the strange land by Internet connection controlled computer, the desktop environment of controlled computer is shown in the local computer, by local computer to the controlled computer that is in the strange land be configured, operations such as software installation procedure, modification.
The operation principle of Long-distance Control is as follows: Long-distance Control need be undertaken by network.Being positioned at local computer is the end that sends of operational order, is called main control end, and long-range controlled computer is called controlled terminal.Main control end and controlled terminal can be to be arranged in same local area network (LAN), also can be two or many computers being in any position by Internet connection.Usually, build-in services device end program is installed client-side program in the computer of controlled terminal in the computer of main control end.During use, the client-side program of server in the computer of main control end in the computer of controlled terminal sends signal, set up special remote service, then by this remote service, use various remote control functions to send remote control command, the various application program operations in the computer of control controlled terminal.
In remote operation, the fluency of display highlighting pointer directly has influence on user's remote operation and experiences.The mode of traditional long-range cursor of demonstration is the variation that every frame detects cursor coordinates, and the coordinate that upgrades is sent, and the other end upgrades cursor position after receiving new coordinate.Could feel smoothness during the image change of human eye more than receiving per second 30 frames.Yet, be subjected to the restriction that each frame period that detects and Network Transmission postpone, even preferably under the situation, still can not reach gratifying effect in computing power and network environment.
Summary of the invention
In view of the above problems, the present invention has been proposed, so that cursor track display packing, device and system in a kind of remote operation that overcomes the problems referred to above or address the above problem at least in part are provided.
According to one aspect of the present invention, the display packing of the cursor track in a kind of remote operation is provided, comprise step:, calculate predicted time at interval according to the frame period time and the propagation delay time of remote equipment; The information that cursor moves on the receiving remote equipment, and the statistics of generation cursor track; According to the information that described statistics and the up-to-date cursor that receives move, prediction is at the cursor track of described predicted time at interval; And the information of utilizing the described up-to-date cursor that receives to move, the cursor track of being predicted is carried out interpolation calculation, and show through the cursor track after the interpolation calculation.
Alternatively, cursor track display packing in the remote operation also comprises step according to an embodiment of the invention: the information that cursor moves on receiving remote equipment and when generating the statistics of cursor track, the further information that moves according to cursor on the remote equipment that is received, display highlighting.
Alternatively, in the cursor track display packing in the remote operation according to an embodiment of the invention, the statistics of information that described cursor moves and described cursor track comprises at least a in the following information: the speed that the direction that cursor moves, cursor move, cursor move the zone at place, the curvature of cursor motion track.
Alternatively, in the cursor track display packing in the remote operation according to an embodiment of the invention, in the described information that moves according to statistics and the up-to-date cursor that receives, prediction in the step of the cursor track of described predicted time at interval, the information that moves according to the statistics and the up-to-date cursor that receives of described cursor track, prediction described predicted time at interval in cursor motion track curvature situation of change and on track the situation of change of speed, to obtain the cursor track in described predicted time interval.
Alternatively, in the cursor track display packing in the remote operation according to an embodiment of the invention, in the described information of utilizing the described up-to-date cursor that receives to move the cursor track of being predicted is carried out in the step of interpolation calculation, based on three Bezier formula, the up-to-date cursor coordinates that comprises in the information that moves for the described up-to-date cursor that receives, one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the information acquisition that moves according to the described up-to-date cursor that receives, and the terminal point cursor coordinates of the cursor track of being predicted, carry out interpolation calculation.
Alternatively, in the cursor track display packing in the remote operation according to an embodiment of the invention, calculate in the predicted time step at interval in described frame period time and the propagation delay time according to remote equipment, to the frame period time and the propagation delay time summation of described remote equipment, to obtain described predicted time at interval.
According to another aspect of the present invention, cursor in a kind of remote operation track display device also is provided, comprise: network interface, be suitable for the information that cursor moves on the receiving remote equipment, with the statistics of generation cursor track, and obtain the information that remote equipment provides about frame period time and propagation delay time; Predicted time interval calculation device is suitable for frame period time and propagation delay time according to remote equipment, calculates predicted time at interval; The cursor trajectory predictor is suitable for the information that moves according to described statistics and the up-to-date cursor that receives, and prediction is at the cursor track of described predicted time at interval; The interpolation calculation device is suitable for the information of utilizing the described up-to-date cursor that receives to move, and the cursor track of being predicted is carried out interpolation calculation; And display, be suitable for showing cursor track through after the interpolation calculation.
Alternatively, in the cursor track display device in the remote operation according to an embodiment of the invention, the information that cursor moves on the described network interface receiving remote equipment and when generating the statistics of cursor track, the information that described display further moves according to cursor on the remote equipment that is received, display highlighting.
Alternatively, in the cursor track display device in the remote operation according to an embodiment of the invention, the statistics of information that described cursor moves and described cursor track comprises at least a in the following information: the speed that the direction that cursor moves, cursor move, cursor move the zone at place, the curvature of cursor motion track.
Alternatively, in the cursor track display device in the remote operation according to an embodiment of the invention, the information that described cursor trajectory predictor moves according to the statistics and the up-to-date cursor that receives of described cursor track, prediction described predicted time at interval in cursor motion track curvature situation of change and on track the situation of change of speed, to obtain the cursor track in described predicted time interval.
Alternatively, in the cursor track display device in the remote operation according to an embodiment of the invention, described interpolation calculation device is based on three Bezier formula, the terminal point cursor coordinates of one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the up-to-date cursor coordinates that comprises in the information that moves for the described up-to-date cursor that receives, the information acquisition that moves according to the described up-to-date cursor that receives and the cursor track of being predicted carries out interpolation calculation.
Alternatively, in the cursor track display device in the remote operation according to an embodiment of the invention, described predicted time interval calculation device is to the frame period time and the propagation delay time summation of described remote equipment, to obtain described predicted time at interval.
According to another aspect of the present invention, the display system of the cursor track in a kind of remote operation also is provided, comprise the cursor track display device in the remote operation according to the present invention; And remote equipment, be suitable for providing described frame period time and propagation delay time, and send the information that cursor moves to described device to described device.
The invention provides cursor track display packing, device and system in the above-mentioned remote operation.According to embodiments of the invention, can be according to the frame period time and the propagation delay time of remote equipment, calculate predicted time at interval, the statistics of information that cursor moves on the receiving remote equipment and generation cursor track, the information that moves according to described statistics and the up-to-date cursor that receives, the cursor track of prediction in described predicted time interval, the information of utilizing the described up-to-date cursor that receives to move, the cursor track of being predicted is carried out interpolation calculation, and show through the cursor track after the interpolation calculation.Thus, can carry out constantly improving and adjusting for the statistics of cursor track according to user's operation information, utilize resulting statistics to carry out the prediction of cursor track, and the cursor track of being predicted is carried out interpolation calculation, thereby the smooth more and nature of the cursor track that makes the remote equipment operation that shows on the local device, even under hardware and the unfavorable situation of Network Transmission environment, level and smooth and smooth cursor track and response fast still can be provided, greatly improve user's remote operation and experienced.
Above-mentioned explanation only is the general introduction of technical solution of the present invention, for can clearer understanding technological means of the present invention, and can be implemented according to the content of specification, and for above and other objects of the present invention, feature and advantage can be become apparent, below especially exemplified by the specific embodiment of the present invention.
Description of drawings
By reading hereinafter detailed description of the preferred embodiment, various other advantage and benefits will become cheer and bright for those of ordinary skills.Accompanying drawing only is used to illustrate the purpose of preferred implementation, and does not think limitation of the present invention.And in whole accompanying drawing, represent identical parts with identical reference symbol.In the accompanying drawings:
Fig. 1 is the flow chart of cursor track display packing according to an embodiment of the invention;
Fig. 2 is the schematic diagram that calculates of curvature according to an embodiment of the invention; And
Fig. 3 is the block diagram of cursor track display system according to an embodiment of the invention.
Embodiment
Exemplary embodiment of the present disclosure is described below with reference to accompanying drawings in more detail.Though shown exemplary embodiment of the present disclosure in the accompanying drawing, yet should be appreciated that and to realize the disclosure and the embodiment that should do not set forth limits here with various forms.On the contrary, it is in order to understand the disclosure more thoroughly that these embodiment are provided, and can with the scope of the present disclosure complete convey to those skilled in the art.
Principle of the present invention is applicable to any electronic equipment that comprises demonstration and processing unit, including, but not limited to: based on the computer of desktop operating systems such as Windows, Linux, Mac OS, Unix; Based on the mobile phone of Mobile operating systems such as iOS, Android, Windows Phone, Symbian, panel computer, video player, electronic reader, DPF or the like.Alternatively, local device and remote equipment can be the electronic equipment of same type, for example realize remote operation between two computers, also can be dissimilar electronic equipments, for example realize remote operation between panel computer and mobile phone.
Hereinafter, will principle of the present invention exemplarily be described with the example of computer as local device and remote equipment.Yet just in order to describe the present invention with concrete example, to help reader understanding's principle of the present invention, scope of the present invention is not limited thereto for this, but go for anyly comprising demonstration and processing unit, based on the electronic equipment of any operating system.
Fig. 1 schematically illustrates the flow chart of cursor track display packing 100 according to an embodiment of the invention.As shown in Figure 1, method 100 starts from step S101, wherein, according to the frame period time and the propagation delay time of remote equipment, calculates predicted time at interval.According to embodiments of the invention, the frame period time of described remote equipment is each detection remote equipment cursor position time separately, and the propagation delay time is the time of delay that brings owing to Network Transmission.Alternatively, can be to the frame period time and the propagation delay time summation of described remote equipment, to obtain described predicted time at interval.
According to embodiments of the invention, described cursor can for example be electronic equipment sensing equipment (for example, mouse, trace ball, touch pad etc.) go up the cursor that shows at the display unit of electronic equipment (for example, the display screen of the display of computer, panel computer etc.).
After step S101, execution in step S103, wherein, the information that cursor moves on the receiving remote equipment, and the statistics of generation cursor track.According to embodiments of the invention, the statistics of information that described cursor moves and described cursor track can comprise at least a in the following information: the speed that the direction that cursor moves, cursor move, cursor move the zone at place, the curvature of cursor motion track.
For example, the direction that moves of cursor can comprise from left to right and moves, moves from the top down, moves down to the right, moves or the like to left down from upper right with a certain slope from upper left with a certain slope; The speed that cursor moves can comprise average speed that cursor moves along a certain track, instantaneous velocity, instantaneous acceleration or the like; The zone that cursor moves the place can comprise screen center zone, screen border area or the like; The curvature of cursor motion track can be the rotation rate of the tangent directional angle of certain point on the cursor motion track curve to arc length.For example referring to Fig. 3, it shows the schematic diagram of curvature calculating according to an embodiment of the invention.For example, some A and point of proximity A' respectively do a tangent line on curve C D, and the arc length between some A and the some A' is Δ S, and two tangent line angles are α, and then the curve C D curvature of ordering at A is:
。
According to embodiments of the invention, in step S103, the direction that above-mentioned cursor can be moved, the speed that cursor moves, zone, this information of four types of cursor motion track that cursor moves the place are added up as four class data, to obtain user's operating habit.
According to embodiments of the invention, in step S103, during the statistics of information that cursor moves on receiving remote equipment and generation cursor track, the information that can further move, display highlighting according to cursor on the remote equipment that is received.For example, can go up the cursor position that shows on the up-to-date remote equipment of receiving at the display unit (for example display of computer) of local device.
After step S103, execution in step S105, wherein, and according to the information that described statistics and the up-to-date cursor that receives move, the cursor track of the predicted time that prediction calculates in above-mentioned steps S101 at interval.For example, can adopt didactic method,, predict according to the information that the user's who is reflected in the described statistics operating habit and the up-to-date cursor that receives moves.For example, the information that can move based on the up-to-date cursor that receives, in statistics, find predicted time at interval in the most possible mobile track that takes place, just can calculate the cursor track of prediction thus.
According to embodiments of the invention, in above-mentioned steps S105, the information that can move according to the statistics and the up-to-date cursor that receives of described cursor track, prediction described predicted time at interval in cursor motion track curvature situation of change and on track the situation of change of speed, to obtain the cursor track in described predicted time interval.
Next, execution in step S107, wherein, the information of utilizing the described up-to-date cursor that receives to move is carried out interpolation calculation to the cursor track of being predicted, and shows through the cursor track after the interpolation calculation.Owing to can have error between the cursor track of the cursor track of prediction and reality with being difficult to avoid, in order to reduce such error, the information that just can utilize the described up-to-date cursor that receives to move is carried out interpolation calculation to the cursor track of being predicted, to realize the transition of smooth trajectory.
According to embodiments of the invention, in described step S107, can be based on three Bezier formula, the terminal point cursor coordinates of one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the up-to-date cursor coordinates that comprises in the information that moves for the described up-to-date cursor that receives, the information acquisition that moves according to the described up-to-date cursor that receives and the cursor track of being predicted carries out interpolation calculation.
Can adopt three times following Bezier formula to carry out interpolation calculation:
B(t)=P
0(1-t)
3+3P
1t(1-t)
2+3P
2t
2(1-t)+P
3t
3，t∈[0，1]。
Wherein, P
0The up-to-date cursor coordinates that comprises in the information that moves for the described up-to-date cursor that receives, P
1Be the terminal point cursor coordinates of the cursor track predicted, and P
2And P
3P for the information acquisition that moves according to the described up-to-date cursor that receives
0Two cursor coordinates on the moving direction, for example, P
2And P
3Can be respectively P
0P on the moving direction
0At interval coordinate and P sometime before
0At interval coordinate sometime afterwards, B (t) is and utilizes above-mentioned three Bezier formula to carry out the resulting coordinate of interpolation calculation.
The mode of above-mentioned interpolation calculation only is an example, to help reader understanding's principle of the present invention.Those skilled in the art can adopt other interpolation calculation mode to reach identical or similar purpose.
After carrying out described interpolation calculation, can go up the cursor track that shows through after the interpolation calculation at display unit (for example display of computer) at local device.
The invention discloses the cursor track display packing in a kind of remote operation.According to embodiments of the invention, can be according to the frame period time and the propagation delay time of remote equipment, calculate predicted time at interval, the statistics of information that cursor moves on the receiving remote equipment and generation cursor track, the information that moves according to described statistics and the up-to-date cursor that receives, the cursor track of prediction in described predicted time interval, the information of utilizing the described up-to-date cursor that receives to move, the cursor track of being predicted is carried out interpolation calculation, and show through the cursor track after the interpolation calculation.Thus, can carry out constantly improving and adjusting for the statistics of cursor track according to user's operation information, utilize resulting statistics to carry out the prediction of cursor track, and the cursor track of being predicted is carried out interpolation calculation, thereby the smooth more and nature of the cursor track that makes the remote equipment operation that shows on the local device, even under hardware and the unfavorable situation of Network Transmission environment, level and smooth and smooth cursor track and response fast still can be provided, greatly improve user's remote operation and experienced.
Corresponding with said method 100, the present invention also provides the cursor track display device 200 in a kind of remote operation.Fig. 3 schematically illustrates the block diagram of cursor track display system 1000 according to an embodiment of the invention, and wherein, system 1000 comprises described device 200 and remote equipment 300.
As shown in Figure 3, device 200 can comprise network interface 201, predicted time interval calculation device 203, cursor trajectory predictor 205, interpolation calculation device 207 and display 209.
According to the present invention, network interface 201 is suitable for the information that cursor moves on the receiving remote equipment, with the statistics of generation cursor track, and obtains the information about frame period time and propagation delay time that remote equipment provides; Predicted time interval calculation device 203 is suitable for frame period time and the propagation delay time according to remote equipment, calculates predicted time at interval; Cursor trajectory predictor 205 is suitable for the information that moves according to described statistics and the up-to-date cursor that receives, and prediction is at the cursor track of described predicted time at interval; Interpolation calculation device 207 is suitable for the information of utilizing the described up-to-date cursor that receives to move, and the cursor track of being predicted is carried out interpolation calculation; And display 209 is suitable for showing the cursor track through after the interpolation calculation.
Above-mentioned network interface 201, predicted time interval calculation device 203, cursor trajectory predictor 205, interpolation calculation device 207, display 209 can be used for carrying out step S101, S103, S105, the S107 of above-mentioned cursor track display packing 100.
According to embodiments of the invention, at first, network interface 201 can receiving remote equipment on the information that moves of cursor, generating the statistics of cursor track, and obtain the information that remote equipment provides about frame period time and propagation delay time.
According to embodiments of the invention, the statistics of information that described cursor moves and described cursor track can comprise at least a in the following information: the speed that the direction that cursor moves, cursor move, cursor move the zone at place, the curvature of cursor motion track.
For example, the direction that moves of cursor can comprise from left to right and moves, moves from the top down, moves down to the right, moves or the like to left down from upper right with a certain slope from upper left with a certain slope; The speed that cursor moves can comprise average speed that cursor moves along a certain track, instantaneous velocity, instantaneous acceleration or the like; The zone that cursor moves the place can comprise screen center zone, screen border area or the like; The curvature of cursor motion track can be the rotation rate of the tangent directional angle of certain point on the cursor motion track curve to arc length.For example referring to Fig. 3, it shows the schematic diagram of curvature calculating according to an embodiment of the invention.For example, some A and point of proximity A' respectively do a tangent line on curve C D, and the arc length between some A and the some A' is Δ S, and two tangent line angles are α, and then the curve C D curvature of ordering at A is:
According to embodiments of the invention, the frame period time of described remote equipment is each detection remote equipment cursor position time separately, and the propagation delay time is the time of delay that brings owing to Network Transmission.
According to embodiments of the invention, the information that cursor moves on described network interface 201 receiving remote equipment and when generating the statistics of cursor track, the information that described display 209 can further move according to cursor on the remote equipment that is received, display highlighting.
Then, predicted time interval calculation device 203 can calculate predicted time at interval according to the frame period time and the propagation delay time of remote equipment.Alternatively, predicted time interval calculation device 203 can be to the frame period time and the propagation delay time summation of described remote equipment, to obtain described predicted time at interval.
Then, the information that cursor trajectory predictor 205 can move according to described statistics and the up-to-date cursor that receives, prediction is at the cursor track of described predicted time at interval.For example, cursor trajectory predictor 205 can adopt didactic method, according to the information that the user's who is reflected in the described statistics operating habit and the up-to-date cursor that receives moves, predicts.For example, the information that cursor trajectory predictor 205 can move based on the up-to-date cursor that receives, in statistics, find predicted time at interval in the most possible mobile track that takes place, just can calculate the cursor track of prediction thus.
According to embodiments of the invention, the information that cursor trajectory predictor 205 can move according to the statistics and the up-to-date cursor that receives of described cursor track, prediction described predicted time at interval in cursor motion track curvature situation of change and on track the situation of change of speed, to obtain the cursor track in described predicted time interval.
Next, the information that interpolation calculation device 207 can utilize the described up-to-date cursor that receives to move is carried out interpolation calculation to the cursor track of being predicted.Owing to can have error between the cursor track of the cursor track of prediction and reality with being difficult to avoid, in order to reduce such error, the information that interpolation calculation device 207 just can utilize the described up-to-date cursor that receives to move, the cursor track of being predicted is carried out interpolation calculation, to realize the transition of smooth trajectory.
According to embodiments of the invention, interpolation calculation device 207 can be based on three Bezier formula, the terminal point cursor coordinates of one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the up-to-date cursor coordinates that comprises in the information that moves for the described up-to-date cursor that receives, the information acquisition that moves according to the described up-to-date cursor that receives and the cursor track of being predicted carries out interpolation calculation.
Alternatively, described interpolation calculation device 207 can for example adopt three times following Bezier formula to carry out interpolation calculation:
B(t)=P
0(1-t)
3+3P
1t(1-t)
2+3P
2t
2(1-t)+P
3t
3，t∈[0，1]。
Wherein, P
0The up-to-date cursor coordinates that comprises in the information that moves for the described up-to-date cursor that receives, P
1Be the terminal point cursor coordinates of the cursor track predicted, and P
2And P
3P for the information acquisition that moves according to the described up-to-date cursor that receives
0Two cursor coordinates on the moving direction, for example, P
2And P
3Can be respectively P
0P on the moving direction
0At interval coordinate and P sometime before
0At interval coordinate sometime afterwards, B (t) is interpolation calculation device 207 and utilizes above-mentioned three Bezier formula to carry out the resulting coordinate of interpolation calculation.
The mode that above-mentioned interpolation calculation device 207 carries out interpolation calculation only is example, to help reader understanding's principle of the present invention.Those skilled in the art can adopt other interpolation calculation mode to reach identical or similar purpose.
After carrying out described interpolation calculation, display 209 can show through the cursor track after the interpolation calculation.
Because above-mentioned respectively to install embodiment corresponding with aforementioned approaches method embodiment, therefore no longer each installed embodiment and be described in detail.
According to another aspect of the invention, also provide the cursor track display system 1000 in a kind of remote operation, as shown in Figure 3, system 1000 can comprise: the cursor track display device 200 in the above-mentioned remote operation; And remote equipment 300, it is suitable for providing described frame period time and propagation delay time to described device 200, and sends the information that cursor moves to described device.
Intrinsic not relevant at this algorithm that provides with any certain computer, virtual system or miscellaneous equipment with demonstration.Various general-purpose systems also can be with using based on the teaching at this.According to top description, it is conspicuous constructing the desired structure of this type systematic.In addition, the present invention is not also at any certain programmed language.Should be understood that and to utilize various programming languages to realize content of the present invention described here, and the top description that language-specific is done is in order to disclose preferred forms of the present invention.
In the specification that is provided, a large amount of details have been described herein.Yet, can understand, embodiments of the invention can be put into practice under the situation of these details not having.In some instances, be not shown specifically known method, structure and technology, so that not fuzzy understanding of this description.
Similarly, be to be understood that, in order to simplify the disclosure and to help to understand one or more in each inventive aspect, in the description to exemplary embodiment of the present invention, each feature of the present invention is grouped together in single embodiment, figure or the description to it sometimes in the above.Yet the method for the disclosure should be construed to the following intention of reflection: promptly the present invention for required protection requires the more feature of feature clearly put down in writing than institute in each claim.Or rather, as following claims reflected, inventive aspect was to be less than all features of the disclosed single embodiment in front.Therefore, follow claims of embodiment and incorporate this embodiment thus clearly into, wherein each claim itself is all as independent embodiment of the present invention.
Those skilled in the art are appreciated that and can adaptively change and they are arranged in one or more devices different with this embodiment the module in the device among the embodiment.Can be combined into the plurality of modules among the embodiment module or unit or assembly, and can be divided into a plurality of submodules or subelement or sub-component to them in addition.In such feature and/or process or module at least some are mutually repelling, and can adopt any combination to disclosed all features in this specification (comprising claim, summary and the accompanying drawing followed) and so all processes or the unit of disclosed any method or equipment make up.Unless clearly statement in addition, disclosed each feature can be by providing identical, being equal to or similar purpose alternative features replaces in this specification (comprising claim, summary and the accompanying drawing followed).
In addition, those skilled in the art can understand, although embodiment more described herein comprise some feature rather than further feature included among other embodiment, the combination of features of different embodiment means and is within the scope of the present invention and forms different embodiment.For example, in claims, the one of any of embodiment required for protection can be used with compound mode arbitrarily.
Each device embodiment of the present invention can realize with hardware, perhaps realizes with the software module of moving on one or more processor, and perhaps the combination with them realizes.It will be understood by those of skill in the art that and to use microprocessor or digital signal processor (DSP) to realize in practice according to some or all some or repertoire of modules in the device of the embodiment of the invention.The present invention can also be embodied as part or all the device program (for example, computer program and computer program) that is used to carry out method as described herein.Such realization program of the present invention can be stored on the computer-readable medium, perhaps can have the form of one or more signal.Such signal can be downloaded from internet website and obtain, and perhaps provides on carrier signal, perhaps provides with any other form.
It should be noted the foregoing description the present invention will be described rather than limit the invention, and those skilled in the art can design alternative embodiment under the situation of the scope that does not break away from claims.In the claims, any reference symbol between bracket should be configured to restriction to claim.Word " comprises " not to be got rid of existence and is not listed in element or step in the claim.Being positioned at word " " before the element or " one " does not get rid of and has a plurality of such elements.The present invention can realize by means of the hardware that includes some different elements and by means of the computer of suitably programming.In having enumerated the unit claim of some devices, several in these devices can be to come imbody by same hardware branch.Any order is not represented in the use of word first, second and C grade.Can be title with these word explanations.
Claims (13)
1. the cursor track display packing (100) in the remote operation comprises step:
According to the frame period time and the propagation delay time of remote equipment, calculate predicted time (S101) at interval;
The information that cursor moves on the receiving remote equipment, and the statistics (S103) of generation cursor track;
According to the information that described statistics and the up-to-date cursor that receives move, prediction is at the cursor track (S105) of described predicted time at interval; And
The information of utilizing the described up-to-date cursor that receives to move is carried out interpolation calculation to the cursor track of being predicted, and shows through the cursor track (S107) after the interpolation calculation.
2. the method for claim 1 also comprises step:
The information that cursor moves on receiving remote equipment and when generating the statistics (S103) of cursor track, the further information that moves according to cursor on the remote equipment that is received, display highlighting.
3. the method for claim 1, the statistics of information that wherein said cursor moves and described cursor track comprise at least a in the following information: the speed that the direction that cursor moves, cursor move, cursor move the zone at place, the curvature of cursor motion track.
4. as each the described method in the claim 1 to 3, wherein in the described information that moves according to statistics and the up-to-date cursor that receives, prediction in the step (S105) of the cursor track of described predicted time at interval, the information that moves according to the statistics and the up-to-date cursor that receives of described cursor track, prediction described predicted time at interval in cursor motion track curvature situation of change and on track the situation of change of speed, to obtain the cursor track in described predicted time interval.
5. as each the described method in the claim 1 to 3, wherein the cursor track of being predicted is carried out in the step of interpolation calculation in the described information of utilizing the described up-to-date cursor that receives to move, based on three Bezier formula, the terminal point cursor coordinates of one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the up-to-date cursor coordinates that comprises in the information that moves for the described up-to-date cursor that receives, the information acquisition that moves according to the described up-to-date cursor that receives and the cursor track of being predicted carries out interpolation calculation.
6. as each the described method in the claim 1 to 3, wherein calculate in the predicted time step (S101) at interval in described frame period time and the propagation delay time according to remote equipment, to the frame period time and the propagation delay time summation of described remote equipment, to obtain described predicted time at interval.
7. the cursor track display device (200) in the remote operation comprising:
Network interface (201) is suitable for the information that cursor moves on the receiving remote equipment, with the statistics of generation cursor track, and obtains the information about frame period time and propagation delay time that remote equipment provides;
Predicted time interval calculation device (203) is suitable for frame period time and propagation delay time according to remote equipment, calculates predicted time at interval;
Cursor trajectory predictor (205) is suitable for the information that moves according to described statistics and the up-to-date cursor that receives, and prediction is at the cursor track of described predicted time at interval;
Interpolation calculation device (207) is suitable for the information of utilizing the described up-to-date cursor that receives to move, and the cursor track of being predicted is carried out interpolation calculation; And
Display (209) is suitable for showing the cursor track through after the interpolation calculation.
8. device as claimed in claim 7, the information that cursor moves on wherein said network interface (201) the receiving remote equipment and when generating the statistics of cursor track, the information that described display (209) further moves according to cursor on the remote equipment that is received, display highlighting.
9. device as claimed in claim 7, the statistics of information that wherein said cursor moves and described cursor track comprise at least a in the following information: the speed that the direction that cursor moves, cursor move, cursor move the zone at place, the curvature of cursor motion track.
10. as each the described device in the claim 7 to 9, the information that wherein said cursor trajectory predictor (205) moves according to the statistics and the up-to-date cursor that receives of described cursor track, prediction described predicted time at interval in cursor motion track curvature situation of change and on track the situation of change of speed, to obtain the cursor track in described predicted time interval.
11. as each the described device in the claim 7 to 9, wherein said interpolation calculation device (207) is based on three Bezier formula, the terminal point cursor coordinates of one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the up-to-date cursor coordinates that comprises in the information that moves for the described up-to-date cursor that receives, the information acquisition that moves according to the described up-to-date cursor that receives and the cursor track of being predicted carries out interpolation calculation.
12. as each the described device in the claim 7 to 9, wherein said predicted time interval calculation device (203) is to the frame period time and the propagation delay time summation of described remote equipment, to obtain described predicted time at interval.
13. the cursor track display system (1000) in the remote operation comprising:
As the described device of claim 7-12 (200); And
Remote equipment (300) is suitable for providing described frame period time and propagation delay time to described device (200), and sends the information that cursor moves to described device (200).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310100872.0A CN103220339B (en) | 2013-03-27 | 2013-03-27 | Cursor display packing, device and system in remote operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310100872.0A CN103220339B (en) | 2013-03-27 | 2013-03-27 | Cursor display packing, device and system in remote operation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103220339A true CN103220339A (en) | 2013-07-24 |
| CN103220339B CN103220339B (en) | 2016-01-13 |
Family
ID=48817790
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310100872.0A Expired - Fee Related CN103220339B (en) | 2013-03-27 | 2013-03-27 | Cursor display packing, device and system in remote operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103220339B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108089831A (en) * | 2017-12-08 | 2018-05-29 | 威创集团股份有限公司 | Position identification display method, device and storage medium |
| CN109564781A (en) * | 2016-08-05 | 2019-04-02 | 费森尤斯医疗保健控股公司 | Remote user interface for dialysis system |
| CN110928449A (en) * | 2019-11-26 | 2020-03-27 | 北京集创北方科技股份有限公司 | Touch screen point reporting method and device, electronic equipment and storage medium |
| CN111682988A (en) * | 2020-06-18 | 2020-09-18 | 西安万像电子科技有限公司 | Remote control method, device, storage medium and processor |
| CN111857462A (en) * | 2020-06-29 | 2020-10-30 | 浪潮(北京)电子信息产业有限公司 | Server, cursor synchronization method and device, and computer readable storage medium |
| CN112732105A (en) * | 2020-12-31 | 2021-04-30 | 贵阳动视云科技有限公司 | Mouse jitter control method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1991710A (en) * | 2005-12-27 | 2007-07-04 | 宏正自动科技股份有限公司 | Remote control method, device and computer switcher |
| CN101377724A (en) * | 2007-08-29 | 2009-03-04 | 富士通电子零件有限公司 | Information processing apparatus, KVM switch, server, and program |
| JP2009123003A (en) * | 2007-11-15 | 2009-06-04 | Sky Kk | Capture image recording apparatus and capture image recording program |
| CN102591493A (en) * | 2011-12-30 | 2012-07-18 | 浙江海康科技有限公司 | Mouse cursor synchronization method for internet protocol K virtual machine (IPKVM) system |
-
2013
- 2013-03-27 CN CN201310100872.0A patent/CN103220339B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1991710A (en) * | 2005-12-27 | 2007-07-04 | 宏正自动科技股份有限公司 | Remote control method, device and computer switcher |
| CN101377724A (en) * | 2007-08-29 | 2009-03-04 | 富士通电子零件有限公司 | Information processing apparatus, KVM switch, server, and program |
| JP2009123003A (en) * | 2007-11-15 | 2009-06-04 | Sky Kk | Capture image recording apparatus and capture image recording program |
| CN102591493A (en) * | 2011-12-30 | 2012-07-18 | 浙江海康科技有限公司 | Mouse cursor synchronization method for internet protocol K virtual machine (IPKVM) system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109564781A (en) * | 2016-08-05 | 2019-04-02 | 费森尤斯医疗保健控股公司 | Remote user interface for dialysis system |
| CN108089831A (en) * | 2017-12-08 | 2018-05-29 | 威创集团股份有限公司 | Position identification display method, device and storage medium |
| CN110928449A (en) * | 2019-11-26 | 2020-03-27 | 北京集创北方科技股份有限公司 | Touch screen point reporting method and device, electronic equipment and storage medium |
| CN110928449B (en) * | 2019-11-26 | 2023-06-23 | 北京集创北方科技股份有限公司 | Point reporting method and device of touch screen, electronic equipment and storage medium |
| CN111682988A (en) * | 2020-06-18 | 2020-09-18 | 西安万像电子科技有限公司 | Remote control method, device, storage medium and processor |
| CN111857462A (en) * | 2020-06-29 | 2020-10-30 | 浪潮(北京)电子信息产业有限公司 | Server, cursor synchronization method and device, and computer readable storage medium |
| CN111857462B (en) * | 2020-06-29 | 2022-02-18 | 浪潮(北京)电子信息产业有限公司 | Server, cursor synchronization method and device, and computer readable storage medium |
| CN112732105A (en) * | 2020-12-31 | 2021-04-30 | 贵阳动视云科技有限公司 | Mouse jitter control method and device |
| CN112732105B (en) * | 2020-12-31 | 2023-03-28 | 贵阳动视云科技有限公司 | Mouse jitter control method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103220339B (en) | 2016-01-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103220339A (en) | Method, device and system for displaying cursor path in remote operation | |
| CN102163096B (en) | Signal conditioning package, information processing method | |
| CN106687922B (en) | Parametric inertia and API | |
| CN109844771A (en) | Control strategy for robot agent | |
| JP2011040035A (en) | Display input device and computer program | |
| US10067632B2 (en) | Dynamic hover grace period | |
| CN102929415A (en) | Local monitor and mouse display synchronization method for local monitor and remote virtual machine | |
| CN102937861A (en) | Share edge for displaying environment | |
| CN105094841A (en) | Page commenting method and device | |
| WO2011022014A1 (en) | Configuration of additional display devices | |
| US20080082940A1 (en) | Methods, systems, and computer program products for controlling presentation of a resource based on position or movement of a selector and presentable content | |
| CN112529890A (en) | Method and device for processing track, road side equipment and cloud control platform | |
| CN113515202B (en) | Cursor moving method and device and electronic equipment | |
| GB2532766A (en) | Interaction with a graph for device control | |
| EP3635339B1 (en) | Dynamically varying visual properties of indicators on a digital map | |
| WO2021098878A1 (en) | Method and device for predicting drawing point of stylus pen | |
| CN107077268B (en) | Suggesting a target location as a viewport moves | |
| CN104299460A (en) | Electronic apparatus for providing function of solid figure learning | |
| KR100348181B1 (en) | A computer system and a method for dynamic information display | |
| CN102981641A (en) | Input device and electronic device and method of controlling cursor movement | |
| CN100589076C (en) | Method for showing program graphical interfaces in window title row as well as computer system | |
| CN111127607B (en) | Animation generation method, device, equipment and medium | |
| CN102929910B (en) | Visual and the editor of synthesis layout | |
| US11035948B2 (en) | Virtual reality feedback device, and positioning method, feedback method and positioning system thereof | |
| US20160290822A1 (en) | Route stabilization scrolling mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160113 Termination date: 20210327 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |