CN103220339B - Cursor display packing, device and system in remote operation - Google Patents
Cursor display packing, device and system in remote operation Download PDFInfo
- Publication number
- CN103220339B CN103220339B CN201310100872.0A CN201310100872A CN103220339B CN 103220339 B CN103220339 B CN 103220339B CN 201310100872 A CN201310100872 A CN 201310100872A CN 103220339 B CN103220339 B CN 103220339B
- Authority
- CN
- China
- Prior art keywords
- cursor
- information
- date
- cursor movement
- statistics
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000012856 packing Methods 0.000 title claims abstract description 17
- 230000033001 locomotion Effects 0.000 claims abstract description 125
- 238000004364 calculation method Methods 0.000 claims abstract description 56
- 238000000034 method Methods 0.000 claims abstract description 16
- 230000008859 change Effects 0.000 claims description 15
- 230000005540 biological transmission Effects 0.000 abstract description 6
- 238000004891 communication Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to network data communication technical field, particularly relate to cursor display packing, device and system in a kind of remote operation.Wherein, described method comprises step: according to frame period time and the propagation delay time of remote equipment, the computational prediction time interval; Receive the information of cursor movement on remote equipment, and generate the statistics of cursor; According to the information of described statistics and the up-to-date cursor movement received, predict the cursor in described predicted time interval; And utilize the information of the described up-to-date cursor movement received, interpolation calculation is carried out to predicted cursor, and the cursor of display after interpolation calculation.According to embodiments of the invention, make the cursor of the remote equipment operation that local device shows more smooth and natural, even if when hardware and Internet Transmission environment undesirable, still can provide level and smooth and smooth cursor and respond fast, the remote operation drastically increasing user is experienced.
Description
Technical field
The present invention relates to network data communication technical field, particularly relate to cursor display packing, device and system in a kind of remote operation.
Background technology
Universal along with network, becomes possibility by real-time performance for the control of long-range electronic equipment.So-called Long-distance Control, typically refer to administrative staff and connected the controlled computer being in strange land by the Internet, the desktop environment of controlled computer is shown in local computer, by local computer, the controlled computer being in strange land is configured, software installation procedure, the operation such as amendment.
The operation principle of Long-distance Control is as follows: Long-distance Control needs to be undertaken by network.Be positioned at the issuing side that local computer is operational order, be called main control end, long-range controlled computer is called controlled terminal.Main control end and controlled terminal can be arranged in same local area network (LAN), also can be two or the multiple stage computer being in any position that are connected by the Internet.Usually, in the computer of main control end, build-in services device end program, installs client-side program in the computer of controlled terminal.During use, server in the computer of main control end sends signal to the client-side program in the computer of controlled terminal, set up special remote service, then by this remote service, use various remote control function to send remote control command, the various application programs controlled in the computer of controlled terminal are run.
In remote operation, the fluency of display highlighting pointer directly has influence on the remote operation experience of user.The mode of the long-range cursor of traditional display is the change that every frame detects cursor coordinates, and sent by the coordinate of renewal, the other end upgrades cursor position after receiving new coordinate.Human eye could feel smooth when receiving the image change of more than 30 frames per second.But, be subject to each frame period of detection and the restriction of Network Transmission Delays, even if under computing power and the good situation of network environment, still gratifying effect can not be reached.
Summary of the invention
In view of the above problems, propose the present invention, to provide a kind of the cursor display packing, device and the system that overcome in the problems referred to above or the remote operation that solves the problem at least in part.
According to one aspect of the present invention, provide the cursor display packing in a kind of remote operation, comprise step: according to frame period time and the propagation delay time of remote equipment, the computational prediction time interval; Receive the information of cursor movement on remote equipment, and generate the statistics of cursor; According to the information of described statistics and the up-to-date cursor movement received, predict the cursor in described predicted time interval; And utilize the information of the described up-to-date cursor movement received, interpolation calculation is carried out to predicted cursor, and the cursor of display after interpolation calculation.
Alternatively, cursor display packing according to an embodiment of the invention in remote operation also comprises step: receiving the information of cursor movement on remote equipment and when generating the statistics of cursor, further according to the information of cursor movement on received remote equipment, display highlighting.
Alternatively, in the cursor display packing in remote operation according to an embodiment of the invention, the information of described cursor movement and the statistics of described cursor comprise at least one in following information: the direction of cursor movement, the speed of cursor movement, cursor move the region at place, the curvature of cursor motion track.
Alternatively, in the cursor display packing in remote operation according to an embodiment of the invention, in the described information according to statistics and the up-to-date cursor movement received, predict in the step of the cursor in described predicted time interval, according to the statistics of described cursor and the information of the up-to-date cursor movement received, the situation of change of prediction cursor motion track curvature in described predicted time interval and on track the situation of change of speed, to obtain the cursor in described predicted time interval.
Alternatively, in the cursor display packing in remote operation according to an embodiment of the invention, carry out in the step of interpolation calculation in the described information of the described up-to-date cursor movement received that utilizes to predicted cursor, based on Cubic kolmogorov's differential system formula, the up-to-date cursor coordinates comprised in information for the described up-to-date cursor movement received, according to the one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the information acquisition of the described up-to-date cursor movement received, and the terminal cursor coordinates of the cursor predicted, carry out interpolation calculation.
Alternatively, in the cursor display packing in remote operation according to an embodiment of the invention, in the step in the described frame period time according to remote equipment and the computational prediction time interval in propagation delay time, frame period time of described remote equipment and propagation delay time are sued for peace, to obtain described predicted time interval.
According to another aspect of the present invention, additionally provide the cursor display unit in a kind of remote operation, comprise: network interface, be suitable for the information receiving cursor movement on remote equipment, to generate the statistics of cursor, and the information about frame period time and propagation delay time obtaining that remote equipment provides; Predicted time Band Computer, is suitable for the frame period time according to remote equipment and propagation delay time, the computational prediction time interval; Cursor fallout predictor, is suitable for the information according to described statistics and the up-to-date cursor movement received, predicts the cursor in described predicted time interval; Interpolation calculation device, is suitable for the information utilizing the described up-to-date cursor movement received, carries out interpolation calculation to predicted cursor; And display, be suitable for showing the cursor after interpolation calculation.
Alternatively, in the cursor display unit in remote operation according to an embodiment of the invention, described network interface receive cursor movement on remote equipment information and when generating the statistics of cursor, described display further according to the information of cursor movement on received remote equipment, display highlighting.
Alternatively, in the cursor display unit in remote operation according to an embodiment of the invention, the information of described cursor movement and the statistics of described cursor comprise at least one in following information: the direction of cursor movement, the speed of cursor movement, cursor move the region at place, the curvature of cursor motion track.
Alternatively, in the cursor display unit in remote operation according to an embodiment of the invention, described cursor fallout predictor is according to the information of the statistics of described cursor and the up-to-date cursor movement received, the situation of change of prediction cursor motion track curvature in described predicted time interval and on track the situation of change of speed, to obtain the cursor in described predicted time interval.
Alternatively, in the cursor display unit in remote operation according to an embodiment of the invention, described interpolation calculation device is based on Cubic kolmogorov's differential system formula, the up-to-date cursor coordinates comprised in information for the described up-to-date cursor movement received, according to the one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the information acquisition of the described up-to-date cursor movement received and the terminal cursor coordinates of cursor predicted, carry out interpolation calculation.
Alternatively, in the cursor display unit in remote operation according to an embodiment of the invention, described predicted time Band Computer was sued for peace to the frame period time of described remote equipment and propagation delay time, to obtain described predicted time interval.
According to another aspect of the present invention, additionally provide the cursor display system in a kind of remote operation, comprise the cursor display unit in remote operation according to the present invention; And remote equipment, be suitable for providing described frame period time and propagation delay time to described device, and send the information of cursor movement to described device.
The invention provides cursor display packing, device and the system in above-mentioned remote operation.According to embodiments of the invention, can according to the frame period time of remote equipment and propagation delay time, the computational prediction time interval, receive the information of cursor movement on remote equipment and generate the statistics of cursor, according to the information of described statistics and the up-to-date cursor movement received, the cursor of prediction in described predicted time interval, utilize the information of the described up-to-date cursor movement received, interpolation calculation is carried out to predicted cursor, and the cursor of display after interpolation calculation.Thus, can constantly improve according to the statistics of user's operation information for cursor and adjust, the statistics obtained is utilized to carry out the prediction of cursor, and interpolation calculation is carried out to predicted cursor, thus make the cursor of the remote equipment operation that local device shows more smooth and natural, even if when hardware and Internet Transmission environment undesirable, still can provide level and smooth and smooth cursor and respond fast, the remote operation drastically increasing user is experienced.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to technological means of the present invention can be better understood, and can be implemented according to the content of specification, and can become apparent, below especially exemplified by the specific embodiment of the present invention to allow above and other objects of the present invention, feature and advantage.
Accompanying drawing explanation
By reading hereafter detailed description of the preferred embodiment, various other advantage and benefit will become cheer and bright for those of ordinary skill in the art.Accompanying drawing only for illustrating the object of preferred implementation, and does not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:
Fig. 1 is the flow chart of cursor display packing according to an embodiment of the invention;
Fig. 2 is the schematic diagram of curvature estimation according to an embodiment of the invention; And
Fig. 3 is the block diagram of cursor display system according to an embodiment of the invention.
Embodiment
Below with reference to accompanying drawings exemplary embodiment of the present disclosure is described in more detail.Although show exemplary embodiment of the present disclosure in accompanying drawing, however should be appreciated that can realize the disclosure in a variety of manners and not should limit by the embodiment set forth here.On the contrary, provide these embodiments to be in order to more thoroughly the disclosure can be understood, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.
Principle of the present invention is applicable to any electronic equipment comprising display and processing unit, including, but not limited to: based on the computer of the desktop operating systems such as Windows, Linux, MacOS, Unix; Based on the mobile phone, panel computer, video player, electronic reader, DPF etc. of the Mobile operating systems such as iOS, Android, WindowsPhone, Symbian.Alternatively, local device and remote equipment can be the electronic equipment of same item type, such as, between two computers, realize remote operation, can be also dissimilar electronic equipment, such as, between panel computer and mobile phone, realize remote operation.
Hereinafter, by using computer as the example of local device and remote equipment, principle of the present invention is exemplarily described.But this is just in order to describe the present invention with concrete example, and to help reader understanding's principle of the present invention, scope of the present invention is not limited thereto, but go for anyly comprising display and processing unit, electronic equipment based on any operating system.
Fig. 1 schematically illustrates the flow chart of cursor display packing 100 according to an embodiment of the invention.As shown in Figure 1, method 100 starts from step S101, wherein, according to frame period time and the propagation delay time of remote equipment, and the computational prediction time interval.According to embodiments of the invention, the frame period time of described remote equipment is each detection remote equipment cursor position time separately, and the propagation delay time is the time of delay brought due to Internet Transmission.Alternatively, can sue for peace to the frame period time of described remote equipment and propagation delay time, to obtain described predicted time interval.
According to embodiments of the invention, described cursor can be such as the sensing equipment of electronic equipment (such as, mouse, trace ball, touch pad etc.) at the upper cursor shown of the display unit (such as, the display of computer, the display screen etc. of panel computer) of electronic equipment.
After step slol, perform step S103, wherein, receive the information of cursor movement on remote equipment, and generate the statistics of cursor.According to embodiments of the invention, the information of described cursor movement and the statistics of described cursor can comprise at least one in following information: the direction of cursor movement, the speed of cursor movement, cursor move the region at place, the curvature of cursor motion track.
Such as, the direction of cursor movement can comprise move from left to right, move from the top down, mobile to the right from upper left with a certain slope, mobile etc. to left down from upper right with a certain slope; The speed of cursor movement can comprise the average speed, instantaneous velocity, instantaneous acceleration etc. of cursor along a certain track movement; The region that cursor moves place can comprise screen center region, screen border area etc.; The curvature of cursor motion track can be that the tangent directional angle of certain point on cursor motion track curve is to the rotation rate of arc length.For example, see Fig. 3, it illustrates the schematic diagram of curvature estimation according to an embodiment of the invention.Such as, curve C D puts A and point of proximity A' and respectively does a tangent line, the arc length between some A and some A' is Δ S, and two tangent line angles are α, then curve C D in the curvature of A point is:
According to embodiments of the invention, in step s 103, can using the direction of above-mentioned cursor movement, the speed of cursor movement, cursor moves the region at place, the information of this Four types of cursor motion track is added up as four class data, to obtain the operating habit of user.
According to embodiments of the invention, in step s 103, receiving the information of cursor movement on remote equipment and when generating the statistics of cursor, can further according to the information of cursor movement on received remote equipment, display highlighting.Such as, can in the upper cursor position shown on the up-to-date remote equipment received of the display unit of local device (display of such as computer).
After step s 103, perform step S105, wherein, according to the information of described statistics and the up-to-date cursor movement received, predict the cursor in the predicted time interval that calculates in above-mentioned steps S101.Such as, didactic method can be adopted, according to the operating habit of the user reflected in described statistics and the information of the up-to-date cursor movement received, predict.Such as, based on the information of the up-to-date cursor movement received, the track of the most possible movement occurred in predicted time interval can be found in statistics, just can calculate the cursor of prediction thus.
According to embodiments of the invention, in above-mentioned steps S105, can according to the information of the statistics of described cursor and the up-to-date cursor movement received, the situation of change of prediction cursor motion track curvature in described predicted time interval and on track the situation of change of speed, to obtain the cursor in described predicted time interval.
Next, perform step S107, wherein, utilize the information of the described up-to-date cursor movement received, interpolation calculation is carried out to predicted cursor, and the cursor of display after interpolation calculation.Due to prediction cursor and the cursor of reality between be difficult to invariably can there is error, in order to reduce such error, just can utilize the information of the described up-to-date cursor movement received, interpolation calculation be carried out to predicted cursor, to realize the transition of smooth trajectory.
According to embodiments of the invention, in described step S107, can based on Cubic kolmogorov's differential system formula, the up-to-date cursor coordinates comprised in information for the described up-to-date cursor movement received, according to the one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the information acquisition of the described up-to-date cursor movement received and the terminal cursor coordinates of cursor predicted, carry out interpolation calculation.
Following Cubic kolmogorov's differential system formula can be adopted to carry out interpolation calculation:
B(t)=P
0(1-t)
3+3P
1t(1-t)
2+3P
2t
2(1-t)+P
3t
3，t∈[0，1]。
Wherein, P
0the up-to-date cursor coordinates comprised in information for the described up-to-date cursor movement received, P
1for the terminal cursor coordinates of predicted cursor, and P
2and P
3for the P of the information acquisition according to the described up-to-date cursor movement received
0two cursor coordinates on moving direction, such as, P
2and P
3p can be respectively
0p on moving direction
0the coordinate at interval and P sometime before
0the coordinate at interval sometime afterwards, B (t) is the coordinate utilizing above-mentioned Cubic kolmogorov's differential system formula to carry out interpolation calculation to obtain.
The mode of above-mentioned interpolation calculation is only example, to help reader understanding's principle of the present invention.Those skilled in the art can adopt other interpolation calculation mode to reach identical or similar object.
After carrying out described interpolation calculation, can in the above cursor of display after interpolation calculation of the display unit (display of such as computer) at local device.
The invention discloses the cursor display packing in a kind of remote operation.According to embodiments of the invention, can according to the frame period time of remote equipment and propagation delay time, the computational prediction time interval, receive the information of cursor movement on remote equipment and generate the statistics of cursor, according to the information of described statistics and the up-to-date cursor movement received, the cursor of prediction in described predicted time interval, utilize the information of the described up-to-date cursor movement received, interpolation calculation is carried out to predicted cursor, and the cursor of display after interpolation calculation.Thus, can constantly improve according to the statistics of user's operation information for cursor and adjust, the statistics obtained is utilized to carry out the prediction of cursor, and interpolation calculation is carried out to predicted cursor, thus make the cursor of the remote equipment operation that local device shows more smooth and natural, even if when hardware and Internet Transmission environment undesirable, still can provide level and smooth and smooth cursor and respond fast, the remote operation drastically increasing user is experienced.
Corresponding with said method 100, present invention also offers the cursor display unit 200 in a kind of remote operation.Fig. 3 schematically illustrates the block diagram of cursor display system 1000 according to an embodiment of the invention, and wherein, system 1000 comprises described device 200 and remote equipment 300.
As shown in Figure 3, device 200 can comprise network interface 201, predicted time Band Computer 203, cursor fallout predictor 205, interpolation calculation device 207 and display 209.
According to the present invention, network interface 201 is suitable for the information receiving cursor movement on remote equipment, to generate the statistics of cursor, and the information about frame period time and propagation delay time obtaining that remote equipment provides; Predicted time Band Computer 203 is suitable for frame period time according to remote equipment and propagation delay time, the computational prediction time interval; Cursor fallout predictor 205 is suitable for the information according to described statistics and the up-to-date cursor movement received, and predicts the cursor in described predicted time interval; Interpolation calculation device 207 is suitable for the information utilizing the described up-to-date cursor movement received, and carries out interpolation calculation to predicted cursor; And display 209 is suitable for showing the cursor after interpolation calculation.
Above-mentioned network interface 201, predicted time Band Computer 203, cursor fallout predictor 205, interpolation calculation device 207, display 209 may be used for performing step S101 in above-mentioned cursor display packing 100, S103, S105, S107.
According to embodiments of the invention, first, network interface 201 can receive the information of cursor movement on remote equipment, to generate the statistics of cursor, and the information about frame period time and propagation delay time obtaining that remote equipment provides.
According to embodiments of the invention, the information of described cursor movement and the statistics of described cursor can comprise at least one in following information: the direction of cursor movement, the speed of cursor movement, cursor move the region at place, the curvature of cursor motion track.
Such as, the direction of cursor movement can comprise move from left to right, move from the top down, mobile to the right from upper left with a certain slope, mobile etc. to left down from upper right with a certain slope; The speed of cursor movement can comprise the average speed, instantaneous velocity, instantaneous acceleration etc. of cursor along a certain track movement; The region that cursor moves place can comprise screen center region, screen border area etc.; The curvature of cursor motion track can be that the tangent directional angle of certain point on cursor motion track curve is to the rotation rate of arc length.For example, see Fig. 3, it illustrates the schematic diagram of curvature estimation according to an embodiment of the invention.Such as, curve C D puts A and point of proximity A' and respectively does a tangent line, the arc length between some A and some A' is Δ S, and two tangent line angles are α, then curve C D in the curvature of A point is:
according to embodiments of the invention, network interface 201 can using the direction of above-mentioned cursor movement, the speed of cursor movement, cursor moves the region at place, the information of this Four types of cursor motion track is added up as four class data, to obtain the operating habit of user.
According to embodiments of the invention, the frame period time of described remote equipment is each detection remote equipment cursor position time separately, and the propagation delay time is the time of delay brought due to Internet Transmission.
According to embodiments of the invention, when described network interface 201 receives the information of cursor movement on remote equipment and generates the statistics of cursor, described display 209 can further according to the information of cursor movement on received remote equipment, display highlighting.
Then, predicted time Band Computer 203 can according to the frame period time of remote equipment and propagation delay time, the computational prediction time interval.Alternatively, predicted time Band Computer 203 can be sued for peace to the frame period time of described remote equipment and propagation delay time, to obtain described predicted time interval.
Then, cursor fallout predictor 205 according to the information of described statistics and the up-to-date cursor movement received, can predict the cursor in described predicted time interval.Such as, cursor fallout predictor 205 can adopt didactic method, according to the operating habit of the user reflected in described statistics and the information of the up-to-date cursor movement received, predicts.Such as, cursor fallout predictor 205 based on the information of the up-to-date cursor movement received, can find the track of the most possible movement occurred in predicted time interval, just can calculate the cursor of prediction thus in statistics.
According to embodiments of the invention, cursor fallout predictor 205 can according to the information of the statistics of described cursor and the up-to-date cursor movement received, the situation of change of prediction cursor motion track curvature in described predicted time interval and on track the situation of change of speed, to obtain the cursor in described predicted time interval.
Next, interpolation calculation device 207 can utilize the information of the described up-to-date cursor movement received, and carries out interpolation calculation to predicted cursor.Due to prediction cursor and the cursor of reality between be difficult to invariably can there is error, in order to reduce such error, interpolation calculation device 207 just can utilize the information of the described up-to-date cursor movement received, interpolation calculation is carried out to predicted cursor, to realize the transition of smooth trajectory.
According to embodiments of the invention, interpolation calculation device 207 can based on Cubic kolmogorov's differential system formula, the up-to-date cursor coordinates comprised in information for the described up-to-date cursor movement received, according to the one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the information acquisition of the described up-to-date cursor movement received and the terminal cursor coordinates of cursor predicted, carry out interpolation calculation.
Alternatively, described interpolation calculation device 207 can such as adopt following Cubic kolmogorov's differential system formula to carry out interpolation calculation:
B(t)=P
0(1-t)
3+3P
1t(1-t)
2+3P
2t
2(1-t)+P
3t
3，t∈[0，1]。
Wherein, P
0the up-to-date cursor coordinates comprised in information for the described up-to-date cursor movement received, P
1for the terminal cursor coordinates of predicted cursor, and P
2and P
3for the P of the information acquisition according to the described up-to-date cursor movement received
0two cursor coordinates on moving direction, such as, P
2and P
3p can be respectively
0p on moving direction
0the coordinate at interval and P sometime before
0the coordinate at interval sometime afterwards, B (t) is the coordinate that interpolation calculation device 207 utilizes above-mentioned Cubic kolmogorov's differential system formula to carry out interpolation calculation to obtain.
The mode that above-mentioned interpolation calculation device 207 carries out interpolation calculation is only example, to help reader understanding's principle of the present invention.Those skilled in the art can adopt other interpolation calculation mode to reach identical or similar object.
After carrying out described interpolation calculation, display 209 can show the cursor after interpolation calculation.
Because above-mentioned each device embodiment is corresponding with aforementioned approaches method embodiment, therefore no longer each device embodiment is described in detail.
According to another aspect of the invention, additionally provide the cursor display system 1000 in a kind of remote operation, as shown in Figure 3, system 1000 can comprise: the cursor display unit 200 in above-mentioned remote operation; And remote equipment 300, it is suitable for providing described frame period time and propagation delay time to described device 200, and sends the information of cursor movement to described device.
Intrinsic not relevant to any certain computer, virtual system or miscellaneous equipment with display at this algorithm provided.Various general-purpose system also can with use based on together with this teaching.According to description above, the structure constructed required by this type systematic is apparent.In addition, the present invention is not also for any certain programmed language.It should be understood that and various programming language can be utilized to realize content of the present invention described here, and the description done language-specific is above to disclose preferred forms of the present invention.
In specification provided herein, describe a large amount of detail.But can understand, embodiments of the invention can be put into practice when not having these details.In some instances, be not shown specifically known method, structure and technology, so that not fuzzy understanding of this description.
Similarly, be to be understood that, in order to simplify the disclosure and to help to understand in each inventive aspect one or more, in the description above to exemplary embodiment of the present invention, each feature of the present invention is grouped together in single embodiment, figure or the description to it sometimes.But, the method for the disclosure should be construed to the following intention of reflection: namely the present invention for required protection requires feature more more than the feature clearly recorded in each claim.Or rather, as claims below reflect, all features of disclosed single embodiment before inventive aspect is to be less than.Therefore, the claims following embodiment are incorporated to this embodiment thus clearly, and wherein each claim itself is as independent embodiment of the present invention.
Those skilled in the art are appreciated that and adaptively can change the module in the device in embodiment and they are arranged in one or more devices different from this embodiment.Some block combiner in embodiment can be become a module or unit or assembly, and multiple submodule or subelement or sub-component can be put them in addition.Except at least some in such feature and/or process or module be mutually repel except, any combination can be adopted to combine all processes of all features disclosed in this specification (comprising adjoint claim, summary and accompanying drawing) and so disclosed any method or equipment or unit.Unless expressly stated otherwise, each feature disclosed in this specification (comprising adjoint claim, summary and accompanying drawing) can by providing identical, equivalent or similar object alternative features replaces.
In addition, those skilled in the art can understand, although embodiments more described herein to comprise in other embodiment some included feature instead of further feature, the combination of the feature of different embodiment means and to be within scope of the present invention and to form different embodiments.Such as, in detail in the claims, the one of any of embodiment required for protection can use with arbitrary compound mode.
Each device embodiment of the present invention with hardware implementing, or can realize with the software module run on one or more processor, or realizes with their combination.It will be understood by those of skill in the art that the some or all functions that microprocessor or digital signal processor (DSP) can be used in practice to realize according to the some or all modules in the device of the embodiment of the present invention.The present invention can also be embodied as part or all the device program (such as, computer program and computer program) for performing method as described herein.Realizing program of the present invention and can store on a computer-readable medium like this, or the form of one or more signal can be had.Such signal can be downloaded from internet website and obtain, or provides on carrier signal, or provides with any other form.
The present invention will be described instead of limit the invention to it should be noted above-described embodiment, and those skilled in the art can design alternative embodiment when not departing from the scope of claims.In the claims, any reference symbol between bracket should be configured to limitations on claims.Word " comprises " not to be got rid of existence and does not arrange element in the claims or step.Word "a" or "an" before being positioned at element is not got rid of and be there is multiple such element.The present invention can by means of including the hardware of some different elements and realizing by means of the computer of suitably programming.In the unit claim listing some devices, several in these devices can be carry out imbody by same hardware branch.Word first, second and third-class use do not represent any order.Can be title by these word explanations.
Claims (11)
1. the cursor display packing (100) in a remote operation, comprises step:
According to frame period time and the propagation delay time of remote equipment, the computational prediction time interval (S101);
Receive the information of cursor movement on remote equipment, and generate the statistics (S103) of cursor;
According to the information of described statistics and the up-to-date cursor movement received, predict the cursor (S105) in described predicted time interval; And
Utilize the information of the described up-to-date cursor movement received, interpolation calculation is carried out to predicted cursor, and the cursor (S107) of display after interpolation calculation;
The information of wherein said cursor movement and the statistics of described cursor comprise the direction of cursor movement, the speed of cursor movement, cursor move the region at place and the curvature of cursor motion track.
2. the method for claim 1, also comprises step:
Receiving the information of cursor movement on remote equipment and when generating statistics (S103) of cursor, further according to the information of cursor movement on received remote equipment, display highlighting.
3. method as claimed in claim 1 or 2, wherein in the described information according to statistics and the up-to-date cursor movement received, predict in the step (S105) of the cursor in described predicted time interval, according to the statistics of described cursor and the information of the up-to-date cursor movement received, the situation of change of prediction cursor motion track curvature in described predicted time interval and on track the situation of change of speed, to obtain the cursor in described predicted time interval.
4. method as claimed in claim 1 or 2, wherein carry out in the step of interpolation calculation in the described information of the described up-to-date cursor movement received that utilizes to predicted cursor, based on Cubic kolmogorov's differential system formula, the up-to-date cursor coordinates comprised in information for the described up-to-date cursor movement received, according to the one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the information acquisition of the described up-to-date cursor movement received and the terminal cursor coordinates of cursor predicted, carry out interpolation calculation.
5. method as claimed in claim 1 or 2, wherein in the step (S101) in the described frame period time according to remote equipment and the computational prediction time interval in propagation delay time, frame period time of described remote equipment and propagation delay time are sued for peace, to obtain described predicted time interval.
6. the cursor display unit (200) in a remote operation, comprising:
Network interface (201), is suitable for the information receiving cursor movement on remote equipment, to generate the statistics of cursor, and the information about frame period time and propagation delay time obtaining that remote equipment provides;
Predicted time Band Computer (203), is suitable for the frame period time according to remote equipment and propagation delay time, the computational prediction time interval;
Cursor fallout predictor (205), is suitable for the information according to described statistics and the up-to-date cursor movement received, predicts the cursor in described predicted time interval;
Interpolation calculation device (207), is suitable for the information utilizing the described up-to-date cursor movement received, carries out interpolation calculation to predicted cursor; And
Display (209), is suitable for showing the cursor after interpolation calculation;
The information of wherein said cursor movement and the statistics of described cursor comprise the direction of cursor movement, the speed of cursor movement, cursor move the region at place and the curvature of cursor motion track.
7. device as claimed in claim 6, wherein said network interface (201) receive cursor movement on remote equipment information and when generating the statistics of cursor, described display (209) further according to the information of cursor movement on received remote equipment, display highlighting.
8. device as claimed in claims 6 or 7, wherein said cursor fallout predictor (205) is according to the information of the statistics of described cursor and the up-to-date cursor movement received, the situation of change of prediction cursor motion track curvature in described predicted time interval and on track the situation of change of speed, to obtain the cursor in described predicted time interval.
9. device as claimed in claims 6 or 7, wherein said interpolation calculation device (207) is based on Cubic kolmogorov's differential system formula, the up-to-date cursor coordinates comprised in information for the described up-to-date cursor movement received, according to the one or more cursor coordinates on the described up-to-date cursor coordinates moving direction of the information acquisition of the described up-to-date cursor movement received and the terminal cursor coordinates of cursor predicted, carry out interpolation calculation.
10. device as claimed in claims 6 or 7, wherein said predicted time Band Computer (203) was sued for peace to the frame period time of described remote equipment and propagation delay time, to obtain described predicted time interval.
Cursor display system (1000) in 11. 1 kinds of remote operations, comprising:
Device (200) according to any one of claim 6-10; And
Remote equipment (300), is suitable for providing described frame period time and propagation delay time to described device (200), and sends the information of cursor movement to described device (200).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310100872.0A CN103220339B (en) | 2013-03-27 | 2013-03-27 | Cursor display packing, device and system in remote operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310100872.0A CN103220339B (en) | 2013-03-27 | 2013-03-27 | Cursor display packing, device and system in remote operation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103220339A CN103220339A (en) | 2013-07-24 |
| CN103220339B true CN103220339B (en) | 2016-01-13 |
Family
ID=48817790
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310100872.0A Expired - Fee Related CN103220339B (en) | 2013-03-27 | 2013-03-27 | Cursor display packing, device and system in remote operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103220339B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180036469A1 (en) * | 2016-08-05 | 2018-02-08 | Fresenius Medical Care Holdings, Inc. | Remote User Interfaces for Dialysis Systems |
| CN108089831A (en) * | 2017-12-08 | 2018-05-29 | 威创集团股份有限公司 | Position identification display method, device and storage medium |
| CN110928449B (en) * | 2019-11-26 | 2023-06-23 | 北京集创北方科技股份有限公司 | Point reporting method and device of touch screen, electronic equipment and storage medium |
| CN111682988B (en) * | 2020-06-18 | 2022-10-04 | 重庆京像微电子有限公司 | Remote control method, device, storage medium and processor |
| CN111857462B (en) * | 2020-06-29 | 2022-02-18 | 浪潮(北京)电子信息产业有限公司 | Server, cursor synchronization method and device, and computer readable storage medium |
| CN112732105B (en) * | 2020-12-31 | 2023-03-28 | 贵阳动视云科技有限公司 | Mouse jitter control method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1991710A (en) * | 2005-12-27 | 2007-07-04 | 宏正自动科技股份有限公司 | Remote control method, device and computer switcher |
| CN101377724A (en) * | 2007-08-29 | 2009-03-04 | 富士通电子零件有限公司 | Information processing apparatus, KVM switch, server, and program |
| CN102591493A (en) * | 2011-12-30 | 2012-07-18 | 浙江海康科技有限公司 | Mouse cursor synchronization method for internet protocol K virtual machine (IPKVM) system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4429353B2 (en) * | 2007-11-15 | 2010-03-10 | Ｓｋｙ株式会社 | Capture image recording apparatus and capture image recording program |
-
2013
- 2013-03-27 CN CN201310100872.0A patent/CN103220339B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1991710A (en) * | 2005-12-27 | 2007-07-04 | 宏正自动科技股份有限公司 | Remote control method, device and computer switcher |
| CN101377724A (en) * | 2007-08-29 | 2009-03-04 | 富士通电子零件有限公司 | Information processing apparatus, KVM switch, server, and program |
| CN102591493A (en) * | 2011-12-30 | 2012-07-18 | 浙江海康科技有限公司 | Mouse cursor synchronization method for internet protocol K virtual machine (IPKVM) system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103220339A (en) | 2013-07-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103220339B (en) | Cursor display packing, device and system in remote operation | |
| CN107422893B (en) | Prediction-based position tracking method | |
| KR101785748B1 (en) | Multi-layer user interface with flexible parallel and orthogonal movement | |
| CN102163096B (en) | Signal conditioning package, information processing method | |
| US9384711B2 (en) | Speculative render ahead and caching in multiple passes | |
| CA2787112A1 (en) | Multi-layer user interface with flexible parallel movement | |
| CN108469979A (en) | A kind of method for page jump, device, server and storage medium | |
| US9501327B2 (en) | Concurrently processing parts of cells of a data structure with multiple processes | |
| CN105335069A (en) | Method and device for generating sliding track in touch screen equipment | |
| CN102929415A (en) | Local monitor and mouse display synchronization method for local monitor and remote virtual machine | |
| WO2021098878A1 (en) | Method and device for predicting drawing point of stylus pen | |
| CN108776544A (en) | Exchange method and device, storage medium, electronic equipment in augmented reality | |
| GB2601054A (en) | Tracking and restoring pointer positions among applications | |
| CN105975119A (en) | Multi-target tracking method, and touch screen control method and system | |
| CN102939586B (en) | Localization place and route in mutual chart system | |
| KR102092979B1 (en) | Interactive control of the curvature of links | |
| CN103309581B (en) | A kind of method of progress bar location and device | |
| CN104299460A (en) | Electronic apparatus for providing function of solid figure learning | |
| US9464915B1 (en) | Route stabilization scrolling mode | |
| CN102929910B (en) | Visual and the editor of synthesis layout | |
| CN104216517A (en) | Information processing method and electronic equipment | |
| CN112025704B (en) | Real-time distributed robot control method and system based on memory type database | |
| CN104765680A (en) | Method and device for automatically testing software | |
| CN114949842A (en) | Virtual object switching method and device, storage medium and electronic equipment | |
| CN113108795A (en) | Arbitrary-order AGV curve route generation method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160113 Termination date: 20210327 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |