CN116382534A

CN116382534A - Control method, system and medium for mouse display in remote desktop system

Info

Publication number: CN116382534A
Application number: CN202310245932.1A
Authority: CN
Inventors: 杨璐
Original assignee: Xian Wanxiang Electronics Technology Co Ltd
Current assignee: Xian Wanxiang Electronics Technology Co Ltd
Priority date: 2023-03-15
Filing date: 2023-03-15
Publication date: 2023-07-04

Abstract

The disclosure relates to a control method, a system and a medium for mouse display in a remote desktop system. Comprising the following steps: after establishing connection with a receiving end, detecting mouse actions; when the mouse action is detected, determining a mouse graph used by the mouse action, and a mouse theme mark and a mouse graph mark corresponding to the mouse graph from the cached mouse theme data; and sending the mouse theme mark and the mouse graphic mark corresponding to the mouse graphic and the action information corresponding to the mouse action to the receiving end, so that the receiving end can draw the mouse pointer according to the mouse theme mark and the mouse graphic mark and act on the mouse pointer according to the action information corresponding to the mouse action. According to the method and the device, all mouse subjects of the mouse are synchronized from a sending end to a receiving end when connected, and only theme marks, graphic marks and actions are required to be transmitted later. Therefore, the display smoothness of the mouse animation can be further improved, and the problem that the mouse deforms and continuously flickers is solved.

Description

Control method, system and medium for mouse display in remote desktop system

Technical Field

The embodiment of the disclosure relates to the technical field of remote desktops, in particular to a control method, a system and a medium for mouse display in a remote desktop system.

Background

The existing remote desktop technology has two implementation modes, namely, a remote mouse directly collects and sends the remote desktop mouse and a picture to a receiving end, and the mode has the defects of high delay, serious dependence on the frame rate fluency of the picture, and serious reduction of operation experience when the picture is blocked.

Alternatively, the mouse is drawn locally at the receiving end, also referred to as a local mouse. The method is also a technology which is most commonly used at present, the image of the acquisition end is acquired separately from the shape of the mouse, when the mouse image changes in real time, the image data of the receiving end is updated, and the shape of the mouse is actually drawn on the receiving end. Part of the prior art adopts a receiving end caching mode to store the mouse shape which is already appeared, and only the mark ID is transmitted subsequently, so that the dependence on a network is reduced.

Regarding the above technical solution, the applicant found that the manner of the local mouse causes a flicker when the shape of the mouse is animated or when the change is rapidly complicated, and the display effect of the receiving end is poor. In addition, the real-time transmission of the mouse-shaped picture has certain dependence on the network bandwidth; although the position information does not have time delay, the mouse deformation has a certain time delay at the receiving end; even with local buffering, retransmission is always required when the mouse shape first appears. Meanwhile, if the mouse theme changes, the sending end triggers more mouse shape transmission requirements.

Accordingly, there is a need to improve one or more problems in the related art as described above.

It should be noted that the information disclosed in the above background section is only for enhancing understanding of the background of the present disclosure and thus may include information that does not constitute prior art known to those of ordinary skill in the art.

Disclosure of Invention

An objective of the disclosed embodiments is to provide a method, a system and a medium for controlling mouse display in a remote desktop system, so as to at least solve one or more problems in the related technical schemes.

The invention adopts the following technical scheme:

in a first aspect, the present invention provides a method for controlling a mouse display in a remote desktop system, where the method is applied to a sending end, and includes:

after establishing connection with a receiving end, performing mouse action detection;

when a mouse action is detected, determining a mouse graph used by the mouse action from the cached mouse theme data, and determining a mouse theme mark and a mouse graph mark corresponding to the mouse graph;

the method comprises the steps that a mouse theme mark and a mouse graphic mark corresponding to the mouse graphic and action information corresponding to the mouse action are sent to the receiving end, so that the receiving end can draw the mouse pointer according to the mouse theme mark and the mouse graphic mark and act on the mouse pointer according to the action information corresponding to the mouse action;

Each group of mouse topics comprises a plurality of mouse graphics, different mouse topics are marked by different mouse topic marks, and different mouse graphics are marked by different mouse graphic marks; when the mouse graphics are animation, the mouse graphics are marked by a group of graphics frames and frame interval information corresponding to the animation.

Optionally, before the mouse action detection, the method further includes: the mouse theme synchronization of the transmitting end and the receiving end is carried out in the following mode:

comparing the mouse theme data in the cache with the mouse theme of the receiving end, so as to determine a target mouse theme which exists in the cache but does not exist in the receiving end;

and sending the data of the target mouse theme to a receiving end.

Optionally, the comparing the mouse theme data based on the cache with the mouse theme of the receiving end so as to determine a target mouse theme existing in the cache but not in the receiving end, including:

when the mouse theme data exist in the cache, the mouse theme comparison is carried out according to the following mode:

acquiring a mouse theme mark from the mouse theme data and marking the mouse theme mark as a first mouse theme mark;

Marking the mouse theme mark acquired from the receiving end as a second mouse theme mark;

comparing the first mouse theme mark with a second mouse theme mark so as to determine a target mouse theme mark which exists in the first mouse theme mark but does not exist in the second mouse theme mark;

when the mouse theme data do not exist in the cache, the mouse theme comparison is performed according to the following mode:

generating mouse theme data according to the local currently installed mouse theme file, and writing the generated mouse theme data into the cache; the generated mouse theme data comprises: mouse theme marks corresponding to the mouse themes, mouse graphics contained in the mouse themes and mouse graphics marks corresponding to the mouse graphics;

acquiring a mouse theme mark from the mouse theme data written in the cache and marking the mouse theme mark as a third mouse theme mark;

marking the mouse theme mark acquired from the receiving end as a fourth mouse theme mark;

and comparing the third mouse theme mark with a fourth mouse theme mark so as to determine a target mouse theme mark which exists in the third mouse theme mark but does not exist in the fourth mouse theme mark.

Optionally, the sending the data of the target mouse theme to the receiving end includes:

and sending the mouse theme marks of the target mouse theme, the mouse graphics contained in the target mouse theme and the graphic marks corresponding to the mouse graphics to a receiving end.

Optionally, the method further comprises:

and detecting whether the synchronized mouse theme data changes according to a preset frequency, and writing the changed mouse theme data into the cache.

Optionally, the detecting whether the synchronized mouse theme data changes includes:

sequentially acquiring data of each mouse theme in a local currently installed mouse theme file;

and comparing the data of the currently acquired mouse theme with the data of the mouse theme in the cache so as to determine whether the currently acquired mouse theme is a changed mouse theme.

Optionally, the comparing the data of the currently acquired mouse theme with the data of the mouse theme in the cache to determine whether the currently acquired mouse theme is a changed mouse theme includes:

determining the data length of the currently acquired data of the mouse theme;

Judging whether mouse subjects with the same data length exist in the cache;

if the current acquired mouse theme does not exist, determining the current acquired mouse theme as the changed mouse theme;

if yes, further determining whether a mouse theme which is identical to the content of the data of the currently acquired mouse theme exists in the mouse theme with the same data length based on a memory block comparison method, if yes, determining that the currently acquired mouse theme is the unchanged mouse theme, and if not, determining that the currently acquired mouse theme is the changed mouse theme.

determining the size of each mouse graph contained in the currently acquired mouse theme;

judging whether mouse subjects containing mouse graphs with the same size exist in the cache;

if so, further determining whether the characteristic value of each mouse graph in the mouse topics containing the mouse graphs with the same size is the same as the characteristic value of each mouse graph contained in the currently acquired mouse topic, if so, determining that the acquired mouse topic is the unchanged mouse topic, and if not, determining that the acquired mouse topic is the changed mouse topic.

Optionally, writing the changed mouse subject into the cache includes:

generating a mouse theme mark corresponding to the changed mouse theme and a graphic mark of each mouse graphic contained in the changed mouse theme;

and writing the generated mouse theme marks, the generated mouse graphic marks and the generated mouse graphics contained in the changed mouse theme into the cache.

Optionally, after the sending end and the receiving end are disconnected, the mouse theme data in the cache are emptied or not emptied according to a preset rule.

Optionally, the mouse theme mark is generated by:

performing hash calculation on the data of the mouse theme based on an MD5 information abstract algorithm, and taking the obtained calculation result as a theme mark of the mouse theme; or,

extracting image features of each mouse graph contained in the mouse theme, performing mathematical operation on the extracted image features of each mouse graph and size data of the corresponding mouse graph to obtain a plurality of mathematical operation results, performing splicing processing on the plurality of mathematical operation results, and taking the spliced results as theme marks of the mouse theme.

In a second aspect, the present invention provides a method for controlling a mouse display in a remote desktop system, where the method is applied to a receiving end, and includes:

establishing connection with a transmitting end;

receiving a theme mark and a graphic mark corresponding to a mouse action sent by a sending end;

determining the theme mark and the mouse graph corresponding to the graph mark from the local mouse theme at the receiving end, and drawing a mouse pointer according to the theme mark and the mouse graph corresponding to the graph mark; meanwhile, the mouse pointer is operated according to the action information;

Optionally, after the connection is established with the transmitting end, the method further includes: the method comprises the following steps of performing mouse theme synchronization with a transmitting end:

the method comprises the steps of sending a mouse theme mark of a local mouse theme of a receiving end to the sending end so that the sending end can determine whether mouse themes on two sides are different according to the received mouse theme mark;

And when the comparison results of the sending ends are different, receiving the data of the target mouse theme sent by the sending end and storing the data in a local place.

In a third aspect, the present invention provides a remote desktop system, where the system is applied to a transmitting end, and includes:

the mouse action detection module is used for carrying out mouse action detection after connection is established with the receiving end;

the mark determining module is used for determining a mouse graph used by the mouse action from the cached mouse theme data when the mouse action is detected, and determining a mouse theme mark and a mouse graph mark corresponding to the mouse graph;

the sending module is used for sending the mouse theme mark and the mouse graphic mark corresponding to the mouse graphic and the action information corresponding to the mouse action to the receiving end, so that the receiving end can draw the mouse pointer according to the mouse theme mark and the mouse graphic mark and act on the mouse pointer according to the action information corresponding to the mouse action;

In a fourth aspect, the present invention provides a remote desktop system, where the system is applied to a receiving end, and includes:

the connection module is used for establishing connection with the transmitting end;

the receiving module is used for receiving the mouse action sent by the sending end and the theme mark and the graphic mark corresponding to the mouse action;

the mouse action module is used for determining the theme mark and the mouse graph corresponding to the graph mark from the local mouse theme of the receiving end, and drawing a mouse pointer according to the theme mark and the mouse graph corresponding to the graph mark; meanwhile, the mouse pointer is operated according to the action information;

In a fifth aspect, the present invention provides a computer readable storage medium having stored thereon a computer program which, when executed, performs the steps of the method for controlling a mouse display in a remote desktop system according to any one of the embodiments described above.

In the embodiment of the disclosure, by synchronizing all mouse subjects of the mouse from the transmitting end to the receiving end during connection, only the subject marks, the graphic marks and the actions need to be transmitted later. Therefore, the display smoothness of the mouse animation can be further improved, the problem that the mouse deformation continuously flashes is solved, and the deformation time delay of the mouse is further reduced.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. It will be apparent to those of ordinary skill in the art that the drawings in the following description are merely examples of the disclosure and that other drawings may be derived from them without undue effort.

FIG. 1 is a flow chart of a method for controlling mouse display in a remote desktop system according to an exemplary embodiment of the disclosure;

FIG. 2 illustrates a schematic diagram of a mouse theme and mouse graphics in an exemplary embodiment of the present disclosure;

FIG. 3 is a flow chart illustrating another method of controlling a mouse display in a remote desktop system in accordance with an exemplary embodiment of the present disclosure;

FIG. 4 is a flow chart of a method of controlling a mouse display in another remote desktop system in an exemplary embodiment of the present disclosure;

FIG. 5 is a flow chart of a method of controlling a mouse display in another remote desktop system in an exemplary embodiment of the present disclosure;

FIG. 6 is a flow chart illustrating another method of controlling a mouse display in a remote desktop system in accordance with an exemplary embodiment of the present disclosure;

FIG. 7 is a flow chart illustrating another method of controlling a mouse display in a remote desktop system in accordance with an exemplary embodiment of the present disclosure;

FIG. 8 illustrates a logic flow diagram of a specific implementation flow in an exemplary embodiment of the present disclosure;

FIG. 9 illustrates a schematic diagram of a storage medium in an exemplary embodiment of the present disclosure;

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software or in one or more hardware modules or integrated circuits or in different networks and/or processor devices and/or microcontroller devices.

In this exemplary embodiment, first, a control method for mouse display in a remote desktop system is provided, and referring to fig. 1, the control method is applied to a transmitting end, and may include the following steps:

step S101: after connection is established with the receiving end, mouse action detection is performed.

Step S102: when the mouse action is detected, determining a mouse graph used by the mouse action from the cached mouse theme data, and determining a mouse theme mark and a mouse graph mark corresponding to the mouse graph.

Step S103: and sending the mouse theme mark and the mouse graphic mark corresponding to the mouse graphic and the action information corresponding to the mouse action to the receiving end, so that the receiving end can draw the mouse pointer according to the mouse theme mark and the mouse graphic mark and act on the mouse pointer according to the action information corresponding to the mouse action.

Each group of mouse topics comprises a plurality of mouse graphics, different mouse topics are marked by different mouse topic marks, and different mouse graphics are marked by different mouse graphic marks; when the mouse graphics are animated, the mouse graphics are marked by a group of graphics frames and frame interval information corresponding to the animation.

It should be understood that referring to fig. 2, the mouse has a plurality of different states, such as: normal selection, background operation, text selection, busy, vertical resizing, etc., each state corresponding to a shape or an animation. Mouse theme: means that for each mouse state, there is a set of mouse patterns or animations that are the same in style. The user can change the scheme at any time, but cannot change the mouse shape of one state alone.

It should be further understood that when marking a mouse theme and its corresponding mouse graphic, a feature value is generated, which is a unique and unchanged feature ID generated for a set of theme data, and is used for a subsequent matching operation, which is called a theme mark, and may also be denoted as t_id. Correspondingly, the graphic symbol may be noted as s_id.

It should be further understood that after the connection between the sending end and the receiving end is successful, a mouse state synchronization monitoring service is started to start the mouse state synchronization, and the service can be in various forms, such as an independent process or a certain thread in an application process; the service will run simultaneously in the sender and receiver.

It should be further understood that the mouse state synchronization monitoring service of the transmitting end traverses all the mouse subjects of the local end, performs data format analysis, reads the characteristics of mouse graphics, masks, animations, animation frame intervals and the like (the mouse graphics refer to a group of data such as mouse images and masks, and the like, and the acquired graphics may be a group of image frames when a certain mouse graphic is an animation.

It should also be understood that, in the use process, when the mouse at the transmitting end changes, the mouse action is generated, and the mouse action mainly comprises three kinds of actions, namely display, hiding and deformation; when the action is display or deformation, the sending end only needs to send the mouse action, the T_ID and the S_ID to the receiving end; when the mouse is hidden, only the action is needed to be sent, and other data are not needed.

It is further understood that when the receiving end receives the mouse change data, if the mouse change data is a display or deformation event, the receiving end reads the local storage mouse shape data according to the T_ID and the S_ID, and firstly judges whether the special attribute of the mouse shape is animation; if so, performing real-time cyclic display on a group of animation shapes corresponding to the current S_ID according to the frame interval, so that the real-time animation mouse shape can be formed; the problem of network delay and the like can not cause the shape of the local mouse to flicker and be blocked.

Through the control method, all mouse subjects of the mouse are synchronized from the sending end to the receiving end during connection, and only theme marks, graphic marks and actions are required to be transmitted later. Therefore, the display smoothness of the mouse animation can be further improved, the problem that the mouse deformation continuously flashes is solved, and the deformation time delay of the mouse is further reduced.

Next, each step of the above-described control method in the present exemplary embodiment will be described in more detail with reference to fig. 1 to 5.

In one embodiment, referring to fig. 3, in step S101, before performing mouse action detection, the synchronization of the mouse subjects of the transmitting end and the receiving end is performed by:

step S301: and comparing the mouse theme data in the cache with the mouse theme of the receiving end, so as to determine the target mouse theme which exists in the cache but does not exist in the receiving end.

Step S302: and sending the data of the target mouse theme to a receiving end.

It is to be understood that the result of comparing the mouse theme data in the cache with the mouse theme at the receiving end is divided into two results. That is, there is mouse theme data in the cache and there is no mouse theme data in the cache. Specifically, after the data is read, the current subject data and the read data after the last monitoring synchronization of the local end (i.e. the sending end) are compared, the comparison is divided into two cases, if the current subject data and the read data are just subjected to handshake, the first comparison of the current connection is represented, only the characteristic value list of the receiving end of the sending end is provided, and no corresponding data are provided, and at the moment, the characteristic value is generated. If the current T_ID is the real data corresponding to the T_ID, the current T_ID is compared with the graphic mark and the theme mark of the currently used mouse.

In one embodiment, in step S301, the following two cases are included:

first case: when mouse theme data exist in the cache, the mouse theme comparison is performed according to the following mode:

step S3011: and acquiring the mouse theme mark from the mouse theme data and marking the mouse theme mark as a first mouse theme mark.

Step S3012: and marking the mouse theme mark acquired from the receiving end as a second mouse theme mark.

Step S3013: and comparing the first mouse theme mark with the second mouse theme mark, so as to determine the target mouse theme mark which exists in the first mouse theme mark but does not exist in the second mouse theme mark.

Second case: when the mouse theme data does not exist in the cache, the mouse theme comparison is performed in the following manner.

Step S3015: generating mouse theme data according to the local currently installed mouse theme file, and writing the generated mouse theme data into a cache.

Step S3016: and acquiring the mouse theme mark from the mouse theme data written in the cache and marking the mouse theme mark as a third mouse theme mark.

Step S3017: and marking the mouse theme mark acquired from the receiving end as a fourth mouse theme mark.

Step S3018: and comparing the third mouse theme mark with the fourth mouse theme mark, so as to determine the target mouse theme mark which exists in the third mouse theme mark but does not exist in the fourth mouse theme mark.

It is to be understood that the generated mouse theme data includes: the mouse theme mark corresponding to each mouse theme, the mouse graph contained in each mouse theme and the mouse graph mark corresponding to each mouse graph. The first case corresponds to a scheme that the sender does not delete the mouse theme data in the cache when the last connection is disconnected. The second case corresponds to a scheme that the transmitting end deletes the mouse theme data in the cache when the connection is disconnected last time, and at this time, when the transmitting end is connected with the receiving end again, the mouse theme data needs to be regenerated and written into the cache.

In one embodiment, step S302 may further include:

step S3021: and sending the mouse theme marks of the target mouse theme, the mouse graphics contained in the target mouse theme and the graphic marks corresponding to the mouse graphics to a receiving end.

It is to be understood that the currently acquired changed mouse theme data is packaged, the T_ID is marked first, and then the specific shape data of the mouse is numbered in sequence, which is called S_ID; the key point here is that when the mouse shape is an animation, the mouse shape is a group, the group of image data identifies a uniform s_id, and a special attribute is added to identify that the mouse shape is an animation, and at the same time, an animation frame interval is recorded; and meanwhile, the local terminal updates the T_ID list and the corresponding real subject data.

In one embodiment, referring to FIG. 4, the method further comprises:

step S401: and detecting whether the synchronized mouse theme data changes according to the preset frequency, and writing the changed mouse theme data into the cache.

It should be understood that the sending end needs to detect the change of the mouse theme at regular time, because the user may add the mouse theme at any time during the use process, and perform new detection and new data synchronization.

In one embodiment, referring to fig. 5, step S401 may further include:

step S501: and sequentially acquiring the data of each mouse theme in the local currently installed mouse theme file.

Step S502: and comparing the data of the currently acquired mouse theme with the data of the mouse theme in the cache so as to determine whether the currently acquired mouse theme is a changed mouse theme.

It is to be understood that whether the synchronized mouse theme data change is detected according to the preset frequency, so that the mouse theme mark of the currently acquired mouse theme can be directly compared with the mouse theme mark of the mouse theme in the cache, and whether the currently acquired mouse theme changes can be determined.

In one embodiment, step S502 may further include:

step S5021: and determining the data length of the data of the currently acquired mouse theme.

Step S5022: judging whether mouse subjects with the same data length exist in the cache.

Step S5023: and if the mouse theme does not exist, determining the currently acquired mouse theme as the changed mouse theme.

Step S5024: if yes, further determining whether a mouse theme with the same data length exists in the mouse theme with the same data length as the content of the data of the currently acquired mouse theme, if yes, determining that the currently acquired mouse theme is the unchanged mouse theme, and if not, determining that the currently acquired mouse theme is the changed mouse theme.

It should be understood that when comparing the subject data, the current read data needs to be compared with the subject data in the cache one by one; comparing the data length of the shape (including various attribute data such as graphics, masks and the like) of each mouse state if the two groups of themes are the same, and if the two groups of themes are different, representing that the two groups of themes are different; when the shape data length is the same in the same mouse state, the data needs to be compared again, the shape data is directly compared with the memory block, and if the comparison result of the memory block is the same, the representative subject data is the same. The reason for the more efficient comparison is that when the subjects are different, the shape data length of the large probability mouse is different, and the memory block comparison is not needed, so that the omission is prevented.

In one embodiment, step S502 may further include:

step S5025: and determining the size of each mouse graph contained in the currently acquired mouse theme.

Step S5026: and judging whether a mouse theme containing the mouse graphics with the same size exists in the cache.

Step S5027: if the mouse theme does not exist, determining the currently acquired mouse theme as the changed mouse theme;

step S5028: if so, further determining whether the characteristic values of all the mouse graphics in the mouse topics containing the mouse graphics with the same size are corresponding to the characteristic values of all the mouse graphics contained in the currently acquired mouse topics, if so, determining that the acquired mouse topics are unchanged mouse topics, and if not, determining that the acquired mouse topics are changed mouse topics.

It should be understood that when comparing the mouse subjects, the sizes of the mouse graphics in the mouse subjects are compared first, and then the shape data of the mouse graphics are compared. And when the size and shape data of the mouse graphics in the mouse theme are consistent, judging the mouse theme as the same. The mouse shape is taken as image data, the characteristic of each mouse shape of the current theme is extracted by utilizing an image processing algorithm, characteristic values of a plurality of shapes are processed such as stitching and the like to generate a new value, the value is added with or multiplied by the image size (including but not limited to) to generate a unique ID, and the unique ID is taken as the characteristic value of the mouse shape, wherein the image size is considered because some theme shape characteristics are the same and only have different sizes.

In one embodiment, step S401 may further include:

step S4011: generating a mouse theme mark corresponding to the changed mouse theme and a graph mark of each mouse graph contained in the changed mouse theme.

Step S4012: and writing the generated mouse theme marks, the generated mouse graphic marks and the various mouse graphics contained in the changed mouse theme into a cache.

In one embodiment, after the sending end and the receiving end are disconnected, the mouse theme data in the cache are emptied or not emptied according to a preset rule. It should be understood that after the connection is disconnected, the sending end may or may not empty the buffer.

In one embodiment, the mouse theme mark is generated by:

and carrying out hash calculation on the data of the mouse theme based on the MD5 information abstract algorithm, and taking the obtained calculation result as a theme mark of the mouse theme.

Or extracting the image characteristics of each mouse graph contained in the mouse theme, performing mathematical operation on the extracted image characteristics of each mouse graph and the size data of the corresponding mouse graph to obtain a plurality of mathematical operation results, performing splicing processing on the plurality of mathematical operation results, and taking the spliced results as the theme mark of the mouse theme.

It should be appreciated that the MD5 message digest algorithm is a widely used cryptographic hash function that produces a 128 bit (16 byte) hash value that is used to ensure that the message is transmitted in full consistency. And taking the current subject data as simple data, performing MD5 hashing, and generating a result as a mouse shape characteristic value.

The present exemplary embodiment also provides a method for controlling a mouse display in a remote desktop system, and referring to fig. 6, the method is applied to a receiving end, and may include the following steps:

step S601: and establishing connection with the transmitting end.

Step S602: and receiving the theme mark and the graphic mark corresponding to the mouse action sent by the sending end.

Step S603: determining mouse graphics corresponding to the theme marks and the graphic marks from the local mouse theme at the receiving end, and drawing a mouse pointer according to the mouse graphics corresponding to the theme marks and the graphic marks; meanwhile, the mouse pointer is operated according to the operation information.

It should be understood that, in the control method of the mouse display in the remote desktop system, the specific manner of executing the operation related to the sending end has been described in detail in the related embodiments, which will not be described in detail herein.

In one embodiment, referring to fig. 7, after establishing a connection with the transmitting end, the method further includes: the mouse theme synchronization with the transmitting end is performed in the following way

Step S701: and sending the mouse theme marks of the local mouse theme of the receiving end to the sending end so that the sending end can determine whether the mouse themes at two sides are different according to the received mouse theme marks.

Step S702: and when the comparison results of the sending end are different, receiving the data of the target mouse theme sent by the sending end and storing the data in a local place.

It is to be understood that the sending end performs handshake with the mouse state synchronous monitoring service of the receiving end, and the receiving end sends the currently existing mouse theme t_id data list to the sending end for removing the repeated data. Therefore, the synchronous data volume of the mouse theme data when the same receiving end and the transmitting end are repeatedly disconnected can be reduced. If the connection is the first time, there is no local shape data and all remote shape data is synchronized. And after the traversing process of the mouse shape data is completed, packaging the data to be transmitted and transmitting the data to a receiving end. The lossless coding compression can be carried out on the data during packaging so as to further reduce the network load; if there is no data to be packed for synchronization. The receiving end unpacks the data after receiving the data, and then stores the mouse shape data according to the T_ID and the S_ID. To improve the storage search efficiency, a hash table or the like may be used for storage.

In combination with the above embodiments related to the transmitting end and the receiving end, this example further provides a more specific implementation procedure:

the specific scheme flow is shown with reference to fig. 8, and is specifically as follows:

1. after the transmitting end and the receiving end are successfully connected, a mouse state synchronization monitoring service is started, and mouse state synchronization is started.

2. The sending end performs handshake with the mouse state synchronous monitoring service of the receiving end, and the receiving end sends the currently existing mouse theme T_ID data list to the sending end for removing repeated data.

3. The mouse state synchronous monitoring service of the transmitting end traverses all mouse subjects of the transmitting end, analyzes data formats, and reads the characteristics of mouse graphics, masks, animations, animation frame intervals and the like. After the data is read, the current subject data and the read data after the last monitoring synchronization of the local end (namely the sending end) are required to be compared, the comparison is divided into two cases, if the current subject data and the read data are just subjected to handshake, the first comparison is represented by the connection of the current subject data, only the characteristic value list of the receiving end of the sending end is not provided with the corresponding data, at the moment, the characteristic value is generated firstly, and the process jumps to 5 to carry out T_ID comparison; if the T_ID buffered by the current transmitting end has real data corresponding to the T_ID, the data comparison is carried out by jumping to 4 so as to accelerate the comparison speed;

4. When comparing the theme data, the current read data is required to be compared with the theme data in the cache one by one; comparing the data length of the shape (including various attribute data such as graphics, masks and the like) of each mouse state if the two groups of themes are the same, and if the two groups of themes are different, representing that the two groups of themes are different; when the shape data length is the same in the same mouse state, the data needs to be compared again, the shape data is directly compared with the memory block, and if the comparison result of the memory block is the same, the representative subject data is the same; if all the current traversal topics are in the cache list, jumping to 3, and waiting for next state synchronization; if some subject data is not in the cache list, generating a T_ID, and jumping to 6.

5. Matching the currently generated T_ID with the T_ID acquired from the receiving end, and if so; then the receiving end of the theme shape is shown to exist, and the current theme data is added as the real data corresponding to the T_ID; skipping the current mouse theme, comparing the next theme data, and if the current mouse theme is not matched, describing that the current mouse theme is new theme data, and executing the step 6;

6. encapsulating the currently acquired changed mouse theme data, firstly identifying T_ID, and then numbering the specific shape data of the mouse according to the sequence, namely S_ID; the key point here is that when the mouse shape is an animation, the mouse shape is a group, the group of image data identifies a uniform s_id, and a special attribute is added to identify that the mouse shape is an animation, and at the same time, an animation frame interval is recorded; meanwhile, the local end updates the T_ID list and corresponding real subject data;

7. And after the traversing process of the mouse shape data is completed, packaging the data to be transmitted and transmitting the data to a receiving end. If no data needs packing synchronization, the method can directly jump to 9;

8. the receiving end unpacks the data after receiving the data, and then stores the mouse shape data according to the T_ID and the S_ID.

9. In the use process, when the mouse of the sending end changes, a mouse action is generated, and when the action is display or deformation, the sending end only needs to send the mouse action, T_ID and S_ID to the receiving end; when the mouse is hidden, only the action is needed to be sent, and other data are not needed.

10. When the receiving end receives the mouse change data, if the mouse change data is a display or deformation event, reading the local storage mouse shape data according to the T_ID and the S_ID, and judging whether the special attribute of the mouse shape is animation or not; if so, a group of animation shapes corresponding to the current S_ID are circularly displayed in real time according to the frame interval.

11. The sending end needs to detect the change of the mouse theme at fixed time, and because the user can add the mouse theme at any time in the using process, the sending end jumps to 3 to perform new detection and new data synchronization.

Further, in this example embodiment, a virtual device capable of implementing the above method is also provided. The virtual device may include virtual modules that implement the steps of the methods described above, respectively.

The invention provides a remote desktop system, which is applied to a transmitting end and comprises:

The invention provides a remote desktop system, which is applied to a receiving end and comprises:

the mouse action module is used for determining the theme mark and the mouse graph corresponding to the graph mark from the local mouse theme of the receiving end, and drawing a mouse pointer according to the mouse graph corresponding to the theme mark and the graph mark; meanwhile, the mouse pointer is operated according to the action information;

The specific manner in which the various modules perform the operations have been described in detail in connection with embodiments of the method, and will not be described in detail herein.

It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit in accordance with embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied. The components shown as modules or units may or may not be physical units, may be located in one place, or may be distributed across multiple network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the wood disclosure scheme. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium having stored thereon a computer program which, when executed by, for example, a processor, can implement the steps of the method for controlling mouse display in a remote desktop system in any of the above embodiments. In some possible embodiments, the various aspects of the invention may also be implemented in the form of a program product comprising program code for causing a terminal device to carry out the steps according to the various exemplary embodiments of the invention as described in the control method section of this specification, when said program product is run on the terminal device.

Referring to fig. 9, a program product 900 for implementing the above-described method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable storage medium may also be any readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

1. The method for controlling the mouse display in the remote desktop system is characterized by being applied to a transmitting end and comprising the following steps:

2. The control method according to claim 1, characterized in that before the mouse action detection, the method further comprises: the mouse theme synchronization of the transmitting end and the receiving end is carried out in the following mode:

and sending the data of the target mouse theme to a receiving end.

3. The control method according to claim 2, wherein the determining the target mouse theme existing in the buffer but not in the receiving terminal by comparing the mouse theme data in the buffer with the mouse theme of the receiving terminal includes:

4. The control method according to claim 2, wherein the sending the data of the target mouse theme to the receiving end includes:

5. The control method according to claim 1, characterized in that the method further comprises:

6. The control method according to claim 5, wherein the detecting whether the synchronized mouse theme data is changed includes:

7. The control method according to claim 6, wherein comparing the data of the currently acquired mouse theme with the data of the mouse theme in the cache to determine whether the currently acquired mouse theme is a changed mouse theme comprises:

determining the data length of the currently acquired data of the mouse theme;

judging whether mouse subjects with the same data length exist in the cache;

8. The control method according to claim 6, wherein comparing the data of the currently acquired mouse theme with the data of the mouse theme in the cache to determine whether the currently acquired mouse theme is a changed mouse theme comprises:

9. The control method according to claim 5, wherein writing the changed mouse subject into the cache includes:

10. The control method according to claim 1, wherein after the transmitting end and the receiving end are disconnected, the mouse theme data in the cache is emptied or not emptied according to a preset rule.

11. The control method according to any one of claims 1 to 10, characterized in that the mouse theme mark is generated by:

12. The method for controlling the mouse display in the remote desktop system is characterized by being applied to a receiving end and comprising the following steps:

establishing connection with a transmitting end;

13. The control method according to claim 12, wherein after the connection is established with the transmitting end, the method further comprises: the method comprises the following steps of performing mouse theme synchronization with a transmitting end:

14. A remote desktop system, wherein the system is applied to a transmitting end, and comprises:

15. A remote desktop system, the system being applied to a receiving end, comprising:

16. A computer readable storage medium having stored thereon a computer program which, when executed, performs the steps of the method for controlling a mouse display in a remote desktop system according to any of the above embodiments.