CN104375825A - Tracking and identification method and system of desktop window elements under VDI environment - Google Patents
Tracking and identification method and system of desktop window elements under VDI environment Download PDFInfo
- Publication number
- CN104375825A CN104375825A CN201410498283.7A CN201410498283A CN104375825A CN 104375825 A CN104375825 A CN 104375825A CN 201410498283 A CN201410498283 A CN 201410498283A CN 104375825 A CN104375825 A CN 104375825A
- Authority
- CN
- China
- Prior art keywords
- window
- desktop
- elements
- change
- tracking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention provides a tracking and identification method and system of desktop window elements under a VDI environment. The method comprises the steps that firstly, handles of all window elements of a current conversation of a user mode are enumerated; secondarily, the changes of the window elements are monitored according to the handles; thirdly, all to-be-tracked windows of a current desktop are stored, and information lists of the windows are transmitted to a kernel mode; fourthly, a window state change engine and a unique identifier are created for each to-be-tracked window; fifthly, the windows are changed and encoded by combining preset processing strategies according to change data, tracked and obtained according to the window state change engines, of the window elements and the unique identifiers; sixthly, the encoded windows are transmitted to a terminal to be displayed. The tracking and identification system of the desktop window elements under the VDI environment is further provided. The method and system have the advantages that the amount of data transmitted to the user terminal becomes small, the bandwidth is reduced, and user experience is improved.
Description
Technical field
The present invention relates to the Tracking Recognition method and system of desktop window element under a kind of VDI environment.
Background technology
Under VDI (virtual desktop architecture) environment, we need by the network of the Bandwidth-Constrained desktop to terminal delivery operation system, the desktop of operating system is made up of window one by one, the kind of window is again various, window elements also can change, this makes take more bandwidth in the process of transmission, and cannot carry out Tracking Recognition to the change that window elements occurs, and reduces the experience of user.
Summary of the invention
The technical problem to be solved in the present invention, be to provide the Tracking Recognition method and system of desktop window element under a kind of VDI environment, by decomposing desktop window element and following the tracks of, and adopt different coded systems to encode to dissimilar window, the data volume being transferred to user terminal is diminished, also reduce bandwidth, improve the experience of user.
One of the technical problem to be solved in the present invention is achieved in that the Tracking Recognition method of desktop window element under VDI environment, operating system and unified being put in the server of data center of application program are run by described VDI, undertaken virtual by the desktop of user, described operating system comprises User space and kernel state; Described method comprises the steps:
Step 1, enumerate the handle of all window elements of User space current sessions;
Step 2, change according to handle supervisory user state current sessions and window station, and then the change of monitoring window elements;
Step 3, all windows to be tracked of preservation User space current desktop, and the information list of window is sent to kernel state;
Step 4, all to create a Window state change engine for each window to be tracked in kernel state, for following the tracks of the delta data obtaining window elements, simultaneously also for each window to be tracked all creates a unique identifier;
Step 5, the delta data following the tracks of the window elements obtained according to different windows and unique identifier, and the processing policy that combination presets changes window and encodes;
Step 6, the window after coding is sent to user terminal and shows.
Further, the delta data of described window elements comprises the window's position, window size, window viewing area and window ID.
Further, described in the processing policy that presets be in advance according to the change of window elements, set the change will carried out window.
Further, described step 5 is specially further: first follow the tracks of the delta data of the window elements obtained and unique identifier according to different windows, and the processing policy that combination presets changes window, then adopts different coded systems to encode to dissimilar window.
Two of the technical problem to be solved in the present invention is achieved in that the tracking and identifying system of desktop window element under VDI environment, operating system and unified being put in the server of data center of application program are run by described VDI, undertaken virtual by the desktop of user, described operating system comprises User space and kernel state; Described system comprises:
Window enumeration module, enumerates the handle of all window elements of User space current sessions;
Monitoring session module, according to the change of handle supervisory user state current sessions and window station, and then the change of monitoring window elements;
Module preserved by window, preserves all windows to be tracked of User space current desktop, and the information list of window is sent to kernel state;
Virtual video card module, for each window to be tracked in kernel state all creates Window state change engine, for following the tracks of the delta data obtaining window elements, simultaneously also for each window to be tracked all creates a unique identifier;
Data coding module, follows the tracks of the delta data of the window elements obtained and unique identifier according to different windows, and the processing policy that combination presets changes window and encodes;
Data transmission module, is sent to user terminal by the window after coding and shows.
Further, the delta data of described window elements comprises the window's position, window size, window viewing area and window ID.
Further, described in the processing policy that presets be in advance according to the change of window elements, set the change will carried out window.
Further, described data coding module is specially further: first follow the tracks of the delta data of the window elements obtained and unique identifier according to different windows, and the processing policy that combination presets changes window, then adopts different coded systems to encode to dissimilar window.
Tool of the present invention has the following advantages: achieve the decomposition to operating system desktop window elements and tracking, and adopt different coded systems to encode to dissimilar window, this not only reduces the data volume being transferred to user terminal, and reduce bandwidth, improve the experience of user.
Accompanying drawing explanation
The present invention is further illustrated in conjunction with the embodiments with reference to the accompanying drawings.
Fig. 1 is the FB(flow block) of the Tracking Recognition method of desktop window element under VDI environment of the present invention.
Fig. 2 is the structured flowchart of the tracking and identifying system of desktop window element under VDI environment of the present invention.
Embodiment
Please refer to shown in Fig. 1, the Tracking Recognition method of desktop window element under VDI environment of the present invention, operating system and unified being put in the server of data center of application program are run by described VDI, undertaken virtual by the desktop of user, described operating system (such as windows operating system) comprises User space and kernel state; Described method specifically comprises the steps:
Step 1, enumerate the handle of all window elements of User space current sessions;
Step 2, change according to handle supervisory user state current sessions and window station (winstation), and then the change of monitoring window elements; Window station (winstation) is a Security Object, and it comprises a clipbook, a series of overall atom and one group of desktop object, and an interactive window station is not only visible to user, and can also accept the input from user.To the reason that current sessions and window station (winstation) are monitored be wherein: due to window elements and current sessions and window station (winstation) closely related, only have and they are monitored, accurately could monitor the change of window elements further;
Step 3, all windows to be tracked of preservation User space current desktop, and the information list of window is sent to kernel state; Here suppose windows desktop has 10 windows to be tracked, the information list of 10 windows, with regard to first preserving these 10 windows, is then sent to kernel state by that;
Step 4, all to create a Window state change engine for each window to be tracked in kernel state, for following the tracks of the delta data obtaining window elements, simultaneously also for each window to be tracked all creates a unique identifier, this unique identifier is used for accurate identification window; The delta data of described window elements comprises the window's position, window size, window viewing area and window ID, and described Window state change engine also can be preserved the delta data of each window elements, realizes the tracking to window;
Step 5, the delta data following the tracks of the window elements obtained according to different windows and unique identifier, and the processing policy that combination presets changes window and encodes, the described processing policy preset is in advance according to the change of window elements, sets the change will carried out window, this step is specially further: first follow the tracks of the delta data of the window elements obtained and unique identifier according to different windows, and combine the processing policy that presets and change (when the change such as presetting window height is within the scope of 0.2cm ~ 0.25cm to window, unified to window adjusting 0.2cm, so when the change of the window height that tracking obtains is in above-mentioned scope, we are just to the height of a window adjusting 0.2cm), then different coded systems is adopted to encode to dissimilar window, such as graphical window can adopt JPEG to encode, H.264, video window can be encoded,
Step 6, the window after coding is sent to user terminal and shows, experience for user.
Please refer to shown in Fig. 2, desktop window element tracking and identifying system under VDI environment of the present invention, operating system and unified being put in the server of data center of application program are run by described VDI, undertaken virtual by the desktop of user, described operating system (such as windows operating system) comprises User space and kernel state; Described system comprises
Window enumeration module, enumerates the handle of all window elements of User space current sessions;
Monitoring session module, according to the change of handle supervisory user state current sessions and window station (winstation), and then the change of monitoring window elements; Window station (winstation) is a Security Object, and it comprises a clipbook, a series of overall atom and one group of desktop object, and an interactive window station is not only visible to user, and can also accept the input from user.To the reason that current sessions and window station (winstation) are monitored be wherein: due to window elements and current sessions and window station (winstation) closely related, only have and they are monitored, accurately could monitor the change of window elements further;
Module preserved by window, preserves all windows to be tracked of User space current desktop, and the information list of window is sent to kernel state; Here suppose windows desktop has 10 windows to be tracked, the information list of 10 windows, with regard to first preserving these 10 windows, is then sent to kernel state by that;
Virtual video card module, for each window to be tracked in kernel state all creates a Window state change engine, for following the tracks of the delta data obtaining window elements, simultaneously also for each window to be tracked all creates a unique identifier, this unique identifier is used for accurate identification window; The delta data of described window elements comprises the window's position, window size, window viewing area and window ID, and described Window state change engine also can be preserved the delta data of each window elements, realizes the tracking to table window;
Data coding module, follows the tracks of the delta data of the window elements obtained and unique identifier according to different windows, and the processing policy that combination presets changes window and encodes, the described processing policy preset is in advance according to the change of window elements, sets the change will carried out window, this step is specially further: first follow the tracks of the delta data of the window elements obtained and unique identifier according to different windows, and combine the processing policy that presets and change (when the change such as presetting window height is within the scope of 0.2cm ~ 0.25cm to window, unified to window adjusting 0.2cm, so when the change of the window height that tracking obtains is in above-mentioned scope, we are just to the height of a window adjusting 0.2cm), then different coded systems is adopted to encode to dissimilar window, such as graphical window can adopt JPEG to encode, H.264, video window can be encoded,
Data transmission module, sends the window after coding to user terminal and shows, experience for user.
Tool of the present invention has the following advantages: achieve the decomposition to operating system desktop window elements and tracking, and adopt different coded systems to encode to dissimilar window, this not only reduces the data volume being transferred to user terminal, and reduce bandwidth, improve the experience of user.
Although the foregoing describe the specific embodiment of the present invention; but be familiar with those skilled in the art to be to be understood that; specific embodiment described by us is illustrative; instead of for the restriction to scope of the present invention; those of ordinary skill in the art, in the modification of the equivalence done according to spirit of the present invention and change, should be encompassed in scope that claim of the present invention protects.
Claims (8)
1. the Tracking Recognition method of desktop window element under VDI environment, operating system and unified being put in the server of data center of application program are run by described VDI, and undertaken virtual by the desktop of user, described operating system comprises User space and kernel state; It is characterized in that: described method comprises the steps:
Step 1, enumerate the handle of all window elements of User space current sessions;
Step 2, change according to handle supervisory user state current sessions and window station, and then the change of monitoring window elements;
Step 3, all windows to be tracked of preservation User space current desktop, and the information list of window is sent to kernel state;
Step 4, all to create a Window state change engine for each window to be tracked in kernel state, for following the tracks of the delta data obtaining window elements, simultaneously also for each window to be tracked all creates a unique identifier;
Step 5, the delta data following the tracks of the window elements obtained according to different windows and unique identifier, and the processing policy that combination presets changes window and encodes;
Step 6, the window after coding is sent to user terminal and shows.
2. the Tracking Recognition method of desktop window element under VDI environment according to claim 1, is characterized in that: the delta data of described window elements comprises the window's position, window size, window viewing area and window ID.
3. the Tracking Recognition method of desktop window element under VDI environment according to claim 1, is characterized in that: described in the processing policy that presets be in advance according to the change of window elements, set the change will carried out window.
4. the Tracking Recognition method of desktop window element under VDI environment according to claim 3, it is characterized in that: described step 5 is specially: first follow the tracks of the delta data of the window elements obtained and unique identifier according to different windows, and the processing policy that combination presets changes window, then adopts different coded systems to encode to dissimilar window.
5. the tracking and identifying system of desktop window element under VDI environment, operating system and unified being put in the server of data center of application program are run by described VDI, and undertaken virtual by the desktop of user, described operating system comprises User space and kernel state; It is characterized in that: comprising:
Window enumeration module, enumerates the handle of all window elements of User space current sessions;
Monitoring session module, according to the change of handle supervisory user state current sessions and window station, and then the change of monitoring window elements;
Module preserved by window, preserves all windows to be tracked of User space current desktop, and the information list of window is sent to kernel state;
Virtual video card module, for each window to be tracked in kernel state all creates Window state change engine, for following the tracks of the delta data obtaining window elements, simultaneously also for each window to be tracked all creates a unique identifier;
Data coding module, follows the tracks of the delta data of the window elements obtained and unique identifier according to different windows, and the processing policy that combination presets changes window and encodes;
Data transmission module, is sent to user terminal by the window after coding and shows.
6. the tracking and identifying system of desktop window element under VDI environment according to claim 5, is characterized in that: the delta data of described window elements comprises the window's position, window size, window viewing area and window ID.
7. the tracking and identifying system of desktop window element under VDI environment according to claim 5, is characterized in that: the described processing policy preset in advance is in advance according to the change of window elements, sets the change will carried out window.
8. the tracking and identifying system of desktop window element under VDI environment according to claim 7, it is characterized in that: described data coding module is specially further: first follow the tracks of the delta data of the window elements obtained and unique identifier according to different windows, and the processing policy that combination presets changes window, then adopts different coded systems to encode to dissimilar window.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410498283.7A CN104375825B (en) | 2014-09-25 | 2014-09-25 | Desktop window element tracks and identifies method and system under VDI environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410498283.7A CN104375825B (en) | 2014-09-25 | 2014-09-25 | Desktop window element tracks and identifies method and system under VDI environment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104375825A true CN104375825A (en) | 2015-02-25 |
| CN104375825B CN104375825B (en) | 2018-06-08 |
Family
ID=52554768
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410498283.7A Active CN104375825B (en) | 2014-09-25 | 2014-09-25 | Desktop window element tracks and identifies method and system under VDI environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104375825B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060136828A1 (en) * | 2004-12-16 | 2006-06-22 | Taiga Asano | System and method for sharing display screen between information processing apparatuses |
| US20120084663A1 (en) * | 2010-10-05 | 2012-04-05 | Citrix Systems, Inc. | Display Management for Native User Experiences |
| US20120311457A1 (en) * | 2011-06-06 | 2012-12-06 | Cisco Technology, Inc. | Merging Remote and Local Interfaces for Application Integration |
| CN103179431A (en) * | 2013-03-21 | 2013-06-26 | 福建升腾资讯有限公司 | Method for redirecting, transcoding and separating audio/video under VDI (Virtual Desktop Infrastructure) condition |
-
2014
- 2014-09-25 CN CN201410498283.7A patent/CN104375825B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060136828A1 (en) * | 2004-12-16 | 2006-06-22 | Taiga Asano | System and method for sharing display screen between information processing apparatuses |
| US20120084663A1 (en) * | 2010-10-05 | 2012-04-05 | Citrix Systems, Inc. | Display Management for Native User Experiences |
| US20120311457A1 (en) * | 2011-06-06 | 2012-12-06 | Cisco Technology, Inc. | Merging Remote and Local Interfaces for Application Integration |
| CN103179431A (en) * | 2013-03-21 | 2013-06-26 | 福建升腾资讯有限公司 | Method for redirecting, transcoding and separating audio/video under VDI (Virtual Desktop Infrastructure) condition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104375825B (en) | 2018-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102413150B (en) | Server and virtual desktop control method and virtual desktop control system | |
| EP3197167B1 (en) | Image transmission method and apparatus | |
| CN104412601B (en) | The system and method for accommodating the single KVM clients of a variety of different video compress techniques | |
| CN104348697A (en) | Video communication information processing method, device and system | |
| CN112584350B (en) | Method, device and equipment for processing information and readable storage medium | |
| CN103516788A (en) | Data pushing method and Flash client terminal and server thereof | |
| CN104123244A (en) | USB redirection system and method | |
| CN102404632A (en) | Information pushing method of intelligent television and application thereof | |
| CN104320458A (en) | Informatization achieving system based on Domino servers and Nginx server | |
| CN104202432B (en) | Remote web management system and management method | |
| CN104917731A (en) | Method and system for improving data display speed, server and browser | |
| CN105849719B (en) | Augmented reality | |
| CN104796435A (en) | Message pushing method and message server | |
| CN104375825A (en) | Tracking and identification method and system of desktop window elements under VDI environment | |
| CN107529711A (en) | The display methods and device of Streaming Media | |
| CN107580068A (en) | A kind of method of cursor synchronization, relevant device and system | |
| CN104468771A (en) | Method and device for determining geographical position | |
| CN105282255A (en) | Image transmission method and system | |
| CN100508596C (en) | Method and system for accessing the video device | |
| CN104283940A (en) | Sharing path tracking system and method | |
| CN103685316A (en) | Audit processing method for network transfer file | |
| CN103873564A (en) | Method for realizing SignalR duplex communication under balanced load condition of multiple servers | |
| WO2008119902A3 (en) | Method for the delivery of audio and video data sequences by a server | |
| CN105099939A (en) | Method and device for implementing flow control among different data centers | |
| CN107295340A (en) | A kind of method and device of remote desktop Video coding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |