WO2012159361A1

WO2012159361A1 - Distributed processing method and system for virtual desktop

Info

Publication number: WO2012159361A1
Application number: PCT/CN2011/077881
Authority: WO
Inventors: 李梦; 尤昉; 程华
Original assignee: 华为技术有限公司
Priority date: 2011-08-01
Filing date: 2011-08-01
Publication date: 2012-11-29
Also published as: CN102449604B; CN102449604A

Abstract

Disclosed are a distributed virtual desktop method and system. The method comprises: a virtual desktop management module identifying a desktop subarea in a corresponding application window of an application; the virtual desktop management module selecting a virtual desktop application processing module for the desktop subarea; the virtual desktop management module acquiring pixel data of the desktop subarea from the virtual desktop application processing module selected for the desktop subarea; the virtual desktop management module displaying the acquired pixel data of the desktop subarea on a virtual desktop terminal, so that, aiming at different applications, the virtual desktop application processing module can be distributed according to the different desktop subareas, avoiding waste of computing power resources due to the different processing power of different applications.

Description

Method and system for distributed processing in virtual desktop

The present invention relates to the field of IT, and in particular to a method and system for distributed processing in a virtual desktop. Background technique

In the current virtual desktop system, the system allocates processing power to users (for example, computing power, and the following content of the application is described by taking computing power as an example). For a single user, a computing power is usually used to process all applications in the virtual desktop. However, in some cases, when a virtual desktop user opens multiple applications or opens a single application that includes multiple objects, the computing power requirements of different applications or objects can vary widely (for example: When a virtual desktop user passes Virtual desktops open multiple applications, and the content or objects processed by each application opened may have different requirements on computing power. For example, web browsing and online games have different computing power requirements; or, when virtual A desktop user opens an application through a virtual desktop. The application needs to process a variety of content or objects, and the content or object has different requirements on computing power, such as a text portion in a web page, a media playing window, word processing, and multimedia processing. The requirements for computing power vary widely).

When the above situation occurs, the current virtual desktop system can only allocate the same resources for all types of content or objects in all applications or applications. If the virtual desktop system allocates resources according to the minimum processing capability requirements, the processing capability cannot be met. The processing of content or objects; if the virtual desktop system allocates resources according to the highest requirements, it will cause waste of resources for content or objects with low processing power requirements.

Summary of the invention

The embodiment of the invention provides a method and a system for distributing processing in a virtual desktop, which can identify desktop sub-areas of different applications, and allocate virtual desktop application processing units for desktop sub-areas of different applications, thereby avoiding waste of resources. An embodiment of the present invention provides a method for distributed processing in a virtual desktop, including: a virtual desktop management module identifying a desktop sub-area in an application window corresponding to the application;

The virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area; the virtual desktop management module acquires pixel data of the desktop sub-area from the virtual desktop application processing module selected for the desktop sub-area ;

The virtual desktop management module displays the acquired pixel data of the desktop sub-area on the virtual desktop terminal.

The embodiment of the present invention further provides a distributed processing system in a virtual desktop, where the system includes: a virtual desktop management module, at least one virtual desktop application processing module, where

a virtual desktop management module, configured to identify a desktop sub-area in an application window corresponding to the application, select a virtual desktop application processing module for the desktop sub-area, and obtain the location from the virtual desktop application processing module selected for the desktop sub-area Decoding the pixel data of the desktop sub-area, and displaying the acquired pixel data of the desktop sub-area on the virtual desktop terminal;

The at least one virtual desktop application processing module is configured to provide processing capability for the application, and feed back pixel data of the desktop sub-region to the virtual desktop management module.

The embodiment of the invention provides a method and a system for distributing processing in a virtual desktop. By introducing a virtual desktop management module in the virtual desktop system, the desktop sub-area in the application window corresponding to the application is identified, and different desktop sub-areas are selected differently. The virtual desktop application processing module processes the desktop sub-area by the selected virtual desktop application processing module and provides pixel data for display on the virtual desktop terminal, so that the virtual desktop application processing can be allocated according to different desktop sub-areas for different applications. The module avoids the waste of resources caused by the difference in processing capacity requirements of different applications.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work. 1 is a schematic flowchart of a method for distributed processing in a virtual desktop according to an embodiment of the present invention; FIG. 2 is a schematic diagram of a system architecture for distributed processing in a virtual desktop according to an embodiment of the present invention; FIG. 3 is a schematic diagram of a system according to an embodiment of the present invention. Schematic diagram of a system architecture in a distributed virtual desktop scenario;

4 is a schematic flow chart of a method for distributed processing in another virtual desktop according to an embodiment of the present invention;

5 is a schematic flowchart of a method for distributing and refreshing a virtual desktop according to an embodiment of the present invention; FIG. 6 is a schematic flowchart of message processing of distributed processing in another virtual desktop according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a desktop state in which only an application -1 window is opened in a virtual desktop according to an embodiment of the present invention, and a content object is included in an application -1 window;

FIG. 8 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention; FIG.

FIG. 9 is a schematic diagram of a desktop state in which only an application -1 window is opened in the virtual desktop according to an embodiment of the present invention, and the application -1 window contains two content objects;

FIG. 10 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention; FIG.

11 is a schematic diagram of a desktop state in which an application-1 window and an application-3 window are opened in a virtual desktop according to an embodiment of the present invention;

FIG. 12 is a schematic flowchart of message processing of distributed processing in another virtual desktop according to an embodiment of the present invention; FIG.

FIG. 13 is a schematic diagram of a desktop state of a partial area of a display area of an application area occlusion application-4 of an application -1 in a virtual desktop according to an embodiment of the present invention;

FIG. 14 is a schematic flowchart of message processing of distributed processing in another virtual desktop according to an embodiment of the present invention; FIG.

FIG. 15 is a schematic structural diagram of a distributed processing system in a virtual desktop according to an embodiment of the present invention. detailed description

As shown in FIG. 1 , a schematic flowchart of a method for distributed processing in a virtual desktop according to an embodiment of the present invention includes:

Step 101: The virtual desktop management module identifies a desktop sub-area in the application window corresponding to the application. Step 102: The virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area;

Step 103: The virtual desktop management module acquires pixel data of the desktop sub-area from the virtual desktop application processing module selected for the desktop sub-area;

Step 104: The virtual desktop management module displays the acquired pixel data of the desktop sub-area on the virtual desktop terminal.

The embodiment of the invention provides a method for distributed processing in a virtual desktop. By introducing a virtual desktop management module in the virtual desktop system, the desktop sub-area in the application window corresponding to the application is identified, and different virtual sub-areas are selected for different desktop sub-areas. The desktop application processing module processes the desktop sub-area by the selected virtual desktop application processing module and provides pixel data for display on the virtual desktop terminal, so that the virtual desktop application processing module can be allocated according to different desktop sub-areas for different applications. The waste of resources caused by the difference in processing capacity requirements of different applications is avoided.

It should be noted that the following embodiments of the present invention are described by taking the computing capability as an example. However, those skilled in the art understand that the computing capability is only a typical case of processing capability, and is not meant to limit the application.

It should be further noted that in the prior art, different objects included in the application may have different requirements for computing power. When objects with different requirements for computing power are allocated to the same virtual desktop application processing module, It will cause a waste of computing power. In response to this situation, the subsequent embodiment of the present invention further identifies the desktop sub-region corresponding to the object, thereby solving the problem, and the subsequent embodiments will be described in detail.

First of all, the following description is made on the names in the embodiments of the present invention, and those skilled in the art understand that the following explanations are merely an understanding of the enhanced terms, and do not mean that the following terms are limited to the explanations listed. Content:

The terminal in the embodiment of the present invention refers to all devices having a display function, including but not limited to: a computer display, a television, a portable device, a mobile phone, a thin terminal, and the like.

The desktop refers to the display area of the computer system on the terminal display device.

An application refers to a program or service in a computer system or a network device that can be used or accessed by a user, such as: an office application, various websites, local games, online games, multimedia download services, web chat services, and other types of network services. Wait.

The application window refers to the interface that the application presents to the user.

The display area of the application refers to the area of the screen occupied by the application window when displayed on the terminal screen. The object refers to various contents that can be displayed on the terminal, and the object category can be text, video, flash animation, game, icon or hyperlink in the webpage, etc.; the display area of the object refers to the object displayed on the terminal screen The occupied screen area; the content of the object is the data needed to process, display, and deliver the object, such as: text content, video frame data, game data.

The display information of the application includes at least one of the following information:

1) Display area information of the application, for example: display position of the application window (display coordinates), absolute size (length and width) of the application window, relative size of the application window (relative to the amount of change of the previous application window), whether the application window is the smallest Whether the application window is maximized, whether the application window is full screen, etc.;

2) categories of objects, such as: web pages, videos, flash animations, games, etc.;

3) The display area information of the object, for example: the display position of the object (display coordinates), the absolute size (length and width) of the object, the relative size of the object (relative to the amount of change of the previous object display area), whether the object is minimized, the object Whether it is maximized, whether the object is full screen, etc.;

4) The content of the object.

The desktop sub-area refers to any display area of the desktop, and the desktop sub-area may include one or more of the following display areas:

The display area of the application;

The display area of the application i or part of the area i or;

The display area of the object; In summary, the desktop sub-area can be any display area of the desktop divided according to any rules, and can be used to distinguish different applications or objects.

The display information of the desktop sub-area includes at least one of the following information:

1) the category of the application;

2) display area information of the application;

3) the content of the application;

4) the category of the object;

5) display area information of the object;

6) The content of the object.

The application area comparison table is a control relationship between the display area of the desktop and the corresponding application, and may be in the form of a table or a tree. The present invention does not limit the specific storage manner.

Desktop display pixel data refers to the pixel data used to display the entire desktop or part of the desktop. The pixel data of the desktop sub-area refers to the pixel data that can be used to display the sub-area of the desktop. The input event refers to a message sent by the virtual desktop terminal to the network carrying information about the operation of the user's desktop. The input event includes at least one of the following information:

1) The identification information of the button, which key to press, including: keyboard, mouse, game controller, etc. All user-operable input device buttons, joysticks and other operating components;

2) Whether the button is pressed or released;

3) Position information, such as: the position of the mouse (display coordinates), the position of the cursor (display coordinates), the position of the input focus (display coordinates), etc.;

4) mouse click interval;

5) movement information of the scroll wheel;

6) Position information touched by the touch screen, change information of the touched point, velocity information of the touched point, and the like. The application corresponding to the input event refers to the application that accepts the input event.

The object corresponding to the input event refers to the target object that is operated by the input event.

The changed application window refers to the application window where the window position or window size changes. Change The changed application window can be an application window or multiple application windows.

The affected application window refers to an application window that is occluded or visualized due to a change in the changed application window or the appearance of a new application window. The affected application window can be an application window or multiple application windows.

The remote application server can be any device that can be accessed through the network, such as a website server, a network game server, or a network video server.

FIG. 2 is a schematic diagram of a system architecture of distributed processing in a virtual desktop according to an embodiment of the present invention. The embodiment of the present invention is based on the foregoing system architecture.

FIG. 3 is a schematic diagram of a system architecture in a distributed virtual desktop scenario according to an embodiment of the present invention, which is used to show a state that a distributed virtual desktop system may be presented in a specific implementation.

FIG. 4 is a schematic flowchart of a method for distributing processing in another virtual desktop according to an embodiment of the present disclosure, where the method for processing a virtual desktop includes:

Step 311: The virtual desktop management module receives the display information of the application sent by the remote application server.

Step 312: The virtual desktop management module identifies the desktop sub-area;

Specifically, the virtual desktop management module displays a display area of each object in the application, a display area of each object in the application, and multiple objects in the application that have the same or similar processing capabilities (eg, computing power). The display area or the display area of the plurality of objects in the application determined by the rule defined by the user or the virtual desktop service provider is identified as one or more desktop sub-areas, and the desktop sub-area may be a display area of one object or more A collection of display areas of an object, and may also be a partial area of a display area of an object.

Step 313: The virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area;

Specifically, the virtual desktop management module selects a virtual desktop application processing module according to the type of the object in the desktop sub-area and/or the requirement of the processing capability (for example, computing capability) of the object in the desktop sub-area, for example, including The desktop sub-area of the webpage text object selects a virtual desktop application processing module with webpage processing function; selects a video sub-area for the desktop sub-area containing the video object The virtual desktop application processing module of the capability; selects a virtual desktop application processing module with game processing capability for the desktop sub-area including the game object. On the other hand, those skilled in the art can understand that the virtual desktop management module can also select the virtual desktop application processing module according to the system load or randomly.

The virtual desktop application processing module may be newly allocated by the virtual desktop management module or may be previously allocated by the virtual desktop management module. On the other hand, the virtual desktop management module may always select a newly allocated virtual for the desktop sub-area. The desktop application processing module, or the virtual desktop management module can always select the same virtual desktop application processing module for the desktop sub-area.

Further, the virtual desktop management module can use the following method to determine whether to select a newly allocated virtual desktop application processing module for the desktop sub-area:

Method 1: If the virtual desktop management module does not allocate the virtual desktop application processing module for the desktop sub-area or the object in the desktop sub-area, the virtual desktop management module is an object in the desktop sub-area or the desktop sub-area. Redistributing the virtual desktop application processing module; if the virtual desktop management module has previously assigned the virtual desktop application processing module for the desktop sub-area or the object in the desktop sub-area, then selecting the desktop sub-area or the a virtual desktop application processing module that allocates objects in the desktop sub-area; or

Method 2: If the type of the object in the desktop sub-area changes, the virtual desktop management module re-allocates the virtual desktop application processing module for the object in the desktop sub-area or the desktop sub-area, if the type of the object in the desktop sub-area does not change. The virtual desktop management module selects a virtual desktop application processing module previously allocated for the desktop sub-area or an object in the desktop sub-area.

Step 314: The virtual desktop management module acquires pixel data of the desktop sub-area from the virtual desktop application processing module.

Specifically, the virtual desktop management module sends the display information of the desktop sub-area to the selected virtual desktop application processing module, and the virtual desktop application processing module feeds back the pixel data of the desktop sub-area to the virtual desktop management module. The virtual desktop application processing module may generate the pixel data according to the display information of the desktop sub-area in a rendering manner. The generation of pixel data can be performed in the prior art. The invention is not limited in many ways. Step 315: The virtual desktop management module displays the pixel data of the desktop sub-area on the virtual desktop terminal.

Specifically, the virtual desktop management module sends desktop display pixel data to the virtual desktop terminal, and the virtual desktop management module generates pixel data of the entire virtual desktop by using pixel data of the desktop sub-region, and sends the generated virtual desktop pixel data as desktop display pixel data. The virtual desktop management module sends the pixel data of the desktop sub-area as desktop display pixel data to the virtual desktop terminal. The virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.

It should be noted that the memory (ie, a special memory) can store the pixel data of the entire desktop, and each desktop sub-area corresponds to the corresponding address segment in the video memory, and the desktop management module receives the pixels of the desktop sub-area. The data is written into the corresponding address segment. When all the pixel data of the desktop sub-area is written into the video memory, the entire virtual desktop pixel data is generated.

Further, the embodiments of the present invention describe the functions of each module in the method as follows: The functions of the virtual desktop management module are:

1) receiving display information of an application sent by the remote application server;

2) receiving an input operation sent by the virtual terminal;

3) Identify the desktop sub-area;

4) selecting a virtual desktop application processing module for the desktop sub-area;

5) acquiring pixel data of the desktop sub-area from the virtual desktop application processing module, specifically:

A) transmitting display information of the desktop sub-area to the selected virtual desktop application processing module;

B) The receiving virtual desktop application processing module feeds back the pixel data of the desktop sub-area to the virtual desktop management module.

6) displaying the pixel data of the desktop sub-area on the virtual desktop terminal, specifically: sending desktop display pixel data to the virtual desktop terminal, and the virtual desktop management module uses the pixels of the desktop sub-area The data generates pixel data of the entire virtual desktop, and the generated virtual desktop pixel data is sent to the virtual desktop terminal as desktop display pixel data; or the virtual desktop management module sends the pixel data of the desktop sub-region as the desktop display pixel data to the virtual desktop terminal. .

The functions of the virtual desktop application processing module are:

1) receiving display information of a desktop sub-area sent by the virtual desktop management module;

2) Send the pixel data of the desktop sub-area to the virtual desktop management module.

The function of the virtual desktop terminal is: Display the desktop display pixel data sent by the virtual desktop management module on the screen of the virtual desktop terminal.

It should be noted that the description of the function of the above module in the embodiment of the present invention is only an explanation of the side of the solution, and does not mean that the module in the embodiment of the present invention necessarily performs some or all of the above functions, and vice versa. Is optional.

FIG. 5 is a schematic flowchart of a method for distributing and refreshing a virtual desktop according to an embodiment of the present disclosure, where the method for refreshing a virtual desktop includes:

Step 321: The virtual desktop management module receives an input event sent by the virtual terminal, or receives display information of the application sent by the remote application server.

Step 322: The virtual desktop management module identifies the desktop sub-area that needs to be refreshed. Specifically, the virtual desktop management module identifies one or more desktop sub-areas in the changed application window as the desktop sub-area that needs to be refreshed, or one or more One or more desktop sub-areas in the affected application window are identified as desktop sub-areas that need to be refreshed.

It should be noted that, when the virtual desktop management module receives the input event sent by the virtual terminal, the corresponding application is opened according to the input event, thereby causing the virtual desktop to display the content change; or directly receiving the application sent by the remote application server. Display information, causing changes in the content displayed by the virtual desktop.

Step 323: The virtual desktop management module acquires pixel data of the desktop sub-area that needs to be refreshed from the virtual desktop application processing module allocated for the desktop sub-area that needs to be refreshed, by: the virtual desktop management module assigning to the desktop sub-sub-task that needs to be refreshed. The virtual desktop application processing module of the area sends a refresh request of the desktop sub-area; the virtual desktop application processing module feeds back to the virtual desktop management module The pixel data of the refreshed desktop sub-area.

Step 324: The virtual desktop management module displays the pixel data of the desktop sub-region that needs to be refreshed on the virtual desktop terminal by: the virtual desktop management module sending the desktop display pixel data to the virtual desktop terminal. The virtual desktop management module generates pixel data of the entire virtual desktop by using pixel data of the desktop sub-region that needs to be refreshed, and sends the generated virtual desktop pixel data as desktop display pixel data to the virtual desktop terminal; or the virtual desktop management module needs to be refreshed. The pixel data of the desktop sub-area is sent to the virtual desktop terminal as desktop display pixel data. The virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.

Explanation: If the pixel data of the desktop sub-area to be refreshed is stored in the virtual desktop management module, step 323 may be omitted.

The functions of each module in the method shown in step 321 to step 324 are as follows:

The functions of the virtual desktop management module are:

2) receiving an input operation sent by the virtual terminal;

3) Identify the desktop sub-area that needs to be refreshed;

4) Obtain pixel data of the desktop sub-area that needs to be refreshed from the virtual desktop application processing module allocated for the desktop sub-area that needs to be refreshed, specifically:

A) sending a refresh request of the desktop sub-area to the virtual desktop application processing module allocated to the desktop sub-area that needs to be refreshed;

6) displaying the pixel data of the desktop sub-area on the virtual desktop terminal, specifically: sending desktop display pixel data to the virtual desktop terminal, and the virtual desktop management module generates the entire virtual desktop by using pixel data of the desktop sub-area to be refreshed. The pixel data is sent to the virtual desktop terminal as the desktop display pixel data, or the virtual desktop management module sends the pixel data of the desktop sub-region that needs to be refreshed as the desktop display pixel data to the virtual desktop terminal. The functions of the virtual desktop application processing module are:

1) receiving a refresh request of a desktop sub-area sent by the virtual desktop management module;

Therefore, the virtual desktop application processing module can be allocated according to different applications or different objects of the same application according to different desktop sub-areas, thereby avoiding waste of computing power resources caused by differences in computing power between different applications. Further, the embodiment of the present invention can identify different applications and objects in the desktop sub-area, and allocate virtual desktop application processing modules for different applications, objects, or applications or objects having similar requirements for computing power, thereby being able to identify various areas of the virtual desktop. The content and objects are processed according to the application processing capabilities of the content and the object allocation, making the use of computing resources more reasonable and effective.

FIG. 6 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention. The preconditions of the embodiment corresponding to FIG. 6 include: a user accessing a virtual desktop through a virtual desktop terminal. The user performs a desktop operation in the virtual desktop terminal, for example: Double-clicking the online game icon on the virtual desktop or pressing the shortcut key to open the online game icon on the virtual desktop and so on. ,

The method for distributing processing in the virtual desktop includes:

Step 401: The virtual desktop terminal sends an input event to the virtual desktop management module.

Step 402: The virtual desktop management module selects a virtual desktop application processing module, and the method is as follows: the virtual desktop management module parses the input event, and determines an application corresponding to the input event or an object corresponding to the input event according to the location information carried by the input event. ;

The virtual desktop management module selects the virtual desktop application processing module to process the input event, specifically: the virtual desktop management module configures a default virtual desktop application processing module for each application or each type of application, and the virtual desktop management module is configured according to the application. The attribute and \ or system load allocates a virtual desktop application processing module of the default configuration to the application; or, the virtual desktop management module randomly allocates a virtual desktop application processing module for the application. For example: The user clicks on the mouse or the joystick to open a certain game icon in the virtual desktop, and the input event is a click event of the mouse or the joystick, and the virtual desktop management module determines the area where the click occurs according to the coordinates of the click, in the application area comparison table. The application corresponding to the click event is a game icon, and the virtual desktop management module configures the default virtual desktop application processing module-1 for the game icon, so the virtual desktop management module selects the virtual desktop application processing module-1 to process The click event;

The virtual desktop application processing module-1 may be newly allocated by the virtual desktop management module or may be previously allocated by the virtual desktop management module; the virtual desktop management module may always select the newly allocated virtual desktop application processing module processing node. The input event; the virtual desktop management module can always select the same virtual desktop application processing module to process the input event; the virtual desktop management module can also determine whether to select the newly assigned virtual desktop application processing module using the following method: If the virtual desktop management module If the virtual desktop application processing module is not allocated to the application corresponding to the input event or the object corresponding to the input event, the virtual desktop management module newly allocates the virtual desktop application processing module to process the input event; if the virtual desktop management module has previously Assigning a virtual desktop application processing module to the application corresponding to the input event or the object corresponding to the input event, and then selecting an application corresponding to the input event or an object corresponding to the input event Virtual desktop application processing module processes the input event.

Step 403: The virtual desktop management module sends operation information to the selected virtual desktop application processing module-1, where the operation information includes all or part of the information in the input event, and may also include information about the application corresponding to the input event, and may also include Enter the information of the object corresponding to the event:

Step 404: The virtual desktop application processing module -1 sends an application request to the virtual desktop management module. E.g:

1) When the desktop operation event is double-clicking the network game icon, the virtual desktop application processing module sends an application request for establishing a network game link to the virtual desktop management module, which includes at least one of the following information:

a) network game server address;

b) establishing request information for the network link; C) The source address of the request, etc.

Step 405: The virtual desktop management module forwards the application request to the remote application server. As shown in FIG. 7 , in the virtual desktop provided by the embodiment of the present invention, only the application -1 window is opened, and the application -1 window has a desktop state diagram of a content object.

FIG. 8 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention. The method corresponds to the desktop state shown in FIG. 7. The preconditions of the method include:

1) The user double-clicks the icon of the application -1 in the virtual desktop through the virtual desktop terminal -1;

2) The user only opens the application -1 window in the virtual desktop;

3) The remote application server -1 provides services and content for the application -1;

4) and application -1 contains only object -1, for example: online games.

At this point, the status of the virtual desktop is as shown in Figure 7.

The message flow of distributed processing in the virtual desktop corresponding to FIG. 8 includes:

Step 501: The remote application server -1 sends the display information of the application to the virtual desktop management module. For example: The online game website sends the display information of the online game start interface. Since the application -1 contains only object -1, the application's display information includes at least one of the following information:

1) Application area information of -1;

2) the category of the object, ie the category of the object -1;

3) display area information of the object, that is, display area information of the object -1;

4) The content of the object, that is, the content of the object -1.

Step 502: The virtual desktop management module selects a virtual desktop application processing module. In the embodiment of the present invention, the application-1 only contains the object-1, and the virtual desktop management module identifies the area of the application-1 window as the desktop sub-area-1, and the desktop sub-area-1 is equal to the area of the application-1 window, the desktop The sub-area-1 only contains the object-1, and the virtual desktop management module selects the virtual desktop application processing module-1 for the desktop sub-area-1 according to the type of the object-1 or the object-1 to the computing capability requirement. The virtual desktop management module can also select the virtual desktop application processing module according to the system load or randomly.

The virtual desktop application processing module-1 may be newly allocated by the virtual desktop management module or may be previously allocated by the virtual desktop management module. 502-1: The Virtual Desktop Management Module can always assign a new Virtual Desktop Application Processing Module to Desktop Sub-Region-1.

502-2: The virtual desktop management module can always select the same virtual desktop application processing module for desktop sub-area -1.

502-3: The virtual desktop management module can also use the following methods to determine whether it is a desktop sub-area - 1 Select the newly assigned virtual desktop application processing module:

Method 1: If the virtual desktop management module has not previously allocated the virtual desktop application processing module for the desktop sub-area-1 or the object-1, the virtual desktop management module newly allocates the virtual desktop application processing module as the virtual desktop application processing module. -1; if the virtual desktop management module has previously assigned the virtual desktop application processing module for the desktop sub-area-1 or the object-1, the virtual desktop management module selects the desktop sub-area-1 or the The virtual desktop application processing module allocated by the object-1 as a virtual desktop application processing module - 1;

Method 2: If the category of the object-1 changes, the virtual desktop management module newly allocates the virtual desktop application processing module as the virtual desktop application processing module-1. If the category of the object-1 does not change, the virtual desktop management module selects before The desktop sub-area-1 or the virtual desktop application processing module allocated by the object-1 is used as the virtual desktop application processing module-1.

Step 503: The virtual desktop management module sends the display information of the desktop sub-area -1 to the virtual desktop application processing module -1. The display information of the desktop area -1 includes at least one of the following information:

1) the category of the object, ie the category of object -1;

2) display area information of the object, that is, display area information of the object -1;

3) The content of the object, that is, the content of the object -1.

Step 504: The virtual desktop application processing module feeds back the pixel data of the desktop sub-area -1 to the virtual desktop management module. The virtual desktop application processing module generates pixel data of the desktop sub-area -1 according to the desktop sub-area -1 display information, and feeds back the generated pixel data of the desktop sub-area -1 to the virtual desktop management module.

Step 505: The virtual desktop management module sends desktop display pixel data to the virtual desktop terminal. The virtual desktop management module can generate the number of pixels of the entire virtual desktop using the desktop sub-area-1 pixel data. According to the method, the generated pixel data of the entire virtual desktop is sent to the virtual desktop terminal as desktop display pixel data; or the virtual desktop management module sends the pixel data of the desktop sub-area-1 as the desktop display pixel data to the virtual desktop terminal. The virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.

As shown in FIG. 9 , a schematic diagram of a desktop state in which only an application-1 window is opened in the virtual desktop and the application-1 window contains two content objects is provided in the virtual desktop. As shown in FIG. 9 , the present invention is implemented. A schematic diagram of a message flow process for distributed processing in another virtual desktop provided by the example. The prerequisites of the message flow are:

2) The user only opens the application -1 window in the virtual desktop;

3) the content in the application -1 window is from the remote application server -1;

4) and application -1 window contains object -1 and object -2, for example: object -1 is text, object -2 is video.

At this point, the status of the virtual desktop is as shown in Figure 9:

The message flow provided by the embodiment of the present invention includes:

Step 601: The remote application server-1 sends the display information of the application to the virtual desktop management module. Since the application-1 includes the object-1 and the object-2, the display information of the application includes the following information: 1) Application-1 Display area information;

2) the category of the object, ie the category of object -1 and the category of object -2;

3) display area information of the object, that is, display area information of the object -1 and display area information of the object -2;

4) The content of the object, that is, the content of the object -1 and the content of the object -2.

Step 602: The virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area by:

602-1: First, the virtual desktop management module identifies the desktop sub-area. Specifically: the virtual desktop management module identifies at least one of the following as one or more desktop sub-areas:

The display area of each object in the application; The display area of each object in the application;

The display area of multiple objects in the application that have similar computing power requirements; or,

A display area of a plurality of objects in an application determined by rules defined by a user or a virtual desktop service provider.

The desktop sub-area may be a display area of one object or a display area of a plurality of objects, or may be a partial area of a display area of one object. In this embodiment, the virtual desktop management module recognizes the display area of the object -1 as the desktop sub-area -1 and the display area of the object -2 as the desktop sub-area -2.

602-2: The virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area, where: the virtual desktop management module calculates the computing capability according to the type of the object in the desktop sub-area and the object-to-desk sub-area Requirements, system load, or random selection of virtual desktop application processing modules, for example: selecting a virtual desktop application processing module with webpage processing function for the webpage text desktop sub-area, and selecting a virtual desktop application processing module with video processing capability for the video desktop sub-area, Select a virtual desktop application processing module with game processing capabilities for the game desktop sub-area. In this embodiment, the virtual desktop application processing module may be selected according to the type of the object: the virtual desktop management module selects the virtual desktop application processing module-1 with text processing capability for the desktop sub-region-1, and selects video processing for the desktop sub-region-2. Capable Virtual Desktop Application Processing Module-2.

The virtual desktop application processing module may be newly allocated by the virtual desktop management module or may be previously allocated by the virtual desktop management module; the virtual desktop management module may always select a newly allocated virtual desktop application processing module for the desktop sub-area. The virtual desktop management module can always select the same virtual desktop application processing module for the desktop sub-area.

Further, the virtual desktop management module can use the following methods to determine whether to reselect the virtual desktop application processing module for the desktop sub-area:

If the virtual desktop management module does not allocate a virtual desktop application processing module for the desktop sub-area or the object in the desktop sub-area, the virtual desktop management module newly allocates the virtual desktop application processing module; if the virtual desktop management module has been previously The desktop sub-area or the object in the desktop sub-area is assigned a virtual desktop application processing module, and then the previous desktop is selected. a virtual desktop application processing module allocated by an object in the area or the desktop sub-area; or if the type of the object in the desktop sub-area changes, the virtual desktop management module newly allocates a virtual desktop application processing module, if in the desktop sub-area The type of the object does not change, and the virtual desktop management module selects a virtual desktop application processing module previously allocated for the desktop sub-area or an object in the desktop sub-area.

Step 603: The virtual desktop management module sends the display information of the desktop sub-area -1 to the virtual desktop application processing module -1. The display information of the desktop sub-area -1 includes at least one of the following information: 1) the category of the object, that is, the category of the object -1;

3) The content of the object, that is, the content of the object -1.

Step 604: The virtual desktop application processing module -1 feeds back the pixel data of the desktop sub-area -1 to the virtual desktop management module.

Step 605: The virtual desktop management module sends the display information of the desktop sub-area -2 to the virtual desktop application processing module -2. The display information of the desktop sub-area-2 includes at least one of the following information: 1) the category of the object, that is, the category of the object-2;

2) display area information of the object, that is, display area information of the object -2;

3) The content of the object, that is, the content of the object -2.

Step 606: The virtual desktop application processing module -2 feeds back the pixel data of the desktop sub-area -2 to the virtual desktop management module.

Step 607: The virtual desktop management module sends desktop display pixel data to the virtual desktop terminal. The virtual desktop management module may generate pixel data of the entire virtual desktop by using pixel data of the desktop sub-area-1 and pixel data of the desktop sub-area-2, and send the generated virtual desktop pixel data as desktop display pixel data to the virtual desktop terminal; Or the virtual desktop management module sends the pixel data of the desktop sub-area-1 and the pixel data of the desktop sub-area-2 as desktop display pixel data to the virtual desktop terminal. The virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.

It should be noted that the order of steps 603 to 604 and steps 605 to 606 is not limited; This embodiment is also applicable to the case where two or more types of content objects are included in the application window.

As shown in FIG. 11, the application-1 window and application are opened in the virtual desktop provided by the embodiment of the present invention.

-3 window diagram of the desktop state. FIG. 12 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention. The preconditions of the message flow are:

1) The user opens the application -1 window and the application -3 window in the virtual desktop;

2) The user can modify the position or size of the application window by using the desktop operation in the virtual desktop, for example, dragging the mouse, so that the original application -3 window is blocked by the application -1 window to be displayed in the virtual desktop.

At this point, the status of the virtual desktop is as shown in Figure 11.

The message flow provided by the embodiment of the present invention includes:

Step 701: The virtual desktop terminal -1 sends an input event to the virtual desktop management module, where the type of the desktop operation carried by the input event is a mouse click drag.

Step 702: The virtual desktop management module identifies the desktop sub-area that needs to be refreshed. The virtual desktop management module identifies one or more desktop sub-regions in the changed application window as desktop sub-regions that need to be refreshed, or identifies one or more desktop sub-regions in one or more affected application windows as needed The refreshed desktop sub-area (note that, when each application window is displayed, the virtual desktop management module has identified each application's window as one or more desktop sub-areas, and assigned each desktop sub-area The virtual desktop application processing module, the specific process is not described here. The virtual desktop management module sends a refresh request of the desktop sub-area to the virtual desktop application processing module allocated to the desktop sub-area that needs to be refreshed. The application window changed in this embodiment is an application-1 window, the affected application window has an application-3 window, and the virtual desktop management module will apply -1 corresponding desktop sub-area-1 and application-3 corresponding desktop sub-area- 3 is identified as a desktop sub-area that needs to be refreshed.

Step 703: The virtual desktop management module sends a refresh request of the desktop sub-area-1 to the virtual desktop application processing module -1 assigned to the desktop sub-area -1 to be refreshed.

Step 704: The virtual desktop application processing module-1 feeds back the pixel data of the desktop sub-area-1 that needs to be refreshed to the virtual desktop management module. Step 705: The virtual desktop management module sends a refresh request of the desktop sub-area-3 to the virtual desktop application processing module-3 assigned to the desktop sub-area-3 that needs to be refreshed.

Step 706: The virtual desktop application processing module -3 feeds back the pixel data of the desktop sub-area -3 that needs to be refreshed to the virtual desktop management module.

Step 707: The virtual desktop management module sends desktop display pixel data to the virtual desktop terminal. The virtual desktop management module can generate the pixel data of the entire virtual desktop by using the pixel data of the desktop sub-area-1 that needs to be refreshed and the pixel data of the desktop sub-area-3 that needs to be refreshed, and use the generated virtual desktop pixel data as the desktop display pixel data. Sending to the virtual desktop terminal; or the virtual desktop management module sends the pixel data of the desktop sub-area-1 that needs to be refreshed and the pixel data of the desktop sub-area-3 that needs to be refreshed as desktop display pixel data to the virtual desktop terminal. The virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.

It should be noted that the sequence of steps 703 and 705 is not limited. If the pixel data of the desktop sub-area is stored in the virtual desktop management module, steps 703 to 706 may be omitted.

It should also be noted that, after the display content of the virtual desktop is changed, the virtual desktop management module identifies the desktop sub-area that needs to be refreshed, and refreshes the application corresponding to the different area to the application comparison table.

As shown in FIG. 13, a schematic diagram of a desktop state of a partial area of a display area of an application area occlusion application-4 of an application -1 is opened in a virtual desktop provided by an embodiment of the present invention. As shown in FIG. 14, a schematic diagram of a message flow of distributed processing in another virtual desktop provided by an embodiment of the present invention, the preconditions of the message process are:

1) The user opens the application -4 window in the virtual desktop;

2) The user opens the application -1 window in the virtual desktop, the remote application server -1 provides content and services for the application -1, and the remote application server -1 can also actively push the application -1 window to the user's virtual desktop;

3) The display area of the application -1 blocks a part of the display area of the application -4.

At this point, the status of the virtual desktop is as shown in Figure 13.

The message flow provided by the embodiment of the present invention includes: Step 801: The remote application server-1 sends the display information of the application to the virtual desktop management module. Step 802: The virtual desktop management module obtains pixel data of the application-1. The virtual desktop management module identifies the display area of the virtual desktop management module application-1 as one or more desktop sub-areas according to the method of steps 502 to 504 or the method of steps 602 to 606, and the virtual desktop management module acquires and recognizes Pixel data of the desktop sub-area.

Step 803: The virtual desktop management module identifies the desktop sub-area that needs to be refreshed. The virtual desktop management module identifies one or more desktop sub-areas in one or more affected application windows as desktop sub-areas that need to be refreshed, and the virtual desktop management module assigns virtual desktops to each desktop sub-area that needs to be refreshed. The application processing module sends a refresh request of the desktop sub-area. In this embodiment, the affected application window has an application-4 window, and the desktop sub-area-4 corresponding to the application-4 window is identified as a desktop sub-area that needs to be refreshed.

Step 804: The virtual desktop management module sends a refresh request of the desktop sub-area-4 to the virtual desktop application processing module -4 assigned to the desktop sub-area-4.

Step 805: The virtual desktop application processing module -4 feeds back the pixel data of the desktop area -4 to be refreshed to the virtual desktop management module.

Step 806: The virtual desktop management module sends desktop display pixel data to the virtual desktop terminal. The virtual desktop management module generates pixel data of the entire virtual desktop by using the pixel data of the desktop sub-area-1 and the pixel data of the desktop sub-area-4 to be refreshed, and sends the generated virtual desktop pixel data as desktop display pixel data to the virtual desktop. The virtual desktop management module sends the pixel data of the desktop sub-area-1 and the pixel data of the desktop sub-area-4 that needs to be refreshed as desktop display pixel data to the virtual desktop terminal. The virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.

It should be noted that the sequence of step 802 and step 803 to step 805 is not limited. If the pixel data of the desktop sub-area is stored in the virtual desktop management module, step 804 and step 806 may be omitted.

The embodiment of the present invention provides a method for distributing processing in a virtual desktop. When an input event to the virtual terminal or display information of the remote application server causes the display content of the virtual desktop to change, The virtual desktop management module identifies the desktop sub-area that needs to be refreshed, and allocates a virtual desktop application processing module to the identified desktop sub-area according to the foregoing allocation principle, and processes the refresh request of the corresponding desktop sub-area to complete the virtual desktop terminal. Display, so that applications or objects that can satisfy similar computing powers can be allocated to the same virtual desktop application processing module to avoid waste of computing power. Corresponding to the foregoing method embodiment, as shown in FIG. 15, the present invention further provides a distributed processing system in a virtual desktop, including: a virtual desktop management module 1501, at least one virtual desktop application processing module 1502,

a virtual desktop management module 1501, configured to identify a desktop sub-area in an application window corresponding to the application, and select a virtual desktop application processing module 1502 for the desktop sub-area, from the virtual desktop application processing module selected for the desktop sub-area The acquiring the pixel data of the desktop sub-area, and displaying the acquired pixel data of the desktop sub-area on the virtual desktop terminal;

The at least one virtual desktop application processing module 1502 is configured to provide processing capability for the application, and feed back pixel data of the desktop sub-region to the virtual desktop management module.

Further, the virtual desktop management module 1501 is further configured to receive an input event sent by the virtual desktop terminal, and determine an application corresponding to the input event according to the location information carried by the input event.

The virtual desktop management module 1501 is specifically configured to: when the input event is a click event, determine an area where the click occurs according to the coordinate of the click occurrence, and search for an application corresponding to the click event in the application area comparison table.

The virtual desktop management module 1501 is further configured to identify a desktop sub-area that needs to be refreshed, and the desktop sub-area that needs to be refreshed is one or more desktop sub-areas in the application window that is changed due to the input event.

The virtual desktop management module 1501 is further configured to send a refresh request to the virtual desktop application processing module 1502 allocated to the desktop sub-area that needs to be refreshed, and receive the refreshed pixel data fed back by the virtual desktop application processing module 1502.

The system further includes at least one application server 1503, the virtual desktop management module 1501, And being used for receiving display information of the application sent by the application server 1503, where the display information of the application includes at least one of the following information: display area information of the application; a category of the object; Display area information; content of the object.

The virtual desktop management module 1501 is specifically configured to select the virtual desktop application processing module 1502 according to at least one of the following principles:

The virtual desktop management module 1501 selects a virtual desktop application processing module 1502 according to the type of the object in the desktop sub-area;

The virtual desktop management module 1501 selects the virtual desktop application processing module 1502 according to the processing capability requirements of the objects in the desktop sub-area.

The virtual desktop management module 1501 is configured to send the display information of the desktop sub-area to the selected virtual desktop application processing module 1502, and receive the pixel data fed back by the virtual desktop application processing module 1502.

The embodiment of the invention provides a method and a system for distributing processing in a virtual desktop, which can identify content and objects in various areas of the virtual desktop, and process according to the application processing capability corresponding to the content and the object allocation, so that the use of the computing resources is further improved. Reasonable and effective.

While the embodiments of the present invention have been described in the foregoing, it will be understood by those skilled in the art Various omissions, substitutions and changes are made in the details of the methods and systems described above. It is within the scope of the present invention to perform substantially the same functions in substantially the same manner to achieve substantially the same results, for example, in a manner that incorporates the steps of the method described above. Therefore, the scope of the invention is to be limited only by the appended claims.

It will be apparent to those skilled in the art that the present invention can be implemented by means of software plus the necessary general hardware platform. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a storage medium such as a ROM/RAM, a disk, An optical disk or the like includes instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments of the present invention or portions of the embodiments. The above is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Claims

Claim

A distributed processing method in a virtual desktop, comprising:

The virtual desktop management module identifies a desktop sub-area in the application window corresponding to the application;

2. The method of claim 1 wherein the application comprises at least one object.

The method according to claim 1 or 2, wherein the desktop sub-area comprises at least one of the following display areas: a display area of the application; and a display area of the object included in the application.

4. The method according to claim 3, wherein when the application includes a plurality of objects, the desktop sub-region is a display region of each object or a display region of an object having the same or similar processing capability requirements set.

The method of claim 1, wherein before the virtual desktop management module identifies the desktop sub-area in the application window, the method further includes:

The virtual desktop management module receives an input event sent by the virtual desktop terminal;

The virtual desktop management module determines an application corresponding to the input event according to the location information carried by the input event.

The method of claim 5, wherein the determining, by the virtual desktop management module, the application corresponding to the input event according to the location information carried by the input event comprises:

When the input event is a click event, the virtual desktop management module determines an area where the click occurs according to the coordinates of the click occurrence, and searches for an application corresponding to the click event in the application area comparison table.

The method of claim 5, after the virtual desktop management module receives the input event sent by the virtual desktop terminal, the method further includes:

The virtual desktop management module identifies a desktop sub-area that needs to be refreshed, and the desktop sub-area that needs to be refreshed is one or more desktop sub-areas in an application window that is changed due to the input event.

8. The method according to claim 7, wherein the method further comprises:

The virtual desktop management module sends a refresh request to the virtual desktop application processing module allocated to the desktop sub-region that needs to be refreshed, and receives the refreshed pixel data fed back by the virtual desktop application processing module.

The method of claim 2, wherein before the virtual desktop management module identifies the desktop sub-area in the application window, the method further includes:

The virtual desktop management module receives display information of the application sent by the application server, where the display information of the application includes at least one of the following information: display area information of the application; a category of the object; Display area information; content of the object.

The method of claim 1, wherein the selecting, by the virtual desktop management module, the virtual desktop application processing module for the desktop sub-area comprises:

The virtual desktop management module selects a virtual desktop application processing module according to at least one of the following principles:

The virtual desktop management module selects a virtual desktop application processing module according to the type of the object in the desktop sub-area;

The virtual desktop management module selects a virtual desktop application processing module according to requirements of processing capabilities in objects in the desktop sub-area.

The method of claim 10, wherein before the virtual desktop management module selects the virtual desktop application processing module for the desktop sub-area, the method further includes: The virtual desktop management module determines whether the virtual desktop application processing module is selected for the object in the desktop sub-area or the desktop sub-area, and if not, when the object in the virtual desktop sub-area changes, The desktop sub-area reselects the virtual desktop application processing module; if so, selects the assigned virtual desktop application processing module for the desktop sub-area.

The method of claim 1, wherein the acquiring, by the virtual desktop management module, the pixel data of the desktop sub-area from the virtual desktop application processing module selected by the desktop sub-area comprises:

The virtual desktop management module sends the display information of the desktop sub-area to the selected virtual desktop application processing module, and receives pixel data fed back by the virtual desktop application processing module.

The method of claim 1, wherein the displaying, by the virtual desktop management module, the obtained pixel data of the desktop sub-area on the virtual desktop terminal comprises:

The virtual desktop management module generates pixel data of the entire virtual desktop by using the pixel data of the desktop sub-region, and sends the generated virtual desktop pixel data as desktop display pixel data to the virtual desktop terminal; or

The virtual desktop management module sends the pixel data of the desktop sub-area to the virtual desktop terminal as desktop display pixel data.

A distributed processing system in a virtual desktop, the system comprising: a virtual desktop management module, at least one virtual desktop application processing module, wherein

The system of claim 14, wherein the virtual desktop management module is further configured to receive an input event sent by the virtual desktop terminal, and determine the input event according to the location information carried by the input event. The corresponding application.

The system of claim 15, wherein the virtual desktop management module is configured to: when the input event is a click event, determine an area where the click occurs according to the coordinates of the click, and compare the area in the application area. Look up the application corresponding to the click event in the table.

The system of claim 15, wherein the virtual desktop management module is further configured to identify a desktop sub-area that needs to be refreshed, and the desktop sub-area that needs to be refreshed is changed due to the input event. One or more desktop sub-areas in the application window.

The system of claim 17, wherein the virtual desktop management module is further configured to send a refresh request to the virtual desktop application processing module allocated to the desktop sub-region that needs to be refreshed, and receive the virtual The refreshed pixel data fed back by the desktop application processing module.

The system according to claim 14, wherein the system further includes at least one application server, and the virtual desktop management module is further configured to receive display information of the application sent by the application server, where The display information of the application includes at least one of the following information: display area information of the application; a category of the object; display area information of the object; content of the object.

The system of claim 14, wherein the virtual desktop management module is configured to select a virtual desktop application processing module according to at least one of the following principles:

The virtual desktop management module selects a processing capability according to an object in the desktop sub-area Select the virtual desktop application processing module.

The system of claim 14, wherein the virtual desktop management module is configured to send the display information of the desktop sub-area to the selected virtual desktop application processing module, and receive the virtual desktop application processing. Pixel data fed back by the module.