WO2012159361A1 - Système et procédé de traitement distribué pour un bureau virtuel - Google Patents

Système et procédé de traitement distribué pour un bureau virtuel Download PDF

Info

Publication number
WO2012159361A1
WO2012159361A1 PCT/CN2011/077881 CN2011077881W WO2012159361A1 WO 2012159361 A1 WO2012159361 A1 WO 2012159361A1 CN 2011077881 W CN2011077881 W CN 2011077881W WO 2012159361 A1 WO2012159361 A1 WO 2012159361A1
Authority
WO
WIPO (PCT)
Prior art keywords
desktop
virtual desktop
area
application
sub
Prior art date
Application number
PCT/CN2011/077881
Other languages
English (en)
Chinese (zh)
Inventor
李梦
尤昉
程华
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2011/077881 priority Critical patent/WO2012159361A1/fr
Priority to CN2011800013542A priority patent/CN102449604B/zh
Publication of WO2012159361A1 publication Critical patent/WO2012159361A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • the present invention relates to the field of IT, and in particular to a method and system for distributed processing in a virtual desktop. Background technique
  • the system allocates processing power to users (for example, computing power, and the following content of the application is described by taking computing power as an example).
  • a computing power is usually used to process all applications in the virtual desktop.
  • the computing power requirements of different applications or objects can vary widely (for example: When a virtual desktop user passes Virtual desktops open multiple applications, and the content or objects processed by each application opened may have different requirements on computing power. For example, web browsing and online games have different computing power requirements; or, when virtual A desktop user opens an application through a virtual desktop.
  • the application needs to process a variety of content or objects, and the content or object has different requirements on computing power, such as a text portion in a web page, a media playing window, word processing, and multimedia processing.
  • the requirements for computing power vary widely).
  • the current virtual desktop system can only allocate the same resources for all types of content or objects in all applications or applications. If the virtual desktop system allocates resources according to the minimum processing capability requirements, the processing capability cannot be met. The processing of content or objects; if the virtual desktop system allocates resources according to the highest requirements, it will cause waste of resources for content or objects with low processing power requirements.
  • the embodiment of the invention provides a method and a system for distributing processing in a virtual desktop, which can identify desktop sub-areas of different applications, and allocate virtual desktop application processing units for desktop sub-areas of different applications, thereby avoiding waste of resources.
  • An embodiment of the present invention provides a method for distributed processing in a virtual desktop, including: a virtual desktop management module identifying a desktop sub-area in an application window corresponding to the application;
  • the virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area; the virtual desktop management module acquires pixel data of the desktop sub-area from the virtual desktop application processing module selected for the desktop sub-area ;
  • the virtual desktop management module displays the acquired pixel data of the desktop sub-area on the virtual desktop terminal.
  • the embodiment of the present invention further provides a distributed processing system in a virtual desktop, where the system includes: a virtual desktop management module, at least one virtual desktop application processing module, where
  • a virtual desktop management module configured to identify a desktop sub-area in an application window corresponding to the application, select a virtual desktop application processing module for the desktop sub-area, and obtain the location from the virtual desktop application processing module selected for the desktop sub-area Decoding the pixel data of the desktop sub-area, and displaying the acquired pixel data of the desktop sub-area on the virtual desktop terminal;
  • the at least one virtual desktop application processing module is configured to provide processing capability for the application, and feed back pixel data of the desktop sub-region to the virtual desktop management module.
  • the embodiment of the invention provides a method and a system for distributing processing in a virtual desktop.
  • a virtual desktop management module in the virtual desktop system, the desktop sub-area in the application window corresponding to the application is identified, and different desktop sub-areas are selected differently.
  • the virtual desktop application processing module processes the desktop sub-area by the selected virtual desktop application processing module and provides pixel data for display on the virtual desktop terminal, so that the virtual desktop application processing can be allocated according to different desktop sub-areas for different applications.
  • the module avoids the waste of resources caused by the difference in processing capacity requirements of different applications.
  • FIG. 1 is a schematic flowchart of a method for distributed processing in a virtual desktop according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a system architecture for distributed processing in a virtual desktop according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a system according to an embodiment of the present invention. Schematic diagram of a system architecture in a distributed virtual desktop scenario
  • FIG. 4 is a schematic flow chart of a method for distributed processing in another virtual desktop according to an embodiment of the present invention.
  • FIG. 5 is a schematic flowchart of a method for distributing and refreshing a virtual desktop according to an embodiment of the present invention
  • FIG. 6 is a schematic flowchart of message processing of distributed processing in another virtual desktop according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a desktop state in which only an application -1 window is opened in a virtual desktop according to an embodiment of the present invention, and a content object is included in an application -1 window;
  • FIG. 8 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a desktop state in which only an application -1 window is opened in the virtual desktop according to an embodiment of the present invention, and the application -1 window contains two content objects;
  • FIG. 10 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of a desktop state in which an application-1 window and an application-3 window are opened in a virtual desktop according to an embodiment of the present invention
  • FIG. 12 is a schematic flowchart of message processing of distributed processing in another virtual desktop according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of a desktop state of a partial area of a display area of an application area occlusion application-4 of an application -1 in a virtual desktop according to an embodiment of the present invention
  • FIG. 14 is a schematic flowchart of message processing of distributed processing in another virtual desktop according to an embodiment of the present invention.
  • FIG. 15 is a schematic structural diagram of a distributed processing system in a virtual desktop according to an embodiment of the present invention. detailed description
  • a schematic flowchart of a method for distributed processing in a virtual desktop includes:
  • Step 101 The virtual desktop management module identifies a desktop sub-area in the application window corresponding to the application.
  • Step 102 The virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area;
  • Step 103 The virtual desktop management module acquires pixel data of the desktop sub-area from the virtual desktop application processing module selected for the desktop sub-area;
  • Step 104 The virtual desktop management module displays the acquired pixel data of the desktop sub-area on the virtual desktop terminal.
  • the embodiment of the invention provides a method for distributed processing in a virtual desktop.
  • a virtual desktop management module in the virtual desktop system
  • the desktop sub-area in the application window corresponding to the application is identified, and different virtual sub-areas are selected for different desktop sub-areas.
  • the desktop application processing module processes the desktop sub-area by the selected virtual desktop application processing module and provides pixel data for display on the virtual desktop terminal, so that the virtual desktop application processing module can be allocated according to different desktop sub-areas for different applications. The waste of resources caused by the difference in processing capacity requirements of different applications is avoided.
  • the terminal in the embodiment of the present invention refers to all devices having a display function, including but not limited to: a computer display, a television, a portable device, a mobile phone, a thin terminal, and the like.
  • the desktop refers to the display area of the computer system on the terminal display device.
  • An application refers to a program or service in a computer system or a network device that can be used or accessed by a user, such as: an office application, various websites, local games, online games, multimedia download services, web chat services, and other types of network services. Wait.
  • the application window refers to the interface that the application presents to the user.
  • the display area of the application refers to the area of the screen occupied by the application window when displayed on the terminal screen.
  • the object refers to various contents that can be displayed on the terminal, and the object category can be text, video, flash animation, game, icon or hyperlink in the webpage, etc.; the display area of the object refers to the object displayed on the terminal screen The occupied screen area; the content of the object is the data needed to process, display, and deliver the object, such as: text content, video frame data, game data.
  • the display information of the application includes at least one of the following information:
  • Display area information of the application for example: display position of the application window (display coordinates), absolute size (length and width) of the application window, relative size of the application window (relative to the amount of change of the previous application window), whether the application window is the smallest Whether the application window is maximized, whether the application window is full screen, etc.;
  • the display area information of the object for example: the display position of the object (display coordinates), the absolute size (length and width) of the object, the relative size of the object (relative to the amount of change of the previous object display area), whether the object is minimized, the object Whether it is maximized, whether the object is full screen, etc.;
  • the desktop sub-area refers to any display area of the desktop, and the desktop sub-area may include one or more of the following display areas:
  • the display area of the application is the display area of the application.
  • the display area of the object can be any display area of the desktop divided according to any rules, and can be used to distinguish different applications or objects.
  • the display information of the desktop sub-area includes at least one of the following information:
  • the application area comparison table is a control relationship between the display area of the desktop and the corresponding application, and may be in the form of a table or a tree.
  • the present invention does not limit the specific storage manner.
  • Desktop display pixel data refers to the pixel data used to display the entire desktop or part of the desktop.
  • the pixel data of the desktop sub-area refers to the pixel data that can be used to display the sub-area of the desktop.
  • the input event refers to a message sent by the virtual desktop terminal to the network carrying information about the operation of the user's desktop.
  • the input event includes at least one of the following information:
  • buttons, joysticks and other operating components are included in the button, which key to press, including: keyboard, mouse, game controller, etc. All user-operable input device buttons, joysticks and other operating components;
  • Position information such as: the position of the mouse (display coordinates), the position of the cursor (display coordinates), the position of the input focus (display coordinates), etc.;
  • Position information touched by the touch screen refers to the application that accepts the input event.
  • the object corresponding to the input event refers to the target object that is operated by the input event.
  • the changed application window refers to the application window where the window position or window size changes. Change The changed application window can be an application window or multiple application windows.
  • the affected application window refers to an application window that is occluded or visualized due to a change in the changed application window or the appearance of a new application window.
  • the affected application window can be an application window or multiple application windows.
  • the remote application server can be any device that can be accessed through the network, such as a website server, a network game server, or a network video server.
  • FIG. 2 is a schematic diagram of a system architecture of distributed processing in a virtual desktop according to an embodiment of the present invention.
  • the embodiment of the present invention is based on the foregoing system architecture.
  • FIG. 3 is a schematic diagram of a system architecture in a distributed virtual desktop scenario according to an embodiment of the present invention, which is used to show a state that a distributed virtual desktop system may be presented in a specific implementation.
  • FIG. 4 is a schematic flowchart of a method for distributing processing in another virtual desktop according to an embodiment of the present disclosure, where the method for processing a virtual desktop includes:
  • Step 311 The virtual desktop management module receives the display information of the application sent by the remote application server.
  • Step 312 The virtual desktop management module identifies the desktop sub-area
  • the virtual desktop management module displays a display area of each object in the application, a display area of each object in the application, and multiple objects in the application that have the same or similar processing capabilities (eg, computing power).
  • the display area or the display area of the plurality of objects in the application determined by the rule defined by the user or the virtual desktop service provider is identified as one or more desktop sub-areas, and the desktop sub-area may be a display area of one object or more A collection of display areas of an object, and may also be a partial area of a display area of an object.
  • Step 313 The virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area;
  • the virtual desktop management module selects a virtual desktop application processing module according to the type of the object in the desktop sub-area and/or the requirement of the processing capability (for example, computing capability) of the object in the desktop sub-area, for example, including
  • the desktop sub-area of the webpage text object selects a virtual desktop application processing module with webpage processing function; selects a video sub-area for the desktop sub-area containing the video object
  • the virtual desktop application processing module of the capability selects a virtual desktop application processing module with game processing capability for the desktop sub-area including the game object.
  • the virtual desktop management module can also select the virtual desktop application processing module according to the system load or randomly.
  • the virtual desktop application processing module may be newly allocated by the virtual desktop management module or may be previously allocated by the virtual desktop management module. On the other hand, the virtual desktop management module may always select a newly allocated virtual for the desktop sub-area. The desktop application processing module, or the virtual desktop management module can always select the same virtual desktop application processing module for the desktop sub-area.
  • the virtual desktop management module can use the following method to determine whether to select a newly allocated virtual desktop application processing module for the desktop sub-area:
  • Method 1 If the virtual desktop management module does not allocate the virtual desktop application processing module for the desktop sub-area or the object in the desktop sub-area, the virtual desktop management module is an object in the desktop sub-area or the desktop sub-area. Redistributing the virtual desktop application processing module; if the virtual desktop management module has previously assigned the virtual desktop application processing module for the desktop sub-area or the object in the desktop sub-area, then selecting the desktop sub-area or the a virtual desktop application processing module that allocates objects in the desktop sub-area; or
  • Method 2 If the type of the object in the desktop sub-area changes, the virtual desktop management module re-allocates the virtual desktop application processing module for the object in the desktop sub-area or the desktop sub-area, if the type of the object in the desktop sub-area does not change. The virtual desktop management module selects a virtual desktop application processing module previously allocated for the desktop sub-area or an object in the desktop sub-area.
  • Step 314 The virtual desktop management module acquires pixel data of the desktop sub-area from the virtual desktop application processing module.
  • the virtual desktop management module sends the display information of the desktop sub-area to the selected virtual desktop application processing module, and the virtual desktop application processing module feeds back the pixel data of the desktop sub-area to the virtual desktop management module.
  • the virtual desktop application processing module may generate the pixel data according to the display information of the desktop sub-area in a rendering manner. The generation of pixel data can be performed in the prior art. The invention is not limited in many ways.
  • Step 315 The virtual desktop management module displays the pixel data of the desktop sub-area on the virtual desktop terminal.
  • the virtual desktop management module sends desktop display pixel data to the virtual desktop terminal, and the virtual desktop management module generates pixel data of the entire virtual desktop by using pixel data of the desktop sub-region, and sends the generated virtual desktop pixel data as desktop display pixel data.
  • the virtual desktop management module sends the pixel data of the desktop sub-area as desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.
  • the memory ie, a special memory
  • the desktop management module receives the pixels of the desktop sub-area. The data is written into the corresponding address segment.
  • the entire virtual desktop pixel data is generated.
  • the functions of the virtual desktop management module are:
  • the receiving virtual desktop application processing module feeds back the pixel data of the desktop sub-area to the virtual desktop management module.
  • displaying the pixel data of the desktop sub-area on the virtual desktop terminal specifically: sending desktop display pixel data to the virtual desktop terminal, and the virtual desktop management module uses the pixels of the desktop sub-area
  • the data generates pixel data of the entire virtual desktop, and the generated virtual desktop pixel data is sent to the virtual desktop terminal as desktop display pixel data; or the virtual desktop management module sends the pixel data of the desktop sub-region as the desktop display pixel data to the virtual desktop terminal.
  • the functions of the virtual desktop application processing module are:
  • the function of the virtual desktop terminal is: Display the desktop display pixel data sent by the virtual desktop management module on the screen of the virtual desktop terminal.
  • FIG. 5 is a schematic flowchart of a method for distributing and refreshing a virtual desktop according to an embodiment of the present disclosure, where the method for refreshing a virtual desktop includes:
  • Step 321 The virtual desktop management module receives an input event sent by the virtual terminal, or receives display information of the application sent by the remote application server.
  • Step 322 The virtual desktop management module identifies the desktop sub-area that needs to be refreshed. Specifically, the virtual desktop management module identifies one or more desktop sub-areas in the changed application window as the desktop sub-area that needs to be refreshed, or one or more One or more desktop sub-areas in the affected application window are identified as desktop sub-areas that need to be refreshed.
  • the virtual desktop management module when the virtual desktop management module receives the input event sent by the virtual terminal, the corresponding application is opened according to the input event, thereby causing the virtual desktop to display the content change; or directly receiving the application sent by the remote application server. Display information, causing changes in the content displayed by the virtual desktop.
  • Step 323 The virtual desktop management module acquires pixel data of the desktop sub-area that needs to be refreshed from the virtual desktop application processing module allocated for the desktop sub-area that needs to be refreshed, by: the virtual desktop management module assigning to the desktop sub-sub-task that needs to be refreshed.
  • the virtual desktop application processing module of the area sends a refresh request of the desktop sub-area; the virtual desktop application processing module feeds back to the virtual desktop management module The pixel data of the refreshed desktop sub-area.
  • Step 324 The virtual desktop management module displays the pixel data of the desktop sub-region that needs to be refreshed on the virtual desktop terminal by: the virtual desktop management module sending the desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop management module generates pixel data of the entire virtual desktop by using pixel data of the desktop sub-region that needs to be refreshed, and sends the generated virtual desktop pixel data as desktop display pixel data to the virtual desktop terminal; or the virtual desktop management module needs to be refreshed.
  • the pixel data of the desktop sub-area is sent to the virtual desktop terminal as desktop display pixel data.
  • the virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.
  • step 323 may be omitted.
  • each module in the method shown in step 321 to step 324 are as follows:
  • the functions of the virtual desktop management module are:
  • the receiving virtual desktop application processing module feeds back the pixel data of the desktop sub-area to the virtual desktop management module.
  • displaying the pixel data of the desktop sub-area on the virtual desktop terminal specifically: sending desktop display pixel data to the virtual desktop terminal, and the virtual desktop management module generates the entire virtual desktop by using pixel data of the desktop sub-area to be refreshed.
  • the pixel data is sent to the virtual desktop terminal as the desktop display pixel data, or the virtual desktop management module sends the pixel data of the desktop sub-region that needs to be refreshed as the desktop display pixel data to the virtual desktop terminal.
  • the functions of the virtual desktop application processing module are:
  • the function of the virtual desktop terminal is: Display the desktop display pixel data sent by the virtual desktop management module on the screen of the virtual desktop terminal.
  • the virtual desktop application processing module can be allocated according to different applications or different objects of the same application according to different desktop sub-areas, thereby avoiding waste of computing power resources caused by differences in computing power between different applications.
  • the embodiment of the present invention can identify different applications and objects in the desktop sub-area, and allocate virtual desktop application processing modules for different applications, objects, or applications or objects having similar requirements for computing power, thereby being able to identify various areas of the virtual desktop.
  • the content and objects are processed according to the application processing capabilities of the content and the object allocation, making the use of computing resources more reasonable and effective.
  • FIG. 6 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention.
  • the preconditions of the embodiment corresponding to FIG. 6 include: a user accessing a virtual desktop through a virtual desktop terminal.
  • the user performs a desktop operation in the virtual desktop terminal, for example: Double-clicking the online game icon on the virtual desktop or pressing the shortcut key to open the online game icon on the virtual desktop and so on.
  • the method for distributing processing in the virtual desktop includes:
  • Step 401 The virtual desktop terminal sends an input event to the virtual desktop management module.
  • Step 402 The virtual desktop management module selects a virtual desktop application processing module, and the method is as follows: the virtual desktop management module parses the input event, and determines an application corresponding to the input event or an object corresponding to the input event according to the location information carried by the input event. ;
  • the virtual desktop management module selects the virtual desktop application processing module to process the input event, specifically: the virtual desktop management module configures a default virtual desktop application processing module for each application or each type of application, and the virtual desktop management module is configured according to the application.
  • the attribute and ⁇ or system load allocates a virtual desktop application processing module of the default configuration to the application; or, the virtual desktop management module randomly allocates a virtual desktop application processing module for the application.
  • the application corresponding to the click event is a game icon, and the virtual desktop management module configures the default virtual desktop application processing module-1 for the game icon, so the virtual desktop management module selects the virtual desktop application processing module-1 to process The click event;
  • the virtual desktop application processing module-1 may be newly allocated by the virtual desktop management module or may be previously allocated by the virtual desktop management module; the virtual desktop management module may always select the newly allocated virtual desktop application processing module processing node.
  • Step 403 The virtual desktop management module sends operation information to the selected virtual desktop application processing module-1, where the operation information includes all or part of the information in the input event, and may also include information about the application corresponding to the input event, and may also include Enter the information of the object corresponding to the event:
  • Step 404 The virtual desktop application processing module -1 sends an application request to the virtual desktop management module.
  • the virtual desktop application processing module sends an application request for establishing a network game link to the virtual desktop management module, which includes at least one of the following information:
  • Step 405 The virtual desktop management module forwards the application request to the remote application server. As shown in FIG. 7 , in the virtual desktop provided by the embodiment of the present invention, only the application -1 window is opened, and the application -1 window has a desktop state diagram of a content object.
  • FIG. 8 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention.
  • the method corresponds to the desktop state shown in FIG. 7.
  • the preconditions of the method include:
  • the remote application server -1 provides services and content for the application -1;
  • application -1 contains only object -1, for example: online games.
  • the message flow of distributed processing in the virtual desktop corresponding to FIG. 8 includes:
  • Step 501 The remote application server -1 sends the display information of the application to the virtual desktop management module.
  • the online game website sends the display information of the online game start interface. Since the application -1 contains only object -1, the application's display information includes at least one of the following information:
  • Step 502 The virtual desktop management module selects a virtual desktop application processing module.
  • the application-1 only contains the object-1
  • the virtual desktop management module identifies the area of the application-1 window as the desktop sub-area-1, and the desktop sub-area-1 is equal to the area of the application-1 window, the desktop
  • the sub-area-1 only contains the object-1
  • the virtual desktop management module selects the virtual desktop application processing module-1 for the desktop sub-area-1 according to the type of the object-1 or the object-1 to the computing capability requirement.
  • the virtual desktop management module can also select the virtual desktop application processing module according to the system load or randomly.
  • the virtual desktop application processing module-1 may be newly allocated by the virtual desktop management module or may be previously allocated by the virtual desktop management module. 502-1: The Virtual Desktop Management Module can always assign a new Virtual Desktop Application Processing Module to Desktop Sub-Region-1.
  • the virtual desktop management module can always select the same virtual desktop application processing module for desktop sub-area -1.
  • the virtual desktop management module can also use the following methods to determine whether it is a desktop sub-area - 1 Select the newly assigned virtual desktop application processing module:
  • Method 1 If the virtual desktop management module has not previously allocated the virtual desktop application processing module for the desktop sub-area-1 or the object-1, the virtual desktop management module newly allocates the virtual desktop application processing module as the virtual desktop application processing module. -1; if the virtual desktop management module has previously assigned the virtual desktop application processing module for the desktop sub-area-1 or the object-1, the virtual desktop management module selects the desktop sub-area-1 or the The virtual desktop application processing module allocated by the object-1 as a virtual desktop application processing module - 1;
  • Method 2 If the category of the object-1 changes, the virtual desktop management module newly allocates the virtual desktop application processing module as the virtual desktop application processing module-1. If the category of the object-1 does not change, the virtual desktop management module selects before The desktop sub-area-1 or the virtual desktop application processing module allocated by the object-1 is used as the virtual desktop application processing module-1.
  • Step 503 The virtual desktop management module sends the display information of the desktop sub-area -1 to the virtual desktop application processing module -1.
  • the display information of the desktop area -1 includes at least one of the following information:
  • Step 504 The virtual desktop application processing module feeds back the pixel data of the desktop sub-area -1 to the virtual desktop management module.
  • the virtual desktop application processing module generates pixel data of the desktop sub-area -1 according to the desktop sub-area -1 display information, and feeds back the generated pixel data of the desktop sub-area -1 to the virtual desktop management module.
  • Step 505 The virtual desktop management module sends desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop management module can generate the number of pixels of the entire virtual desktop using the desktop sub-area-1 pixel data. According to the method, the generated pixel data of the entire virtual desktop is sent to the virtual desktop terminal as desktop display pixel data; or the virtual desktop management module sends the pixel data of the desktop sub-area-1 as the desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.
  • FIG. 9 a schematic diagram of a desktop state in which only an application-1 window is opened in the virtual desktop and the application-1 window contains two content objects is provided in the virtual desktop.
  • the present invention is implemented.
  • a schematic diagram of a message flow process for distributed processing in another virtual desktop provided by the example. The prerequisites of the message flow are:
  • the content in the application -1 window is from the remote application server -1;
  • application -1 window contains object -1 and object -2, for example: object -1 is text, object -2 is video.
  • Step 601 The remote application server-1 sends the display information of the application to the virtual desktop management module. Since the application-1 includes the object-1 and the object-2, the display information of the application includes the following information: 1) Application-1 Display area information;
  • display area information of the object that is, display area information of the object -1 and display area information of the object -2;
  • the content of the object that is, the content of the object -1 and the content of the object -2.
  • Step 602 The virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area by:
  • the virtual desktop management module identifies the desktop sub-area. Specifically: the virtual desktop management module identifies at least one of the following as one or more desktop sub-areas:
  • the display area of each object in the application The display area of each object in the application;
  • a display area of a plurality of objects in an application determined by rules defined by a user or a virtual desktop service provider.
  • the desktop sub-area may be a display area of one object or a display area of a plurality of objects, or may be a partial area of a display area of one object.
  • the virtual desktop management module recognizes the display area of the object -1 as the desktop sub-area -1 and the display area of the object -2 as the desktop sub-area -2.
  • the virtual desktop management module selects a virtual desktop application processing module for the desktop sub-area, where: the virtual desktop management module calculates the computing capability according to the type of the object in the desktop sub-area and the object-to-desk sub-area Requirements, system load, or random selection of virtual desktop application processing modules, for example: selecting a virtual desktop application processing module with webpage processing function for the webpage text desktop sub-area, and selecting a virtual desktop application processing module with video processing capability for the video desktop sub-area, Select a virtual desktop application processing module with game processing capabilities for the game desktop sub-area.
  • the virtual desktop application processing module may be selected according to the type of the object: the virtual desktop management module selects the virtual desktop application processing module-1 with text processing capability for the desktop sub-region-1, and selects video processing for the desktop sub-region-2. Capable Virtual Desktop Application Processing Module-2.
  • the virtual desktop application processing module may be newly allocated by the virtual desktop management module or may be previously allocated by the virtual desktop management module; the virtual desktop management module may always select a newly allocated virtual desktop application processing module for the desktop sub-area.
  • the virtual desktop management module can always select the same virtual desktop application processing module for the desktop sub-area.
  • the virtual desktop management module can use the following methods to determine whether to reselect the virtual desktop application processing module for the desktop sub-area:
  • the virtual desktop management module does not allocate a virtual desktop application processing module for the desktop sub-area or the object in the desktop sub-area, the virtual desktop management module newly allocates the virtual desktop application processing module; if the virtual desktop management module has been previously The desktop sub-area or the object in the desktop sub-area is assigned a virtual desktop application processing module, and then the previous desktop is selected. a virtual desktop application processing module allocated by an object in the area or the desktop sub-area; or if the type of the object in the desktop sub-area changes, the virtual desktop management module newly allocates a virtual desktop application processing module, if in the desktop sub-area The type of the object does not change, and the virtual desktop management module selects a virtual desktop application processing module previously allocated for the desktop sub-area or an object in the desktop sub-area.
  • Step 603 The virtual desktop management module sends the display information of the desktop sub-area -1 to the virtual desktop application processing module -1.
  • the display information of the desktop sub-area -1 includes at least one of the following information: 1) the category of the object, that is, the category of the object -1;
  • Step 604 The virtual desktop application processing module -1 feeds back the pixel data of the desktop sub-area -1 to the virtual desktop management module.
  • Step 605 The virtual desktop management module sends the display information of the desktop sub-area -2 to the virtual desktop application processing module -2.
  • the display information of the desktop sub-area-2 includes at least one of the following information: 1) the category of the object, that is, the category of the object-2;
  • Step 606 The virtual desktop application processing module -2 feeds back the pixel data of the desktop sub-area -2 to the virtual desktop management module.
  • Step 607 The virtual desktop management module sends desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop management module may generate pixel data of the entire virtual desktop by using pixel data of the desktop sub-area-1 and pixel data of the desktop sub-area-2, and send the generated virtual desktop pixel data as desktop display pixel data to the virtual desktop terminal; Or the virtual desktop management module sends the pixel data of the desktop sub-area-1 and the pixel data of the desktop sub-area-2 as desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.
  • steps 603 to 604 and steps 605 to 606 is not limited; This embodiment is also applicable to the case where two or more types of content objects are included in the application window.
  • the application-1 window and application are opened in the virtual desktop provided by the embodiment of the present invention.
  • FIG. 12 is a schematic diagram of a message flow of distributed processing in another virtual desktop according to an embodiment of the present invention.
  • the preconditions of the message flow are:
  • the user can modify the position or size of the application window by using the desktop operation in the virtual desktop, for example, dragging the mouse, so that the original application -3 window is blocked by the application -1 window to be displayed in the virtual desktop.
  • Step 701 The virtual desktop terminal -1 sends an input event to the virtual desktop management module, where the type of the desktop operation carried by the input event is a mouse click drag.
  • Step 702 The virtual desktop management module identifies the desktop sub-area that needs to be refreshed.
  • the virtual desktop management module identifies one or more desktop sub-regions in the changed application window as desktop sub-regions that need to be refreshed, or identifies one or more desktop sub-regions in one or more affected application windows as needed
  • the refreshed desktop sub-area (note that, when each application window is displayed, the virtual desktop management module has identified each application's window as one or more desktop sub-areas, and assigned each desktop sub-area
  • the virtual desktop application processing module the specific process is not described here.
  • the virtual desktop management module sends a refresh request of the desktop sub-area to the virtual desktop application processing module allocated to the desktop sub-area that needs to be refreshed.
  • the application window changed in this embodiment is an application-1 window
  • the affected application window has an application-3 window
  • the virtual desktop management module will apply -1 corresponding desktop sub-area-1 and application-3 corresponding desktop sub-area- 3 is identified as a desktop sub-area that needs to be refreshed.
  • Step 703 The virtual desktop management module sends a refresh request of the desktop sub-area-1 to the virtual desktop application processing module -1 assigned to the desktop sub-area -1 to be refreshed.
  • Step 704 The virtual desktop application processing module-1 feeds back the pixel data of the desktop sub-area-1 that needs to be refreshed to the virtual desktop management module.
  • Step 705 The virtual desktop management module sends a refresh request of the desktop sub-area-3 to the virtual desktop application processing module-3 assigned to the desktop sub-area-3 that needs to be refreshed.
  • Step 706 The virtual desktop application processing module -3 feeds back the pixel data of the desktop sub-area -3 that needs to be refreshed to the virtual desktop management module.
  • Step 707 The virtual desktop management module sends desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop management module can generate the pixel data of the entire virtual desktop by using the pixel data of the desktop sub-area-1 that needs to be refreshed and the pixel data of the desktop sub-area-3 that needs to be refreshed, and use the generated virtual desktop pixel data as the desktop display pixel data.
  • Sending to the virtual desktop terminal; or the virtual desktop management module sends the pixel data of the desktop sub-area-1 that needs to be refreshed and the pixel data of the desktop sub-area-3 that needs to be refreshed as desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.
  • steps 703 and 705 is not limited. If the pixel data of the desktop sub-area is stored in the virtual desktop management module, steps 703 to 706 may be omitted.
  • the virtual desktop management module identifies the desktop sub-area that needs to be refreshed, and refreshes the application corresponding to the different area to the application comparison table.
  • FIG. 13 a schematic diagram of a desktop state of a partial area of a display area of an application area occlusion application-4 of an application -1 is opened in a virtual desktop provided by an embodiment of the present invention.
  • FIG. 14 a schematic diagram of a message flow of distributed processing in another virtual desktop provided by an embodiment of the present invention, the preconditions of the message process are:
  • the remote application server -1 provides content and services for the application -1, and the remote application server -1 can also actively push the application -1 window to the user's virtual desktop;
  • the display area of the application -1 blocks a part of the display area of the application -4.
  • the message flow provided by the embodiment of the present invention includes: Step 801: The remote application server-1 sends the display information of the application to the virtual desktop management module.
  • the virtual desktop management module identifies the display area of the virtual desktop management module application-1 as one or more desktop sub-areas according to the method of steps 502 to 504 or the method of steps 602 to 606, and the virtual desktop management module acquires and recognizes Pixel data of the desktop sub-area.
  • Step 803 The virtual desktop management module identifies the desktop sub-area that needs to be refreshed.
  • the virtual desktop management module identifies one or more desktop sub-areas in one or more affected application windows as desktop sub-areas that need to be refreshed, and the virtual desktop management module assigns virtual desktops to each desktop sub-area that needs to be refreshed.
  • the application processing module sends a refresh request of the desktop sub-area.
  • the affected application window has an application-4 window
  • the desktop sub-area-4 corresponding to the application-4 window is identified as a desktop sub-area that needs to be refreshed.
  • Step 804 The virtual desktop management module sends a refresh request of the desktop sub-area-4 to the virtual desktop application processing module -4 assigned to the desktop sub-area-4.
  • Step 805 The virtual desktop application processing module -4 feeds back the pixel data of the desktop area -4 to be refreshed to the virtual desktop management module.
  • Step 806 The virtual desktop management module sends desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop management module generates pixel data of the entire virtual desktop by using the pixel data of the desktop sub-area-1 and the pixel data of the desktop sub-area-4 to be refreshed, and sends the generated virtual desktop pixel data as desktop display pixel data to the virtual desktop.
  • the virtual desktop management module sends the pixel data of the desktop sub-area-1 and the pixel data of the desktop sub-area-4 that needs to be refreshed as desktop display pixel data to the virtual desktop terminal.
  • the virtual desktop terminal displays the received desktop display pixel data on the screen of the virtual desktop terminal.
  • step 802 and step 803 to step 805 is not limited. If the pixel data of the desktop sub-area is stored in the virtual desktop management module, step 804 and step 806 may be omitted.
  • the embodiment of the present invention provides a method for distributing processing in a virtual desktop.
  • the virtual desktop management module identifies the desktop sub-area that needs to be refreshed, and allocates a virtual desktop application processing module to the identified desktop sub-area according to the foregoing allocation principle, and processes the refresh request of the corresponding desktop sub-area to complete the virtual desktop terminal. Display, so that applications or objects that can satisfy similar computing powers can be allocated to the same virtual desktop application processing module to avoid waste of computing power.
  • the present invention further provides a distributed processing system in a virtual desktop, including: a virtual desktop management module 1501, at least one virtual desktop application processing module 1502,
  • a virtual desktop management module 1501 configured to identify a desktop sub-area in an application window corresponding to the application, and select a virtual desktop application processing module 1502 for the desktop sub-area, from the virtual desktop application processing module selected for the desktop sub-area The acquiring the pixel data of the desktop sub-area, and displaying the acquired pixel data of the desktop sub-area on the virtual desktop terminal;
  • the at least one virtual desktop application processing module 1502 is configured to provide processing capability for the application, and feed back pixel data of the desktop sub-region to the virtual desktop management module.
  • the virtual desktop management module 1501 is further configured to receive an input event sent by the virtual desktop terminal, and determine an application corresponding to the input event according to the location information carried by the input event.
  • the virtual desktop management module 1501 is specifically configured to: when the input event is a click event, determine an area where the click occurs according to the coordinate of the click occurrence, and search for an application corresponding to the click event in the application area comparison table.
  • the virtual desktop management module 1501 is further configured to identify a desktop sub-area that needs to be refreshed, and the desktop sub-area that needs to be refreshed is one or more desktop sub-areas in the application window that is changed due to the input event.
  • the virtual desktop management module 1501 is further configured to send a refresh request to the virtual desktop application processing module 1502 allocated to the desktop sub-area that needs to be refreshed, and receive the refreshed pixel data fed back by the virtual desktop application processing module 1502.
  • the system further includes at least one application server 1503, the virtual desktop management module 1501, And being used for receiving display information of the application sent by the application server 1503, where the display information of the application includes at least one of the following information: display area information of the application; a category of the object; Display area information; content of the object.
  • the virtual desktop management module 1501 is specifically configured to select the virtual desktop application processing module 1502 according to at least one of the following principles:
  • the virtual desktop management module 1501 selects a virtual desktop application processing module 1502 according to the type of the object in the desktop sub-area;
  • the virtual desktop management module 1501 selects the virtual desktop application processing module 1502 according to the processing capability requirements of the objects in the desktop sub-area.
  • the virtual desktop management module 1501 is configured to send the display information of the desktop sub-area to the selected virtual desktop application processing module 1502, and receive the pixel data fed back by the virtual desktop application processing module 1502.
  • the embodiment of the invention provides a method and a system for distributing processing in a virtual desktop, which can identify content and objects in various areas of the virtual desktop, and process according to the application processing capability corresponding to the content and the object allocation, so that the use of the computing resources is further improved. Reasonable and effective.
  • the present invention can be implemented by means of software plus the necessary general hardware platform. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a storage medium such as a ROM/RAM, a disk, An optical disk or the like includes instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments of the present invention or portions of the embodiments.
  • a computer device which may be a personal computer, server, or network device, etc.

Abstract

L'invention concerne un système et un procédé de bureau virtuel distribué. Le procédé comprend les étapes suivantes : un module de gestion de bureau virtuel identifie une sous-zone de bureau dans une fenêtre d'application correspondante d'une application ; le module de gestion de bureau virtuel sélectionne un module de traitement d'application de bureau virtuel pour la sous-zone de bureau ; le module de gestion de bureau virtuel acquiert des données de pixels de la sous-zone de bureau à partir du module de traitement d'application de bureau virtuel sélectionné pour la sous-zone de bureau ; le module de gestion de bureau virtuel affiche les données de pixels acquises de la sous-zone de bureau sur un terminal de bureau virtuel, de sorte que, étant destiné à des applications différentes, le module de traitement d'application de bureau virtuel peut être distribué selon les sous-zones de bureau différentes, en évitant le gaspillage des ressources de puissance informatiques dû à la puissance de traitement différente des applications différentes.
PCT/CN2011/077881 2011-08-01 2011-08-01 Système et procédé de traitement distribué pour un bureau virtuel WO2012159361A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2011/077881 WO2012159361A1 (fr) 2011-08-01 2011-08-01 Système et procédé de traitement distribué pour un bureau virtuel
CN2011800013542A CN102449604B (zh) 2011-08-01 2011-08-01 虚拟桌面中分布处理的方法和系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/077881 WO2012159361A1 (fr) 2011-08-01 2011-08-01 Système et procédé de traitement distribué pour un bureau virtuel

Publications (1)

Publication Number Publication Date
WO2012159361A1 true WO2012159361A1 (fr) 2012-11-29

Family

ID=46010197

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/077881 WO2012159361A1 (fr) 2011-08-01 2011-08-01 Système et procédé de traitement distribué pour un bureau virtuel

Country Status (2)

Country Link
CN (1) CN102449604B (fr)
WO (1) WO2012159361A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103414712B (zh) * 2013-08-05 2016-01-27 深圳市杰云科技有限公司 一种分布式虚拟桌面管理系统和方法
CN103838375B (zh) * 2014-02-28 2017-12-29 深信服科技股份有限公司 终端输入方法及终端
CN106126252A (zh) * 2016-06-30 2016-11-16 乐视控股（北京）有限公司 一种加载应用桌面的方法及电子设备
CN107426114B (zh) * 2017-08-28 2021-02-12 西安万像电子科技有限公司 资源分配方法及系统
CN108021425B (zh) * 2017-12-28 2020-11-03 南开大学 一种集成多个应用图形窗口的虚拟桌面系统及运行方法
CN110138817A (zh) * 2018-02-08 2019-08-16 中兴通讯股份有限公司 流媒体播放方法、装置、设备及计算机可读存储介质
CN111431948B (zh) * 2020-06-15 2020-10-16 广东睿江云计算股份有限公司 一种框架与内容分离的云桌面优化显示方法及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101288104A (zh) * 2003-10-23 2008-10-15 微软公司 动态视窗分解
CN101661370A (zh) * 2008-08-28 2010-03-03 索尼株式会社 信息处理设备、方法和计算机程序
CN101754046A (zh) * 2008-12-18 2010-06-23 威睿公司 使用显示通道测量客户交互性能
CN102027464A (zh) * 2008-05-12 2011-04-20 微软公司 虚拟桌面视图滚动

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8046468B2 (en) * 2009-01-26 2011-10-25 Vmware, Inc. Process demand prediction for distributed power and resource management
US20110161404A1 (en) * 2009-12-31 2011-06-30 Nimbus Is, Inc. Systems and methods for communicating data between a server and a device on a virtual desktop

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101288104A (zh) * 2003-10-23 2008-10-15 微软公司 动态视窗分解
CN102027464A (zh) * 2008-05-12 2011-04-20 微软公司 虚拟桌面视图滚动
CN101661370A (zh) * 2008-08-28 2010-03-03 索尼株式会社 信息处理设备、方法和计算机程序
CN101754046A (zh) * 2008-12-18 2010-06-23 威睿公司 使用显示通道测量客户交互性能

Also Published As

Publication number Publication date
CN102449604A (zh) 2012-05-09
CN102449604B (zh) 2013-03-27

Similar Documents

Publication Publication Date Title
US10877826B2 (en) Message processing method and apparatus, storage medium, and computer device
WO2012159361A1 (fr) Système et procédé de traitement distribué pour un bureau virtuel
WO2021072912A1 (fr) Procédé, appareil et système de partage de fichiers, dispositif intelligent interactif, dispositif d'extrémité source et support de stockage
JP6328947B2 (ja) マルチタスキング運用のための画面表示方法及びこれをサポートする端末機
JP5325286B2 (ja) 複数種類のコンピューティングデバイス間で複数の情報形態に対話する装置および方法
US8074227B2 (en) Utilizing a first managed process to host at least a second managed process
US9052806B2 (en) User interface for presenting media items of social networking service in media reel
US20130268826A1 (en) Synchronizing progress in audio and text versions of electronic books
CN111124668B (zh) 内存释放方法、装置、存储介质及终端
JP2005108210A (ja) デジタルコンテンツ表示表示方法、デジタルコンテンツ表示提示方法、デジタルコンテンツ提示方法、インタラクション情報決定方法、デジタルコンテンツ配信方法、デジタルコンテンツ表示表示プログラム、及び、システム
JP2005108210A5 (fr)
WO2023005197A1 (fr) Procédé d'affichage de contenu et terminal
JP2014514668A (ja) 階層的領域におけるマルチ入力ジェスチャー
JP2020161135A (ja) チャットスレッドを表示するための方法およびシステム
CN113268212A (zh) 投屏方法、装置、存储介质及电子设备
CN110992112A (zh) 广告信息的处理方法和装置
CN112035195A (zh) 应用界面的展示方法、装置、电子设备及存储介质
US20220244845A1 (en) Method, device, electronic device, and storage medium for sending and receiving message
CN111045565B (zh) 多媒体页面的切换方法及电子设备
US10327027B2 (en) Methods for screencasting and systems and apparatuses using the same
JP6294349B2 (ja) タブボタンの管理
US10148602B2 (en) Enhancing messaging application functionality
CN114090896A (zh) 信息展示方法、装置及电子设备
CN114253449A (zh) 截屏方法、装置、设备及介质
US11673044B1 (en) Contextual recommendations in media streaming

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201180001354.2

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11866428

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11866428

Country of ref document: EP

Kind code of ref document: A1