CN114443192A - Multi-window virtual application method and device based on cloud desktop - Google Patents
Multi-window virtual application method and device based on cloud desktop Download PDFInfo
- Publication number
- CN114443192A CN114443192A CN202111619673.1A CN202111619673A CN114443192A CN 114443192 A CN114443192 A CN 114443192A CN 202111619673 A CN202111619673 A CN 202111619673A CN 114443192 A CN114443192 A CN 114443192A
- Authority
- CN
- China
- Prior art keywords
- window
- virtual application
- application
- cloud desktop
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 90
- 230000008569 process Effects 0.000 claims abstract description 52
- 238000009877 rendering Methods 0.000 claims abstract description 10
- 238000012545 processing Methods 0.000 claims description 22
- 238000004891 communication Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 abstract description 6
- 230000000694 effects Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011900 installation process Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
Abstract
The invention discloses a cloud desktop-based multi-window virtual application method and device, wherein all windows of an application process are subjected to independent screenshot in a cloud desktop, a transmission channel with a client side is independently established for each window to carry out picture transmission, a virtual application client side supports multi-window rendering, and pictures of each channel are rendered, so that the effect of multi-window virtual application based on the cloud desktop can be achieved, all windows of the multi-window virtual application can be specifically supported to be displayed simultaneously, a user can use the virtual application to be more similar to local application, and multi-window linkage experience is smooth.
Description
Technical Field
The invention relates to the technical field of IT and software development, in particular to a cloud desktop-based multi-window virtual application method and device.
Background
The virtual application is an application which does not need to be installed, is ready to use and has a user experience similar to that of the local application, compared with the traditional method that a user needs to install the application locally in advance to run and use the application. The virtual application does not need to solve the problem of system compatibility in the traditional application installation process, and has the advantages of low requirement on local terminal configuration and the like.
The multi-window application is also called a multi-window application program and comprises a main window and a plurality of auxiliary windows. For example: the QQ has a main window and multiple chat windows.
Generally, the implementation of virtual applications is mainly directed to virtualizing the current interface of the application, and a user can only see one application interface. When the application has multiple interfaces, the multiple interfaces cannot be displayed simultaneously, and the user cannot switch the interfaces, so that the user still cannot operate the application interfaces of the multiple virtual applications completely like a local application.
Disclosure of Invention
The embodiment of the invention provides a multi-window virtual application method and device based on a cloud desktop, which are used for solving the problem that a user cannot use multi-window virtual application in the prior art.
The embodiment of the invention provides a cloud desktop-based multi-window virtual application method, which is applied to a virtual application client and comprises the following steps:
when an instruction of opening a virtual application is received, the virtual application is opened, and communication to a cloud desktop server is established;
when window screenshots of all application processes sent by the cloud desktop server through a plurality of independent channels are received, rendering each window screenshot respectively;
and displaying each rendered screenshot of the window.
In one embodiment, further comprising:
and when an instruction of adjusting the size of the window screenshot is received, correspondingly adjusting the size of the displayed window screenshot, and sending a corresponding size adjusting instruction to the cloud desktop server.
In one embodiment, further comprising:
and when an instruction of closing the virtual application is received, closing the virtual application, and sending a quit closing instruction to the cloud desktop server.
On the other hand, the embodiment of the invention provides a cloud desktop-based multi-window virtual application method, which is applied to a cloud desktop server and comprises the following steps:
when a request for establishing communication with an opened virtual application sent by a virtual application client is received, opening an application process corresponding to the virtual application, or distributing a pre-opened application process corresponding to the virtual application client;
detecting windows of all application processes running in a cloud desktop, and respectively capturing the windows of all the application processes to obtain a plurality of window screenshots;
and establishing an independent channel with the virtual application client for each application process, and sending each window screenshot to the virtual application client through the independent channel.
In one embodiment, further comprising:
and when a size adjusting instruction sent by the virtual application client executing the size of the screenshot of the window is received, adjusting the window size of the application process.
In one embodiment, further comprising:
and when receiving a quit closing instruction sent by the virtual application client for closing the virtual application, quitting the application process corresponding to the virtual application and closing the window of the application process.
In another aspect, an embodiment of the present invention provides a virtual application client, including:
the system comprises a first processing module, a second processing module and a third processing module, wherein the first processing module is used for opening a virtual application and establishing communication to a cloud desktop server when receiving an instruction of a user for opening the virtual application;
the second processing module is used for rendering each window screenshot when receiving the window screenshot of each application process sent by the cloud desktop server through a plurality of independent channels;
and the display module is used for displaying the rendered screenshot of each window.
In another aspect, an embodiment of the present invention provides a cloud desktop server, including:
the third processing module is used for opening an application process corresponding to the virtual application or distributing a pre-opened application process corresponding to the virtual application client when a request for establishing communication with the opened virtual application, which is sent by the virtual application client, is received;
the fourth processing module is used for detecting the windows of all application processes running in the cloud desktop and respectively capturing the windows of all the application processes to obtain a plurality of window screenshots;
and the sending module is used for establishing an independent channel with the virtual application client for each application process and sending each window screenshot to the virtual application client through the independent channel.
In another aspect, an embodiment of the present invention provides an electronic device, including at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions for execution by the at least one processor; the instructions are executed by the at least one processor, so that the at least one processor can execute the cloud desktop-based multi-window virtual application method provided by the embodiment of the invention.
On the other hand, an embodiment of the present invention provides a computer storage medium, where a computer program is stored, and the computer program is configured to execute the cloud desktop-based multi-window virtual application method provided in the embodiment of the present invention.
The invention has the following beneficial effects:
according to the cloud desktop-based multi-window virtual application method and device provided by the embodiment of the invention, all windows of an application process are subjected to independent screenshot in the cloud desktop, a transmission channel with a client side is independently established for each window to carry out picture transmission, the virtual application client side supports multi-window rendering, and the picture of each channel is rendered, so that the effect of multi-window virtual application based on the cloud desktop can be achieved, all windows of the multi-window virtual application can be specifically supported to be displayed simultaneously, a user can use the virtual application more like a local application, and the multi-window linkage experience is smooth.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a schematic flowchart of a cloud desktop-based multi-window virtual application method on a virtual application client side according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a cloud desktop-based multi-window virtual application method on a cloud desktop server side according to an embodiment of the present invention;
FIG. 3 is a schematic connection diagram of a multi-window virtual application according to an embodiment of the present invention;
FIG. 4 is an interaction diagram of a cloud desktop-based multi-window virtual application method according to an embodiment of the present invention;
fig. 5a is a schematic structural diagram of a virtual client according to an embodiment of the present invention;
fig. 5b is a schematic structural diagram of a cloud desktop server according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are some, but not all embodiments of the present disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
The term "and/or" in the embodiments of the present disclosure describes an association relationship of associated objects, and means that there may be three relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
The application scenario described in the embodiment of the present disclosure is for more clearly illustrating the technical solution of the embodiment of the present disclosure, and does not form a limitation on the technical solution provided in the embodiment of the present disclosure, and as a person having ordinary skill in the art knows, with the occurrence of a new application scenario, the technical solution provided in the embodiment of the present disclosure is also applicable to similar technical problems. In the description of the present disclosure, the meaning of "a plurality" is two or more, unless otherwise specified.
In the prior art, the implementation of virtual applications mainly aims at the current interface of a virtualized application, and a user can only see one application interface. When the application has multiple interfaces, the multiple interfaces cannot be displayed simultaneously, and the user cannot switch the interfaces, so that the user still cannot operate the application interfaces of the multiple virtual applications completely like a local application.
Based on this, according to the cloud desktop-based multi-window virtual application method provided by the embodiment of the invention, on the premise that the user logs in the account, when the user opens the cloud desktop-based virtual application, the corresponding application process is opened back in the cloud computer of the server, and then it is detected that the application processes have several windows in total, and a separate window screenshot is performed on each window. And data of each window screenshot are transmitted through an independent channel established between the cloud desktop server and the client. After receiving the data of each independent channel, the virtual application client opens a corresponding number of windows on the virtual application client to perform picture rendering. And finally, the same number of windows as the number of the windows applied in the cloud desktop are realized, so that a user can independently drag, enlarge and reduce each window like a local application.
According to the cloud desktop-based multi-window virtual application method provided by the embodiment of the invention, all windows of an application process are subjected to independent screenshot in the cloud desktop, a transmission channel with a client side is independently established for each window to carry out picture transmission, the virtual application client side supports multi-window rendering, and the picture of each channel is rendered, so that the effect of cloud desktop-based multi-window virtual application can be realized, all windows of the multi-window virtual application can be specifically supported to be displayed simultaneously, a user can use the virtual application more like a local application, and the multi-window linkage experience is smooth.
The embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Specifically, at a virtual application client, the cloud desktop-based multi-window virtual application method provided in the embodiment of the present invention, as shown in fig. 1, may specifically include the following steps:
s101, when receiving an instruction of opening the virtual application instructed by a user, opening the virtual application, and establishing communication with a cloud desktop server;
s102, when window screenshots of all application processes sent by a cloud desktop server through a plurality of independent channels are received, rendering the window screenshots respectively;
and S103, displaying the rendered screenshot of each window.
Optionally, in an embodiment, as shown in fig. 1, at the virtual application client, the following steps may also be included:
and S104, when an instruction of the user for adjusting the size of the screenshot of the window is received, correspondingly adjusting the size of the displayed screenshot of the window, and sending a corresponding size adjusting instruction to the cloud desktop server.
Optionally, in an embodiment, as shown in fig. 1, at the virtual application client, the following steps may also be included:
s105, when receiving an instruction of closing the virtual application instructed by the user, closing the virtual application, and sending an exit closing instruction to the cloud desktop server.
On the cloud desktop server side, the cloud desktop-based multi-window virtual application method provided by the embodiment of the present invention, as shown in fig. 2, may specifically include the following steps:
s201, when a request for establishing communication with an opened virtual application sent by a virtual application client is received, opening an application process corresponding to the virtual application, or distributing a pre-opened application process corresponding to the virtual application client;
s202, detecting windows of all application processes running in the cloud desktop, and respectively capturing the windows of all the application processes to obtain a plurality of window screenshots;
s203, establishing an independent channel with the virtual application client for each application process, and sending each window screenshot to the virtual application client through the independent channel.
Optionally, in an embodiment, as shown in fig. 2, at the virtual application client, the following steps may also be included:
and S204, when a size adjusting instruction sent by the virtual application client executing the size of the screenshot of the window is received, adjusting the window size of the application process.
Optionally, in an embodiment, as shown in fig. 2, at the virtual application client, the following steps may also be included:
s205, when a quit closing instruction sent by the virtual application client executing and closing the virtual application is received, quitting the application process corresponding to the virtual application and closing the window of the application process.
Fig. 3 shows a schematic connection diagram of a multi-window virtual application established in the method provided by the embodiment of the present invention. As shown in fig. 4, an interaction flow diagram of a virtual application client and a cloud desktop server specifically includes the following steps:
1) and the virtual application client side opens the virtual application and establishes communication to the cloud desktop.
2) And opening the application program in the cloud desktop, or directly distributing the pre-opened application to the user.
3) And detecting windows of the application process in the cloud desktop, and respectively capturing the image of each window.
4) And each window and the client establish an independent channel and send the screenshot to the client.
5) And (4) rendering the window screenshots sent in the step (4) by the client respectively.
6) When the client side drags the window, the application position in the cloud desktop is not changed; and changing the size of the window, transmitting the window back to the cloud desktop, and adjusting the application window.
7) The mouse and keyboard operation of the user in the application window is used as the local application.
8) And the client closes the application, and synchronously closes and quits the application in the cloud desktop.
Based on the same inventive concept, the embodiment of the invention also provides a virtual application client and a cloud desktop server, and as the principle of solving the problems of the virtual application client and the cloud desktop server is similar to the cloud desktop-based multi-window virtual application method, the implementation of the virtual application client and the cloud desktop server can refer to the implementation of the method, and repeated parts are not repeated.
Specifically, as shown in fig. 5a, the virtual application client provided in the embodiment of the present invention includes:
the first processing module 501 is configured to open a virtual application and establish communication with a cloud desktop server when receiving an instruction that a user instructs to open the virtual application;
the second processing module 502 is configured to render each window screenshot when receiving the window screenshot of each application process sent by the cloud desktop server through the multiple independent channels;
and a display module 503, configured to display the rendered screenshot of each window.
Specifically, as shown in fig. 5b, the cloud desktop server provided in the embodiment of the present invention includes:
a third processing module 504, configured to, when receiving a request for establishing communication with an opened virtual application sent by a virtual application client, open an application process corresponding to the virtual application, or allocate an application process corresponding to the virtual application, which is opened in advance, to the virtual application client;
a fourth processing module 505, configured to detect a window of each application process running in the cloud desktop, and perform screenshot on the window of each application process respectively to obtain multiple window screenshots;
a sending module 506, configured to establish an independent channel with the virtual application client for each application process, and send each window screenshot to the virtual application client through the independent channel.
After the cloud desktop based multi-window virtual application method and apparatus provided by the embodiment of the present invention are introduced, an electronic device according to another exemplary embodiment of the present invention is introduced next.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
In some possible embodiments, an electronic device of the invention may include at least one processor, and at least one computer storage medium. The computer storage medium stores program code, which when executed by a processor, causes the processor to perform the steps of the cloud desktop based multi-window virtual application method according to various exemplary embodiments of the present invention described above in this specification.
An electronic device 600 according to this embodiment of the invention is described below with reference to fig. 6. The electronic device 600 shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 6, the electronic device 600 is represented in the form of a general electronic device. The components of the electronic device 600 may include, but are not limited to: the at least one processor 601, the at least one computer storage medium 602, and the bus 603 that connects the various system components (including the computer storage medium 602 and the processor 601).
The computer storage media 602 may include readable media in the form of volatile computer storage media, such as random access computer storage media (RAM)621 and/or cache storage media 622, and may further include read-only computer storage media (ROM) 623.
The computer storage medium 602 may also include a program/utility 625 having a set (at least one) of program modules 624, such program modules 624 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 600 may also communicate with one or more external devices 604 (e.g., keyboard, pointing device, etc.), with one or more devices that enable a user to interact with the electronic device 600, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 600 to communicate with one or more other electronic devices. Such communication may occur via input/output (I/O) interfaces 605. Also, the electronic device 600 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 606. As shown, the network adapter 606 communicates with the other modules for the electronic device 600 over the bus 603. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
In some possible embodiments, the aspects of the cloud desktop based multi-window virtual application method provided by the present invention can also be implemented in the form of a program product, which includes program code for causing a computer device to perform the steps of the cloud desktop based multi-window virtual application method according to various exemplary embodiments of the present invention described above in this specification when the program product is run on the computer device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable diskette, a hard disk, a random access computer storage media (RAM), a read-only computer storage media (ROM), an erasable programmable read-only computer storage media (EPROM or flash memory), an optical fiber, a portable compact disc read-only computer storage media (CD-ROM), an optical computer storage media piece, a magnetic computer storage media piece, or any suitable combination of the foregoing.
The program product of the cloud desktop based multi-window virtual application method of the embodiments of the present invention may employ a portable compact disk read-only computer storage medium (CD-ROM) and include program code, and may be run on an electronic device. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the consumer electronic device, partly on the consumer electronic device, as a stand-alone software package, partly on the consumer electronic device and partly on a remote electronic device, or entirely on the remote electronic device or server. In the case of remote electronic devices, the remote electronic devices may be connected to the consumer electronic device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external electronic device (for example, through the internet using an internet service provider).
It should be noted that although several modules of the apparatus are mentioned in the above detailed description, such division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the modules described above may be embodied in one module according to embodiments of the invention. Conversely, the features and functions of one module described above may be further divided into embodiments by a plurality of modules.
Moreover, while the operations of the method of the invention are depicted in the drawings in a particular order, this does not require or imply that the operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk computer storage media, CD-ROMs, optical computer storage media, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable computer storage medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable computer storage medium produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A multi-window virtual application method based on a cloud desktop is applied to a virtual application client and comprises the following steps:
when an instruction of opening a virtual application is received, the virtual application is opened, and communication to a cloud desktop server is established;
when window screenshots of all application processes sent by the cloud desktop server through a plurality of independent channels are received, rendering each window screenshot respectively;
and displaying each rendered screenshot of the window.
2. The method of claim 1, further comprising:
and when an instruction of adjusting the size of the window screenshot is received, correspondingly adjusting the size of the displayed window screenshot, and sending a corresponding size adjusting instruction to the cloud desktop server.
3. The method of claim 1 or 2, further comprising:
and when an instruction of closing the virtual application is received, closing the virtual application, and sending a quit closing instruction to the cloud desktop server.
4. A multi-window virtual application method based on a cloud desktop is applied to a cloud desktop server and comprises the following steps:
when a request for establishing communication with an opened virtual application sent by a virtual application client is received, opening an application process corresponding to the virtual application, or distributing a pre-opened application process corresponding to the virtual application client;
detecting windows of all application processes running in a cloud desktop, and respectively capturing the windows of all the application processes to obtain a plurality of window screenshots;
and establishing an independent channel with the virtual application client for each application process, and sending each window screenshot to the virtual application client through the independent channel.
5. The method of claim 4, further comprising:
and when a size adjusting instruction sent by the virtual application client executing the size of the screenshot of the window is received, adjusting the window size of the application process.
6. The method of claim 4 or 5, further comprising:
and when receiving a quit closing instruction sent by the virtual application client for closing the virtual application, quitting the application process corresponding to the virtual application and closing the window of the application process.
7. A virtual application client, comprising:
the system comprises a first processing module, a second processing module and a third processing module, wherein the first processing module is used for opening a virtual application and establishing communication to a cloud desktop server when receiving an instruction of a user for opening the virtual application;
the second processing module is used for rendering each window screenshot when receiving the window screenshot of each application process sent by the cloud desktop server through a plurality of independent channels;
and the display module is used for displaying the rendered screenshot of each window.
8. A cloud desktop server, comprising:
the third processing module is used for opening an application process corresponding to the virtual application or distributing a pre-opened application process corresponding to the virtual application client when a request for establishing communication with the opened virtual application, which is sent by the virtual application client, is received;
the fourth processing module is used for detecting the windows of all application processes running in the cloud desktop and respectively capturing the windows of all the application processes to obtain a plurality of window screenshots;
and the sending module is used for establishing an independent channel with the virtual application client for each application process and sending each window screenshot to the virtual application client through the independent channel.
9. An electronic device comprising at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions for execution by the at least one processor; the instructions are executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.
10. A computer storage medium, characterized in that the computer storage medium stores a computer program for performing the method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619673.1A CN114443192B (en) | 2021-12-27 | Multi-window virtual application method and device based on cloud desktop |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619673.1A CN114443192B (en) | 2021-12-27 | Multi-window virtual application method and device based on cloud desktop |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114443192A true CN114443192A (en) | 2022-05-06 |
| CN114443192B CN114443192B (en) | 2024-04-26 |
Family
ID=
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117234657A (en) * | 2023-11-16 | 2023-12-15 | 北京麟卓信息科技有限公司 | Multi-window rendering optimization method based on virtual sub-layer |
Citations (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090106662A1 (en) * | 2007-10-19 | 2009-04-23 | Ning Ye | Methods and Systems for Incorporating at Least One Window From a First Desktop Environment Having a First Themed Graphical Display into a Second Desktop Environment Having a Second Themed Graphical Display |
| US20120324365A1 (en) * | 2011-03-03 | 2012-12-20 | Citrix Systems, Inc. | Reverse Seamless Integration Between Local and Remote Computing Environments |
| US20130346858A1 (en) * | 2012-06-25 | 2013-12-26 | Neyrinck Llc | Remote Control of Audio Application and Associated Sub-Windows |
| CN103518189A (en) * | 2011-05-06 | 2014-01-15 | 思科技术公司 | Integrated rendering of streaming media in virtualized desktop environment |
| CN104941181A (en) * | 2015-06-18 | 2015-09-30 | 深圳市新众玩网络科技有限公司 | Method and device for achieving real-time game interaction between different intelligent terminals |
| US20160274736A1 (en) * | 2015-03-16 | 2016-09-22 | Microsoft Technology Licensing, Llc | Synchronized multi-window interaction with hierarchical data on thin-client |
| US20170024100A1 (en) * | 2015-07-24 | 2017-01-26 | Coscreen, Inc. | Frictionless Interface for Virtual Collaboration, Communication and Cloud Computing |
| WO2017113551A1 (en) * | 2015-12-30 | 2017-07-06 | Beijing Chaozhuo Technology Co., Ltd. | System and method for operating system of mobile device |
| CN107508886A (en) * | 2017-08-24 | 2017-12-22 | 西安万像电子科技有限公司 | Application display method and device |
| US20180121217A1 (en) * | 2016-10-28 | 2018-05-03 | Calgary Scientific Inc. | Multi-window architecture and data communication for a remote access application session |
| CN108021425A (en) * | 2017-12-28 | 2018-05-11 | 南开大学 | A kind of virtual desktop system and operation method for integrating multiple Graphics Application windows |
| WO2018112855A1 (en) * | 2016-12-22 | 2018-06-28 | 深圳前海达闼云端智能科技有限公司 | Virtualisation method and device, electronic device, and computer program product |
| CN108322549A (en) * | 2018-03-13 | 2018-07-24 | 武汉兴和产业大数据研究院有限公司 | Cloud desktop computer system based on middleware and application method |
| CN110049365A (en) * | 2019-03-18 | 2019-07-23 | 深圳康佳电子科技有限公司 | Visual information source switching handling method, display terminal, television set and storage medium |
| US20190361718A1 (en) * | 2018-05-25 | 2019-11-28 | Vmware, Inc. | 3D API Redirection for Virtual Desktop Infrastructure |
| CN111124335A (en) * | 2019-12-10 | 2020-05-08 | 山东超越数控电子股份有限公司 | Remote-viewer-based cloud desktop multi-window display method and system |
| CN111295679A (en) * | 2018-04-20 | 2020-06-16 | 甲骨文国际公司 | Managing customer relationships using multiple chat servers designed to interface with a service application |
| CN111367456A (en) * | 2020-02-28 | 2020-07-03 | 青岛海信移动通信技术股份有限公司 | Communication terminal and display method in multi-window mode |
| WO2020197675A1 (en) * | 2019-03-27 | 2020-10-01 | Citrix Systems, Inc. | Providing user interface (ui) elements having scrollable content in virtual machine sessions at reduced latency and related methods |
| CN111818120A (en) * | 2020-05-20 | 2020-10-23 | 北京元心科技有限公司 | End cloud user interaction method and system, corresponding equipment and storage medium |
| CN112565869A (en) * | 2020-12-11 | 2021-03-26 | 武汉噢易云计算股份有限公司 | Window fusion method, device and equipment for video redirection |
| CN112650596A (en) * | 2019-10-11 | 2021-04-13 | 腾讯科技（深圳）有限公司 | Cross-process sharing method, device and equipment of target data and storage medium |
| CN113312125A (en) * | 2021-04-30 | 2021-08-27 | 北京仁光科技有限公司 | Multi-window adjusting method, system, readable storage medium and electronic equipment |
| CN113687750A (en) * | 2020-05-08 | 2021-11-23 | 腾讯科技（深圳）有限公司 | Screenshot processing method and device |
| CN113778583A (en) * | 2021-08-03 | 2021-12-10 | 福建升腾资讯有限公司 | Method, device, equipment and medium for publishing local application of cloud desktop |
Patent Citations (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090106662A1 (en) * | 2007-10-19 | 2009-04-23 | Ning Ye | Methods and Systems for Incorporating at Least One Window From a First Desktop Environment Having a First Themed Graphical Display into a Second Desktop Environment Having a Second Themed Graphical Display |
| US20120324365A1 (en) * | 2011-03-03 | 2012-12-20 | Citrix Systems, Inc. | Reverse Seamless Integration Between Local and Remote Computing Environments |
| CN103518189A (en) * | 2011-05-06 | 2014-01-15 | 思科技术公司 | Integrated rendering of streaming media in virtualized desktop environment |
| US20130346858A1 (en) * | 2012-06-25 | 2013-12-26 | Neyrinck Llc | Remote Control of Audio Application and Associated Sub-Windows |
| US20160274736A1 (en) * | 2015-03-16 | 2016-09-22 | Microsoft Technology Licensing, Llc | Synchronized multi-window interaction with hierarchical data on thin-client |
| CN104941181A (en) * | 2015-06-18 | 2015-09-30 | 深圳市新众玩网络科技有限公司 | Method and device for achieving real-time game interaction between different intelligent terminals |
| US20170024100A1 (en) * | 2015-07-24 | 2017-01-26 | Coscreen, Inc. | Frictionless Interface for Virtual Collaboration, Communication and Cloud Computing |
| WO2017113551A1 (en) * | 2015-12-30 | 2017-07-06 | Beijing Chaozhuo Technology Co., Ltd. | System and method for operating system of mobile device |
| US20180121217A1 (en) * | 2016-10-28 | 2018-05-03 | Calgary Scientific Inc. | Multi-window architecture and data communication for a remote access application session |
| WO2018112855A1 (en) * | 2016-12-22 | 2018-06-28 | 深圳前海达闼云端智能科技有限公司 | Virtualisation method and device, electronic device, and computer program product |
| CN107508886A (en) * | 2017-08-24 | 2017-12-22 | 西安万像电子科技有限公司 | Application display method and device |
| CN108021425A (en) * | 2017-12-28 | 2018-05-11 | 南开大学 | A kind of virtual desktop system and operation method for integrating multiple Graphics Application windows |
| CN108322549A (en) * | 2018-03-13 | 2018-07-24 | 武汉兴和产业大数据研究院有限公司 | Cloud desktop computer system based on middleware and application method |
| CN111295679A (en) * | 2018-04-20 | 2020-06-16 | 甲骨文国际公司 | Managing customer relationships using multiple chat servers designed to interface with a service application |
| US20190361718A1 (en) * | 2018-05-25 | 2019-11-28 | Vmware, Inc. | 3D API Redirection for Virtual Desktop Infrastructure |
| CN110049365A (en) * | 2019-03-18 | 2019-07-23 | 深圳康佳电子科技有限公司 | Visual information source switching handling method, display terminal, television set and storage medium |
| WO2020197675A1 (en) * | 2019-03-27 | 2020-10-01 | Citrix Systems, Inc. | Providing user interface (ui) elements having scrollable content in virtual machine sessions at reduced latency and related methods |
| CN112650596A (en) * | 2019-10-11 | 2021-04-13 | 腾讯科技（深圳）有限公司 | Cross-process sharing method, device and equipment of target data and storage medium |
| CN111124335A (en) * | 2019-12-10 | 2020-05-08 | 山东超越数控电子股份有限公司 | Remote-viewer-based cloud desktop multi-window display method and system |
| CN111367456A (en) * | 2020-02-28 | 2020-07-03 | 青岛海信移动通信技术股份有限公司 | Communication terminal and display method in multi-window mode |
| CN113687750A (en) * | 2020-05-08 | 2021-11-23 | 腾讯科技（深圳）有限公司 | Screenshot processing method and device |
| CN111818120A (en) * | 2020-05-20 | 2020-10-23 | 北京元心科技有限公司 | End cloud user interaction method and system, corresponding equipment and storage medium |
| CN112565869A (en) * | 2020-12-11 | 2021-03-26 | 武汉噢易云计算股份有限公司 | Window fusion method, device and equipment for video redirection |
| CN113312125A (en) * | 2021-04-30 | 2021-08-27 | 北京仁光科技有限公司 | Multi-window adjusting method, system, readable storage medium and electronic equipment |
| CN113778583A (en) * | 2021-08-03 | 2021-12-10 | 福建升腾资讯有限公司 | Method, device, equipment and medium for publishing local application of cloud desktop |
Non-Patent Citations (4)
| Title |
|---|
| SINGH G 等: "《MultiDroid: An energy optimization technique for multi-window operations on OLED smartphones》", 《IEEE ACCESS》, vol. 6, 8 June 2018 (2018-06-08), pages 31983 - 31995 * |
| 张欢: "《基于Web浏览器的远程桌面控制协议的研究与实现》", 《中国优秀硕士学位论文全文数据库信息科技辑》, no. 2, 15 February 2018 (2018-02-15), pages 139 - 316 * |
| 王萍圆: "《虚拟桌面中轻量级图形传输机制的研究》", 《 中国优秀硕士学位论文全文数据库信息科技辑》, no. 7, 15 July 2013 (2013-07-15), pages 138 - 683 * |
| 董青: "《基于虚拟化的桌面融合技术》", 《中国优秀硕士学位论文全文数据库信息科技辑》, no. 12, 15 December 2011 (2011-12-15), pages 138 - 878 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117234657A (en) * | 2023-11-16 | 2023-12-15 | 北京麟卓信息科技有限公司 | Multi-window rendering optimization method based on virtual sub-layer |
| CN117234657B (en) * | 2023-11-16 | 2024-01-19 | 北京麟卓信息科技有限公司 | Multi-window rendering optimization method based on virtual sub-layer |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8150971B2 (en) | Mechanism for migration of client-side virtual machine system resources | |
| US8607158B2 (en) | Content presentation in remote monitoring sessions for information technology systems | |
| US8924502B2 (en) | System, method and computer program product for updating a user session in a mach-derived system environment | |
| WO2016202102A1 (en) | Message transmission method and device | |
| US20180013651A1 (en) | Suspending and resuming virtual machines in a network | |
| WO2023093016A1 (en) | Cloud code development system, method, and apparatus, device, and storage medium | |
| CN113691602A (en) | Service processing method, system, device, equipment and medium based on cloud mobile phone | |
| CN110275787B (en) | Online platform data transmission method, device, medium and electronic equipment | |
| WO2024061308A1 (en) | Notification processing method, and terminal device, server side and computer storage medium | |
| CN114217900A (en) | Remote control method, device and system, computing equipment and storage medium | |
| CN113778593A (en) | Cloud desktop control method and device, electronic equipment, storage medium and program product | |
| US10015232B2 (en) | Systems and methods for transmitting images | |
| CN113535292A (en) | Interface information control method and device, electronic equipment and storage medium | |
| CN114443192A (en) | Multi-window virtual application method and device based on cloud desktop | |
| CN114443192B (en) | Multi-window virtual application method and device based on cloud desktop | |
| CN114244700A (en) | Port processing method and device, electronic equipment and computer readable storage medium | |
| CN111008041B (en) | Command processing method and device for host, electronic equipment and storage medium | |
| CN114640893A (en) | Method and device for connecting service end of real-time audio and video communication system | |
| US9996373B1 (en) | Avoiding overloading of network adapters in virtual environments | |
| CN107870803A (en) | The data redirection optimization method of intelligence desktop virtualization, device and system | |
| CN111767489A (en) | Method, device and equipment for accelerating running of webpage and storage medium | |
| CN111443983B (en) | Application program virtualization method and device, electronic equipment and storage medium | |
| CN115278376B (en) | Audio and video data transmission method and device | |
| WO2019015089A1 (en) | Control method, device and apparatus for global menu, and storage medium | |
| CN112671970B (en) | Control method and control device for mobile equipment and cloud mobile phone, electronic equipment, mobile equipment, cloud server and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |