CN114443192B - Multi-window virtual application method and device based on cloud desktop - Google Patents
Multi-window virtual application method and device based on cloud desktop Download PDFInfo
- Publication number
- CN114443192B CN114443192B CN202111619673.1A CN202111619673A CN114443192B CN 114443192 B CN114443192 B CN 114443192B CN 202111619673 A CN202111619673 A CN 202111619673A CN 114443192 B CN114443192 B CN 114443192B
- Authority
- CN
- China
- Prior art keywords
- window
- virtual application
- cloud desktop
- application
- screenshot
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 86
- 230000008569 process Effects 0.000 claims abstract description 49
- 238000009877 rendering Methods 0.000 claims abstract description 9
- 238000012545 processing Methods 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims 1
- 230000005540 biological transmission Effects 0.000 abstract description 6
- 230000000694 effects Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 14
- 238000004891 communication Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000011900 installation process Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a multi-window virtual application method and device based on a cloud desktop, which are characterized in that through independently capturing images of all windows of an application process in the cloud desktop, a transmission channel with a client is independently established for each window to carry out picture transmission, the virtual application client supports multi-window rendering, and the picture of each channel is rendered, so that the effect of realizing the multi-window virtual application based on the cloud desktop is achieved, and particularly, all windows of the multi-window virtual application can be supported to be displayed simultaneously, so that a user can use the virtual application to be more similar to a local application, and the multi-window linkage experience is smooth.
Description
Technical Field
The invention relates to the technical field of IT and software development, in particular to a cloud desktop-based multi-window virtual application method and device.
Background
Virtual applications are applications that do not require installation, are ready to use, and have a user experience similar to that of the local application, as opposed to traditional applications that require the application to be installed locally before they can be run. The virtual application does not need to solve the problem of system compatibility in the traditional application installation process, and has the advantages of low configuration requirement on the local terminal and the like.
A multi-window application, also referred to as a multi-window application, includes a primary window and a plurality of secondary windows. For example: the QQ has a main window and a plurality of chat windows.
Generally, the implementation of a virtual application is mainly aimed at the current interface of the virtual application, and a user can only see one application interface. When the application has a plurality of interfaces, the interfaces cannot be displayed at the same time, and the user cannot switch the interfaces, so that the user still cannot operate the application interfaces of the plurality of virtual applications completely like the local application.
Disclosure of Invention
The embodiment of the invention provides a multi-window virtual application method and device based on a cloud desktop, which are used for solving the problem that a user cannot use the multi-window virtual application in the prior art.
The embodiment of the invention provides a multi-window virtual application method based on a cloud desktop, which is applied to a virtual application client and comprises the following steps:
When receiving an instruction of a user for opening a virtual application, opening the virtual application, and establishing communication to a cloud desktop server;
When window screenshots of all application processes sent by the cloud desktop server through a plurality of independent channels are received, rendering each window screenshot respectively;
And displaying the rendered window screenshots.
In one embodiment, further comprising:
when receiving an instruction of a user for indicating to adjust the size of the window screenshot, correspondingly adjusting the size of the displayed window screenshot, and sending a corresponding size adjusting instruction to the cloud desktop server.
In one embodiment, further comprising:
And closing the virtual application when receiving an instruction of closing the virtual application instructed by a user, and sending an instruction of exiting the closing to the cloud desktop server.
On the other hand, the embodiment of the invention provides a multi-window virtual application method based on a cloud desktop, which is applied to a cloud desktop server and comprises the following steps:
When receiving a request for establishing communication with an opened virtual application sent by a virtual application client, opening an application process corresponding to the virtual application, or distributing the pre-opened application process corresponding to the virtual application client;
detecting windows of all application processes running in a cloud desktop, and respectively capturing the windows of each application process to obtain a plurality of window captures;
And establishing an independent channel with the virtual application client for each application process, and sending the window screenshot to the virtual application client through the independent channel.
In one embodiment, further comprising:
And when a size adjustment instruction sent by the virtual application client for executing the window screenshot size adjustment is received, adjusting the window size of the application process.
In one embodiment, further comprising:
And when receiving an exit closing instruction sent by the virtual application client to close the virtual application, exiting an application process corresponding to the virtual application, and closing a window of the application process.
In another aspect, an embodiment of the present invention provides a virtual application client, including:
the cloud desktop server comprises a first processing module, a second processing module and a cloud desktop server, wherein the first processing module is used for opening a virtual application when receiving an instruction of opening the virtual application from a user;
The second processing module is used for respectively rendering the window screenshots of all the application processes when receiving the window screenshots of all the application processes sent by the cloud desktop server through a plurality of independent channels;
and the display module is used for displaying the rendered window screenshots.
In another aspect, an embodiment of the present invention provides a cloud desktop server, including:
The third processing module is used for opening an application process corresponding to the virtual application or distributing the pre-opened application process corresponding to the virtual application client when receiving a request for establishing communication with the opened virtual application, which is sent by the virtual application client;
the fourth processing module is used for detecting windows of all application processes running in the cloud desktop, and capturing the windows of each application process respectively to obtain a plurality of window captures;
And the sending module is used for establishing an independent channel with the virtual application client for each application process, and sending each window screenshot to the virtual application client through the independent channel.
In another aspect, an embodiment of the present invention provides an electronic device, including at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions for execution by the at least one processor; the instructions are executed by the at least one processor, so that the at least one processor can execute the multi-window virtual application method based on the cloud desktop provided by the embodiment of the invention.
On the other hand, the embodiment of the invention provides a computer storage medium, and the computer storage medium stores a computer program, and the computer program is used for executing the multi-window virtual application method based on the cloud desktop.
The invention has the following beneficial effects:
According to the cloud desktop-based multi-window virtual application method and device, through the fact that all windows of an application process in the cloud desktop are independently captured, a transmission channel with a client is independently established for each window to carry out picture transmission, the virtual application client supports multi-window rendering, and a picture of each channel is rendered, the effect of the cloud desktop-based multi-window virtual application can be achieved, and particularly all windows of the multi-window virtual application can be supported to be displayed simultaneously, so that a user can use the virtual application to be more similar to a local application, and multi-window linkage experience is smooth.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are needed in the description of the embodiments will be briefly described below, it will be apparent that the drawings in the following description are only some embodiments of the present disclosure, and that other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.
Fig. 1 is a schematic flow diagram of a cloud desktop-based multi-window virtual application method provided by an embodiment of the present invention;
Fig. 2 is a schematic flow diagram of a cloud desktop-based multi-window virtual application method provided by an embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating connection of a multi-window virtual application according to an embodiment of the present invention;
fig. 4 is an interaction schematic diagram of a cloud desktop-based multi-window virtual application method according to an embodiment of the present invention;
Fig. 5a is a schematic structural diagram of a virtual client according to an embodiment of the present invention;
Fig. 5b is a schematic structural diagram of a cloud desktop server according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are some embodiments of the present disclosure, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure.
The term "and/or" in the embodiments of the present disclosure describes an association relationship of association objects, which indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.
The application scenario described in the embodiments of the present disclosure is for more clearly describing the technical solution of the embodiments of the present disclosure, and does not constitute a limitation on the technical solution provided by the embodiments of the present disclosure, and as a person of ordinary skill in the art can know that, with the appearance of a new application scenario, the technical solution provided by the embodiments of the present disclosure is equally applicable to similar technical problems. In the description of the present disclosure, unless otherwise indicated, the meaning of "a plurality" is two or more.
In the prior art, the implementation of the virtual application is mainly aimed at the current interface of the virtual application, and a user can only see one application interface. When the application has a plurality of interfaces, the interfaces cannot be displayed at the same time, and the user cannot switch the interfaces, so that the user still cannot operate the application interfaces of the plurality of virtual applications completely like the local application.
Based on the above, in the cloud desktop-based multi-window virtual application method provided by the embodiment of the invention, when a user opens a cloud desktop-based virtual application on the premise that the user has logged in an account, a corresponding application process is opened back in a cloud computer of a server, then the application process is detected to share a plurality of windows, and individual window screenshot is performed on each window. And the data of each window screenshot are respectively transmitted by establishing an independent channel between the cloud desktop server and the client. After receiving the data of each independent channel, the virtual application client opens a corresponding number of windows on the virtual application client to perform picture rendering. Finally, the same number of windows as the windows in the cloud desktop are applied, so that a user can drag, enlarge and reduce each window independently like a local application.
According to the cloud desktop-based multi-window virtual application method, through the fact that all windows of an application process in a cloud desktop are independently captured, a transmission channel with a client is independently established for each window to carry out picture transmission, the virtual application client supports multi-window rendering, and a picture of each channel is rendered, so that the effect of the cloud desktop-based multi-window virtual application can be achieved, and particularly all windows of the multi-window virtual application can be supported to be displayed simultaneously, so that a user can use the virtual application to be more like a local application, and multi-window linkage experience is smooth.
The following describes the scheme of the invention in detail with reference to the accompanying drawings.
Specifically, at the virtual application client, the cloud desktop-based multi-window virtual application method provided by the embodiment of the invention, as shown in fig. 1, may specifically include the following steps:
S101, when an instruction of a user for opening a virtual application is received, opening the virtual application, and establishing communication to a cloud desktop server;
s102, when window screenshots of all application processes sent by a cloud desktop server through a plurality of independent channels are received, rendering all the window screenshots respectively;
S103, displaying the rendered window screenshots.
Optionally, in one embodiment, as shown in fig. 1, at the virtual application client, the following steps may be further included:
and S104, when receiving an instruction of a user for indicating to adjust the size of the window screenshot, correspondingly adjusting the size of the displayed window screenshot, and sending a corresponding instruction for adjusting the size to the cloud desktop server.
Optionally, in one embodiment, as shown in fig. 1, at the virtual application client, the following steps may be further included:
and S105, closing the virtual application when receiving an instruction of closing the virtual application instructed by the user, and sending an instruction of exiting the closing to the cloud desktop server.
On the cloud desktop server side, the multi-window virtual application method based on the cloud desktop provided by the embodiment of the invention, as shown in fig. 2, specifically may include the following steps:
S201, when receiving a request for establishing communication with an opened virtual application sent by a virtual application client, opening an application process corresponding to the virtual application, or distributing the pre-opened application process corresponding to the virtual application client;
S202, detecting windows of all application processes running in a cloud desktop, and respectively capturing the windows of each application process to obtain a plurality of window captures;
s203, establishing an independent channel with the virtual application client for each application process, and sending the window screenshots to the virtual application client through the independent channel.
Optionally, in one embodiment, as shown in fig. 2, at the virtual application client, the following steps may be further included:
S204, when a size adjustment instruction sent by the virtual application client for executing the window screenshot size adjustment is received, the window size of the application process is adjusted.
Optionally, in one embodiment, as shown in fig. 2, at the virtual application client, the following steps may be further included:
s205, when receiving an exit closing instruction sent by the virtual application client to close the virtual application, exiting an application process corresponding to the virtual application, and closing a window of the application process.
The connection schematic diagram of the multi-window virtual application established in the method provided by the embodiment of the invention is shown in fig. 3. As shown in fig. 4, the interaction process specifically includes the following steps:
1) And opening the virtual application at the virtual application client side, and establishing communication to the cloud desktop.
2) And opening an application program in the cloud desktop, or directly distributing the pre-opened application to the user.
3) Windows of an application process are detected in the cloud desktop, and screenshot is carried out on each window respectively.
4) And each window establishes an independent channel with the client, and the screenshot is sent to the client.
5) And (3) the client side respectively renders the window screenshots sent in the step (4).
6) When the client drags the window, the application position in the cloud desktop is not changed; and transmitting the window size change back into the cloud desktop, and adjusting the application window.
7) The user operates the mouse and the keyboard in the application window and uses the same as the local application.
8) And closing the application by the client, and synchronously closing and exiting the application in the cloud desktop.
Based on the same inventive concept, the embodiments of the present invention further provide a virtual application client and a cloud desktop server, and because the principle of solving the problem by the virtual application client and the cloud desktop server is similar to the foregoing multi-window virtual application method based on the cloud desktop, implementation of the virtual application client and the cloud desktop server can be referred to implementation of the method, and redundant description is omitted.
Specifically, as shown in fig. 5a, a virtual application client provided in an embodiment of the present invention includes:
A first processing module 501, configured to open a virtual application and establish communication to a cloud desktop server when receiving an instruction that a user instructs to open the virtual application;
The second processing module 502 is configured to render each screenshot of an application process when receiving the screenshots of each application process sent by the cloud desktop server through a plurality of independent channels;
And the display module 503 is used for displaying the rendered window screenshots.
Specifically, as shown in fig. 5b, the cloud desktop server provided by the embodiment of the present invention includes:
A third processing module 504, configured to, when receiving a request for establishing communication with an opened virtual application sent by a virtual application client, open an application process corresponding to the virtual application, or allocate a pre-opened application process corresponding to the virtual application client;
the fourth processing module 505 is configured to detect windows of each application process running in the cloud desktop, and respectively perform screenshot on the window of each application process to obtain a plurality of window screenshots;
And the sending module 506 is configured to establish an independent channel with the virtual application client for each application process, and send the screenshots of the windows to the virtual application client through the independent channel.
After introducing the cloud desktop-based multi-window virtual application method and device provided by the embodiment of the invention, an electronic device according to another exemplary embodiment of the invention is described next.
Those skilled in the art will appreciate that the various aspects of the invention may be implemented as a system, method, or program product. Accordingly, aspects of the invention may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects may be referred to herein as a "circuit," module "or" system.
In some possible embodiments, the electronic device of the invention may comprise at least one processor, and at least one computer storage medium. The computer storage medium stores therein program code that, when executed by a processor, causes the processor to perform the steps in the cloud desktop-based multi-window virtual application method according to various exemplary embodiments of the invention described above in this specification.
An electronic device 600 according to this embodiment of the invention is described below with reference to fig. 6. The electronic device 600 shown in fig. 6 is merely an example, and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in fig. 6, the electronic device 600 is embodied in the form of a general-purpose electronic device. Components of electronic device 600 may include, but are not limited to: the at least one processor 601, the at least one computer storage medium 602, and a bus 603 that connects the various system components, including the computer storage medium 602 and the processor 601.
Bus 603 represents one or more of several types of bus structures, including a computer storage media bus or computer storage media controller, a peripheral bus, a processor, or a local bus using any of a variety of bus architectures.
The computer storage media 602 may include readable media in the form of volatile computer storage media, such as random access computer storage media (RAM) 621 and/or cache storage media 622, and may further include read only computer storage media (ROM) 623.
The computer storage media 602 can also include a program/utility 625 with a set (at least one) of program modules 624, such program modules 624 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.
The electronic device 600 may also communicate with one or more external devices 604 (e.g., keyboard, pointing device, etc.), with one or more devices that enable a user to interact with the electronic device 600, and/or with any device (e.g., router, modem, etc.) that enables the electronic device 600 to communicate with one or more other electronic devices. Such communication may occur through an input/output (I/O) interface 605. Also, the electronic device 600 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through a network adapter 606. As shown, the network adapter 606 communicates with other modules for the electronic device 600 over the bus 603. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 600, including, but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
In some possible embodiments, aspects of the cloud desktop-based multi-window virtual application method provided by the present invention may also be implemented in the form of a program product comprising program code for causing a computer device to perform the steps of the cloud desktop-based multi-window virtual application method according to the various exemplary embodiments of the present invention as described herein above when the program product is run on the computer device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, a random access computer storage medium (RAM), a read-only computer storage medium (ROM), an erasable programmable read-only computer storage medium (EPROM or flash memory), an optical fiber, a portable compact disc read-only computer storage medium (CD-ROM), an optical computer storage medium, a magnetic computer storage medium, or any suitable combination of the foregoing.
The program product of the cloud desktop-based multi-window virtual application method of embodiments of the present invention may employ a portable compact disc read-only computer storage medium (CD-ROM) and include program code and may run on an electronic device. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the consumer electronic device, partly on the consumer electronic device, as a stand-alone software package, partly on the consumer electronic device, partly on the remote electronic device, or entirely on the remote electronic device or server. In the case of remote electronic devices, the remote electronic device may be connected to the consumer electronic device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external electronic device (e.g., connected through the internet using an internet service provider).
It should be noted that although several modules of the apparatus are mentioned in the detailed description above, this division is merely exemplary and not mandatory. Indeed, the features and functions of two or more modules described above may be embodied in one module in accordance with embodiments of the present invention. Conversely, the features and functions of one module described above may be further divided into a plurality of modules to be embodied.
Furthermore, although the operations of the methods of the present invention are depicted in the drawings in a particular order, this is not required or suggested that these operations must be performed in this particular order or that all of the illustrated operations must be performed in order to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk computer storage media, CD-ROM, optical computer storage media, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable computer storage medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable computer storage medium produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (10)
1. The multi-window virtual application method based on the cloud desktop is characterized by being applied to a virtual application client and comprising the following steps of:
when receiving an instruction of a user for opening a virtual application, sending an application starting request to a cloud desktop server;
After receiving corresponding window screenshots sent by the cloud desktop server through each independent channel respectively, rendering each window screenshot respectively; the cloud desktop server detects a plurality of windows corresponding to the virtual application, and captures the windows; the independent channels are respectively established for each window screenshot after the cloud desktop server obtains the window screenshot;
And respectively displaying the rendered window screenshots.
2. The method as recited in claim 1, further comprising:
when receiving an instruction of a user for indicating to adjust the size of the window screenshot, correspondingly adjusting the size of the displayed window screenshot, and sending a corresponding size adjusting instruction to the cloud desktop server.
3. The method of claim 1 or 2, further comprising:
And closing the virtual application when receiving an instruction of closing the virtual application instructed by a user, and sending an instruction of exiting the closing to the cloud desktop server.
4. The multi-window virtual application method based on the cloud desktop is characterized by being applied to a cloud desktop server and comprising the following steps of:
When an application starting request sent by a virtual application client is received, an application process corresponding to the virtual application is opened, or the application process corresponding to the virtual application which is opened in advance is distributed to the virtual application client;
Window detection is carried out in the cloud desktop, a plurality of windows corresponding to the application process are obtained, and screenshot is carried out on each window respectively, so that corresponding window screenshot is obtained;
For each window screenshot, establishing a corresponding independent channel with the virtual application client, and sending the corresponding window screenshot to the virtual application client through each independent channel, so that the virtual application client renders and displays each window screenshot.
5. The method as recited in claim 4, further comprising:
And when a size adjustment instruction sent by the virtual application client for executing the window screenshot size adjustment is received, adjusting the window size of the application process.
6. The method of claim 4 or 5, further comprising:
And when receiving an exit closing instruction sent by the virtual application client to close the virtual application, exiting an application process corresponding to the virtual application, and closing a window of the application process.
7. A virtual application client, comprising:
The first processing module is used for sending an application starting request to the cloud desktop server when receiving an instruction of a user for opening the virtual application;
The second processing module is used for rendering the window screenshots after receiving the corresponding window screenshots respectively sent by the cloud desktop server through the independent channels; the cloud desktop server detects a plurality of windows corresponding to the virtual application, and captures the windows; the independent channels are respectively established for each window screenshot after the cloud desktop server obtains the window screenshot;
and the display module is used for displaying the rendered window screenshots respectively.
8. A cloud desktop server, comprising:
The third processing module is used for opening an application process corresponding to the virtual application or distributing the pre-opened application process corresponding to the virtual application client when receiving an application starting request sent by the virtual application client;
the fourth processing module is used for detecting windows in the cloud desktop, obtaining a plurality of windows corresponding to the application process, and respectively capturing the windows to obtain corresponding window captures;
And the sending module is used for establishing a corresponding independent channel with the virtual application client for each window screenshot respectively, and sending the corresponding window screenshot to the virtual application client through each independent channel respectively so that the virtual application client renders and displays each window screenshot respectively.
9. An electronic device comprising at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions for execution by the at least one processor; the instructions being executable by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1-6.
10. A computer storage medium, characterized in that it stores a computer program for executing the method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619673.1A CN114443192B (en) | 2021-12-27 | 2021-12-27 | Multi-window virtual application method and device based on cloud desktop |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619673.1A CN114443192B (en) | 2021-12-27 | 2021-12-27 | Multi-window virtual application method and device based on cloud desktop |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114443192A CN114443192A (en) | 2022-05-06 |
| CN114443192B true CN114443192B (en) | 2024-04-26 |
Family
ID=81365830
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111619673.1A Active CN114443192B (en) | 2021-12-27 | 2021-12-27 | Multi-window virtual application method and device based on cloud desktop |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114443192B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117234657B (en) * | 2023-11-16 | 2024-01-19 | 北京麟卓信息科技有限公司 | Multi-window rendering optimization method based on virtual sub-layer |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103518189A (en) * | 2011-05-06 | 2014-01-15 | 思科技术公司 | Integrated rendering of streaming media in virtualized desktop environment |
| CN104941181A (en) * | 2015-06-18 | 2015-09-30 | 深圳市新众玩网络科技有限公司 | Method and device for achieving real-time game interaction between different intelligent terminals |
| WO2017113551A1 (en) * | 2015-12-30 | 2017-07-06 | Beijing Chaozhuo Technology Co., Ltd. | System and method for operating system of mobile device |
| CN107508886A (en) * | 2017-08-24 | 2017-12-22 | 西安万像电子科技有限公司 | Application display method and device |
| CN108021425A (en) * | 2017-12-28 | 2018-05-11 | 南开大学 | A kind of virtual desktop system and operation method for integrating multiple Graphics Application windows |
| WO2018112855A1 (en) * | 2016-12-22 | 2018-06-28 | 深圳前海达闼云端智能科技有限公司 | Virtualisation method and device, electronic device, and computer program product |
| CN108322549A (en) * | 2018-03-13 | 2018-07-24 | 武汉兴和产业大数据研究院有限公司 | Cloud desktop computer system based on middleware and application method |
| CN110049365A (en) * | 2019-03-18 | 2019-07-23 | 深圳康佳电子科技有限公司 | Visual information source switching handling method, display terminal, television set and storage medium |
| CN111124335A (en) * | 2019-12-10 | 2020-05-08 | 山东超越数控电子股份有限公司 | Remote-viewer-based cloud desktop multi-window display method and system |
| CN111295679A (en) * | 2018-04-20 | 2020-06-16 | 甲骨文国际公司 | Managing customer relationships using multiple chat servers designed to interface with a service application |
| CN111367456A (en) * | 2020-02-28 | 2020-07-03 | 青岛海信移动通信技术股份有限公司 | Communication terminal and display method in multi-window mode |
| WO2020197675A1 (en) * | 2019-03-27 | 2020-10-01 | Citrix Systems, Inc. | Providing user interface (ui) elements having scrollable content in virtual machine sessions at reduced latency and related methods |
| CN111818120A (en) * | 2020-05-20 | 2020-10-23 | 北京元心科技有限公司 | End cloud user interaction method and system, corresponding equipment and storage medium |
| CN112565869A (en) * | 2020-12-11 | 2021-03-26 | 武汉噢易云计算股份有限公司 | Window fusion method, device and equipment for video redirection |
| CN112650596A (en) * | 2019-10-11 | 2021-04-13 | 腾讯科技（深圳）有限公司 | Cross-process sharing method, device and equipment of target data and storage medium |
| CN113312125A (en) * | 2021-04-30 | 2021-08-27 | 北京仁光科技有限公司 | Multi-window adjusting method, system, readable storage medium and electronic equipment |
| CN113687750A (en) * | 2020-05-08 | 2021-11-23 | 腾讯科技（深圳）有限公司 | Screenshot processing method and device |
| CN113778583A (en) * | 2021-08-03 | 2021-12-10 | 福建升腾资讯有限公司 | Method, device, equipment and medium for publishing local application of cloud desktop |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8046695B2 (en) * | 2007-10-19 | 2011-10-25 | Citrix Systems, Inc. | Methods and systems for incorporating at least one window from a first desktop environment having a first themed graphical display into a second desktop environment having a second themed graphical display |
| US9210213B2 (en) * | 2011-03-03 | 2015-12-08 | Citrix Systems, Inc. | Reverse seamless integration between local and remote computing environments |
| US20130346858A1 (en) * | 2012-06-25 | 2013-12-26 | Neyrinck Llc | Remote Control of Audio Application and Associated Sub-Windows |
| US20160274736A1 (en) * | 2015-03-16 | 2016-09-22 | Microsoft Technology Licensing, Llc | Synchronized multi-window interaction with hierarchical data on thin-client |
| US10747418B2 (en) * | 2015-07-24 | 2020-08-18 | Coscreen, Inc. | Frictionless interface for virtual collaboration, communication and cloud computing |
| WO2018078457A1 (en) * | 2016-10-28 | 2018-05-03 | Calgary Scientific Inc. | Multi-window architecture and data communication for a remote access application session |
| US11150920B2 (en) * | 2018-05-25 | 2021-10-19 | Vmware, Inc. | 3D API redirection for virtual desktop infrastructure |
-
2021
- 2021-12-27 CN CN202111619673.1A patent/CN114443192B/en active Active
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103518189A (en) * | 2011-05-06 | 2014-01-15 | 思科技术公司 | Integrated rendering of streaming media in virtualized desktop environment |
| CN104941181A (en) * | 2015-06-18 | 2015-09-30 | 深圳市新众玩网络科技有限公司 | Method and device for achieving real-time game interaction between different intelligent terminals |
| WO2017113551A1 (en) * | 2015-12-30 | 2017-07-06 | Beijing Chaozhuo Technology Co., Ltd. | System and method for operating system of mobile device |
| WO2018112855A1 (en) * | 2016-12-22 | 2018-06-28 | 深圳前海达闼云端智能科技有限公司 | Virtualisation method and device, electronic device, and computer program product |
| CN107508886A (en) * | 2017-08-24 | 2017-12-22 | 西安万像电子科技有限公司 | Application display method and device |
| CN108021425A (en) * | 2017-12-28 | 2018-05-11 | 南开大学 | A kind of virtual desktop system and operation method for integrating multiple Graphics Application windows |
| CN108322549A (en) * | 2018-03-13 | 2018-07-24 | 武汉兴和产业大数据研究院有限公司 | Cloud desktop computer system based on middleware and application method |
| CN111295679A (en) * | 2018-04-20 | 2020-06-16 | 甲骨文国际公司 | Managing customer relationships using multiple chat servers designed to interface with a service application |
| CN110049365A (en) * | 2019-03-18 | 2019-07-23 | 深圳康佳电子科技有限公司 | Visual information source switching handling method, display terminal, television set and storage medium |
| WO2020197675A1 (en) * | 2019-03-27 | 2020-10-01 | Citrix Systems, Inc. | Providing user interface (ui) elements having scrollable content in virtual machine sessions at reduced latency and related methods |
| CN112650596A (en) * | 2019-10-11 | 2021-04-13 | 腾讯科技（深圳）有限公司 | Cross-process sharing method, device and equipment of target data and storage medium |
| CN111124335A (en) * | 2019-12-10 | 2020-05-08 | 山东超越数控电子股份有限公司 | Remote-viewer-based cloud desktop multi-window display method and system |
| CN111367456A (en) * | 2020-02-28 | 2020-07-03 | 青岛海信移动通信技术股份有限公司 | Communication terminal and display method in multi-window mode |
| CN113687750A (en) * | 2020-05-08 | 2021-11-23 | 腾讯科技（深圳）有限公司 | Screenshot processing method and device |
| CN111818120A (en) * | 2020-05-20 | 2020-10-23 | 北京元心科技有限公司 | End cloud user interaction method and system, corresponding equipment and storage medium |
| CN112565869A (en) * | 2020-12-11 | 2021-03-26 | 武汉噢易云计算股份有限公司 | Window fusion method, device and equipment for video redirection |
| CN113312125A (en) * | 2021-04-30 | 2021-08-27 | 北京仁光科技有限公司 | Multi-window adjusting method, system, readable storage medium and electronic equipment |
| CN113778583A (en) * | 2021-08-03 | 2021-12-10 | 福建升腾资讯有限公司 | Method, device, equipment and medium for publishing local application of cloud desktop |
Non-Patent Citations (4)
| Title |
|---|
| 《MultiDroid: An energy optimization technique for multi-window operations on OLED smartphones》;Singh G 等;《IEEE Access》;20180608;第6卷;31983-31995 * |
| 《基于Web浏览器的远程桌面控制协议的研究与实现》;张欢;《中国优秀硕士学位论文全文数据库信息科技辑》;20180215(第2期);I139-316 * |
| 《基于虚拟化的桌面融合技术》;董青;《中国优秀硕士学位论文全文数据库信息科技辑》;20111215(第12期);I138-878 * |
| 《虚拟桌面中轻量级图形传输机制的研究》;王萍圆;《 中国优秀硕士学位论文全文数据库信息科技辑》;20130715(第7期);I138-683 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114443192A (en) | 2022-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8924502B2 (en) | System, method and computer program product for updating a user session in a mach-derived system environment | |
| US11243737B2 (en) | Method and system for remote collaboration | |
| US9600152B2 (en) | Providing feedback for screen sharing | |
| CN107479957A (en) | A kind of switching method of Multiple system, device, equipment and storage medium | |
| CN106330986B (en) | Message transmission method and device | |
| CN104866272A (en) | Control treatment system and method of monitor screen wall | |
| CN109819268B (en) | Live broadcast room play control method, device, medium and equipment in video live broadcast | |
| CN112019896B (en) | Screen projection method and device, electronic equipment and computer readable medium | |
| CN105809817A (en) | ATM fault monitoring method and device | |
| CN114443192B (en) | Multi-window virtual application method and device based on cloud desktop | |
| CN112866784A (en) | Large-screen local playback control method, control system, equipment and storage medium | |
| CN110275787B (en) | Online platform data transmission method, device, medium and electronic equipment | |
| CN110266701B (en) | Intelligent device data transmission method, device, medium and electronic device | |
| WO2022205784A1 (en) | Interface information control method and apparatus | |
| CN110673886B (en) | Method and device for generating thermodynamic diagrams | |
| WO2024061308A1 (en) | Notification processing method, and terminal device, server side and computer storage medium | |
| EP4274237A1 (en) | Information display method and apparatus, and device and medium | |
| CN114640893A (en) | Method and device for connecting service end of real-time audio and video communication system | |
| CN114237531A (en) | Remote screen projection control method and system | |
| CN107390981B (en) | Global menu control method, device, equipment and storage medium | |
| US10812565B2 (en) | Systems and methods to configure metadata | |
| CN112671970B (en) | Control method and control device for mobile equipment and cloud mobile phone, electronic equipment, mobile equipment, cloud server and medium | |
| CN111142820B (en) | Remote control method, device and system based on multiple screens | |
| CN115278376B (en) | Audio and video data transmission method and device | |
| CN113760215B (en) | Multi-terminal display data transmission method, equipment and medium based on Hongming system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |