CN113778593A - Cloud desktop control method and device, electronic equipment, storage medium and program product - Google Patents
Cloud desktop control method and device, electronic equipment, storage medium and program product Download PDFInfo
- Publication number
- CN113778593A CN113778593A CN202110975852.2A CN202110975852A CN113778593A CN 113778593 A CN113778593 A CN 113778593A CN 202110975852 A CN202110975852 A CN 202110975852A CN 113778593 A CN113778593 A CN 113778593A
- Authority
- CN
- China
- Prior art keywords
- input event
- cloud
- cloud desktop
- operating system
- remote
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000004044 response Effects 0.000 claims abstract description 41
- 238000004590 computer program Methods 0.000 claims abstract description 16
- 230000005540 biological transmission Effects 0.000 claims description 25
- 238000005516 engineering process Methods 0.000 claims description 15
- 230000004048 modification Effects 0.000 claims description 14
- 238000012986 modification Methods 0.000 claims description 14
- 238000012546 transfer Methods 0.000 claims description 3
- 239000000126 substance Substances 0.000 claims 1
- 238000004891 communication Methods 0.000 description 12
- 238000012545 processing Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000003993 interaction Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 210000004899 c-terminal region Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000004171 remote diagnosis Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure provides a cloud desktop control method and device applied to a physical machine running Linux, electronic equipment, a computer readable storage medium and a computer program product, and relates to the technical fields of cloud desktops, containerization and the like. The method comprises the following steps: receiving a remote control instruction aiming at a cloud desktop sent by a cloud desktop user, wherein a cloud operating system corresponding to the cloud desktop runs in a containerization environment constructed by a physical machine, and a remote input event is generated by the cloud desktop user through a remote input device; identifying a remote input event contained in a remote control command as an effective input event through a preset graphical interface service; and sending the control operation corresponding to the effective input event to the cloud operating system through the graphical interface service, and returning response data returned by the cloud operating system to the cloud desktop user. The method enables the containerized cloud operating system to be feasible as a cloud desktop.
Description
Technical Field
The present disclosure relates to the field of data processing technologies, and in particular, to the field of cloud desktop and containerization technologies, and in particular, to a cloud desktop control method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product.
Background
With the appearance of the concept of cloud in service, various cloud-based services appear, a cloud desktop is a common service, an operating system (hereinafter, collectively referred to as a cloud operating system) running on a remote physical machine or a server transmits a picture of the operating system to a cloud desktop user, and then the cloud desktop transmits local control operation to the remote server or the server to reproduce the picture to the cloud operating system.
With diversification of application scenarios, more requirements are also provided for deployment of a cloud operating system, and how to better meet various requirements is a problem to be solved urgently in the field of cloud desktops by technical personnel in the field.
Disclosure of Invention
The embodiment of the disclosure provides a cloud desktop control method and device, electronic equipment, a computer readable storage medium and a computer program product.
In a first aspect, an embodiment of the present disclosure provides a cloud desktop control method, which is applied to a physical machine running Linux, and includes: receiving a remote control instruction aiming at a cloud desktop sent by a cloud desktop user, wherein a cloud operating system corresponding to the cloud desktop runs in a containerization environment constructed by a physical machine; identifying a remote input event contained in a remote control command as an effective input event through a preset graphical interface service; and sending the control operation corresponding to the effective input event to the cloud operating system through the graphical interface service, and returning response data returned by the cloud operating system to the cloud desktop user.
In a second aspect, an embodiment of the present disclosure provides a cloud desktop control device, which is applied to a physical machine running Linux, and includes: the remote control instruction receiving unit is configured to receive a remote control instruction aiming at a cloud desktop sent by a cloud desktop user, and a cloud operating system corresponding to the cloud desktop runs in a containerization environment constructed by a physical machine; a remote input event recognition unit configured to recognize a remote input event included in a remote control command as a valid input event through a preset graphic interface service; and the control operation transmission and response data return unit is configured to send the control operation corresponding to the effective input event to the cloud operating system through the graphical interface service and return response data returned by the cloud operating system to the cloud desktop user.
In a third aspect, an embodiment of the present disclosure provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to implement the cloud desktop control method as described in any implementation manner of the first aspect when executed.
In a fourth aspect, the disclosed embodiments provide a non-transitory computer-readable storage medium storing computer instructions for enabling a computer to implement the cloud desktop control method as described in any implementation manner of the first aspect when executed.
In a fifth aspect, the present disclosure provides a computer program product including a computer program, where the computer program is capable of implementing the cloud desktop control method as described in any implementation manner of the first aspect when executed by a processor.
The cloud desktop control method applied to the physical machine running the Linux provided by the embodiment of the disclosure comprises the following steps: receiving a remote control instruction aiming at a cloud desktop sent by a cloud desktop user, wherein a cloud operating system corresponding to the cloud desktop runs in a containerization environment constructed by a physical machine; identifying a remote input event contained in a remote control command as an effective input event through a preset graphical interface service; and sending the control operation corresponding to the effective input event to the cloud operating system through the graphical interface service, and returning response data returned by the cloud operating system to the cloud desktop user.
Aiming at cloud operating systems which are isolated from each other through a container technology in a physical machine running Linux, the disclosure provides a scheme for providing the cloud operating systems running in the container as a cloud desktop for a cloud desktop user and enabling the cloud desktop user to normally control the cloud operating systems, namely, a graphical interface service which identifies local input events generated by local input equipment under Linux as effective instructions is improved, so that the graphical interface service can also identify remote input events contained in the remote control instructions as the effective input events, and control operations corresponding to the effective input events are transmitted to the cloud operating systems in the containers through data transmission interfaces between the containers, so that the scheme for realizing the cloud desktop by using the cloud operating systems isolated through the containerization technology is feasible.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
Other features, objects and advantages of the disclosure will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 is an exemplary system architecture to which the present disclosure may be applied;
fig. 2 is a flowchart of a cloud desktop control method provided in an embodiment of the present disclosure;
fig. 3 is a flowchart of another cloud desktop control method provided in the embodiment of the present disclosure;
fig. 4 is a flowchart of another cloud desktop control method provided by the embodiment of the present disclosure;
FIG. 5 is a flowchart of a method for controlling operation delivery and response data return according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a component for implementing cloud desktop control in an application scenario according to an embodiment of the present disclosure;
fig. 7 is a block diagram of a cloud desktop control device according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of an electronic device adapted to execute a cloud desktop control method according to an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness. It should be noted that, in the present disclosure, the embodiments and features of the embodiments may be combined with each other without conflict.
In the technical scheme of the disclosure, the collection, storage, use, processing, transmission, provision, disclosure and other processing of the personal information of the related user are all in accordance with the regulations of related laws and regulations and do not violate the good customs of the public order.
Fig. 1 illustrates an exemplary system architecture 100 to which embodiments of the cloud desktop control method, apparatus, electronic device, and computer-readable storage medium of the present disclosure may be applied.
As shown in fig. 1, the system architecture 100 may include a physical machine 101 running Linux, a network 102, and user terminals 103, 104.
The physical machine 101 is a physical machine running an operating system with Linux as a kernel as a bottom physical system, containers 1011 and 1012 are further constructed on the operating system running with Linux as the kernel by using a containerization technology, and different containers are isolated from each other, wherein cloud operating systems facing cloud desktop users run respectively, and the types of the cloud operating systems can be different from the types of the bottom physical system of the physical machine 101; user terminals 103 and 104 refer to terminal devices used by cloud desktop users in different expression forms; the medium used by the network 102 to provide communication links between the physical machines 101, the user terminals 103, 104 may represent various types of connections, such as wired, wireless communication links, or fiber optic cables, among others.
The cloud desktop user may use the user terminals 103 and 104 to interact with the cloud operating systems in the containers 10111 and 1012 in the physical machine 101 through the network 102 to receive the sent image data or send control instructions and the like. Various operations including the above-described interactive operations may be performed by various applications installed on the user terminals 103 and 104 and the physical machine 101, such as a cloud desktop application for providing a cloud desktop service, a remote diagnosis application for providing remote fault diagnosis, a communication application for providing peer-to-peer communication, and the like.
Taking a cloud desktop application that can provide a cloud desktop service as an example, the physical machine 101 may implement the following effects when running the cloud desktop application: receiving a remote control instruction aiming at a cloud desktop sent by a cloud desktop user through input equipment connected to user terminals 103 and 104 through a network 102; identifying a remote input event contained in a remote control command as an effective input event through a preset graphical interface service; and sending the control operation corresponding to the effective input event to the cloud operating system in the corresponding container through the graphical interface service, and returning response data returned by the cloud operating system to the cloud desktop user through the network 102.
The cloud desktop control method provided in the subsequent embodiments of the present disclosure is executed by the physical machine 101 running the containerized cloud operating system for providing the cloud desktop to the outside, and accordingly, the cloud desktop control device is generally also disposed in the physical machine 101, and may be directly the physical machine 101 itself, or may be a controller or a control component for executing the above operations in the physical machine 101.
It should be understood that the number of physical machines, containers and user terminals in fig. 1 is merely illustrative. There may be any number of physical machines, containers, and user terminals, as desired for an implementation.
Referring to fig. 2, fig. 2 is a flowchart of a cloud desktop control method according to an embodiment of the present disclosure, where the process 200 includes the following steps:
step 201: receiving a remote control instruction aiming at the cloud desktop sent by a cloud desktop user;
this step is intended to receive, by an execution subject (for example, the physical machine 101 shown in fig. 1) of the cloud desktop control method, a remote control instruction for a cloud desktop sent by a cloud desktop user, where the cloud desktop is actually from a cloud operating system running in a container built by the execution subject, that is, the cloud operating system runs in a containerization environment built by the execution subject.
Specifically, the remote control command is different from the local control command in nomenclature, and it should be understood that, in this embodiment and the subsequent embodiments, the concepts of local and remote are both relative to the execution main body, that is, the input device directly connected to the execution main body will be referred to as a local input device, the control command directly generated by the local input device will be referred to as a local control command, and the local control command includes a local input event; correspondingly, the input device which is not directly connected to the execution main body and is directly connected to the user terminal of the cloud desktop user will be referred to as a non-local input device (or a remote input device), the control instruction directly generated by the non-local input device will be referred to as a remote control instruction, and the remote control instruction includes a remote input event.
In addition, the remote control instruction may further include other information besides the remote input event, for example, selection information or an identity used for specifying which specific cloud desktop is, a timestamp used for specifying a time sequence of different input events, authentication information used for specifying whether a cloud desktop user issuing the remote control instruction has a right to control the cloud operating system, and the like, and may be flexibly determined according to all possible influence factors of an actual application scenario, which is not specifically limited herein.
Step 202: identifying a remote input event contained in a remote control command as an effective input event through a preset graphical interface service;
on the basis of step 201, this step is intended to identify a remote input event contained in the remote control command as a valid input event through a preset graphical interface service by the execution subject.
The graphic interface service described in this step is actually only an improved Xserver, which is a service responsible for the graphic interface under Linux, and may be further subdivided into a plurality of different sub-services or sub-protocols according to different actual uses. However, it should be noted that the standard Xserver only has the capability of recognizing the local input event in the local control instruction, that is, the recognition object of the standard Xserver only has the local input event generated by the local input device directly connected to the execution main body, and does not include the recognition capability of the remote input event generated by the non-local input device, so that there is no way to provide the cloud desktop service to the cloud desktop user in the scheme of the standard Xserver, because the input event from the outside cannot be normally recognized as a valid input event by the standard Xserver, and naturally cannot be converted into a control operation for a certain function button or changing a certain click position on the graphical interface provided by the cloud operating system.
Therefore, the present disclosure is directed to the above problems of the standard X server, and in particular, in combination with the containerization environment specifically addressed by the present disclosure, to provide a solution to the above technical problem, i.e., to make an improved graphics interface service (X server) capable of recognizing a remote input event contained in a remote control command as a valid input event, the capability of the improved graphics interface service (X server) can be divided into at least two layers: first, the modified X server needs to identify a remote input event from the remote control command, and then, the identified remote input event needs to be determined as a valid input event.
Given the above-described solution idea, there is a possibility to achieve this object through a variety of different specific implementations, and the following embodiments will respectively give two different solutions in conjunction with fig. 3 and fig. 4 to support the generic concept of this step as specific implementations.
Step 203: and sending the control operation corresponding to the effective input event to the cloud operating system through the graphical interface service, and returning response data returned by the cloud operating system to the cloud desktop user.
On the basis of step 202, in this step, the execution main body sends the control operation corresponding to the valid input event to the cloud operating system through the graphical interface service, so that the cloud operating system obtains corresponding response data after the operation of the cloud desktop user is repeated according to the received control operation, and finally the execution main body returns the response data to the cloud desktop user and receives a subsequent remote control instruction after preparation.
Aiming at cloud operating systems which are isolated from each other through a container technology in a physical machine running Linux, the cloud desktop control method provided by the embodiment of the disclosure provides a scheme for providing the cloud operating systems running in the container as a cloud desktop to a cloud desktop user and enabling the cloud desktop user to normally control the cloud operating systems, namely, a graphical interface service which identifies local input events generated by local input equipment under Linux as effective instructions is improved, so that the graphical interface service can also identify remote input events contained in the remote control instructions as the effective input events, and control operations corresponding to the effective input events are transmitted to the cloud operating systems in the containers through data transmission interfaces between the containers, so that the scheme for realizing the cloud desktop by using the cloud operating systems isolated through the containerization technology has feasibility.
Referring to fig. 3, fig. 3 is a flowchart of another cloud desktop control method according to an embodiment of the present disclosure, where the process 300 includes the following steps:
step 301: receiving a remote control instruction aiming at the cloud desktop sent by a cloud desktop user;
this step is consistent with step 201 in the process 200, and the technical content already described is not repeated here, please refer to the expanded description of step 201 in the above embodiment.
Step 302: identifying a remote input event contained in a remote control command through an extended identification rule added in the graphical interface service;
the extension identification rule is named to be different from a basic identification rule, the basic identification rule has the function of enabling a standard X server to have the capacity of identifying a local input event contained in a local control command, and the basic identification rule can be obtained by writing according to event characteristics contained in the local input event; in contrast, the added extension recognition rule in this embodiment is to make the graphical interface service have an originally-unavailable capability of recognizing the remote input event included in the remote control instruction, the extension recognition rule may be compiled according to an event feature included in the remote input event, and an event feature of the extension recognition rule for the compiling may be an event feature unique to the remote input event, or may be an event feature that is not unique but can be used to distinguish a local input event.
That is, this step is intended to provide the graphical interface service with the ability to recognize a remote input event from a remote control command, i.e., the first of the two levels mentioned above.
Step 303: determining a remote input event as a valid input event juxtaposed to a local input event by an additional decision rule added in the graphical interface service;
in contrast to the basic decision rule, which is used to enable the standard X server to have the capability of determining the identified local input event as a valid input event, the new added additional decision rule of this embodiment enables the improved X server to have the capability of determining the remote input event as a valid input event juxtaposed to the local input event.
That is, this step is intended to then provide the graphical interface service with the ability to determine the identified remote input event as a valid input event, i.e., the second of the two levels mentioned above.
Step 304: and sending the control operation corresponding to the effective input event to the cloud operating system through the graphical interface service, and returning response data returned by the cloud operating system to the cloud desktop user.
That is, in this embodiment, through steps 302 to 303, the standard X server originally including only the basic identification rule and the basic determination rule is improved by adding the extended identification rule and the extended determination rule, so that the improved X server additionally has the capability of identifying the remote input event included in the remote control instruction as the valid input event by means of the extended identification rule and the extended determination rule, and further, the technical defect in the prior art is overcome.
Slightly different from the solution presented in fig. 3, the flow 400 shown in fig. 4 comprises the following steps:
step 401: receiving a remote control instruction aiming at the cloud desktop sent by a cloud desktop user;
this step is consistent with step 201 in the process 200, and the technical content already described is not repeated here, please refer to the expanded description of step 201 in the above embodiment.
Step 402: identifying a remote input event contained in a remote control command through an extended identification rule added in the graphical interface service;
this step is consistent with step 302 in the process 300, and the technical content already described is not repeated here, please refer to the expanded description of step 302 in the above embodiment.
Step 403: modifying the remote input event into a pseudo local input event generated by the local input device through an event modification rule added in the graphical interface service;
on the basis of step 402, this step aims to modify, by the execution subject, the remote input event into the pseudo local input event generated by the local input device through the event modification rule added in the graphical interface service, that is, in this embodiment, on the basis of adding the extended identification rule to the standard X server in step 402, an event modification rule is further added immediately, and the operation executed by the event modification rule is as follows: the modification of a remote input event to a pseudo-local input event generated by a local input device, i.e., the modification object being the source of the input device generating the input event, is termed herein as a pseudo-local input event, in order to distinguish it from a true local input event that is actually generated by the local input device (local input events without a "true" or "pseudo" prefix previously appended to them in this disclosure shall each be referred to by default as a "true local input event").
Step 404: identifying the pseudo local input event as a valid input event by a basic decision rule in the graphical interface service;
on the basis of step 403, this step is intended to identify a pseudo local input event as a valid input event by the executing agent through the underlying identification rules in the graphical interface service. The basic judgment rule is used for enabling the standard X server to have the capacity of judging the identified local input event as a valid input event, so that the standard X server only needs to modify the identified local input event into a pseudo local input event which can be validated by the basic judgment rule through an additional identification rule and an event modification rule.
Step 405: and sending the control operation corresponding to the effective input event to the cloud operating system through the graphical interface service, and returning response data returned by the cloud operating system to the cloud desktop user.
Different from the embodiment provided in fig. 3, the embodiment, on the basis of continuing to extend the identification rule, can achieve the same object through the original basic determination rule by adding the event modification rule.
The specific choice of the solution provided by fig. 3 or fig. 4 can be flexibly selected according to the requirements of the actual application scenario.
On the basis of any of the above embodiments, in order to deepen the specific implementation flow of step 203, the present disclosure further provides a specific implementation manner through fig. 5, where the flow 500 includes the following steps:
step 501: determining, by the graphical interface service, a control operation corresponding to the valid input event;
the control operation here refers to various operations, such as clicking (left key clicking, right key clicking), clicking sliding, information entry, and the like, on each function button of a graphical operation interface presented to a cloud desktop user by the cloud operating system, which are represented by the effective input event.
Step 502: determining a target container where a cloud operating system is located and a data transmission interface of the target container;
namely, each containerized cloud operating system performs data interaction with the underlying operating system of the execution main body through different data transmission interfaces.
Step 503: sending the control operation to a cloud operating system through a data transmission interface;
step 504: controlling the cloud operating system to execute the received control operation to obtain response data;
step 505: controlling the cloud operating system to output response data through the data transmission interface;
step 506: and returning the response data output by the data transmission interface to the cloud desktop user.
The steps shown in the above flow 500 are only implementation steps given for a specific actual application scenario, and may also be adaptively adjusted in other application scenarios according to the logical idea shown in the above steps.
Further, in order to ensure the continuity of the image data stream returned to the cloud desktop user and improve the viewing experience as much as possible, the code rate for generating the response data can be dynamically adjusted according to the real-time network quality between the cloud desktop user and the cloud desktop user, that is, when the network quality is poor, the code rate is reduced, the response data with poor image quality is returned to the cloud desktop user, so that the response data can be seen by the cloud desktop user within a limited time, and on the contrary, when the network quality is good, the code rate can be increased, so that the response data with high image quality can be transmitted to the cloud desktop user as much as possible and returned. Based on the dynamic adjustment concept, the analysis parameter can also be adjusted by applying the dynamic adjustment concept to a user terminal (e.g., the user terminals 103 and 104 shown in fig. 1) that receives and analyzes the presentation screen.
On the basis of any of the above embodiments, the image data in Linux generally needs a frame buffer module to temporarily store and transfer image data in an intermediate state in units of frames, and the frame buffer module on one physical machine is generally provided and used by dedicated hardware, and the number of the frame buffer modules is relatively limited, so that under the condition that a plurality of containerized cloud operating systems are constructed by fully utilizing the physical machine operating resources, the situations of queuing and long-term waiting caused by insufficient use of a few or only physical frame buffer modules are avoided, a plurality of virtual frame buffer modules can be generated by the general operating resources on the physical machine through a virtualization technology, and the binding relationship between each containerized cloud operating system and different virtual frame buffer modules is suggested, so as to control the cloud operating system in the containerization environment to temporarily store frame data in the corresponding virtual frame buffer modules, and the processing efficiency is improved by using the virtual frame buffer module constructed in a virtualization mode while further using general operation resources of the physical machine.
For further understanding, the present disclosure also provides a specific implementation scheme in combination with a specific application scenario, please refer to the schematic structural diagram of components shown in fig. 6:
many hardware compatibility layers are implemented in the source code of X server official Xorg for running the Xserver on different platforms or hardware, including Xfree86(X server is an implementation of the Window System), Xwayland (an implementation under Wayland's display protocol), Xvfb (an implementation under a virtual screen), etc., and some external proprietary implementations such as Xvnc (an X server based on the open source code release from the real vnc project and x.org Foundation) etc., where each hardware compatibility layer implements an OS (Operating System) compatibility layer, keyboard support, mouse support, graphic display driver, etc.
However, for running the cloud operating system in a container under Linux, the X server cannot support recognizing an input event transmitted from the outside, and thus cannot realize a cloud desktop scheme based on a containerized cloud operating system. Therefore, referring to the above-mentioned idea of adding a hardware compatible layer, the present embodiment also privately implements an additional hardware compatible layer (referred to as Xremoteplay in the present embodiment), including a graphic display driver, transmitting keyboard and mouse events and some controls.
The specific implementation scheme is as follows:
1) the method for realizing Xremoteplay DDX graphic display driving mainly comprises the following steps:
initializing screen information, implementing setting pixel depth and color table, implementing method of allocating/destroying Framebuffer, implementing XRender (chinese may be translated into renderer) extension, implementing XRandR (related instructions for screen display) extension, for changing resolution and pixel depth, etc., implementing various callbacks required in the main message loop, etc.
2) The method for realizing the two ends of libxrpctlC/S of Xremoteplay mainly comprises the following steps:
adding a socket address monitoring in an Xserver message cycle;
the libxrpctl (referring to an xpc library, and xpc referring to a high throughput remote method calling component) sends a message to the socket, and receives and analyzes the message in the address recv callback of the Xserver socket;
if the message is a message transmitted from a keyboard and a mouse on an external C terminal (i.e., a Client terminal, which is a user terminal used by the cloud desktop user described in the above embodiment), converting and correcting (the specific operation referred to herein may refer to the scheme provided in fig. 4) and calling an Xserver DIX layer function;
if the control events are other, the related Xserver DIX layer function can be called to realize the control events.
3) Interaction of Remoteplay and Xremoteplay:
setting Xremoteplay resolution using libxrptl, grabbing a Framebuffer for Xremoteplay using libxcb (refer to xcb library, a component library under Linux), synchronizing various states of the keyboard to Xremoteplay using libxrptl, such as NumLock (numeric Lock on keyboard)/CapsLock (capitalized Lock on keyboard), etc., sending keymouse input events to Xremoteplay using libxrptl, etc.
That is, as shown in fig. 7, the X client1 and X client2, which are deployed with libx11 and libxcb component libraries, implement input information transfer with Remoteplay, which is also deployed with libxcb and libxrpctl components, through the improved X server including Xserver DIX and Xserver DDX components, thereby implementing a cloud desktop solution.
The embodiment provides an implementation scheme of the X server in the container through the above contents, and actually solves the problem of input and output of the X server at the bottom layer of the desktop system such as ubuntu of the cloud desktop, and has the following advantages: the Libxrpctl and the Xremoteplay hardware compatible layer are provided, the X server can be completely controlled, the Framebuffer is read in the Remoteplay daemon, the Framebuffer is coded into a video stream, and the video stream is transmitted to the cloud desktop client side without being processed by the X server.
With further reference to fig. 7, as an implementation of the methods shown in the above-mentioned figures, the present disclosure provides an embodiment of a cloud desktop control apparatus, where the apparatus embodiment corresponds to the method embodiment shown in fig. 2, and the apparatus may be specifically applied to various electronic devices.
As shown in fig. 7, the cloud desktop control apparatus 700 of the present embodiment may include: a remote control instruction receiving unit 701, a remote input event identifying unit 702, and a control operation transmitting and response data returning unit 703. The remote control instruction receiving unit 701 is configured to receive a remote control instruction for a cloud desktop sent by a cloud desktop user, and a cloud operating system corresponding to the cloud desktop runs in a containerization environment constructed by physical machines; a remote input event recognition unit 702 configured to recognize a remote input event included in the remote control command as a valid input event through a preset graphic interface service; the control operation transmitting and response data returning unit 703 is configured to send the control operation corresponding to the valid input event to the cloud operating system through the graphical interface service, and return response data returned by the cloud operating system to the cloud desktop user.
In this embodiment, in cloud desktop control apparatus 700: the specific processing and the technical effects thereof of the remote control instruction receiving unit 701, the remote input event identifying unit 702, and the control operation transmission and response data returning unit 703 can be referred to the related descriptions of step 201 and step 203 in the corresponding embodiment of fig. 2, and are not described herein again.
In some optional implementations of the present embodiment, the far-end input event recognition unit 702 may be further configured to:
identifying a remote input event contained in a remote control command through an extended identification rule added in the graphical interface service, wherein the extended identification rule is compiled according to the event characteristics of a non-local input event generated by non-local input equipment;
the remote input event is determined as a valid input event juxtaposed to a local input event generated by a local input device installed on the physical machine by an additional decision rule added to the graphic interface service.
In some optional implementations of the present embodiment, the far-end input event recognition unit 702 may be further configured to:
identifying a remote input event contained in a remote control command through an extended identification rule added in the graphical interface service, wherein the extended identification rule is compiled according to the event characteristics of a non-local input event generated by non-local input equipment;
modifying a remote input event into a pseudo local input event generated by a local input device by an event modification rule added in the graphical interface service, wherein the local input device is an input device directly installed on a physical machine;
the pseudo local input event is identified as a valid input event by the underlying identification rule in the graphical interface service.
In some optional implementations of this embodiment, the control operation delivery and response data returning unit 703 may be further configured to:
determining, by the graphical interface service, a control operation corresponding to the valid input event;
determining a target container where a cloud operating system is located and a data transmission interface of the target container;
sending the control operation to a cloud operating system through a data transmission interface;
controlling the cloud operating system to execute the received control operation to obtain response data;
controlling the cloud operating system to output response data through the data transmission interface;
and returning the response data output by the data transmission interface to the cloud desktop user.
In some optional implementations of the present embodiment, the cloud desktop control apparatus 700 may further include:
and the code rate dynamic adjustment unit is configured to dynamically adjust the code rate for generating the response data according to the real-time network quality between the cloud desktop user and the cloud desktop user.
In some optional implementations of the present embodiment, the cloud desktop control apparatus 700 may further include:
and the frame data temporary storage module is configured to control the cloud operating system in the containerization environment to temporarily store the frame data in the corresponding virtual frame buffer module, and the virtual frame buffer module is generated by general operation resources on the physical machine through a virtualization technology.
The present embodiment exists as an embodiment of an apparatus corresponding to the above method embodiment, and for a cloud operating system in a physical machine running Linux that is isolated from each other by a container technology, the cloud desktop control apparatus provided in the embodiments of the present disclosure provides a scheme for providing the cloud operating system running in a container as a cloud desktop to a cloud desktop user and enabling the cloud desktop user to normally control the cloud operating system, namely, the graphical interface service which identifies the local input event generated by the local input equipment as the effective command under Linux is improved, so that the remote input event contained in the remote control command can be identified as the effective input event, the control operation corresponding to the effective input event is transmitted to the cloud operating system in the container through the data transmission interface between the containers, the scheme of realizing the cloud desktop by the cloud operating system isolated by the containerization technology has feasibility.
According to an embodiment of the present disclosure, the present disclosure also provides an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can implement the cloud desktop control method described in any of the above embodiments when executing the instructions.
According to an embodiment of the present disclosure, the present disclosure further provides a readable storage medium, where computer instructions are stored, and the computer instructions are configured to enable a computer to implement the cloud desktop control method described in any of the above embodiments when executed.
The embodiment of the disclosure provides a computer program product, and the computer program can realize the cloud desktop control method described in any embodiment when being executed by a processor.
FIG. 8 illustrates a schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 8, the apparatus 800 includes a computing unit 801 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)802 or a computer program loaded from a storage unit 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The calculation unit 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.
A number of components in the device 800 are connected to the I/O interface 805, including: an input unit 806, such as a keyboard, a mouse, or the like; an output unit 807 such as various types of displays, speakers, and the like; a storage unit 808, such as a magnetic disk, optical disk, or the like; and a communication unit 809 such as a network card, modem, wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The Server may be a cloud Server, which is also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service extensibility in the conventional physical host and Virtual Private Server (VPS) service.
Aiming at cloud operating systems which are isolated from each other through a container technology in a physical machine running Linux, the cloud desktop control method provided by the embodiment of the disclosure provides a scheme for providing the cloud operating systems running in the container as a cloud desktop to a cloud desktop user and enabling the cloud desktop user to normally control the cloud operating systems, namely, a graphical interface service which identifies local input events generated by local input equipment under Linux as effective instructions is improved, so that the graphical interface service can also identify remote input events contained in the remote control instructions as the effective input events, and control operations corresponding to the effective input events are transmitted to the cloud operating systems in the containers through data transmission interfaces between the containers, so that the scheme for realizing the cloud desktop by using the cloud operating systems isolated through the containerization technology has feasibility.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and the present disclosure is not limited herein.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.
Claims (15)
1. A cloud desktop control method is applied to a physical machine running Linux, and comprises the following steps:
receiving a remote control instruction aiming at a cloud desktop sent by a cloud desktop user, wherein a cloud operating system corresponding to the cloud desktop runs in a containerization environment constructed by the physical machine;
identifying a remote input event contained in the remote control command as an effective input event through a preset graphical interface service;
and sending the control operation corresponding to the effective input event to the cloud operating system through the graphical interface service, and returning response data returned by the cloud operating system to the cloud desktop user.
2. The method according to claim 1, wherein the identifying, through a preset graphical interface service, a far-end input event contained in the far-end control command as a valid input event comprises:
identifying a remote input event contained in the remote control command through an expansion identification rule added in the graphical interface service, wherein the expansion identification rule is compiled according to event characteristics of a non-local input event generated by non-local input equipment;
determining the remote input event as a valid input event juxtaposed to a local input event generated by a local input device installed on the physical machine by an additional decision rule added in the graphic interface service.
3. The method according to claim 1, wherein the identifying, through a preset graphical interface service, a far-end input event contained in the far-end control command as a valid input event comprises:
identifying a remote input event contained in the remote control command through an expansion identification rule added in the graphical interface service, wherein the expansion identification rule is compiled according to event characteristics of a non-local input event generated by non-local input equipment;
modifying the remote input event into a pseudo local input event generated by a local input device through an event modification rule added in the graphical interface service, wherein the local input device is an input device directly installed on the physical machine;
identifying the pseudo local input event as the valid input event by a base identification rule in the graphical interface service.
4. The method of claim 1, wherein the sending, by the graphical interface service, the control operation corresponding to the valid input event to the cloud operating system and returning response data returned by the cloud operating system to the cloud desktop user comprises:
determining, by the graphical interface service, a control operation corresponding to the valid input event;
determining a target container where the cloud operating system is located and a data transmission interface of the target container;
sending the control operation to the cloud operating system through the data transmission interface;
controlling the cloud operating system to execute the received control operation to obtain the response data;
controlling the cloud operating system to output the response data through the data transmission interface;
and returning the response data output by the data transmission interface to the cloud desktop user.
5. The method of claim 1, further comprising:
and dynamically adjusting the code rate for generating the response data according to the real-time network quality between the cloud desktop user and the cloud desktop user.
6. The method of any of claims 1-5, further comprising:
and controlling a cloud operating system in the containerization environment to temporarily store frame data in a corresponding virtual frame buffer module, wherein the virtual frame buffer module is generated by general operation resources on the physical machine through a virtualization technology.
7. A cloud desktop control device is applied to a physical machine running Linux, and comprises:
a remote control instruction receiving unit configured to receive a remote control instruction for a cloud desktop sent by a cloud desktop user, wherein a cloud operating system corresponding to the cloud desktop runs in a containerization environment constructed by the physical machine;
a remote input event recognition unit configured to recognize a remote input event included in the remote control command as a valid input event through a preset graphic interface service;
and the control operation transmission and response data return unit is configured to send the control operation corresponding to the effective input event to the cloud operating system through the graphical interface service and return response data returned by the cloud operating system to the cloud desktop user.
8. The apparatus of claim 7, wherein the remote input event recognition unit is further configured to:
identifying a remote input event contained in the remote control command through an expansion identification rule added in the graphical interface service, wherein the expansion identification rule is compiled according to event characteristics of a non-local input event generated by non-local input equipment;
determining the remote input event as a valid input event juxtaposed to a local input event generated by a local input device installed on the physical machine by an additional decision rule added in the graphic interface service.
9. The apparatus of claim 7, wherein the remote input event recognition unit is further configured to:
identifying a remote input event contained in the remote control command through an expansion identification rule added in the graphical interface service, wherein the expansion identification rule is compiled according to event characteristics of a non-local input event generated by non-local input equipment;
modifying the remote input event into a pseudo local input event generated by a local input device through an event modification rule added in the graphical interface service, wherein the local input device is an input device directly installed on the physical machine;
identifying the pseudo local input event as the valid input event by a base identification rule in the graphical interface service.
10. The apparatus of claim 7, wherein the control operation transfer and response data return unit is further configured to:
determining, by the graphical interface service, a control operation corresponding to the valid input event;
determining a target container where the cloud operating system is located and a data transmission interface of the target container;
sending the control operation to the cloud operating system through the data transmission interface;
controlling the cloud operating system to execute the received control operation to obtain the response data;
controlling the cloud operating system to output the response data through the data transmission interface;
and returning the response data output by the data transmission interface to the cloud desktop user.
11. The apparatus of claim 7, further comprising:
and the code rate dynamic adjustment unit is configured to dynamically adjust the code rate for generating the response data according to the real-time network quality between the cloud desktop user and the cloud desktop user.
12. The apparatus of any of claims 7-11, further comprising:
a frame data temporary storage module configured to control a cloud operating system in the containerization environment to temporarily store frame data in a corresponding virtual frame buffer module, wherein the virtual frame buffer module is generated by a general-purpose computing resource on the physical machine through a virtualization technology.
13. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the cloud desktop control method of any of claims 1-6.
14. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the cloud desktop control method of any one of claims 1-6.
15. A computer program product comprising a computer program which, when executed by a processor, carries out the steps of the cloud desktop control method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110975852.2A CN113778593B (en) | 2021-08-24 | 2021-08-24 | Cloud desktop control method and device, electronic equipment, storage medium and program product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110975852.2A CN113778593B (en) | 2021-08-24 | 2021-08-24 | Cloud desktop control method and device, electronic equipment, storage medium and program product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113778593A true CN113778593A (en) | 2021-12-10 |
| CN113778593B CN113778593B (en) | 2023-11-10 |
Family
ID=78839169
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110975852.2A Active CN113778593B (en) | 2021-08-24 | 2021-08-24 | Cloud desktop control method and device, electronic equipment, storage medium and program product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113778593B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114501083A (en) * | 2022-02-07 | 2022-05-13 | 北京百度网讯科技有限公司 | Code rate adjusting method, device, equipment, medium and program product |
| CN117435146A (en) * | 2023-12-20 | 2024-01-23 | 摩尔线程智能科技(成都)有限责任公司 | Code stream generation method, system and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060170670A1 (en) * | 2004-11-10 | 2006-08-03 | Burke Joel S | Interactive electronic dispaly, methods and apparatus for targeted propagation of sign content, systems for capturing and sending photographs and video, as a means of integrated customer service, information capture and marketing |
| CN109395372A (en) * | 2018-12-07 | 2019-03-01 | 上海达龙信息科技有限公司 | Realize method, system and the electronic equipment of game paddle remote control computer game |
| CN111368095A (en) * | 2020-02-28 | 2020-07-03 | 河海大学 | Decision support system architecture and method based on water conservancy knowledge-affair coupling network |
| CN112202825A (en) * | 2020-12-09 | 2021-01-08 | 江苏北弓智能科技有限公司 | Remote mobile cloud desktop transmission system and method |
| CN112416505A (en) * | 2021-01-22 | 2021-02-26 | 统信软件技术有限公司 | Remote control system, method and computing equipment |
-
2021
- 2021-08-24 CN CN202110975852.2A patent/CN113778593B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060170670A1 (en) * | 2004-11-10 | 2006-08-03 | Burke Joel S | Interactive electronic dispaly, methods and apparatus for targeted propagation of sign content, systems for capturing and sending photographs and video, as a means of integrated customer service, information capture and marketing |
| CN109395372A (en) * | 2018-12-07 | 2019-03-01 | 上海达龙信息科技有限公司 | Realize method, system and the electronic equipment of game paddle remote control computer game |
| WO2020114007A1 (en) * | 2018-12-07 | 2020-06-11 | 上海达龙信息科技有限公司 | Method employing gamepad to remotely control computer game, system, and electronic apparatus |
| CN111368095A (en) * | 2020-02-28 | 2020-07-03 | 河海大学 | Decision support system architecture and method based on water conservancy knowledge-affair coupling network |
| CN112202825A (en) * | 2020-12-09 | 2021-01-08 | 江苏北弓智能科技有限公司 | Remote mobile cloud desktop transmission system and method |
| CN112416505A (en) * | 2021-01-22 | 2021-02-26 | 统信软件技术有限公司 | Remote control system, method and computing equipment |
Non-Patent Citations (4)
| Title |
|---|
| SAVILL J 等: "Remote FX improves the capabilities available to users connecting to Microsoft Virtual Desktop Infrastructure(VDI)environments and eliminates many of the past restrictions", WINDOWS IT PRO * |
| 王峰;江峰;李朝阳;: "虚拟桌面及关键技术分析", 电信技术, no. 01 * |
| 王斌;: "基于分类云计算的计算机机房交互式应用", 粘接, no. 08 * |
| 霍旭轮;蒋志松;赵文;: "云桌面虚拟化架构的研究与应用", 电脑与电信, no. 08 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114501083A (en) * | 2022-02-07 | 2022-05-13 | 北京百度网讯科技有限公司 | Code rate adjusting method, device, equipment, medium and program product |
| CN117435146A (en) * | 2023-12-20 | 2024-01-23 | 摩尔线程智能科技(成都)有限责任公司 | Code stream generation method, system and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113778593B (en) | 2023-11-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11494010B2 (en) | Touch support for remoted applications | |
| CN111433743B (en) | APP remote control method and related equipment | |
| US8924502B2 (en) | System, method and computer program product for updating a user session in a mach-derived system environment | |
| US8654134B2 (en) | Command remoting | |
| CN113778593A (en) | Cloud desktop control method and device, electronic equipment, storage medium and program product | |
| CA2920050C (en) | Image display method and apparatus | |
| CN108762934B (en) | Remote graphic transmission system and method and cloud server | |
| CN113360116A (en) | Method, device and equipment for controlling terminal and storage medium | |
| KR20140027741A (en) | Application service providing system and method, server apparatus and client apparatus for application service | |
| CN113032080A (en) | Page implementation method, application program, electronic device and storage medium | |
| US8860740B2 (en) | Method and apparatus for processing a display driver in virture desktop infrastructure | |
| CN111881387A (en) | Data processing method, device, equipment and medium for small program | |
| CN113655975B (en) | Image display method, image display device, electronic apparatus, and medium | |
| CN104765636A (en) | Remote desktop image synthesis method and device | |
| CN111767059B (en) | Deployment method and device of deep learning model, electronic equipment and storage medium | |
| US20170109113A1 (en) | Remote Image Projection Method, Sever And Client Device | |
| CN115373618B (en) | Multi-screen display method and device, vehicle machine and storage medium | |
| CN113407259B (en) | Scene loading method, device, equipment and storage medium | |
| CN113905040B (en) | File transmission method, device, system, equipment and storage medium | |
| CN113835816A (en) | Virtual machine desktop display method, device, equipment and readable storage medium | |
| CN108235822B (en) | Virtual SIM card implementation method and device, storage medium and electronic equipment | |
| CN113613043A (en) | Screen display and image processing method, embedded device and cloud server | |
| US11243650B2 (en) | Accessing window of remote desktop application | |
| CN114095758B (en) | Cloud image intercepting method and related device | |
| CN113434551B (en) | Data processing method, device, equipment and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |