CN114356200A - Cloud application program operation method, system and device - Google Patents
Cloud application program operation method, system and device Download PDFInfo
- Publication number
- CN114356200A CN114356200A CN202111440815.8A CN202111440815A CN114356200A CN 114356200 A CN114356200 A CN 114356200A CN 202111440815 A CN202111440815 A CN 202111440815A CN 114356200 A CN114356200 A CN 114356200A
- Authority
- CN
- China
- Prior art keywords
- operation data
- target
- original
- cloud application
- virtual machine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 79
- 238000004891 communication Methods 0.000 claims abstract description 105
- 230000008569 process Effects 0.000 claims abstract description 24
- 238000012545 processing Methods 0.000 claims abstract description 19
- 238000004806 packaging method and process Methods 0.000 claims abstract description 14
- 238000004590 computer program Methods 0.000 claims description 13
- 230000004044 response Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 10
- 238000013519 translation Methods 0.000 description 9
- 235000013599 spices Nutrition 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000011017 operating method Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides a cloud application program running method, a cloud application program running system and a cloud application program running device, and relates to the technical field of cloud; packaging the original operation data according to a preset communication protocol to obtain target operation data; and sending the target operation data to the server. The server decapsulates the target operation data according to a preset communication protocol to obtain original operation data; sending original operation data to the virtual machine; the virtual machine processes the original operation data through the virtual multi-point touch component to obtain standard operation data which accord with a multi-point touch protocol; and responding standard operation data in the target cloud application program through the application layer of the virtual machine. Based on the processing, the target cloud application program can respond to the multi-touch operation of the user.
Description
Technical Field
The invention relates to the technical field of cloud, in particular to a method, a system and a device for operating a cloud application program.
Background
With the rapid development of network technologies, in order to reduce the requirements for client configuration, cloud application services may be provided to users based on the architecture of clients and cloud devices (e.g., cloud servers).
For example, a user may select to launch a cloud application in a client, which may then send a launch request to the cloud device. After the cloud application is started, the cloud device may send the video stream of the cloud application to the client. Accordingly, the client may then display an interface of the cloud application based on the video stream.
In the related art, data transmission and processing are performed between the client and the cloud device based on a Spice protocol, however, the Spice protocol only supports single-point touch operation data, so that the cloud device cannot respond to multi-point touch operation of a user and cannot meet the requirement of the user for using a cloud application program.
Disclosure of Invention
The embodiment of the invention aims to provide a cloud application program running method, a cloud application program running system and a cloud application program running device, so that a target cloud application program can respond to multi-point touch operation of a user, and the requirement of the user for using the cloud application program is met. The specific technical scheme is as follows:
in a first aspect of the present invention, there is provided a method for operating a cloud application, where the method is applied to a virtual machine, and a target cloud application is operated in the virtual machine, and the method includes:
acquiring original operation data from a server; wherein the original operation data is: the server-side decapsulates the target operation data sent by the client-side according to a preset communication protocol to obtain the target operation data; the target operation data is as follows: the client encapsulates the original operation data of the multi-point touch operation in the running interface of the target cloud application program according to the preset communication protocol;
processing the original operation data through a virtual multi-point touch component to obtain a standard meeting a multi-point touch protocol;
and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
Optionally, the processing the original operation data by the virtual multi-touch component to obtain standard operation data conforming to a multi-touch protocol includes:
converting the original operation data through a virtual multi-point touch component to obtain virtual operation data matched with the virtual multi-point touch component;
and processing the virtual operation data through the virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol.
Optionally, before the responding the standard operation data in the target cloud application program through the application layer of the virtual machine, the method further includes:
sending the standard operation data to a virtual multi-point touch drive through the virtual multi-point touch component;
generating a touch event corresponding to the standard operation data through the virtual multi-point touch drive to serve as a multi-point touch event, and sending the multi-point touch event to an application layer of the virtual machine;
the responding the standard operation data in the target cloud application program through the application layer of the virtual machine comprises:
executing the multi-touch event in the target cloud application program through an application layer of the virtual machine so as to respond to the standard operation data.
Optionally, the method further includes:
acquiring operation data of the target cloud application program as original operation data;
and sending the original operation data to the server so that the server encapsulates the original operation data according to the preset communication protocol to obtain target operation data, and sending the target operation data to the client so that the client de-encapsulates the target operation data according to the preset communication protocol to obtain the original operation data, and loading the original operation data.
Optionally, the original operation data includes: a touch type and a touch position of the multi-touch operation.
In a second aspect of the present invention, there is provided a cloud application running method, where the method is applied to a server, and the method includes:
acquiring target operation data from a client; wherein the target operation data is: the client encapsulates original operation data of the multi-point touch operation in an operation interface of the target cloud application program according to a preset communication protocol to obtain the original operation data;
decapsulating the target operation data according to the preset communication protocol to obtain the original operation data;
sending the original operation data to a virtual machine so that the virtual machine processes the original operation data through a virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
Optionally, the method further includes:
acquiring original operation data of the target cloud application program from the virtual machine;
packaging the original operation data according to the preset communication protocol to obtain target operation data;
and sending the target operation data to the client so that the client decapsulates the target operation data according to the preset communication protocol to obtain the original operation data, and loading the original operation data.
Optionally, the original operation data includes: a touch type and a touch position of the multi-touch operation.
In a third aspect implemented by the present invention, there is provided a cloud application running method, where the method is applied to a client, and the method includes:
acquiring original operation data of multi-point touch operation in an operation interface of a target cloud application program;
packaging the original operation data according to a preset communication protocol to obtain target operation data;
sending the target operation data to a server to enable the server to decapsulate the target operation data according to the preset communication protocol to obtain original operation data, and sending the original operation data to a virtual machine to enable the virtual machine to process the original operation data through a virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
Optionally, the method further includes:
acquiring target operation data from the server; wherein the target operation data is: the server side encapsulates original operation data of the target cloud application program sent by the virtual machine according to the preset communication protocol to obtain the original operation data;
decapsulating the target operation data according to the preset communication protocol to obtain the original operation data;
and loading the original operation data.
Optionally, the original operation data includes: a touch type and a touch position of the multi-touch operation.
In a fourth aspect of the present invention, there is provided a cloud application running system, where the system includes a client, a server, and a virtual machine, and a target cloud application is run in the virtual machine, where:
the client is used for acquiring original operation data of multi-point touch operation in an operation interface of the target cloud application program; packaging the original operation data according to a preset communication protocol to obtain target operation data; sending the target operation data to the server;
the server is used for de-encapsulating the target operation data according to the preset communication protocol to obtain the original operation data; sending the original operation data to the virtual machine;
the virtual machine is used for processing the original operation data through the virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
In a fifth aspect of the present invention, there is provided a cloud application running apparatus, where the apparatus is applied to a virtual machine, and a target cloud application runs in the virtual machine, the apparatus including:
the original operation data acquisition module is used for acquiring original operation data from the server; wherein the original operation data is: the server-side decapsulates the target operation data sent by the client-side according to a preset communication protocol to obtain the target operation data; the target operation data is as follows: the client encapsulates the original operation data of the multi-point touch operation in the running interface of the target cloud application program according to the preset communication protocol;
the standard operation data acquisition module is used for processing the original operation data through the virtual multi-point touch component to obtain standard operation data which accord with a multi-point touch protocol;
and the response module is used for responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
Optionally, the standard operation data obtaining module is specifically configured to convert the original operation data through a virtual multi-point touch component to obtain virtual operation data matched with the virtual multi-point touch component;
and processing the virtual operation data through the virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol.
Optionally, the apparatus further comprises:
the sending module is used for sending the standard operand to a virtual multi-point touch driver through the virtual multi-point touch component;
a multi-point touch event generating module, configured to generate, through the virtual multi-point touch driver, a touch event corresponding to the standard operation data, as a multi-point touch event, and send the multi-point touch event to an application layer of the virtual machine;
the response module is specifically configured to execute the multi-touch event in the target cloud application through an application layer of the virtual machine to respond to the standard operation data.
Optionally, the apparatus further comprises:
the original operation data acquisition module is used for acquiring the operation data of the target cloud application program as original operation data;
and the original operation data sending module is used for sending the original operation data to the server so that the server encapsulates the original operation data according to the preset communication protocol to obtain target operation data, and sending the target operation data to the client so that the client de-encapsulates the target operation data according to the preset communication protocol to obtain the original operation data and loads the original operation data.
Optionally, the original operation data includes: a touch type and a touch position of the multi-touch operation.
In a sixth aspect of the present invention, there is provided a cloud application running apparatus, where the apparatus is applied to a server, and the apparatus includes:
the target operation data acquisition module is used for acquiring target operation data from the client; wherein the target operation data is: the client encapsulates original operation data of the multi-point touch operation in an operation interface of the target cloud application program according to a preset communication protocol to obtain the original operation data;
the original operation data acquisition module is used for decapsulating the target operation data according to the preset communication protocol to obtain the original operation data;
the original operation data sending module is used for sending the original operation data to a virtual machine so that the virtual machine processes the original operation data through a virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
Optionally, the apparatus further comprises:
the original operation data acquisition module is used for acquiring original operation data of the target cloud application program from the virtual machine;
the target operation data acquisition module is used for packaging the original operation data according to the preset communication protocol to obtain target operation data;
and the target operation data sending module is used for sending the target operation data to the client so that the client unpacks the target operation data according to the preset communication protocol to obtain the original operation data and loads the original operation data.
Optionally, the original operation data includes: a touch type and a touch position of the multi-touch operation.
In a seventh aspect of the present invention, there is provided a cloud application running apparatus, where the apparatus is applied to a client, and the apparatus includes:
the system comprises an original operation data acquisition module, a multi-point touch operation module and a control module, wherein the original operation data acquisition module is used for acquiring original operation data of the multi-point touch operation in an operation interface of a target cloud application program;
the target operation data acquisition module is used for packaging the original operation data according to a preset communication protocol to obtain target operation data;
the target operation data sending module is used for sending the target operation data to a server so that the server decapsulates the target operation data according to the preset communication protocol to obtain original operation data, and sending the original operation data to a virtual machine so that the virtual machine processes the original operation data through a virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
Optionally, the apparatus further comprises:
the target operation data acquisition module is used for acquiring target operation data from the server; wherein the target operation data is: the server side encapsulates original operation data of the target cloud application program sent by the virtual machine according to the preset communication protocol to obtain the original operation data;
the original operation data acquisition module is used for decapsulating the target operation data according to the preset communication protocol to obtain the original operation data;
and the loading module is used for loading the original operation data.
Optionally, the original operation data includes: a touch type and a touch position of the multi-touch operation.
The embodiment of the invention also provides electronic equipment which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing any one of the cloud application program running methods when executing the program stored in the memory.
The embodiment of the invention also provides a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when being executed by a processor, the computer program realizes any one of the cloud application program running methods.
An embodiment of the present invention further provides a computer program product including instructions, which, when running on a computer, causes the computer to execute any of the above cloud application running methods.
The embodiment of the invention has the following beneficial effects:
according to the cloud application program running method provided by the embodiment of the invention, a client acquires original operation data of multi-point touch operation in a running interface of a target cloud application program; packaging the original operation data according to a preset communication protocol to obtain target operation data; and sending the target operation data to the server. The server decapsulates the target operation data according to a preset communication protocol to obtain original operation data; sending original operation data to the virtual machine; the virtual machine processes the original operation data through the virtual multi-point touch component to obtain standard operation data which accord with a multi-point touch protocol; and responding standard operation data in the target cloud application program through the application layer of the virtual machine.
Based on the processing, the standard operation data meeting the multi-point touch protocol can be obtained through the virtual multi-point touch component, and then the standard operation data is responded in the target cloud application program, so that the multi-point touch operation of the user can be responded, and the requirement of the user for using the cloud application program is met.
Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by referring to these drawings.
Fig. 1 is an architecture diagram of a cloud application operating system according to an embodiment of the present invention;
fig. 2 is an interaction diagram of a cloud application running method according to an embodiment of the present invention;
fig. 3 is an interaction diagram of another cloud application operating method according to an embodiment of the present invention;
fig. 4 is an interaction diagram of another cloud application operating method according to an embodiment of the present invention;
fig. 5 is a schematic diagram illustrating operation of a cloud application according to an embodiment of the present invention;
fig. 6 is a structural diagram of a cloud application running apparatus according to an embodiment of the present invention;
fig. 7 is a structural diagram of a cloud application operating apparatus according to an embodiment of the present invention;
fig. 8 is a structural diagram of a cloud application operating apparatus according to an embodiment of the present invention;
fig. 9 is a structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention are within the scope of the present invention.
An embodiment of the present invention provides a cloud application running system, and referring to fig. 1, fig. 1 is an architecture diagram of a cloud application running system provided in an embodiment of the present invention, where the cloud application running system includes a virtual machine 101, a server 102, and a client 103. A target cloud application is running in the virtual machine 101, wherein:
the client 103 is used for acquiring original operation data of multi-point touch operation in an operation interface of the target cloud application program; packaging the original operation data according to a preset communication protocol to obtain target operation data; and sending the target operation data to the server 102.
The server 102 is configured to decapsulate the target operation data according to a preset communication protocol to obtain original operation data; the raw operation data is sent to the virtual machine 101.
The virtual machine 101 is used for processing the original operation data through the virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; the standard operation data is responded to in the target cloud application through the application layer of the virtual machine 101.
According to the cloud application program running system provided by the embodiment of the invention, the standard operation data meeting the multi-point touch protocol can be obtained through the virtual multi-point touch component, and then the standard operation data is responded in the target cloud application program, so that the multi-point touch operation of a user can be responded, and the requirement of the user for using the cloud application program is met.
For other embodiments of the cloud application running system, reference may be made to the following detailed description of method embodiments of a virtual machine, a server, and a client.
Based on the same inventive concept, the embodiment of the invention also provides a cloud application program running method, and the method can be applied to a virtual machine, a server and a client. The virtual machine runs a target cloud application, and the virtual machine, the server and the client may be a virtual machine 101, a server 102 and a client 103 in the cloud application running system, respectively. Referring to fig. 2, the method may include the steps of:
s201: the method comprises the steps that a client side obtains original operation data of multi-point touch operation in an operation interface of a target cloud application program, and the original operation data are packaged according to a preset communication protocol to obtain target operation data.
S202: and the client sends the target operation data to the server.
S203: and the server decapsulates the target operation data according to a preset communication protocol to obtain original operation data.
S204: and the server side sends the original operation data to the virtual machine.
S205: the virtual machine processes the original operation data through the virtual multi-point touch component to obtain standard operation data which accords with a multi-point touch protocol.
S206: and the virtual machine responds to the standard operation data in the target cloud application program through the application layer.
According to the cloud application program running method provided by the embodiment of the invention, the standard operation data meeting the multi-point touch protocol can be obtained through the virtual multi-point touch component, and then the standard operation data is responded in the target cloud application program, so that the multi-point touch operation of a user can be responded, and the requirement of the user for using the cloud application program is met.
For step S201, the target cloud application may be: the cloud application program is indicated in the client by the user to be operated and is actually operated in the virtual machine. For example, the application may be a cloud game application, or may be a cloud graphics application, but is not limited thereto.
The preset Communication protocol may be implemented based on a WebRtc (Web Real-Time Communication) protocol, or a Spice protocol. The WebRtc protocol denotes a communication protocol supporting a real-time voice conversation or video conversation through a web browser. The Spice protocol is an open-source special desktop virtualization data transmission protocol, and is a communication protocol carried by Qemu (analog processor for distributing source codes by GPL (General Public License)). That is, the preset communication protocol provided in the embodiment of the present invention may be obtained by modifying the relevant communication protocol, so that the client can obtain the operation data of the multi-touch operation of the user based on the preset communication protocol and send the operation data to the server. Correspondingly, the server can analyze the data sent by the client according to a preset communication protocol and identify the operation data of the multi-point touch operation.
In one embodiment, the raw operation data includes: touch type and touch position of the multi-touch operation.
The touch type may include: single click, double click, translation, press, scroll, and rotation.
In the embodiment of the invention, the client can display the running interface of the target cloud application program, and when browsing the running interface, a user can execute multi-point touch operation in the running interface, that is, the user executes touch operation at multiple positions in the running interface at the same time. For example, the target cloud application is a cloud game application, and the user may perform a touch operation in the running interface to control the movement of a game character, or control the switching of game scenes, and the like.
Accordingly, the terminal may obtain operation data (i.e., original operation data in the embodiment of the present invention) of the multi-touch operation performed by the user, where the original operation data may represent: the user can touch the touch screen for multiple times, and the coordinates of each touch position, the translation distance, the translation direction, the translation speed, the pressing pressure and the like can be obtained.
The virtual machine in the embodiment of the present invention may include a system part and a virtual component, where the virtual component may include: the device comprises a virtual display card, a virtual sound card, a virtual hard disk and a virtual multi-point touch component. The virtual multi-touch component may be a virtual touch screen, and the virtual touch screen may process the received operation data to obtain data conforming to a multi-touch protocol, so as to identify operation data of the multi-touch operation.
When the virtual machine is implemented based on Qemu, the virtual components of the virtual machine may be referred to as Qemu ports.
In one embodiment, the server and the virtual machine are located in the same host. In one implementation, in the host, the server and the Qemu may exist in the form of processes, respectively.
The virtual multi-touch component is a virtual component supporting Type B, that is, a virtual component capable of tracking and distinguishing touch points. For example, the virtual multi-touch component may be a virtual touch screen capable of tracking and distinguishing electrical shocks.
For step S205, after receiving the original operation data, the virtual multi-touch component may process the original operation data to obtain standard operation data conforming to the multi-touch protocol.
In the embodiment of the present invention, the original operation data acquired by the client includes data of the multi-touch operation of the user, but in the original operation data, the attribute of each piece of data cannot be distinguished, that is, which piece of data represents the distance of the translation, which piece of data represents the speed of the translation, and the like cannot be determined. The relationship between the data and the touch position cannot be determined, that is, the data and the touch position cannot be associated, and the operation data of a plurality of touch positions cannot be distinguished.
Therefore, after the original operation data is obtained, the virtual multi-touch component can process the virtual operation data according to the multi-touch protocol to obtain the standard operation data. That is, the standard operation data may have data associated with the touch position, and the attribute of each piece of data can be identified.
In one embodiment, referring to fig. 3, on the basis of fig. 2, the step S205 may include the following steps:
s2051: and converting the original operation data through the virtual multi-point touch component to obtain virtual operation data matched with the virtual multi-point touch component.
S2052: and processing the virtual operation data through the virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol.
In the embodiment of the present invention, the virtual multi-touch component may convert the original operation data, so that the converted virtual operation data matches the virtual multi-touch component.
For example, the virtual multi-touch component may convert coordinates of a touch position in the original operation data, and convert a distance of translation, a direction of translation, a rate of translation, and a pressure magnitude of pressing according to a resolution of the terminal and a resolution of the virtual multi-touch component.
In one embodiment, referring to fig. 3, before the step S206, the method may further include the steps of:
s207: and sending standard operation data to the virtual multi-point touch driver through the virtual multi-point touch component.
S208: and generating a touch event corresponding to the standard operation data as a multi-point touch event through the virtual multi-point touch drive, and sending the multi-point touch event to an application layer of the virtual machine.
The step S206 may include:
s2061: and executing the multi-touch event in the target cloud application program through the application layer of the virtual machine so as to respond to the standard operation data.
In the embodiment of the present invention, the virtual multi-touch driver may generate a corresponding touch event (i.e., the multi-touch event in the embodiment of the present invention) based on the association relationship between the data and the touch position in the standard operation data and the attribute of the data, and send the corresponding touch event to the application layer of the virtual machine. The multi-touch event can represent a multi-touch operation performed in the client by the user.
Furthermore, through the application layer, the monitored multi-touch event can be executed in the target cloud application program, and the target cloud application program can respond to the multi-touch operation of the user.
In one embodiment, referring to fig. 4, on the basis of fig. 2, the method may further include the steps of:
s209: the virtual machine acquires the operation data of the target cloud application program as original operation data.
S2010: and the virtual machine sends the original operation data to the server.
S2011: and the server encapsulates the original operation data according to a preset communication protocol to obtain target operation data.
S2012: and the server side sends the target operation data to the client side.
S2013: and the client decapsulates the target operation data according to a preset communication protocol to obtain original operation data, and loads the original operation data.
In the embodiment of the invention, in the process that the target cloud application runs in the virtual machine, the virtual machine can acquire the running data (namely, the original running data) of the target cloud application.
The running data may include a video stream of the target cloud application and may also include an audio stream. For example, if the target cloud application is a cloud game application, the content of the corresponding video stream represents a game interface, and the corresponding audio stream represents a game scene sound effect, a game character voice, and the like. The client loads the original operation data, so that the operation interface of the target cloud application program can be displayed, and the audio of the target cloud application program can be played.
In addition, the server side can also encode the original operation data to obtain compressed operation data, and then package the compressed operation data according to a preset communication protocol to obtain target operation data.
Correspondingly, the client can decapsulate the target operation data according to a preset communication protocol to obtain compressed operation data, and decode the compressed operation data to obtain original operation data.
For example, the server may encode a video stream to obtain compressed video data, and encode an audio stream to obtain compressed audio data. The video encoding format may be an H264 encoding format, or may also be an H265 encoding format. The Audio Coding format may be an AAC (Advanced Audio Coding) format, or may be an SBC (Sub-Band Coding) format.
The original operation data are coded, so that the transmission rate of the data can be improved, further, the time delay of loading the original operation data by the client can be reduced, and the requirement of a user on using a cloud application program is met.
Referring to fig. 5, fig. 5 is a schematic view illustrating operation of a cloud application according to an embodiment of the present invention.
The client acquires original operation data of multi-point touch operation in an operation interface of a target cloud application program through the touch data acquisition module, encapsulates the original operation data according to a preset communication protocol to obtain target operation data, and then sends the target operation data to the server.
And the server decapsulates the target operation data according to a preset communication protocol through the input module to obtain original operation data, and sends the original operation data to the virtual machine.
The virtual machine converts the original operation data through the virtual multi-point touch component to obtain virtual operation data matched with the virtual multi-point touch component, processes the virtual operation data to obtain standard operation data conforming to a multi-point touch protocol, and then sends the standard operation data to the virtual multi-point touch driver. The virtual multi-point touch driver generates a multi-point touch event corresponding to the standard operation data, and sends the multi-point touch event to an application layer (not shown) of the virtual machine. Through the application layer, the multi-touch event is executed in the target cloud application program, and the target cloud application program can respond to the multi-touch operation of the user.
Based on the same inventive concept, an embodiment of the present invention further provides a cloud application running apparatus, where the apparatus is applied to a virtual machine, and a target cloud application runs in the virtual machine, with reference to fig. 6, the apparatus includes:
an original operation data obtaining module 601, configured to obtain original operation data from a server; wherein the original operation data is: the server-side decapsulates the target operation data sent by the client-side according to a preset communication protocol to obtain the target operation data; the target operation data is as follows: the client encapsulates the original operation data of the multi-point touch operation in the running interface of the target cloud application program according to the preset communication protocol;
a standard operation data obtaining module 602, configured to process the original operation data through a virtual multi-point touch component, so as to obtain standard operation data meeting a multi-point touch protocol;
a response module 603, configured to respond to the standard operation data in the target cloud application through an application layer of the virtual machine.
Optionally, the standard operation data obtaining module 602 is specifically configured to convert the original operation data through a virtual multi-point touch component to obtain virtual operation data matched with the virtual multi-point touch component;
and processing the virtual operation data through the virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol.
Optionally, the apparatus further comprises:
the sending module is used for sending the standard operand to a virtual multi-point touch driver through the virtual multi-point touch component;
a multi-point touch event generating module, configured to generate, through the virtual multi-point touch driver, a touch event corresponding to the standard operation data, as a multi-point touch event, and send the multi-point touch event to an application layer of the virtual machine;
the response module 603 is specifically configured to execute the multi-touch event in the target cloud application through an application layer of the virtual machine, so as to respond to the standard operation data.
Optionally, the apparatus further comprises:
the original operation data acquisition module is used for acquiring the operation data of the target cloud application program as original operation data;
and the original operation data sending module is used for sending the original operation data to the server so that the server encapsulates the original operation data according to the preset communication protocol to obtain target operation data, and sending the target operation data to the client so that the client de-encapsulates the target operation data according to the preset communication protocol to obtain the original operation data and loads the original operation data.
Optionally, the original operation data includes: a touch type and a touch position of the multi-touch operation.
Based on the same inventive concept, an embodiment of the present invention further provides a cloud application running apparatus, where the apparatus is applied to a server, and referring to fig. 7, the apparatus includes:
a target operation data obtaining module 701, configured to obtain target operation data from a client; wherein the target operation data is: the client encapsulates original operation data of the multi-point touch operation in an operation interface of the target cloud application program according to a preset communication protocol to obtain the original operation data;
an original operation data obtaining module 702, configured to decapsulate the target operation data according to the preset communication protocol to obtain the original operation data;
an original operation data sending module 703, configured to send the original operation data to a virtual machine, so that the virtual machine processes the original operation data through a virtual multi-touch component, to obtain standard operation data that conforms to a multi-touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
Optionally, the apparatus further comprises:
the original operation data acquisition module is used for acquiring original operation data of the target cloud application program from the virtual machine;
the target operation data acquisition module is used for packaging the original operation data according to the preset communication protocol to obtain target operation data;
and the target operation data sending module is used for sending the target operation data to the client so that the client unpacks the target operation data according to the preset communication protocol to obtain the original operation data and loads the original operation data.
Optionally, the original operation data includes: a touch type and a touch position of the multi-touch operation.
Based on the same inventive concept, an embodiment of the present invention further provides a cloud application running apparatus, where the apparatus is applied to a client, and referring to fig. 8, the apparatus includes:
an original operation data obtaining module 801, configured to obtain original operation data of a multi-touch operation in an operation interface of a target cloud application;
a target operation data obtaining module 802, configured to encapsulate the original operation data according to a preset communication protocol to obtain target operation data;
a target operation data sending module 803, configured to send the target operation data to a server, so that the server decapsulates the target operation data according to the preset communication protocol to obtain the original operation data, and sends the original operation data to a virtual machine, so that the virtual machine processes the original operation data through a virtual multi-touch component to obtain standard operation data that conforms to a multi-touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
Optionally, the apparatus further comprises:
the target operation data acquisition module is used for acquiring target operation data from the server; wherein the target operation data is: the server side encapsulates original operation data of the target cloud application program sent by the virtual machine according to the preset communication protocol to obtain the original operation data;
the original operation data acquisition module is used for decapsulating the target operation data according to the preset communication protocol to obtain the original operation data;
and the loading module is used for loading the original operation data.
Optionally, the original operation data includes: a touch type and a touch position of the multi-touch operation.
An embodiment of the present invention further provides an electronic device, as shown in fig. 9, which includes a processor 901, a communication interface 902, a memory 903, and a communication bus 904, where the processor 901, the communication interface 902, and the memory 903 complete mutual communication through the communication bus 904,
a memory 903 for storing computer programs;
the processor 901 is configured to implement the steps of any cloud application running method in the foregoing embodiments when executing the program stored in the memory 903.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In another embodiment provided by the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any of the above cloud application running methods.
In another embodiment, the present invention further provides a computer program product containing instructions, which when executed on a computer, causes the computer to execute any of the cloud application execution methods in the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus, system, electronic device, computer-readable storage medium, and computer program product embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference may be made to some descriptions of the method embodiments for relevant points.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (25)
1. The cloud application program running system is characterized by comprising a client, a server and a virtual machine, wherein a target cloud application program runs in the virtual machine, and the system comprises:
the client is used for acquiring original operation data of multi-point touch operation in an operation interface of the target cloud application program; packaging the original operation data according to a preset communication protocol to obtain target operation data; sending the target operation data to the server;
the server is used for de-encapsulating the target operation data according to the preset communication protocol to obtain the original operation data; sending the original operation data to the virtual machine;
the virtual machine is used for processing the original operation data through the virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
2. A cloud application program running method is applied to a virtual machine, a target cloud application program runs in the virtual machine, and the method comprises the following steps:
acquiring original operation data from a server; wherein the original operation data is: the server-side decapsulates the target operation data sent by the client-side according to a preset communication protocol to obtain the target operation data; the target operation data is as follows: the client encapsulates the original operation data of the multi-point touch operation in the running interface of the target cloud application program according to the preset communication protocol;
processing the original operation data through a virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol;
and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
3. The method of claim 2, wherein the processing the raw operation data by the virtual multi-touch component to obtain standard operation data conforming to a multi-touch protocol comprises:
converting the original operation data through a virtual multi-point touch component to obtain virtual operation data matched with the virtual multi-point touch component;
and processing the virtual operation data through the virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol.
4. The method of claim 2, wherein prior to said responding, by the application layer of the virtual machine, to the standard operational data in the target cloud application, the method further comprises:
sending the standard operation data to a virtual multi-point touch drive through the virtual multi-point touch component;
generating a touch event corresponding to the standard operation data through the virtual multi-point touch drive to serve as a multi-point touch event, and sending the multi-point touch event to an application layer of the virtual machine;
the responding the standard operation data in the target cloud application program through the application layer of the virtual machine comprises:
executing the multi-touch event in the target cloud application program through an application layer of the virtual machine so as to respond to the standard operation data.
5. The method of claim 2, further comprising:
acquiring operation data of the target cloud application program as original operation data;
and sending the original operation data to the server so that the server encapsulates the original operation data according to the preset communication protocol to obtain target operation data, and sending the target operation data to the client so that the client de-encapsulates the target operation data according to the preset communication protocol to obtain the original operation data, and loading the original operation data.
6. The method of claim 2, wherein the raw operation data comprises: a touch type and a touch position of the multi-touch operation.
7. A cloud application program running method is applied to a server side, and comprises the following steps:
acquiring target operation data from a client; wherein the target operation data is: the client encapsulates original operation data of the multi-point touch operation in an operation interface of the target cloud application program according to a preset communication protocol to obtain the original operation data;
decapsulating the target operation data according to the preset communication protocol to obtain the original operation data;
sending the original operation data to a virtual machine so that the virtual machine processes the original operation data through a virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
8. The method of claim 7, further comprising:
acquiring original operation data of the target cloud application program from the virtual machine;
packaging the original operation data according to the preset communication protocol to obtain target operation data;
and sending the target operation data to the client so that the client decapsulates the target operation data according to the preset communication protocol to obtain the original operation data, and loading the original operation data.
9. The method of claim 7, wherein the raw operation data comprises: a touch type and a touch position of the multi-touch operation.
10. A cloud application program running method is applied to a client, and comprises the following steps:
acquiring original operation data of multi-point touch operation in an operation interface of a target cloud application program;
packaging the original operation data according to a preset communication protocol to obtain target operation data;
sending the target operation data to a server to enable the server to decapsulate the target operation data according to the preset communication protocol to obtain original operation data, and sending the original operation data to a virtual machine to enable the virtual machine to process the original operation data through a virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
11. The method of claim 10, further comprising:
acquiring target operation data from the server; wherein the target operation data is: the server side encapsulates original operation data of the target cloud application program sent by the virtual machine according to the preset communication protocol to obtain the original operation data;
decapsulating the target operation data according to the preset communication protocol to obtain the original operation data;
and loading the original operation data.
12. The method of claim 10, wherein the raw operation data comprises: a touch type and a touch position of the multi-touch operation.
13. A cloud application running device is applied to a virtual machine, wherein a target cloud application runs in the virtual machine, and the device comprises:
the original operation data acquisition module is used for acquiring original operation data from the server; wherein the original operation data is: the server-side decapsulates the target operation data sent by the client-side according to a preset communication protocol to obtain the target operation data; the target operation data is as follows: the client encapsulates the original operation data of the multi-point touch operation in the running interface of the target cloud application program according to the preset communication protocol;
the standard operation data acquisition module is used for processing the original operation data through the virtual multi-point touch component to obtain standard operation data which accord with a multi-point touch protocol;
and the response module is used for responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
14. The apparatus according to claim 13, wherein the standard operation data obtaining module is specifically configured to convert the original operation data by using a virtual multi-touch component to obtain virtual operation data matched with the virtual multi-touch component;
and processing the virtual operation data through the virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol.
15. The apparatus of claim 13, further comprising:
the sending module is used for sending the standard operand to a virtual multi-point touch driver through the virtual multi-point touch component;
a multi-point touch event generating module, configured to generate, through the virtual multi-point touch driver, a touch event corresponding to the standard operation data, as a multi-point touch event, and send the multi-point touch event to an application layer of the virtual machine;
the response module is specifically configured to execute the multi-touch event in the target cloud application through an application layer of the virtual machine to respond to the standard operation data.
16. The apparatus of claim 13, further comprising:
the original operation data acquisition module is used for acquiring the operation data of the target cloud application program as original operation data;
and the original operation data sending module is used for sending the original operation data to the server so that the server encapsulates the original operation data according to the preset communication protocol to obtain target operation data, and sending the target operation data to the client so that the client de-encapsulates the target operation data according to the preset communication protocol to obtain the original operation data and loads the original operation data.
17. The apparatus of claim 13, wherein the raw operation data comprises: a touch type and a touch position of the multi-touch operation.
18. The cloud application running device is applied to a server side, and comprises:
the target operation data acquisition module is used for acquiring target operation data from the client; wherein the target operation data is: the client encapsulates original operation data of the multi-point touch operation in an operation interface of the target cloud application program according to a preset communication protocol to obtain the original operation data;
the original operation data acquisition module is used for decapsulating the target operation data according to the preset communication protocol to obtain the original operation data;
the original operation data sending module is used for sending the original operation data to a virtual machine so that the virtual machine processes the original operation data through a virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
19. The apparatus of claim 18, further comprising:
the original operation data acquisition module is used for acquiring original operation data of the target cloud application program from the virtual machine;
the target operation data acquisition module is used for packaging the original operation data according to the preset communication protocol to obtain target operation data;
and the target operation data sending module is used for sending the target operation data to the client so that the client unpacks the target operation data according to the preset communication protocol to obtain the original operation data and loads the original operation data.
20. The apparatus of claim 18, wherein the raw operation data comprises: a touch type and a touch position of the multi-touch operation.
21. A cloud application running device, which is applied to a client, and comprises:
the system comprises an original operation data acquisition module, a multi-point touch operation module and a control module, wherein the original operation data acquisition module is used for acquiring original operation data of the multi-point touch operation in an operation interface of a target cloud application program;
the target operation data acquisition module is used for packaging the original operation data according to a preset communication protocol to obtain target operation data;
the target operation data sending module is used for sending the target operation data to a server so that the server decapsulates the target operation data according to the preset communication protocol to obtain original operation data, and sending the original operation data to a virtual machine so that the virtual machine processes the original operation data through a virtual multi-point touch component to obtain standard operation data conforming to a multi-point touch protocol; and responding the standard operation data in the target cloud application program through the application layer of the virtual machine.
22. The apparatus of claim 21, further comprising:
the target operation data acquisition module is used for acquiring target operation data from the server; wherein the target operation data is: the server side encapsulates original operation data of the target cloud application program sent by the virtual machine according to the preset communication protocol to obtain the original operation data;
the original operation data acquisition module is used for decapsulating the target operation data according to the preset communication protocol to obtain the original operation data;
and the loading module is used for loading the original operation data.
23. The apparatus of claim 21, wherein the raw operation data comprises: a touch type and a touch position of the multi-touch operation.
24. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of claims 2-6, or 7-9, or 10-12 when executing a program stored in a memory.
25. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 2 to 6, or 7 to 9, or 10 to 12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111440815.8A CN114356200A (en) | 2021-11-30 | 2021-11-30 | Cloud application program operation method, system and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111440815.8A CN114356200A (en) | 2021-11-30 | 2021-11-30 | Cloud application program operation method, system and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114356200A true CN114356200A (en) | 2022-04-15 |
Family
ID=81098349
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111440815.8A Pending CN114356200A (en) | 2021-11-30 | 2021-11-30 | Cloud application program operation method, system and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114356200A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| CN109062433A (en) * | 2018-07-23 | 2018-12-21 | 广州视源电子科技股份有限公司 | Method, apparatus, smart machine and the storage medium of touch data processing |
| CN110647375A (en) * | 2019-09-23 | 2020-01-03 | 天津卓朗科技发展有限公司 | Image rendering method and device of cloud desktop and cloud server |
| CN112221127A (en) * | 2020-11-10 | 2021-01-15 | 腾讯科技（深圳）有限公司 | Multi-point control method and device for cloud games |
| CN112685106A (en) * | 2021-01-19 | 2021-04-20 | 北京爱奇艺科技有限公司 | Application program starting method, system, device, electronic equipment and storage medium |
-
2021
- 2021-11-30 CN CN202111440815.8A patent/CN114356200A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| CN109062433A (en) * | 2018-07-23 | 2018-12-21 | 广州视源电子科技股份有限公司 | Method, apparatus, smart machine and the storage medium of touch data processing |
| CN110647375A (en) * | 2019-09-23 | 2020-01-03 | 天津卓朗科技发展有限公司 | Image rendering method and device of cloud desktop and cloud server |
| CN112221127A (en) * | 2020-11-10 | 2021-01-15 | 腾讯科技（深圳）有限公司 | Multi-point control method and device for cloud games |
| CN112685106A (en) * | 2021-01-19 | 2021-04-20 | 北京爱奇艺科技有限公司 | Application program starting method, system, device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210377341A1 (en) | Method and apparatus for execution of applications in a cloud system | |
| CN102647620B (en) | Method, set-top box, cloud terminal application server and system for realizing cloud terminal business | |
| JP6990772B2 (en) | Information push method, storage medium, terminal equipment and server | |
| US20150081764A1 (en) | Remote Virtualization of Mobile Apps | |
| US20210271339A1 (en) | System and method for early media buffering using prediction of user behavior | |
| US20120304062A1 (en) | Referencing content via text captions | |
| KR20050015209A (en) | Apparatus and method for processing multimedia data of home media gateway improving thin client technique | |
| CN110694267A (en) | Cloud game implementation method and device | |
| CN108011951B (en) | Remote assistance method, device and system and electronic equipment | |
| CN114338621A (en) | Cloud application program operation method, system and device | |
| CN112221127B (en) | Multi-point control method and device for cloud game | |
| CN113535063A (en) | Live broadcast page switching method, video page switching method, electronic device and storage medium | |
| WO2024037110A1 (en) | Data processing method and apparatus, device, and medium | |
| CN112911320A (en) | Live broadcast method and device, computer equipment and storage medium | |
| US9392047B1 (en) | Facilitating application compatibility across devices | |
| CN114257841A (en) | Method, device, system, equipment and medium for isolated playback of webpage video | |
| US10834164B2 (en) | Virtualizing audio and video devices using synchronous A/V streaming | |
| CN112843681B (en) | Virtual scene control method and device, electronic equipment and storage medium | |
| US11076198B2 (en) | System and method to generate an interactive video on the fly | |
| CN107862035B (en) | Network reading method and device for conference record, intelligent tablet and storage medium | |
| CN114356200A (en) | Cloud application program operation method, system and device | |
| CN115760494A (en) | Data processing-based service optimization method and device for real estate marketing | |
| WO2022117028A1 (en) | Game livestreaming-based anchor input operation sharing and displaying methods and device | |
| US20220263882A1 (en) | A service worker and the related method | |
| CN113613041A (en) | Page identification method, device and system, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |