CN113893524A - Cloud application processing system, method, device and equipment - Google Patents
Cloud application processing system, method, device and equipment Download PDFInfo
- Publication number
- CN113893524A CN113893524A CN202110893362.8A CN202110893362A CN113893524A CN 113893524 A CN113893524 A CN 113893524A CN 202110893362 A CN202110893362 A CN 202110893362A CN 113893524 A CN113893524 A CN 113893524A
- Authority
- CN
- China
- Prior art keywords
- cloud
- local
- application
- data
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/31—Communication aspects specific to video games, e.g. between several handheld game devices at close range
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
- A63F2300/308—Details of the user interface
Abstract
The application discloses a cloud application processing system, a cloud application processing method, a cloud application processing device, a cloud game processing system and an electronic device. The system comprises a server and a client, wherein the server is used for sending starting indication information of local application related to cloud interactive operation to the client when the cloud interactive operation of the cloud application is triggered; receiving cloud application local interactive operation data sent by a client; executing cloud application interactive processing according to the local interactive operation data; the client is used for starting the local application according to the starting indication information; determining the local interactive operation data through the local application; and sending the local interaction operation data to a server. By adopting the processing mode, the cloud application developer can realize the consistency of the operation experience of the cloud application on the 'end' and the 'cloud' without changing any way, and a user can obtain the original experience when using the cloud application.
Description
Technical Field
The application relates to the technical field of cloud computing, in particular to a cloud application processing system, a cloud application processing method, a cloud application processing device and electronic equipment.
Background
Cloud applications (Cloud Apps) refer to applications in which a terminal interacts with a Cloud, the terminal operates the synchronous Cloud, and occupied local space also retains terminal data through Cloud backup. The cloud application can help a user to reduce equipment cost, and the cross-platform characteristic can help the user to obviously reduce use cost and improve working efficiency, so that the development and innovation of the traditional terminal application to the cloud application are not blocked.
A typical cloud application is a cloud game, in which a game is migrated to a cloud end to be operated, and a mobile terminal (such as a smartphone) of a user plays the game to the cloud end through a real-time audio/video technology. When playing a cloud game, a user expects an experience which is basically indistinguishable from that of playing the game on a mobile terminal, namely, an operation experience which is consistent with that of a terminal and a cloud is achieved.
However, in the process of implementing the present invention, the inventor finds that currently, mainstream cloud games only allow a user to use a cloud input method and log in through a cloud instant messaging APP, which may cause the user to encounter some problems that may affect the functional experience, and the problems are as follows:
1. when the characters need to be input in the process of playing the cloud game, the input method of the cloud server is used, and the operation level brings bad experience to the user;
2. many current cloud games do not support voice communication, and function level causes loss;
3. the device information of the local end is not synchronized to the cloud server, so that the problems of abnormal statistics and dotting of the application side and the like are caused;
4. many current cloud game solutions do not support adaptive resolution and adaptation of a special-shaped screen, and poor experience is brought to users in a visual layer;
5. and the login and payment of the e-commerce platform APP/third party payment APP/instant messaging APP at the local end are not supported.
In summary, the prior art has a problem that a user cannot obtain the same operation experience as that of the user using the terminal application when using the cloud application.
Disclosure of Invention
The application provides a cloud application processing method to solve the problem that in the prior art, a user cannot obtain the same operation experience as the user uses a terminal application when using a cloud application. The present application additionally provides.
The application provides a cloud application processing system, including:
the server is used for sending starting indication information of local application related to cloud interactive operation to the client when the cloud interactive operation of the cloud application is triggered; receiving cloud application local interactive operation data sent by a client; executing cloud application interactive processing according to the local interactive operation data;
the client is used for starting the local application according to the starting indication information; determining the local interactive operation data through the local application; and sending the local interaction operation data to a server.
Optionally, the server is further configured to receive device parameter data sent by the client; determining cloud application rendering data according to the equipment parameter data;
the client is further used for sending the equipment parameter data to the cloud application server.
The application also provides a cloud application processing method, which comprises the following steps:
when the cloud application interactive operation is triggered, sending starting indication information of local application related to the cloud application interactive operation to a client;
receiving cloud application local interactive operation data sent by a client;
and executing cloud application interactive processing according to the local interactive operation data.
Optionally, the executing, according to the local interactive operation data, cloud application interactive processing includes:
writing the local interactive operation data into an input device through an operating system;
and the cloud application acquires the local interactive operation data through the input equipment.
Optionally, the method further includes:
receiving equipment parameter data sent by a client;
and determining cloud application rendering data according to the equipment parameter data.
Optionally, the determining, according to the device parameter data, cloud application rendering data includes:
writing the equipment parameter data into a parameter interface corresponding to an operating system;
and the cloud application acquires the equipment parameter data through the parameter interface.
The application also provides a cloud application processing method, which comprises the following steps:
receiving starting indication information of local application related to cloud application interactive operation and sent by a server;
starting the local application according to the starting indication information;
determining local interactive operation data of the cloud application through the local application;
and sending the local interactive operation data to a server so that the server can execute cloud application interactive processing according to the local interactive operation data.
Optionally, the local application includes: voice collection; the local operation data includes: user voice data;
the local interaction operation data are sent to a server in the following mode:
and sending the real-time voice data stream to the server.
Optionally, the method further includes:
and sending the equipment parameter data to the server side so that the server side can determine the cloud application rendering data according to the equipment parameter data.
The present application further provides a cloud application processing system, including:
the server is used for receiving the equipment parameter data sent by the client; determining cloud application rendering data according to the equipment parameter data;
and the client is used for sending the equipment parameter data to the server.
The present application further provides a cloud game processing system, including:
the server is used for sending starting indication information of local application related to cloud interactive operation to the client when the cloud interactive operation of the cloud game is triggered; receiving cloud game local interaction operation data sent by a client; executing cloud game interaction processing according to the local interaction operation data;
the client is used for starting the local application according to the starting indication information; determining the local interactive operation data through the local application; and sending the local interaction operation data to a server.
The present application further provides an electronic device, comprising:
a processor; and
a memory for storing a program for implementing the above method, the device being powered on and the program for the method being run by the processor.
The present application also provides a computer-readable storage medium having stored therein instructions, which when run on a computer, cause the computer to perform the various methods described above.
The present application also provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the various methods described above.
Compared with the prior art, the method has the following advantages:
according to the cloud application processing system provided by the embodiment of the application, a user can use local applications (such as an input method, a microphone, an e-commerce application, a third-party payment application, an instant messaging application and the like) of a terminal to perform interactive operation with a target cloud application, for example, the user uses the terminal input method to input information in a cloud application interface, uses the terminal microphone to collect voice data required by the target cloud application, uses the local e-commerce application/the third-party payment application/the instant messaging application of the terminal to log in, so that payment can be performed for the use of the cloud application, and the like. By adopting the processing mode, the cloud application developer can realize the consistency of the operation experience of the cloud application on the 'end' and the 'cloud' without changing any way, and a user can obtain the original experience when using the cloud application.
The cloud application processing system provided by the embodiment of the application synchronizes the system parameters of the terminal to the cloud server, so that the cloud application can adapt to the special-shaped screen and the resolution of the user terminal to use the cloud application, and the like. By adopting the processing mode, the cloud application developer can realize the consistency of the operation experience of the cloud application on the 'end' and the 'cloud' without changing any way, and a user can obtain the original experience when using the cloud application.
Drawings
FIG. 1 is a schematic diagram of a cloud application processing system provided herein;
FIG. 2 is a schematic diagram of a cloud application processing system provided herein;
FIG. 3 is a device interaction diagram of a cloud application processing system provided herein;
fig. 4 is a schematic diagram of a specific device interaction of the cloud application processing system provided in the present application.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.
In the application, a cloud application processing system, a cloud game processing system, an electronic device, a cloud application processing method and a cloud application processing device are provided. Each of the schemes is described in detail in the following examples.
First embodiment
Please refer to fig. 1, which is a schematic structural diagram of a cloud application processing system according to an embodiment of the present application. The system may include: a server 1 and a client 2.
The cloud application refers to application of interaction between terminal equipment and a service (cloud) end, the terminal operates a synchronous cloud end, and occupied local space also reserves terminal data through cloud end backup. The cloud applications, including but not limited to: the cloud game can also be other common cloud applications.
The server 1 may be a public cloud server, and provides cloud application services for a plurality of terminal devices. The server may also be a private cloud server, and is dedicated to providing cloud application services for terminal devices in a certain range (such as communities, units, and the like). The client 2 includes, but is not limited to, a smart phone, and also includes terminal devices such as a personal computer, a PAD, and an iPad.
Please refer to fig. 2, which is a schematic view illustrating a scenario of an embodiment of a cloud application processing system provided in the present application. In this embodiment, the server and the client may be connected through a network, for example, the client may be networked through WIFI or the like. The user can use the cloud application service provided by the server through the client to watch the cloud application interface provided by the server. Taking the example of playing the cloud game through the tablet computer, when the user plays the cloud game and triggers the cloud interaction operation of the cloud game, if game interaction information needs to be input, if an input method of pulling up the cloud end in the prior art is adopted, the input soft keyboard displayed by the tablet computer is an input keyboard of a cloud end type which is not familiar and suitable for the user, and an input interface of the cloud game is not friendly to the user and is not convenient for the user to use. If the system provided by the embodiment of the application is adopted, the server side sends the indication information for starting the terminal input method to the tablet computer, the tablet computer pulls up the local input method, the user sees a very familiar keyboard appearance of the tablet computer, the user is more adaptive to the input mode, the original experience is obtained, and the consistency of the operation experience of the cloud game at the 'end' and the 'cloud' is realized.
Please refer to fig. 3, which is a schematic diagram of device interaction of an embodiment of a cloud application processing system provided in the present application. In this embodiment, the server is configured to send, to the client, start instruction information for a local application related to a cloud-end interaction operation when the cloud-end interaction operation of the cloud application is triggered; receiving cloud application local interactive operation data sent by a client; executing cloud application interactive processing according to the local interactive operation data; correspondingly, the client is used for starting the local application according to the starting indication information; determining the local interactive operation data through the local application; and sending the local interaction operation data to a server.
The following describes a specific embodiment of the cloud application processing system provided in the present application, taking a cloud game as an example. When a user uses the cloud game, the cloud interactive operation of the cloud game can be triggered by clicking an interactive button on the cloud game interface, and if the user clicks an input button, the cloud game interface can display an input soft keyboard. The server side can monitor click events of the 'input' button, and when the event is captured to occur, starting indication information of a client side local input method application related to cloud game input operation is sent to the client side.
The start indication information of the local application can be transmitted between the server and the client in the form of data packets. The content of the data packet is the starting indication information of the local application, if the indication information for starting the local input method is { cmd: "keyboard" }, the indication information for starting the local microphone is { cmd: "voice" }. The data packet can be sent from the server side to the client side through a pre-constructed data channel.
After a user starts the cloud game client, the client is connected with the cloud game server, and a data channel between the two devices is created at the moment. The data channel can be a long connection established based on TCP/UDP. In specific implementation, other modes can be adopted to construct a data channel, such as real-time audio and video modes like WebRTC.
In this embodiment, the server is specifically configured to create a long connection data channel corresponding to the cloud application client based on a transmission control protocol TCP. By adopting the processing mode, the data packet loss can be effectively prevented. During specific implementation, a data channel can be created based on UDP, UDP belongs to unreliable transmission, and the phenomenon of data packet loss can be found by combining with data packet sequence number inspection.
And after receiving the data packet, the client can analyze the data packet and obtain the starting indication information of the local application from the data packet. Then, the local application can be started according to the starting indication information. In specific implementation, a local application module can be built in an operating system of the terminal device, and the local application can be started by executing a wakeup instruction of the local application.
Taking the local input method of the client as an example, after the client starts the local input method, the appearance of the local keyboard is displayed in the display picture of the cloud game. And inputting information interacted with the cloud game by a user through a familiar local keyboard, wherein the input content is the local interaction operation data. And the client sends the local interactive operation data to the server.
And after receiving the local interactive operation data, the server executes cloud application interactive processing according to the local interactive operation data. In this embodiment, the local interactive operation data may be written into an input device of the cloud application server through the server operating system; and the cloud application acquires the local interactive operation data through the input equipment. By adopting the bottom-layer keyboard event response processing mode of the operating system, a user cannot perceive data transmission processing between devices, and the consistency of cloud application operation experience in the 'end' and 'cloud' can be further improved.
In one example, the local interactive operation data is content input by a user through a client local input method, and the server can write input content obtained by the client local input method into an input method of the server; and the cloud application acquires the local interaction operation data through a cloud input method and carries out subsequent processing.
In another example, the local interactive operation data is payment data obtained by a user through payment by logging in a client local third-party payment application, and the server can write the client local payment data into a third-party payment device of the server; and the cloud application acquires the local payment data through the cloud third-party payment device and processes the local payment data after payment.
In another example, the local interactive operation data is user voice data collected by a user through a client local microphone, and the server can write the user voice data collected by the client local microphone into a voice collecting device of the server; and the cloud application acquires the user voice data through a cloud voice acquisition device and carries out subsequent voice processing.
In consideration of the fact that the voice data volume collected in practical application is large, when the local interactive operation data with large data volume is transmitted from the client to the server, the obtained local interactive operation data stream can be sent to the server in real time, and the voice data stream can be sent in real time. In this way, cloud application processing latency can be effectively reduced, e.g., less than 100 milliseconds. In this embodiment, the client turns on the local microphone and records while speaking, and the real-time voice data stream is sent once in about 10-20 ms.
Please refer to fig. 4, which is a schematic diagram illustrating a specific device interaction of an embodiment of a cloud application processing system provided in the present application. In one example, upon launching the cloud application client, the client is further operable to send the device parameter data to the server; correspondingly, the server is further used for determining cloud application rendering data according to the device parameter data of the client. The device parameter data includes, but is not limited to: device identification information (such as a device number), shaped screen information (such as a square screen or a circular screen), and resolution information.
As shown in fig. 2, the client is a special-shaped screen, and if the prior art is adopted, the cloud game interface is not adapted to the special-shaped screen, and a black edge is left on the left side of the screen. If the system provided by the embodiment of the application is adopted, the cloud game client can send the equipment parameter data to the server when being started, at the moment, the cloud game interface displayed by the cloud game client is matched with the display effect of the special-shaped screen, a user obtains the natural experience, and the consistency of the operation experience of the cloud game at the 'end' and the 'cloud' is realized.
During specific implementation, the server side can write the received equipment parameter data into a parameter interface corresponding to the server side operating system; the cloud application running at the server side acquires the equipment parameter data through the parameter interface, and the cloud application can determine cloud application rendering data according to the equipment parameter data.
As an optimized implementation manner, the cloud application processing system provided in the embodiment of the present application can also synchronize system parameters of the terminal to the cloud server, so that the cloud application can adapt to the resolution of the special-shaped screen and the user terminal to use the cloud application, and the like. By adopting the processing mode, the cloud application developer can realize the consistency of the operation experience of the cloud application on the 'end' and the 'cloud' without changing any way, and a user can obtain the original experience when using the cloud application.
In this embodiment, a user starts a cloud game client installed on a smartphone of the user, the cloud game client is connected to a cloud game server when the cloud game client is started, and the server creates a data channel between two devices. The client and the server can realize the consistency of the operation experience of the cloud game at the equipment end and the cloud end through the cloud application processing devices respectively arranged at the two ends. The cloud application processing device can comprise two parts of mobile phone end local component synchronization and mobile phone end system parameter synchronization. The local components of the mobile phone end can pull up the local application synchronously, a user can perform cloud game interaction operation through the local application, and the mobile phone end obtains local interaction operation data and sends the local interaction operation data to the server. For example, a local input method of a mobile phone is pulled up, a user inputs characters, and the characters are synchronized to the cloud through a data channel; the local microphone of the mobile phone is pulled up, the user inputs voice, and the voice data is synchronized to the cloud end through the data channel; the synchronous login state of the local three-way login of the mobile phone is pulled up, the user finishes the login, and the login state is synchronized to the cloud through a data channel; and pulling up other local components (namely applications) of the mobile phone, executing the operation by the user through the local applications, and synchronizing local operation data to the cloud end through the data channel. The system parameters of the mobile phone end are synchronous, and the device parameter data (such as special-shaped screen parameters, resolution parameters and the like) can be sent to the server end through the data channel. The cloud game server initializes relevant system parameters of the cloud system layer according to the local device parameter data, reads the system parameters when the cloud game is started, and completes adaptation processing with the client device. For example, the cloud game starts to read the special-shaped screen parameters to complete the special-shaped screen adaptation; the game starts to read the resolution parameter, and the resolution adaptation is completed.
As can be seen from the foregoing embodiments, in the cloud application processing system provided in the embodiments of the present application, a user may perform an interactive operation with a target cloud application by using a local application of a terminal (e.g., an input method, a microphone, an e-commerce application, a third-party payment application, an instant messaging application, etc.), for example, the user inputs information in a cloud application interface by using the terminal input method, collects voice data required by the target cloud application by using the terminal microphone, logs in by using the local e-commerce application/third-party payment application/instant messaging application of the terminal, so as to pay for using the cloud application, and so on. By adopting the processing mode, the cloud application developer can realize the consistency of the operation experience of the cloud application on the 'end' and the 'cloud' without changing any way, and a user can obtain the original experience when using the cloud application.
Second embodiment
In the foregoing embodiment, a cloud application processing system is provided, and correspondingly, the present application also provides a cloud application processing method. The method corresponds to the embodiment of the system described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
The execution subject of the cloud application processing method includes, but is not limited to, a server, and may also be any device capable of implementing the method. The cloud applications, including but not limited to: the cloud game can also be other common cloud applications. The following describes a specific implementation of the method provided by the present application, taking a cloud game as an example.
In this embodiment, the method may include the steps of:
step 1: when the cloud application interactive operation is triggered, sending starting indication information of local application related to the cloud application interactive operation to the client.
When a user uses the cloud game, the cloud interactive operation of the cloud game can be triggered by clicking an interactive button on the cloud game interface, and if the user clicks an input button, the cloud game interface can display an input soft keyboard. The server side can monitor click events of the 'input' button, and when the event is captured to occur, starting indication information of a client side local input method application related to cloud game input operation is sent to the client side.
The start indication information of the local application can be transmitted between the server and the client in the form of data packets. The content of the data packet is the starting indication information of the local application, if the indication information for starting the local input method is { cmd: "keyboard" }, the indication information for starting the local microphone is { cmd: "voice" }. The data packet can be sent from the server side to the client side through a pre-constructed data channel.
Step 2: and receiving cloud application local interactive operation data sent by the client.
Taking the local input method of the client as an example, after the client starts the local input method, the appearance of the local keyboard is displayed in the display picture of the cloud game. And inputting information interacted with the cloud game by a user through a familiar local keyboard, wherein the input content is the local interaction operation data. And the client sends the local interactive operation data to the server.
And step 3: and executing cloud application interactive processing according to the local interactive operation data.
In one example, step 3 may include the following sub-steps: writing the local interactive operation data into input equipment of a server through an operating system of the server; and the cloud application acquires the local interactive operation data through the input equipment. By adopting the bottom-layer keyboard event response processing mode of the operating system, a user cannot perceive data transmission processing between devices, and the consistency of cloud application operation experience in the 'end' and 'cloud' can be further improved.
In one example, the local interactive operation data is content input by a user through a client local input method, and the server can write input content obtained by the client local input method into an input method of the server; and the cloud application acquires the local interaction operation data through a cloud input method and carries out subsequent processing.
In another example, the local interactive operation data is payment data obtained by a user through payment by logging in a client local third-party payment application, and the server can write the client local payment data into a third-party payment device of the server; and the cloud application acquires the local payment data through the cloud third-party payment device and processes the local payment data after payment.
In another example, the local interactive operation data is user voice data collected by a user through a client local microphone, and the server can write the user voice data collected by the client local microphone into a voice collecting device of the server; and the cloud application acquires the user voice data through a cloud voice acquisition device and carries out subsequent voice processing.
In one example, the method may further comprise the steps of: receiving equipment parameter data sent by a client; and determining cloud application rendering data according to the equipment parameter data. In this way, the cloud application can adapt the resolution of the shaped screen and the user terminal to use the cloud application, and so on.
The device parameter data includes, but is not limited to: device identification information (such as a device number), shaped screen information (such as a square screen or a circular screen), and resolution information.
In a specific implementation, the determining cloud application rendering data according to the device parameter data may include the following sub-steps: writing the equipment parameter data into a parameter interface corresponding to an operating system; and the cloud application acquires the equipment parameter data through the parameter interface.
Third embodiment
In the foregoing embodiment, a cloud application processing method is provided, and correspondingly, the present application also provides a cloud application processing apparatus. The apparatus corresponds to an embodiment of the method described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
The application provides a cloud application processing apparatus includes:
the indication information sending unit is used for sending starting indication information of local application related to the cloud application interactive operation to the client when the cloud application interactive operation is triggered;
the local data receiving unit is used for receiving cloud application local interactive operation data sent by the client;
and the interactive processing unit is used for executing the cloud application interactive processing according to the local interactive operation data.
In one example, the interactive processing unit may include the following sub-units:
the writing subunit is used for writing the local interactive operation data into the input equipment through an operating system;
and the acquisition subunit is used for acquiring the local interaction operation data through the input equipment by the cloud application.
In one example, the apparatus may further include:
the device parameter receiving unit is used for receiving device parameter data sent by the client;
and the rendering unit is used for determining cloud application rendering data according to the equipment parameter data.
In one example, the rendering unit may include the following sub-units:
the writing subunit is used for writing the device parameter data into a parameter interface corresponding to an operating system;
and the acquisition subunit is used for acquiring the equipment parameter data through the parameter interface by the cloud application.
Fourth embodiment
In the foregoing embodiment, a cloud application processing system is provided, and correspondingly, the present application also provides a cloud application processing method. The method corresponds to the embodiment of the system described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
The execution subject of the cloud application processing method includes, but is not limited to, a client, and may be any device capable of implementing the method. In this embodiment, the method may include the steps of:
step 1: and receiving starting indication information of the local application related to the cloud application interactive operation, which is sent by the server.
The start indication information of the local application can be transmitted between the server and the client in the form of data packets. The content of the data packet is the starting indication information of the local application, if the indication information for starting the local input method is { cmd: "keyboard" }, the indication information for starting the local microphone is { cmd: "voice" }. The data packet can be sent from the server side to the client side through a pre-constructed data channel. And after receiving the data packet, the client can analyze the data packet and obtain the starting indication information of the local application from the data packet.
Step 2: and starting the local application according to the starting indication information.
In specific implementation, a local application module can be built in an operating system of the terminal device, and the local application can be started by executing a wakeup instruction of the local application.
And step 3: and determining local interactive operation data of the cloud application through the local application.
Taking the local input method of the client as an example, after the client starts the local input method, the appearance of the local keyboard is displayed in the display picture of the cloud game. And inputting information interacted with the cloud game by a user through a familiar local keyboard, wherein the input content is the local interaction operation data. And the client sends the local interactive operation data to the server.
And 4, step 4: and sending the local interactive operation data to a server so that the server can execute cloud application interactive processing according to the local interactive operation data.
In one example, the native application includes: voice collection; the local operation data includes: user voice data; the local interaction operation data are sent to a server, and the following method can be adopted: and sending the real-time voice data stream to the server.
In one example, the method may further comprise the steps of: and sending the equipment parameter data to the server side so that the server side can determine the cloud application rendering data according to the equipment parameter data.
Fifth embodiment
In the foregoing embodiment, a cloud application processing method is provided, and correspondingly, the present application also provides a cloud application processing apparatus. The apparatus corresponds to an embodiment of the method described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
The application provides a cloud application processing apparatus includes:
the indication information receiving unit is used for receiving starting indication information of local application related to cloud application interactive operation and sent by a server;
the local application starting unit is used for starting the local application according to the starting indication information;
the local interaction unit is used for determining cloud application local interaction operation data through the local application;
and the local data sending unit is used for sending the local interaction operation data to a server so that the server can execute cloud application interaction processing according to the local interaction operation data.
In one example, the native application includes: voice collection; the local operation data includes: user voice data; the local data sending unit is specifically configured to send a real-time voice data stream to the server.
In one example, the apparatus may further include:
and the device parameter sending unit is used for sending the device parameter data to the server so that the server can determine the cloud application rendering data according to the device parameter data.
Sixth embodiment
The application also provides an electronic device. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An electronic device of the present embodiment includes: a processor and a memory; and the memory is used for storing a program for realizing the cloud application processing method, and the device is powered on and runs the program of the method through the processor.
Seventh embodiment
In the foregoing embodiment, a cloud application processing system is provided, and correspondingly, the present application also provides a cloud application processing system. The method corresponds to the embodiment of the system described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
The cloud application processing system of the present application may include: a server and a client. The client is used for sending the equipment parameter data to the server; correspondingly, the server is used for receiving the device parameter data sent by the client and determining cloud application rendering data according to the device parameter data.
The cloud application processing system provided by the embodiment of the application synchronizes the system parameters of the terminal to the cloud server, so that the cloud application can adapt to the special-shaped screen and the resolution of the user terminal to use the cloud application, and the like. By adopting the processing mode, the cloud application developer can realize the consistency of the operation experience of the cloud application on the 'end' and the 'cloud' without changing any way, and a user can obtain the original experience when using the cloud application.
Eighth embodiment
In the foregoing embodiment, a cloud application processing system is provided, and accordingly, the present application also provides a cloud game processing system. The method corresponds to the embodiment of the system described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
The cloud game processing system of the present application may include: a server and a client.
The server is used for sending starting indication information of local application related to cloud interactive operation to the client when the cloud interactive operation of the cloud game is triggered; receiving cloud game local interaction operation data sent by a client; executing cloud game interaction processing according to the local interaction operation data; the client is used for starting the local application according to the starting indication information; determining the local interactive operation data through the local application; and sending the local interaction operation data to a server.
According to the cloud game processing system provided by the embodiment of the application, a user can use local applications (such as an input method, a microphone, an e-commerce application, a third-party payment application, an instant messaging application and the like) of a terminal to perform interactive operation with a cloud game, for example, the user uses the terminal input method to input information in a cloud game interface, uses the terminal microphone to collect voice data required by the cloud game, uses the e-commerce application/the third-party payment application/the instant messaging application of the terminal to log in so as to pay for using the cloud game, and the like. By adopting the processing mode, cloud game developers can realize the consistency of the operation experience of the cloud game at the 'end' and the 'cloud', and users can obtain the original experience when using the cloud game, without changing.
Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
1. Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.
2. As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Claims (12)
1. A cloud application processing system, comprising:
the server is used for sending starting indication information of local application related to cloud interactive operation to the client when the cloud interactive operation of the cloud application is triggered; receiving cloud application local interactive operation data sent by a client; executing cloud application interactive processing according to the local interactive operation data;
the client is used for starting the local application according to the starting indication information; determining the local interactive operation data through the local application; and sending the local interaction operation data to a server.
2. The system of claim 1,
the server is also used for receiving the equipment parameter data sent by the client; determining cloud application rendering data according to the equipment parameter data;
the client is further used for sending the equipment parameter data to the cloud application server.
3. A cloud application processing method is characterized by comprising the following steps:
when the cloud application interactive operation is triggered, sending starting indication information of local application related to the cloud application interactive operation to a client;
receiving cloud application local interactive operation data sent by a client;
and executing cloud application interactive processing according to the local interactive operation data.
4. The method of claim 3,
the executing cloud application interactive processing according to the local interactive operation data comprises:
writing the local interactive operation data into an input device through an operating system;
and the cloud application acquires the local interactive operation data through the input equipment.
5. The method of claim 3, further comprising:
receiving equipment parameter data sent by a client;
and determining cloud application rendering data according to the equipment parameter data.
6. The method of claim 5,
determining cloud application rendering data according to the device parameter data, comprising:
writing the equipment parameter data into a parameter interface corresponding to an operating system;
and the cloud application acquires the equipment parameter data through the parameter interface.
7. A cloud application processing method is characterized by comprising the following steps:
receiving starting indication information of local application related to cloud application interactive operation and sent by a server;
starting the local application according to the starting indication information;
determining local interactive operation data of the cloud application through the local application;
and sending the local interactive operation data to a server so that the server can execute cloud application interactive processing according to the local interactive operation data.
8. The method of claim 7,
the native application comprises: voice collection; the local operation data includes: user voice data;
the local interaction operation data are sent to a server in the following mode:
and sending the real-time voice data stream to the server.
9. The method of claim 7, further comprising:
and sending the equipment parameter data to the server side so that the server side can determine the cloud application rendering data according to the equipment parameter data.
10. A cloud application processing system, comprising:
the server is used for receiving the equipment parameter data sent by the client; determining cloud application rendering data according to the equipment parameter data;
and the client is used for sending the equipment parameter data to the server.
11. A cloud gaming processing system, comprising:
the server is used for sending starting indication information of local application related to cloud interactive operation to the client when the cloud interactive operation of the cloud game is triggered; receiving cloud game local interaction operation data sent by a client; executing cloud game interaction processing according to the local interaction operation data;
the client is used for starting the local application according to the starting indication information; determining the local interactive operation data through the local application; and sending the local interaction operation data to a server.
12. An electronic device, comprising:
a processor; and
a memory for storing a program implementing the method according to any one of claims 3 to 9, the device being powered on and the program of the method being run by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110893362.8A CN113893524B (en) | 2021-08-04 | 2021-08-04 | Cloud application processing system, method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110893362.8A CN113893524B (en) | 2021-08-04 | 2021-08-04 | Cloud application processing system, method, device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113893524A true CN113893524A (en) | 2022-01-07 |
| CN113893524B CN113893524B (en) | 2022-09-20 |
Family
ID=79187736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110893362.8A Active CN113893524B (en) | 2021-08-04 | 2021-08-04 | Cloud application processing system, method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113893524B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114844871A (en) * | 2022-03-25 | 2022-08-02 | 阿里巴巴（中国）有限公司 | Cloud application access method and device |
| CN114895824A (en) * | 2022-05-12 | 2022-08-12 | 阿里巴巴（中国）有限公司 | Application window processing method, terminal device, server and storage medium |
| CN114979114A (en) * | 2022-03-29 | 2022-08-30 | 阿里巴巴（中国）有限公司 | Cloud application processing method and system |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103106680A (en) * | 2013-02-16 | 2013-05-15 | 赞奇科技发展有限公司 | Implementation method for three-dimensional figure render based on cloud computing framework and cloud service system |
| CN104796767A (en) * | 2015-03-31 | 2015-07-22 | 北京奇艺世纪科技有限公司 | Method and system for editing cloud video |
| US20180041557A1 (en) * | 2015-04-07 | 2018-02-08 | Intel Corporation | Cloud computing for mobile client devices |
| CN110368686A (en) * | 2019-07-03 | 2019-10-25 | 上海闻泰信息技术有限公司 | Cloud game implementation method, device, cloud server, terminal and medium |
| CN111544886A (en) * | 2020-04-30 | 2020-08-18 | 腾讯科技（深圳）有限公司 | Picture display method and related device |
| CN111770052A (en) * | 2020-05-21 | 2020-10-13 | 中清龙图计算机科技(上海)有限公司 | Cloud game payment method, device, equipment and medium |
| CN112055072A (en) * | 2020-08-31 | 2020-12-08 | 北京爱奇艺科技有限公司 | Cloud audio input method and device, cloud system, electronic equipment and storage medium |
| CN112206513A (en) * | 2020-09-17 | 2021-01-12 | 江苏视博云信息技术有限公司 | Control method, information interaction method, device and system of cloud game |
| CN112316424A (en) * | 2021-01-06 | 2021-02-05 | 腾讯科技（深圳）有限公司 | Game data processing method, device and storage medium |
| CN112383539A (en) * | 2020-11-11 | 2021-02-19 | 视若飞信息科技(上海)有限公司 | Method and device for calling cloud browser based on remote process and electronic equipment |
| CN112667093A (en) * | 2020-12-31 | 2021-04-16 | 江苏视博云信息技术有限公司 | Character input method and device for cloud application and computer equipment |
| CN112685106A (en) * | 2021-01-19 | 2021-04-20 | 北京爱奇艺科技有限公司 | Application program starting method, system, device, electronic equipment and storage medium |
| CN112807678A (en) * | 2021-02-23 | 2021-05-18 | 北京字节跳动网络技术有限公司 | Cloud game implementation method, device, system, equipment and medium |
-
2021
- 2021-08-04 CN CN202110893362.8A patent/CN113893524B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103106680A (en) * | 2013-02-16 | 2013-05-15 | 赞奇科技发展有限公司 | Implementation method for three-dimensional figure render based on cloud computing framework and cloud service system |
| CN104796767A (en) * | 2015-03-31 | 2015-07-22 | 北京奇艺世纪科技有限公司 | Method and system for editing cloud video |
| US20180041557A1 (en) * | 2015-04-07 | 2018-02-08 | Intel Corporation | Cloud computing for mobile client devices |
| CN110368686A (en) * | 2019-07-03 | 2019-10-25 | 上海闻泰信息技术有限公司 | Cloud game implementation method, device, cloud server, terminal and medium |
| CN111544886A (en) * | 2020-04-30 | 2020-08-18 | 腾讯科技（深圳）有限公司 | Picture display method and related device |
| CN111770052A (en) * | 2020-05-21 | 2020-10-13 | 中清龙图计算机科技(上海)有限公司 | Cloud game payment method, device, equipment and medium |
| CN112055072A (en) * | 2020-08-31 | 2020-12-08 | 北京爱奇艺科技有限公司 | Cloud audio input method and device, cloud system, electronic equipment and storage medium |
| CN112206513A (en) * | 2020-09-17 | 2021-01-12 | 江苏视博云信息技术有限公司 | Control method, information interaction method, device and system of cloud game |
| CN112383539A (en) * | 2020-11-11 | 2021-02-19 | 视若飞信息科技(上海)有限公司 | Method and device for calling cloud browser based on remote process and electronic equipment |
| CN112667093A (en) * | 2020-12-31 | 2021-04-16 | 江苏视博云信息技术有限公司 | Character input method and device for cloud application and computer equipment |
| CN112316424A (en) * | 2021-01-06 | 2021-02-05 | 腾讯科技（深圳）有限公司 | Game data processing method, device and storage medium |
| CN112685106A (en) * | 2021-01-19 | 2021-04-20 | 北京爱奇艺科技有限公司 | Application program starting method, system, device, electronic equipment and storage medium |
| CN112807678A (en) * | 2021-02-23 | 2021-05-18 | 北京字节跳动网络技术有限公司 | Cloud game implementation method, device, system, equipment and medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114844871A (en) * | 2022-03-25 | 2022-08-02 | 阿里巴巴（中国）有限公司 | Cloud application access method and device |
| CN114844871B (en) * | 2022-03-25 | 2024-03-26 | 阿里巴巴（中国）有限公司 | Cloud application access method and device |
| CN114979114A (en) * | 2022-03-29 | 2022-08-30 | 阿里巴巴（中国）有限公司 | Cloud application processing method and system |
| CN114979114B (en) * | 2022-03-29 | 2023-12-08 | 阿里巴巴（中国）有限公司 | Cloud application processing method and system |
| CN114895824A (en) * | 2022-05-12 | 2022-08-12 | 阿里巴巴（中国）有限公司 | Application window processing method, terminal device, server and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113893524B (en) | 2022-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113893524B (en) | Cloud application processing system, method, device and equipment | |
| TWI732240B (en) | Video file generation method, device, and storage medium | |
| CN111433743B (en) | APP remote control method and related equipment | |
| WO2021073368A1 (en) | Video file generating method and device, terminal, and storage medium | |
| WO2022135005A1 (en) | Call-based screen sharing method, apparatus, device, and storage medium | |
| CN111629253A (en) | Video processing method and device, computer readable storage medium and electronic equipment | |
| US20150106730A1 (en) | Framework for screen content sharing system with generalized screen descriptions | |
| CN112843676B (en) | Data processing method, device, terminal, server and storage medium | |
| CN111901695B (en) | Video content interception method, device and equipment and computer storage medium | |
| CN109240833A (en) | Resource allocation method, device, terminal and storage medium | |
| CN113784049B (en) | Camera calling method of android system virtual machine, electronic equipment and storage medium | |
| CN112073754A (en) | Cloud game screen projection method and device, computer equipment, computer readable storage medium and cloud game screen projection interaction system | |
| US20230079785A1 (en) | Video clipping method and apparatus, computer device, and storage medium | |
| EP3754998B1 (en) | Streaming media quality monitoring method and system | |
| CN111818383A (en) | Video data generation method, system, device, electronic equipment and storage medium | |
| CN109302636A (en) | The method and device of data object panorama sketch information is provided | |
| CN113050904A (en) | Screen sharing method and device | |
| WO2024001802A1 (en) | Image processing method and apparatus, and electronic device and storage medium | |
| CN114245036B (en) | Video production method and device | |
| JP2022166203A (en) | Audio data processing method, device, electronics, and computer readable storage medium | |
| CN113836424A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN112804551A (en) | Live broadcast method and device, computer equipment and storage medium | |
| CN112861612A (en) | Method and device for shooting image, electronic equipment and storage medium | |
| CN114827742B (en) | Live interaction method, live interaction device, computer equipment and computer readable medium | |
| CN112433697A (en) | Resource display method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |