CN113556568A

CN113556568A - Cloud application program operation method, system, device and storage medium

Info

Publication number: CN113556568A
Application number: CN202110827371.7A
Authority: CN
Inventors: 周志伟
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2021-07-21
Filing date: 2021-07-21
Publication date: 2021-10-26
Anticipated expiration: 2041-07-21
Also published as: CN113556568B

Abstract

The embodiment of the invention provides a cloud application program running method, a cloud application program running system, a cloud application program running device and a storage medium, and relates to the technical field of cloud; the standby video realizes playing control based on user operation; the cloud server receives the target video stream from the cloud equipment and sends the target video to the client, and then the client can receive the target video stream from the cloud server and play the target video stream. Therefore, the user can interact with the displayed standby video in the process of waiting for the start of the cloud application program, the waiting process of the user is more interesting and interactive, the user is prevented from quitting due to long-time waiting, the stickiness of the user is increased, and further, the development of cloud application is facilitated.

Description

Cloud application program operation method, system, device and storage medium

Technical Field

The invention relates to the technical field of cloud, in particular to a cloud application program running method, system, device and storage medium.

Background

With the rapid development of network technologies, in order to reduce the requirements for client configuration, a game service may be provided to a user based on the architecture of a client and a cloud device.

For example, a user may select to launch a cloud gaming application in a client, and accordingly, the client may send a launch request to the cloud device. After the cloud game application program is started, the cloud device can send the video stream of the cloud game application program to the client, and correspondingly, the client can display the video stream. When browsing the video stream displayed by the client, the user can also execute the operation aiming at the cloud game application program in the client. The client can send the operation data of the user to the cloud equipment, further, the cloud equipment can send a new video stream triggered by the operation data to the client, and correspondingly, the client can display the new video stream.

However, a certain time period is required for the cloud device to start the cloud game application, so that the user needs to wait until the cloud device finishes starting the cloud game application after selecting to start the cloud game application. Therefore, the user may be in a waiting state for a long time, which affects the development of cloud applications.

Disclosure of Invention

Embodiments of the present invention provide a method, a system, a device, and a storage medium for running a cloud application, so that a user can interact with a displayed standby video while waiting for a start of the cloud application, the waiting process of the user is more interesting and interactive, the user is prevented from quitting due to long-time waiting, the user stickiness is increased, and the development of cloud application is facilitated. The specific technical scheme is as follows:

in a first aspect of the embodiment of the present invention, there is provided a method for running a cloud application, where the method is applied to a client, and the method includes:

when the operation of a user for the cloud application program is detected, an operation request is sent to a cloud server, and a standby video is played; the standby video realizes playing control based on user operation;

and receiving a target video stream from the cloud server, and playing the target video stream.

In a second aspect of the embodiment of the present invention, there is also provided an application program running method, where the method is applied to a cloud server, and the method includes:

when an operation request aiming at a cloud application program sent by a client is received, sending a starting notice of the cloud application program to cloud equipment; the operation request is sent to the cloud server when the client detects the operation of a user on the cloud application program; the client is also used for playing a standby video when detecting the running operation; the standby video realizes playing control based on user operation;

sending the standby video to the client;

and receiving a target video stream from the cloud equipment, and sending the target video stream to the client so that the client plays the target video stream.

In a third aspect of the present invention, there is also provided a cloud application operating system, where the system includes a client and a cloud server, where:

the client is used for sending an operation request to the cloud server and playing a standby video when the operation of a user for the cloud application program is detected; the standby video realizes playing control based on user operation;

the cloud server is used for sending a starting notice of the cloud application program to cloud equipment when the operation request is received; sending the standby video to the client; receiving a target video stream from the cloud equipment and sending the target video stream to the client;

the client is further configured to receive the target video stream and play the target video stream.

In a fourth aspect of the present invention, there is also provided a cloud application running apparatus, where the apparatus is applied to a client, and the apparatus includes:

the processing module is used for sending an operation request to the cloud server and playing a standby video when the operation of a user for the cloud application program is detected; the standby video realizes playing control based on user operation;

and the target video stream playing module is used for receiving the target video stream from the cloud server and playing the target video stream.

In a fifth aspect of the present invention, there is also provided a cloud application running apparatus, where the apparatus is applied to a cloud server, and the apparatus includes:

the starting notification sending module is used for sending a starting notification of the cloud application program to the cloud equipment when receiving an operation request aiming at the cloud application program sent by a client; the operation request is sent to the cloud server when the client detects the operation of a user on the cloud application program; the client is also used for playing a standby video when detecting the running operation; the standby video realizes playing control based on user operation;

the standby video sending module is used for sending the standby video to the client;

and the target video stream sending module is used for receiving the target video stream from the cloud equipment and sending the target video stream to the client so that the client plays the target video stream.

In another aspect of the present invention, there is also provided an electronic device, including a processor, a communication interface, a memory and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;

a memory for storing a computer program;

and the processor is used for realizing any one of the cloud application program running methods when executing the program stored in the memory.

In yet another aspect of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements any of the cloud application running methods described above.

In yet another aspect of the present invention, there is also provided a computer program product containing instructions, which when run on a computer, causes the computer to execute any of the cloud application running methods described above.

According to the cloud application program running method provided by the embodiment of the invention, when the running operation of the user on the cloud application program is detected, the client sends the running request to the cloud server, the standby video can be played, and the playing control of the standby video is realized based on the user operation. Furthermore, when the target video stream sent by the cloud server is received, the client can play the target video stream.

Based on the processing, in the starting process of the cloud application program, a user can browse the played standby video in the client, and can perform playing control through user operation. That is, the user may perform some operations to control the playing of the standby video in the time before the start of the cloud application is completed. Compared with the prior art that the user can execute the operation only after the cloud application program is started, based on the method provided by the embodiment of the invention, the user can interact with the displayed standby video in the process of waiting for the start of the cloud application program, so that the waiting process of the user is more interesting and interactive, the user is prevented from quitting due to long-time waiting, the user viscosity is increased, and further, the development of the cloud application is facilitated.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.

Fig. 1 is an architecture diagram of a cloud application operating system provided in an embodiment of the present invention;

fig. 2 is an interaction diagram of a cloud application operating method provided in an embodiment of the present invention;

fig. 3 is an interaction diagram of another cloud application operating method provided in the embodiment of the present invention;

fig. 4 is an interaction diagram of another cloud application operating method provided in the embodiment of the present invention;

fig. 5 is an interaction diagram of another cloud application operating method provided in the embodiment of the present invention;

fig. 6 is an interaction diagram of another cloud application operating method provided in the embodiment of the present invention;

fig. 7 is a signaling diagram of a method for operating a cloud application according to an embodiment of the present invention;

fig. 8 is a structural diagram of a cloud application operating apparatus according to an embodiment of the present invention;

fig. 9 is a structural diagram of another cloud application execution apparatus provided in the embodiment of the present invention;

fig. 10 is a structural diagram of an electronic device provided in an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.

In the context of a cloud application, a system for running a cloud application may include: a client and a cloud device.

The cloud device may be a virtual device, for example, the cloud device may be a logical device virtualized on a cloud server by a virtualization technology. Alternatively, the cloud device may also be a physical device. Illustratively, the cloud device may be a desktop computer or a server, etc. In actual operation, the cloud device may provide a corresponding network service by installing a cloud application (also referred to as a cloud application). For example, a cloud device provides cloud gaming services by installing a cloud application, i.e., the cloud application runs on the cloud device. One or more cloud applications may be run on any one of the cloud devices.

Clients are physical devices that may be a variety of electronic devices with display screens including, but not limited to, smart phones, tablets, laptop portable computers, desktop computers, and the like. The client can provide corresponding network services by installing an application program of the client. For example, a client provides a video or image playing service by installing a video player.

In one implementation, for a cloud gaming application, a cloud device may send a video stream of the cloud gaming application to a client. The client may then display the received video stream through the application. Further, the client can also acquire operation data operated by the user and send the operation data to the cloud equipment. And the cloud equipment responds and refreshes the video stream based on the operation data, and sends the refreshed video stream to the client. Therefore, the cloud game application installed on the cloud equipment can be used by the user through the client.

However, in the related art, a certain time is required for the cloud device to start the cloud application, so that the user needs to wait until the cloud application is started, after selecting to start the cloud application, and the operation can be performed. Therefore, the user may be in a waiting state for a long time, and the user may be bored to quit the cloud application with a long waiting time, which may affect the development of the cloud application.

In order to solve the above problem, an embodiment of the present invention provides a cloud application running system, and referring to fig. 1, fig. 1 is an architecture diagram of a cloud application running system provided in an embodiment of the present invention, where the application running system may include a client 101 and a cloud server 102.

The client 101 is used for sending an operation request to the cloud server 102 and playing a standby video when detecting that a user operates the cloud application; the standby video realizes play control based on user operation.

The cloud server 102 is used for sending a starting notification of the cloud application program to the cloud equipment when receiving the operation request; sending the standby video to the client 101; receive a target video stream from a cloud device and send the target video stream to the client 101.

The client 101 is further configured to receive the target video stream and play the target video stream.

According to the cloud application program running system provided by the embodiment of the invention, in the starting process of the cloud application program, a user can browse the played standby video in the client side, and the playing control can be carried out through the user operation. That is, the user may perform some operations to control the playing of the standby video in the time before the start of the cloud application is completed. Compared with the prior art that the user can execute the operation only after the cloud application program is started, in the embodiment of the invention, the user can interact with the displayed standby video in the process of waiting for the start of the cloud application program, so that the waiting process of the user is more interesting and interactive, the user is prevented from quitting due to long-time waiting, the user viscosity is increased, and further, the development of the cloud application is facilitated.

For other embodiments of the cloud application running system, reference may be made to the following detailed description of method embodiments of the client and the cloud server.

In order to make the process of waiting for the cloud application program to be started more interesting and interactive, avoid the user from quitting due to long-time waiting, increase the user viscosity and promote the development of the cloud application, the embodiment of the invention also provides a cloud application program running method. Referring to fig. 2, fig. 2 is an interaction diagram of a cloud application running method provided in an embodiment of the present invention, where the method may be applied to a client and a cloud server, and the client and the cloud server may be a client 101 and a cloud server 102 in the cloud application running system, respectively, and the method may include the following steps:

s201: when the running operation of the user for the cloud application program is detected, the client sends a running request to the cloud server.

S202: the cloud server sends the standby video to the client.

S203: the client plays the standby video.

Wherein, the standby video realizes the playing control based on the user operation.

S204: and when receiving the operation request, the cloud server sends a starting notice of the cloud application program to the cloud equipment.

S205: the cloud server receives a target video stream from the cloud device.

S206: the cloud server sends the target video stream to the client.

S207: and the client receives the target video stream and plays the target video stream.

For the step S201, the cloud application may indicate, in the client, a cloud application to be currently run for the user. For example, the application may be a cloud game application, or may be a cloud graphics application, but is not limited thereto.

In one mode, a user may select a cloud application program to be run in a client, and then the client may send a running request carrying a program identifier of the cloud application program to a cloud server based on an instruction of the user, so as to request that the cloud application program is run in a cloud device. The program identification of the cloud application may be a name of the cloud application.

For step S202, the standby video is a video played by the client before the target video stream corresponding to the cloud application is played. In addition, when the cloud application is started, the client can switch from the standby video to the target video stream after receiving the target video stream. That is, in the starting process of the cloud application program, a user can browse the standby video; when the cloud application program is started, the user can browse the video when the cloud application program runs. Namely, the standby video in the embodiment of the present invention is a video that is used as a standby video in the starting process of the cloud application.

The standby video realizes playing control based on user operation, that is, in the process of displaying the standby video by the client, the user can execute the user operation aiming at the standby video to control the playing of the standby video. Therefore, the user can interact with the displayed standby video in the process of waiting for the start of the cloud application program, and further the interestingness and the interactivity in the waiting process of the user can be increased, the user can be prevented from quitting due to long-time waiting, the user viscosity is increased, and the development of cloud application is facilitated to be promoted.

The cloud server sends the standby video to the client, so that the client can play the standby video.

In one implementation, the cloud server may send the backup video to the client in advance before step S201, that is, before receiving the operation request (that is, S202 may be performed before S201 in advance), and then, the client may obtain and play the backup video from the local. Therefore, when the standby video needs to be played, the client does not need to acquire the standby video from the cloud server in real time, and further, the waiting time of the user for waiting for the client to play the standby video can be shortened. In addition, if a plurality of cloud application programs correspond to the same standby video, the cloud server only needs to issue the standby video to the client once, so that when a user requests to operate each cloud application program, the client can directly obtain the standby video from the local, the client does not need to obtain the standby video from the cloud server every time, transmission of useless data can be reduced, and the waiting time of the user for waiting for the client to play the standby video can be shortened.

In another implementation manner, the cloud server may also obtain a standby video that the client needs to display when receiving the operation request, and send the standby video to the client (i.e., S202 is executed in response to S201, and the cloud server sends the standby video to the client in real time). Therefore, before the cloud server sends the target video stream to the client, whether the cloud server can respond to the operation request of the client can be determined, and further whether the cloud server can respond to the user operation of the user for the cloud application program can be determined.

In step S204, the cloud server sends a start notification to the cloud device, and accordingly, after receiving the start notification, the cloud device may start to start the cloud application, for example, the cloud device starts to load data required when the cloud application starts.

For step S205, after the cloud application is started, the cloud device may send a video stream (i.e., a target video stream) of the cloud application to the cloud server, and the cloud server may correspondingly forward the target video stream to the client.

In one embodiment, for the step S202, in the case that the cloud server sends the backup video to the client when receiving the operation request, if there is one backup video, the cloud server may send the backup video to the client in a loop. Correspondingly, the client can circularly play the standby video until the cloud server sends the target video stream to the client.

If there are multiple standby videos, the cloud server may send each standby video to the client. Correspondingly, the client can play each standby video according to the operation information of the user and the indication of the user until the cloud server sends the target video stream to the client. In addition, if the user has no operation control, only one video can be played, for example, only the main video is played, and the control video is not played; or, the standby videos can be played in sequence according to a preset sequence. For example, the preset sequence may be a receiving sequence in which the client receives the standby videos, or may also be a numbering or identification sequence between the standby videos, or may also be any other custom sequence, which is not particularly limited in this embodiment of the present invention.

In one embodiment, the standby video may include a main video and a control video, and accordingly, the step S202 may include the steps of: sending the main video and the control video to the client; or sending the main video to the client, and sending the control video to the client based on the video acquisition request.

That is, the cloud server may, but is not limited to, send the main video and the control video to the client in the following two ways.

The first method is as follows: the cloud server sends the main video and the control video to the client together.

In one embodiment, the cloud server may send the backup videos (i.e., the primary video and the control video) to the client in advance before receiving the operation request, and the client may store the backup videos locally. Subsequently, the client can directly obtain and play the standby video from the local. Based on the processing, when the standby video needs to be played, the client does not need to acquire the standby video from the cloud server in real time, and further, the waiting time of the user for waiting for the client to play the standby video can be shortened. In addition, if a plurality of cloud application programs correspond to the same standby video, the cloud server only needs to issue the standby video to the client once, so that when a user requests to operate each cloud application program, the client does not need to acquire the standby video from the cloud server every time, transmission of useless data can be reduced, and the waiting time of the user for waiting for the client to play the standby video can be shortened.

In another embodiment, the cloud server may send the backup videos (i.e., the primary video and the control video) to the client upon receiving the run request. Accordingly, the client can acquire and play the standby video from the cloud server. Therefore, before the cloud server sends the target video stream to the client, whether the cloud server can respond to the operation request of the client can be determined, and further whether the cloud server can respond to the user operation of the user for the cloud application program can be determined.

The second method comprises the following steps: and the cloud server separately transmits the main video and the control video to the client.

In one embodiment, the cloud server may send the main video to the client in advance before receiving the running request, and the client may store the main video locally. Subsequently, the client can locally acquire and play the main video. In the process of playing the main video, a user can execute user operation in the client, and the client can acquire operation information of the user operation and send the operation information to the cloud server. The cloud server can acquire the control video indicated by the operation information and send the control video to the client. Therefore, the cloud server does not need to send the main video to the client when the cloud application program is operated every time, transmission of useless data can be reduced, and the waiting time of a user for waiting the client to play the main video can be shortened. In addition, before the cloud server sends the target video stream to the client, whether the cloud server can respond to the operation request of the client can be detected, and further whether the cloud server can respond to the user operation of the user for the cloud application program can be determined.

In another embodiment, upon receiving the operation request, the cloud server may send the main video to the client, and the client may play the main video. In the process of playing the main video, the user can perform user operation in the client. The client can acquire operation information operated by the user and send the operation information to the cloud server. The cloud server may then determine the control video indicated by the operation information and send the control video to the client. Therefore, before the cloud server sends the target video stream to the client, whether the cloud server can respond to the operation request of the client can be detected, and whether the cloud server can respond to the user operation of the user for the cloud application program can be further determined.

Corresponding to the manner of sending the standby video by the cloud server, in an embodiment, referring to fig. 3, on the basis of fig. 2, before the step S203, the method may further include the following steps:

s208: receiving a standby video from a cloud server; or, acquiring the standby video corresponding to the running request from the local.

In one embodiment, if the cloud server sends the backup video to the client in advance before receiving the running request, the client may store the backup video locally. Furthermore, when the standby video needs to be played, the client can locally acquire and play the standby video. That is to say, when needing to play the standby video, the client does not need to obtain the standby video from the cloud server in real time, and then, can shorten the waiting time of waiting for the client to play the standby video. In addition, if a plurality of cloud application programs correspond to the same standby video, the cloud server only needs to issue the standby video to the client once, so that when a user requests to operate each cloud application program, the client does not need to acquire the standby video from the cloud server every time, transmission of useless data can be reduced, and the waiting time of the user for waiting for the client to play the standby video can be shortened.

In another embodiment, the run request corresponds to a backup video, i.e., a backup video associated with the content exposed by the cloud application. Correspondingly, if the cloud server sends the standby video to the client when receiving the operation request, correspondingly, after sending the operation request, the client can obtain the standby video from the cloud server to play. Therefore, before the cloud server sends the target video stream to the client, whether the cloud server can respond to the operation request of the client can be detected, and whether the cloud server can respond to the user operation of the user for the cloud application program can be further determined.

In one embodiment, the video content of the backup video is associated with content presented by the cloud application. That is, the video content of the backup video is associated with the video content of the target video stream of the cloud application.

In one implementation, the type of video content of the backup video is the same as the type of video content of the target video stream. For example, if the video content of the target video stream is a game scene, the video content of the standby video is also a game scene. Specifically, the game scene in the standby video and the game scene in the target video stream may be a scene of the same game, or may be a scene of a similar type of game.

In another implementation, the video content of the standby video and the video content of the target video stream are directed to the same cloud application, and the video content of the standby video and the video content of the target video stream have different scenes. That is, the video content of the backup video is not the video content when the cloud application is actually running. Specifically, the scene of the video content of the standby video may be a background introduction of the cloud application corresponding to the target video stream (for example, the standby video is used to introduce a large background of the cloud game), or the scene of the video content of the standby video may also be a role introduction of the cloud application corresponding to the target video stream (for example, the standby video may show a plurality of characters (main videos) related to the cloud game and show character introductions (control videos) of a role selected by the user based on a selection operation of the user, or may also directly play character introductions of each main role), or the scene of the video content of the standby video may also be an operation description of the cloud application corresponding to the target video stream (for example, the standby video may be a control method of the cloud game). For example, if the cloud application is a cloud game application, the backup video may be a video of a promotional animation, an operation guide, and the like of the cloud game application. For example, if the cloud application is a cloud graphics application, the backup video may be a video such as an operation guide or a video template of the cloud graphics application.

Therefore, the video content of the standby video is associated with the content displayed by the cloud application program, so that the enthusiasm of the user for interacting with the displayed standby video can be improved, the interestingness and the interactivity of the user in waiting for the starting process of the cloud application program are further improved, the user is prevented from quitting due to long-time waiting, the user viscosity is increased, and further, the development of cloud application is facilitated.

In one embodiment, the standby video may be a video, and during playing the video, based on a user operation, the client may implement play control for the video. For example, the video is paused, resumed, fast forwarded, doubled, etc.

In addition, if there are a plurality of standby videos, the client may control the switching and playing among the plurality of standby videos based on the user operation. In one embodiment, the backup video includes a primary video and a control video. Correspondingly, the client can realize the switching playing between the main video and the control video under the control of the user operation.

For example, during playing of a main video, the client may switch from the main video to the play control video based on a user operation. For another example, during playing of the control video, the client may switch from playing the control video to playing the main video based on a user operation. In addition, if there are a plurality of control videos, the client may switch from playing the current control video to playing another control video based on a user operation during playing one control video.

In addition, for each of the main video and the control video, during the process of playing the video by the client, based on the user operation, the client may also implement play control for the video, for example, pause playing the video, resume playing the video, fast-forward playing the video, double-speed playing the video, and so on.

In one embodiment, referring to fig. 4, the step S203 may include the following steps:

s2031: and playing the main video, and acquiring operation information operated by a user in the process of playing the main video.

S2032: and switching to playing the control video indicated by the operation information based on the operation information.

In one implementation, if the backup video includes the main video and the control video, the number of the control videos may be one or multiple.

For example, the client may play the main video when sending the run request to the cloud server. In the process of playing the main video, the user can perform user operation in the client. Furthermore, the client can acquire operation information operated by the user, acquire the control video indicated by the operation information, and switch to play the control video.

The main video and the control video played by the client can be sent to the client in advance by the cloud server before receiving the operation request, and the client is stored locally; alternatively, the cloud server may send the operation request and the operation information of the user operation to the client.

Based on the above processing, if there are multiple control videos, the client may switch to playing different control videos based on different user operations.

Therefore, the user can interact with the displayed standby video in the process of waiting for the start of the cloud application program, the waiting process of the user is more interesting and interactive, the user is prevented from quitting due to long-time waiting, the stickiness of the user is increased, and further, the development of cloud application is facilitated.

In an embodiment, if the client does not receive the corresponding control video within a preset time after the client sends the operation information of the user operation to the cloud server, the client may display a second reminding message to remind the user that the current cloud server cannot respond to the user operation.

In one embodiment, the user action may include, but is not limited to, at least one of: gesture operation, voice operation, air separation operation and the like.

In the embodiment of the invention, different user operations can correspond to different video control instructions. The client can play and control the standby video according to the corresponding video control instruction based on the operation information operated by the user.

In one implementation, the gesture operations include, but are not limited to, at least one of: click operation, slide operation, and long press operation. The client can recognize the gesture operation of the user, determine a video control instruction corresponding to the gesture operation, and play and control the standby video according to the video control instruction.

The voice operation is an operation corresponding to voice data input by a user. The client can perform voice recognition on voice data input by a user, determine a video control instruction corresponding to the voice data, and perform play control on the standby video according to the video control instruction.

The blanking operations may include head operations and/or eye operations. Different head movements can correspond to different video control instructions, and different eye movements can correspond to different video control instructions. Correspondingly, the client can acquire the image of the head of the user, further, the client can recognize the head action and/or the eye action of the user, and determine the corresponding video control instruction, and further, the client can play and control the standby video according to the video control instruction.

Based on the processing, the user can play and control the standby video in different modes, the interestingness and the interactivity of the user in the waiting process are further improved, the user is prevented from quitting due to long-time waiting, the user viscosity is increased, and further, the development of cloud application is facilitated.

In one embodiment, referring to fig. 5, after the above step S2032, the method may further comprise the steps of:

s2033: and when the control video playing indicated by the operation information is finished, continuing to play the main video.

In the embodiment of the invention, after the control video is switched to be played, when the control video is played, the client can continue to play the main video. That is, when the client switches to play the control video, the client continues to play the main video at the played position of the main video.

Based on the above processing, if there are a plurality of control videos, the client may switch to playing the control video 1 based on the user operation 1 of the user during the process of playing the main video. When the control video 1 is played, the client may switch to continue playing the main video. Accordingly, in the process of continuing to play the main video, the client may switch to play the control video 2 based on the user operation 2 of the user. When the control video 2 is finished playing, the client can continue to switch to play the main video, and so on.

In addition, if the client does not receive the target video stream when the main video is played, the client may play the main video again. Similarly, in the process of replaying the main video, the client may still switch to playing the control video based on the user operation.

Therefore, the user can interact with the displayed standby video in the process of waiting for the start of the cloud application program, the waiting process of the user is more interesting and interactive, the user is prevented from quitting due to long-time waiting, the user viscosity is increased, the automatic switching back to the main video can be realized, and the development of cloud application is facilitated.

In an embodiment, if there are a plurality of control videos, when the playing of the control video indicated by the operation information is finished, the client may further continue to play the next control video according to the preset arrangement sequence among the control videos. Similarly, if the next control video is played, the client may still continue to play the next control video according to the preset sorting order. And repeating the steps until the playing of the last control video in the preset arrangement sequence is finished, and at the moment, the client can continue to play the main video.

In one embodiment, referring to fig. 6, on the basis of fig. 2, the step S207 may include the following steps:

s2071: and receiving a target video stream from the cloud server, and performing operation detection on the cloud application program.

Wherein the operation detection comprises: and detecting the running environment and/or the user of the cloud application.

S2072: and in the case of passing the operation detection, playing the target video stream.

In the embodiment of the present invention, before playing the target video stream of the cloud application, the client may further detect whether it is currently detectable through operation of the cloud application.

In one implementation, the client may only perform the operation environment detection, and if the operation environment detection is passed, the client may determine that the operation detection is passed.

In one implementation, the client may only perform user detection, and if the user detection is passed, the client may determine that the operation detection is passed.

In one implementation, the client may perform both user detection and runtime environment detection. Upon detection by the user, and upon detection by the runtime environment, the client may determine to pass the runtime detection. For example, the client may perform the operation environment detection, and if the operation environment detection is passed, the client may perform the user detection. If the user detection is passed, the client can determine that the operation detection is passed; if the user detection is not passed, the client may determine that the running detection is not passed. In addition, if the running environment detection is not passed, the client directly determines that the running detection is not passed.

And if the running detection is passed, the client can play the target video stream, and if the running detection is not passed, the client does not play the target video stream temporarily and continues to play the standby video until the running detection is passed.

Based on the processing, the client can play the target video stream under the condition of passing the operation detection, namely, the user can be prevented from using the cloud application program under the condition of not passing the operation detection, and the user experience is improved.

In one embodiment, the runtime environment detection includes at least one of:

detecting whether the current overall network delay of the client is smaller than a preset delay threshold value; detecting whether the rate of receiving the video stream by the client side reaches the rate of sending the video stream by the cloud server; and detecting whether the rate of rendering the video stream by the client side reaches the rate of sending the video stream by the cloud server.

In one implementation, the cloud server may send video frames in the standby video to the client according to a preset frame rate. Accordingly, the client may calculate a rate of receiving the video frame during the process of receiving the video frame in the standby video, and determine whether the rate reaches a preset frame rate (i.e., a rate sent by the server). If the network state is good, the client can determine to pass the operation environment detection. Otherwise, the client determines that the running environment detection is not passed.

In addition, the client may also determine whether the current overall network delay is smaller than a preset delay threshold based on the rate of receiving the video frame. If the current overall network delay is smaller than the preset threshold, the client side can determine that the network delay is smaller than the preset threshold. Otherwise, the client determines that the running environment detection is not passed.

In addition, when the client decodes and renders the video frame in the standby video, the client may also calculate a rate of rendering the video frame, and determine whether the rate reaches a preset frame rate (that is, a rate at which the cloud server sends the video frame). If so, indicating that the rate at which the client renders video frames is high, the client may determine that the running environment detection is passed. Otherwise, the client determines that the running environment detection is not passed.

In one embodiment, if it is determined that the running environment detection is not passed, the client may display a first reminding message to remind the user that the running condition of the cloud application is not currently reached. Correspondingly, after browsing the first reminding message, the user can change the network accessed by the client, or optimize the client and the like.

Based on the processing, the client can play the target video stream under the condition of running environment detection, namely, the user can be prevented from using the cloud application program under the condition of not running environment detection, namely, the situation that the cloud application program runs in a stuck state is avoided, and the user experience is improved.

In one embodiment, the user detection may include:

displaying the inquiry information; and if the confirmed playing operation of the user is detected, confirming that the playing operation passes the user detection.

Wherein the query information is used to confirm whether to play the target video stream.

In the embodiment of the present invention, before playing the target video stream, the client may further confirm, i.e., display the query information to the user, so that the user confirms whether to play the target video stream.

For example, the client may display a window containing "whether to play the target video stream of the cloud application", and the window contains controls corresponding to "play" and "not play". Further, when the user clicks the "play" control, the client may determine that the user selects to play the target video stream, i.e., by user detection.

In one embodiment, if the user detection is not passed, the client may continue playing the standby video, i.e., not switch to playing the target video stream.

Based on the processing, the client can play the target video stream under the condition allowed by the user, so that the personalized requirements of the user can be met, and the user experience is improved.

In one embodiment, the first frame of the control video is a key frame and the first frame of the target video stream is a key frame.

The key frame is the video frame where the key action in the motion change of the object in the video is located. Therefore, if the first frame played after switching is a key frame, the user can directly view the key action of the object motion in the switched video, and smooth switching of the user in the viewing experience can be realized. Therefore, by setting the first frame of the control video as the key frame, smooth switching from the main video to the control video can be realized; the first frame of the target video stream is set as the key frame, so that smooth switching from the standby video to the target video stream can be realized, and further, the browsing experience of a user can be improved.

In an embodiment, referring to fig. 7, fig. 7 is a signaling diagram of a cloud application running method according to an embodiment of the present invention, where the method may be applied to a cloud application running system, where the system may include a client, a cloud server, and a cloud device, and the system is used to run a cloud game application. The method may comprise the steps of:

the user can select the cloud game application program to be operated in the client, correspondingly, the client can receive the instruction for starting the game input by the user, and further, the client can send a request to the cloud server to request for operating the cloud game application program.

After receiving the request, the cloud server may read video data (i.e., the main video in the embodiment of the present invention) and return the video data to the client, and accordingly, the client may play the main video.

In addition, after receiving the request, the cloud server may further send a start notification of the cloud game application to the cloud device, and accordingly, the cloud device may start starting the cloud game application.

In the process of playing the main video by the client, the user can execute the operation. The client may then obtain operation information of the operation and send a transmission command to the cloud server (i.e., send the operation information to the cloud server).

Further, the cloud server may return video data (i.e., a control video in the embodiment of the present invention) corresponding to the command to the client. Accordingly, the client can play the control video.

When the cloud game application is started, the cloud device may transmit game video data (i.e., the target video stream in the embodiment of the present invention) to the cloud server. Accordingly, the cloud server may stop storing video push (i.e., stop sending backup video to the client), and push game video data to the client. Further, the client can play the game video data.

Therefore, in the starting process of the cloud application program, a user can browse the played standby video in the client, and the playing control can be performed through the user operation. That is, the user may perform some operations to control the playing of the standby video in the time before the start of the cloud application is completed. Compared with the prior art that the user can execute the operation only after the cloud application program is started, in the embodiment of the invention, the user can interact with the displayed standby video in the process of waiting for the start of the cloud application program, so that the waiting process of the user is more interesting and interactive, the user is prevented from quitting due to long-time waiting, the user viscosity is increased, and further, the development of the cloud application is facilitated.

In order to make the process of waiting for the start of the cloud application more interesting and interactive, avoid the exit of the user due to long waiting time, increase the user viscosity, and promote the development of the cloud application, an embodiment of the present invention further provides a cloud application running device, referring to fig. 8, where fig. 8 is a structural diagram of a cloud application running device provided in an embodiment of the present invention, and the device is applied to a client, and includes:

the processing module 801 is configured to send an operation request to a cloud server and play a standby video when detecting that a user operates a cloud application; the standby video realizes playing control based on user operation;

a target video stream playing module 802, configured to receive a target video stream from the cloud server, and play the target video stream.

Optionally, the video content of the backup video is associated with content presented by the cloud application.

Optionally, the standby video includes a main video and a control video;

the processing module 801 includes:

the first playing submodule is used for playing the main video and acquiring operation information operated by a user in the process of playing the main video;

and the switching playing sub-module is used for switching to play the control video indicated by the operation information based on the operation information.

Optionally, the apparatus further comprises:

and the playing module is used for continuing to play the main video when the control video indicated by the operation information is played after the control video indicated by the operation information is switched to be played based on the operation information.

Optionally, the apparatus further comprises:

the standby video acquisition module is used for receiving the standby video from the cloud server before the standby video is played;

or the like, or, alternatively,

and acquiring the standby video corresponding to the running request from the local.

Optionally, the target video stream playing module 802 includes:

the detection submodule is used for receiving the target video stream from the cloud server and carrying out operation detection on the cloud application program; wherein the operation detection comprises: detecting the running environment and/or the user of the cloud application program;

and the target video stream playing sub-module is used for playing the target video stream under the condition of passing the operation detection.

Optionally, the detection submodule is specifically configured to detect at least one of the following:

detecting whether the current overall network delay of the client is smaller than a preset delay threshold value;

detecting whether the rate of receiving the video stream by the client side reaches the rate of sending the video stream by the cloud server;

and detecting whether the rate of rendering the video stream by the client side reaches the rate of sending the video stream by the cloud server.

Optionally, the detection sub-module is specifically configured to display inquiry information; wherein the query information is used for confirming whether the target video stream is played;

and if the confirmed playing operation of the user is detected, confirming that the playing operation passes the user detection.

Optionally, the first frame of the control video is a key frame, and the first frame of the target video stream is a key frame.

According to the cloud application program running device provided by the embodiment of the invention, in the starting process of the cloud application program, a user can browse the played standby video in the client side and can perform playing control through user operation. That is, the user may perform some operations to control the playing of the standby video in the time before the start of the cloud application is completed. Compared with the prior art that the user can execute the operation only after the cloud application program is started, in the embodiment of the invention, the user can interact with the displayed standby video in the process of waiting for the start of the cloud application program, so that the waiting process of the user is more interesting and interactive, the user is prevented from quitting due to long-time waiting, the user viscosity is increased, and further, the development of the cloud application is facilitated.

In order to make a process of waiting for the start of the cloud application more interesting and interactive, avoid a user from exiting due to long waiting, increase user stickiness, and promote development of the cloud application, an embodiment of the present invention further provides a cloud application running apparatus, referring to fig. 9, where fig. 9 is a structural diagram of the cloud application running apparatus provided in the embodiment of the present invention, and the apparatus is applied to a cloud server, and includes:

a start notification sending module 901, configured to send a start notification of a cloud application to a cloud device when receiving an operation request for the cloud application sent by a client; the operation request is sent to the cloud server when the client detects the operation of a user on the cloud application program; the client is also used for playing a standby video when detecting the running operation; the standby video realizes playing control based on user operation;

a standby video sending module 902, configured to send the standby video to the client;

a target video stream sending module 903, configured to receive a target video stream from the cloud device, and send the target video stream to the client, so that the client plays the target video stream.

Optionally, the standby video includes a main video and a control video;

the standby video sending module 902 is specifically configured to send the main video and the control video to the client;

alternatively, the first and second electrodes may be,

sending the main video to the client, and sending the control video to the client based on a video acquisition request; the video obtaining request is used for requesting to play the control video indicated by the operation information operated by the user in the process of playing the main video by the client.

The embodiment of the present invention further provides an electronic device, as shown in fig. 10, which includes a processor 1001, a communication interface 1002, a memory 1003 and a communication bus 1004, wherein the processor 1001, the communication interface 1002 and the memory 1003 complete mutual communication through the communication bus 1004,

a memory 1003 for storing a computer program;

the processor 1001 is configured to implement the cloud application running method according to any one of the embodiments described above when executing the program stored in the memory 1003.

The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the electronic equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

In another embodiment of the present invention, a computer-readable storage medium is further provided, where a computer program is stored in the computer-readable storage medium, and when executed by a processor, the computer program implements the cloud application running method described in any of the above embodiments.

In another embodiment, the present invention further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute the cloud application running method described in any of the above embodiments.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system, apparatus, electronic device, computer-readable storage medium, and computer program product embodiments are substantially similar to the method embodiments, so that the description is simple, and reference may be made to some descriptions of the method embodiments for relevant points.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A cloud application program running method is applied to a client, and comprises the following steps:

2. The method of claim 1, wherein video content of the backup video is associated with content presented by the cloud application.

3. The method of claim 1 or 2, wherein the backup video comprises a primary video and a control video;

the playing of the standby video comprises:

playing the main video, and acquiring operation information operated by a user in the process of playing the main video;

and switching to playing the control video indicated by the operation information based on the operation information.

4. The method according to claim 3, wherein after the switching to play the control video indicated by the operation information based on the operation information, the method further comprises:

and when the control video playing indicated by the operation information is finished, continuing to play the main video.

5. The method of claim 1 or 2, wherein prior to said playing the alternate video, the method further comprises:

receiving a standby video from the cloud server;

or the like, or, alternatively,

6. The method of claim 1, wherein receiving the target video stream from the cloud server and playing the target video stream comprises:

receiving the target video stream from the cloud server, and performing operation detection on the cloud application program; wherein the operation detection comprises: detecting the running environment and/or the user of the cloud application program;

and playing the target video stream under the condition of passing the running detection.

7. The method of claim 6, wherein performing the runtime environment detection of the cloud application comprises at least one of:

8. The method of claim 6, wherein performing the user detection of the cloud application comprises:

displaying the inquiry information; wherein the query information is used for confirming whether the target video stream is played;

9. The method of claim 3, wherein the first frame of the control video is a key frame and the first frame of the target video stream is a key frame.

10. A cloud application program running method is applied to a cloud server, and comprises the following steps:

sending the standby video to the client;

11. The method of claim 10, wherein video content of the backup video is associated with content presented by the cloud application.

12. The method of claim 10 or 11, wherein the backup video comprises a primary video and a control video;

the sending the standby video to the client includes:

sending the main video and the control video to the client;

alternatively, the first and second electrodes may be,

13. A cloud application running system, the system comprising a client and a cloud server, wherein:

the client for implementing the method steps of any of claims 1-9;

the cloud server for implementing the method steps of any of claims 10-12.

14. A cloud application running device, which is applied to a client, and comprises:

15. A cloud application running device is applied to a cloud server, and comprises:

16. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any of claims 1-9, or 10-12 when executing a program stored in a memory.

17. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 9, or 10 to 12.