CN116421964A

CN116421964A - Cloud game control method and device, electronic equipment and storage medium

Info

Publication number: CN116421964A
Application number: CN202211597889.7A
Authority: CN
Inventors: 熊丹; 刘光亮; 吴怡生
Original assignee: Netease Hangzhou Network Co Ltd
Current assignee: Netease Hangzhou Network Co Ltd
Priority date: 2022-12-12
Filing date: 2022-12-12
Publication date: 2023-07-14

Abstract

The application relates to the technical field of cloud games, and discloses a control method, a device, electronic equipment and a storage medium of a cloud game, wherein the method is applied to a cloud game server and comprises the following steps: receiving a cloud game starting instruction sent by a first terminal, wherein the cloud game starting instruction comprises a game identifier of a target cloud game; responding to a cloud game starting instruction, starting a target cloud game, and acquiring a game picture of the target cloud game; sending a game picture to a first terminal and a second terminal with an association relation with the first terminal; and if a game control instruction sent by the second terminal aiming at the target cloud game is received, controlling the target cloud game according to the game control instruction, wherein the game control instruction is generated according to a triggering operation performed on a game picture displayed on the second terminal. The method and the device can effectively solve the problem that complex input cannot be carried out in the game process due to limited input in the related technology.

Description

Cloud game control method and device, electronic equipment and storage medium

Technical Field

The present application relates to the technical field of cloud games, and in particular, to a control method and apparatus for a cloud game, an electronic device, and a storage medium.

Background

With the development of cloud game technology and the wide application of smart televisions, users expect to play cloud games through smart televisions. However, in the process of playing the cloud game through the smart television, a user can only input through the remote controller, keys on the remote controller are very limited, more complex input cannot be realized, and the input is limited in the process of playing the cloud game, so that the user experience is greatly influenced.

Disclosure of Invention

In view of the above problems, embodiments of the present application provide a method, an apparatus, an electronic device, and a storage medium for controlling a cloud game, so as to solve the problem that complex input cannot be performed in a game process due to limited keys of an input device in the related art.

According to an aspect of the embodiments of the present application, there is provided a control method of a cloud game, applied to a cloud game server, the method including: receiving a cloud game starting instruction sent by a first terminal, wherein the cloud game starting instruction comprises a game identifier of a target cloud game; responding to the cloud game starting instruction, starting the target cloud game, and acquiring a game picture of the target cloud game; sending the game picture to the first terminal and a second terminal with an association relation with the first terminal; and if a game control instruction sent by the second terminal for the target cloud game is received, controlling the target cloud game according to the game control instruction, wherein the game control instruction is generated according to a triggering operation performed on the game picture displayed on the second terminal.

According to an aspect of the embodiments of the present application, there is provided a control device for a cloud game, which is applied to a cloud game server, and the device includes: the cloud game starting device comprises a receiving module, a first terminal and a second terminal, wherein the receiving module is used for receiving a cloud game starting instruction sent by the first terminal, and the cloud game starting instruction comprises a game identifier of a target cloud game; the starting and picture obtaining module is used for responding to the cloud game starting instruction, starting the target cloud game and obtaining a game picture of the target cloud game; a sending module, configured to send the game screen to the first terminal and a second terminal having an association relationship with the first terminal; and the control module is used for controlling the target cloud game according to the game control instruction if receiving the game control instruction sent by the second terminal aiming at the target cloud game, wherein the game control instruction is generated according to the triggering operation performed by the game picture displayed on the second terminal.

In some embodiments, the control device of the cloud game further includes: the first coding module is used for coding the game picture according to a first resolution to obtain first picture coding data; the first resolution is the resolution corresponding to the display screen of the first terminal; in this embodiment, the transmitting module is further configured to: and sending the first picture coding data to the first terminal and the second terminal so that the first terminal and the second terminal decode according to the first picture coding data to obtain a game picture with first resolution.

In some embodiments, the control device of the cloud game further includes: the first coding module is used for coding the game picture according to a first resolution to obtain first picture coding data; the first resolution is the resolution corresponding to the display screen of the first terminal; the second coding module is used for coding the game picture according to a second resolution to obtain second picture coding data; the second resolution is the resolution corresponding to the display screen of the second terminal, and the second resolution is different from the first resolution; in this embodiment, the transmitting module is further configured to: transmitting the first picture coding data to the first terminal so that the first terminal decodes the first picture coding data to obtain a game picture with a first resolution; and sending the second picture coding data to the second terminal so that the second terminal decodes the second picture coding data to obtain a game picture with the second resolution.

In some embodiments, the control device of the cloud game further includes: an access request receiving module, configured to receive an access request sent by the first terminal or the second terminal, where the access request is used to instruct to associate the first terminal serving as a master device with the second terminal serving as a slave device; and the association module is used for associating the first terminal with the second terminal according to the access request.

In some embodiments, the control device of the cloud game further includes: and the control authority transfer module is used for transferring the control authority of the first terminal aiming at the cloud game to the second terminal.

In some embodiments, the control device of the cloud game further includes: and the instruction neglecting module is used for neglecting the game control instruction from the first terminal if the game control instruction sent by the first terminal aiming at the target cloud game is received.

In other embodiments, the control device for a cloud game further includes: and the priority information determining module is used for determining priority information according to the access request, wherein the priority information is used for indicating the priority of the first terminal and the second terminal on the control authority of the target cloud game.

In some embodiments, the control device of the cloud game further includes: and the ordering module is used for ordering the game control instruction from the first terminal aiming at the target cloud game and the game control instruction from the second terminal aiming at the target cloud game according to the priority information.

In some embodiments, the access request is sent by the second terminal, which generates the access request by scanning access code information displayed on the first terminal.

In other embodiments, the control device for a cloud game further includes: the instruction storage module is used for storing game control instructions aiming at the target cloud game from the first terminal and game control instructions aiming at the target cloud game from the second terminal into an instruction queue according to the sequence of time from first to last; and the instruction acquisition module is used for sequentially acquiring game control instructions aiming at the target cloud game from the instruction queue.

In some embodiments, the control device of the cloud game further includes: the first game picture acquisition module is used for acquiring a first game picture of the target cloud game after responding to the game control instruction; and the second sending module is used for sending the first game picture to the first terminal and the second terminal.

According to an aspect of an embodiment of the present application, there is provided an electronic device including: a processor; and the memory is stored with computer readable instructions which, when executed by the processor, implement the control method of the cloud game.

According to an aspect of the embodiments of the present application, there is provided a computer-readable storage medium having stored thereon computer-readable instructions, which when executed by a processor, implement a control method of a cloud game as described above.

According to an aspect of embodiments of the present application, there is provided a computer program product comprising computer instructions which, when executed by a processor, implement a method of controlling a cloud game as above.

In the application, after a first terminal requests a cloud game server to start a target cloud game, the cloud game server synchronizes game pictures of the target cloud game to the first terminal and to a second terminal with an association relationship with the first terminal, on the basis, the second terminal can control the target cloud game according to the displayed game pictures of the target cloud game and correspondingly generates a game control instruction, and the cloud game server correspondingly executes the game control instruction after receiving the game control instruction from the second terminal. Therefore, the cloud game is controlled by means of the third-party terminal outside the first terminal, and the cloud game can be applied to interaction with the cloud game through the second terminal with rich input functions in the scene that the first terminal is the equipment with limited input, so that the problem that complex input cannot be performed in the game process due to limited input in the related technology can be effectively solved.

In addition, the scheme of the application can be applied to a scene that the first terminal is inconvenient for a user to operate, for example, the display screen of the first terminal is large, and the user is inconvenient to operate by hand, so that the first terminal can be associated with the second terminal which is convenient to operate, and then, in the process of running the cloud game, the cloud game is operated through the second terminal which is convenient to operate.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application. It is apparent that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained from these drawings without inventive effort for a person of ordinary skill in the art.

Fig. 1 schematically illustrates an application scenario of the solution of the present application.

Fig. 2 is a flowchart illustrating a control method of a cloud game according to one embodiment of the present application.

Fig. 3 is a schematic diagram of an application scenario illustrated according to another embodiment of the present application.

Fig. 4 is a flow chart illustrating steps preceding step 230 in an embodiment according to an embodiment of the present application.

Fig. 5A schematically illustrates a display of device access information on a first terminal.

Fig. 5B illustrates a display interface diagram of access code information.

Fig. 6 is a block diagram of a control device of a cloud game according to an embodiment of the present application.

Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the present application. One skilled in the relevant art will recognize, however, that the aspects of the application can be practiced without one or more of the specific details, or with other methods, components, devices, steps, etc. In other instances, well-known methods, devices, implementations, or operations are not shown or described in detail to avoid obscuring aspects of the application.

The block diagrams depicted in the figures are merely functional entities and do not necessarily correspond to physically separate entities. That is, the functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

The flow diagrams depicted in the figures are exemplary only, and do not necessarily include all of the elements and operations/steps, nor must they be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the order of actual execution may be changed according to actual situations.

It should be noted that: references herein to "a plurality" means two or more. "and/or" describes an association relationship of an association object, meaning that there may be three relationships, e.g., a and/or B may represent: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.

Fig. 1 schematically illustrates an application scenario of the solution of the present application. As shown in fig. 1, the application scenario includes a first terminal 110, a second terminal 120, and a cloud game server 130. The first terminal 110 and the second terminal 120 are communicatively connected to the cloud game server 130 through wired or wireless networks, respectively.

Cloud game server 130 refers to a server that can run cloud game applications. In the present application, the cloud gaming server 130 may run one or more cloud gaming applications, which are not specifically limited herein.

Cloud gaming is an online gaming technology based on cloud computing technology. Cloud gaming technology enables lightweight devices with relatively limited graphics processing and data computing capabilities to run high quality games. In a cloud game scenario, the cloud game is not executed in a game terminal (e.g., a smart phone) of a player, but is executed in a cloud game server, and the cloud server renders the game scenario into a video-audio stream, which is transmitted to the player game terminal through a network. The player game terminal does not need to have strong graphic operation and data processing capability, and only needs to have basic streaming media playing capability and the capability of acquiring player input instructions and sending the player input instructions to the cloud server.

In this application, the first terminal 110 refers to a terminal that initiates a cloud game start instruction, and the second terminal 120 refers to a terminal that is associated with the first terminal 110 and that can be used to control a cloud game corresponding to a game screen displayed by the first terminal. The first terminal 110 and the second terminal 120 are different terminals.

The first terminal 110 and the second terminal 120 may be electronic devices that have audio and video decoding capability and can display game pictures. The second terminal 120 may also be provided with a touch screen input function, so that a user may perform a trigger operation based on a game screen displayed on a display screen of the second terminal 120 to interact with the cloud game server 130 to control the cloud game through the second terminal 120. Of course, in other embodiments, the second terminal 120 may also interact with the cloud game by means of a mouse, keyboard, or the like.

In a specific embodiment, the second terminal 120 may be a device with rich input functions, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, and the like, which is not limited herein.

In this application, after the cloud game server 130 starts the target cloud game in response to the game start instruction sent by the first terminal 110, the cloud game server 130 acquires the game screen of the target cloud game in real time, and sends the cloud game screen to the first terminal 110 and the second terminal 120 having an association relationship with the first terminal 110. Thus, the first terminal 110 and the second terminal 120 can synchronously display game screens of the target cloud game.

Based on the game screen displayed on the second terminal 120, the user may perform an interactive operation, for example, trigger a triggerable object in the game screen, where the triggerable object in the game screen may be an operation control provided in the cloud game or may be a virtual object in a virtual scene corresponding to the cloud game, which is not specifically limited herein. Accordingly, the second terminal 120 may correspondingly generate a game control instruction after detecting an operation of the user on the game screen triggered for the triggerable object, and transmit the game control instruction to the cloud game server. Then, the cloud game server may execute the game control instruction and update the game screen of the target cloud game correspondingly, and then synchronize the updated game screen to the first terminal 110 and the second terminal 120.

From the above, the scheme realizes: after the first terminal 110 requests the cloud game server 130 to start the target cloud game, the target cloud game is controlled by the first terminal 110 and a third party terminal (i.e., the second terminal 120) other than the cloud game server 130, and game pictures of the target cloud game are synchronously displayed in the first terminal 110 and the second terminal 120.

In some application scenarios, if the first terminal 110 is a device without a touch screen function, for example, the first terminal 110 is a smart tv, in this case, the first terminal and the second terminal with a rich input function may be associated with each other, then, a cloud game is controlled through a game screen displayed on the second terminal, and the screen is synchronized to the first terminal and the second terminal, so that the cloud game is controlled through a third party terminal outside the first terminal, and game input is not required through a remote controller in the game process, thereby effectively solving the problem that complex input cannot be performed in the game process due to limited keys in the remote controller in the related art.

In some application scenarios, the display screen of the first terminal 110 may be larger, although the first terminal has a touch screen function, because the display screen of the first terminal 110 is larger, it is inconvenient for the user to interact on the display screen of the first terminal, so that according to the method of the present application, the second terminal that is convenient to operate is associated with the first terminal, and then, the user controls the target cloud game through the game screen displayed on the display screen of the second terminal. Because the game picture is synchronously displayed on the first terminal and the second terminal, the display screen of the first terminal is larger, so that a user or other users except the user can watch the game picture conveniently, and the cloud game is controlled through the terminal with the smaller display screen, so that the game experience is improved.

The implementation details of the technical solutions of the embodiments of the present application are described in detail below:

fig. 2 is a flowchart of a method for controlling a cloud game, which is executed by a cloud game server, according to an embodiment of the present application, and with reference to fig. 2, the method includes at least steps 210 to 240, which are described in detail as follows:

step 210, receiving a cloud game starting instruction sent by a first terminal, where the cloud game starting instruction includes a game identifier of a target cloud game.

Cloud game start instructions refer to instructions for requesting the running of a cloud game application. The target cloud game is a cloud game which is requested to be started by a cloud game starting instruction sent by the first terminal. The game identifier of the target cloud game is used for uniquely identifying the target cloud game.

The first terminal can display a cloud game selection page, the cloud game selection page can provide one or more cloud games for selection, and then a user can select a target cloud game to be started according to the requirement and correspondingly send a cloud game starting instruction to the cloud game server. The first terminal can run the client of the cloud game, so that a user can enter the cloud game selection page through the client of the cloud game. Or the first terminal can enter a selection page of the cloud game through the browser to select the cloud game to be started.

In some embodiments, if the first terminal does not have the touch screen function, for example, the first terminal is a smart tv without the touch screen function, the user may select the target cloud game requested to be started on the cloud game selection page through a remote controller of the smart tv or a key provided on the smart tv.

Step 220, in response to the cloud game start instruction, starting the target cloud game, and obtaining a game picture of the target cloud game.

After responding to the cloud game starting instruction, the cloud game server starts the target cloud game according to the game identification of the target cloud game carried by the cloud game starting instruction, then performs game scene rendering correspondingly, and acquires a game picture for reflecting the real-time scene of the target cloud game correspondingly in real time.

And 230, sending a game picture to the first terminal and a second terminal with an association relation with the first terminal.

Before step 230, the first terminal and the second terminal are associated, and the association relationship between the first terminal and the second terminal and the network address of the second terminal are reported to the cloud game server, so that after the cloud game server obtains the game picture of the target cloud game, the cloud game server synchronously sends the game picture to the first terminal and the second terminal according to the network address of the first terminal and the network address of the second terminal.

In some embodiments, in step 230, the cloud gaming server may obtain association information for the first terminal indicating whether the first terminal has other devices associated therewith. On the basis, if the first terminal is indicated to be not associated with other terminals according to the association information of the first terminal, the cloud game server determines that only a game picture of the target cloud game needs to be sent to the first terminal; otherwise, if the first terminal is indicated to have other associated equipment according to the association information of the first terminal, the cloud game server correspondingly takes the equipment associated with the first terminal as a second terminal, and determines that a game picture of the target cloud game needs to be synchronously sent to the first terminal and the second terminal.

In some embodiments, in a case where the user wants to control the target cloud game requested to run by the first terminal through the second terminal, the user may control the first terminal and the second terminal, and associate the first terminal and the second terminal. On the basis, the first terminal adds a first mark in the game starting instruction under the condition that the first terminal is determined to be associated with the second terminal, wherein the first mark is used for indicating that the first terminal is associated with the second terminal, and correspondingly adding the network address of the second terminal in the game starting instruction. And after receiving the game starting instruction sent by the first terminal, if the cloud game server determines that the game starting instruction carries the first mark, the cloud game server correspondingly determines that the game picture of the target cloud game needs to be sent to two terminals (namely the first terminal and the second terminal), and correspondingly acquires the network address of the second terminal from the game starting instruction.

In a specific embodiment, in order to ensure the efficiency and accuracy of the game picture transmission, the cloud game server encodes the game picture of the target cloud game and then transmits the encoded game picture. In this case, in step 230, the game screen transmitted by the cloud game server to the first terminal and the second terminal is actually encoded data of the game screen.

In the application, since the game screen of the target cloud game needs to be displayed on the display screen of the first terminal, in order to ensure the display effect of the game screen on the first terminal, the cloud game server may encode the game screen of the target cloud game according to the resolution corresponding to the display screen of the first terminal. In this case, prior to step 230, the method further comprises: encoding the game picture according to the first resolution to obtain first picture encoding data; the first resolution is the resolution corresponding to the display screen of the first terminal; in this embodiment, step 230 includes: and transmitting the first picture coding data to the first terminal and the second terminal so that the first terminal and the second terminal decode according to the first picture coding data to obtain a game picture with the first resolution.

In this case, both the first terminal and the second terminal may display a game screen of the first resolution. The resolution of the display screen of the first terminal is the first resolution, so that the suitability of the resolution between the game picture of the first resolution and the display screen of the first terminal can be ensured.

In this embodiment, before step 230, the method further includes: the cloud game server receives a display screen parameter of the first terminal, wherein the display screen parameter is used for indicating the resolution of a display screen of the first terminal. Thus, in step 230, the cloud game server may encode the game frames at the first resolution, correspondingly.

If the resolutions of the display screens of the first terminal and the second terminal are the same, correspondingly, the suitability between the game picture with the first resolution and the display screen of the first terminal and the suitability between the game picture with the first resolution and the display screen of the second terminal can be ensured.

In some embodiments, in the case that the resolutions of the display screens of the first and second terminals are different, if the second terminal also displays a game screen of the first resolution, black edges may exist on the edge of the display screen of the second terminal due to the fact that the resolution of the game screen is not matched with the resolution of the display screen of the second terminal, and the look and feel of the game screen displayed on the second terminal are affected by the user. In this case, the second terminal may perform resolution adjustment on the game screen according to the resolution of its own display screen and the resolution of the game screen from the cloud game server to adjust the resolution of the game screen to the resolution of the display screen of the second terminal; and then displaying the game picture with the adjusted resolution, so as to ensure the suitability of the resolution between the displayed game picture and the display screen of the second terminal.

In other embodiments, if the resolution of the display screen of the first terminal is different from the resolution of the display screen of the second terminal, the cloud game server may further send, for the same game frame, game frames of different resolutions to the first terminal and the second terminal according to the first resolution corresponding to the display screen of the first terminal and the resolution corresponding to the display screen of the second terminal (i.e., the second resolution).

Fig. 3 is a schematic diagram of an application scenario according to another embodiment of the present application, as shown in fig. 3, a cloud game server sends a game screen with a first resolution to a first terminal, and sends a game screen with a second resolution to a second terminal.

In the application scenario shown in fig. 3, before step 230, the method further includes: encoding the game picture according to the first resolution to obtain first picture encoding data; the first resolution is the resolution corresponding to the display screen of the first terminal; encoding the game picture according to the second resolution to obtain second picture encoding data; the second resolution is the resolution corresponding to the display screen of the second terminal, and the second resolution is different from the first resolution; in this embodiment, step 230 includes: transmitting first picture coding data to a first terminal so that the first terminal decodes according to the first picture coding data to obtain a game picture with first resolution; and transmitting the second picture coding data to the second terminal so that the second terminal decodes the second picture coding data to obtain a game picture with the second resolution.

In this embodiment, the cloud game server encodes the same game frame according to the first resolution corresponding to the first terminal and the second resolution corresponding to the second terminal, where the resolutions of the game frames obtained by decoding the first terminal and the second terminal are respectively adapted to the resolutions of the display screens of the first terminal and the second terminal, so that the effect of displaying the game frames on the first terminal and the second terminal is ensured, and the look and feel experience of the user is improved.

Of course, if the cloud game server determines that the resolution of the display screen of the first terminal is the same as the resolution of the display screen of the second terminal, the cloud game server may encode the game screen only in the first resolution.

In particular embodiments, the cloud game server may encode the game frames into a video stream and then synchronize the game frames in the form of the video stream to the first terminal and the second terminal. Furthermore, as background sound or audio with other sound effects may be added in the target cloud game, the cloud game server may encode the game frame and the audio in the target cloud game into audio and video streams, and synchronize the audio and video streams to the first terminal and the second terminal correspondingly.

In some application scenarios, the distance between the first terminal and the second terminal may be relatively short, so that if the first terminal and the second terminal play the audio in the target cloud game synchronously under the condition that the same game screen is displayed, the same sound from two sound sources may be heard in a relatively short time for the watched user, and the game experience of the user is greatly affected.

To solve this problem, the cloud game server may transmit audio data in the target cloud game to one of the first terminal and the second terminal, and not transmit audio data in the target cloud game to the other terminal. In other words, the cloud game server transmits a game screen and audio data to one of the first terminal and the second terminal, and transmits a game screen to the other terminal without transmitting audio data in the course of running the target cloud game.

Specifically, the cloud game server encodes two data based on the game picture and the audio data in the target cloud game, namely, one data is a real-time audio-video stream of the target cloud game, and the other data is a real-time video stream of the target cloud game, so that the audio-video stream is sent to one of the first terminal and the second terminal, and the video stream is sent to the other terminal.

In some embodiments, the cloud game server may send a real-time audio-video stream of the target cloud game to the first terminal and a real-time video stream of the target cloud game to the second terminal. In this way, the first terminal correspondingly plays the audio in the target cloud game in the process of displaying the game picture, and the second terminal only displays the game picture of the target cloud game without playing the audio in the target cloud game.

In some embodiments, the cloud game server may determine whether to transmit audio data in the target cloud game to both the first terminal and the second terminal according to a size of a distance between the first terminal and the second terminal. Specifically, the first terminal or the second terminal may detect and obtain a distance between the first terminal and the second terminal, and report the distance between the first terminal and the second terminal to the cloud game server. If the cloud game server determines that the distance between the first terminal and the second terminal is greater than the distance threshold, determining that the audio data in the target cloud game needs to be provided for both the first terminal and the second terminal; otherwise, if it is determined that the distance between the first terminal and the second terminal is smaller than or equal to the distance threshold, it is determined that audio data in the target cloud game only needs to be provided to one of the first terminal and the second terminal.

In some embodiments, if the cloud game server determines to send the real-time audio and video stream of the target cloud game to the first terminal, the method further includes, before step 230: acquiring the distance between a first terminal and a second terminal; if the distance between the first terminal and the second terminal is greater than the distance threshold, generating a video stream and an audio-video stream according to the game picture and the audio data at the corresponding moment in the target cloud game; in step 230, an audio and video stream is sent to the first terminal and a video stream is sent to the second terminal. Of course, the resolutions of the video stream and the corresponding resolutions of the video frames in the audio-video stream may be the same, for example, the resolutions may be the first resolution, or may be different, for example, the resolutions of the video frames in the audio-video stream are the first resolution, and the resolutions of the video frames in the video stream are the second resolution.

In other embodiments, the first terminal or the second terminal may provide an option of whether the cloud game server sends the audio data to the second terminal in the process of associating the first terminal with the second terminal, so that the user may select whether to instruct the cloud game server to send the audio data to the second terminal according to actual needs. And then, generating audio transmission indicating information according to the options selected by the user, and reporting the audio transmission indicating information to the cloud game server, wherein the audio transmission indicating information is used for indicating whether to transmit audio data in the cloud game to the second terminal.

On the basis, the cloud game server determines whether to provide the audio data in the target cloud game to the second terminal according to the audio transmission instruction information. That is, if the audio transmission instruction information indicates that the audio data in the cloud game does not need to be transmitted to the second terminal, in step 230, the cloud game server transmits a real-time audio/video stream of the target cloud game to the first terminal and a real-time video stream of the target cloud game to the second terminal; if the audio sending indication information indicates that the audio data in the cloud game needs to be sent to the second terminal, in step 230, the cloud game server sends real-time audio and video streams of the target cloud game to both the first terminal and the second terminal.

Step 240, if a game control instruction sent by the second terminal for the target cloud game is received, the target cloud game is controlled according to the game control instruction, and the game control instruction is generated according to a trigger operation performed on a game screen displayed on the second terminal.

And after receiving the game picture sent by the cloud game server, the first terminal and the second terminal correspondingly display the game picture. The game screen includes a triggerable area, and the triggerable area can be used for triggering operations, such as clicking operations, double-clicking operations, sliding operations, long-pressing operations, touching operations, and the like, by a user. The triggerable area may be an area where the game control is located in the game screen, or may be an area where the virtual object controlled in the game screen is located.

In some embodiments, if the second terminal is a device with a touch screen function, the user may trigger the triggerable area in the game screen displayed by the second terminal by touching with a finger or touching with a stylus, and correspondingly, the second terminal generates the corresponding game control instruction according to the triggering operation detected in the displayed game screen.

In other embodiments, if the second terminal may access an input device such as a keyboard or a mouse, the user may trigger the triggerable area in the game screen displayed by the second terminal by using the mouse or the keyboard.

Based on the game picture displayed by the second terminal, if the user triggers the triggerable area in the game picture, the second terminal can correspondingly generate a game control instruction. The game control command may be a command instructing the virtual object to be manipulated to act, for example, a control command instructing the virtual object to adjust the body posture, groveling, walking, running, riding, jumping, attacking, throwing, or a command instructing to release skill, a command to change skin, or the like, and is not particularly limited.

In step 240, the cloud game server updates the game scene corresponding to the target cloud game correspondingly after executing the game control instruction. After step 240, the method further comprises:

Acquiring a first game picture of a target cloud game after responding to a game control instruction;

and sending the first game picture to the first terminal and the second terminal.

In this application, for convenience of distinction, a game screen acquired by the cloud game server after executing the game control instruction is referred to as a first game screen, and it can be understood that the first game screen is a game screen of the cloud game server after updating a game scene of the target cloud game in response to the game control instruction.

As above, the cloud game server may encode the first game frame and then send the encoded first game frame to the first terminal and the second terminal, where the resolutions of the first game frame sent to the first terminal and the second terminal may be the same or different, and the specific implementation process is referred to the description of the implementation process of step 230 above, which is not repeated herein.

In the related art, in order to solve the problem that complex input cannot be performed in the game process due to limited input, a scheme of enriching input in the game process through a virtual keyboard is provided, however, the scheme needs to configure different function keys in the virtual keyboard for different games, and a user is required to establish an adaptation relationship between a game picture and the virtual keyboard. In the scheme of the application, based on the abundant input functions (such as touch screen input, mouse input and keyboard input) of the second terminal, after the game images are synchronized to the first terminal and the second terminal, interaction is performed based on the game images displayed on the display screen of the second terminal, and the mapping relation between the cloud game and the virtual keyboard is not required to be established, so that the scheme of the application can be applied to control various cloud games.

In some embodiments, as shown in fig. 4, prior to step 230, the method further comprises:

in step 410, an access request sent by the first terminal or the second terminal is received, where the access request is used to instruct to associate the first terminal as a master device with the second terminal as a slave device.

That is, the access request indicates the roles of the first terminal and the second terminal, i.e., the role of the first terminal is the master device and the role of the second terminal is the slave device.

And step 420, associating the first terminal with the second terminal according to the access request.

In some embodiments, the access request is sent by a second terminal, which generates the access request by scanning access code information displayed on the first terminal, after which the second terminal correspondingly sends the access request to the cloud game server.

The presentation form of the access code information may be a bar code or a two-dimensional code, which is not particularly limited herein. The access code information may carry the device identifier of the first terminal and the network address of the cloud game server, so that the second terminal may obtain the device identifier of the first terminal and the network address of the cloud game server by scanning the access code information, and then, the second terminal generates an access request according to the device identifier of the first terminal and the device identifier of the second terminal, and sends the access request to the cloud game server according to the network address of the cloud game server. Because the access request includes the device identifier of the first terminal and the device identifier of the second terminal, the cloud game server can correspondingly associate the first terminal with the second terminal.

In some embodiments, after the first terminal is started, the first terminal may display a device access prompt, where the device access prompt is used to indicate whether other input devices need to be accessed. Fig. 5A is a schematic diagram showing the device access information displayed on the first terminal, where "whether to open the virtual input" shown in fig. 5A is the device access prompt information, and if the user selects the "yes" control, it indicates that the user selects to access other input devices.

If the user selects the "yes" option in the interface shown in fig. 5A, the first terminal may enter the display interface diagram of the access code information shown in fig. 5B. And then, the second terminal can acquire the network address of the cloud game server by scanning the displayed access code information and send an access request to the cloud game server.

Of course, if the user selects the "no" option in the interface shown in fig. 5A, the first terminal does not need to provide the access code information to the second terminal correspondingly. Further, the first terminal may report association information indicating that the first terminal does not have other associated devices to the cloud game server; or the first terminal does not add the first flag in the game start instruction.

In other embodiments, the access request may also be sent by the first terminal to the cloud server. In the case that the user needs to access the third party device, for example, the user selects the "yes" option in the interface shown in fig. 5A, the first terminal may perform device search, request to obtain the network address of the second terminal after searching for the second terminal, and then generate, by the first terminal, an access request according to the network address of the second terminal, the device identifier of the second terminal, and the device identifier of the first terminal. And the cloud game server associates the first terminal with the second terminal based on the access request, and then can acquire the network address of the second terminal from the access request so as to send a game picture of the target cloud game to the second terminal according to the network address of the second terminal.

In some embodiments, the first terminal and the second terminal may be associated before step 210, or may be associated during the running process of the target cloud game after the first terminal requests the cloud game server to run the target cloud game, which is not limited herein specifically.

In other embodiments, after the user selects the target cloud game in the cloud game selection page in the first terminal, the first terminal may access the prompt information corresponding to the display device, so that the first terminal may acquire the device identifier of the second terminal and the network address of the second terminal according to the above process, and then, the first terminal adds the device identifier of the second terminal and the network address of the second terminal to the game start instruction, so that the cloud game server may associate the first terminal and the second terminal based on the game start instruction. In this embodiment, the game start instruction sent by the first terminal to the cloud game server is an access request.

In some embodiments, after step 420, the method further comprises: and handing over the control authority of the first terminal aiming at the cloud game to the second terminal.

Because the access request indicates roles to which the first terminal and the second terminal belong, the cloud game server can correspondingly determine that the first terminal is a device originally provided with the target cloud game operation authority. Thus, the control authority of the first terminal for the target cloud game can be handed over to the second terminal based on the roles of the first terminal and the second terminal indicated by the access request.

It is understood that after the manipulation authority transfer is performed, the first terminal does not have the manipulation authority for the target cloud game running in the cloud game server, and only the second terminal has the manipulation authority for the target cloud game. After handing over the right of the first terminal to the second terminal for the target cloud game, the method further includes: and if the game control instruction sent by the first terminal aiming at the target cloud game is received, the game control instruction from the first terminal is ignored. That is, the cloud game server does not execute the game control instruction transmitted by the first terminal for the target cloud game, but executes the game control instruction transmitted by the second terminal for the target cloud game. Further, after receiving a game control instruction sent by the first terminal aiming at the target cloud game, the cloud game server returns first prompt information to the first terminal, wherein the first prompt information is used for indicating that the first terminal does not have the control authority of the target cloud game.

In the above embodiment, after the cloud game server associates the first terminal with the second terminal, the control authority of the first terminal for the target cloud game is handed over to the second terminal, so that the cloud game server only executes the game control instruction of the second terminal for the target cloud game, and the situation that the plurality of terminals control the target cloud game does not occur.

In other embodiments, after the first terminal is associated with the second terminal, the right to play the target cloud game by the first terminal may also be reserved. In other words, in this case, both the first terminal and the second terminal have the right to play the target cloud game.

In some embodiments, in the process of associating the first terminal with the second terminal, the first terminal may display control right prompting information, where the control right prompting information is used to instruct a user to select whether to handover the control right of the first terminal for the cloud game to the associated device; if the user selects an option for handing over the control right based on the control right prompt information, the cloud game server correspondingly carries out handing over of the control right after receiving the access request; otherwise, if the user selects the option of not handing over the control right based on the control right prompt information, the corresponding cloud game server reserves the control right of the first terminal to the cloud game after receiving the access request, and configures the control right for the cloud game for the second terminal associated with the first terminal correspondingly.

In some embodiments, in a case where the first terminal and the second terminal both have the right to play the target cloud game, after step 420, the method further includes: and determining priority information according to the access request, wherein the priority information is used for indicating the priority of the first terminal and the second terminal for the control authority of the target cloud game.

Specifically, priorities of the control authorities corresponding to different roles may be preset, and then priority information may be determined according to the priorities of the control authorities corresponding to different roles and the roles of the first terminal and the second terminal indicated by the access request. For example, if the priority of the control authority of the master device is set to be higher than the priority of the slave device, the priority information determined based on the access request indicates that the priority of the control authority of the first terminal is higher than the priority of the control authority of the second terminal; for another example, if the priority of the steering right of the slave device is set to be higher than the priority of the master device, the priority information determined based on the access request indicates that the priority of the steering right of the second terminal is higher than the priority of the steering right of the first terminal.

In some embodiments, after the step of determining the priority information from the access request, the method further comprises: and ordering game control instructions from the first terminal aiming at the target cloud game and game control instructions from the second terminal aiming at the target cloud game according to the priority information.

Specifically, if the cloud game server receives the game control instruction from the first terminal for the target cloud game and the game control instruction from the second terminal for the target cloud game in a period of time when the interval duration is smaller than the duration threshold, the game control instructions are ordered according to the priority indicated by the priority information, so that the cloud game server firstly executes the game control instruction sent by the terminal with the higher priority of the corresponding operation authority.

In other embodiments, in the case where the first terminal and the second terminal each have the right to play the target cloud game, the cloud game server may be further configured to execute the game control instructions from the first terminal and the second terminal in order from front to back. In this embodiment, the method further includes: storing game control instructions aiming at the target cloud game from the first terminal and game control instructions aiming at the target cloud game from the second terminal into an instruction queue according to the time sequence from first to last; game control instructions for the target cloud game are sequentially acquired from the instruction queue.

The instruction queue is used for temporarily storing game control instructions. Under the condition that the first terminal and the second terminal have the control authority of the target cloud game, after the game control instructions from the first terminal for the target cloud game and the game control instructions from the second terminal for the target cloud game are stored in the instruction queue in the order from first to last according to time, the game control instructions received by the cloud game server first are executed first.

Based on the above embodiment, it can be effectively ensured that the game control instructions of the first terminal and the second terminal for the target cloud game can be sequentially executed under the condition that the first terminal and the second terminal have the control authority of the target cloud game.

The following describes apparatus embodiments of the present application that may be used to perform the methods of the above-described embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments described above in the present application.

Fig. 6 is a block diagram of a control apparatus of a cloud game according to an embodiment of the present application, which may be applied to a cloud game server. As shown in fig. 6, the control device for the cloud game includes: a receiving module 610, configured to receive a cloud game start instruction sent by a first terminal, where the cloud game start instruction includes a game identifier of a target cloud game; a starting and picture obtaining module 620, configured to start a target cloud game in response to a cloud game starting instruction, and obtain a game picture of the target cloud game; a sending module 630, configured to send a game screen to a first terminal and a second terminal that has an association relationship with the first terminal; and the control module 640 is configured to control the target cloud game according to a game control instruction if a game control instruction sent by the second terminal for the target cloud game is received, where the game control instruction is generated according to a trigger operation performed on a game screen displayed on the second terminal.

In some embodiments, the control device of the cloud game further includes: the first coding module is used for coding the game picture according to the first resolution to obtain first picture coding data; the first resolution is the resolution corresponding to the display screen of the first terminal; in this embodiment, the sending module 630 is further configured to: and transmitting the first picture coding data to the first terminal and the second terminal so that the first terminal and the second terminal decode according to the first picture coding data to obtain a game picture with the first resolution.

In other embodiments, the control device for a cloud game further includes: the first coding module is used for coding the game picture according to the first resolution to obtain first picture coding data; the first resolution is the resolution corresponding to the display screen of the first terminal; the second coding module is used for coding the game picture according to a second resolution to obtain second picture coding data; the second resolution is the resolution corresponding to the display screen of the second terminal, and the second resolution is different from the first resolution; in this embodiment, the sending module 630 is further configured to: transmitting first picture coding data to a first terminal so that the first terminal decodes according to the first picture coding data to obtain a game picture with first resolution; and transmitting the second picture coding data to the second terminal so that the second terminal decodes the second picture coding data to obtain a game picture with the second resolution.

In some embodiments, the control device of the cloud game further includes: the access request receiving module is used for receiving an access request sent by the first terminal or the second terminal, and the access request is used for indicating the first terminal serving as the master device to be associated with the second terminal serving as the slave device; and the association module is used for associating the first terminal with the second terminal according to the access request.

In other embodiments, the control device for a cloud game further includes: the priority information determining module is used for determining priority information according to the access request, and the priority information is used for indicating the priority of the first terminal and the second terminal for the control authority of the target cloud game.

In some embodiments, the control device of the cloud game further includes: and the ordering module is used for ordering the game control instruction aiming at the target cloud game from the first terminal and the game control instruction aiming at the target cloud game from the second terminal according to the priority information.

In other embodiments, the control device for a cloud game further includes: the instruction storage module is used for storing game control instructions aiming at the target cloud game from the first terminal and game control instructions aiming at the target cloud game from the second terminal into the instruction queue according to the time sequence from first to last; and the instruction acquisition module is used for sequentially acquiring game control instructions aiming at the target cloud game from the instruction queue.

Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device may be a cloud game server. As shown in fig. 7, the electronic device may include: a processor 701, such as a CPU (Central Processing Unit ), a network interface 704, a user interface 703, a memory 705, a communication bus 702. Wherein the communication bus 702 is used to enable connected communications between these components. The user interface 703 may be used to connect a Display screen (Display), an input unit such as a Keyboard (Keyboard). The network interface 704 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 705 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 705 may alternatively be a storage device separate from the aforementioned processor 701.

It will be appreciated by those skilled in the art that the configuration of the electronic device shown in fig. 7 is not limiting of the electronic device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.

As shown in fig. 7, an operating system, a network communication module, a user interface module, and a program implementing a control method of a cloud game may be included in a memory 705 as one type of computer-readable storage medium.

In the electronic device shown in fig. 7, the network interface 704 is mainly used for communication connection with other devices. The user interface 703 is mainly used for connecting to a user terminal (e.g., the first terminal and the second terminal above) and performing data communication with the user terminal; and the processor 701 may be used to call a program for implementing a control method of a cloud game stored in the memory 705 and execute the steps of the control method of a cloud game in any of the method embodiments above.

According to an aspect of the embodiments of the present application, there is provided a computer-readable storage medium having computer-readable instructions stored thereon, which when executed by a processor, implement a control method of a cloud game in any of the method embodiments above.

It should be noted that, the computer readable medium shown in the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium may be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-Only Memory (ROM), an erasable programmable read-Only Memory (Erasable Programmable Read Only Memory, EPROM), flash Memory, an optical fiber, a portable compact disc read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present application, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

According to an aspect of the embodiments of the present application, there is provided a computer program product comprising computer instructions which, when executed by a processor, implement a method of controlling a cloud game as in any of the method embodiments above.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Where each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present application may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a usb disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, a touch terminal, or a network device, etc.) to perform the method according to the embodiments of the present application.

Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains.

It is to be understood that the present application is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims

1. A control method of a cloud game, which is applied to a cloud game server, the method comprising:

receiving a cloud game starting instruction sent by a first terminal, wherein the cloud game starting instruction comprises a game identifier of a target cloud game;

responding to the cloud game starting instruction, starting the target cloud game, and acquiring a game picture of the target cloud game;

sending the game picture to the first terminal and a second terminal with an association relation with the first terminal;

and if a game control instruction sent by the second terminal for the target cloud game is received, controlling the target cloud game according to the game control instruction, wherein the game control instruction is generated according to a triggering operation performed on the game picture displayed on the second terminal.

2. The method of claim 1, wherein before the game screen is transmitted to the first terminal and a second terminal having an association relationship with the first terminal, the method further comprises:

encoding the game picture according to a first resolution to obtain first picture encoding data; the first resolution is the resolution corresponding to the display screen of the first terminal;

The sending the game picture to the first terminal and a second terminal having an association relationship with the first terminal includes:

and sending the first picture coding data to the first terminal and the second terminal so that the first terminal and the second terminal decode according to the first picture coding data to obtain a game picture with first resolution.

3. The method of claim 1, wherein before the game screen is transmitted to the first terminal and a second terminal having an association relationship with the first terminal, the method further comprises:

encoding the game picture according to a second resolution to obtain second picture encoding data; the second resolution is the resolution corresponding to the display screen of the second terminal, and the second resolution is different from the first resolution;

Transmitting the first picture coding data to the first terminal so that the first terminal decodes the first picture coding data to obtain a game picture with a first resolution;

and sending the second picture coding data to the second terminal so that the second terminal decodes the second picture coding data to obtain a game picture with the second resolution.

4. The method of claim 1, wherein before the game screen is transmitted to the first terminal and a second terminal having an association relationship with the first terminal, the method further comprises:

receiving an access request sent by the first terminal or the second terminal, wherein the access request is used for indicating the first terminal serving as a master device to be associated with the second terminal serving as a slave device;

and associating the first terminal with the second terminal according to the access request.

5. The method of claim 4, wherein after the associating the first terminal with the second terminal according to the access request, the method further comprises:

and handing over the control authority of the first terminal for the cloud game to the second terminal.

6. The method of claim 5, wherein after the handing over the right to play the cloud game by the first terminal to the second terminal, the method further comprises:

and if the game control instruction sent by the first terminal aiming at the target cloud game is received, the game control instruction from the first terminal is ignored.

7. The method of claim 4, wherein after the associating the first terminal with the second terminal according to the access request, the method further comprises:

and determining priority information according to the access request, wherein the priority information is used for indicating the priority of the first terminal and the second terminal for the control authority of the target cloud game.

8. The method of claim 7, wherein the method further comprises:

and ordering the game control instructions of the first terminal aiming at the target cloud game and the game control instructions of the second terminal aiming at the target cloud game according to the priority information.

9. The method of claim 4, wherein the access request is sent by the second terminal, the second terminal generating the access request by scanning access code information displayed on the first terminal.

10. The method according to claim 1, wherein the method further comprises:

according to the sequence of time from first to last, storing game control instructions aiming at a target cloud game from the first terminal and game control instructions aiming at the target cloud game from the second terminal into an instruction queue;

and sequentially acquiring game control instructions aiming at the target cloud game from the instruction queue.

11. The method of claim 1, wherein, if the game control instruction sent by the second terminal for the target cloud game is received, after the target cloud game is controlled according to the game control instruction, the method further comprises:

acquiring a first game picture of the target cloud game after responding to the game control instruction;

12. A control device for a cloud game, the control device being applied to a cloud game server, the device comprising:

the cloud game starting device comprises a receiving module, a first terminal and a second terminal, wherein the receiving module is used for receiving a cloud game starting instruction sent by the first terminal, and the cloud game starting instruction comprises a game identifier of a target cloud game;

The starting and picture obtaining module is used for responding to the cloud game starting instruction, starting the target cloud game and obtaining a game picture of the target cloud game;

a sending module, configured to send the game screen to the first terminal and a second terminal having an association relationship with the first terminal;

and the control module is used for controlling the target cloud game according to the game control instruction if receiving the game control instruction sent by the second terminal aiming at the target cloud game, wherein the game control instruction is generated according to the triggering operation performed by the game picture displayed on the second terminal.

13. An electronic device, comprising:

a processor;

a memory having stored thereon computer readable instructions which, when executed by the processor, implement the method of any of claims 1 to 11.

14. A computer readable storage medium having stored thereon computer readable instructions which, when executed by a processor, implement the method of any of claims 1 to 11.