CN113975797A

CN113975797A - Cloud game interaction method and device, storage medium and electronic equipment

Info

Publication number: CN113975797A
Application number: CN202111306949.0A
Authority: CN
Inventors: 林子斌; 周谱德
Original assignee: Beijing ByteDance Network Technology Co Ltd
Current assignee: Beijing ByteDance Network Technology Co Ltd
Priority date: 2021-11-05
Filing date: 2021-11-05
Publication date: 2022-01-28

Abstract

The disclosure relates to a cloud game interaction method, a cloud game interaction device, a storage medium and an electronic device, which are used for overcoming the limitations of the cloud game interaction method in the related art. The method comprises the following steps: displaying a plurality of game display areas on a screen of the cloud game terminal in a split screen manner; responding to game selection operation, and determining a target cloud game corresponding to at least one target area in the plurality of game display areas; sending a game starting instruction to the cloud game server, wherein the game starting instruction is used for starting the target cloud game; acquiring streaming media data sent by the cloud game server, wherein the streaming media data are generated by the cloud game server according to a game picture confluence of the target cloud game; and displaying the picture corresponding to the streaming media data.

Description

Cloud game interaction method and device, storage medium and electronic equipment

Technical Field

The present disclosure relates to the field of cloud game technologies, and in particular, to a cloud game interaction method and apparatus, a storage medium, and an electronic device.

Background

With the increasing desire for game diversity, it is desired to propose new game modes, such as a split-screen game, which is understood to be a game provided to a plurality of players on one device, so that pictures of the game of the plurality of players are presented on a display screen of the device.

However, the cloud game interaction method in the related art has great limitations, for example, games supporting multi-screen operation are small games with low performance requirements rather than high performance requirements, and games with high performance requirements relatively need higher performance equipment to be implemented.

Disclosure of Invention

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

In a first aspect, the present disclosure provides a cloud game interaction method, applied to a cloud game terminal, the method including:

displaying a plurality of game display areas on a screen of the cloud game terminal in a split screen manner;

responding to game selection operation, and determining a target cloud game corresponding to at least one target area in the plurality of game display areas;

sending a game starting instruction to the cloud game server, wherein the game starting instruction is used for starting the target cloud game;

acquiring streaming media data sent by the cloud game server, wherein the streaming media data are generated by the cloud game server according to a game picture confluence of the target cloud game;

and displaying the picture corresponding to the streaming media data.

In a second aspect, the present disclosure provides a cloud game interaction method applied to a cloud game server, the method including:

receiving a game starting instruction sent by a cloud game terminal, wherein the game starting instruction is a game starting instruction of a target cloud game corresponding to at least one target area in a plurality of game display areas;

starting the target cloud game according to the game starting instruction;

merging to generate streaming media data according to the game picture of the target cloud game;

and sending the streaming media data to the cloud game terminal so that the cloud game terminal displays the streaming media data.

In a third aspect, the present disclosure provides a cloud game interaction apparatus, applied to a cloud game terminal, the apparatus including:

the cloud game terminal comprises a first display module, a second display module and a display module, wherein the first display module is used for displaying a plurality of game display areas on a screen of the cloud game terminal in a split screen mode;

the target cloud game determining module is used for responding to game selection operation and determining a target cloud game corresponding to at least one target area in the plurality of game display areas;

a game starting instruction sending module, configured to send a game starting instruction to the cloud game server, where the game starting instruction is used to start the target cloud game;

the streaming media data acquisition module is used for acquiring streaming media data sent by the cloud game server, and the streaming media data is generated by the cloud game server according to a game picture confluence of the target cloud game;

and the second display module is used for displaying the picture corresponding to the streaming media data.

In a fourth aspect, the present disclosure provides a cloud game interaction apparatus, applied to a cloud game server, the apparatus comprising:

the game starting instruction receiving module is used for receiving a game starting instruction sent by the cloud game terminal, and the game starting instruction is a game starting instruction of a target cloud game corresponding to at least one target area in the plurality of game display areas;

the starting module is used for starting the target cloud game according to the game starting instruction;

the confluence module is used for generating streaming media data according to the game picture of the target cloud game;

and the streaming media data sending module is used for sending the streaming media data to the cloud game terminal so as to display the streaming media data by the cloud game terminal.

In a fifth aspect, the present disclosure provides a computer readable medium having stored thereon a computer program which, when executed by a processing apparatus, performs the steps of the method of the first or second aspect.

In a sixth aspect, the present disclosure provides an electronic device comprising:

a storage device having a computer program stored thereon;

processing means for executing the computer program in the storage means to carry out the steps of the method of the first aspect or the second aspect.

Through the technical scheme, the cloud game terminal can display a plurality of game display areas on a screen in a split-screen mode, then after a target cloud game corresponding to at least one target area in the plurality of game display areas is determined in response to game selection operation, a game starting instruction for starting the target cloud game is sent to the cloud game server, the cloud game server starts and operates the target cloud game to generate a game picture corresponding to the target cloud game, and streaming media data generated according to confluence of the game pictures corresponding to the target cloud game are sent to the cloud game terminal for displaying, as the operation process of the game is carried out on the cloud game server, the cloud game terminal is not required to provide processing capacity to operate the game, and the cloud game terminal can realize the capacity of a multi-player split-screen game only by displaying the streaming media data, so that the performance requirement on the game terminal is greatly reduced, meanwhile, the cloud game server has higher performance, so the cloud game interaction method disclosed by the embodiment of the disclosure is not limited to leisure mini games any more, is suitable for multiple types of games, and has a wide application range.

Additional features and advantages of the disclosure will be set forth in the detailed description which follows.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale. In the drawings:

fig. 1 is a flow chart illustrating a cloud game interaction method according to an exemplary embodiment of the present disclosure;

fig. 2 is a schematic diagram illustrating a screen displayed on a screen of a cloud game terminal according to an exemplary embodiment of the present disclosure;

FIG. 3 is a schematic diagram illustrating an association between a game display area and an instruction input device according to an exemplary embodiment of the present disclosure;

fig. 4 is a flow chart illustrating another cloud game interaction method according to an exemplary embodiment of the present disclosure;

FIG. 5 is an interaction flow diagram illustrating a cloud gaming interaction method according to an exemplary embodiment of the present disclosure;

FIG. 6 is a scene architecture diagram of a split-screen gaming system shown in accordance with an exemplary embodiment of the present disclosure;

fig. 7 is a block diagram illustrating a cloud game interaction device according to an exemplary embodiment of the present disclosure;

fig. 8 is a block diagram illustrating another cloud game interaction device according to an exemplary embodiment of the present disclosure;

fig. 9 is a block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.

It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.

It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.

The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.

As a background, the cloud game interaction method in the related art has a great limitation. In some cases, the function of split-screen game can be realized by running multiple game instances simultaneously through virtualization technology, but this requires the device to have strong performance and can be called virtualization technology. In other cases, for a device with a general performance, it is not possible to support running multiple game instances simultaneously, and usually only one game instance is supported to run, and a multi-player split-screen operation function is supported in the game instance. Therefore, how to realize a relatively universal cloud game interaction method, reduce the requirements on equipment performance and games, and is a problem to be solved.

Prior to specifically describing the embodiments of the present disclosure, a description will be given of a related art to which the embodiments of the present disclosure are applied.

Cloud games, which may also be called game On Demand (Gaming), are an online game technology based On cloud computing technology. Cloud gaming technology enables light-end devices (thinclients) with relatively limited graphics processing and data computing capabilities to run high-quality games. In the cloud game environment, the game is not in a player game terminal, but runs in a cloud game server in the cloud, and the cloud game server renders a game scene into a video and audio stream which is transmitted to the player game terminal through a network. The player game terminal does not need to have strong graphic operation and data processing capacity, and only needs to have basic streaming media playing capacity and capacity of acquiring player input instructions and sending the instructions to the cloud game server.

Referring to fig. 1, fig. 1 is a flowchart illustrating a cloud game interaction method according to an exemplary embodiment of the present disclosure, where the cloud game interaction method may be applied to a cloud game terminal, and referring to fig. 1, the cloud game interaction method includes:

and step 110, displaying a plurality of game display areas on the screen of the cloud game terminal in a split screen mode.

In the embodiment of the disclosure, the cloud game terminal may be a terminal having a streaming media playing function, and has no special requirement on the terminal performance. For example, it may be a TV, game box, computer, tablet, smart display device, etc. These terminals may become cloud gaming terminals by installing cloud gaming applications.

In the embodiment of the disclosure, a plurality of game display areas can be displayed on a screen of the cloud game terminal in a split-screen manner, wherein each game display area is used for displaying one cloud game.

Step 120, in response to the game selection operation, determining a target cloud game corresponding to at least one target area in the plurality of game display areas.

The game selection operation is an operation of selecting a target cloud game.

The target cloud game is a cloud game corresponding to a target area selected in response to a game selection operation.

In the embodiment of the disclosure, a game selection interface may be displayed in the game display area, and the game selection interface is provided for the player to initiate a game selection operation.

The game selection interface provided to the player to initiate the game selection can take a variety of forms, among others.

Optionally, the game selection interface may exist in one of the plurality of game display areas, so that the cloud game corresponding to the selected target area may be determined in response to a game selection operation for the game selection interface in the game display area. In this case, the game selection operation may include a display area selection operation and a game type selection operation, so that a target cloud game corresponding to at least one target area of the plurality of game display areas may be determined in response to the game selection operation and the game type selection operation.

Wherein the target area may be at least one of the plurality of game display areas. That is, the target area may be the entire game display area of the currently set lower split screen display of the cloud game terminal, or may be a part of the entire game display area of the currently set lower split screen display of the cloud game terminal. For example, assuming that the total game display areas displayed in a split screen manner are 4 under the current setting of the cloud game terminal, the target areas may be 1, 2, 3, or 4, and the like, and the maximum number of the target areas depends on the number of the game display areas displayed in the split screen manner.

Alternatively, the game selection interface may be present in each of the plurality of game display areas, so that the cloud game corresponding to the selected target area may be determined in response to the game selection operation for each of the game display areas. In this case, the game selection operation may include a game type selection operation, wherein the target area may be at least one of the plurality of game display areas.

For example, assuming that 4 game display areas are displayed on the screen of the cloud game terminal in a split screen manner, game selection interfaces may be respectively displayed in the 4 game display areas, so that a target cloud game corresponding to a selected target area in the 4 game display areas may be determined by responding to a game selection operation in each game selection interface.

In the above embodiments, the player initiated game selection operation may take a variety of forms. Optionally, the screen of the cloud game terminal is a touch screen, and at this time, the game selection operation may be initiated by touching the screen of the cloud game terminal. Alternatively, the game selection operation may be initiated by an external command input device, such as a mouse, keyboard, gamepad, or the like. Alternatively, the game selection operation may also be initiated by voice, for example, sending a voice "select game a in game display area 1".

Step 130, a game starting instruction is sent to the cloud game server, and the game starting instruction is used for starting the target cloud game.

After determining a target cloud game corresponding to the target area, the cloud game terminal may generate a game starting instruction, and then may send the game starting instruction to the cloud game server, and after receiving the game starting instruction, the cloud game server may start the corresponding target cloud game based on the game starting instruction.

Wherein, the game starting instruction can be of various types. Alternatively, the game device may be a single instruction composed of sub-game starting instructions for the respective target games, or may be an instruction set composed of sub-game starting instructions for the respective target games.

In addition, it should be further noted that, in the embodiment of the present disclosure, the target cloud game corresponding to at least one target area may be the same game or different games.

In one example, as shown in fig. 2, for a screen displayed on a screen of a cloud game terminal, in fig. 2, 4 game display areas, namely an area 21, an area 22, an area 23, and an area 24, are displayed in a split screen manner, that is, the number of all players allowed to play a split screen game under the current setting of the cloud game terminal is 4, and a game selection interface is displayed in each of the 4 game display areas. Assuming that 3 players initiate game selection operations in the area 21, the area 22, and the area 23 respectively, and the game selected respectively is A, B, C, at this time, the cloud game terminal may determine that the target cloud game corresponding to the target area including the area 21 is a, the target cloud game corresponding to the target area including the area 22 is B, and the target cloud game corresponding to the target area including the area 23 is C, and then the cloud game terminal may send a game start instruction to the cloud game server, at this time, the game start instruction may include a sub-game start instruction for starting the a game in the target area 21, a sub-game start instruction for starting the B game in the target area 22, and a sub-game start instruction for starting the C game in the target area 23.

Step 140, acquiring streaming media data sent by the cloud game server, wherein the streaming media data is generated by the cloud game server according to the game picture confluence of the target cloud game.

And 150, displaying a picture corresponding to the streaming media data.

In the embodiment of the disclosure, after receiving a game starting instruction, the cloud game server may start each target cloud game, and after starting each target cloud game, the cloud game server may merge and splice game pictures of each target cloud game to generate corresponding streaming media data, and then, the cloud game server may send the streaming media data to the cloud game terminal.

As can be seen from the foregoing, the cloud game terminal may be a terminal having a basic streaming media playing function, so that after receiving the streaming media data sent by the cloud game server, the cloud game terminal may display a picture corresponding to the streaming media data. It can be understood that, when the cloud game terminal displays the picture corresponding to the streaming media data, since the streaming media data is generated by merging the game pictures of the target cloud game by the cloud game server, the displayed game pictures are displayed in a split manner according to the game display area.

In addition, in order to facilitate data transmission between the cloud game terminal and the cloud game server, in some embodiments, the cloud game server may further perform operations such as compression and encoding on the generated streaming media data, and then transmit the streaming media data obtained after the operations such as compression and encoding to the cloud game terminal.

The streaming media data may be streaming media data corresponding to a video stream, or streaming media data corresponding to an image frame. That is, the game picture of each target cloud game may be a picture in a video stream format or a picture in an image frame format.

In some implementations, the streaming media data can also include audio data.

There are many cases where the server generates streaming media data from the merged scenes of the games selected by the players.

In some cases, when the target area is all game display areas that are currently set by the cloud game terminal and displayed in a split screen manner, that is, all game display areas start the cloud game, the server may start the pictures of the target games corresponding to all game display areas, respectively, so as to merge the pictures of the target games corresponding to the game display areas, respectively, to obtain streaming media data.

In other cases, when the target area is a part of the game display area of all the game display areas currently set by the cloud game terminal for split-screen display, that is, only the target area starts the game, and the rest of the game display areas do not start the game, the server may generate a picture corresponding to the target area, and the area not selected for starting does not correspond to the game picture, so that, in order to ensure the integrity of the picture corresponding to the streaming media data generated by merging, the cloud game server may replace the positions of the pictures not corresponding to the game pictures with some preset pictures, and thus, in this case, the cloud game server may merge the preset pictures and the pictures corresponding to the target cloud game to obtain the streaming media data.

In order to distinguish from the normal game picture, the preset picture may be some pictures which are not commonly used, such as a black screen picture, a white board picture or a flower screen picture.

Therefore, whether the target area is the whole game display area of the split screen display currently set by the cloud game terminal or a part of the game display area in the whole game display area, the streaming media data generated by merging at least comprises the game picture corresponding to the target cloud game.

Through the mode, the cloud game terminal can display a plurality of game display areas on a screen in a split screen mode, then after a target cloud game corresponding to at least one target area in the plurality of game display areas is determined in response to game selection operation, a game starting instruction for starting the target cloud game is sent to the cloud game server, the cloud game server starts and runs the target cloud game to generate a game picture corresponding to the target cloud game, and streaming media data generated according to the confluence of the game pictures corresponding to the target cloud game are sent to the cloud game terminal for displaying, as the running process of the game is carried out on the cloud game server, the cloud game terminal is not required to provide processing capacity to run the game, and the cloud game terminal only needs to display the streaming media data to realize the capacity of a multi-player split screen game, the performance requirement on the game terminal is greatly reduced, meanwhile, the cloud game server has higher performance, so the cloud game interaction method disclosed by the embodiment of the disclosure is not limited to leisure mini games any more, is suitable for multiple types of games, and has a wide application range.

In some implementations, the cloud gaming terminal may also send layout styles for multiple game display areas to the cloud gaming server. The layout style is used for the cloud game server to generate the streaming media data according to the layout style, so that the position of the game picture of the target cloud game on the picture corresponding to the streaming media data is consistent with the position of at least one target area on the screen of the cloud game terminal.

The layout style can be understood as the arrangement condition of the game display area.

In the embodiment of the disclosure, after receiving the layout styles of the plurality of game display areas sent by the cloud game terminal, the cloud game server may generate streaming media data according to the layout styles and the game screen confluence of the target cloud game. And the position of the game picture of the target cloud game in the picture corresponding to the streaming media data is consistent with the position of at least one target area on the screen of the cloud game terminal.

Continuing to refer to fig. 2, at this time, the layout style of the game display area is a style presenting a 4-grid, specifically, the area 21 is arranged at the upper left corner, the area 22 is arranged at the upper right corner, the area 23 is arranged at the lower left corner, and the area 24 is arranged at the lower right corner. Then, in the pictures corresponding to the streaming media data generated by the server according to the layout style and the confluence of the game pictures of the target cloud game, the picture of the game corresponding to the area 21 is arranged at the upper left corner, the picture of the game corresponding to the area 22 is arranged at the upper right corner, the picture of the game corresponding to the area 23 is arranged at the lower left corner, and the picture of the game corresponding to the area 24 is arranged at the lower right corner.

In some cases, if some areas do not initiate game selection operation, at this time, the area does not correspond to a game screen, and at this time, a preset screen may be used to replace the screen of the area in the first merged screen.

Continuing with reference to fig. 2, and following the foregoing example, assuming that 3 players have initiated game selection operations in the area 21, the area 22, and the area 23, respectively, and the game selected respectively is A, B, C, at this time, the cloud game terminal may determine that the target cloud game corresponding to the target area including the area 21 is a, the target cloud game corresponding to the target area including the area 22 is B, and the target cloud game corresponding to the target area including the area 23 is C, in which case, when streaming media data is generated according to the layout pattern and the game screen confluence of the target cloud game, the cloud game server may arrange the screen corresponding to the area 21 in the upper left corner, the screen corresponding to the area 22 in the upper right corner, the screen corresponding to the area 23 in the lower left corner, and since the area 24 has not initiated a game selection operation, the area 24 should not have a game screen, the cloud game server can arrange a preset picture at the lower right corner.

By adopting the mode, the layout styles of the plurality of game display areas are sent to the cloud game server, so that when streaming media data are generated at the confluence of the cloud game server, the game pictures of the target cloud game can be arranged according to the layout styles of the game display areas displayed on the screen of the cloud game terminal, the stability of the positions of the game pictures displayed during split-screen game is ensured, each player can conveniently and quickly position the game pictures, and the game experience of the players is improved.

In some embodiments, the layout style of the plurality of game display areas may be player set. Accordingly, the cloud game interaction method shown in fig. 1 further includes the steps of: determining the number of the plurality of game display areas in response to a number selection operation; determining a layout style of the plurality of game display areas in response to a layout selection operation; in this case, the step of displaying the plurality of game display areas in the screen of the cloud game terminal in a split manner as shown in fig. 1 may include: displaying the plurality of game display areas on a screen of the cloud game terminal based on the determined number and layout style of the plurality of game display areas.

In the cloud game terminal, a setting interface may be provided in which a number selection option for determining the number of game display areas and a layout style selection option for determining a layout style of the game display areas are provided.

The cloud game terminal may determine the number of the plurality of game display regions in response to the number selection operation with respect to the number selection option after the player operates the number selection option, and may determine the layout style of the plurality of game display regions in response to the layout selection operation with respect to the layout style selection option after the player operates the layout style selection option, and may display the plurality of game display regions in the layout style on the screen of the cloud game terminal based on the determined number and layout style of the plurality of game display regions.

It should be noted that the number selection option and the layout style selection option may be in the same setting interface, or may not be in the same setting interface, for example, the number selection option is displayed first, and after the player operates the number selection option, the interface is switched to the interface displaying the layout style selection option.

Illustratively, the number selection option may be a number of people input control, which may input a number within a threshold range, e.g., 1-6, to correspondingly set 1-6 game display areas. Taking the input number as 4 as an example, the selection interface can be switched to a layout style of 4 game display areas, corresponding to 4 players, there may be 3 layout styles from left to right, from top to bottom, or 4 grids, at this time, three layout styles may be provided in the interface for selection, that is, the layout style selection option may be a style selection control, for example, after the player selects the layout style of 4 grids, 4 game display areas may be displayed in the layout style of 4 grids on the screen of the cloud game terminal.

By adopting the mode, the number selection operation and the layout selection operation are initiated by the players, the screen splitting game requirements of players with different numbers can be met, the layout requirements of the users are further met by selecting the proper screen layout, and the game experience of the players is improved while the screen splitting game is realized.

In some embodiments, the cloud game interaction method shown in fig. 1 further includes the steps of: the method comprises the steps of obtaining a game operation instruction input by a game display area corresponding to any target cloud game, and sending the game operation instruction to a cloud game server so that the cloud game server can control the running of the corresponding game according to the game operation instruction.

After the cloud game terminal displays the streaming media data, the player who has started the game can operate the game display area corresponding to the player to play the game, at the moment, the operation of any player in the players on the game display area corresponding to the player can generate a game operation instruction, so that the cloud game terminal can acquire the game operation instruction input by aiming at the game display area corresponding to any target cloud game and send the game operation instruction to the cloud game server, the cloud game server controls the operation of the corresponding game according to the game operation instruction, and second updated streaming media data are generated according to the operation picture of the corresponding game.

By way of example, suppose players a, b, c respectively release the keys by clicking on the skill release button on the gamepad, skill releasing operation is input to the game display area corresponding to the cloud game terminal, at this time, the cloud game terminal can obtain game operation instructions corresponding to the skill releasing operation of the players a, b and c, thereby sending game operation instructions corresponding to skill release operations of the players a, b and c to the cloud game server, controlling the characters in the games corresponding to the players a, b and c to release the skills by the cloud game server according to the game operation instructions, thereby, a video picture of the game character corresponding to the players a, b, c is obtained, and at this time, the cloud game server can generate second updated streaming media data according to the video pictures released by the game skills corresponding to the players a, b and c and the preset pictures. After the second updated streaming media data is generated by the confluence, the second updated streaming media data can be sent to the cloud game terminal, so that the cloud game terminal can display the second updated streaming media data after receiving the second updated streaming media data.

It should be noted that, in the embodiment of the present disclosure, the game operation instruction input for each game display area may be an operation instruction of a different game, that is, the game server in the embodiment of the present disclosure may include a plurality of game servers corresponding to different games, for example, if the player a starts the game a, the game operation instruction corresponding to the player a is sent to the game server corresponding to the game a, if the player B starts the game B, the game operation instruction corresponding to the player B is sent to the game server corresponding to the game B, and so on. Therefore, the cloud game interaction method can support split screen playing of different games.

In some embodiments, the cloud game interaction method shown in fig. 1 further includes the steps of: determining the incidence relation between each game display area and each instruction input device of the cloud game terminal; and sending the association relation to the cloud game server.

As can be seen from the foregoing, the instruction received by the cloud game terminal may be input through an instruction input device, and in order to enable the cloud game server to accurately control the operation of the game corresponding to each game display area, the cloud game terminal may first determine an association relationship between each game display area and each instruction input device of the cloud game terminal, and then send the association relationship to the cloud game.

For example, referring to fig. 3, assuming that the area 31 is associated with the instruction input device 311, the area 32 is associated with the instruction input device 312, the area 33 is associated with the instruction input device 313, the area 34 is associated with the instruction input device 314, and the area 31, the area 32, and the area 33 start a game, the cloud game terminal may obtain the association relationship and send the association relationship to the cloud game terminal, and then after receiving a certain game operation instruction, the cloud game server may determine the instruction input device corresponding to the game operation instruction, for example, after receiving the game operation instruction 1, the cloud game server determines that the corresponding instruction input device is the instruction input device 311, and at this time, the cloud game server may directly control the running of the game corresponding to the area 31 according to the game operation instruction 1. Similarly, the process of controlling the running of the corresponding game by the server according to the operation instruction of other sub-games is similar. In addition, after controlling the running of the corresponding game, the cloud game server can generate corresponding streaming media data according to the running picture of the corresponding game. The process of generating the streaming media data by the cloud game server is similar to the foregoing description, and is not repeated here.

In some embodiments, the association relationship between each game display area and each instruction input device of the cloud game terminal may be obtained by pre-configuration. That is, the setting interface provided by the cloud game terminal may include an association selection option for determining a correspondence between the instruction input device and the game display area, in addition to the number selection option and the layout style selection option. The command input devices can be matched and the command input devices can be distributed through the selection options of the association relation, so that the operations of the command input devices are isolated from each other. Alternatively, the command input device may be an externally connected command input device such as a joystick, a keyboard, a mouse, or the like.

In some embodiments, the cloud game server may include an instruction distribution server, a game server, and a merge server, where the instruction distribution server is configured to receive an operation instruction sent by the cloud game terminal, and then send the operation instruction to a game server corresponding to a game in a corresponding game display area according to an association relationship between each game display area and each instruction input device of the cloud game terminal, each game server may control an operation of the corresponding game according to the operation instruction after obtaining the corresponding operation instruction, and the merge server may be configured to receive an operation screen of the game sent by each game server, merge the operation screens of the game, and obtain corresponding streaming media data.

By adopting the mode, the association relation between each game display area and each instruction input device of the cloud game terminal is sent to the cloud game server, so that the cloud game server can quickly and accurately control the operation of the game corresponding to the corresponding game display area according to each game operation instruction.

In addition, considering that when a screen-splitting game is performed, a plurality of players share one screen, and a game corresponding to each player only occupies a part of the screen, compared with a mode in which one screen displays one game, a display area of the game is reduced, so that a display effect of the game corresponding to each player is reduced to a certain extent, and therefore, in order to reduce an influence of the reduction of the display area on the display effect of the game corresponding to the player, in some embodiments, the cloud game interaction method shown in fig. 1 further includes the steps of: the method comprises the steps of obtaining a zooming instruction input aiming at any game display area, sending the zooming instruction to a cloud game server, enabling the cloud game server to zoom the size of a game picture of a corresponding cloud game according to the zooming instruction, obtaining a zoomed game picture of the corresponding cloud game, and generating first updating streaming media data according to confluence of the zoomed game pictures of the corresponding cloud game.

In the embodiment of the disclosure, any game player can input a scaling instruction for the game display area of the game player, so that after a certain player inputs a scaling instruction for the game display area, the cloud game terminal can acquire the scaling instruction input for any game display area and send the scaling instruction to the cloud game server.

After receiving the scaling instruction, the cloud game server may scale the size of the corresponding game screen to obtain a scaled game screen corresponding to the game, and generate first updated streaming media data according to the scaled game screen confluence of the corresponding game.

In the embodiment of the present disclosure, the zoom instruction is an instruction for zooming the game screen corresponding to the game display area. It is to be understood that the zoom instruction may specifically be a zoom-out instruction as well as a zoom-in instruction.

When the scaling instruction is a scaling instruction, scaling the size of the corresponding game screen may be an instruction to scale down the game screen in the game display area corresponding to the scaling instruction by a certain factor, for example, by 1 factor, by 2 factors, by 5 factors, and adaptively scale up the game screens in other game display areas by a certain factor, where the vacated position of the scaled-down game screen is occupied by the adaptively scaled-up game screen, and the cloud game server may generate the first updated streaming media data according to the confluence of the scaled-down game screen and the adaptively scaled-up game screen. In one case, when the reduction factor reaches the first target factor, a certain picture can be regarded as hidden, i.e., no longer appears in the merged picture, so that the game pictures of other games are adaptively enlarged to occupy the position of the hidden game picture.

When the zoom instruction is a zoom-in instruction, the zooming in or out of the game screen in the game display area corresponding to the zoom-in instruction may be an instruction to zoom in the game screen in the game display area corresponding to the zoom-in instruction by a predetermined factor, for example, by 1 time, 2 times, 5 times, or the like, and adaptively zoom out the game screens in other display areas by a predetermined factor, and the zoomed-in game screen may occupy the position vacated by the zoomed-in game screen, and the cloud game server may generate the first updated streaming media data by merging the zoomed-in game screen and the adaptively zoomed-out game screen. In one case, when the magnification reaches the second target magnification, a certain picture can be regarded as a full screen display, i.e. the whole merged picture is the game picture of the corresponding game.

The zoom function of the disclosed embodiments is described in detail below with a few possible scenarios.

For example, taking 2 players to perform a cloud game as an example, after a task of a game character of a game selected by player 1 fails, a game display area corresponding to player 1 is in a task failure state of a grey screen, and at this time, it does not have much meaning to display a game picture corresponding to the game, at this time, player 1 may initiate a reduction instruction input for the game display area of itself, so as to reduce the game picture of the game selected by itself, so as to vacate a larger display area for player 2, so that a game picture of player 2 in progress can have a larger display area to display, thereby increasing the area of the display area of the meaningful game picture.

For another example, if 2 players perform a cloud game, then when the game character of the game selected by the player 2 has highlight time, the player 2 may enlarge the game screen corresponding to the highlight time to display the game screen with emphasis, and at this time, the player 2 may initiate an enlargement instruction input to the game display area of the player 2 to enlarge the game screen display of the game selected by the player 2, so that the game screen display of the cloud game terminal can be displayed in a larger area to highlight the game screen of the player 2, thereby increasing the area of the display area of the game screen that makes sense.

By adopting the mode, the player can send the zooming instruction to the server according to the requirement, so that the significant game picture can be displayed in a larger area at the cloud game terminal, and the influence of the reduction of the game picture display area on the display effect of the game corresponding to the player in the split-screen game is reduced.

With the above, when the target area is a part of the game display areas in all the game display areas currently set by the cloud game terminal for split-screen display, that is, when only a part of players select a game to start, and a part of players do not select a game to start, the cloud game server may merge the preset picture and the game picture of the target cloud game corresponding to the target area to obtain streaming media data. At this time, if the streaming media data is directly displayed at the cloud game terminal, a preset picture is displayed in the remaining game display area where the game is not started, and in order to avoid displaying the preset picture and influencing a player who does not start the game to continue initiating a game selection operation, in some embodiments, the step of displaying a picture corresponding to the streaming media data in the cloud game interaction method shown in fig. 1 may include: under the condition that a preset picture exists in pictures corresponding to the streaming media data, determining a corresponding target game display area according to the position of the preset picture, and replacing the preset picture with a picture currently displayed in the target game display area to obtain a new display picture, wherein the preset picture is a picture preset by the cloud game server for a game display area waiting for starting a game on a screen of the cloud game terminal; and displaying the new display picture.

In the embodiment of the disclosure, when a game display area where a game is not selected to be started exists at the cloud game terminal, the game display area does not have a corresponding game picture, and therefore a preset picture exists in a picture corresponding to the streaming media data and corresponds to the game display area, at this time, the cloud game server may determine that the game display area where the game is not selected to be started is a game display area waiting for starting the game, so that the cloud game server may set a preset picture for the game display area waiting for starting the game when the streaming media data is generated, so that the generated streaming media data includes the preset picture, and further, after the cloud game terminal obtains the streaming media data, it may determine whether the preset picture exists in the streaming media data.

The cloud game terminal can determine an area corresponding to the position of the preset picture as the preset area under the condition that the preset picture is determined to exist in the streaming media data, replace the preset picture with a picture currently displayed in the preset area, obtain a new display picture, and display the new display picture.

As can be seen from the foregoing, the preset area corresponds to a game display area in the cloud game terminal where a game is not selected to be started, and a currently displayed picture in the preset area may be a game selection interface, that is, in the embodiment of the present disclosure, the preset picture in the preset area may be replaced by the game selection interface, so that the cloud game terminal continues to display the game selection interface in the preset area, and a corresponding player can continue to perform a game selection operation.

The cloud game terminal determines whether a preset picture exists in the streaming media data and a target game display area corresponding to the position of the preset picture can be in various modes.

Optionally, the cloud game terminal may distinguish whether a preset picture exists in the picture and a target game display area corresponding to a position where the preset picture is located according to information such as pixel brightness distribution of the picture corresponding to the streaming media data.

Optionally, the cloud game server may add an identifier to each game display area when generating the streaming media data, the cloud game terminal may obtain the identifier when acquiring the streaming media data, and the cloud game terminal may determine whether a preset picture exists in a picture corresponding to the streaming media data and a target game display area corresponding to a position where the preset picture is located through the identifier.

Optionally, the cloud game server may add descriptive information to the streaming media data when the streaming media data is generated, and the cloud game terminal may obtain the descriptive information when the streaming media data is obtained, where the descriptive information describes whether a preset picture exists in a picture corresponding to the streaming media data and a position where the preset picture is located, so that the cloud game terminal may determine whether the preset picture exists in the picture corresponding to the streaming media data and a target game display area corresponding to the position where the preset picture is located through the descriptive information.

By adopting the mode, under the condition that the preset picture exists in the picture corresponding to the streaming media data, the picture currently displayed in the preset area is used for replacing the preset picture, so that the game display area of the player who does not select the game to start can continuously display the game selection interface, and the player who does not select the game to start can continuously initiate the game selection operation.

It should be noted that, the cloud game interaction method mentioned above may be implemented by an application program (APP) in the cloud game terminal, so that before the cloud game interaction method is implemented, the corresponding APP may be opened first, and the cloud game interaction method is implemented in the APP.

Referring to fig. 4, fig. 4 is a flowchart illustrating a cloud game interaction method according to an exemplary embodiment of the present disclosure, where the cloud game interaction method may be applied to a cloud game server, and referring to fig. 4, the cloud game interaction method includes:

step 410, receiving a game starting instruction sent by the cloud game terminal, where the game starting instruction is a game starting instruction of a target cloud game corresponding to at least one target area in the plurality of game display areas.

And step 420, starting the target cloud game according to the game starting instruction.

And step 430, merging to generate streaming media data according to the game picture of the target cloud game.

Step 440, sending the streaming media data to the cloud game terminal, so that the cloud game terminal displays a picture corresponding to the streaming media data.

For a detailed description of this embodiment, reference may be made to the contents of relevant parts in the foregoing embodiments, which are not described herein again.

In some embodiments, the cloud game interaction method shown in fig. 4 further includes the steps of: receiving a layout style of a plurality of game display areas sent by the cloud game terminal, wherein the game display areas are displayed on a screen of the cloud game terminal in a split screen mode; in this case, the step of merging to generate the streaming media data according to the game screen of the at least one target cloud game shown in fig. 4 may include: and generating streaming media data according to the layout style and the game picture of the at least one target cloud game, wherein the position of the game picture of the at least one target cloud game in the picture corresponding to the streaming media data is consistent with the position of the at least one target area on the screen of the cloud game terminal.

In some embodiments, based on the above embodiments, the cloud game interaction method further includes the steps of: receiving a game operation instruction which is sent by a cloud game terminal and is input aiming at a game display area corresponding to any target cloud game; controlling the running of the corresponding game according to the game operation instruction, and generating second updated streaming media data according to the picture after the running of the corresponding game; and sending the second updating streaming media data to the cloud game terminal so that the cloud game terminal displays the second updating streaming media data.

In some embodiments, based on the above embodiments, the cloud game interaction method further includes the steps of: receiving the association relation between each game display area sent by the cloud game terminal and each instruction input device of the cloud game terminal; in this case, the controlling of the execution of the corresponding game according to the game operation instruction shown in fig. 4 includes: determining target instruction input equipment corresponding to the game operation instruction; determining a game display area associated with the target instruction input device based on the association relation; and controlling the running of the game corresponding to the game display area associated with the target instruction input equipment according to the sub-game operation instruction.

In some embodiments, based on the above embodiments, the cloud game interaction method further includes the steps of: receiving a zooming instruction which is sent by a cloud game terminal and input aiming at any game display area; according to the zooming instruction, zooming the size of the game picture of the corresponding game to obtain a zoomed game picture of the corresponding game; generating first updated streaming media data according to the zoomed game picture of the corresponding game; and sending the first updating streaming media data to the cloud game terminal so that the cloud game terminal displays the first updating streaming media data.

In some implementations, based on the above example, the game screen according to the at least one target cloud game shown in fig. 4, the merging to generate the streaming media may include: and generating streaming media data according to the game picture and a preset picture of at least one target cloud game, wherein the preset picture is a picture preset by the cloud game server for a game display area waiting for starting the game on the screen of the cloud game terminal.

Referring to fig. 5, fig. 5 is an interaction flowchart illustrating a cloud game interaction method implemented by interaction between a cloud game terminal and a cloud game server according to an exemplary embodiment of the present disclosure, and referring to fig. 5, the cloud game interaction method includes:

step 501, the cloud game terminal sends a game starting instruction and a layout style to the cloud game server.

The game starting instruction is a game starting instruction of a target cloud game corresponding to at least one target area in the plurality of game display areas.

Step 502, the cloud game server starts a target cloud game according to a game starting instruction.

In step 503, the cloud game server generates streaming media data according to the layout style and the game picture confluence of the at least one target cloud game.

And the position of the game picture of the at least one target cloud game in the picture corresponding to the streaming media data is consistent with the position of the at least one target area on the screen of the cloud game terminal.

Step 504, the cloud game server sends the streaming media data to the cloud game terminal.

And 505, displaying a picture corresponding to the streaming media data by the cloud game terminal.

Step 506, the cloud game terminal sends game operation instructions input aiming at the game display area corresponding to any target cloud game and the association relation between each game display area and each instruction input device of the cloud game terminal to the cloud game server.

In step 506, the association relationship between each game display area and each command input device of the cloud game terminal may be transmitted in step 501.

Step 507, the cloud game server determines a target instruction input device corresponding to the game operation instruction, and determines a game display area associated with the target instruction input device based on the association relationship.

And step 508, the cloud game server controls the running of the corresponding game according to the game operation instruction to obtain a running picture of the corresponding game.

In step 509, the cloud game server generates second updated streaming media data according to the running picture and the layout style of the corresponding game.

Step 510, the cloud game server sends the second updated streaming media data to the cloud game terminal.

In step 511, the cloud game terminal displays a picture corresponding to the second updated streaming media data.

The specific implementation manner of steps 501 to 511 may refer to the specific description of the foregoing embodiments, and is not described herein again.

An exemplary application of the embodiment of the present disclosure in an actual application scenario will be described below with reference to a scenario architecture diagram of a split-screen game system shown in fig. 6.

In the split-screen game system applied to the embodiment of the disclosure, the split-screen game system comprises a cloud game terminal and a cloud game server, wherein the cloud game server can comprise an instruction distribution server, a game server and a confluence server.

The method comprises the steps that a cloud game APP is installed on a Television (TV) terminal, a player opens the cloud game APP, and after a split-screen game mode is selected in the APP, a setting interface is displayed on a screen of the cloud game terminal.

The number of players playing games is 4 on the setting interface, the setting interface is switched to a screen layout style selection interface which can be selected when the 4 players play games, the screen layout style selection interface comprises picture layouts of 4 grids from left to right, from top to bottom or from 4 grids, then the user selects the layout style of the 4 grids, the setting interface is switched to the game display interface of the 4 grids again, and the binding instruction input device is prompted in the game display interface. At this time, the cloud game terminal may transmit the layout style to the merge server.

Then, the player connects 4 game pads externally in the cloud game terminal, and sets the association relationship between each game pad and each game display area on the interface. At this time, the cloud game terminal may transmit the association relationship between each gamepad and each game display area to the instruction distribution server.

At this point, the configuration process for the split screen game is completed. Each player can select the game in the game display area corresponding to the player and perform subsequent games.

After configuration is completed, 4 players trigger game selection operation in a game display area of the players through controlling a game handle to generate 4 game starting instructions, the cloud game terminal sends the 4 game starting instructions to an instruction distribution server, the instruction distribution server finds a corresponding game server according to an address carried by the 4 game starting instructions, the corresponding game server starts a game and generates game pictures, each game server respectively pushes the generated game pictures to a confluence server, the confluence server merges the game pictures according to a layout pattern to generate streaming media data, and then, after compressing, encoding and the like, the streaming media data are returned to the cloud game terminal, and the cloud game terminal analyzes the received streaming media data to obtain split-screen game pictures and displays the split-screen game pictures, so that the starting process of the game is completed.

In the process of playing the subsequent game by each player, 4 players input game operation instructions to the cloud game terminal by operating the game handle respectively, the cloud game terminal sends the 4 game operation instructions to the instruction distribution server, the instruction distribution server sends the 4 sub-game starting instructions to the corresponding game servers respectively according to the association relation, the corresponding game servers generate the running pictures of the game, each sub-game server respectively pushes the generated running pictures of the game to the confluence server, the confluence server merges the running pictures of each game according to the layout pattern to generate second updated streaming media data, then the second updated streaming media data is compressed, coded and the like and then returned to the cloud game terminal, and the cloud game terminal analyzes the received second updated streaming media data to obtain the updated split-screen game pictures, and displaying, thus finishing the operation process of the game.

Based on the same inventive concept, the embodiment of the present disclosure further provides a cloud game interaction apparatus, which may be a part or all of an electronic device through software, hardware, or a combination of the two. Referring to fig. 7, the cloud game interaction apparatus 700 is applied to a cloud game terminal, and the cloud game interaction apparatus 700 may include:

the first display module 710 is configured to display a plurality of game display areas on a screen of the cloud game terminal in a split-screen manner.

And a target cloud game determining module 720, configured to determine, in response to a game selection operation, a target cloud game corresponding to at least one target area in the plurality of game display areas.

A game starting instruction sending module 730, configured to send a game starting instruction to the cloud game server, where the game starting instruction is used to start the target cloud game.

A streaming media data obtaining module 740, configured to obtain streaming media data sent by the cloud game server, where the streaming media data is generated by the cloud game server according to a game image confluence of the target cloud game.

And a second display module 750, configured to display a picture corresponding to the streaming media data.

In some embodiments, the apparatus 700 further comprises:

a layout style sending module, configured to send a layout style of the plurality of game display areas to the cloud game server; the layout style is used for the cloud game server to generate the streaming media data according to the layout style, so that the position of a game picture of the target cloud game on a picture corresponding to the streaming media data is consistent with the position of at least one target area on a screen of the cloud game terminal.

In some embodiments, the apparatus 700 further comprises:

a first response module for determining the number of the plurality of game display areas in response to a number selection operation;

a second response module for determining a layout style of the plurality of game display areas in response to a layout selection operation.

In this case, the first display module 710 is further configured to display the plurality of game display areas on the screen of the cloud game terminal based on the determined number and the layout style of the plurality of game display areas.

In some embodiments, the apparatus 700 further comprises:

the game operation instruction sending module is used for obtaining a game operation instruction input by a game display area corresponding to any target cloud game and sending the game operation instruction to the cloud game server so that the cloud game server controls the running of the corresponding game according to the game operation instruction.

In some embodiments, the apparatus 700 further comprises:

and the incidence relation determining module is used for determining the incidence relation between each game display area and each instruction input device of the cloud game terminal.

And the incidence relation sending module is used for sending the incidence relation to the cloud game server.

And the association relation is used for determining the instruction input equipment corresponding to the game operation instruction by the cloud game server under the condition that the cloud game server receives the game operation instruction, and controlling the running of the game corresponding to the game display area associated with the instruction input equipment according to the game operation instruction.

In some embodiments, the apparatus 700 further comprises:

and the scaling instruction sending module is used for acquiring a scaling instruction input aiming at any game display area, sending the scaling instruction to the cloud game server so as to enable the cloud game server to scale the size of the game picture of the corresponding cloud game according to the scaling instruction to obtain a scaled game picture of the corresponding cloud game, and generating first updated streaming media data according to the scaled game pictures of the corresponding cloud game in a confluence mode.

In some embodiments, the second display module 750 is further configured to, when a preset picture exists in pictures corresponding to the streaming media data, determine a corresponding preset area according to a position of the preset picture, and replace the preset picture with a picture currently displayed in the preset area to obtain a new display picture, where the preset picture is a picture preset by the cloud game server for a game display area on a screen of the cloud game terminal, where a game is to be started; and displaying the new display picture.

Based on the same inventive concept, the embodiment of the present disclosure further provides a cloud game interaction apparatus, which may be a part or all of an electronic device through software, hardware, or a combination of the two. Referring to fig. 8, the cloud game interaction apparatus 800 is applied to a cloud game server, and the cloud game interaction apparatus 800 may include:

the game starting instruction receiving module 810 is configured to receive a game starting instruction sent by the cloud game terminal, where the game starting instruction is a game starting instruction for a target cloud game corresponding to at least one target area in the multiple game display areas.

A starting module 820, configured to start the target cloud game according to the game starting instruction.

And a merging module 830, configured to merge to generate streaming media data according to the game screen of the target cloud game.

The streaming media data sending module 840 is configured to send the streaming media data to the cloud game terminal, so that the cloud game terminal displays the streaming media data.

In some embodiments, the apparatus 800 further comprises:

the cloud game terminal comprises a layout style receiving module used for receiving the layout styles of a plurality of game display areas sent by the cloud game terminal, wherein the game display areas are displayed on the screen of the cloud game terminal in a split screen mode.

In this case, the merging module is further configured to generate the streaming media data according to the layout style and a merging of the game pictures of the at least one target cloud game, where a position of the game picture of the at least one target cloud game in the picture corresponding to the streaming media data coincides with a position of the at least one target area on the screen of the cloud game terminal.

In some embodiments, the apparatus 800 further comprises:

the game operation instruction receiving module is used for receiving a game operation instruction which is sent by the cloud game terminal and is input aiming at a game display area corresponding to any target cloud game;

the second updating stream media data generating module is used for controlling the running of the corresponding game according to the game operation instruction and generating second updating stream media data according to the running picture of the corresponding game;

and the second updating streaming media data sending module is used for sending the second updating streaming media data to the cloud game terminal so that the cloud game terminal displays the second updating streaming media data.

In some embodiments, the apparatus 800 further comprises:

and the association relation receiving module is used for receiving the association relation between each game display area sent by the cloud game terminal and each instruction input device of the cloud game terminal.

In this case, the second update streaming media data generation module is further configured to determine a target instruction input device corresponding to the game operation instruction; determining a game display area associated with the target instruction input device based on the association relation; and controlling the running of the game corresponding to the game display area associated with the target instruction input equipment according to the sub-game operation instruction.

In some embodiments, the apparatus 800 further comprises:

the zooming instruction receiving module is used for receiving zooming instructions which are sent by the cloud game terminal and input aiming at any game display area;

the zooming module is used for zooming the size of the game picture of the corresponding game according to the zooming instruction to obtain a zoomed game picture of the corresponding game;

the first updating stream media data generating module is used for generating first updating stream media data according to the zoomed game picture of the corresponding game;

and the first updating streaming media data sending module is used for sending the first updating streaming media data to the cloud game terminal so that the cloud game terminal displays the first updating streaming media data.

In some embodiments, the streaming media data is generated by streaming according to a game screen of the at least one target cloud game and a preset screen, where the preset screen is a screen preset by the cloud game server for a game display area on a screen of the cloud game terminal, where the game display area is waiting for starting a game.

It should be noted that the device embodiment and the method embodiment in the present application correspond to each other, and specific principles in the device embodiment may refer to the contents in the method embodiment, which is not described herein again.

Referring now to fig. 9, a schematic diagram of an electronic device (e.g., a cloud gaming terminal or a cloud gaming server in an embodiment of the present disclosure) 900 suitable for implementing an embodiment of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 9 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 9, the electronic device 900 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 901 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)902 or a program loaded from a storage means 908 into a Random Access Memory (RAM) 903. In the RAM 903, various programs and data necessary for the operation of the electronic apparatus 900 are also stored. The processing apparatus 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input/output (I/O) interface 905 is also connected to bus 904.

Generally, the following devices may be connected to the I/O interface 905: input devices 906 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 907 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 908 including, for example, magnetic tape, hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic apparatus 900 to perform wireless or wired communication with other apparatuses to exchange data. While fig. 9 illustrates an electronic device 900 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication device 909, or installed from the storage device 908, or installed from the ROM 902. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing apparatus 901.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: displaying a plurality of game display areas on a screen of the cloud game terminal in a split screen manner; responding to game selection operation, and determining a target cloud game corresponding to at least one target area in the plurality of game display areas; sending a game starting instruction to the cloud game server, wherein the game starting instruction is used for starting the target cloud game; acquiring streaming media data sent by the cloud game server, wherein the streaming media data are generated by the cloud game server according to a game picture confluence of the target cloud game; and displaying the picture corresponding to the streaming media data.

Alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: receiving a game starting instruction sent by a cloud game terminal, wherein the game starting instruction is a game starting instruction of a target cloud game corresponding to at least one target area in a plurality of game display areas; starting the target cloud game according to the game starting instruction; merging to generate streaming media data according to the game picture of the target cloud game; and sending the streaming media data to the cloud game terminal so that the cloud game terminal displays the streaming media data.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules described in the embodiments of the present disclosure may be implemented by software or hardware. Wherein the name of a module in some cases does not constitute a limitation on the module itself.

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

Example 1 provides a cloud game interaction method applied to a cloud game terminal, according to one or more embodiments of the present disclosure, the method including:

and displaying the picture corresponding to the streaming media data.

Example 2 provides the method of example 1, further comprising, in accordance with one or more embodiments of the present disclosure:

sending a layout style of the plurality of game display areas to the cloud game server;

the layout style is used for the cloud game server to generate the streaming media data according to the layout style, so that the position of a game picture of the target cloud game on a picture corresponding to the streaming media data is consistent with the position of at least one target area on a screen of the cloud game terminal.

Example 3 provides the method of example 1, further comprising, in accordance with one or more embodiments of the present disclosure:

determining the number of the plurality of game display areas in response to a number selection operation;

determining a layout style of the plurality of game display areas in response to a layout selection operation;

the split-screen display of the plurality of game display areas in the screen of the cloud game terminal includes:

displaying the plurality of game display areas on a screen of the cloud game terminal based on the determined number of the plurality of game display areas and the layout style.

Example 4 provides the method of example 1, further comprising, in accordance with one or more embodiments of the present disclosure:

the method comprises the steps of obtaining a game operation instruction input by aiming at a game display area corresponding to any target cloud game, and sending the game operation instruction to the cloud game server so that the cloud game server can control the running of the corresponding game according to the game operation instruction.

Example 5 provides the method of example 4, further comprising, in accordance with one or more embodiments of the present disclosure:

determining an incidence relation between each game display area and each instruction input device of the cloud game terminal;

sending the association relationship to the cloud game server;

Example 6 provides the method of example 1, further comprising, in accordance with one or more embodiments of the present disclosure:

and acquiring a zooming instruction input aiming at any game display area, sending the zooming instruction to the cloud game server, so that the cloud game server zooms the size of the game picture of the corresponding cloud game according to the zooming instruction to obtain a zoomed game picture of the corresponding cloud game, and generating first updated streaming media data according to confluence of the zoomed game pictures of the corresponding cloud game.

Example 7 provides the method of any one of examples 1 to 6, wherein displaying the screen corresponding to the streaming media data includes:

under the condition that a preset picture exists in pictures corresponding to the streaming media data, determining a corresponding preset area according to the position of the preset picture, and replacing the preset picture with a picture currently displayed in the preset area to obtain a new display picture, wherein the preset picture is a picture preset by the cloud game server for a game display area waiting for starting a game on a screen of the cloud game terminal;

and displaying the new display picture.

Example 8 provides a cloud game interaction method applied to a cloud game terminal, the method including:

starting the target cloud game according to the game starting instruction;

Example 9 provides the method of example 8, further comprising, in accordance with one or more embodiments of the present disclosure:

receiving a layout style of a plurality of game display areas sent by the cloud game terminal, wherein the game display areas are displayed on a screen of the cloud game terminal in a split mode;

the streaming media data is generated by the confluence according to the game picture of the at least one target cloud game, and the streaming media data comprises:

and generating the streaming media data according to the layout style and the game picture confluence of the at least one target cloud game, wherein the position of the game picture of the at least one target cloud game in the picture corresponding to the streaming media data is consistent with the position of the at least one target area on the screen of the cloud game terminal.

Example 10 provides the method of example 9, further comprising, in accordance with one or more embodiments of the present disclosure:

receiving a game operation instruction which is sent by the cloud game terminal and is input aiming at a game display area corresponding to any target cloud game;

controlling the running of the corresponding game according to the game operation instruction, and generating second updated streaming media data according to the picture after the running of the corresponding game;

and sending the second updated streaming media data to the cloud game terminal so that the cloud game terminal displays the second updated streaming media data.

Example 11 provides the method of example 10, further comprising, in accordance with one or more embodiments of the present disclosure:

receiving an incidence relation between each game display area sent by the cloud game terminal and each instruction input device of the cloud game terminal;

the controlling the running of the corresponding game according to the game operation instruction comprises the following steps:

determining target instruction input equipment corresponding to the game operation instruction;

determining a game display area associated with the target instruction input device based on the association relation;

and controlling the running of the game corresponding to the game display area associated with the target instruction input equipment according to the sub-game operation instruction.

Example 12 provides the method of example 9, further comprising, in accordance with one or more embodiments of the present disclosure:

receiving a zooming instruction which is sent by the cloud game terminal and is input aiming at any game display area;

according to the zooming instruction, zooming the size of the game picture of the corresponding game to obtain a zoomed game picture of the corresponding game;

generating first updated streaming media data according to the zoomed game picture of the corresponding game;

and sending the first updated streaming media data to the cloud game terminal so that the cloud game terminal displays the first updated streaming media data.

Example 13 provides the method of any one of examples 8-12, in accordance with one or more embodiments of the present disclosure, the merging to generate streaming media data from the game screen of the at least one target cloud game, including:

and converging to generate the streaming media data according to the game picture of the at least one target cloud game and a preset picture, wherein the preset picture is a picture preset by the cloud game server for a game display area waiting for starting the game on the screen of the cloud game terminal.

Example 14 provides a cloud game interaction apparatus applied to a cloud game terminal, the apparatus including:

Example 15 provides, in accordance with one or more embodiments of the present disclosure, a cloud game interaction apparatus for application to a cloud game server, the apparatus including:

Example 16 provides a computer readable medium having stored thereon a computer program that, when executed by a processing apparatus, implements the steps of the method of any of examples 1-7 or implements the steps of the method of any of examples 8-13, in accordance with one or more embodiments of the present disclosure.

Example 17 provides, in accordance with one or more embodiments of the present disclosure, an electronic device, comprising:

a storage device having a computer program stored thereon;

processing means for executing the computer program in the storage means to carry out the steps of the method of any one of examples 1-7 or to carry out the steps of the method of any one of examples 8-13.

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims. With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Claims

1. A cloud game interaction method is applied to a cloud game terminal, and comprises the following steps:

and displaying the picture corresponding to the streaming media data.

2. The cloud game interaction method of claim 1, wherein the method further comprises:

3. The cloud game interaction method of claim 1, wherein the method further comprises:

4. The cloud game interaction method of claim 1, wherein the method further comprises:

5. The cloud game interaction method of claim 4, wherein the method further comprises:

sending the association relationship to the cloud game server;

6. The cloud game interaction method of claim 1, wherein the method further comprises:

7. The cloud game interaction method of any one of claims 1 to 6, wherein the displaying a picture corresponding to the streaming media data comprises:

and displaying the new display picture.

8. A cloud game interaction method is applied to a cloud game server, and comprises the following steps:

starting the target cloud game according to the game starting instruction;

9. The cloud game interaction method of claim 8, wherein the method further comprises:

10. The cloud game interaction method of claim 9, wherein the method further comprises:

11. The cloud game interaction method of claim 10, wherein the method further comprises:

12. The cloud game interaction method of claim 9, wherein the method further comprises:

13. The cloud game interaction method of any one of claims 8-12, wherein the stream media data is generated from the game screens of the at least one target cloud game, and comprises:

14. The cloud game interaction device is applied to a cloud game terminal, and comprises:

15. A cloud game interaction device is applied to a cloud game server, and comprises:

16. A computer-readable medium, on which a computer program is stored, which program, when being executed by processing means, is adapted to carry out the steps of the method of any one of claims 1 to 7 or to carry out the steps of the method of any one of claims 8 to 13.

17. An electronic device, comprising:

a storage device having a computer program stored thereon;

processing means for executing the computer program in the storage means to carry out the steps of the method of any one of claims 1 to 7 or to carry out the steps of the method of any one of claims 8 to 13.