CN113996065A

CN113996065A - Control method, device and system of cloud game and electronic equipment

Info

Publication number: CN113996065A
Application number: CN202111284968.8A
Authority: CN
Inventors: 吴怡生; 邓国明; 刘柱; 韩永豪; 熊丹; 关嘉华
Original assignee: Netease Hangzhou Network Co Ltd
Current assignee: Netease Hangzhou Network Co Ltd
Priority date: 2021-11-01
Filing date: 2021-11-01
Publication date: 2022-02-01

Abstract

The application provides a control method, a control device, a control system and electronic equipment of a cloud game, relates to the technical field of data processing, and solves the technical problem that a plurality of users in different physical environments are difficult to control the same game together. The method comprises the following steps: responding to a control application of a second client to the target cloud game, and sending a control request corresponding to the control application to the first client; and responding to the consent notice of the first client for the control request, allocating a second GW to the second client, so that the second client acquires second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW.

Description

Control method, device and system of cloud game and electronic equipment

Technical Field

The present application relates to the field of data processing technologies, and in particular, to a method, an apparatus, a system and an electronic device for controlling a cloud game.

Background

Cloud games refer to a game playing mode in which a game runs on a cloud machine, audio and video of the game are sent to a client, and output of a user is transmitted to the cloud machine. The user can freely switch the client side in the cloud game scene without stopping the game. For example, originally, a cloud game is run on a computer, a user switches the game from the computer to a mobile phone, and the game is not stopped only when pictures and controls are moved from the computer to the mobile phone.

However, with such prior art solutions regarding cloud games, it is difficult for multiple users, who are in different physical environments, to collectively control the same game.

Disclosure of Invention

The application aims to provide a cloud game control method, a cloud game control device, a cloud game control system and electronic equipment, so as to relieve the technical problem that a plurality of users in different physical environments are difficult to control the same game together.

In a first aspect, an embodiment of the present application provides a method for controlling a cloud game, where first multimedia data of a target cloud game is distributed to a first client through a media server, so that the first client plays a game screen video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first Gateway server (GW), and the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, where the method includes:

responding to a control application of a second client to the target cloud game, and sending a control request corresponding to the control application to the first client;

and responding to the consent notice of the first client for the control request, allocating a second GW to the second client, so that the second client acquires second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW.

In one possible implementation, the multimedia data includes any one or more of:

audio data, video data, and text data of the cloud game.

In one possible implementation, the step of assigning a second GW to the second client in response to the consent notification by the first client for the control request includes:

and responding to the consent notice of the first client aiming at the control request, determining a second GW corresponding to the second client, and distributing the second GW to the second client.

In one possible implementation, after the step of allocating, in response to the consent notification of the first client for the control request, a second GW to the second client, so that the second client obtains second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW, the method further includes:

and sending a first closing notification to the second GW in response to the control retraction notification of the first client for the second client, so that the second GW closes the operation based on the first closing notification.

and responding to the control retraction notification of the first client aiming at the second client, and sending control retraction prompt information of the target cloud game to the second client.

and responding to the multimedia retraction notification of the first client aiming at the second client, and sending a second closing notification to the media server so as to enable the media server to stop sending the second multimedia data to the second client based on the second closing notification.

and responding to the multimedia withdrawing notification of the first client to the second client, and sending multimedia withdrawing prompt information of the target cloud game to the second client so as to enable the second client to close the page of the target cloud game.

In a second aspect, another method for controlling a cloud game is provided, where first multimedia data of a target cloud game is distributed to a first client through a media server, so that the first client plays a game screen video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first GW, and the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, where the method includes:

responding to a control application of a second client to the target cloud game, and sending a control request corresponding to the control application to the first client by the cloud game server;

in response to the consent notification of the first client for the control request, the cloud game server assigning a second GW to the second client to cause the second client to send a second control instruction for controlling the operation of the target cloud game to the cloud game server through the second GW;

responding to a multimedia application sent by the second client to the second GW, the second GW sending information of the second client and a multimedia request corresponding to the multimedia application, so that the media server sends second multimedia data of the target cloud game to the second client.

In one possible implementation, the method further includes:

in response to the second control instruction of the second client for the target cloud game, the second GW sending the second control instruction to the cloud game server to cause the cloud game server to run the target cloud game based on the first control instruction and the second control instruction.

In a possible implementation, the step of, in response to the multimedia application sent by the second client to the second GW, the second GW sending information of the second client and a multimedia request corresponding to the multimedia application, so that the media server sends second multimedia data of the target cloud game to the second client includes:

responding to the second client to send a multimedia application to the second GW, and sending information of the second client and a multimedia request corresponding to the multimedia application to the cloud game server by the second GW;

the cloud game server determines second multimedia data in the media server by distributing video resources in the media server based on the multimedia request, and sends information of the second client to the media server;

and the media server sends the second multimedia data to the second client based on the information of the second client.

In one possible implementation, the information of the second client includes any one or more of the following:

IP address information, protocol information and network topology condition of the second client.

In one possible implementation, the method further includes:

and responding to the second client side sending a multimedia application to the second GW, wherein the second GW provides the information of the media server to the second client side so as to enable the second client side and the media server to negotiate connection.

In one possible implementation, the information of the media server includes any one or more of:

IP address information, protocol information and network topology condition of the media server.

In a third aspect, there is provided a control apparatus for a cloud game, where first multimedia data of a target cloud game is distributed to a first client through a media server, so that the first client plays a game screen video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first gateway server GW, and the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, the apparatus including:

the sending module is used for responding to a control application of a second client to the target cloud game and sending a control request corresponding to the control application to the first client;

and the allocating module is used for allocating a second GW to the second client in response to the approval notification of the first client for the control request, so that the second client acquires second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW.

In a fourth aspect, a control system for a cloud game is provided, where first multimedia data of a target cloud game is distributed to a first client through a media server, so that the first client plays a game screen video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first GW, and the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, where the system includes:

the cloud game server is used for responding to a control application of a second client to the target cloud game and sending a control request corresponding to the control application to the first client;

the cloud game server is also used for responding to the consent notice of the first client terminal for the control request, and allocating a second GW to the second client terminal by the cloud game server so that the second client terminal sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW;

the second GW is configured to send, in response to a multimedia application sent by the second client to the second GW, information of the second client and a multimedia request corresponding to the multimedia application, so that the media server sends second multimedia data of the target cloud game to the second client.

In a fifth aspect, this application provides an electronic device, which includes a memory and a processor, where the memory stores a computer program that is executable on the processor, and the processor implements the steps of the method according to the first aspect when executing the computer program.

In a sixth aspect, this embodiment of the present application further provides a computer-readable storage medium, which stores computer-executable instructions, which, when invoked and executed by a processor, cause the processor to execute the method of the first aspect.

The embodiment of the application brings the following beneficial effects:

in the method, the device, the control system and the electronic device for controlling the cloud game provided by the embodiment of the application, the first multimedia data of the target cloud game is distributed to the first client through the media server, so that the first client plays the game picture video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to the first gateway server GW, the first GW is used for sending the first control instruction of the first client to the cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, the method can respond to a control application of the second client to the target cloud game, send a control request corresponding to the control application to the first client, respond to a notification of the first client to the control request, and allocating a second GW to the second client, so that the second client acquires second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the operation of the target cloud game to the cloud game server through the second GW. In the scheme, the first client corresponds to the first GW, the control instruction of the corresponding first client can be sent to the cloud game server of the target cloud game through the first GW, so that the cloud game server operates the target cloud game based on the control instruction corresponding to the first client, and when the first client receives a control request sent by other second clients, the second GW is distributed to the second client after the first client agrees to achieve the acquisition of the control authority of the target cloud game by the second client, the multi-user common control and cooperative control of the target cloud game are achieved, and the technical problem that multiple users in different physical environments are difficult to control the same game together is solved.

Drawings

In order to more clearly illustrate the detailed description of the present application or the technical solutions in the prior art, the drawings needed to be used in the detailed description of the present application or the prior art description will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application;

fig. 2 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

fig. 3 is a schematic view of a usage scenario of an electronic device according to an embodiment of the present application;

fig. 4 is a schematic flowchart of a control method of a cloud game according to an embodiment of the present disclosure;

fig. 5 is a schematic timing flow chart of a control method of a cloud game according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram illustrating a comparison between the prior art provided by an embodiment of the present application and an embodiment of the present application;

fig. 7 is a schematic timing flow chart of another control method of a cloud game according to an embodiment of the present disclosure;

fig. 8 is a schematic flowchart of another cloud game control method according to an embodiment of the present disclosure;

fig. 9 is a schematic timing flow chart of another control method of a cloud game according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a control device of a cloud game according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the present application will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "comprising" and "having," and any variations thereof, as referred to in the embodiments of the present application, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Cloud games refer to a game playing mode that a game runs on a cloud machine, audio and video of the game are sent to a client, and output of a user is transmitted to the cloud machine, and the game playing mode can be understood as remote control of another mobile phone and is only very real-time control. In a cloud game scene, a user can freely switch clients without stopping games, and in a simple way, for example, the user plays the cloud game on a computer, the game is switched from the computer to a mobile phone, only pictures and controls are moved from the computer to the mobile phone, and the game is not stopped.

However, in the existing technical solution, one user end device corresponds to one cloud end device. If there are several good friends who play the game together, but the people are in different physical environments, at this time, in the existing mode that one terminal of a cloud game scene is connected with one cloud terminal device, a large family cannot play the game together. And the user can only play the account number of the user, if the user tries to play the account number of other people, the user needs to log in again by using the account number and the password of other people, and in some multi-player single-machine games, the user can only play the games by himself, and the multi-player playing cannot be supported.

According to the defects, the existing technical scheme is that one user side device corresponds to one cloud device, the multi-user cooperative control of the same game cannot be supported, the free switching of the game control right cannot be supported, and the technical problem that multiple users in different physical environments are difficult to cooperatively control the same game is caused.

Based on this, the embodiment of the application provides a control method, a control device, a control system and an electronic device for a cloud game, and the method can solve the technical problem that in the prior art, a plurality of users in different physical environments are difficult to cooperatively control the same game. Multi-person control and cooperative control are realized, and richness in product logic can be realized, such as game relay, and multi-person interactive game. The cloud game mode can be effectively utilized, and a function of playing the game together is provided for a plurality of users in different physical environments.

In one embodiment of the present application, a control method of a cloud game may be executed in a server. When the control method of the cloud game runs on the server, the method can be implemented and executed based on a cloud interaction system, wherein the cloud interaction system comprises the server and the client device.

In an optional embodiment, various cloud applications may be run under the cloud interaction system, for example: and (5) cloud games. Taking a cloud game as an example, a cloud game refers to a game mode based on cloud computing. In the running mode of the cloud game, the running main body of the game program and the game picture presenting main body are separated, the storage and the running of the control method of the cloud game are finished on a cloud game server, and the client equipment is used for receiving and sending data and presenting the game picture, for example, the client equipment can be display equipment with a data sending function close to a user side, such as a mobile terminal, a television, a computer, a palm computer and the like; but the cloud game server which performs information processing is a cloud. When a game is played, a user operates the client device to send an operation instruction to the cloud game server, the cloud game server runs the game according to the operation instruction, data such as game pictures and the like are coded and compressed, the data are returned to the client device through a network, and finally the data are decoded through the client device and the game pictures are output.

In a possible implementation manner, an embodiment of the present application provides a control method of a cloud game, where a graphical user interface is provided by a terminal device, where the terminal device may be the aforementioned local terminal device, and may also be the aforementioned client device in a cloud interaction system.

For example, as shown in fig. 1, fig. 1 is a schematic view of an application scenario provided in the embodiment of the present application. The application scenario may include a touch terminal (e.g., a cell phone 102) and a server 101, and the touch terminal may communicate with the server 101 through a wired network or a wireless network. The touch terminal is used for operating a virtual desktop, and can interact with the server 101 through the virtual desktop to control a virtual object in the server 101.

The touch terminal of the present embodiment is described by taking the mobile phone 102 as an example. The handset 102 includes Radio Frequency (RF) circuitry 210, memory 220, a touch screen 230, a processor 240, and the like. Those skilled in the art will appreciate that the handset configuration shown in fig. 2 is not intended to be limiting and may include more or fewer components than those shown, or may combine certain components, or split certain components, or arranged in different components. Those skilled in the art will appreciate that the touch screen 230 is part of a User Interface (UI) and that the cell phone 102 may include fewer than or the same User Interface as illustrated.

The RF circuitry 210 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), and the like.

The memory 220 may be used for storing software programs and modules, and the processor 240 executes various functional applications and data processing of the cellular phone 102 by operating the software programs and modules stored in the memory 220. The memory 220 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the stored data area may store data created from use of the handset 102, and the like. Further, the memory 220 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The touch screen 230 may be used to display a graphical user interface and receive user operations with respect to the graphical user interface. A particular touch screen 230 may include a display panel and a touch panel. The Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. The touch panel may collect contact or non-contact operations of a user on or near the touch panel (for example, as shown in fig. 3, operations of the user on or near the touch panel using any suitable object or accessory such as a finger 301, a stylus pen, etc.), and generate preset operation instructions. In addition, the touch panel may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction and gesture of a user, detects signals brought by touch operation and transmits the signals to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into information that can be processed by the processor, sends the information to the processor 240, and receives and executes commands sent from the processor 240. In addition, the touch panel may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, a surface acoustic wave, and the like, and may also be implemented by any technology developed in the future. Further, the touch panel may cover the display panel, a user may operate on or near the touch panel covered on the display panel according to a graphical user interface displayed by the display panel, the touch panel detects an operation thereon or nearby and transmits the operation to the processor 240 to determine a user input, and the processor 240 provides a corresponding visual output on the display panel in response to the user input. In addition, the touch panel and the display panel can be realized as two independent components or can be integrated.

The processor 240 is the control center of the handset 102, connects various parts of the entire handset using various interfaces and lines, and performs various functions and processes of the handset 102 by running or executing software programs and/or modules stored in the memory 220 and calling data stored in the memory 220, thereby performing overall monitoring of the handset.

Embodiments of the present application are further described below with reference to the accompanying drawings.

Fig. 4 is a schematic flowchart of a control method of a cloud game according to an embodiment of the present application. The method can be applied to a cloud game server running a target cloud game, first multimedia data of the target cloud game are distributed to a first client through a media server, so that the first client plays a game picture video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first gateway server (GW), and the first GW is used for sending the first control instruction of the first client to the cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction. As shown in fig. 4, the method includes:

step S410, in response to a control application for the target cloud game by the second client, sending a control request corresponding to the control application to the first client.

The game server in the embodiment of the present application refers to a server in which a game program is installed and played. In the cloud game system, a cloud game server can run a plurality of different game programs, and different players can push media data of different games through the same media server. In the embodiment of the application, different players can push the media data of the same game through the same media server.

In practical application, data may not be directly transmitted and received between the first client and the second client, the second client applies for a control application of the target cloud game to the cloud game server, and the cloud game server may control all logic to perform notification and coordination, that is, the execution subject is the cloud game server. As shown in fig. 6, the second client sends the control request to the cloud game server, and then the cloud game server sends the control request to the first client.

Step S420, in response to the approval notification of the first client for the control request, allocating a second GW to the second client, so that the second client obtains second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the operation of the target cloud game to the target cloud game server through the second GW.

For example, as shown in fig. 5, the first client sends an approval notification for the control request to the cloud game server, and the cloud game server receives the approval notification from the first client and allocates the second GW to the second client.

It should be noted that the allocation of the GW may be allocation according to a certain rule, or may be random allocation, or may apply for a new GW for the second client. For allocating the GW according to a certain rule, an appropriate GW may be allocated to a tenant (a player corresponding to the second client) according to GW resources of the room, for example, resources of a plurality of GWs are corresponding to the room, and these GW resources may be allocated to the room in advance.

In addition, the second multimedia data may be the same as the first multimedia data, and may also be different from the first multimedia data. For the case that the second multimedia data is different from the first multimedia data, for example, the video of the game screen seen between the homeowner and the tenant (the player corresponding to the second client) may be different because the homeowner (the player corresponding to the first client) sets different permissions or functions.

In practical applications, during video distribution, the media server may implement traffic distribution in a manner that a tenant (a player corresponding to the second client) and a homeowner (a game play owner, a player corresponding to the first client) share a process. Furthermore, multiple control command inputs may be supported in the same game. The processing of the control authority granting aspect may include how to authenticate, how to increase, decrease the users controlling the game, and so on.

In a possible implementation manner, the control method of the target cloud game in the embodiment of the present application may be applied to a "play together" scenario, for example, after a homeowner opens a live room to play the game, and other users get on the phone, the homeowner may apply for controlling the game. After the homeowner agrees, the homeowner can give the main control or give the auxiliary control. The primary control, i.e. the house owner, becomes the role of watching only, and the secondary control, i.e. the house owner and the tenant, can play games together at the same time. And the homeowner can withdraw control, after which the tenant will be prompted "the homeowner has withdrawn control".

Exemplarily, fig. 6 is a comparison diagram of the prior art and an embodiment of the present application, where a media server, i.e. a media server, in the diagram is a server cluster for processing delivery of real-time audio/video data; the GW in the figure is responsible for communicating all the modules, providing media server addresses to the user side and transmitting user instructions to the cloud game server; the cloud game server in the figure is a game cluster, and is simply a machine cluster of a running game. The improvements of the embodiments of the present application over the prior art include, but are not limited to, the following two logics:

firstly, the media server adds the function of pushing a plurality of users, the media server is used as an intermediate medium for pushing stream to the users by the server, and has respective protocol communication with the server and the users, in order to achieve the processing of multi-user control logic, the media server realizes the association relationship among the users and the distribution logic of different users of videos under a communication protocol system, and simultaneously performs additional processing (such as disconnection processing and the like related to protocols) on a homeowner/tenant and the like; secondly, a plurality of GWs are distributed in a cooperative control scene to provide input support for a plurality of clients, and the connection relationship between the clients and the server is realized. Here, the server refers to a server running the game program, that is, a game suit. While the cloud game server described earlier is referred to as a business backend.

The multimedia data of the target cloud game can be video information obtained by the client from the media server, and the framework needs to be adjusted in multi-player control. In the overall architecture of the application scenario of the present solution, there may be multiple rooms (groups), each room corresponds to one game at the same time, that is, the member players in each room may play one game at the same time, and of course, the member players in the room may also play another game, but only one game is played at the same time, as the association between the room and the game. The room may be established by a player, the player establishing the room may serve as a house owner, and when the room is established, a plurality of GWs are corresponding to the room, or a specific number of GWs may be divided according to rules. And later players in the room, the cloud game server selects a second GW from among the above-mentioned specific number of GWs and assigns it to the new player, if permitted by the homeowner (i.e., the approval notification of the first client for the control request). And the second GW which is allocated later may establish connection and communication with the media server through the designated identifier and the cloud game server, for example, if the media server recognizes that the identifier sent by the second GW matches the local preset identifier, the media server establishes communication connection with the second GW, and obtains a stream of the target cloud game or a data transmission channel accessed to the target cloud game.

For the above description, the situation in a practical application scenario may be understood as: firstly, a house owner takes a game as a Content core to form a concept of a group (namely a room), association information between the group and the game is kept, other users need to participate in the group to enter the group, after the group enters, authority processing is carried out on the users, if a part of the users can watch, the other part of the users can control the user game, the part is realized by obtaining/shielding each service component by the users, after the users enter the group, the service distributes corresponding Content Delivery Network (CDN) video resources, if multi-user control is needed to be realized, the corresponding gw (control module) and media service (real-time video stream) in the group can be distributed through authority operation, and the users can be controlled after connection. In this process, a single structure of the user-media server-GW-game server is adjusted to a structure in which one content of the user group-GW group-media server-game server corresponds to a plurality of users.

The CDN is an intelligent virtual network constructed on the basis of the existing network, and by means of edge servers deployed in various regions and through functional modules of load balancing, content distribution, scheduling and the like of a central platform, a user can obtain required content nearby, network congestion is reduced, and the access response speed and hit rate of the user are improved. The key technology of the CDN is mainly content storage and distribution technology.

In the embodiment of the application, the first client corresponds to the first GW, the control instruction of the corresponding first client can be sent to the cloud game server of the target cloud game through the first GW, so that the cloud game server runs the target cloud game based on the control instruction corresponding to the first client, and when the first client receives a control request sent by another second client, the second GW is allocated to the second client after the first client agrees to the control request, so that the second client obtains the control authority of the target cloud game, multi-user common control and cooperative control of the target cloud game are realized, and the technical problem that multiple users in different physical environments are difficult to control the same game together is solved.

The above steps are described in detail below.

In some embodiments, the multimedia data may include multiple types to enable support for the target cloud game. As an example, the multimedia data includes any one or more of:

audio data, video data, and text data of the target cloud game.

The audio data provides game sounds such as background music, game sound effects and the like for the target cloud game; the video data provides game pictures such as game pictures, scenario animations and the like for the target cloud game; the text data provides game text such as subtitles and character dialogues for the target cloud game.

By enabling the multimedia data to contain audio data, video data, text data and other related data of the target cloud game, game sound, game pictures and game text can be presented to other users in other physical environments, and the other users can participate in the game.

In some embodiments, after receiving the approval notification sent by the first client, the cloud game server may allocate a GW corresponding to the cloud game server to the second client, so as to implement accurate sending of the multimedia data. As an example, the step S420 may specifically include the following steps:

and a), responding to the consent notice of the first client aiming at the control request, determining a second GW corresponding to the second client, and distributing the second GW to the second client.

GW is also called gateway server, protocol converter, and is a computer system or device acting as a conversion task. For example, walking from room to room necessarily passes through a door. Similarly, sending information from one network to another must also pass through a "gateway," which is the GW. As shown in fig. 9, a client (e.g., a second client in fig. 9) needs to send a multimedia request to a cloud game server (e.g., a server in fig. 9) through a GW, and the cloud game server further sends information of the client (e.g., second client information in fig. 9) to a media server, so that the media server sends multimedia data such as audio data, video data, and text data requested by the client to the client, so that a player can view and play a target cloud game through the client.

In practical application, after receiving the approval notification sent by the first client, the cloud game server allocates a corresponding GW to the second client, so as to send multimedia data such as audio data, video data, and text data of the target cloud game to the media server, so that other users can receive the multimedia data such as audio data, video data, and text data of the target cloud game through the second client, and view and play the target cloud game.

In some embodiments, the first client may relinquish control of the second client and send a notification to the second GW to cause the second GW to turn off. As an example, after the step S420, the method may further include the steps of:

and b), responding to the control retraction notification of the first client aiming at the second client, and sending a first closing notification to the second GW so as to enable the second GW to close the operation based on the first closing notification.

For example, as shown in fig. 7, a first client sends a control retraction notification to a cloud game server, the cloud game server sends a first shutdown notification to a second GW corresponding to a second client after receiving the control retraction notification sent by the first client, and the second GW shuts down operation after receiving the first shutdown notification from the cloud game server, so as to retract the control right for the second client.

In practical application, when the game situation is influenced by poor game operation of the tenant, the tenant can timely withdraw the game control right to avoid the situation of the game from being prone to disadvantages. As another example, when a tenant attempts to compromise (abuse items, expending game currency) the tenant's virtual property in the game, the tenant may also in time regain control of the game to avoid compromising his or her virtual property.

And sending a first closing notification to the second GW through the cloud game server in response to the control recovery notification of the first client for the second client, so that the second GW closes the operation based on the first closing notification. The user of the first client, namely the homeowner, can recover the control right at any time, so that the control right of the game can be returned to the hands of the user, and the rights and interests of the homeowner are protected.

In some embodiments, the first client receiving back control of the second client may be prompted to the second client to let the user of the second client know that control was received back. As an example, after the step S420, the method may further include the steps of:

and c), responding to the control recovery notification of the first client to the second client, and sending control recovery prompt information of the target cloud game to the second client.

For example, as shown in fig. 7, the first client sends a control retraction notification to the cloud game server, and after receiving the control retraction notification sent by the first client, the cloud game server sends a control retraction prompt message to the second client.

In practical application, the cloud game server can send a control recovery prompt message to the second client corresponding to the tenant, so that the tenant can timely know that the own control right is recovered by the tenant, and the cloud game server plays a role in prompting that the tenant does not need to perform game operation any more.

In some embodiments, the first client may withdraw the second client's viewing rights and send a notification to the multimedia server to cause the multimedia server to stop sending data to the second client. As an example, after the step S420, the method may further include the steps of:

and d), responding to the multimedia retraction notice of the first client aiming at the second client, sending a second closing notice to the media server, so that the media server stops sending the second multimedia data to the second client based on the second closing notice.

For example, as shown in fig. 7, the first client sends a multimedia recovery notification to the cloud game server, the cloud game server sends a second shutdown notification to the media server after receiving the multimedia recovery notification sent by the first client, and the media server stops sending the second multimedia data to the second client after receiving the second shutdown notification from the cloud game server.

In practical application, when the homeowner does not want the tenant to watch the game, the homeowner can receive back the watching right of the tenant, that is, the multimedia receiving notification is sent to the cloud game server, so that the media server stops sending multimedia data such as audio data, video data and text data of the target cloud game to the second client corresponding to the tenant, and the tenant stops watching the game.

In some embodiments, the first client may reclaim the multimedia transmission and send a notification to the second client to cause the second client's target cloud game page to close. As an example, after the step S420, the method may further include the steps of:

and e), responding to the multimedia withdrawing notification of the first client aiming at the second client, and sending the multimedia withdrawing prompt information of the target cloud game to the second client so that the second client closes the page of the target cloud game.

For example, as shown in fig. 7, a first client sends a multimedia recovery notification to a cloud game server, and after receiving the multimedia recovery notification sent by the first client, the cloud game server sends a multimedia recovery prompt message to a second client, so that a tenant knows that his/her viewing right is recovered by the tenant, and closes the tenant.

In practical applications, with reference to fig. 7, the overall retraction control flow can be understood as follows: a house owner applies for recovery control to the cloud game server; the cloud game server informs the GW to close the GW and informs the tenant client to withdraw the control right; the house owner applies for withdrawing the multimedia from the service list; the cloud game server informs the media server to withdraw the corresponding user watching right; GW goes offline and informs the tenant that the watching right is recovered; the tenant client exits the page.

The embodiment of the application further provides another control method of a target cloud game, wherein the method can be applied to a cloud game server running the target cloud game, first multimedia data of the target cloud game is distributed to a first client through a media server, so that the first client plays a game picture video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first GW, and the first GW is used for sending the first control instruction of the first client to the cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction. As shown in fig. 8, the method includes:

step S810, in response to a control application for the target cloud game by the second client, the cloud game server sends a control request corresponding to the control application to the first client.

In step S820, in response to the approval notification of the first client for the control request, the cloud game server allocates a second GW to the second client, so that the second client sends a second control instruction for controlling the operation of the target cloud game to the cloud game server through the second GW.

Step S830, in response to the multimedia application sent by the second client to the second GW, the second GW sends information of the second client and a multimedia request corresponding to the multimedia application, so that the media server sends second multimedia data of the target cloud game to the second client.

In the embodiment of the application, when a main client (a first client) receives control requests sent by a plurality of other clients (second clients), additional GW (second GW) is allocated to the plurality of other clients after the main client agrees to achieve the purpose that the other clients obtain the control right of the target cloud game, multi-user control and cooperative control of the target cloud game are achieved, the mode of the target cloud game can be effectively utilized, and the technical problem that a plurality of users in different physical environments are difficult to cooperatively control the same game is solved.

In some embodiments, the second GW may send a second control instruction to the game server to collectively control the game based on the first control instruction and the second control instruction. As an example, the method may further comprise the steps of:

and step f), responding to a second control instruction of the second client aiming at the target cloud game, and sending the second control instruction to the cloud game server by the second GW so as to enable the cloud game server to run the target cloud game based on the first control instruction and the second control instruction.

For example, as shown in fig. 6, a plurality of clients send control instructions to a cloud game server (such as the game server in fig. 6) through a plurality of GWs, so that the cloud game server can run a target cloud game based on the instructions sent by the plurality of clients, and the purpose that a homeowner and a tenant can simultaneously control the game is achieved.

In some embodiments, the cloud game server and the GW play a role of central control, so that the second client is connected with the media server, so that the media server can transmit the second multimedia data according to the information of the second client. As an example, the step S830 may specifically include the following steps:

and step g), responding to the second client sending the multimedia application to the second GW, and sending the information of the second client and the multimedia request corresponding to the multimedia application to the cloud game server by the second GW.

And h), the cloud game server determines second multimedia data in the media server by distributing video resources in the media server based on the multimedia request, and sends the information of the second client to the media server.

And step i), the media server sends second multimedia data to the second client based on the information of the second client.

For example, the application process is shown in fig. 9, which shows the process of applying for the homeowner game video for the tenant, and the cloud game server distributes and checks the video by applying for the GW, and forms a video path by exchanging protocol information with the media server. The overall application control flow can be understood as follows in conjunction with the content of fig. 9: the method comprises the steps that after a homeowner starts a game, media service video resources are obtained; the tenant applies for control and submits the control to the cloud game server; the cloud game server applies for the application to the homeowner, and the homeowner agrees to submit the application; the cloud game server allocates proper GW to the tenant according to the resources in the room; after receiving the application passing notification, the tenant opens the page and connects with the GW; after GW connects, the tenant requests the GW to obtain the corresponding media server, and the GW adds users to the media server; GW returns the relevant information of the tenant media server, and the tenant negotiates with the media server for connection; and if the connection is successful, the media server sends corresponding audio and video information to the tenant.

In the process of allocating the proper GW to the tenant by the cloud game server according to the resources in the room, for example, the room is provided with resources of a plurality of GWs, the GW resources may be allocated to the room in advance, and in the process of allocating the proper GW to the tenant according to the GW resources in the room, the GW that is idle and closer to the zone of the game player to which the tenant belongs may be selected as the proper GW according to the idle degree of the GW, the distance between the GW and the zone of the game player to which the tenant belongs, and the like, and the proper GW may be allocated to the second client.

Through the application control flow, multi-user control and cooperative control of the target cloud game can be realized, the mode of the target cloud game can be effectively utilized, and the technical problem that multiple users in different physical environments are difficult to cooperatively control the same game is solved.

In some embodiments, the information of the second client includes multiple types to facilitate accurate connection with the media server. As an example, the information of the second client includes any one or more of:

Wherein, the IP address refers to an Internet protocol address, is a uniform address format, and distributes a logical address for each network and each host on the Internet so as to shield the difference of physical addresses; a set of rules, standards or conventions established by a network protocol for data exchange in a computer network, for example, a microcomputer user in the network communicates with an operator of a mainframe, but the character sets used by the two data terminals are different, and in order to enable communication, it is specified that each terminal converts characters in the respective character set into characters of a standard character set, then transmits the characters in the standard character set to a network, and converts the characters into characters of the terminal character set after reaching a destination terminal; the manner in which computers are connected is called the "network topology," which refers to the physical layout by which various devices are interconnected by a transmission medium, particularly the locations where computers are distributed and how cables run through them.

By sending the IP address information, the protocol information, and the network topology condition of the second client to the media server, the second client can be accurately connected to the media server through the second GW, so that the media server can send the multimedia data of the target cloud game to the second client.

In some embodiments, the second GW may provide the second client with information of the media server to enable a smooth connection for the two for the transmission of data. As an example, the method may further comprise the steps of:

step j), responding to the multimedia application sent by the second client to the second GW, the second GW providing the information of the media server to the second client, so that the second client and the media server negotiate connection.

For example, as shown in fig. 9, after receiving the multimedia application of the second client, the second GW provides information of the media server to the second client, so that the second client and the media server negotiate a connection, and thus the media server can send multimedia data of the target cloud game to the second client.

Based on the step j), the information of the media server includes multiple types, so that the second client can be accurately connected with the media server, and the media server can efficiently send the multimedia data to the second client. As an example, the information of the media server includes any one or more of:

IP address information of the media server, protocol information, and network topology conditions.

By sending the IP address information, the protocol information and the network topology condition of the media server to the second client, the second client can be accurately connected with the media server through the second GW, so that the media server can send the multimedia data of the target cloud game to the second client.

The control method of the target cloud game provided by the embodiment of the application has the same technical characteristics as the control method of the target cloud game provided by the embodiment, so that the same technical problems can be solved, and the same technical effects can be achieved.

Fig. 10 provides a control apparatus 1000 for a cloud game, where first multimedia data of a target cloud game is distributed to a first client through a media server, so that the first client plays a game screen video according to the first multimedia data, the target cloud game is a game started in response to a first client control instruction, the first client corresponds to a first gateway server GW, and the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction. As shown in fig. 9, the control device 1000 of the cloud game includes:

the sending module 1001 is configured to send a control request corresponding to a control application to a first client in response to the control application of a second client to a target cloud game;

the allocating module 1002 is configured to allocate a second GW to the second client in response to the approval notification of the first client for the control request, so that the second client obtains second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the operation of the target cloud game to the cloud game server through the second GW.

In some embodiments, the multimedia data includes any one or more of:

audio data, video data, and text data of the cloud game.

In some embodiments, assignment module 1002 is specifically configured to:

and responding to the consent notice of the first client for the control request, determining a second GW corresponding to the second client, and distributing the second GW to the second client.

In some embodiments, the apparatus further comprises:

and the first notification module is used for responding to the control retraction notification of the first client aiming at the second client, and sending a first closing notification to the second GW so as to enable the second GW to close the operation based on the first closing notification.

In some embodiments, the apparatus further comprises:

and the second notification module is used for responding to the control recovery notification of the first client to the second client and sending the control recovery prompt information of the target cloud game to the second client.

In some embodiments, the apparatus further comprises:

and the third notification module is used for responding to the multimedia withdrawing notification of the first client aiming at the second client, and sending a second closing notification to the media server so that the media server stops sending the second multimedia data to the second client based on the second closing notification.

In some embodiments, the apparatus further comprises:

and the fourth notification module is used for responding to the multimedia withdrawing notification of the first client to the second client, and sending the multimedia withdrawing prompt information of the target cloud game to the second client so that the second client closes the page of the target cloud game.

The control device for the cloud game provided by the embodiment of the application has the same technical characteristics as the control method for the cloud game provided by the embodiment of the application, so that the same technical problems can be solved, and the same technical effects can be achieved.

The embodiment of the present application further provides a control system for a cloud game, where first multimedia data of a target cloud game is distributed to a first client through a media server, so that the first client plays a game picture video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first gateway server GW, the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, and the system includes:

the cloud game server is used for responding to a control application of the second client to the target cloud game and sending a control request corresponding to the control application to the first client;

the cloud game server is also used for responding to the consent notice of the first client terminal for the control request, and the cloud game server distributes a second GW to the second client terminal so that the second client terminal sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW;

and the second GW is used for responding to the multimedia application sent by the second client to the second GW, sending the information of the second client and the multimedia request corresponding to the multimedia application so that the media server sends second multimedia data of the target cloud game to the second client.

The control system of the cloud game provided by the embodiment of the application has the same technical characteristics as the control method and the control device of the cloud game provided by the embodiment of the application, so that the same technical problems can be solved, and the same technical effects can be achieved.

Corresponding to the control method of the cloud game, an embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are called and executed by a processor, the computer-executable instructions cause the processor to execute the steps of the control method of the cloud game.

The control device of the cloud game provided by the embodiment of the application can be specific hardware on the device, or software or firmware installed on the device, and the like. The device provided by the embodiment of the present application has the same implementation principle and technical effect as the foregoing method embodiments, and for the sake of brief description, reference may be made to the corresponding contents in the foregoing method embodiments where no part of the device embodiments is mentioned. It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the foregoing systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.

For another example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments provided in the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the cloud game control method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus once an item is defined in one figure, it need not be further defined and explained in subsequent figures, and moreover, the terms "first", "second", "third", etc. are used merely to distinguish one description from another and are not to be construed as indicating or implying relative importance.

Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the scope of the embodiments of the present application. Are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for controlling a cloud game, in which first multimedia data of a target cloud game is distributed to a first client through a media server, so that the first client plays a game screen video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first gateway server GW, and the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, the method comprising:

2. The method of claim 1, wherein the multimedia data comprises any one or more of:

audio data, video data, and text data of the cloud game.

3. The method of claim 1, wherein the step of assigning a second GW to the second client in response to the grant notification of the first client for the control request comprises:

4. The method of claim 1, wherein after the step of assigning a second GW to the second client in response to the consent notification of the first client for the control request, so that the second client obtains second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW, further comprising:

5. The method of claim 1, wherein after the step of assigning a second GW to the second client in response to the consent notification of the first client for the control request, so that the second client obtains second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW, further comprising:

6. The method of claim 1, wherein after the step of assigning a second GW to the second client in response to the consent notification of the first client for the control request, so that the second client obtains second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW, further comprising:

7. The method of claim 1, wherein after the step of assigning a second GW to the second client in response to the consent notification of the first client for the control request, so that the second client obtains second multimedia data of the target cloud game from the media server through the second GW and sends a second control instruction for controlling the running of the target cloud game to the cloud game server through the second GW, further comprising:

8. A method for controlling a cloud game, in which first multimedia data of a target cloud game is distributed to a first client through a media server, so that the first client plays a game screen video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first GW, and the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, the method comprising:

9. The method of claim 8, further comprising:

10. The method of claim 8, wherein the step of the second GW sending information of the second client and a multimedia request corresponding to the multimedia application in response to the multimedia application sent by the second client to the second GW, so that the media server sends second multimedia data of the target cloud game to the second client comprises:

11. The method according to claim 8 or 10, wherein the information of the second client comprises any one or more of the following:

12. The method of claim 8, further comprising:

13. The method of claim 12, wherein the information of the media server comprises any one or more of the following:

14. A control apparatus for a cloud game, wherein first multimedia data of a target cloud game is distributed to a first client via a media server, so that the first client plays a game screen video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first gateway server GW, and the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, the apparatus comprising:

15. A control system for a cloud game, wherein first multimedia data of a target cloud game is distributed to a first client through a media server, so that the first client plays a game screen video according to the first multimedia data, the target cloud game is a game started in response to a control instruction of the first client, the first client corresponds to a first GW, and the first GW is configured to send the first control instruction of the first client to a cloud game server running a game program of the target cloud game, so that the cloud game server runs the target cloud game based on the first control instruction, the system comprising:

16. An electronic device comprising a memory and a processor, wherein the memory stores a computer program operable on the processor, and wherein the processor implements the steps of the method of any of claims 1 to 13 when executing the computer program.

17. A computer readable storage medium having stored thereon computer executable instructions which, when invoked and executed by a processor, cause the processor to execute the method of any of claims 1 to 13.