WO2021114795A1

WO2021114795A1 - Cloud game live broadcast method, cloud game anchor end, viewer end and computer-readable storage medium

Info

Publication number: WO2021114795A1
Application number: PCT/CN2020/115990
Authority: WO
Inventors: 杜晶; 林顺
Original assignee: 厦门雅基软件有限公司
Priority date: 2019-12-11
Filing date: 2020-09-17
Publication date: 2021-06-17
Also published as: CN111818394A

Abstract

Provided are a cloud game live broadcast method, a cloud game anchor end, a viewer end and a computer-readable storage medium. The method comprises: when a viewer end in a live broadcast room obtains a cloud game control right, a cloud game anchor end sending a connection notification to a first viewer end; the first viewer end receiving the connection notification sent, by the cloud game anchor end, by means of an interaction signaling server at a cloud end, and establishing a connection with a main control GS on the basis of connection information of the main control GS; then, the cloud game anchor end pulling a cloud game picture and sound data from a live streaming server, and pushing multimedia information for an anchor to the live streaming server; and the first viewer end pulling the multimedia information for the anchor from the live streaming server at the cloud end, and sending a control instruction for a game to the main control GS, so that the main control GS simulates and controls, on the basis of the control instruction, a game instance running at the cloud end, generates the cloud game picture and the sound data, and pushes same to the live streaming server.

Description

Cloud game live broadcast method, cloud game host terminal, audience terminal and computer readable storage medium

Cross-references to related applications

This disclosure claims the rights and interests of a Chinese patent application with an application number of 201911269041.X filed at the State Intellectual Property Office of China on December 11, 2019, the entire content of which is incorporated herein by reference in its entirety.

Technical field

This application relates to the field of Internet technology. Specifically, this application relates to a cloud game live broadcast method, a cloud game host, an audience terminal, and a computer-readable storage medium.

Background technique

With the development of information technology and the rapid development of Internet technology, the live broadcast industry has emerged accordingly. Diversified live broadcast content has become the content pursued by major live broadcast platforms. More and more users are engaged in online entertainment and marketing through various live broadcast platforms. Conferences and even game live broadcasts, especially game live broadcasts, can enhance the interaction between the anchor and the audience, and have greater appeal.

In recent years, with the emergence of cloud games, due to the advantages of cloud games themselves, for example, all games in cloud games run on the cloud game server, which requires lower hardware requirements for terminal equipment, and has become increasingly popular with major live broadcast platforms. As well as the welcome of major broadcasters, the live broadcast of cloud games has also become a trend, so how to combine cloud games and live broadcast has become a key issue.

Summary of the invention

This application provides a cloud game live broadcast method, a client and a computer-readable storage medium, which can solve at least one of the above technical problems. The technical solutions are as follows:

In the first aspect, a cloud game live broadcast method is provided, which is executed by the cloud game host, and the method includes:

When the audience terminal in the live broadcast room obtains the control right of the cloud game, a connection notification is sent to the first audience terminal, wherein the connection notification carries the connection information of the master GS, and the connection notification is used to notify the first audience terminal to establish a connection with the master GS , The first audience terminal is the audience terminal that obtains the control rights of the cloud game; and

Pull cloud game picture and sound data from the live streaming server, and push multimedia information for the anchor to the live streaming server, where the cloud game picture and sound data are generated based on the game control instructions of the first viewer.

In a possible implementation manner, determining the manner in which the audience terminal in the live broadcast room obtains the control rights of the cloud game includes:

The first cloud game control right transfer request is sent to a certain audience terminal in the live broadcast room through the cloud interactive signaling server, where the first cloud game control right transfer request carries the identity of the audience terminal receiving the request, and the first cloud game controls The right transfer request is used to invite the audience in the live broadcast room to control the cloud game; and

When receiving the confirmation message for the first cloud game control right transfer request, it is determined that the audience terminal in the live broadcast room obtains the cloud game control right.

In another possible implementation manner, determining the manner in which the audience in the live broadcast room obtains the control rights of the cloud game includes:

Receive a second cloud game control right transfer request sent by any viewer through the cloud interactive signaling server, where the second cloud game control right transfer request carries the identity information of the viewer who sent the second cloud game control right transfer request, and Second, the cloud game control right transfer request is used to request the control of cloud games, and

A confirmation message for the second cloud game control right transfer request is sent through the cloud interactive signaling server, and it is determined that the audience in the live broadcast room obtains the cloud game control right.

Sending a third cloud game control right transfer request to any viewer terminal through the cloud interactive signaling server, where the viewer terminal that receives the third cloud game control right transfer request is determined by the cloud interactive signaling server; and

When receiving the confirmation message for the third cloud game control transfer request, it is determined that the audience in the live broadcast room obtains the cloud game control right, where the confirmation message for the third cloud game control transfer request carries the confirmation message sender The identity of the corresponding audience.

In another possible implementation manner, the method further includes: disconnecting from the main control GS.

In another possible implementation manner, pushing multimedia information for the anchor to the live streaming server includes:

Acquire multimedia information for the host of the cloud game through the multimedia acquisition device, where the multimedia information includes: video data and audio data; and

Push the multimedia information for the anchor to the live streaming server through RTMP streaming, so that each viewer terminal pulls the multimedia information for the anchor from the live streaming server.

In another possible implementation manner, the method further includes:

The interactive signaling server in the cloud sends a control right notice to the first audience, and the interactive signaling server in the cloud sends a disconnection notice to the master GS, where the notice of the control right is used to notify the first audience. , The host of the cloud game takes back the control of the cloud game, and the disconnect notification is used to notify the master GS to disconnect from the first viewer.

In another possible implementation manner, the method further includes:

Obtain the identity information corresponding to all the viewers in the live broadcast room from the instant messaging IM live broadcast server in the cloud.

In the second aspect, a cloud game live broadcast method is provided, which is executed by the first audience terminal, and includes:

Receive the connection notification sent by the cloud game host through the interactive signaling server in the cloud, where the connection notification carries the connection information of the master game server GS, and the connection notification is used to notify the first viewer to establish a connection with the master GS;

Establish a connection with the master GS based on the connection information of the master GS; and

Pull multimedia information for the anchor from the live streaming server in the cloud, and push the game control instructions to the main control GS of the cloud game server, so that the main control GS of the cloud game server generates cloud game screen and sound data based on the control instructions. And push the cloud game screen and sound data to the live streaming server in the cloud.

In a possible implementation, after the game-specific control instructions are pushed to the master GS of the cloud game server, the method further includes:

Receive the video stream and audio stream pushed by the main control GS of the cloud game server through the point-to-point P2P real-time protocol, where the video stream and audio stream are obtained by the main control GS of the cloud game server encodes the game screen and sound data generated based on the control instructions .

In a possible implementation manner, a notification message for regaining the control right sent by an interactive signaling server in the cloud is received, where the notification message is used to notify the first viewer terminal that the cloud game host terminal reclaims the control right for the cloud game.

In a possible implementation, after establishing a connection with the master GS based on the connection information of the master GS, the method further includes:

Stop pulling game screen and sound data from the live streaming server in the cloud.

In the third aspect, a cloud game anchor terminal is provided, including:

The first sending module is configured to send a connection notification to the first audience terminal when the audience terminal in the live broadcast room obtains the control right of the cloud game. The connection notification carries the connection information of the master GS, and the connection notification is used to notify the first audience terminal. The audience terminal establishes a connection with the main control GS, and the first audience terminal is the audience terminal that has the right to control the cloud game; and

The pull and push module is configured to pull the cloud game picture and sound data from the live streaming server, and push multimedia information for the anchor to the live streaming server, where the cloud game picture and sound data are based on the game at the first audience Generated by control instructions;

In a possible implementation manner, the cloud tour anchor terminal further includes: a first determining module, wherein:

The first determining module is configured to: when determining that the audience terminal in the live broadcast room obtains the control right of the cloud game:

The first cloud game control right transfer request is sent to a certain audience terminal in the live broadcast room through the cloud interactive signaling server, where the first cloud game control right transfer request carries the identity of the audience terminal receiving the request, and the first cloud game controls The right transfer request is used to invite the audience in the live broadcast room to control the cloud game;

In a possible implementation manner, the cloud tour anchor terminal further includes: a second determining module, where:

The second determining module is configured to: when determining that the audience terminal in the live broadcast room obtains the control right of the cloud game:

Receive a second cloud game control right transfer request sent by any viewer through the cloud interactive signaling server, where the second cloud game control right transfer request carries the identity information of the viewer who sent the second cloud game control right transfer request, and Second, the cloud game control right transfer request is used to request the control of cloud games,

In a possible implementation manner, the cloud tour anchor terminal further includes: a third determining module, where:

The third determining module is configured to: when determining that the audience terminal in the live broadcast room obtains the control right of the cloud game:

When receiving the confirmation message for the third cloud game control transfer request, it is determined that the audience in the live broadcast room obtains the cloud game control right, and the confirmation message for the third cloud game control transfer request carries the confirmation message corresponding to the sender The identity of the audience.

In a possible implementation manner, the cloud tour anchor terminal further includes: a disconnection module, where:

The disconnect module is configured to disconnect from the main control GS.

In a possible implementation manner, when the push module pushes multimedia information for the anchor to the live streaming server, it is configured as follows:

In a possible implementation manner, the cloud tour anchor terminal further includes: a second sending module, where:

The second sending module is configured to send a notification to withdraw the control right to the first audience through the interactive signaling server in the cloud, and to send a disconnection notification to the master GS through the interactive signaling server in the cloud, where the control is withdrawn The notification is used to notify the first viewer that the cloud game host will withdraw the control right of the cloud game, and the disconnect notification is used to notify the master GS to disconnect from the first viewer.

In a possible implementation manner, the cloud tour anchor terminal further includes: an acquisition module, where:

The obtaining module is configured to obtain the identity information corresponding to all the viewers in the live broadcast room from the instant messaging IM live broadcast server in the cloud.

The fourth aspect provides an audience terminal, including:

The first receiving module is configured to receive the connection notification sent by the cloud game host through the interactive signaling server in the cloud, wherein the connection notification carries the connection information of the master game server GS, and the connection notification is used to notify the first viewer and the host Control GS to establish a connection;

Establish a connection module, which is configured to establish a connection with the main control GS based on the connection information of the main control GS;

The first pull module is configured to pull multimedia information for the anchor from the live streaming server in the cloud; and

The push module is configured to push the control commands for the game to the main control GS of the cloud game server, so that the main control GS of the cloud game server generates cloud game screen and sound data based on the control command, and pushes the cloud game screen and sound data to stream Live streaming server to the cloud.

In a possible implementation, the audience side further includes: a second receiving module configured to receive the video stream and audio stream pushed by the master GS of the cloud gaming server through the point-to-point P2P real-time protocol, where the video stream and the audio stream are It is obtained by encoding the game screen and sound data generated based on the control instruction by the main control GS of the cloud game server.

In a possible implementation manner, the audience terminal further includes: a third receiving module configured to receive a notification message for revocation of the control right sent by the interactive signaling server in the cloud, wherein the notification message is used to notify the first audience terminal, The host of the cloud game withdraws the control rights for cloud games.

In a possible implementation manner, the audience terminal further includes: a second pulling module configured to stop pulling game images and sound data from the live streaming server in the cloud.

In the fifth aspect, a cloud game anchor terminal is provided, including:

One or more processors;

Memory

One or more application programs, where one or more application programs are stored in a memory and configured to be executed by one or more processors, and one or more programs are configured to: execute according to the first aspect or the first aspect The operation corresponding to the cloud game live broadcast method shown in any possible implementation manner.

In the sixth aspect, a cloud game anchor terminal is provided, including:

One or more processors;

Memory

One or more application programs, where one or more application programs are stored in a memory and configured to be executed by one or more processors, and one or more programs are configured to: execute according to the second aspect or the second aspect The operation corresponding to the cloud game live broadcast method shown in any possible implementation manner.

In a seventh aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the cloud game live broadcast method shown in the first aspect or any possible implementation manner of the first aspect is implemented.

In an eighth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the cloud game live broadcast method shown in the second aspect or any possible implementation manner of the second aspect is implemented.

The beneficial effects brought about by the technical solution provided by this application are:

This application provides a cloud game live broadcast method, a cloud game host and a computer-readable storage medium. Compared with the prior art, in this application, when the audience in the live broadcast room obtains the control right of the cloud game, the first viewer The connection notification carries the connection information of the master game server GS. The connection notification is used to notify the first audience terminal to establish a connection with the master GS. The first audience terminal obtains the cloud game control right from the audience terminal, and then from the live broadcast The streaming server pulls the cloud game image and sound data, and pushes multimedia information for the anchor to the live streaming server to realize the cloud game live broadcast. The cloud game image and sound data are generated based on the game control instructions of the first viewer. That is to say, in this application, the viewer in the live room can control the cloud game, and the cloud game host can pull the viewer’s control screen and sound data for the cloud game from the live streaming server, and push the multimedia information about the host. To the live streaming server, it can realize the combination of cloud game control and live broadcasting.

This application provides a cloud game live broadcast method, an audience terminal, and a computer-readable storage medium. Compared with the prior art, this application receives a connection notification sent by a cloud game host through an interactive signaling server in the cloud, and the connection notification carries the host Control the connection information of the game server GS, the connection notification is used to notify the first audience to establish a connection with the main control GS, and then establish a connection with the main control GS based on the connection information of the main control GS, and then pull the target from the live streaming server in the cloud The host’s multimedia information, and the game-specific control instructions are pushed to the cloud game server's main control GS, so that the cloud game server's main control GS generates cloud game screen and sound data based on the control instructions, and pushes it to the cloud live streaming server. That is, in this application, the viewer terminal that obtains the control right in the live room pulls the multimedia information for the anchor from the live streaming server, and connects with the main control GS, controls the cloud game and pushes the control instructions to the main control GS, so that The main control GS pushes the cloud game picture and sound data generated based on the control instruction to the live streaming server, thereby realizing the combination of cloud game control and live broadcast.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments of the present application.

FIG. 1 is a schematic flowchart of a cloud game live broadcast method executed by a cloud game host provided by an embodiment of the application;

2 is a schematic flowchart of a cloud game live broadcast method executed by a first audience terminal according to an embodiment of the application;

FIG. 3 is a schematic diagram of a device structure of a cloud tour anchor terminal provided by an embodiment of the application; FIG.

FIG. 4 is a schematic structural diagram of a first audience device provided by an embodiment of the application;

FIG. 5 is a schematic structural diagram of a physical device on the anchor end of a cloud game provided by an embodiment of the application; FIG.

FIG. 6 is a schematic structural diagram of another physical device of the first audience terminal provided by an embodiment of the application;

Figure 7 is a schematic diagram of the host and viewers pushing and pulling streams through the live streaming server;

FIG. 8 is a schematic diagram of establishing a connection between a cloud game server and a live streaming server in an embodiment of the application;

Fig. 9 is a schematic diagram of an example of cloud game live broadcast in an embodiment of the application.

Detailed ways

The embodiments of the present application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the drawings are exemplary, and are only used to explain the present application, and cannot be construed as limiting the present invention.

Those skilled in the art can understand that, unless specifically stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of this application refers to the presence of the described features, integers, steps, operations, elements and/or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components, and/or groups of them. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element, or intervening elements may also be present. In addition, “connected” or “coupled” used herein may include wireless connection or wireless coupling. The term "and/or" as used herein includes all or any unit and all combinations of one or more associated listed items.

In order to make the purpose, technical solutions, and advantages of the present application clearer, the implementation manners of the present application will be described in further detail below in conjunction with the accompanying drawings.

Game live broadcast uses a platform consistent with other scenarios, such as talent live broadcasts. The live broadcast system distributes the content of the host to multiple viewers in the live room. The video must be sliced and buffered. The live broadcast of the host generally uses the real-time message transmission protocol (Real Time Messaging Protocol, RTMP) as an application layer protocol, that is, the anchor end pushes RTMP streams to the live streaming server, and the streaming generally uses RTMP, HTTP-based streaming media network transmission protocol (HTTP Live Streaming, HLS) or HDL (full English name: HTTP) Deliver Living) (or HLV (full English name: HTTP Live Video)) and other protocols, among which the transport layer protocols corresponding to the push and pull streams are the Transmission Control Protocol (TCP) protocol, as shown in Figure 7. Show.

Specifically, the realizing process of the game live broadcast includes: a live streaming process at the host end and a process of viewers pulling the stream to watch the live broadcast.

Among them, the live streaming process of the host includes: when the host logs in to the live account and enters the management page to create a new live room, obtain the address of the push server, the port of the push server, and the authorization key; then the host opens the instant messaging (Instant Messaging) , IM) tool, after logging in to the live account, enter the live room to have video and graphic chat with the audience in the live room; then run the local native game, open OBS (Open Broadcaster Software) to complete the necessary settings for screen recording and streaming , Start to push the stream to the corresponding push server in the live broadcast room, so that the audience can obtain the game picture and sound of the host;

Among them, the process of live streaming from the audience includes: when the audience enters the live broadcast room by logging in to the live broadcast account (or as a visitor), it can chat with the anchor in the live broadcast room and other audiences in video and text at the same time. In the case of streaming at the host end, you can also watch the game process that the host may be doing.

On the basis of the above solution, the following technical problems may also exist: (1) In the prior art, the live broadcast system needs to be rebuilt, which is costly, time-consuming and labor-intensive; (2) The audience in the live broadcast room can only watch the host For the control of cloud games on your own terminal, you cannot directly establish in-game interaction with the host in the live broadcast platform; (3) If you need to pass the control of the cloud game to an audience in the live broadcast room, you need to directly transfer the cloud game The account number and password are passed to the audience, which leads to the disclosure of the host’s account and key, causing trouble to the user; (4) After passing the control right to a certain audience in the live broadcast room, other viewers in the live broadcast room Only the video and sound of the audience collected by the camera and microphone of the audience can be seen at the end;

The cloud game live broadcast method, client and computer-readable storage medium provided in this application are intended to solve the above technical problems in the prior art.

The cloud game live broadcast method provided by the embodiments of the present application can be applied to a cloud game live broadcast system, and the system may include: a cloud game host, the cloud, and each audience terminal (the first audience terminal and other audience terminals) in the live broadcast room, where the cloud includes : Live IM (instant messaging) server, interactive signaling server, live streaming server, cloud travel server, where cloud travel server includes: a certain game instance running in it, game service (Game Service, GS), in which each live room is generally There is only one GS that controls the main character in the game (master GS for short); further, the host of the cloud game can interact with the audiences in the live room through the live IM server; the host of the cloud game can communicate with the live broadcast through the interactive signaling server Information exchange between the various audience ends of the game; the host of the cloud game can directly exchange information with the various audience ends of the live room through the live streaming server; the host of the cloud game exchanges information with the host of the cloud through the cloud game server and the live streaming server. Of course, in the embodiment of the present application, both the first viewer terminal and the cloud tour anchor terminal can exchange information with the cloud tour server (including the master GS) through a P2P connection. On the basis of the above system, the following embodiments respectively introduce the method of cloud game live broadcast from the perspective of the cloud game host and the first audience terminal, and the cloud game live broadcast method from the perspective of interaction between the cloud game host and the first audience terminal .

The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

The embodiment of the application provides a cloud game live broadcast method. As shown in FIG. 1, it is executed by the cloud game host, where the cloud game host is the client corresponding to the host performing the cloud game live broadcast. The method includes:

Step S101: When the audience terminal in the live broadcast room obtains the control right of the cloud game, a connection notification is sent to the first audience terminal.

Wherein, the connection notification carries the connection information of the master GS, the connection notification is used to notify the first audience terminal to establish a connection with the master GS, and the first audience terminal is the audience terminal that obtains the control right of the cloud game. In this embodiment of the application, the connection information may include at least one of the following: the identity of the master GS (Identity, Id), the Id of the live broadcast room, the host Id, and the authentication token for the current control transfer of the host. , Id of the first audience, the name of the game running in the cloud, and other information.

For the embodiment of this application, the cloud game host in a live room can transfer cloud game control to any viewer in the live room. When a certain viewer in the live room obtains cloud game control, the cloud game host sends The first audience terminal sends a connection request to request the first audience terminal to establish a connection with the master GS in the live broadcast room. In the embodiment of the present application, the audience terminal that obtains the control right of the cloud game is the audience terminal that can perform cloud game control in place of the anchor.

Further, under normal circumstances, a live room corresponds to a master GS. After the cloud game host will determine the audience (first audience) that has the control right of the cloud game, it will send the interactive signaling server to the one who has the control right of the cloud game. The audience terminal sends a connection notification, so that the audience terminal (the first audience terminal) that has obtained the control right establishes a connection with the corresponding master GS based on the connection information of the master GS carried in the received connection notification.

Furthermore, after the audience terminal (the first audience terminal) who has obtained the control of the cloud game establishes a connection with the master GS, the audience terminal (the first audience terminal) who has the control of the cloud game can control the cloud game through the P2P connection The instructions are pushed to the main control GS, so that the main control GS simulates the game control instructions in the target game instance running in the cloud, obtains the game screen and sound data, and pushes them to the live streaming server, so as to realize the live streaming from the cloud game host in step S102 The cloud game screen and sound data are pulled from the streaming server, and the specific process is detailed in the following embodiments. In the embodiment of this application, the game instance is the actual running game process. Among them, the instance is the concrete representation of the object, the operation can act on the instance, and the instance can store the result of the operation in a stateful manner.

Step S102: Pull the cloud game picture and sound data from the live streaming server, and push multimedia information for the anchor to the live streaming server, so as to realize the cloud game live broadcast.

Among them, the cloud game picture and sound data are generated based on the game control instructions of the first audience terminal for the cloud game in the connected master GS.

Of course, it can be seen from the above embodiment that the cloud game host can pull cloud game screen and sound data from the live streaming server. Of course, in the live broadcast room, except for the audience terminal (the first audience terminal) who has the right to control the cloud game, Other viewers can pull cloud game images and sound data from the live streaming server. Of course, the multimedia information (video and audio) of the host that can be obtained by the cloud game host is pushed to the live streaming server, so that each viewer in the live room can pull the host-specific multimedia information from the live streaming server, and obtain and The method of pushing multimedia information for the anchor is detailed in the following embodiments. I won't repeat them here.

The embodiment of the application provides a cloud game live broadcast method. Compared with the prior art, when the audience terminal in the live broadcast room obtains the control right of the cloud game, a connection notification is sent to the first audience terminal, and the connection notification carries the master GS Connection information. The connection notification is used to notify the first audience terminal to establish a connection with the master GS. The first audience terminal is the audience terminal that has obtained the control right of the cloud game. Then it pulls the cloud game screen and sound data from the live streaming server and sends it to The live streaming server pushes the multimedia information for the anchor to realize the cloud game live broadcast. The cloud game picture and sound data are generated based on the game control instructions of the first viewer. That is, in the embodiment of the present application, the viewer in the live broadcast room can control the cloud game, and the cloud game host can pull the viewer’s control screen and sound data for the cloud game from the live streaming server, and update the host’s multimedia The information is pushed to the live streaming server, so that the control of cloud games and the live broadcast can be combined.

It can be seen from the above embodiment that when the viewer terminal in the live broadcast room obtains the control right of the cloud game, the above steps S101 and S102 are executed, but the cloud game host needs to first determine that the viewer terminal in the live broadcast room obtains the cloud game control right. The method for the host to determine that the viewer in the live broadcast room obtains the control right of the cloud game is detailed in the following embodiments.

A possible implementation of the embodiment of the present application is to determine the manner in which the audience terminal in the live broadcast room obtains cloud game control rights, including: sending the first cloud game control to a certain audience terminal in the live broadcast room through an interactive signaling server in the cloud The first cloud game control right transfer request carries the identity of the audience terminal receiving the request, and the first cloud game control right transfer request is used to invite the audience terminal in the live broadcast room to control the cloud game; In the confirmation message of the game control transfer request, it is determined that the audience terminal in the live broadcast room obtains the cloud game control.

Specifically, when the cloud game host detects the cloud game control right transfer operation triggered by the host, it sends the first cloud game control right transfer request to the cloud interactive signaling server, so that the cloud interactive signaling server controls the cloud game according to the first cloud game control. The right transfer request carries the identity of the viewer that receives the request, and sends the first cloud game control right transfer request to the corresponding viewer. Furthermore, when the cloud game host receives the viewer through the cloud interactive signaling server When the end is based on the confirmation message of the first cloud game control transfer request, it is determined that the audience end in the live broadcast room has the cloud game control right, and can know the audience end that has obtained the cloud game control right, that is, the first cloud game control right transfer request is in progress The audience terminal corresponding to the carried identifier of the audience terminal receiving the request is called, for example, the first audience terminal.

Further, the first cloud game control right transfer request may carry at least two identities corresponding to the audience terminals, and the cloud interactive signaling server sends the first cloud game control right transfer request to the corresponding audience terminals. When the cloud game host receives the confirmation message for the control of the first cloud game for the first time, it is determined that the audience terminal in the live broadcast room has obtained the cloud game control instruction, and the audience terminal that has obtained the cloud game control instruction is the first time that it has received the confirmation message for the first cloud game control. The sender corresponding to the confirmation message of the game control right, of course, can also determine the viewer who has the control right based on the anchor’s selection operation when the confirmation message sent by at least two viewers is received, and determine the audience in the live broadcast room. The audience side obtains the right to operate. Of course, the mobile game host can also randomly select one of the at least two audience sides that send the confirmation message as the audience side that has the control right, and determines that the audience side in the live broadcast room has the control right.

For example, the host of the cloud game sends the first cloud game control right transfer request to the audience A and the audience B through the interactive signaling server in the cloud. If the confirmation message from the audience A is first received, the audience who has the control right is determined The end is the viewer end A, and it is determined that the viewer end in the live room has the control right; or, after receiving the confirmation message sent by the viewer end A and the viewer end B separately, the cloud tour host end determines the viewer end based on the host's selection operation B is the viewer who has the right to control, and it is determined that the viewer in the live room has the right to control; or, after receiving the confirmation messages sent by the viewer A and the viewer B respectively, the Yunyou host randomly selects the audience Terminal A is the audience terminal that has the control right, and it is determined that the audience terminal in the live broadcast room has the control right.

In the above embodiment, it is described that the host of the cloud game actively sends a cloud game control right transfer request. Of course, the viewer in the live broadcast room can also actively send a cloud game control right transfer request to request the control right of the cloud game. For details, see the following实施例。 Example.

Another possible implementation of the embodiment of the present application is to determine the manner in which the audience terminal in the live broadcast room obtains the cloud game control right, including: receiving the second cloud game control right sent by any audience terminal through the cloud interactive signaling server Transfer request. The second cloud game control right transfer request carries the identity information of the viewer who sent the second cloud game control right transfer request. The second cloud game control right transfer request is used to request control of the cloud game and is sent through the cloud interactive signaling server In response to the confirmation message of the second cloud game control right transfer request, it is determined that the audience terminal in the live broadcast room obtains the cloud game control right.

Specifically, after receiving the second game control transfer request sent by any viewer through the interactive signaling server in the cloud, the anchor end of the cloud game can display it to the anchor. When the anchor's confirmation operation is detected, the anchor end of the cloud game will respond to The confirmation message of the second cloud game control right transfer request is sent to the corresponding audience terminal through the interactive signaling server in the cloud, so as to confirm that the audience terminal in the live broadcast room obtains the cloud game control right.

Of course, after the mobile game host receives the second game control transfer request sent by at least two viewers within a preset time period, it can be displayed to the host, and then based on the host’s selection and manipulation, the viewer that has the control right is determined. And send a confirmation message for the second cloud game control transfer request sent by it; or based on the order in which the control transfer request is received, determine the audience that has the control right, and send the second cloud game sent to it. A confirmation message for the transfer request of the game control right; or the cloud game host can randomly determine the viewer terminal that has the control right, and send a confirmation message for the second cloud game control transfer request sent by it.

For example, the host of the cloud game receives the second game control transfer request sent by the viewer C and the viewer D within 1 minute, and displays it to the host. Based on the host's selection operation, it is determined that the viewer C is the viewer with the control rights. At the end, it sends a confirmation message for the second cloud game control transfer request to the audience C; or the cloud game host receives the second game control transfer request sent by the audience C and the audience D separately within 1 minute, And first receives the request of the audience terminal C, it is determined that the audience terminal C is the audience terminal that has the control right, and then the confirmation message for the second cloud game control right transfer request is sent to the audience terminal C, and it is determined that the audience terminal has obtained the cloud game Control; or, the cloud game host randomly selects the audience terminal D as the audience terminal that has the control right, and sends a confirmation message for the second cloud game control right transfer request to the audience terminal D, and determines that the audience terminal obtains the cloud game Control.

Further, in addition to the above two methods ((1) The host of the cloud game determines the audience that sends the cloud game transfer request, and sends the first cloud game control right transfer request to the determined audience, and then determines that the audience obtains the cloud game. Control; (2) The cloud game host directly receives the second cloud game control transfer request sent by the audience, and then determines the audience that has the control right to determine that the audience has the control of the cloud game. Of course, it can also be controlled by the audience. The interactive signaling server in the cloud determines the audience end that receives the cloud game transfer request. For details, refer to the following embodiments.

Another possible implementation of the embodiment of the present application is to determine the manner in which the audience terminal in the live broadcast room obtains cloud game control rights, including: sending a third cloud game control right transfer to any audience terminal through the cloud interactive signaling server The request, where the audience that receives the third cloud game control right transfer request is determined by the cloud interactive signaling server; when the confirmation message for the third cloud game control right transfer request is received, the audience in the live broadcast room is determined The terminal obtains the control right of the cloud game, and the confirmation message for the third cloud game control right transfer request carries the identity of the audience terminal corresponding to the sender of the confirmation message.

Specifically, the cloud game host sends a third cloud game control right transfer request. After the cloud interactive signaling server receives the transfer request, it determines the audience that receives the third cloud game control right transfer request, and then transfers the third cloud game control right transfer request. Three cloud game control transfer request is pushed to the corresponding audience. In the embodiment of the present application, the interactive signaling server in the cloud can randomly determine the audience side that receives the third cloud game control right transfer request, and can also obtain the control right record based on history to determine to receive the third cloud game control The audience side of the right transfer request. Of course, the method of determining the viewer terminal receiving the third cloud game control right transfer request based on other methods is within the protection scope of the embodiment of the present application.

Further, after the cloud game host receives the confirmation message for the third cloud game control transfer right, the method of determining the audience terminal to obtain the control right and the method of determining the audience terminal obtaining the cloud game control right are as described in the above-mentioned embodiment The method is similar, so I won't repeat it here.

Of course, in addition to determining the audience terminal that obtains cloud game control rights and determining the manner in which the audience terminal obtains cloud game control rights described in the embodiments of this application, there are other possibilities to determine the audience terminal that obtains cloud game control rights and determine the audience terminal. The ways to obtain the cloud game control right are all within the protection scope of the embodiments of the present application.

It can be seen from the above embodiment that the cloud game host transfers the control of the cloud game to a certain viewer in the live broadcast room. At this time, the cloud game host does not need to connect with the master GS at this time. Therefore, in this embodiment of the application , Also includes: disconnect the connection with the master GS.

Further, at the same time or after it is determined that the viewer terminal of the live broadcast terminal obtains the control of the cloud game, the disconnection operation with the master GS can be performed; of course, the connection with the master GS can also be disconnected at the same time or after the connection notification is sent. Operation, or when it is detected that the audience terminal (the first audience terminal) that has obtained the control right establishes a connection with the master GS, the connection operation with the master GS is disconnected. The specific execution sequence is not limited in the embodiments of the present application. Any possible execution order falls within the protection scope of the embodiments of this application.

It can be seen from the above embodiment that the viewer end (the first viewer end) that obtains the control right can also obtain the control right for the cloud game, and the cloud game host still has the ability to push multimedia information for the host to the live streaming server in the cloud. Specifically, Pushing multimedia information for the host to the live streaming server includes: obtaining the multimedia information for the host through the multimedia acquisition device; pushing the multimedia information for the host to the live streaming server through RTMP streaming, so that each viewer can pull from the live streaming server Get multimedia information for the anchor.

Among them, multimedia information includes: video data and audio data.

Specifically, the anchor end of the cloud game obtains the anchor's video data through the camera, and obtains the anchor's audio data through the microphone, and pushes the obtained video data and audio data to the live streaming server through RTMP streaming, so that each audience in the live room (Including the first audience terminal and other audience terminals) pull the anchor's video data and audio data from the live streaming server.

Of course, the above-mentioned acquired multimedia information for the host may also include multimedia information when the host of the cloud tour is connected to microphones and multi-person meetings. Therefore, the embodiment of the application does not affect the interaction of the host of the cloud tour with other viewers and other hosts.

Further, in addition to cloud game picture and sound data, and multimedia information for the anchor, it may also include chat information and gift information. In this embodiment of the application, the chat information input by the cloud game anchor on the public screen can be broadcast The IM server is transmitted to each audience in the live room. Of course, the chat information input by any audience in the live room on the public screen can also be transmitted to the cloud game host and each audience through the live IM server. Of course, any audience can give it away. The gift information for the host can also be transmitted to the cloud tour host and each audience through the live IM server, so as to display the gift information given by the audience at the corresponding location.

Further, the cloud game host only transfers the control of the cloud game to the audience (the first audience). In fact, the cloud game host still has the control of the cloud game, that is, it can take back the first audience’s control of the cloud game at any time. Control rights, as follows:

Another possible implementation manner of the embodiment of the present application further includes: sending a notification of taking back the control right to the first audience through the interactive signaling server in the cloud, and sending disconnection to the master GS through the interactive signaling server in the cloud Notice.

For the embodiment of the present application, there is no difference between the step of sending a notification of taking back the control right to the first audience through the interactive signaling server in the cloud and the step of sending a disconnection notification to the master GS through the interactive signaling server in the cloud. Strict order, that is, the two can be performed at the same time, and one of the steps can be performed before the other.

Among them, the notice of taking back the control right is used to notify the first viewer end, the cloud game host end takes back the control right of the cloud game, and the disconnect notice is used to notify the master GS to disconnect from the first viewer end.

Specifically, after the audience side in the live broadcast room obtains the control right of the cloud game, it can send a notification of taking back the control right to the interactive signaling server in the cloud, so that the interactive signaling server in the cloud can send the control right request to the audience side (first The audience side) sends a notification of taking back the control right. For example, the audience side that has obtained the control right can only display "The cloud game host has taken back the control right of the cloud game and will not be able to control the cloud game after XXX time" and so on.

Further, the cloud game host sends a disconnection notification to the master GS through the interactive signaling server in the cloud, so that the master GS receiving the disconnection notification will disconnect after a preset time and the viewer terminal that has the control right (The first audience) connection. For example, the main control GS starts a countdown after receiving the disconnection notification, and actively disconnects the connection with the audience terminal (the first audience terminal) that has the control right after the countdown ends.

In this embodiment of the application, the cloud game host can send a withdrawal control notification to the first viewer at any time, and the cloud game control right can be withdrawn without the first viewer’s consent, that is, the cloud game host has absolute control of the cloud game. This can ensure that the cloud game host is in control of the cloud game live broadcast and enhance the experience of the host.

Of course, after the cloud game host has retracted the control of the cloud game, the game control can also be transferred to another audience side in the above manner. Of course, the game control can also be transferred again on the same audience side. The specific method is shown above, here No longer. Furthermore, the audience end (the first audience end) that has obtained the control right can also transfer the control right of the game to another audience end in the live broadcast room. The specific operation process is as follows:

(1) The first viewer end sends a control right transfer request to another viewer end, either through the interactive signaling server or not through the interactive signaling server;

Of course, before the first viewer end sends a control right transfer request to another viewer end, it first sends a request whether to allow the control right transfer to the cloud tour host end, and the request carries the identity information of the viewer end to be controlled.

(2) The first audience terminal receives the confirmation control of the control right transfer request from the other audience terminal, either through the interactive signaling server or not through the interactive signaling server;

(3) The first audience terminal sends a connection notification to the other audience terminal, carrying the connection information of the master GS, so that the other audience terminal establishes a connection with the master GS;

(4) The first audience terminal is disconnected from the main control GS, and the sequence of this step and (2) and (3) is not limited;

(5) The main control GS receives the control instruction from the other audience side, simulates the corresponding control, obtains the game screen and sound data, and pushes the game screen and sound data to the live streaming server;

(6) The first audience terminal, the cloud game host terminal, and other audience terminals (except the first audience terminal and the other audience terminal) pull the game screen and sound data from the live streaming server;

Of course, the anchor end of the cloud game will still push the multimedia information for the anchor to the live streaming server, so that each viewer end can pull the multimedia information for the anchor.

Further, in the above case, the anchor still has the control right to withdraw the authority, and the specific method is similar to the above withdrawal method, and will not be repeated.

Of course, in the above-mentioned embodiment, if neither the cloud game host nor the first viewer terminal receives any confirmation message for the cloud game control transfer request, the cloud game transfer request can be re-sent to other viewer terminals, and of course it can continue. Control cloud games. Further, the viewer terminal that has obtained the cloud game may also send a request to the cloud game host to request the cloud game host to withdraw its cloud game control rights.

It can be seen from the above embodiment that the cloud game host needs to interact with the audience in the live room. Therefore, the method further includes: obtaining the identity information corresponding to all the viewers in the live room from the instant messaging IM live server in the cloud.

Specifically, the step of obtaining the identity information corresponding to all the viewers in the live broadcast room from the IM live broadcast server in the cloud may be performed before sending the connection notification to the first viewer, or may be located at the interactive signaling server in the cloud to the live broadcast. Before a certain viewer terminal sends the first cloud game control right transfer request, of course, it can also be located at the same time or after the cloud game anchor terminal logs in to the live broadcast room. It is not limited in the embodiments of this application.

The foregoing embodiment mainly introduces the cloud game live broadcast method from the perspective of the cloud game host. The following describes the cloud game live broadcast method mainly from the first viewer terminal (the viewer terminal that obtains the control right). For details, refer to the following embodiments.

The embodiment of the present application also provides another cloud game live broadcast method, as shown in FIG. 2, executed by the first audience terminal, including:

Step S201: Receive a connection notification sent by the cloud game host through the interactive signaling server in the cloud.

Wherein, the connection notification carries the connection information of the master GS, and the connection notification is used to notify the first audience to establish a connection with the master GS.

Specifically, the manner in which the first viewer terminal receives the connection notification sent by the cloud game host through the cloud interactive signaling server and the connection information of the master GS are detailed in the above-mentioned embodiment, and will not be repeated here.

Step S202: Establish a connection with the main control GS based on the connection information of the main control GS. In the embodiment of the present application, the first audience terminal establishes a P2P connection with the main control GS based on the received connection information of the main control GS.

Further, the cloud game control can be realized only after the first audience terminal establishes a connection relationship with the main control GS.

Step S203: Pull multimedia information for the anchor from the live streaming server in the cloud, and push the game-specific control instructions to the main control GS of the cloud game server, so that the main control GS of the cloud game server generates cloud game images and images based on the control instructions. The audio data is pushed to the live streaming server in the cloud.

Specifically, the first viewer terminal obtains the viewer's control instructions for the cloud game, and pushes the control instructions for the cloud game to the master GS through the P2P real-time protocol stream, so that the master GS corresponds to the target game instance running in the cloud The game control instructions are simulated in the game control command, and based on the control result, the game picture and sound data are generated, and streamed to the live streaming server, so that the cloud game host and other viewers can pull the game picture and sound data from the live streaming server. Of course, the cloud game host and other viewers can pull the game screen and sound data by pulling RTMP streams, HLS streams or other protocol streams.

Of course, the first viewer and other viewers still pull multimedia information for the anchor from the live streaming server.

The embodiment of the application provides a cloud game live broadcast method. Compared with the prior art, the embodiment of the application receives a connection notification sent by a cloud game host through an interactive signaling server in the cloud, and the connection notification carries the connection information of the master GS , The connection notification is used to notify the first audience to establish a connection with the master GS, and then establish a connection with the master GS based on the connection information of the master GS, and then pull the multimedia information for the anchor from the live streaming server in the cloud, and The game control commands are pushed to the main control GS in the cloud game server, so that the main control GS in the main control GS of the cloud game server generates cloud game screen and sound data based on the control instructions, and pushes them to the live streaming server in the cloud. That is, in this application, the viewer terminal that obtains the control right in the live room pulls the multimedia information for the anchor from the live streaming server, and connects with the main control GS, controls the cloud game and pushes the control instructions to the main control GS, so that The main control GS pushes the cloud game picture and sound data generated based on the control instruction to the live streaming server, thereby realizing the combination of cloud game control and live broadcast.

Another possible implementation manner of the embodiment of the present application is to establish a connection with the main control GS based on the connection information of the main control GS, and then further includes: stopping to pull the game screen and sound data from the live streaming server in the cloud.

For the embodiment of this application, since the first audience terminal obtains the control right of the cloud game, that is, the first audience terminal controls the cloud game, the first audience terminal stops the live broadcast from the cloud after establishing a connection relationship with the master GS Pull the game screen and sound data from the streaming server. But it still pulls multimedia information for the anchor.

Furthermore, although the first audience end (the audience who has the control right) pushes the control instructions for the game to the main control GS of the cloud game server, the first audience (the audience who has the control right) also needs to obtain the control instructions for the cloud game. Therefore, after pushing the control instructions for the game to the cloud game server, it also includes: receiving the video stream and audio stream pushed by the main control GS of the cloud game server through the point-to-point P2P real-time protocol. The video stream and audio stream are from the cloud game server The main control GS is obtained by encoding the game picture and sound data generated based on the control command.

Specifically, in the above-mentioned embodiment, the main control GS in the cloud game server generates cloud game picture and sound data based on the control instruction, and can also encode it to obtain the corresponding video stream and audio stream, and push the video stream and audio stream to Live streaming server, and push the video stream and audio stream to the first audience (the audience with the control right) through the P2P real-time protocol, that is, the first audience receives the video stream and audio pushed by the master GS in the cloud game server flow.

Further, the first audience terminal only obtains the control right of the cloud game, but the cloud game host terminal can withdraw the control right of the first audience terminal for the cloud game at any time. Specifically, the method further includes: receiving the cloud-based interactive signaling server. The notification message of taking back the control right.

Among them, the notification message is used to notify the first viewer end that the cloud game anchor end takes back the control right for the cloud game.

For the manner of receiving the notification message of reclaiming the control right sent by the interactive signaling server in the cloud, please refer to the corresponding embodiment of the cloud game host for details, which will not be repeated here.

It can be seen from the above embodiment that whether it is the cloud game host controlling the cloud game or the audience controlling the cloud game with the control right, the master GS needs to push the control result (cloud game screen and sound data) to the live streaming server, because Before controlling the cloud game, the master GS and the host streaming server need to establish a connection relationship; specifically, the master GS receives the streaming address and key sent by the Yunyou host, and the push address and key are when the Yunyou host logs in to the live room The obtained push stream address and key; the master control GS updates the stored push stream address based on the received push stream address; the master control GS sends the connection carrying the key to the live streaming server based on the updated push stream address Request to establish a connection between the live streaming server and the cloud game server. In the embodiment of this application, after the master GS receives the push stream address and key sent by the host of Yunyou, it can also update the stored push stream address according to the received push stream address, and directly according to the received push stream address. The push stream address sends a connection request carrying the key to the host stream server.

Specifically, when a Yunyou host logs in to the live room, the host obtains the push address and key, and then the Yunyou host receives the push address and key entered by the user (host) on the page side, and will push the address when starting the game And the key is transmitted to the main control GS of the cloud game server, the main control GS updates the stored push stream address, and sends a connection request carrying the key to the live stream server based on the updated push stream address, so that the live stream server The verification is based on the key, and after the verification is passed, a connection between the live streaming server and the master GS of the cloud game server is realized, as shown in Fig. 8.

Further, on the basis of the foregoing embodiment, a specific example is introduced to introduce the cloud game live broadcast method, as shown in FIG. 9.

① The host of the cloud game obtains the corresponding identities of each audience in the live room from the live IM server in the cloud through the live SDK;

②The host of the cloud game sends a cloud game control right transfer request to a certain audience through the interactive signaling server in the cloud;

③If the viewer agrees to obtain the control right, it will send a confirmation message for the cloud game control right transfer request to the cloud game host through the cloud interactive signaling server;

④The anchor end of the cloud game disconnects the connection with the master GS in the cloud game server;

⑤Send a connection notification to the audience that has the control right to notify the audience to establish a connection with the master GS;

⑥The audience terminal that has obtained the control right establishes a P2P connection with the main control GS (at this time, the control command for cloud games can be sent to the main control GS);

⑦The viewer terminal that has obtained the control right sends a connected notification message to the cloud tour host through the interactive signaling server to notify the cloud tour host, and the viewer terminal that has the control right establishes a connection with the master GS;

⑧ The viewer who has obtained the control right stops pulling the corresponding game screen and sound data from the live streaming server;

⑨The main control GS pushes the game screen and sound data to the live streaming server;

⑩The cloud game host and other viewers pull the game screen and sound data from the live streaming server; further, other viewers pull the game screen and sound data from the live streaming server, which is no longer shown in Figure 9;

The host of the tour pushes the multimedia information for the host to the live streaming server;

A viewer terminal pulls multimedia information for the anchor from the live streaming server.

Among them, ⑨⑩

There is no restriction on the order of execution. Moreover, the multimedia information for the live broadcast that other viewers pull from the live streaming server is not shown in FIG. 9.

The host of the cloud game sends a notice of revocation of the control right through the interactive signaling server to the audience that has the control right, and sends a disconnection notice to the master GS through the interactive signaling server, so that the master GS is disconnected and the audience who has the control right P2P connection at the end.

Among them, the disconnection of the main control GS and the connection of the audience terminal with the control right are not shown in FIG. 9.

Furthermore, it can be seen from the above embodiment that the cloud game host only transfers the cloud game control rights to a certain audience, and does not need to transmit the game account and key, so as to avoid the leakage of the game account and key, resulting in insecure information. Circumstances, and improve the interaction between the anchor and the audience.

Furthermore, it can be seen from the above embodiment that when the cloud game host has the cloud game control right, the cloud game host connects to the master GS through P2P to push the cloud game control instructions to the master GS, and then the master GS will The game screen and sound data generated by the cloud game control instruction is pushed to the live streaming server in the cloud, so that each viewer in the live room can pull the game screen and sound data from the live streaming server in the cloud; and, cloud travel The host can also push the acquired multimedia information for the host to the live streaming server in the cloud, so that each viewer in the live room can pull the corresponding multimedia information for the host from the live streaming server in the cloud. When any viewer in the room pulls the corresponding data, it can send a request message to the live streaming server to request the type of data to be pulled. If the requested data is the multimedia information of the host, or the cloud game screen and For audio data, pull the multimedia information for the anchor or cloud game picture and sound data from the live streaming server in the cloud. If the requested data is the multimedia information for the anchor and the cloud game picture and sound data, the cloud The live streaming server can synthesize the multimedia information for the host and the cloud game picture and sound data into a stream through image superposition or image synthesis processing, and the viewer can pull the stream to obtain the multimedia information for the host And cloud game screen and sound data; of course, after the cloud game host end transfers the control of the cloud game to a certain audience in the live room (the first audience), other audiences in the live room (except the first audience) When pulling data from the live streaming server, it is also applicable to the above-mentioned pulling method, which will not be repeated here.

Further, in the embodiment of the present application, the main control GS can be integrated into the game instance, or of course, can also exist separately. This is not limited in the embodiments of the present application.

The above-mentioned embodiments respectively introduced the cloud game host end executing cloud game live broadcast method and the first audience end executing cloud game live broadcast method from the perspective of the method flow. The following introduces a cloud game host end from the perspective of a virtual module or a virtual unit. The first audience terminal, the cloud game anchor terminal and the first audience terminal introduced in the embodiments of the present application may be applicable to the foregoing method embodiments, and will not be repeated here.

The embodiment of the present application provides a cloud game anchor terminal. As shown in FIG. 3, the cloud game anchor terminal 30 may include: a first sending module 31, a pull and push module 32, wherein:

The first sending module 31 is configured to send a connection notification to the first audience terminal when the audience terminal in the live broadcast room obtains the control right of the cloud game.

Wherein, the connection notification carries the connection information of the master GS, the connection notification is used to notify the first audience terminal to establish a connection with the master GS, and the first audience terminal is the audience terminal that obtains the control right of the cloud game.

The pull and push module 32 is configured to pull the cloud game picture and sound data from the live streaming server, and push multimedia information for the anchor to the live streaming server, so as to realize the cloud game live broadcast.

Among them, the cloud game picture and sound data are generated based on the game control instructions of the first audience terminal.

In another possible implementation manner of the embodiment of the present application, the cloud tour anchor terminal 30 further includes: a first determining module, wherein:

When the first determining module determines that the audience terminal in the live broadcast room obtains the control right of the cloud game, it is specifically configured as follows:

The first cloud game control right transfer request is sent to a certain audience in the live broadcast room through the cloud interactive signaling server. The first cloud game control right transfer request carries the identity of the audience receiving the request. The first cloud game control right transfer The request is used to invite the audience in the live broadcast room to control the cloud game;

In another possible implementation manner of the embodiment of the present application, the cloud tour anchor terminal 30 further includes: a second determining module, wherein:

Receive a second cloud game control right transfer request sent by any viewer through the cloud interactive signaling server. The second cloud game control right transfer request carries the identity information of the viewer who sent the second cloud game control right transfer request, and the second cloud The game control transfer request is used to request the control of cloud games,

In another possible implementation manner of the embodiment of the present application, the cloud tour anchor terminal 30 further includes: a third determining module, wherein:

Sending a third cloud game control right transfer request to any audience terminal through the cloud interactive signaling server, where the audience terminal that receives the third cloud game control right transfer request is determined by the cloud interactive signaling server;

When the confirmation message for the third cloud game control transfer request is received, it is determined that the audience in the live broadcast room obtains the cloud game control. The confirmation message for the third cloud game control transfer request carries the audience corresponding to the sender of the confirmation message The identity of the terminal.

In another possible implementation manner of the embodiment of the present application, the cloud tour anchor terminal 30 further includes: a disconnection module, where:

The disconnect module is configured to disconnect from the main control GS.

In another possible implementation manner of the embodiment of the present application, when the pushing module 33 pushes the multimedia information for the anchor to the live streaming server, it is configured to:

Acquire multimedia information for the host of the cloud game through the multimedia acquisition device, and the multimedia information includes: video data and audio data;

Push the multimedia information for the anchor to the live streaming server through RTMP streaming, so that each viewer can pull the multimedia information for the anchor from the live streaming server.

In another possible implementation manner of the embodiment of the present application, the cloud tour anchor terminal 30 further includes: a second sending module, where:

The second sending module is configured to send a notification of taking back the control right to the first audience through the interactive signaling server in the cloud, and to send a disconnection notification to the master GS through the interactive signaling server in the cloud, and the notification of taking back the control right is used for The first viewer is notified that the cloud game host will withdraw the control of the cloud game, and the disconnect notification is used to notify the master GS to disconnect from the first viewer.

In another possible implementation manner of the embodiment of the present application, the cloud tour anchor terminal 30 further includes: an acquisition module, wherein:

The embodiment of the application provides a cloud game host. Compared with the prior art, the embodiment of the application sends a connection notification to the first audience terminal when the audience terminal in the live broadcast room obtains the control right of the cloud game, and the connection notification carries the host Control the connection information of the GS, the connection notification is used to notify the first audience to establish a connection with the master GS. The first audience is the audience that has the control of the cloud game, and then pulls the cloud game screen and sound data from the live streaming server , And push the multimedia information for the anchor to the live streaming server to realize the cloud game live broadcast. The cloud game picture and sound data are generated based on the game control instructions of the first viewer. That is, in the embodiment of the present application, the viewer in the live room can control the cloud game, and the cloud game host can pull the viewer’s control screen and sound data for the cloud game from the live streaming server, and then update the host’s multimedia The information is pushed to the live streaming server, so that the control of cloud games and the live broadcast can be combined.

The embodiment of the present application also provides a first audience terminal. As shown in FIG. 4, the first audience terminal 40 may include: a first receiving module 41, a connection establishing module 42, a first pulling module 43, and a pushing module 44, among them,

The first receiving module 41 is configured to receive the connection notification sent by the cloud game host through the interactive signaling server in the cloud.

The connection establishment module 42 is configured to establish a connection with the main control GS based on the connection information of the main control GS.

The first pulling module 43 is configured to pull multimedia information for the host from the live streaming server in the cloud.

The push module 44 is configured to push the control commands for the game to the main control GS of the cloud game server, so that the main control GS of the cloud game server generates cloud game screen and sound data based on the control instructions, and pushes it to the live streaming server in the cloud .

In a possible implementation manner of the embodiment of the present application, the first audience terminal 40 further includes: a second receiving module, wherein:

The second receiving module is configured to receive the video stream and audio stream pushed by the main control GS of the cloud game server through the point-to-point P2P real-time protocol. The video stream and audio stream are generated by the main control GS of the cloud game server based on the control instructions. Sound data is encoded.

In a possible implementation manner of the embodiment of the present application, the first audience terminal 40 further includes: a third receiving module, wherein:

The third receiving module is configured to receive the notification message of reclaiming the control right sent by the interactive signaling server in the cloud.

In a possible implementation manner of the embodiment of the present application, the first audience terminal 40 further includes: a second pull module, wherein:

The second pulling module is configured to stop pulling the game screen and sound data from the live streaming server in the cloud.

The embodiment of the application provides a first viewer terminal. Compared with the prior art, the embodiment of the application receives a connection notification sent by the cloud game host through the interactive signaling server in the cloud, and the connection notification carries the connection information of the master GS , The connection notification is used to notify the first audience to establish a connection with the master GS, and then establish a connection with the master GS based on the connection information of the master GS, and then pull the multimedia information for the anchor from the live streaming server in the cloud, and The control commands for the game are pushed to the main control GS of the cloud game server, so that the main control GS of the cloud game server generates cloud game screen and sound data based on the control instructions, and pushes it to the live streaming server in the cloud. That is, in the embodiment of the present application, the audience terminal that obtains the control right in the live broadcast room pulls multimedia information for the anchor from the live streaming server, and connects with the main control GS, controls the cloud game and pushes the control instructions to the main control GS, In this way, the main control GS pushes the cloud game picture and sound data generated based on the control instruction to the live streaming server, thereby realizing the combination of cloud game control and live broadcast.

The above embodiment introduces a cloud game host and first audience terminal from the perspective of a virtual module or a virtual unit. The following embodiment introduces a cloud game host and first audience terminal from the perspective of a physical device. For details, see The following examples.

The embodiment of the present application provides a cloud game anchor terminal. As shown in FIG. 5, the cloud game anchor terminal 5000 shown in FIG. 5 includes a processor 5001 and a memory 5003. Among them, the processor 5001 and the memory 5003 are connected, for example, through a bus 5002. Optionally, the mobile host 5000 may further include a transceiver 5004. It should be noted that in actual applications, the transceiver 5004 is not limited to one, and the structure of the mobile host 5000 does not constitute a limitation to the embodiment of the present application.

The processor 5001 may be a CPU, a general-purpose processor, DSP, ASIC, FPGA, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor 5001 may also be a combination that implements computing functions, for example, it includes one or more microprocessor combinations, a DSP and a microprocessor combination, and so on.

The bus 5002 may include a path for transferring information between the above-mentioned components. The bus 5002 may be a PCI bus, an EISA bus, or the like. The bus 5002 can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used to represent in FIG. 5, but it does not mean that there is only one bus or one type of bus.

The memory 5003 can be ROM or other types of static storage devices that can store static information and instructions, RAM or other types of dynamic storage devices that can store information and instructions, or it can be EEPROM, CD-ROM or other optical disk storage, or optical disk storage. (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this.

The memory 5003 is used to store application program codes for executing the solutions of the present application, and is controlled by the processor 5001 to execute. The processor 5001 is configured to execute the application program code stored in the memory 5003 to implement the content shown in any method embodiment executed by the cloud game host.

The embodiment of the application provides a cloud game anchor terminal. The cloud game anchor terminal in the embodiment of the application includes: a memory and a processor; at least one program is stored in the memory and used to be executed by the processor, which is similar to the prior art. Realizable: In the embodiment of this application, when the audience terminal in the live broadcast room obtains the control right of the cloud game, a connection notification is sent to the first audience terminal. The connection notification carries the connection information of the master GS, and the connection notification is used to notify the first audience terminal. Establish a connection with the main control GS. The first audience is the one that has the control of the cloud game. Then it pulls the cloud game screen and sound data from the live streaming server, and pushes multimedia information for the anchor to the live streaming server to achieve In the cloud game live broadcast, the cloud game picture and sound data are generated based on the game control instructions of the first audience terminal. That is, in the embodiment of the present application, the viewer in the live broadcast room can control the cloud game, and the cloud game host can pull the viewer’s control screen and sound data for the cloud game from the live streaming server, and provide multimedia information about the host. Push the stream to the live streaming server, which can realize the combination of cloud game control and live broadcasting.

The embodiment of the present application provides a first audience terminal. As shown in FIG. 6, the first audience terminal 6000 shown in FIG. 6 includes a processor 6001 and a memory 6003. Among them, the processor 6001 and the memory 6003 are connected, for example, through a bus 6002. Optionally, the cloud tour anchor 6000 may further include a transceiver 6004. It should be noted that in actual applications, the transceiver 6004 is not limited to one, and the structure of the mobile host 6000 does not constitute a limitation to the embodiment of the present application.

The processor 6001 may be a CPU, a general-purpose processor, DSP, ASIC, FPGA, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor 6001 may also be a combination that implements computing functions, for example, includes a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on.

The bus 6002 may include a path for transferring information between the above-mentioned components. The bus 6002 may be a PCI bus or an EISA bus. The bus 6002 can be divided into an address bus, a data bus, a control bus, and so on. For ease of representation, only one thick line is used in FIG. 6, but it does not mean that there is only one bus or one type of bus.

The memory 6003 can be ROM or other types of static storage devices that can store static information and instructions, RAM or other types of dynamic storage devices that can store information and instructions, or it can be EEPROM, CD-ROM or other optical disk storage, or optical disk storage. (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this.

The memory 6003 is used to store application program codes for executing the solutions of the present application, and is controlled by the processor 6001 to execute. The processor 6001 is configured to execute the application program code stored in the memory 6003, so as to realize the content shown in any method embodiment executed by the first viewer terminal.

The embodiment of the present application provides a first viewer terminal. The cloud game host terminal in the embodiment of the present application includes: a memory and a processor; at least one program is stored in the memory and is used to be executed by the processor in accordance with the prior art. The comparison is achievable: The embodiment of the application receives the connection notification sent by the cloud game host through the interactive signaling server in the cloud, and the connection notification carries the connection information of the master GS, and the connection notification is used to notify the first audience to establish a connection with the master GS Connect, and then establish a connection with the master GS based on the connection information of the master GS, and then pull the multimedia information for the anchor from the live streaming server in the cloud, and push the control commands for the game to the master GS of the cloud game server to The main control GS of the cloud game server generates cloud game screen and sound data based on the control instructions, and pushes it to the live streaming server in the cloud. That is, in the embodiment of the present application, the viewer terminal that obtains the control right in the live broadcast room pulls the multimedia information for the anchor from the live streaming server, and connects with the main control GS, controls the cloud game and pushes the control instructions to the main control GS, to The main control GS pushes the cloud game picture and sound data generated based on the control instruction to the live streaming server, thereby realizing the combination of cloud game control and live broadcast.

The embodiment of the present application provides a computer-readable storage medium with a computer program stored on the computer-readable storage medium, and when it runs on a computer, the computer can execute the corresponding method in the aforementioned embodiment of the method executed by the cloud game host. content. Compared with the prior art, in this embodiment of the application, when the audience terminal in the live broadcast room obtains the control right of the cloud game, a connection notification is sent to the first audience terminal. The connection notification carries the connection information of the master GS, and the connection notification is used to notify the first audience terminal. An audience terminal establishes a connection with the main control GS. The first audience terminal is the audience terminal that has the control right of the cloud game. Then it pulls the cloud game screen and sound data from the live streaming server, and pushes the multimedia information for the host to the live streaming server. , In order to realize the cloud game live broadcast, the cloud game picture and sound data are generated based on the game control instruction of the first audience terminal. That is, in the embodiment of the present application, the viewer in the live broadcast room can control the cloud game, and the cloud game host can pull the viewer’s control screen and sound data for the cloud game from the live streaming server, and provide multimedia information about the host. Push the stream to the live streaming server, which can realize the combination of cloud game control and live broadcasting.

The embodiment of the present application provides a computer-readable storage medium with a computer program stored on the computer-readable storage medium, and when it runs on a computer, the computer can execute the aforementioned method executed by the first viewer. Corresponding content. Compared with the prior art, this embodiment of the application receives a connection notification sent by a cloud game host through an interactive signaling server in the cloud. The connection notification carries the connection information of the master GS, and the connection notification is used to notify the first viewer and the master. GS establishes a connection, and then establishes a connection with the master GS based on the connection information of the master GS, and then pulls the multimedia information for the anchor from the live streaming server in the cloud, and pushes the control commands for the game to the master GS of the cloud game server , So that the main control GS of the cloud game server generates cloud game screen and sound data based on the control instructions, and pushes it to the live streaming server in the cloud. That is, in the embodiment of the present application, the viewer terminal that obtains the control right in the live broadcast room pulls the multimedia information for the anchor from the live streaming server, and connects with the main control GS, controls the cloud game and pushes the control instructions to the main control GS, to The main control GS pushes the cloud game picture and sound data generated based on the control instruction to the live streaming server, thereby realizing the combination of cloud game control and live broadcast.

It should be understood that although the various steps in the flowchart of the drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless explicitly stated in this article, the execution of these steps is not strictly limited in order, and they can be executed in other orders. Moreover, at least part of the steps in the flowchart of the drawings may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the order of execution is also It is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

The above are only part of the embodiments of the present disclosure. It should be pointed out that for those of ordinary skill in the art, without departing from the principles of the present disclosure, several improvements and modifications can be made, and these improvements and modifications are also Should be regarded as the protection scope of the present disclosure.

Claims

A cloud game live broadcast method, executed by the cloud game host, includes:

When the audience terminal in the live broadcast room obtains the control right of the cloud game, a connection notification is sent to the first audience terminal, wherein the connection notification carries the connection information of the master game server GS, and the connection notification is used to notify the first audience terminal. The audience terminal establishes a connection with the main control GS, and the first audience terminal is the audience terminal that obtains the control right of the cloud game; and

Pull cloud game image and sound data from the live streaming server, and push multimedia information for the anchor to the live streaming server, where the cloud game image and sound data are generated based on the game control instructions of the first viewer of.
The method according to claim 1, wherein determining the manner in which the audience terminal in the live broadcast room obtains the control right of the cloud game comprises:

The first cloud game control right transfer request is sent to a certain audience terminal in the live broadcast room through the cloud interactive signaling server, wherein the first cloud game control right transfer request carries the identity of the audience terminal that receives the request, and the first cloud game control right transfer request carries the identity of the audience terminal receiving the request. A cloud game control right transfer request is used to invite viewers in the live broadcast room to control the cloud game; and

When receiving the confirmation message for the first cloud game control right transfer request, it is determined that the audience terminal in the live broadcast room obtains the cloud game control right.
The method according to claim 1, wherein determining the manner in which the audience terminal in the live broadcast room obtains the control right of the cloud game comprises:

Receive a second cloud game control right transfer request sent by any viewer through the cloud interactive signaling server, where the second cloud game control right transfer request carries the information of the viewer that sent the second cloud game control right transfer request Identity information, the second cloud game control right transfer request is used to request control of the cloud game; and

A confirmation message for the second cloud game control right transfer request is sent through the cloud interactive signaling server, and it is determined that the audience terminal in the live broadcast room obtains the cloud game control right.
The method according to claim 1, wherein determining the manner in which the audience terminal in the live broadcast room obtains the control right of the cloud game comprises:

Sending a third cloud game control right transfer request to any viewer terminal through the cloud interactive signaling server, wherein the viewer terminal that receives the third cloud game control right transfer request is determined by the cloud interactive signaling server; and

When receiving the confirmation message for the third cloud game control right transfer request, it is determined that the audience terminal in the live broadcast room obtains the cloud game control right, wherein the confirmation message for the third cloud game control right transfer request It carries the identity of the viewer corresponding to the sender of the confirmation message.
The method according to claim 1, further comprising: disconnecting the main control GS.
The method according to claim 1, wherein the pushing multimedia information for the host to the live streaming server comprises:

Acquire multimedia information for the cloud game host terminal through a multimedia acquisition device,

Wherein, the multimedia information includes: video data and audio data;

The multimedia information for the host is pushed to the live streaming server through RTMP streaming, so that each viewer terminal pulls the multimedia information for the host from the live streaming server.
The method according to claim 1, further comprising:

Sending a notice of taking back the control right to the first audience terminal through the interactive signaling server in the cloud, and

Send a disconnection notification to the master GS through the interactive signaling server in the cloud,

Wherein, the notice of taking back the control right is used to notify the first viewer end, the cloud game anchor end has taken back the control right of the cloud game, and the disconnection notice is used to notify the disconnection from the master GS and the first viewer. The audience connection.
The method according to claim 1, further comprising:

Obtain the identity information corresponding to all the viewers in the live broadcast room from the instant messaging IM live broadcast server in the cloud.
A cloud game live broadcast method, executed by the first audience terminal, includes:

Receive the connection notification sent by the cloud game host through the interactive signaling server in the cloud; wherein the connection notification carries the connection information of the master game server GS, and the connection notification is used to notify the first audience and the host Control GS to establish a connection;

Establish a connection with the main control GS based on the connection information of the main control GS; and

Pull multimedia information for the anchor from the live streaming server in the cloud, and push the game-specific control instructions to the main control GS of the cloud game server, so that the main control GS of the cloud game server generates the cloud game screen based on the control instructions And sound data, and push the cloud game picture and sound data to the live streaming server in the cloud.
According to the method of claim 9, after pushing the control instruction for the game to the master GS of the cloud game server, the method further comprises:

Receive the video stream and audio stream pushed by the master GS of the cloud game server through the point-to-point P2P real-time protocol, where the video stream and audio stream are the game screen and sound data generated by the master GS of the cloud game server based on the control instructions Coded.
The method according to claim 9 or 10, further comprising:

Receiving a notification of regaining the control right sent by the interactive signaling server in the cloud, where the notification is used to notify the first viewer end that the cloud game host end regains the control right for the cloud game.
The method according to claim 9, after the connection is established with the main control GS based on the connection information of the main control GS, the method further comprises:

Stop pulling the game screen and sound data from the live streaming server in the cloud.
A cloud tour anchor terminal, including:

The first sending module is configured to send a connection notification to the first audience terminal when the audience terminal in the live broadcast room obtains the control right of the cloud game, wherein the connection notification carries the connection information of the master GS, and the connection notification is used for Notifying the first audience terminal to establish a connection with the master GS, and the first audience terminal is the audience terminal that obtains the control right of the cloud game; and

The pull and push module is configured to pull cloud game images and sound data from the live streaming server, and push multimedia information for the anchor to the live streaming server, wherein the cloud game images and sound data are based on all Said first spectator’s game control instruction is generated.
A kind of audience, including:

The first receiving module is configured to receive a connection notification sent by the cloud game host through the interactive signaling server in the cloud, wherein the connection notification carries the connection information of the master GS, and the connection notification is used to notify the first viewer Establish a connection with the main control GS;

A connection establishment module configured to establish a connection with the main control GS based on the connection information of the main control GS;

The first pull module is configured to pull multimedia information for the anchor from the live streaming server in the cloud; and

The push module is configured to push the control instruction for the game to the main control GS of the cloud game server, so that the main control GS of the cloud game server generates cloud game screen and sound data based on the control instruction, and sends the cloud game The picture and sound data are pushed to the live streaming server in the cloud.
A cloud tour anchor terminal, including:

One or more processors;

Memory; and

One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to: execute The cloud game live broadcast method according to any one of claims 1-8.
A kind of audience, including:

One or more processors;

Memory; and

One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to: execute The cloud game live broadcast method according to any one of claims 9-12.
A computer-readable storage medium having a computer program stored thereon, and when the program is executed by a processor, the cloud game live broadcast method according to any one of claims 1 to 8 is realized.
A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, realizes the cloud game live broadcast method according to any one of claims 9-12.