CN110012362B

CN110012362B - Live broadcast voice processing method, device, equipment and storage medium

Info

Publication number: CN110012362B
Application number: CN201910305724.XA
Authority: CN
Inventors: 康谋; 刘贝林
Original assignee: Guangzhou Huya Information Technology Co Ltd
Current assignee: Guangzhou Huya Information Technology Co Ltd
Priority date: 2019-04-16
Filing date: 2019-04-16
Publication date: 2021-07-02
Anticipated expiration: 2039-04-16
Also published as: CN110012362A

Abstract

The embodiment of the invention provides a live broadcast voice processing method, a live broadcast voice processing device, live broadcast voice processing equipment and a storage medium, wherein the method comprises the following steps: the anchor live broadcast client sends voice group invitation information to at least one audience live broadcast client in the live broadcast room according to the voice group request; the anchor live broadcast client side and each target audience live broadcast client side form a group together according to a confirmation response fed back by at least one target audience live broadcast client side, and a bidirectional transmission channel corresponding to the group is triggered and established; the live client of anchor is in the in-process of the live audio frequency and video live broadcast media stream of the live client of non-target audience in to the live room through the live information transmission channel, if the live client of anchor switches to the backstage, and the recreation client switches to the proscenium, through two-way transmission channel with the live client of target audience in the group carries out speech communication, can save the time of communicating, improves communication efficiency, has avoided adopting the speech tool in the recreation client to carry out the problem of speech communication.

Description

Live broadcast voice processing method, device, equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of live broadcasting, in particular to a live broadcasting voice processing method, a live broadcasting voice processing device, live broadcasting voice processing equipment and a storage medium.

Background

With the improvement of hardware performance of terminal devices and the rapid development of the internet, real-time online live broadcast of information content has become a mainstream trend. The live broadcast mode is that the anchor can log in a live broadcast platform by using an anchor live broadcast client, live broadcast is carried out on the live broadcast platform, and audiences watching the live broadcast also select to watch the live broadcast content after entering the live broadcast platform.

In the related art, during the live game or when the anchor plays a group game with a target audience, the anchor and the target audience can communicate with each other through a bullet screen. However, the bullet screen communication efficiency through the typing mode is low, and the communication time is long; especially, when each target audience has various problems, the communication process is relatively long and inefficient due to the large amount of communication content.

In the related technology, or the anchor may perform voice communication with the target audience in a live broadcast manner, that is, the anchor live broadcast client broadcasts a live audio/video media stream synthesized by the voice of the anchor and a live broadcast frame of the anchor to the target audience live broadcast client, so that each target audience can hear the voice of the anchor. However, in this voice communication method, the voice of the anchor and the live broadcast frame need to be synthesized to generate the audio/video live broadcast media stream, and the process of synthesizing the voice of the anchor and the live broadcast frame needs a long time, which may cause the delay of the voice of the anchor, and thus reduce the communication efficiency.

In the related art, when a main broadcast and a target audience form a team game, both a main broadcast client and a game client operate on main broadcast equipment, or both a target audience live broadcast client and a game client operate on target audience equipment, only one client can occupy a microphone due to system limitation of the equipment. Thus, when the live client occupies the microphone, it results in voice communication between the anchor live client and the target audience live client that is not available for gaming. When the game client occupies the microphone, the anchor live broadcast client cannot acquire the anchor voice, so that the anchor voice cannot be received by the non-target audience live broadcast client in the live broadcast room, and the non-target audience cannot hear the anchor voice to influence the live broadcast.

Disclosure of Invention

Embodiments of the present invention provide a live broadcast voice processing method, apparatus, device, and storage medium, which can save communication time, improve communication efficiency, avoid the problem of performing voice communication using a voice tool in a game client, and avoid the problem of inaudible anchor voice due to voice communication using the voice tool of the game client.

In a first aspect, an embodiment of the present invention provides a live broadcast voice processing method, including:

the anchor live broadcast client side sends voice group invitation information to at least one audience live broadcast client side in the live broadcast room according to the voice group request;

the anchor live broadcast client side and each target audience live broadcast client side form a group together according to a confirmation response fed back by at least one target audience live broadcast client side, and a bidirectional transmission channel corresponding to the group is triggered and established;

in the process that the anchor live broadcast client side broadcasts audio and video live broadcast media streams to non-target audience live broadcast client sides in a live broadcast room through a live broadcast information transmission channel, if the anchor live broadcast client side is switched to a background, a game client side is switched to a foreground, and the anchor live broadcast client side carries out voice communication with the target audience live broadcast client sides in the group through the bidirectional transmission channel; and the non-target audience live broadcast client is an audience live broadcast client in the live broadcast room except the target audience live broadcast client in the group.

In a second aspect, an embodiment of the present invention further provides a live broadcast voice processing method, including:

the server receives voice group invitation information sent by a main broadcast live client and sends the voice group invitation information to at least one audience live client in a live broadcast room;

when the server receives a confirmation response fed back by at least one target audience live broadcast client, establishing a bidirectional transmission channel corresponding to a group formed by the anchor live broadcast client and each target audience live broadcast client;

the server sends the audio and video live broadcast media stream of the anchor live broadcast client to the non-target audience live broadcast client, and transmits the voice between the anchor live broadcast client and the target audience live broadcast client in the group through the bidirectional transmission channel, wherein the non-target audience live broadcast client is the audience live broadcast client except the target audience live broadcast client in the group in the live broadcast room.

In a third aspect, an embodiment of the present invention further provides a live broadcast voice processing method, including:

when a target audience live broadcast client receives a group invitation message sent by a main broadcast client, feeding back a confirmation response to the main broadcast client based on the operation of the target audience so that the main broadcast client triggers and establishes a two-way transmission channel corresponding to a group formed by each target audience live broadcast client;

and if the target audience live broadcast client is switched to operate in the background and the game client operates in the foreground, the target audience live broadcast client is in voice communication with other target audience live broadcast clients and the anchor live broadcast client in the group respectively through the bidirectional transmission channel.

In a fourth aspect, an embodiment of the present invention further provides an apparatus, including:

one or more processors;

a storage device for storing one or more programs,

when the one or more programs are executed by the one or more processors, the one or more processors implement a live speech processing method provided by an embodiment of the present invention.

In a fifth aspect, the embodiment of the present invention further provides a computer-readable storage medium, and a live broadcast voice processing method provided in the embodiment of the present invention.

According to the technical scheme provided by the embodiment of the invention, a group is formed by a main broadcast client and a target audience live broadcast client, and by establishing a bidirectional transmission channel corresponding to the group, when the main broadcast client broadcasts audio and video media streams to a non-target audience end of a live broadcast room in a live broadcast process, if the main broadcast client switches to a background, a game client is switched to a foreground, and the main broadcast client can carry out voice communication with each target audience live broadcast client through the bidirectional information transmission channel, so that the problem of low efficiency of bullet screen communication during team games between the main broadcast and the target audience can be solved, the problem of voice delay of the main broadcast in voice communication between the main broadcast and the target audience can be solved, and the communication efficiency can be improved; through at the live client operation proscenium of the anchor, the game client runs in the scene of the proscenium, the live client of the anchor can carry out voice communication with each target audience live client through the two-way transmission channel, can guarantee that the anchor and the target audience carry out voice communication when playing a group game, the communication efficiency is improved, the problem that voice communication is carried out by adopting a voice tool in the game client is avoided, the audio and video live broadcast media stream is live broadcast to the non-target audience in the live broadcast room through the live broadcast information transmission channel, the non-target audience can watch the live broadcast, thereby the non-target audience can be guaranteed to hear the voice of the anchor, so the problem that the voice of the anchor can not be heard because of the voice tool depending on the game client carries out voice communication is avoided.

Drawings

Fig. 1a is a flowchart of a live speech processing method according to an embodiment of the present invention;

fig. 1b is a display interface of a live broadcast room of a main broadcast client according to an embodiment of the present invention;

fig. 1c is a schematic diagram of a detailed page of a voice group displayed by a anchor live client according to an embodiment of the present invention;

FIG. 1d is a flowchart of a live voice processing method according to an embodiment of the present invention

Fig. 2a is a flowchart of a live speech processing method according to an embodiment of the present invention;

fig. 2b is a schematic diagram of a live speech processing according to an embodiment of the present invention;

fig. 3 is a flowchart of a live voice processing method according to an embodiment of the present invention;

fig. 4a is a flowchart of a live speech processing method according to an embodiment of the present invention;

FIG. 4b is a schematic diagram of a display interface of a viewer live client according to an embodiment of the present invention;

fig. 4c is a schematic diagram of a display interface of a target viewer live client according to an embodiment of the present invention;

fig. 5 is a flowchart of a live voice processing method according to an embodiment of the present invention;

fig. 6 is a flowchart of a live voice processing method according to an embodiment of the present invention;

fig. 7 is a block diagram of a live speech processing apparatus according to an embodiment of the present invention;

fig. 8 is a block diagram of a live speech processing apparatus according to an embodiment of the present invention;

fig. 9 is a block diagram of a live speech processing apparatus according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of an apparatus according to an embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

Fig. 1a is a flowchart of a live voice processing method according to an embodiment of the present invention, where the method is performed by a live voice processing apparatus, the apparatus is implemented by software and/or hardware, the apparatus is configured at a anchor live client, and the anchor live client may be installed on an anchor device. The anchor device may be a tablet computer, a mobile phone, a computer, or a like smart device having a display screen. Specifically, in the embodiment of the present invention, the anchor live client and the game client may be configured in the anchor device.

The method provided by the embodiment of the invention can be applied to a scene that a main broadcast and audiences carry out communication and interaction in the live broadcast process. Specifically, the method provided by the embodiment of the invention can be applied to a scene of communication and interaction between a main broadcast and audiences in the process of live broadcast games.

As shown in fig. 1a, the technical solution provided by the embodiment of the present invention includes:

s110: and the anchor live broadcast client sends voice group invitation information to at least one audience live broadcast client in the live broadcast room according to the voice group request.

In an embodiment of the present invention, the anchor live client may be a live client configured on the anchor device. The viewer live client may be a live client of a viewer disposed on a viewer device.

In the embodiment of the invention, when the anchor live client runs in the foreground, a control for initiating the voice group can be displayed on a display interface of the live broadcast room. When the anchor triggers the control, the anchor live broadcast client receives the voice group request and sends voice group invitation information to at least one audience live broadcast client in the live broadcast room according to the voice group request. When the anchor triggers the control initiating the voice group, the anchor live client can display a detailed page of the voice group for introducing information on how to perform voice group operation and display a start control. When the anchor triggers the start control, the anchor live broadcast client receives the voice group request and sends voice group invitation information to at least one audience live broadcast client in the live broadcast room according to the voice group request. The form of triggering the anchor live broadcast client to send the voice group invitation information to the audience live broadcast client in the live broadcast room is not limited to the above form.

For example, as shown in fig. 1b, on the display interface of the live broadcast room of the anchor live broadcast client, a control 1 for initiating a voice group may be displayed, and the display position of the control is not limited. Corresponding text prompt information can be displayed in the component 1, and preset voice icons and the like can be displayed, so that the anchor is easily distinguished from other components. The anchor live client can also display a detailed page of the voice group when the anchor triggers this component 1. As shown in fig. 1c, the detail page shows the operation information of how to group the voice group, for example, information of how to start the voice group, some basic operation information, how to kick out the target audience, and the like can be displayed. And when the anchor triggers the starting component, the anchor live client sends invitation information of the voice group to at least one audience live client in the live broadcast room.

S120: and the anchor live broadcast client side and each target audience live broadcast client side form a group together according to the confirmation response fed back by at least one target audience live broadcast client side, and the anchor live broadcast client side triggers and establishes a bidirectional transmission channel corresponding to the group.

In the embodiment of the invention, when the anchor live client sends the voice group invitation information to at least one audience live client in the live broadcast room, the audience live client receives the voice group invitation information sent by the anchor live client and can display the preset control. When the target audience live broadcast client detects that the target audience triggers the preset control, the target audience live broadcast client can send a confirmation response for receiving the voice group to the anchor live broadcast client. The anchor live broadcast client receives a confirmation response sent by at least one target audience live broadcast client, forms a group with each target audience live broadcast client according to the confirmation response fed back by the at least one target audience live broadcast client, and triggers and establishes a bidirectional transmission channel corresponding to the group.

Specifically, the anchor live client may send an invitation message of the voice group to each viewer live client through the server, and the target viewer live client may feed back an acknowledgement response to the anchor live client through the server. When the server receives a confirmation response fed back by at least one target audience live broadcast client, the target audience live broadcast client is added into the voice room, and a bidirectional transmission channel corresponding to the group is formed by the anchor live broadcast client and each target audience live broadcast client.

S130: the anchor live broadcast client carries out voice communication with a target audience live broadcast client in the group through a bidirectional transmission channel in the process of live broadcasting audio and video live broadcast media streams to a non-target audience live broadcast client in a live broadcast room through a live broadcast information transmission channel; and the non-target audience live broadcast client is an audience live broadcast client in the live broadcast room except the target audience live broadcast client in the group.

In the embodiment of the invention, the anchor live broadcast client can live broadcast audio and video live broadcast media streams to the audience live broadcast clients except the target audience live broadcast client in the group in the live broadcast room through the live broadcast information transmission channel, so that the non-target audience live broadcast client which does not form a group with the anchor live broadcast client can be ensured to receive the audio and video live broadcast media streams, the non-target audience can be ensured to watch the live broadcast, and the voice communication is carried out with the target audience live broadcast client in the group through the bidirectional transmission channel, so that the voice communication efficiency can be improved. The audio and video live broadcast media stream can be generated by the live broadcast voice of the anchor broadcast, the live broadcast picture of the anchor broadcast client and the target audience voice of the target audience live broadcast client. Wherein the live information transmission channel and the bidirectional transmission channel are independent of each other.

In the related art, in the live broadcast process, the anchor and the target audience can perform communication and interaction through the barrage, for example, when the anchor wants to perform group activities (group playing games) with the target audience in the live broadcast room, the efficiency of communication of the barrage through typing is low, and the communication time is long; especially, when each target audience has various problems, the communication process is relatively long and inefficient due to the large amount of communication content. Or the anchor can communicate with the target audience in a live broadcasting mode, namely, the anchor live broadcasting client broadcasts the audio and video live broadcasting media stream synthesized by the voice of the anchor and the live broadcasting picture of the anchor to the target audience live broadcasting client, so that each target audience can hear the voice of the anchor. However, in this way of communicating the voices of the anchor and the target audience, the target audience can only hear the voice of the anchor, and needs to synthesize the voice of the anchor and the live screen to generate the live audio/video media stream, but the process of synthesizing the voice of the anchor and the live screen takes a lot of time, which causes a delay of the voice of the anchor, and thus, communication efficiency is also reduced.

According to the method provided by the embodiment of the invention, the anchor live broadcast client and the target audience live broadcast client form a group, and the anchor live broadcast client can perform voice communication with each target audience live broadcast client through the bidirectional information transmission channel in the live broadcast process of the anchor live broadcast client by establishing the bidirectional transmission channel corresponding to the group, so that the problem of low efficiency of communication between the anchor and the target audience through the bullet screen can be solved. The anchor live client sends the anchor voice to the target audience live client through the bidirectional transmission channel only through the anchor voice, and audio and video live media streams are not required to be synthesized, so that the time for audio and video synthesis can be saved when the anchor live client sends the anchor voice to the target audience live client through the bidirectional transmission channel, the problem of anchor voice delay existing in the voice communication between the anchor and the target audience in the live broadcast process can be solved, and the communication efficiency is improved.

The live broadcast voice processing method provided by the embodiment of the invention is characterized in that a main broadcast live broadcast client side sends voice group invitation information, when receiving a confirmation response fed back by at least one target audience live broadcast client side, a bidirectional transmission channel corresponding to a group formed by all target audience live broadcast client sides is triggered to be established, and when the main broadcast live broadcast client side carries out voice communication with a target audience live broadcast client side in the group through the established bidirectional transmission channel in the process of carrying out live broadcast audio and video media stream to a non-target audience live broadcast client side in a live broadcast room through the live broadcast information transmission channel. In the live broadcast process, the anchor live broadcast client side broadcasts audio and video live broadcast media streams to non-target audiences in a live broadcast room through the live broadcast information transmission channel, the fact that the non-target audience live broadcast client sides can receive the audio and video live broadcast media streams can be guaranteed, accordingly, the non-target audiences can watch live broadcast is guaranteed, a group formed by the anchor live broadcast client side and each target audience live broadcast client side is built, voice communication is conducted with the target audience live broadcast client sides in the group through the built bidirectional transmission channel, the problem that the efficiency of communication between the anchor and the target audiences through a bullet screen is low can be solved, the problem that the voice communication of the anchor and the target audiences in the prior art is delayed due to the voice communication of the anchor and the target audiences can be.

It should be noted that the method provided by the embodiment of the present invention can be applied to a scene in which only a anchor live client operates on anchor equipment, the anchor live client can live an audio/video live media stream to a non-target audience live client through a live information transmission channel, so that the non-target audience can watch the live audio/video live media stream, and can also perform voice communication with the target audience live client through a bidirectional transmission channel, so that the anchor and the target audience perform voice communication, wherein the non-target audience can be an audience logging in the non-target audience live client, and the target audience is an audience logging in the target audience live client.

Or the method provided by the embodiment of the invention can also be applied to a scene that the anchor live client and the group client are respectively switched correspondingly in the foreground and the background of the anchor device. The group class client may be a client that performs group activities by at least two users logging in on respective devices to construct a group. For example, the group-like client may be a game client, or a social-like client. Optionally, in a specific scenario, the method provided by the embodiment of the present invention may be applied to a scenario in which the anchor live client and the game client perform corresponding switching respectively in a foreground and a background of the anchor device.

Fig. 1d is a flowchart of a live voice processing method according to an embodiment of the present invention, where the method is performed by a live voice processing apparatus, the apparatus is implemented by software and/or hardware, the apparatus is configured at a anchor live client, and the anchor live client may be installed on an anchor device. The anchor device may be a tablet computer, a mobile phone, a computer, or a like smart device having a display screen.

The method provided by the embodiment of the invention can be applied to a scene that a main broadcast and audiences carry out communication and interaction in the live broadcast process. Specifically, the method provided by the embodiment of the invention can be applied to a scene of communication and interaction between a main broadcast and audiences in the process of live broadcast games. A specific application scenario is a scenario in which the anchor live client and the game client are respectively switched between the foreground and the background of the anchor device.

As shown in fig. 1d, the technical solution provided by the embodiment of the present invention includes:

s101: and the anchor live broadcast client sends voice group invitation information to at least one audience live broadcast client in the live broadcast room according to the voice group request.

S102: and the anchor live broadcast client side and each target audience live broadcast client side form a group together according to the confirmation response fed back by at least one target audience live broadcast client side, and the anchor live broadcast client side triggers and establishes a bidirectional transmission channel corresponding to the group.

In the embodiment of the present invention, the descriptions of S101 to S102 may refer to the descriptions of S110 to S120 in the above embodiment, and will not be repeated.

S103: in the process that the anchor live broadcast client side broadcasts audio and video live broadcast media streams to non-target audience live broadcast client sides in a live broadcast room through a live broadcast information transmission channel, if the anchor live broadcast client side is switched to a background, a game client side is switched to a foreground, and the anchor live broadcast client side carries out voice communication with the target audience live broadcast client sides in the group through the bidirectional transmission channel; and the non-target audience live broadcast client is an audience live broadcast client in the live broadcast room except the target audience live broadcast client in the group.

In the embodiment of the invention, in the process that the anchor live client live broadcasts the audio/video live broadcast media stream to the non-target audience live broadcast client in the live broadcast room through the live broadcast information transmission channel, if the anchor wants to live a game or group a game with the target audience, the anchor can open the game client so that the game client foreground operates, and the anchor live broadcast client operates in the background. And in the scene that the anchor live client is switched to the background and the game client is switched to the foreground, the anchor live client performs voice communication with the target audience live client in the group through a bidirectional transmission channel, so that game communication can be performed between the anchor and each target audience.

In the related technology, in the process of live game broadcasting or when the anchor plays a group game with target audiences, the anchor and the target audiences can communicate with each other through a barrage, but the efficiency of barrage communication through a typing mode is low, and the communication time is long; especially, when the content communicated between each target audience and the anchor is more, the communication process is relatively long and inefficient. Or the anchor can communicate with the target audience in a live broadcasting mode, namely, the anchor live broadcasting client broadcasts the audio and video live broadcasting media stream synthesized by the voice of the anchor and the live broadcasting picture of the anchor to the target audience live broadcasting client, so that each target audience can hear the voice of the anchor. However, in this audio communication method between the anchor and the target audience, the target audience can only hear the audio of the anchor, and needs to synthesize the audio of the anchor and the live game screen to generate the live audio/video media stream, but the process of synthesizing the audio of the anchor and the live game screen takes a lot of time, which causes delay of the audio of the anchor, and thus communication efficiency is also reduced.

According to the method provided by the embodiment of the invention, a group is formed by the anchor live broadcast client and the target audience live broadcast client, and by establishing the bidirectional transmission channel corresponding to the group, when the anchor live broadcast client broadcasts audio and video media streams to the non-target audience end of the live broadcast room, if the anchor live broadcast client is switched to the background, the game client is switched to the foreground, the anchor live broadcast client can carry out voice communication with each target audience live broadcast client through the bidirectional information transmission channel, and the problem of low efficiency of communication through a bullet screen during team games between the anchor and the target audiences can be solved. The anchor live client sends the anchor voice to the target audience live client through the bidirectional transmission channel only through the anchor voice, and audio and video live media streams are not required to be synthesized, so that the time for audio and video synthesis can be saved when the anchor live client sends the anchor voice to the target audience live client through the bidirectional transmission channel, the problem of anchor voice delay existing in the voice communication between the anchor and the target audience can be solved, and the communication efficiency is improved. In the related art, when the anchor wants to play a game with a target audience group of the live broadcast room, the anchor opens the anchor live broadcast client, and the target audience opens the target audience live broadcast client and enters the anchor live broadcast room. The anchor determines the game zone suit and the account number in a bullet screen mode, and target audiences can communicate information such as game problems with the anchor through the bullet screen. Or the anchor determines the game suit and the account number in a live voice mode, and then the anchor and the target audience respectively open the game client. The anchor live client and the target audience live client respectively run in the backstage of the anchor equipment and the target audience equipment, the game clients on the anchor equipment and the target audience equipment run in the foreground, the anchor and the target audience log in accounts in corresponding game zones through the game clients, and the game clients start game voices through voice tools, so that the anchor and the target audience can play games while communicating with each other through voices.

However, when both the anchor live client and the game client are running on the anchor device, or both the target spectator live client and the game client are running on the target spectator's device, only one client may occupy the microphone due to system limitations of the device. Thus, when the live client occupies the microphone, it results in voice communication between the anchor live client and the target audience live client that is not available for gaming. When the game client occupies the microphone, the anchor live broadcast client cannot acquire the anchor voice, so that the anchor voice cannot be received by the non-target audience live broadcast client in the live broadcast room, and the non-target audience cannot hear the anchor voice to influence the live broadcast.

The technical proposal provided by the embodiment of the invention forms a group by the anchor live broadcast client and the target audience live broadcast client, triggers and establishes a bidirectional transmission channel corresponding to the group, in the scene that the anchor live broadcast client terminal runs on the foreground and the game client terminal runs on the foreground, the anchor live broadcast client terminal can carry out voice communication with each target audience live broadcast client terminal through a bidirectional transmission channel, can ensure voice communication when the anchor and the target audience play the group game, improve the communication efficiency, avoid the problem of voice communication by adopting a voice tool in the game client, live broadcasting audio and video live broadcast media stream to non-target audience in the live broadcast room through a live broadcast information transmission channel, the non-target audience can watch the live broadcast, thereby ensuring that the non-target audience can hear the main broadcast voice, therefore, the problem that the anchor voice cannot be heard due to the fact that voice communication is carried out by means of a voice tool of the game client is avoided.

Optionally, the microphone occupation permission of the bidirectional transmission channel of the anchor live broadcast client is higher than the microphone occupation permission of the game client. The game client can be opened before the operation of the anchor live client or after the operation of the anchor live client, and because the microphone occupation permission of the bidirectional transmission channel of the anchor live client is higher than that of the game client, the game client is opened before or after the operation of the anchor live client, and the anchor live client preferentially occupies the microphone, so that the anchor live client and the game client can carry out voice communication through the bidirectional information transmission channel when the anchor live client and the game client operate on the anchor device at the same time.

Fig. 2a is a flowchart of a live speech processing method according to an embodiment of the present invention, where in the embodiment of the present invention, optionally, the live information transmission channel includes a first transmission channel between a main live client and a server, and a second transmission channel between the server and the non-target audience live client; the bidirectional transmission channel comprises the first transmission channel and a third transmission channel between the server and the target audience live client;

the live broadcast client of the anchor broadcasts the live broadcast media stream of audio and video to the live broadcast client of the non-target audience in the live broadcast room through the live broadcast information transmission channel, if the live broadcast client of the anchor switches to the background, the game client switches to the foreground, carries on the voice communication with the live broadcast client of the target audience in the group through the two-way transmission channel, including:

if the anchor live broadcast client is switched to the background, the game client is switched to the foreground, and the anchor live broadcast client receives target audience voice sent by at least one target audience live broadcast client in the group through the first transmission channel;

the anchor live broadcast client side sends the anchor voice and the game live broadcast picture to the server through the first transmission channel, so that the server sends the anchor voice to a target audience live broadcast client side in the group through the third transmission channel and a target audience voice synthesis audio and video live broadcast media stream based on the anchor voice, the game live broadcast picture and the target audience live broadcast client side in the group, and sends the audio and video synthesis audio and video live broadcast media stream to a non-target audience live broadcast client side in a live broadcast room through the second transmission channel.

As shown in fig. 2a, the technical solution provided by the embodiment of the present invention includes:

s210: and the anchor live broadcast client sends voice group invitation information to at least one audience live broadcast client in the live broadcast room according to the voice group request.

S220: the anchor live broadcast client side and each target audience live broadcast client side form a group together according to a confirmation response fed back by at least one target audience live broadcast client side, and a bidirectional transmission channel corresponding to the group is triggered and established; the bidirectional transmission channel comprises a first transmission channel between a main broadcast client and a server and a third transmission channel between the server and the target audience broadcast client. S230: and if the anchor live broadcast client is switched to the background, the game client is switched to the foreground, and the anchor live broadcast client receives target audience voice sent by at least one target audience live broadcast client in the group through the first transmission channel.

In the embodiment of the present invention, when the anchor and the target audience team play a game, the anchor live broadcast client switches to the background, and the game client switches to the foreground, as shown in fig. 2b, the anchor live broadcast client receives the target audience voice sent by the server through the first transmission channel 10, the target audience voice is the voice sent by at least one target audience live broadcast client in the group, and the target audience live broadcast client sends the target audience voice to the server through the third transmission channel 30. The anchor live client receives the target audience speech transmitted by the server via the first transmission pass 10 so that the anchor can hear the target audience speech. Wherein the first transmission channel 10 is a portion where the live information transmission channel overlaps with the bidirectional transmission channel.

S240: the anchor live broadcast client side sends the anchor voice and the game live broadcast picture to the server through the first transmission channel, so that the server sends the anchor voice to the target audience live broadcast client side in the group through the third transmission channel and synthesizes audio and video live broadcast media streams based on the anchor voice, the game live broadcast picture and the target audience voice sent by the target audience live broadcast client side in the group, and sends the audio and video live broadcast media streams to a non-target audience live broadcast client side in a live broadcast room through a second transmission channel in a live broadcast information transmission channel.

In the embodiment of the invention, the first transmission channel and the second transmission channel form a live broadcast information transmission channel. As shown in fig. 2b, the anchor live broadcasting client sends the anchor voice and the live game picture to the server through the first transmission channel 10, and the server sends the anchor voice to the target audience live broadcasting client in the group through the third transmission channel 30, so that the target audience can hear the anchor voice. The server synthesizes audio and video live broadcast media streams based on received anchor voice, game live broadcast pictures and target audience voice sent by a target audience live broadcast client in the group, and sends the audio and video live broadcast media streams to a non-target audience live broadcast client in a live broadcast room through a second transmission channel 20, so that the non-target audience can watch live broadcast and can hear conversation voice of the anchor and the target audience in the group.

Therefore, when the anchor live client is switched to the background and the game client is switched to the foreground (the anchor and the target audiences form a team to play the game and the anchor live client carries out live broadcasting on the game), the anchor live client receives the target audience voice sent by at least one target audience live client and sent by the server, so that the anchor can hear the voice of the target audiences, and the anchor live client sends the anchor voice and the game to the server, so that the server sends the anchor voice to the target audience live client in the team, so that the target audiences can hear the anchor voice, the communication efficiency of the anchor and the target audiences is improved, the server sends the received anchor voice, the target audience voice and the game picture to be combined into the audio and video live broadcast media stream and sends the audio and video live broadcast media stream to the non-target audience client, so that the non-target audiences can both receive the video, and the dialogue voice of the anchor and the target audience can be heard, so the problem that the anchor voice can not be heard because the voice communication is carried out by depending on the voice tool of the game client is avoided.

Fig. 3 is a flowchart of a live broadcast voice processing method according to an embodiment of the present invention, where the method is executed by a live broadcast voice processing apparatus, the apparatus may be implemented by software and/or hardware, the apparatus may be configured in a server, and the method may be applied in a scene where a main broadcast interacts with a viewer during a live game.

As shown in fig. 3, the technical solution provided by the embodiment of the present invention includes:

s310: the server receives voice group invitation information sent by the anchor live broadcast client and sends the voice group invitation information to at least one audience live broadcast client in the live broadcast room.

When the anchor live client operates in the foreground, a control for initiating the voice group can be displayed on a display interface of the live broadcast room, when the anchor triggers the control, the anchor live client receives a voice group request and sends voice group invitation information to the server according to the voice group request, and the server receives the voice group invitation information sent by the anchor live client and sends the voice group invitation information to at least one audience live client in the live broadcast room.

S320: and when the server receives a confirmation response fed back by at least one target audience live broadcast client, establishing a bidirectional transmission channel corresponding to the group formed by the anchor live broadcast client and each target audience live broadcast client.

In a specific embodiment of the present invention, optionally, when the server receives a confirmation response fed back by at least one target audience live broadcast client, establishing a bidirectional transmission channel corresponding to a group formed by the anchor live broadcast client and each target audience live broadcast client may include: when the server receives a confirmation response fed back by at least one target audience live broadcast client, a voice room is created, and the anchor live broadcast client is added into the voice room; when the server receives a confirmation response fed back by at least one target audience live broadcast client, adding the at least one target audience live broadcast client into the voice room to form a bidirectional transmission channel corresponding to a group formed by the anchor live broadcast client and each target audience live broadcast client.

Therefore, a voice room is created through the server, the anchor live broadcast client and the target audience live broadcast client are added into the voice room, a bidirectional transmission channel corresponding to a group formed by the anchor live broadcast client and the target audience live broadcast client is formed, and the anchor live broadcast client and the target audience live broadcast client can carry out voice communication through the channel.

S330: the server sends the audio and video live broadcast media stream of the anchor live broadcast client to the non-target audience live broadcast client, and transmits the voice between the anchor live broadcast client and the target audience live broadcast client in the group through the bidirectional transmission channel, wherein the non-target audience live broadcast client is the audience live broadcast client except the target audience live broadcast client in the group.

In an implementation manner of the embodiment of the present invention, optionally, the bidirectional transmission channel includes a first transmission channel between the anchor live client and the server, and a third transmission channel between the server and the target audience live client; a second transmission channel between the server and a non-target audience live client and the first transmission channel form a live information transmission channel;

the server sends the audio and video live broadcast media stream of the anchor live broadcast client to the non-target audience live broadcast client, and transmits the voice between the anchor live broadcast client and the target audience live broadcast client in the group through the bidirectional transmission channel, which may include: the server receives the anchor voice and the game live broadcast picture sent by the anchor live broadcast client through the first transmission channel, and sends the anchor voice to each target audience live broadcast client through the third transmission channel; the server receives target audience voice sent by at least one target audience live client in a live broadcast room through the third transmission channel, sends the target audience voice to other target audience live clients through the third transmission channel, and sends the target audience voice to the anchor live client through the first transmission channel; the other target audience live broadcast client terminals are client terminals except the target audience live broadcast client terminal which transmits the voice of the target audience; and the server generates an audio and video live broadcast media stream based on the anchor voice, the game live broadcast picture and the target audience voice, and sends the audio and video live broadcast media stream to a non-target audience live broadcast client through the second transmission channel.

As shown in fig. 2b, the server receives the anchor voice and the live game screen sent by the anchor live client through the first transmission channel 10, and sends the anchor voice to each target audience live client through the third transmission channel 30, so that each target audience can hear the anchor voice. The server receives the target audience voice sent by at least one target audience live client in the live broadcast room through the third transmission channel 30, and sends the target audience voice to other target audience live clients through the third transmission channel 30, so that other target audiences can hear the voice of the current target audience, and other target audiences can not hear the voice of the other target audiences again. The server generates an audio and video live broadcast media stream based on the anchor voice, the game live broadcast picture and the target audience voice, and sends the audio and video live broadcast media stream to the non-target audience live broadcast client through the second transmission channel 20, so that the non-target audience can watch videos and hear the voice of the anchor and the target audience.

According to the technical scheme provided by the embodiment of the invention, the server transmits the voice between the anchor live broadcast client and the target audience live broadcast client through the bidirectional transmission channel, so that the communication efficiency between the anchor and the target audience can be improved, and the watching of the live broadcast by non-target audiences is not influenced.

On the basis of the foregoing embodiment, the method provided in the embodiment of the present invention may further include: and the server stops sending the audio and video live broadcast media stream to the target audience live broadcast client in the group. Therefore, the server stops sending the audio and video live broadcast media stream to the target audience live broadcast client in the group, so that the target audience live broadcast client closes the live broadcast picture, and the performance consumption and the flow consumption of the target audience live broadcast client can be saved.

Fig. 4a is a flowchart of a live speech processing method according to an embodiment of the present invention, where the method is performed by a live speech processing apparatus, where the apparatus is performed by software and/or hardware, and the apparatus may be configured at a target audience live client. The target audience live client may be configured on a target audience device, where the target audience live client may be an audience live client that feeds back an acknowledgement response to the anchor live client. The target audience device can be a computer, a mobile phone and other intelligent devices with display screens.

The method provided by the embodiment of the invention can be applied to scenes of target audiences and anchor team games. As shown in figure 4a of the drawings,

the technical scheme provided by the embodiment of the invention comprises the following steps:

s410: when the target audience live broadcast client receives the group invitation message sent by the anchor live broadcast client, the target audience operation is used for feeding back a confirmation response to the anchor live broadcast client so that the anchor live broadcast client triggers and establishes a bidirectional transmission channel corresponding to the group formed by the target audience live broadcast clients.

In a specific implementation manner of the embodiment of the present invention, optionally, when the target audience live broadcast client receives the group invitation message sent by the anchor live broadcast client, feeding back a confirmation response to the anchor live broadcast client based on the target audience operation includes: when a target audience live broadcast client receives a group invitation message sent by a main broadcast live broadcast client, displaying a preset control on a display interface of a live broadcast room; and when the target audience live broadcast client detects that the preset control is triggered, feeding back a confirmation response to the anchor live broadcast client.

And preset controls can be displayed on a live broadcast room display interface of the audience live broadcast client which receives the team invitation message sent by the anchor live broadcast client. And the audience live broadcast client end feeding back the confirmation response to the anchor live broadcast client end is the target audience live broadcast client end. The preset control may be displayed at any position on the display interface of the viewer live client, for example, as shown in fig. 4b, the preset control may be a control 3 for controlling a voice function at the viewer live client, and a preset voice icon (not shown in fig. 4 b) may be displayed in the preset control.

The target audience can trigger the preset control, and when the target audience live broadcast client detects that the target audience triggers the preset control, a confirmation response is fed back to the anchor live broadcast client.

Therefore, when the group invitation message sent by the anchor live broadcast client is received, the preset control is displayed on the display interface of the live broadcast room, the operation of triggering the preset control is detected, the confirmation response is sent to the anchor live broadcast client, the group communication can be carried out according to the requirements of audiences, and the practicability is improved.

S420: and if the target audience live broadcast client is switched to operate in the background and the game client operates in the foreground, the target audience live broadcast client is in voice communication with other target audience live broadcast clients and the anchor live broadcast client in the group respectively through the bidirectional transmission channel.

In the embodiment of the invention, when the target audience live broadcast client is switched to operate in the background and the game client operates in the foreground, each target audience can play games with the anchor team by logging in the game client, the target audience live broadcast client is respectively in voice communication with other target audience live broadcast clients in the team and the anchor live broadcast client through the bidirectional transmission channel, and when each target audience plays games with the anchor team, the target audiences and the anchor audience can be in voice communication through the bidirectional transmission channel, so that the communication efficiency is submitted.

In an implementation manner of the embodiment of the present invention, optionally, the performing, by the target audience live broadcast client, voice communication with other target audience live broadcast clients in the group and the anchor live broadcast client through the bidirectional transmission channel respectively includes: the target audience live broadcast client receives the anchor voice sent by the anchor live broadcast client and the target audience voice of other target audience live broadcast clients, which are sent by a server, through a bidirectional transmission channel; and the target audience live broadcast client sends target audience voice to the server through a bidirectional transmission channel so that the server sends the target audience voice sent by the target audience live broadcast client to the anchor live broadcast client and other target audience live broadcast clients.

Specifically, as shown in fig. 2b, the bidirectional transmission channel may include a first transmission channel 10 and a third transmission channel 30. Specifically, the target audience live broadcast client receives the anchor voice sent by the server and the target audience voice sent by other target audience live broadcast clients through the third transmission channel 30, so that the current target audience can hear the anchor voice and the voices of other target audiences. Wherein, the anchor voice is sent to the server by the anchor live client through the first transmission channel 10. The target audience live broadcast client sends the target audience voice to the server through the third transmission channel 30, and the server sends the target audience voice to the anchor live broadcast client and other target audience live broadcast clients, so that the anchor and other target audiences can hear the voice of the current target audience.

In the embodiment of the invention, the target audience live broadcast client does not receive the audio and video live broadcast media stream sent by the server, and closes the live broadcast picture, so that the performance consumption and the flow consumption of the target audience live broadcast client can be saved, the target audience cannot watch the live broadcast picture, and the target audience can log in through another device and enter a live broadcast room of a main broadcast to watch the live broadcast of the main broadcast. When the anchor live client sends the voice group invitation message, wherein the voice group invitation message can be a voice game group invitation message, the anchor live client can send the group invitation message and the game identification information to the audience live client, so that the game identification information can be displayed on a display interface of the audience live client. When a target audience live broadcast client sends a confirmation response to a main audience live broadcast client, the main audience live broadcast client and each target audience live broadcast client form a group, so that the main audience live broadcast client triggers and establishes a two-way information transmission channel corresponding to the group formed by each target audience live broadcast client, the target audience live broadcast client runs at the background, the target audience live broadcast client carries out voice communication with other target audience live broadcast clients in the group and the main audience live broadcast client through the two-way transmission channel in a scene that the game client runs at the foreground, the target audience live broadcast client does not receive audio and video live broadcast media streams sent by a server, and the target audience live broadcast client closes a live broadcast picture. When the target audience wants to watch the live broadcast picture, the target audience live broadcast client can be operated in the foreground, as shown in fig. 4c, a microphone dropping control used for exiting the group is displayed on the display interface of the live broadcast room, the target audience can trigger the microphone dropping control, the target audience live broadcast client sends a microphone dropping application message to the server, and the server can clear the target audience live broadcast client from the group. Wherein, the game identification information XXXX of the team group, the identification information AAAA of the anchor and the identification information BBBB of the target audience can be displayed on the display interface of the live broadcast room of the target audience live broadcast client.

Fig. 5 is a flowchart of a live speech processing method according to an embodiment of the present invention, and as shown in fig. 5, a technical solution according to an embodiment of the present invention includes:

s510: and the anchor live broadcast client receives the voice group request and sends voice group invitation information to the server according to the voice group request.

S520: the server receives the group invitation information sent by the anchor live client and sends the group invitation information to at least one audience live client.

S530: and when the target audience live client receives the group invitation message sent by the anchor live client, feeding back a confirmation response to the server based on the operation of the target audience.

S540: when the server receives a confirmation response fed back by at least one target audience live broadcast client, establishing a bidirectional transmission channel corresponding to a group formed by a main broadcast live broadcast client and each target audience live broadcast client, and feeding back the confirmation response to the main broadcast live broadcast client.

S550: and the anchor live broadcast client receives the confirmation response so that the anchor live broadcast client and each target audience live broadcast client form a group together according to the confirmation response fed back by at least one target audience live broadcast client.

S560: and the anchor live broadcast client side carries out voice communication with the target audience live broadcast client side in the group on the basis of the server through a bidirectional transmission channel.

S570: and the anchor live broadcast client broadcasts the audio and video live broadcast media stream to the non-target audience live broadcast client through the live broadcast information transmission channel based on the server.

According to the technical scheme provided by the embodiment of the invention, the anchor live broadcast client side sends voice group invitation information, and triggers and establishes a bidirectional transmission channel corresponding to a group formed by all target audience live broadcast client sides when receiving a confirmation response fed back by at least one target audience live broadcast client side, and the anchor live broadcast client side carries out voice communication with the target audience live broadcast client sides in the group through the established bidirectional transmission channel in the process of carrying out live broadcast audio and video media stream to the non-target audience live broadcast client sides in the live broadcast room through the live broadcast information transmission channel. In the live broadcast process, the anchor live broadcast client side broadcasts audio and video live broadcast media streams to non-target audiences in a live broadcast room through the live broadcast information transmission channel, the fact that the non-target audience live broadcast client sides can receive the audio and video live broadcast media streams can be guaranteed, accordingly, the non-target audiences can watch live broadcast is guaranteed, a group formed by the anchor live broadcast client side and each target audience live broadcast client side is built, voice communication is conducted with the target audience live broadcast client sides in the group through the built bidirectional transmission channel, the problem that the efficiency of communication between the anchor and the target audiences through a bullet screen is low can be solved, the problem that the voice communication of the anchor and the target audiences in the prior art is delayed due to the voice communication of the anchor and the target audiences can be.

Fig. 6 is a flowchart of a live broadcast voice processing method according to an embodiment of the present invention, where the method according to the embodiment of the present invention is applied to a scenario where a live broadcast client and a game client perform corresponding switching respectively in a foreground and a background of a live broadcast device; or the method is applied to a scene that the anchor live broadcast client and the game client are respectively switched correspondingly in the foreground and the background of the anchor equipment, and the target audience live broadcast client and the game client are switched correspondingly in the foreground and the background of the target audience equipment.

As shown in fig. 6, the technical solution provided by the embodiment of the present invention includes:

s610: and if the anchor live broadcast client operates in the foreground, when the anchor live broadcast client receives the voice group request, sending voice group invitation information to the server according to the voice group request.

S620: the server receives the group invitation information sent by the anchor live client and sends the group invitation information to at least one audience live client.

S630: when the target audience live broadcast client receives the group invitation message sent by the anchor live broadcast client, the target audience live broadcast client operates in the foreground, and the confirmation response is fed back to the server based on the operation of the target audience.

S640: when the server receives a confirmation response fed back by at least one target audience live broadcast client, establishing a bidirectional transmission channel corresponding to a group formed by a main broadcast live broadcast client and each target audience live broadcast client, and feeding back the confirmation response to the main broadcast live broadcast client.

S650: and the anchor live broadcast client receives the confirmation response so that the anchor live broadcast client and each target audience live broadcast client form a group together according to the confirmation response fed back by at least one target audience live broadcast client.

S660: and when the anchor live client is switched to the background to operate, the game client is switched to the scene of foreground operation, and the anchor live client sends anchor voice and live pictures to the server through a first transmission channel in the bidirectional transmission channel.

S670: and the server sends the anchor voice to each target audience live broadcast client through a third transmission channel in the bidirectional transmission channel.

S680: and the target audience live broadcast client end is switched to the background, the game client end is switched to the foreground, and the target audience live broadcast client end sends the target audience voice to the server through the third transmission channel.

S690: the server sends the target audience voice to the anchor live broadcast client through the first transmission channel and other target audience live broadcast clients through the third transmission channel, synthesizes audio and video live broadcast media streams based on the received target audience voice, the anchor voice and the live broadcast pictures, and sends the audio and video live broadcast media streams to the non-target audience live broadcast client of the live broadcast room through the second transmission channel in the live broadcast information transmission channel.

The technical proposal provided by the embodiment of the invention can ensure that the voice communication of the game can be ensured when the anchor and the target audience play the group game by logging in the game client end, the audio and video media stream can be live broadcast to the non-target audience in the live broadcast room through the live broadcast information transmission channel, so that the non-target audience can watch the live broadcast, thereby ensuring that the non-target audience can hear the anchor voice, therefore, the problem that the anchor voice cannot be heard due to the fact that voice communication is carried out by means of a voice tool of the game client is avoided.

Fig. 7 is a block diagram of a live speech processing apparatus according to an embodiment of the present invention, where the apparatus is configured at a main live client, and the apparatus includes: a sending module 710, a trigger establishing module 720 and a first voice communication module 730.

A sending module 710, configured to send voice group invitation information to at least one viewer live broadcast client in the live broadcast room according to the voice group request;

the trigger establishing module 720 is used for forming a group together with each target audience live broadcast client according to a confirmation response fed back by at least one target audience live broadcast client, and triggering and establishing a bidirectional transmission channel corresponding to the group;

the first voice communication module 730 is used for switching the game client to the foreground if the anchor live client is switched to the background in the process of live broadcasting audio and video live broadcast media stream to the non-target audience live broadcast client in the live broadcast room through the live broadcast information transmission channel, and performing voice communication with the target audience live broadcast client in the group through the bidirectional transmission channel; and the non-target audience live broadcast client is an audience live broadcast client in the live broadcast room except the target audience live broadcast client in the group.

Optionally, the live broadcast information transmission channel includes a first transmission channel between a main broadcast live client and a server, and a second transmission channel between the server and the non-target audience live broadcast client; the bidirectional transmission channel comprises the first transmission channel and a third transmission channel between the server and the target audience live client;

the first voice communication module 730 is configured to, if the anchor live broadcast client is switched to the background, switch the game client to the foreground, and receive, through the first transmission channel, a target audience voice sent by at least one target audience live broadcast client in the group sent by the server;

and sending the anchor voice and the game live broadcast picture to a server through the first transmission channel so that the server sends the anchor voice to a target audience live broadcast client end in the group through the third transmission channel and synthesizes audio and video live broadcast media streams based on the anchor voice, the game live broadcast picture and the target audience voice sent by the target audience live broadcast client end in the group, and sends the audio and video live broadcast media streams to a non-target audience live broadcast client end in a live broadcast room through the second transmission channel.

Optionally, the microphone occupation permission of the bidirectional transmission channel is higher than that of the game client.

The device can execute the method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Fig. 8 is a block diagram of a live speech processing apparatus according to an embodiment of the present invention, where the apparatus is configured in a server, and as shown in fig. 8, the apparatus includes: a receiving/transmitting module 810, a establishing module 820 and a communication module 830.

A receiving/sending module 810, which receives the voice group invitation information sent by the anchor live broadcasting client and sends the information to at least one audience live broadcasting client in the live broadcasting room;

an establishing module 820, configured to, when receiving a confirmation response fed back by at least one target audience live broadcast client, establish a bidirectional transmission channel corresponding to a group formed by the anchor live broadcast client and each target audience live broadcast client;

and the communication module 830 is configured to send an audio/video live broadcast media stream of a main broadcast live broadcast client to a non-target audience live broadcast client, and transmit voice between the main broadcast live broadcast client and a target audience live broadcast client in the group through the bidirectional transmission channel, where the non-target audience live broadcast client is an audience live broadcast client in the live broadcast room except for the target audience live broadcast client in the group.

Optionally, the bidirectional transmission channel includes a first transmission channel between the anchor live client and the server, and a third transmission channel between the server and the target audience live client; a second transmission channel between the server and a non-target audience live client and the first transmission channel form a live information transmission channel;

a communication module 830 for:

receiving the anchor voice and the game live broadcast picture sent by an anchor live broadcast client through the first transmission channel, and sending the anchor voice to each target audience live broadcast client through the third transmission channel;

receiving target audience voice sent by at least one target audience live client in a live broadcast room through the third transmission channel, sending the target audience voice to other target audience live clients through the third transmission channel, and sending the target audience voice to the anchor live client through the first transmission channel; the other target audience live broadcast client terminals are client terminals except the target audience live broadcast client terminal which transmits the voice of the target audience;

and generating an audio and video live broadcast media stream based on the anchor voice, the game live broadcast picture and the target audience voice, and sending the audio and video live broadcast media stream to a non-target audience live broadcast client through the second transmission channel.

Optionally, the establishing module 820 is configured to, when receiving a confirmation response fed back by at least one target audience live broadcast client, create a voice room by the server, and add the anchor live broadcast client to the voice room;

and when a confirmation response fed back by at least one target audience live broadcast client is received, adding the at least one target audience live broadcast client into the voice room to form a bidirectional transmission channel corresponding to a group formed by the anchor live broadcast client and each target audience live broadcast client.

Optionally, the apparatus further comprises: and the stopping module is used for stopping sending the audio and video live broadcast media stream to the target audience live broadcast client in the group.

Fig. 9 is a live speech processing apparatus provided in an embodiment of the present invention, where the apparatus may be configured at a target audience live client, and the apparatus includes: a feedback module 910 and a second voice communication module 920.

A feedback module 910, configured to, when receiving a group invitation message sent by a anchor live broadcast client, feed back a confirmation response to the anchor live broadcast client based on a target audience operation, so that the anchor live broadcast client triggers establishment of a bidirectional transmission channel corresponding to a group formed by each target audience live broadcast client;

and a second voice communication module 920, configured to perform voice communication with other target audience live broadcast clients in the group and the anchor live broadcast client through the bidirectional transmission channel if the target audience live broadcast client is switched to operate in the background and the game client operates in the foreground.

Optionally, the second voice communication module 920 is configured to receive, through a bidirectional transmission channel, a anchor voice sent by the anchor live broadcast client and target audience voices sent by other target audience live broadcast clients and sent by a server;

and sending the target audience voice to the server through a bidirectional transmission channel so that the server sends the target audience voice sent by the target audience live broadcast client to a main broadcast live broadcast client and other target audience live broadcast clients.

Optionally, the feedback module 910 is configured to display a preset control on a display interface of the live broadcast room when receiving a group invitation message sent by the anchor live broadcast client;

and feeding back a confirmation response to the anchor live broadcast client when the preset control is detected to be triggered.

Fig. 10 is a schematic structural diagram of an apparatus provided in an embodiment of the present invention, and as shown in fig. 10, the apparatus includes:

one or more processors 1010, one processor 1010 being illustrated in FIG. 10;

a memory 1020;

the apparatus may further include: an input device 1030 and an output device 1040.

The processor 1010, the memory 1020, the input device 1030, and the output device 1040 in the apparatus may be connected by a bus or other means, and fig. 10 illustrates the connection by a bus as an example.

The memory 1020, which is a non-transitory computer-readable storage medium, may be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to a live speech processing method in an embodiment of the present invention (for example, the sending module 710, the trigger establishing module 720, and the first speech communication module 730 shown in fig. 7, or the receiving/sending module 810, the establishing module 820, and the communication module 830 shown in fig. 8, or the feedback module 910 and the second speech communication module 920 shown in fig. 9). The processor 1010 executes various functional applications and data processing of the computer device by running software programs, instructions and modules stored in the memory 1020, so as to implement a live voice processing method of the above method embodiment, that is:

sending voice group invitation information to at least one audience live broadcast client in the live broadcast room according to the voice group request;

according to the confirmation response fed back by at least one target audience live broadcast client, forming a group together with each target audience live broadcast client, and triggering and establishing a bidirectional transmission channel corresponding to the group;

in the process of live broadcasting audio and video live broadcast media streams to a non-target audience live broadcast client in a live broadcast room through a live broadcast information transmission channel, if the anchor live broadcast client is switched to a background, a game client is switched to a foreground, and the anchor live broadcast client is in voice communication with the target audience live broadcast client in the group through the bidirectional transmission channel; and the non-target audience live broadcast client is an audience live broadcast client in the live broadcast room except the target audience live broadcast client in the group.

Or;

receiving voice group invitation information sent by a main broadcast live client, and sending the voice group invitation information to at least one audience live client in a live broadcast room;

when receiving a confirmation response fed back by at least one target audience live broadcast client, establishing a bidirectional transmission channel corresponding to a group formed by the anchor live broadcast client and each target audience live broadcast client;

and sending the audio and video live broadcast media stream of the anchor live broadcast client to a non-target audience live broadcast client, and transmitting the voice between the anchor live broadcast client and a target audience live broadcast client in the group through the bidirectional transmission channel, wherein the non-target audience live broadcast client is an audience live broadcast client in the live broadcast room except the target audience live broadcast client in the group.

Or;

when receiving a group invitation message sent by a main broadcast client, feeding back a confirmation response to the main broadcast client based on target audience operation so that the main broadcast client triggers and establishes a two-way transmission channel corresponding to a group formed by each target audience live client;

and if the target audience live broadcast client is switched to the background to operate and the game client operates in the foreground, respectively carrying out voice communication with other target audience live broadcast clients and the main broadcast live broadcast client in the group through the bidirectional transmission channel.

The memory 1020 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 1020 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 1020 may optionally include memory located remotely from processor 1010, which may be connected to a terminal device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 1030 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer apparatus. Output device 1040 may include a display device such as a display screen.

An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a live speech processing method according to an embodiment of the present invention:

Or;

Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A live speech processing method, comprising:

the anchor live broadcast client sends voice group invitation information to at least one audience live broadcast client in the live broadcast room according to the voice group request;

in the process that the anchor live broadcast client side broadcasts audio and video live broadcast media streams to non-target audience live broadcast client sides in a live broadcast room through a live broadcast information transmission channel, if the anchor live broadcast client side is switched to a background, a game client side is switched to a foreground, and the anchor live broadcast client side carries out voice communication with the target audience live broadcast client sides in the group through the bidirectional transmission channel; the non-target audience live broadcast client is an audience live broadcast client in the live broadcast room except the target audience live broadcast client in the group;

wherein, the said anchor live broadcast customer end is broadcasting the live media stream of audio frequency and video to the live broadcast customer end live broadcast of non-target audience in the live broadcast room through the transmission channel of the live broadcast information, including:

synthesizing the received anchor voice, target audience voice and game live broadcast picture into an audio and video live broadcast media stream through a server, and sending the audio and video live broadcast media stream to the non-target audience live broadcast client;

the said main broadcasting living broadcast client end carries on the voice communication with the target audience living broadcast client end in the group through the said two-way transmission channel, including:

and the anchor live broadcast client sends only anchor voice to the target audience live broadcast client through the bidirectional transmission channel.

2. The method of claim 1, wherein the live information transmission channel comprises a first transmission channel between a main live client and a server, and a second transmission channel between the server and the non-target audience live client; the bidirectional transmission channel comprises the first transmission channel and a third transmission channel between the server and the target audience live client;

the anchor live broadcast client side sends anchor voice and game live broadcast pictures to the server through the first transmission channel, so that the server sends the anchor voice to a target audience live broadcast client side in the group through the third transmission channel and synthesizes audio and video live broadcast media streams based on the anchor voice, the game live broadcast pictures and the target audience voice sent by the target audience live broadcast client side in the group, and sends the audio and video live broadcast media streams to a non-target audience live broadcast client side in a live broadcast room through the second transmission channel.

3. The method of claim 1, wherein a microphone occupancy permission of a bidirectional transmission channel of the anchor live client is higher than a microphone occupancy permission of a game client.

4. A live speech processing method, comprising:

the server sends the audio and video live broadcast media stream of the anchor live broadcast client to a non-target audience live broadcast client, and transmits the voice between the anchor live broadcast client and the target audience live broadcast client in the group through the bidirectional transmission channel, wherein the non-target audience live broadcast client is the audience live broadcast client except the target audience live broadcast client in the group in the live broadcast room;

the server sends the audio and video live broadcast media stream of the anchor live broadcast client to the non-target audience live broadcast client, and the method comprises the following steps:

the server synthesizes the received anchor voice, target audience voice and game live broadcast picture into an audio-video live broadcast media stream and sends the audio-video live broadcast media stream to the non-target audience live broadcast client;

the transmitting voice between the anchor live client and the target audience live client in the group through the bidirectional transmission channel comprises:

5. The method of claim 4,

the bidirectional transmission channel comprises a first transmission channel between the anchor live client and the server and a third transmission channel between the server and the target audience live client;

a second transmission channel between the server and a non-target audience live client and the first transmission channel form a live information transmission channel;

the server sends the audio and video live broadcast media stream of the anchor live broadcast client to the non-target audience live broadcast client, and transmits the voice between the anchor live broadcast client and the target audience live broadcast client in the group through the bidirectional transmission channel, and the method comprises the following steps:

the server receives the anchor voice and the game live broadcast picture sent by the anchor live broadcast client through the first transmission channel, and sends the anchor voice to each target audience live broadcast client through the third transmission channel;

the server receives target audience voice sent by at least one target audience live client in a live broadcast room through the third transmission channel, sends the target audience voice to other target audience live clients through the third transmission channel, and sends the target audience voice to the anchor live client through the first transmission channel; the other target audience live broadcast client sides are client sides except the target audience live broadcast client side which sends the target audience voice;

and the server generates an audio and video live broadcast media stream based on the anchor voice, the game live broadcast picture and the target audience voice, and sends the audio and video live broadcast media stream to a non-target audience live broadcast client through the second transmission channel.

6. The method of claim 4, wherein when the server receives an acknowledgement response fed back from at least one target audience live client, establishing a bidirectional transmission channel corresponding to a group formed by the anchor live client and each target audience live client comprises:

when the server receives a confirmation response fed back by at least one target audience live broadcast client, a voice room is created, and the anchor live broadcast client is added into the voice room;

and when the server receives a confirmation response fed back by at least one target audience live client, adding the at least one target audience live client into the voice room to form a bidirectional transmission channel corresponding to a group formed by the anchor live client and each target audience live client.

7. A live speech processing method, comprising:

if the target audience live broadcast client is switched to operate in the background and the game client operates in the foreground, the target audience live broadcast client is in voice communication with other target audience live broadcast clients and the anchor live broadcast client in the group through the bidirectional transmission channel respectively;

the target audience live broadcast client-side carries out voice communication with other target audience live broadcast client-sides in the group and the anchor live broadcast client-side through the bidirectional transmission channel respectively, and the voice communication method comprises the following steps:

and the anchor live broadcast client sends only anchor voice to the target audience live broadcast client and the other target audience live broadcast clients through the bidirectional transmission channel.

8. The method of claim 7,

the target audience live broadcast client receives the anchor voice sent by the anchor live broadcast client and the target audience voice of other target audience live broadcast clients, which are sent by a server, through a bidirectional transmission channel;

and the target audience live broadcast client sends target audience voice to the server through a bidirectional transmission channel so that the server sends the target audience voice sent by the target audience live broadcast client to the anchor live broadcast client and other target audience live broadcast clients.

9. The method of claim 7, wherein feeding back an acknowledgement response to the anchor live client based on the target viewer action when the target viewer live client receives the group invitation message from the anchor live client comprises:

when a target audience live broadcast client receives a group invitation message sent by a main broadcast live broadcast client, displaying a preset control on a display interface of a live broadcast room;

and when the target audience live broadcast client detects that the preset control is triggered, feeding back a confirmation response to the anchor live broadcast client.

10. A live speech processing device, comprising:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement a live speech processing method of any of claims 1-3, or a live speech processing method of claims 4-6, or a live speech processing method of any of claims 7-9.

11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a live speech processing method as claimed in any one of claims 1 to 3, or a live speech processing method as claimed in claims 4 to 6, or a live speech processing method as claimed in any one of claims 7 to 9.