CN111212306A

CN111212306A - Wheat connecting method and device, electronic equipment and storage medium

Info

Publication number: CN111212306A
Application number: CN201911351945.7A
Authority: CN
Inventors: 王凯
Original assignee: Reach Best Technology Co Ltd
Current assignee: Reach Best Technology Co Ltd; Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2019-12-24
Filing date: 2019-12-24
Publication date: 2020-05-29

Abstract

The disclosure shows a wheat connecting method, a device, electronic equipment and a storage medium, wherein in response to an operation instruction for triggering a user account to enter a live broadcast room, a terminal pulls multimedia data of a main broadcast account in the live broadcast room from a server and displays the multimedia data to the user account; and when the fact that the user account meets the audience microphone connecting condition is detected, the multimedia data provided by the user account is pushed to the server, the multimedia data of the target audience account in the live broadcast room are obtained from the server, the multimedia data are displayed to the user account, and microphone connecting between the user account and the target audience account is triggered and realized. By adopting the technical scheme, when the audience watches the live broadcast, the microphone connection interaction among the audience accounts is realized, the interaction efficiency among the audience accounts is improved, and the brand new live broadcast watching experience is given to the audience accounts. Moreover, the microphone-connecting interaction among the audience accounts is only visible at the audience end, so that the live broadcasting experience of the anchor is not influenced.

Description

Wheat connecting method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for connecting a microphone, an electronic device, and a storage medium.

Background

The network live broadcast is an entertainment mode for different users to realize interaction through a live broadcast platform at the same time. The live content may be a personal show, a game, a movie, etc. The network live shows are mostly live personal shows, and in general, users who live personal shows in a live room are called anchor shows, and users who watch the personal shows are called audiences.

With the continuous development of the live broadcast platform, more and more playing methods come up endlessly, such as the main broadcast connecting with the wheat PK, the main broadcast connecting with the audience and the like. However, in the process of watching the live broadcast, the current audience users can only communicate with each other in the modes of barrage, sending private messages and the like, and the interaction efficiency is low.

Disclosure of Invention

The present disclosure provides a method, an apparatus, an electronic device and a storage medium for connecting to a microphone, so as to at least solve the problem of low interaction efficiency between audience users in the related art. The technical scheme of the disclosure is as follows:

according to a first aspect of the present disclosure, there is provided a method for connecting a microphone, which is applied to a terminal, the method including:

responding to an operation instruction for triggering a user account to enter a live broadcast room, pulling multimedia data of a main broadcast account in the live broadcast room from a server side, and displaying the multimedia data to the user account;

and when the fact that the user account meets the audience microphone connecting condition is detected, the multimedia data provided by the user account is pushed to the server, the multimedia data of a target audience account in the live broadcast room are obtained from the server, the multimedia data are displayed to the user account, and microphone connecting between the user account and the target audience account is triggered and realized.

In an optional implementation manner, the acquiring, from the server, multimedia data of a target audience account in the live broadcast room, presenting the multimedia data to the user account, and triggering to implement a connection between the user account and the target audience account includes:

obtaining and displaying a connecting microphone audience list from a server, wherein the connecting microphone audience list comprises account identifications of audience accounts which can be used for connecting microphones;

responding to a selection instruction of a target account identifier in the continuous microphone audience list, and acquiring multimedia data of the target audience account with the target account identifier from a server.

In an alternative implementation manner, the obtaining, from the server, the list of connected viewers includes:

sending connecting wheat configuration information to a server, triggering the server to select a user account which accords with the connecting wheat configuration information to generate a corresponding connecting wheat audience list and returning the list;

the connecting wheat configuration information comprises account attribute information of other user accounts which are limited by the user account and realize the connecting wheat of the audience; the account attribute information at least comprises one of account security information or account social information.

In an optional implementation, the method further includes:

sending connecting microphone configuration information to a server, and triggering the server to only provide multimedia data of a target audience account which accords with the connecting microphone configuration information in a live broadcast room;

In an optional implementation manner, when it is detected that the user account meets the audience microphone connecting condition, pushing multimedia data provided by the user account to the server, acquiring the multimedia data of a target audience account in the live broadcast room from the server, displaying the multimedia data to the user account, and triggering to realize microphone connecting between the user account and the target audience account includes:

establishing a corresponding data pushing channel with the server according to the user account identifier corresponding to the user account, so as to push multimedia data provided by the user account to the server through the data pushing channel;

and establishing a corresponding data acquisition channel with the server according to the target user identification corresponding to the target user account, so as to acquire the multimedia data of the target audience account in the live broadcast room from the server through the data acquisition channel.

In an optional implementation, the method further includes:

and when the fact that the user account does not meet the audience connecting microphone condition is detected, closing the data pushing channel and the data obtaining channel to achieve the purpose of disconnecting the user account and the target audience account.

In an optional implementation manner, the audience microphone condition at least comprises that the user account starts an audience microphone connecting function; the method further comprises the following steps:

and setting the on or off of the audience microphone connecting function in response to the received microphone connecting configuration instruction.

According to a second aspect of the present disclosure, there is provided a method for connecting to a wheat, which is applied to a server, the method including:

receiving multimedia data of a main broadcasting account in a live broadcasting room, and pushing the multimedia data to an audience account in the live broadcasting room, wherein the audience account comprises a user account and a target audience account;

when the fact that the user account is connected with the target audience account is detected, the received multimedia data of the user account is pushed to the target audience account, the received multimedia data of the target audience account is pushed to the user account, and therefore the user account and the target audience account are connected.

In an optional implementation manner, when it is detected that the user account and the target audience account are connected, pushing the received multimedia data of the user account to the target audience account, and pushing the received multimedia data of the target audience account to the user account, so that the user account and the target audience account are connected, the method includes:

sending the online shopping audience list to the user account, wherein the online shopping audience list comprises account identifications of the online shopping audience accounts;

and acquiring a target account identifier selected by the user account according to the connected-to-the-wheat audience list, pushing the multimedia data of the target audience account with the target account identifier to the user account, and pushing the multimedia data of the user account to the target audience account with the target account identifier.

In an alternative implementation, the sending the connected wheat audience list to the user account includes:

receiving connected-to-microphone configuration information sent by the user account, wherein the connected-to-microphone configuration information comprises account attribute information of other user accounts which are limited by the user account and realize audience connected-to-microphone; the account attribute information at least comprises one of account security information or account social information;

and selecting a user account which accords with the connecting wheat configuration information to generate a corresponding connecting wheat audience list, and sending the connecting wheat audience list to the user account.

In an optional implementation, the method further includes:

and pushing the multimedia data of the target audience account which accords with the microphone connecting configuration information in the live broadcast room to the user account.

establishing a corresponding first data pushing channel with the user account according to the user account identifier corresponding to the user account, so as to push the multimedia data of the target audience account to the user account through the first data pushing channel;

and establishing a corresponding second data push channel with the target audience account according to the target audience account identifier corresponding to the target audience account, so as to push the multimedia data of the user account to the target audience account through the second data push channel.

In an optional implementation, the method further includes:

and when the connection between the user account and the target audience account is not detected, setting to close the first data push channel and the second data push channel so as to disconnect the connection between the user account and the target audience account.

According to a third aspect of the present disclosure, there is provided a microphone connecting apparatus applied to a terminal, the apparatus including:

the system comprises a first module, a second module and a third module, wherein the first module is configured to respond to an operation instruction that a user account triggers to enter a live broadcast room, pull multimedia data of a main broadcast account in the live broadcast room from a server side and display the multimedia data to the user account;

and the second module is configured to push multimedia data provided by the user account to the server when detecting that the user account meets the audience microphone connecting condition, acquire the multimedia data of a target audience account in the live broadcast room from the server, display the multimedia data to the user account, and trigger the realization of microphone connecting between the user account and the target audience account.

In an alternative implementation, the second module includes:

the system comprises a first unit, a second unit and a third unit, wherein the first unit is configured to acquire and display a microphone connecting audience list from a server, and the microphone connecting audience list comprises account identifications of audience accounts which can be used for microphone connecting;

and the second unit is configured to respond to a selection instruction of a target account identifier in the microphone connecting audience list, and acquire multimedia data of the target audience account with the target account identifier from a server.

In an optional implementation manner, the first unit is specifically configured to:

In an optional implementation, the apparatus further includes:

the third module is configured to send the microphone connecting configuration information to the server, and trigger the server to only provide multimedia data of a target audience account which accords with the microphone connecting configuration information in a live broadcast room;

In an alternative implementation, the second module is specifically configured to:

In an optional implementation, the apparatus further includes:

and the fourth module is configured to set and close the data push channel and the data acquisition channel when detecting that the user account does not meet the audience microphone connecting condition, so as to disconnect the microphone connecting between the user account and the target audience account.

In an optional implementation manner, the audience microphone condition at least comprises that the user account starts an audience microphone connecting function; the device further comprises:

and the fifth module is configured to respond to the received microphone connecting configuration instruction and set the opening or closing of the microphone connecting function of the audience.

According to a fourth aspect of the present disclosure, there is provided a microphone connecting device applied to a server, the device including:

the system comprises a first module, a second module and a third module, wherein the first module is configured to receive multimedia data of a main broadcasting account in a live broadcasting room and push the multimedia data to an audience account in the live broadcasting room, and the audience account comprises a user account and a target audience account;

the second module is configured to push the received multimedia data of the user account to the target audience account and push the received multimedia data of the target audience account to the user account when the user account is detected to be connected with the target audience account, so that the user account and the target audience account are connected with each other.

In an alternative implementation, the second module includes:

the first unit is configured to send the online shopping audience list to the user account, wherein the online shopping audience list comprises account identifications of the online shopping audience accounts;

the second unit is configured to acquire a target account identifier selected by the user account according to the linkman audience list, push multimedia data of the target audience account with the target account identifier to the user account, and push the multimedia data of the user account to the target audience account with the target account identifier.

In an optional implementation, the apparatus further includes:

the third module is configured to receive the connecting configuration information sent by the user account, wherein the connecting configuration information comprises account attribute information of other user accounts which are limited by the user account and realize audience connecting; the account attribute information at least comprises one of account security information or account social information;

the fourth module is configured to push the multimedia data of the target audience account which accords with the microphone connecting configuration information in the live broadcast room to the user account.

In an optional implementation, the apparatus further includes:

a fifth module configured to set to close the first data push channel and the second data push channel when the user account is not detected to be connected with the target audience account, so as to disconnect the connection between the user account and the target audience account.

According to a fifth aspect of the present disclosure, a wheat-connecting system is provided, which includes a spectator end, a main broadcasting end and a service end;

the audience terminal is configured to respond to an operation instruction of triggering a user account to enter a live broadcast room, pull the multimedia data of a main broadcast account in the live broadcast room from a server terminal, and display the multimedia data to the user account; when the fact that the user account meets the audience wheat connecting condition is detected, multimedia data provided by the user account is pushed to the server, the multimedia data of a target audience account in the live broadcast room are obtained from the server, the multimedia data are displayed to the user account, and the wheat connecting between the user account and the target audience account is triggered and realized;

the anchor terminal is configured to push the multimedia data of the anchor account to the server terminal;

the server is configured to receive multimedia data of a main broadcasting account in a live broadcasting room and push the multimedia data to an audience account in the live broadcasting room, wherein the audience account comprises a user account and a target audience account; when the fact that the user account is connected with the target audience account is detected, the received multimedia data of the user account is pushed to the target audience account, the received multimedia data of the target audience account is pushed to the user account, and therefore the user account and the target audience account are connected.

According to a sixth aspect of the present disclosure, there is provided an electronic apparatus comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the microphone connecting method according to the first aspect.

According to a seventh aspect of the present disclosure, there is provided an electronic apparatus comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the microphone connecting method according to the second aspect.

According to an eighth aspect of the present disclosure, there is provided a storage medium, wherein instructions, when executed by a processor of an electronic device, enable the electronic device to perform the microphone connecting method according to the first aspect.

According to a ninth aspect of the present disclosure, there is provided a storage medium, wherein instructions, when executed by a processor of an electronic device, enable the electronic device to perform the microphone connecting method according to the second aspect.

According to a tenth aspect of the present disclosure, there is provided a computer program product, wherein the instructions of the computer program product, when executed by a processor of an electronic device, enable the electronic device to perform the microphone connecting method according to the first aspect.

According to an eleventh aspect of the present disclosure, there is provided a computer program product, wherein instructions which, when executed by a processor of an electronic device, enable the electronic device to perform the microphone connecting method according to the second aspect.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:

the technical scheme of the disclosure provides a wheat connecting method, a device, electronic equipment and a storage medium, wherein in response to an operation instruction for triggering a user account to enter a live broadcast room, a terminal pulls multimedia data of a main broadcast account in the live broadcast room from a server side and displays the multimedia data to the user account; when the fact that the user account meets the audience microphone connecting condition is detected, the terminal pushes multimedia data provided by the user account to the server side, the multimedia data of a target audience account in a live broadcast room are obtained from the server side, the multimedia data are displayed to the user account, and microphone connecting between the user account and the target audience account is achieved through triggering. By adopting the technical scheme, the live broadcast watching among the audience accounts can be realized when the audience watches the live broadcast, the interaction efficiency among the audience accounts is improved, and the brand new live broadcast watching experience is given to the audience accounts. Moreover, the microphone-connecting interaction among the audience accounts is only visible at the audience end, so that the live broadcasting experience of the anchor is not influenced.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

Fig. 1 is a flowchart illustrating a connecting method applied to a terminal according to an exemplary embodiment.

Fig. 2 is a flow diagram illustrating a method for obtaining multimedia data for a target audience account according to an example embodiment.

Fig. 3 is a flowchart illustrating data transmission between a terminal and a server according to an exemplary embodiment.

Fig. 4 is a diagram illustrating data transmission between a terminal and a server according to an exemplary embodiment.

Fig. 5 is a diagram illustrating another data transmission between a terminal and a server according to an exemplary embodiment.

Fig. 6 is a flowchart illustrating a connecting method applied to a server according to an exemplary embodiment.

Fig. 7 is a flow diagram illustrating a method for transmitting targeted audience account multimedia data according to an example embodiment.

Fig. 8 is a flow diagram illustrating another method for transmitting targeted viewer account multimedia data according to an example embodiment.

Fig. 9 is a flow chart illustrating data transmission between a server and a terminal according to an example embodiment.

Fig. 10 is a block diagram illustrating a microphone connecting apparatus applied to a terminal according to an exemplary embodiment.

Fig. 11 is a block diagram illustrating a microphone connecting apparatus applied to a server according to an exemplary embodiment.

FIG. 12 is a block diagram illustrating an electronic device in accordance with an example embodiment.

FIG. 13 is a block diagram illustrating an electronic device in accordance with an example embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

Fig. 1 is a flowchart illustrating a method for connecting to a mobile phone according to an exemplary embodiment, where the method is applied to a terminal, as shown in fig. 1, and may include the following steps.

In step S11, in response to an operation instruction for the user account to enter the live broadcast room, the multimedia data of the anchor account in the live broadcast room is pulled from the server and displayed to the user account.

In a specific implementation, after receiving an operation instruction for entering a live broadcast room from a user account, a terminal pulls multimedia data pushed to a server from an anchor account and displays the multimedia data to the user account. The user account is an account of a viewer in the live broadcast room, and the multimedia data may include audio or video data, etc.

In step S12, when it is detected that the user account meets the audience link-to-talk condition, the multimedia data provided by the user account is pushed to the server, and the multimedia data of the target audience account in the live broadcast room is acquired from the server, and is displayed to the user account, which triggers the realization of the link-to-talk between the user account and the target audience account.

The audience mashup condition includes that the user account starts the audience mashup function, and accordingly, before step S12, the method may further include: and setting the on or off of the audience microphone connecting function in response to the received microphone connecting configuration instruction.

When the audience microphone connecting function needs to be opened, the user may input a microphone connecting configuration instruction through the terminal, for example, by clicking a button or an icon on the terminal interface indicating to open or close the audience microphone connecting function, so as to open or close the audience microphone connecting function. The terminal responds to the microphone connecting configuration instruction input by the user, can send a message of opening or closing the microphone connecting function of the audience to the server side through the user account, and sets the opening or closing of the microphone connecting function of the audience. Through the microphone connecting configuration instruction, a user can flexibly determine whether to start the microphone connecting function of the audience according to the self requirement.

In addition, the audience connecting conditions can further comprise that the user account is not an abnormal account such as an illegal registered account, a plug-in software account and the like.

The target audience account is the other audience accounts which are designated by the user account and realize the microphone connection interaction. In specific implementation, the terminal can directly send the information of the target audience account to the server, and the multimedia data of the target audience account is obtained from the server; the terminal can also obtain and display the identification information of the audience account which can be connected with the microphone from the server, determine the target audience account according to the selection of the user on the identification information of the audience account which can be connected with the microphone, and obtain the multimedia data of the target audience account from the server. These two implementations are described in detail in the following embodiments.

When the fact that the user account meets the audience wheat connecting condition is detected, if the user account at least starts an audience wheat connecting function and is not an abnormal account, the terminal pulls the multimedia data of the main broadcasting account from the server, simultaneously pulls the multimedia data pushed to the server by the target audience account, pushes the multimedia data of the user account to the server, displays the multimedia data of the target audience account to the user account, and triggers the realization of wheat connecting between the user account and the target audience account.

When the fact that the user account does not meet the audience microphone connecting condition is detected, if the user account closes the audience microphone connecting function or the user account is an abnormal account, the terminal only pulls the multimedia data of the main broadcasting account from the server, does not pull the multimedia data pushed to the server by other audience accounts, and does not push the multimedia data of the user account to the server.

The wheat connecting method provided by the embodiment can realize the wheat connecting interaction among the audience accounts when the audience watches the live broadcast, improve the interaction efficiency among the audience accounts and give brand new live broadcast watching experience to the audience accounts. Moreover, the microphone-connecting interaction among the audience accounts is only visible at the audience end, so that the live broadcasting experience of the anchor is not influenced.

In a specific implementation, before the data transmission process is performed between a terminal and a server, a long TCP connection is established with the server to ensure the reliability of the connection; connecting and transmitting control information such as a set block size, a video display size and the like through Connection; then, a handshake connection is established, and a stream connection is created, wherein the stream connection mainly functions to transmit specific multimedia data and command information for controlling the transmission of the multimedia data. After the connection between the terminal and the server is established, data transmission can be carried out between the terminal and the server.

The terminal can acquire the multimedia data provided by the user account in the following ways: firstly, multimedia data (such as audio or video) is collected, then the collected multimedia data is preprocessed and coded by a coder, and the coded data is packaged into a data packet in an RTMP format or a UDP format and is pushed to a server.

In an alternative implementation, as shown in fig. 2, step S12 may include:

in step S21, a connected-to-live audience list is obtained from the server and displayed, where the connected-to-live audience list includes account identifiers of the connected-to-live audience accounts.

In a specific implementation, the connecting wheat configuration information can be sent to the server, and the server is triggered to select a user account which accords with the connecting wheat configuration information to generate a corresponding connecting wheat audience list and return the list; the connecting wheat configuration information comprises account attribute information of other user accounts which are limited by the user account and realize the connecting wheat of the audience; the account attribute information includes at least one of account security information or account social information.

The account security information is used for indicating whether the account belongs to a trusted security account or an abnormal account. The account social information may indicate, for example, whether the account is a friend account.

In the specific implementation, the terminal firstly sends the microphone connecting configuration information specified by the user account to the server, the server selects the audience account identification with account safety information and/or account social contact information according to the microphone connecting configuration information, generates a microphone connecting audience list and sends the microphone connecting audience list to the terminal, and the terminal displays the microphone connecting audience list to the user account.

In step S22, in response to the selection instruction of the target account identifier in the connected wheat audience list, the multimedia data of the target audience account with the target account identifier is acquired from the server.

In the specific implementation, a user inputs a selection instruction of a target account identifier through a terminal according to a connected-to-microphone audience list, determines a target audience account, and acquires multimedia data of the target audience account from a server.

In the implementation mode, the terminal selects the connecting wheat audience list to determine the target audience account, so that the connecting wheat interaction efficiency and the probability of successful connecting wheat can be improved.

In another alternative implementation manner, before step S12 of the wheat connecting method shown in fig. 1, the method may further include:

sending the connecting microphone configuration information to the server, and triggering the server to only provide multimedia data of a target audience account which accords with the connecting microphone configuration information in the live broadcast room; the connecting wheat configuration information comprises account attribute information of other user accounts which are limited by the user account and realize the connecting wheat of the audience; the account attribute information includes at least one of account security information or account social information.

In a specific implementation, the user account may select which viewer accounts to connect to or block from, and specifically, when the terminal establishes a connection with the server, the server may be notified of which viewer accounts the user account only wants to connect to or block from.

For example, the terminal notifies the server to only connect with the friend account in the friend list of the user account, and the server can query the friend list of the user account, determine the ID of the target viewer account, only push the multimedia data of the friend account to the terminal, and only push the multimedia data of the user account to the friend account.

Similarly, for example, the terminal may notify the server that the user account wishes to mask the viewer account with certain attributes (for example, an account that is forbidden for a long time or has a lower level than itself), and the server may query and determine the corresponding viewer account ID, and not push the multimedia data of the masked viewer account to the user account, nor push the multimedia data of the user account to the masked viewer account.

In the implementation mode, the server side can filter and shield the untrusted security account or the abnormal account directly according to the account security information and/or the account social contact information in the connected-to-microphone configuration information to determine the target audience account.

In an alternative implementation, as shown in fig. 3, step S12 may include:

in step S31, a corresponding data push channel is established with the server according to the user account identifier corresponding to the user account, so as to push the multimedia data provided by the user account to the server through the data push channel.

In step S32, a corresponding data obtaining channel is established with the server according to the target user identifier corresponding to the target user account, so as to obtain the multimedia data of the target audience account in the live broadcast from the server through the data obtaining channel.

In a specific implementation, the terminal may establish different data pushing channels and data acquiring channels according to the user account ID, push multimedia data of the user account to the server through the data pushing channels, and acquire multimedia data of the target audience account from the server through the data acquiring channels.

In the wheat connecting method provided in this implementation manner, the method may further include:

in step S33, when it is detected that the user account does not meet the audience microphone connecting condition, the data push channel and the data acquisition channel are set to be closed, so as to disconnect the microphone connection between the user account and the target audience account.

In specific implementation, when the user account is detected to close the audience microphone connecting function or is detected to be an abnormal account, the data pushing channel and the data acquisition channel are set to be closed, the terminal does not pull the multimedia data of the target audience account any more, and does not push the multimedia data of the user account to the server, so that microphone connection between the user account and the target audience account is disconnected.

In a specific implementation, the server and the viewer may format the transmitted data according to the requirements of the RTMP protocol, and meanwhile, in order to implement the multiplexing and data packetization functions, when the viewer transmits multimedia data with the server, the viewer carries the unique account id identifier of the multimedia data in the Message block to distinguish the multimedia data of different viewers.

Fig. 4 shows a schematic diagram of the RTMP-based online interaction between three viewer accounts in the same live broadcast room, where the three viewer accounts are a viewer account 1, a viewer account 2, and a viewer account 3, respectively, where the viewer account 1 is a user account, and the viewer account 2 and the viewer account 3 are target viewer accounts. After a user account (audience account 1) enters a live broadcast room, multimedia data of a main broadcast account is pulled from a server, when the user account starts an audience microphone connecting function, the multimedia data (pull stream 2 and pull stream 3) of a plurality of target audience accounts (audience account 2 and audience account 3) are respectively pulled from the server, and the multimedia data (push stream) of the user account is pushed to the server, so that the server pushes the multimedia data of the user account (audience account 1) to the target audience account, and microphone connecting interaction between the user account and the target audience account is realized.

The data transmission is carried out based on the RTMP protocol, the cost is low, and the multimedia data of a plurality of target audience accounts can be simultaneously pulled from the server side in parallel without mutual influence. However, the RTMP network has a high delay, and the audience needs to pull the multimedia data of the anchor end, push the multimedia data to the server end, and pull the multimedia data stream of the target audience account, and when there are a plurality of target audience accounts, it is necessary to establish a plurality of pull channels to respectively pull, as shown in fig. 4, the data transmission based on the RTMP protocol has high requirements on the network and the device performance.

In order to solve the problem that data transmission based on the RTMP protocol has high requirements on network requirements and device performance, the server and the viewer can format the transmitted data according to the requirements of the UDP protocol. In a specific implementation, the server may first perform synthesis processing on the multimedia data of the anchor account and the multimedia data of the target audience account according to a UDP protocol to obtain a data packet. Thus, as shown in fig. 5, the terminal can obtain the multimedia data of the anchor account and the target audience account only by pulling the data packet through one pull channel, so as to reduce the pressure of the terminal.

Fig. 6 is a flowchart illustrating a method for connecting to a server according to an exemplary embodiment, where the method is applied to a server, and may include the following steps.

In step S61, the multimedia data of the anchor account in the live broadcast room is received and pushed to the viewer account in the live broadcast room, where the viewer account includes a user account and a target viewer account.

In a specific implementation, the server receives multimedia data of the anchor account and pushes the multimedia data to audience accounts such as a user account and a target audience account in a live broadcast room.

In step S62, when it is detected that the user account and the target audience account are connected, the received multimedia data of the user account is pushed to the target audience account, and the received multimedia data of the target audience account is pushed to the user account, so that the user account and the target audience account are connected.

In a specific implementation, the server receives multimedia data of the audience account, including multimedia data of the user account and multimedia data of the target audience account, in addition to multimedia data of the anchor account. When the connection between the user account and the target audience account is detected, the server side pushes the multimedia data of the user account to the target audience account, and pushes the multimedia data of the target audience account to the user account, so that the connection between the user account and the target audience account is realized.

The wheat connecting method provided by the embodiment can realize the wheat connecting interaction among the audience accounts when the audience watches the live broadcast, improve the interaction efficiency among the audience accounts and give brand new live broadcast watching experience to the audience accounts. Moreover, because the multimedia data of the user account and the target audience account are not sent to the main broadcasting account, the microphone connection interaction between the audience accounts is only visible at the audience end, and therefore the live broadcasting experience of the main broadcasting is not influenced.

In an alternative implementation manner, referring to fig. 7, in step S62, the method may further include:

in step S71, a connected-to-live audience list is sent to the user account, where the connected-to-live audience list includes an account identifier of the connected-to-live audience account.

In specific implementation, the server may first receive the connected-to-wheat configuration information sent by the user account, then select a user account conforming to the connected-to-wheat configuration information to generate a corresponding connected-to-wheat audience list, and send the list to the user account, where the connected-to-wheat configuration information includes account attribute information that the user account defines other user accounts for realizing audience connected to wheat; the account attribute information includes at least one of account security information or account social information.

In a specific implementation, a server firstly receives connected-to-wheat configuration information sent by a user account, then selects an audience account identifier with account security information and/or account social information according to the connected-to-wheat configuration information, generates a connected-to-wheat audience list and sends the connected-to-wheat audience list to the user account, so that the user account selects a target account identifier according to the connected-to-wheat audience list.

Further, the server may generate a connected-to-live audience list according to the connected-to-live audience configuration information and the multimedia data push stream record of the audience account, where the connected-to-live audience list includes an audience account identifier that conforms to the connected-to-live audience configuration information and has pushed the multimedia data to the server.

In step S72, the user account is acquired according to the target account identifier selected from the linkman audience list, the multimedia data of the target audience account with the target account identifier is pushed to the user account, and the multimedia data of the user account is pushed to the target audience account with the target account identifier.

In a specific implementation, the server determines a target audience account according to the target account identifier, pushes multimedia data of the target audience account to a user account, and pushes the multimedia data of the user account to the target audience account.

In the implementation mode, the server determines the target audience account according to the selection result of the user account to the continuous microphone audience list, and the continuous microphone audience list comprises the audience account identification which pushes the multimedia data to the server, so that the implementation mode can improve the continuous microphone interaction efficiency and the probability of successful microphone connection.

In another alternative implementation, before step S62 of the wheat connecting method shown in fig. 6, referring to fig. 8, the method may further include:

in step S81, receiving linkman configuration information sent by a user account, where the linkman configuration information includes account attribute information of other user accounts for which the user account restricts realizing audience linkman; the account attribute information includes at least one of account security information or account social information.

In step S82, the multimedia data of the target audience account matching the profile information in the live broadcast room is pushed to the user account.

In a specific implementation, the server may determine which audience accounts the user account selects to connect to or shield from according to the connecting configuration information sent by the user account.

When the profile information includes account social information, the account social information may indicate, for example, that the user account only connects to the audience accounts in the friend list, and the server may query the friend list of the user account, determine the target audience account ID, only push multimedia data of the friend account to the terminal, and only push the multimedia data of the user account to the friend account. When the profile information includes account security information, the account security information may indicate, for example, that the user account wishes to mask the viewer account with certain attributes (for example, an account that is prohibited for a long time or has a lower level than itself), and the server may query and determine the corresponding masked viewer account ID, and not push the multimedia data of the masked viewer account to the terminal, nor push the multimedia data of the user account to the masked viewer account.

In the implementation mode, the server side filters and shields the untrusted safety account or the abnormal account according to the account safety information and/or the account social contact information in the connected-to-microphone configuration information, and determines the target audience account, so that the implementation mode can reduce the processing resource burden of the terminal and is suitable for scenes with limited terminal capability.

In an alternative implementation manner, referring to fig. 9, in step S62, the method may further include:

in step S91, a first data push channel corresponding to the user account is established according to the user account identifier corresponding to the user account, so as to push the multimedia data of the target audience account to the user account through the first data push channel.

In step S92, a second data push channel corresponding to the target audience account is established according to the target audience account identifier corresponding to the target audience account, so as to push the multimedia data of the user account to the target audience account through the second data push channel.

In a specific implementation, the server side can push multimedia data of a target audience account to a user account through a data push channel corresponding to a user account identifier; and pushing the multimedia data of the user account to the target audience account through a data pushing channel corresponding to the target audience account identification.

in step S93, when the user account is not detected to be connected to the target audience account, the first data push channel and the second data push channel are closed, so as to disconnect the connection between the user account and the target audience account.

In a specific implementation, when the connection between the user account and the target audience account is not detected, the first data push channel and the second data push channel are set to be closed, the server side does not push the multimedia data of the target audience account to the user account any more, and does not push the multimedia data of the user account to the target audience account any more, so that the connection between the user account and the target audience account is disconnected.

Fig. 4 shows a schematic diagram of the RTMP-based online interaction between three viewer accounts in the same live broadcast room, where the three viewer accounts are a viewer account 1, a viewer account 2, and a viewer account 3, respectively, where the viewer account 1 is a user account, and the viewer account 2 and the viewer account 3 are target viewer accounts. Based on the RTMP protocol, the server receives multimedia data for the live room anchor account (the push stream for the anchor account) and multimedia data for three viewer accounts (the push stream including viewer account 1, viewer account 2, and viewer account 3). The server side respectively pushes the multimedia data of the main broadcasting account to three audience accounts in a live broadcasting room, when the connection between a user account (audience account 1) and target audience accounts (audience account 2 and audience account 3) is detected, the multimedia data (pull stream 2 and pull stream 3) of the target audience accounts are also pushed to the user account (audience account 1), and the multimedia data (pull stream 1) of the user accounts are pushed to the target audience accounts (audience account 2 and audience account 3), so that the connection interaction between the user accounts and the target audience accounts is realized.

The data transmission is carried out based on the RTMP protocol, the cost is low, and the server side can simultaneously push the multimedia data of a plurality of target audience accounts to the user accounts without mutual influence. However, the RTMP network has a high latency, and when there are a plurality of target audience accounts, the server needs to push the multimedia data of the plurality of target audience accounts in addition to the multimedia data of the anchor account, as shown in fig. 4, the data transmission based on the RTMP protocol has high requirements on the network and the device performance.

In order to solve the problem that data transmission based on the RTMP protocol has high requirements on network requirements and device performance, the server and the viewer can format the transmitted data according to the requirements of the UDP protocol. In specific implementation, the server performs synthesis processing on the multimedia data of the anchor account and the multimedia data of the target audience account according to a UDP protocol to obtain a data packet. Thus, as shown in fig. 5, the server can push the multimedia data of the anchor account and the target audience account to the user account only by using one stream pushing channel, so as to reduce the pressure of the terminal.

Another embodiment of the present disclosure further provides a wheat connecting method, which is applied to a wheat connecting system, where the wheat connecting system includes a main broadcasting end, an audience end and a server end, and a main broadcasting account of the main broadcasting end and an audience account of the audience end are located in the same live broadcasting room. The wheat connecting method provided by the embodiment mainly comprises the following steps:

the anchor terminal sends the multimedia data of the anchor account to the server terminal;

the server side pushes the multimedia data of the anchor account to audience accounts in the live broadcast room, wherein the audience accounts comprise user accounts and target audience accounts;

when the terminal detects that the user account meets the audience connecting conditions, the multimedia data provided by the user account is pushed to the server;

when the server detects that the connection between the user account and the target audience account is carried out, pushing multimedia data provided by the user account to the target audience account, and pushing the multimedia data of the target audience account to the user account;

the terminal displays the multimedia data of the target audience account to the user account, and the connection between the user account and the target audience account is realized.

The specific implementation manner of each step in this embodiment may refer to the description of the foregoing embodiment, and is not described herein again.

Fig. 10 is a block diagram of a microphone attachment apparatus according to an exemplary embodiment. Referring to fig. 10, the apparatus is applied to a terminal and may include:

the system comprises a first module 101, a second module and a third module, wherein the first module is configured to respond to an operation instruction that a user account triggers to enter a live broadcast room, pull multimedia data of a main broadcast account in the live broadcast room from a server side, and display the multimedia data to the user account;

the second module 102 is configured to, when it is detected that the user account meets the audience microphone connecting condition, push multimedia data provided by the user account to the server, acquire multimedia data of a target audience account in the live broadcast room from the server, display the multimedia data to the user account, and trigger realization of microphone connecting between the user account and the target audience account.

In an alternative implementation, the second module 102 includes:

In an optional implementation, the apparatus further includes:

In an alternative implementation, the second module 102 is specifically configured to:

In an optional implementation, the apparatus further includes:

With regard to the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the mic-connecting method applied to the terminal, and will not be elaborated herein.

Fig. 11 is a block diagram of a microphone attachment apparatus according to an example embodiment. Referring to fig. 11, the apparatus, applied to a server, may include:

a first module 111, configured to receive multimedia data of a main broadcasting account in a live broadcasting room, and push the multimedia data to an audience account in the live broadcasting room, where the audience account includes a user account and a target audience account;

a second module 112, configured to, when it is detected that the user account and the target audience account are connected, push the received multimedia data of the user account to the target audience account, and push the received multimedia data of the target audience account to the user account, so that the user account and the target audience account are connected.

In an alternative implementation, the second module 112 includes:

In an optional implementation, the apparatus further includes:

In an alternative implementation, the second module 112 is specifically configured to:

In an optional implementation, the apparatus further includes:

With regard to the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the mic-connecting method applied to the server, and will not be elaborated here.

Another embodiment of the present application further provides a microphone connecting system, which includes a viewer side, a main broadcasting side and a server side.

The audience terminal is configured to respond to an operation instruction of triggering a user account to enter a live broadcast room, pull multimedia data of a main broadcast account in the live broadcast room from a server terminal, and display the multimedia data to the user account; when the fact that the user account meets the audience wheat connecting condition is detected, multimedia data provided by the user account is pushed to the server, the multimedia data of a target audience account in the live broadcast room are obtained from the server, the multimedia data are displayed to the user account, and the wheat connecting between the user account and the target audience account is triggered and realized;

With regard to the mic connecting system in the above embodiment, the specific manners of performing operations by the viewer side and the server side have been described in detail in the mic connecting method embodiments applied to the terminal and the server side, respectively, and will not be described in detail herein.

Fig. 12 is a block diagram of one type of electronic device 800 shown in the present disclosure. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 12, electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.

The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of any of the methods described in any of the embodiments. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 806 provides power to the various components of the electronic device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the electronic device 800. For example, the sensor assembly 814 may detect an open/closed state of the device 800, the relative positioning of components, such as a display and keypad of the electronic device 800, the sensor assembly 814 may also detect a change in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, orientation or acceleration/deceleration of the electronic device 800, and a change in the temperature of the electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G, or 5G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the microphone interfacing method described in any of the embodiments.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the electronic device 800 to perform the method of any of the embodiments is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

In an exemplary embodiment, a computer program product is also provided, which comprises readable program code executable by the processor 820 of the device 800 to perform the method of any of the embodiments. Alternatively, the program code may be stored in a storage medium of the apparatus 800, which may be a non-transitory computer readable storage medium, for example, ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

Fig. 13 is a block diagram of one type of electronic device 1900 shown in the present disclosure. For example, electronic device 1900 may be provided as a service end.

Referring to fig. 13, electronic device 1900 includes a processing component 1922 further including one or more processors and memory resources, represented by memory 1932, for storing instructions, e.g., applications, executable by processing component 1922. The application programs stored in memory 1932 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1922 is configured to execute instructions to perform the microphone attachment method of any of the embodiments.

The electronic device 1900 may also include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input/output (I/O) interface 1958. The electronic device 1900 may operate based on an operating system, such as Windows Server, MacOSXTM, UnixTM, LinuxTM, FreeBSDTM, or the like, stored in memory 1932.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

A1, a connecting method, applied to a terminal, the method comprises:

A2, according to the method in a1, the acquiring multimedia data of a target audience account in the live broadcast room from the server, showing the multimedia data to the user account, and triggering to realize the connection between the user account and the target audience account includes:

A3, according to the method in A2, the obtaining the connected wheat audience list from the server includes:

A4, the method of A1, the method further comprising:

A5, according to the method in a1, when it is detected that the user account meets the audience microphone connecting condition, pushing multimedia data provided by the user account to the server, acquiring the multimedia data of a target audience account in the live broadcast room from the server, displaying the multimedia data to the user account, and triggering the microphone connecting between the user account and the target audience account, including:

A6, the method of A5, the method further comprising:

A7, according to the method in A1, the audience microphone condition at least includes that the user account starts the audience microphone connecting function; the method further comprises the following steps:

A8, a wheat connecting method, applied to a server, the method comprising:

A9, according to the miking method of A8, when it is detected that the user account and the target audience account are miked, pushing the received multimedia data of the user account to the target audience account, and pushing the received multimedia data of the target audience account to the user account, so as to enable the miking between the user account and the target audience account, including:

A10, according to the connecting method of A9, sending the connecting audience list to the user account, including:

A11, the linting method of A8, the method further comprising:

A12, according to the miking method of A8, when it is detected that the user account and the target audience account are miked, pushing the received multimedia data of the user account to the target audience account, and pushing the received multimedia data of the target audience account to the user account, so as to enable the miking between the user account and the target audience account, including:

A13, the linting method of A12, the method further comprising:

A14, a connecting device, applied to a terminal, the device comprises:

A15, the apparatus of A14, the second module comprising:

A16, the apparatus of A15, the first unit specifically configured to:

A17, the apparatus of A14, further comprising:

A18, the apparatus of A14, the second module specifically configured to:

A19, the apparatus of A18, further comprising:

A20, according to the device in A14, the audience microphone condition at least comprises that the user account starts an audience microphone connecting function; the device further comprises:

A21, a wheat connecting device, applied to a server, the device comprising:

A22, the apparatus of A21, the second module comprising:

A23, the apparatus of A22, the first unit specifically configured to:

A24, the apparatus of A21, further comprising:

A25, the apparatus of A21, the second module specifically configured to:

A26, the apparatus of A25, further comprising:

Claims

1. A wheat connecting method is applied to a terminal, and comprises the following steps:

2. The method of claim 1, wherein the obtaining of the multimedia data of the target audience account in the live broadcast room from the server, the displaying of the multimedia data to the user account, and the triggering of the connection between the user account and the target audience account comprise:

3. A wheat connecting method is applied to a server side, and comprises the following steps:

4. A wheat connecting device is applied to a terminal, and comprises:

5. A wheat connecting device is applied to a server side, and the device comprises:

6. A wheat connecting system is characterized by comprising an audience terminal, a main broadcasting terminal and a service terminal;

7. An electronic device, characterized in that the electronic device comprises:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the microphone connecting method of any one of claims 1 to 2.

8. A storage medium having instructions that, when executed by a processor of an electronic device, enable the electronic device to perform the microphone connecting method of any one of claims 1-2.

9. An electronic device, characterized in that the electronic device comprises:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the microphone connecting method as claimed in claim 3.

10. A storage medium having instructions that, when executed by a processor of an electronic device, enable the electronic device to perform the microphone attachment method as recited in claim 3.