CN107342978B - Live broadcast room microphone connection control method and device and corresponding terminal equipment - Google Patents

Live broadcast room microphone connection control method and device and corresponding terminal equipment Download PDF

Info

Publication number
CN107342978B
CN107342978B CN201710390575.2A CN201710390575A CN107342978B CN 107342978 B CN107342978 B CN 107342978B CN 201710390575 A CN201710390575 A CN 201710390575A CN 107342978 B CN107342978 B CN 107342978B
Authority
CN
China
Prior art keywords
target
server
signaling
terminal
initiating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710390575.2A
Other languages
Chinese (zh)
Other versions
CN107342978A (en
Inventor
杨良剑
李学凌
胡建强
姜健华
曾莹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bigo Technology Singapore Pte Ltd
Original Assignee
Guangzhou Baiguoyuan Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Baiguoyuan Information Technology Co Ltd filed Critical Guangzhou Baiguoyuan Information Technology Co Ltd
Priority to CN201710390575.2A priority Critical patent/CN107342978B/en
Publication of CN107342978A publication Critical patent/CN107342978A/en
Application granted granted Critical
Publication of CN107342978B publication Critical patent/CN107342978B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
    • H04L1/1812—Hybrid protocols; Hybrid automatic repeat request [HARQ]
    • H04L1/1816—Hybrid protocols; Hybrid automatic repeat request [HARQ] with retransmission of the same, encoded, message
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1083—In-session procedures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/764—Media network packet handling at the destination 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/55—Push-based network services

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to the field of live video, in particular to a live broadcast room microphone connecting control method, a live broadcast room microphone connecting control device and corresponding terminal equipment, wherein the method comprises the following steps: responding to the connecting operation initiated by the user, the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server; when the target end meets the connecting condition, the initiating end sends a connection signaling to the target end to enable the target end to output a corresponding connection confirmation window; and the initiating terminal receives the connection confirmation signaling transmitted by the target terminal and forwarded by the server to establish connection with the target terminal and pull the second audio/video stream transmitted by the target terminal. Through the secondary signaling confirmation, the abnormal situation that the initiating terminal sends the invitation signaling once and no response occurs when the invitation signaling is overtime, but the initiating terminal cancels the connection of the microphone but delays the arrival of the invitation signaling at the target terminal and pushes the second audio and video stream to the server after the target terminal receives the invitation is effectively solved.

Description

Live broadcast room microphone connection control method and device and corresponding terminal equipment
[ technical field ] A method for producing a semiconductor device
The invention relates to the field of live video, in particular to a live broadcast room microphone connecting control method and device and corresponding terminal equipment.
[ background of the invention ]
With the development of internet technology and intelligent mobile terminal equipment, various internet products bring convenience and entertainment to the work and life of people, in recent years, various live broadcast platforms for live video broadcast are in endless, and live video broadcast brings real-time social experience to people. The connecting function in the live video broadcast becomes a popular interactive mode in the live video broadcast, and the connecting function refers to a function that a main broadcast user carries out live broadcast with other users in the live broadcast process. At present, the problem of continuous microphone failure caused by abnormal conditions such as continuous microphone process signaling loss or delayed arrival due to an unstable network exists in the establishment of continuous microphones, the reliability of the successful establishment of the continuous microphones cannot be guaranteed, and the problem of inconsistent terminal continuous microphone states of a main broadcasting user, a continuous microphone user and an audience user caused by the signaling loss or the delayed arrival is also caused, so that the data receiving and processing pressure of each terminal is increased. In addition, in the current scheme for transmitting audio/video streams after microphone connection, a common audience user terminal needs to pull at least two paths of audio/video streams of a main broadcasting user and a microphone connection user at the same time, so that the synchronization of the multiple paths of audio/video streams cannot be well guaranteed, more network bandwidth resources need to be occupied, the requirement on the network bandwidth is increased, and the terminal load is increased.
[ summary of the invention ]
The invention mainly aims to provide a live broadcast room microphone connecting control method and a device;
another object of the present invention is to provide a computer program and a corresponding terminal device for implementing a live broadcast room microphone connection control method.
In order to realize the purpose, the invention adopts the following technical scheme:
in a first aspect, an embodiment of the present invention provides a live broadcast room microphone connection control method, including the following steps:
responding to the connecting operation initiated by the user, the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server;
when the target end meets the connecting condition, the initiating end sends a connection signaling to the target end to enable the target end to output a corresponding connection confirmation window;
and the initiating terminal receives the connection confirmation signaling transmitted by the target terminal and forwarded by the server to establish connection with the target terminal and pull the second audio/video stream transmitted by the target terminal.
Further, after the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server, before determining that the target terminal meets the connecting condition, the method further includes:
the initiating end receives an invitation response of the target end, and when the invitation response representation meets the wheat connecting condition, the target end is determined to meet the wheat connecting condition;
or, after the initiating terminal sends the connection signaling to the target terminal, before receiving the connection confirmation signaling sent by the target terminal and forwarded by the server, the method further includes:
receiving a connection response sent by a target end;
or, after the initiating terminal receives the connection confirmation signaling sent by the target terminal and forwarded by the server, when pulling the second audio/video stream transmitted by the target terminal, the method further includes:
and sending a connection confirmation response to the target end.
Preferably, after the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server, before determining that the target terminal meets the connecting condition, the method further includes:
the initiating end receives an invitation response of the target end, and when the invitation response representation meets the wheat connecting condition, the target end is determined to meet the wheat connecting condition;
and after the initiating terminal sends the connection signaling to the target terminal, before receiving the connection confirmation signaling sent by the target terminal and forwarded by the server, the method further comprises the following steps:
receiving a connection response sent by a target end;
and when the initiating terminal pulls the second audio/video stream transmitted by the target terminal after receiving the connection confirmation signaling sent by the target terminal and forwarded by the server, the method further comprises the following steps:
and sending a connection confirmation response to the target end.
Further, the invitation signaling, the connection signaling and the connection confirmation signaling sent by the initiator are repeatedly sent according to a preset time interval, and
when the initiating end receives the invitation response, the initiating end cancels the sending of the invitation signaling according to a preset time interval; or
After receiving the connection response, the anchor cancels the sending of the connection signaling according to a preset time interval; or
And after receiving the connection confirmation response, the target end cancels the sending of the connection confirmation signaling according to a preset time interval.
Specifically, the invite signaling carries a unique identifier of a connected session, a location identifier, and identity information of a target user.
Specifically, after receiving the invitation signaling, the server pre-allocates a microphone connecting position for the target user and obtains identity information of the target user so as to forward the invitation signaling to the target end.
Further, after receiving a connection confirmation signaling sent by a target end, the server allocates the pre-allocated microphone connecting positions to a target user, updates the position information and then pushes the position information to each terminal in the live broadcast room.
Further, the method further comprises:
responding to the termination of the microphone connecting operation of the initiating user, the initiating terminal sends a microphone connecting termination instruction to the server so that the server forwards the microphone connecting termination instruction to the target terminal, and stops pulling the second audio/video stream transmitted by the target terminal; or
And responding to the termination of the microphone connecting operation of the target user, the target end sends a microphone connecting termination instruction to the server so that the server forwards the microphone connecting termination instruction to the initiating end, and stops uploading the second audio and video stream to the server.
Preferably, the method further comprises:
after the target end receives the connecting microphone termination instruction, a connecting microphone termination response is sent to the initiating end through the server, and uploading of a second audio and video stream to the server is terminated; or
And after the anchor terminal receives the connecting microphone termination instruction, sending a connecting microphone termination response to the target terminal through the server, and stopping pulling the second audio/video stream transmitted by the target terminal.
Furthermore, the initiating end and/or the target end receives the wheat position information pushed to each terminal in the live broadcast room by the server at a preset time interval, the wheat position information comprises a wheat position list and wheat position state information, and when the wheat position information pushed by the server and received by the initiating end or the target end is inconsistent with the local wheat connecting state, the local wheat connecting state is reported to the server so that the server updates the wheat position information and forwards the wheat position information to the target end or the initiating end.
In a second aspect, the present invention provides a live broadcast room microphone connection control method, which is applied to the live broadcast room microphone connection control method, and includes the following steps:
responding to the starting end and the target end to finish the wheat connecting operation, and pulling a second audio/video stream of at least one target end by the starting end;
the initiating terminal processes the second audio and video stream and a first audio and video stream locally collected by the initiating terminal to generate a third audio and video stream;
and the initiating end pushes the third audio and video stream to a server so that each audience end in the live broadcast room pulls the third audio and video stream to be displayed and played.
Further, the method further comprises:
the initiating end pushes the locally acquired first audio stream to the server so that the target end can pull the first audio stream and then play the first audio stream.
Specifically, the method further comprises:
and after the target terminal pulls the third video stream from the server, replacing a display window of the second video stream contained in the third video stream with the second video stream locally acquired by the target terminal, and then displaying and playing the second video stream.
Corresponding to the first aspect, the present invention also provides a live broadcast room microphone connecting control apparatus, including:
an invitation module: the device is used for responding to the microphone connecting operation initiated by the user, sending the invitation signaling to the server and forwarding the invitation signaling to the target end through the server;
a connecting module: the device is used for sending a connection signaling to the target end to enable the target end to output a corresponding connection confirmation window when the target end meets the connecting condition;
a building module: and the server is used for receiving a connection confirmation signaling sent by the target end and forwarded by the server to establish a connection with the target end and pull the second audio/video stream transmitted by the target end.
Corresponding to the second aspect, the present invention further provides a live broadcast room microphone connecting video stream push control device, including:
a wheat connecting module: the system comprises an initiating terminal, a target terminal and a server, wherein the initiating terminal is used for responding to the completion of the microphone connecting operation between the initiating terminal and the target terminal and pulling a second audio/video stream of at least one target terminal;
a generation module: the audio/video processing device is used for processing the second audio/video stream and the first audio/video stream locally collected by the initiating terminal to generate a third audio/video stream;
a pushing module: and the third audio and video stream is pushed to a server so that each audience end in the live broadcast room pulls the third audio and video stream to be displayed and played.
In a third aspect, the present invention further provides a terminal device, including a processor and a memory, where the memory stores a computer program, and the computer program, when executed by the processor, implements the steps of the method in the first aspect or the second aspect.
Compared with the prior art, the invention has the following advantages:
1. through the secondary signaling confirmation, the abnormal situation that the initiating terminal sends the invitation signaling once and no response occurs when the invitation signaling is overtime, but the initiating terminal cancels the connection of the microphone but delays the arrival of the invitation signaling at the target terminal and pushes the second audio and video stream to the server after the target terminal receives the invitation is effectively solved.
2. The initiating end and the target end wait for receiving corresponding signaling response aiming at each signaling sent, all the signaling automatically retransmits when waiting for response overtime, and the retransmission is cancelled when the response is received, so that the reliability of the microphone connection is improved, and the condition that the microphone connection function is disordered due to delayed arrival or loss of the signaling in the transmission process is avoided. Meanwhile, the multi-terminal continuous wheat states are kept consistent based on multi-terminal maintenance of the initiating terminal, the server and the target terminal, and the server only needs to maintain a wheat sequence list and a wheat position state according to a specific signaling, so that the complexity of server codes and the pressure for processing the signaling are reduced.
3. The method is characterized in that a multi-end live broadcast wheat-connecting scheme for pushing one path of synthesized audio and video stream to a server after integrating all audio and video streams in a live broadcast channel based on a main broadcast end is adopted, for the main broadcast end, only one path of synthesized third video stream and two paths of audio streams need to be pushed, the coding and decoding pressure of the main broadcast end is reduced to the maximum extent on the premise of ensuring that audience users synchronously watch a plurality of wheat-connecting sessions, the problem of delay of audio and video interaction among multiple wheat-connecting ends is effectively solved, and the problem that a target end locally plays the audio stream which is acquired and sent to the main broadcast end is avoided; the audience only needs to pull the third video stream and the third audio stream pushed by the anchor end, so that the requirement of the audience on the network bandwidth is reduced, and the audience only needs to decode one path of audio and video stream, so that the decoding and playing pressure of the audience equipment is reduced, the heat productivity of the equipment is reduced, and the electric quantity consumption is reduced.
It is to be understood that the foregoing general description of the advantages of the present invention is provided for illustration and description, and that various other advantages of the invention will be apparent to those skilled in the art from this disclosure.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
[ description of the drawings ]
Fig. 1 is a schematic flow chart of a live broadcast room microphone connecting control method according to an embodiment of the present invention;
fig. 2 is a schematic view of a user interface when a anchor initiates a wheat connection invitation in the present invention;
fig. 3 is a schematic view of a user interface of the present invention with the anchor terminal in a "connected call" state;
fig. 4 is a schematic diagram of a connection confirmation window output by a target terminal after receiving a connection signaling of an originating terminal according to the present invention;
FIG. 5 is a schematic view of a user interface of the present invention with the anchor terminal in "connecting to the wheat" state;
fig. 6 is a schematic flow chart illustrating a method for controlling live broadcast room connection in accordance with another embodiment of the present invention;
FIG. 7 is a diagram illustrating signaling and signaling response transmission according to an embodiment of the present invention;
fig. 8 is a schematic flow chart of an embodiment of a live broadcast room live-microphone video stream push control method according to the present invention;
fig. 9 is a schematic diagram of a third video stream pushed by the anchor to the server according to the present invention;
fig. 10 is a schematic view of a live broadcast room microphone connecting control device according to an embodiment of the present invention;
fig. 11 is a schematic view of an embodiment of a live broadcast room-coupled wheat video stream push control device according to the present invention;
fig. 12 is a schematic diagram of another embodiment of a live broadcast room-coupled microphone video stream push control device according to the present invention.
[ detailed description ] embodiments
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative only and should not be construed as limiting the invention.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
In the embodiment of the present invention, the initiating end and the target end are both user terminals in a live broadcast room, and may be a main broadcast end of a main broadcast user in the live broadcast room or a viewer end of a viewer user, when the main broadcast end initiates a talk operation, the main broadcast end at this time is the initiating end, and the corresponding target viewer user is the target end, and when the viewer end initiates the talk operation, the viewer end at this time is the target end, and the corresponding main broadcast end is the target end. In the following embodiments, if the anchor side is used as the initiating side without specific description, those skilled in the art will understand that the audience side can also be used as the initiating side.
In a first aspect, as shown in fig. 1, a schematic flow chart of an embodiment of a live broadcast room microphone connecting control method of the present invention includes the following steps:
step S100: and responding to the connecting operation initiated by the user, the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server.
The wheat connecting function is an important way for activating the atmosphere of a live broadcast room in the current live broadcast activity, the live broadcast is converted into an equal interactive social mode from a transmission mode by the wheat connecting function, the distance between a main broadcast and audiences is better increased, and the audiences can live broadcast and interact with the main broadcast at the same time and share own images and sound with other audiences in the live broadcast room through wheat connecting.
In this embodiment, the anchor terminal is used as an initiating terminal to initiate the wheat connecting operation to a target terminal. Specifically, in an implementation manner in which a user initiates a mic connecting operation, a user interface of a anchor terminal is configured with a button for initiating a mic connecting invitation, an anchor user clicks a button such as "mic connecting" on the user interface of the anchor terminal to pop up a corresponding user list, it can be set that the user needs to satisfy a certain condition to enter the list, and then a certain user is selected from the user list as a target user to initiate a mic connecting operation; in another implementation manner of initiating the wheat connecting operation in this embodiment, the anchor user opens a data card of a certain user through a user list and a public screen message entry in the live broadcast room, a button for initiating a wheat connecting invitation is provided on the data card of the user, and the anchor user regards the user as a target user and initiates the wheat connecting operation by clicking a button such as "wheat connecting" on the card. It can be understood that, if the audience is used as the initiator to initiate the microphone connecting operation, a button such as "apply for microphone connecting" is correspondingly arranged on the user interface of the audience, and the audience user can also initiate the microphone connecting operation to the main broadcasting terminal by clicking the button.
The initiating terminal responds to the connecting operation initiated by the user, sends the invitation signaling to the server, and still takes the anchor terminal as the initiating terminal for explanation. The anchor end responds to the connecting operation of the anchor user and sends an invitation signaling to the server, and at the moment, the anchor end enters a 'connecting calling in process' state and carries out connecting countdown to wait for the acceptance of the target user or refusal of the connecting invitation. The invite signaling carries a unique session identifier, a microphone bit identifier and target user identity information, wherein the unique session identifier is a unique session ID (sessionId) allocated by the anchor terminal for each microphone connection session and is used for signaling identification of the target terminal, and the target terminal only processes the signaling with the same session identifier, so that mutual interference among different sessions is avoided; the wheat position identification is a wheat position serial number on a wheat position list, and after the server receives and analyzes the invitation signaling, wheat positions are pre-allocated to the target user for subsequent use of the target user; the target user identity information is a target user ID; the server receives the invitation signaling, analyzes and acquires the identity information of the target user in the invitation signaling, pre-allocates a wheat space for the target user, and then forwards the invitation signaling to the target terminal. As shown in fig. 2, which is an embodiment of the user interface of the anchor side, the anchor user clicks a "connect to the wheat" button 21 pointed by an arrow to initiate a connect to the wheat invitation to the target user, and the anchor side sends the invitation signaling to the server and forwards the invitation signaling to the target side through the server after responding to the connect to the wheat operation initiated by the anchor user to the target user.
Step S200: and when the target end meets the connecting condition, the initiating end sends a connection signaling to the target end so as to enable the target end to output a corresponding connection confirmation window.
After receiving an invitation signaling forwarded by a server, a target terminal makes corresponding feedback information for the invitation signaling and sends the feedback information to an anchor terminal, wherein the feedback information comprises the connecting condition information of the target terminal, if the target terminal meets the connecting condition, the feedback information carries a successful resCode representing the meeting of the connecting condition, otherwise, the feedback information carries a specific reason resCode. The initiating end sends an invitation signaling and confirms the connecting condition of the target end as the first signaling confirmation of the initiating end and the target end.
And when the anchor terminal confirms that the target terminal meets the connecting condition, the anchor terminal is still in a 'connecting call in process' state, and simultaneously, a connecting video preview window of a target user is output on a user interface of the anchor terminal, and then, a connection signaling is sent to the target terminal so that the target terminal outputs a corresponding connection confirmation window after receiving the connection signaling. Fig. 3 is a schematic diagram of an embodiment of a user interface of a "connected microphone call" state at a main broadcast end, in which a large window 31 is a video screen local to the main broadcast user, a lower right small window 32 is a preview window of a connected microphone video of a target user, a "waiting to accept"/"Connecting" screen is output in the preview window, and information such as a head portrait of the target user and a user name is also output in the preview window.
Step S300: and the initiating terminal receives the connection confirmation signaling transmitted by the target terminal and forwarded by the server to establish connection with the target terminal and pull the second audio/video stream transmitted by the target terminal.
The target terminal outputs a corresponding connection confirmation window after receiving the connection signaling sent by the initiating terminal, and when the target user selects to accept the connecting invitation from the connection confirmation window, the corresponding connection confirmation signaling is generated and fed back to the initiating terminal through the server, and then the initiating terminal pulls the second audio and video stream transmitted by the target terminal from the server. Similarly, the anchor terminal is taken as an initiating terminal for explanation, after receiving the connection confirmation signaling, the anchor terminal establishes the connection confirmation with the target terminal, and at this time, the anchor terminal enters a 'connecting in the wheat' state and pulls the second audio/video stream transmitted by the target terminal from the server. It can be understood that, when the target user selects to reject the connection invitation from the connection confirmation window, the target end feeds back the signaling representation of the anchor end to reject the connection, at this time, the connection stops, and the anchor end ends the "call in connection" state. As shown in fig. 4, which is a schematic diagram of an embodiment of a connection confirmation window output by the target after receiving the connection signaling of the initiator, when the target user selects an "Accept" button in the window 41, the target feeds back the connection confirmation signaling to the initiator to establish a connection with the initiator. Fig. 5 is a schematic diagram of an embodiment of establishing the connection confirmation between the anchor terminal and the target terminal, and entering the "connected to the wheat" state by the anchor terminal, at this time, the anchor terminal pulls the second video stream of the target terminal and then displays and plays the second video stream on the anchor terminal, wherein the widget 51 is the second video stream pulled by the anchor terminal. The connection signaling sent by the initiating terminal and the connection confirmation signaling received by the initiating terminal are the second signaling confirmation of the initiating terminal and the target terminal.
Through the secondary signaling confirmation, the abnormal situation that the initiating terminal sends the invitation signaling once and no response occurs when the invitation signaling is overtime, but the initiating terminal cancels the connection of the microphone but delays the arrival of the invitation signaling at the target terminal and pushes the second audio and video stream to the server after the target terminal receives the invitation is effectively solved.
Further, in an embodiment of the method for controlling live broadcasting room connection, after the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server, and before determining that the target terminal meets the connection condition, the method further includes:
the initiating end receives an invitation response of the target end, and when the invitation response representation meets the wheat connecting condition, the target end is determined to meet the wheat connecting condition;
or, after the initiating terminal sends the connection signaling to the target terminal, before receiving the connection confirmation signaling sent by the target terminal and forwarded by the server, the method further includes:
receiving a connection response sent by a target end;
or, after the initiating terminal receives the connection confirmation signaling sent by the target terminal and forwarded by the server, when pulling the second audio/video stream transmitted by the target terminal, the method further includes:
and sending a connection confirmation response to the target end.
In this embodiment, the signaling sent by the initiator/target is repeatedly sent according to a preset time interval, and the repeated sending of the signaling is cancelled after receiving a corresponding signaling response, where the signaling response is used for the signaling receiving direction to send the signaling party to confirm that the corresponding signaling party has been received. For example, after the initiating end sends the invitation signaling to the server and forwards the invitation signaling to the target end through the server, the initiating end receives the invitation response of the target end, and when the invitation response represents that the wheat-connecting condition is met, the target end is determined to meet the wheat-connecting condition and then executes the subsequent steps, preferably, the invitation response of the target end to the invitation signaling is the automatic processing of the target end after receiving the invitation signaling, and is transparent to the target user, namely, the processing procedures of receiving the invitation signaling and making the invitation response to the invitation signaling are not output and displayed on the user interface of the target end; or after the initiating end sends the connection signaling to the target end, receiving the connection response sent by the target end, and then executing the subsequent steps; or after the initiating terminal receives the connection confirmation signaling transmitted by the target terminal and forwarded by the server, the initiating terminal transmits a connection confirmation response to the target terminal, at the moment, establishes a connection with the target terminal, and pulls the second audio/video stream transmitted by the target terminal.
Further, as shown in fig. 6, a schematic flow chart of another embodiment of the live broadcast room microphone connecting control method of the present invention includes the following steps:
step S100: responding to the connecting operation initiated by the user, the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server;
step S200: when the target end meets the connecting condition, the initiating end sends a connection signaling to the target end to enable the target end to output a corresponding connection confirmation window;
step S300: the initiating terminal receives a connection confirmation signaling transmitted by the target terminal and forwarded by the server to establish a connection with the target terminal and pull a second audio/video stream transmitted by the target terminal;
and after the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server, before determining that the target terminal meets the connecting condition, the method further comprises the following steps:
step S101: the initiating end receives an invitation response of the target end, and when the invitation response representation meets the wheat connecting condition, the target end is determined to meet the wheat connecting condition;
and after the initiating terminal sends the connection signaling to the target terminal, before receiving the connection confirmation signaling sent by the target terminal and forwarded by the server, the method further comprises the following steps:
step S201: receiving a connection response sent by a target end;
and when the initiating terminal pulls the second audio/video stream transmitted by the target terminal after receiving the connection confirmation signaling sent by the target terminal and forwarded by the server, the method further comprises the following steps:
step S301: and sending a connection confirmation response to the target end.
In this embodiment, similarly, the invite signaling, the connection signaling, and the connection confirmation signaling fed back by the target end that are sent by the initiator are all repeatedly sent according to a preset time interval, further, the initiator sends the invite signaling to the target end according to the preset time interval in response to the mic connecting operation of the user, and the target end feeds back an invite response to the initiator after receiving the invite signaling, and when the initiator receives the invite response, the initiator cancels sending of the invite signaling according to the preset time interval, preferably, the target end makes the invite response to the invite signaling is an automatic process that the target end makes after receiving the invite signaling, and is transparent to the target user, that is, a processing procedure of receiving the invite signaling and making the invite response to the invite signaling is not output and displayed on a user interface of the target end; the method comprises the steps that after an initiating terminal receives an invitation response sent by a target terminal and representing that the invitation response meets a microphone connecting condition, a connection signaling is sent to the target terminal according to a preset time interval, and the connection signaling is cancelled according to the preset time interval until the connection response fed back by the target terminal is received; similarly, the target end responds to the 'receiving the connecting to the wheat' operation of the target user, sends a connection confirmation signaling to the initiating end according to the preset time interval, and cancels the sending of the connection confirmation signaling according to the preset time interval after receiving the connection confirmation response fed back by the initiating end. Fig. 7 is a schematic transmission diagram of signaling and response in this embodiment, where the invite signaling is PMicLinkInvite, the invite response is PMicLinkInviteAck, the connection signaling is PMicLinkInviteConfirm, the connection response is pmiclinkeconfirmack, the connection acknowledgement signaling is pmiclinkinvitecontres, and the connection acknowledgement response is PMicLinkInviteResAck. The initiating terminal waits for receiving a corresponding signaling response of the target terminal aiming at each signaling sent to the target terminal, and meanwhile, the initiating terminal also makes a corresponding signaling response to the signaling sent by the target terminal; similarly, for the target end, after receiving the signaling of the initiating end, the target end also makes a corresponding signaling response and waits to receive the signaling response of the anchor end after sending the signaling to the initiating end. The initiating end sends an invitation signaling and receives an invitation response as a first signaling confirmation of the initiating end and the target end; the connection signaling sent by the initiating terminal to the target terminal and the connection signaling response of the receiving target terminal are second signaling confirmation; the connection confirmation signaling sent by the target end and the connection confirmation response of the receiving initiating end are third signaling confirmation; solving the abnormal situation caused by the delayed arrival of the signaling through multiple times of signaling confirmation; and all signaling realize waiting for response overtime then automatic retransmission, receive response then cancel retransmission, improve the reliability of connecting the wheat, avoid the signaling delay to arrive or lose and cause the situation that the function of connecting the wheat realizes the disorder in the transmission course.
Further, the embodiment of the present invention further includes a wheat connection terminating step, where a wheat connection terminating instruction may be sent to the target end by the initiating user through the initiating end or sent to the initiating end by the target user through the target end, specifically:
responding to the termination of the microphone connecting operation of the initiating user, the initiating terminal sends a microphone connecting termination instruction to the server so as to forward the microphone connecting termination instruction to the target terminal, and simultaneously terminates the pulling of the second audio and video stream uploaded by the target terminal from the server; or
And responding to the termination of the microphone connecting operation of the target user, the target terminal sends a microphone connecting termination instruction to the server so as to forward the microphone connecting termination instruction to the initiating terminal, and simultaneously terminates uploading of the second audio and video stream which is locally collected to the server.
Specifically, an operation button such as "terminate wheat-connecting" is arranged on a user interface of the initiating terminal and the target terminal, and after a user touches the "terminate wheat-connecting" button, the initiating terminal/the target terminal can generate a wheat-connecting termination instruction and send the same to the server to be forwarded to the target terminal/the initiating terminal by the server, wherein the wheat-connecting termination instruction is PMicLinkStop. Meanwhile, when the initiating user initiates the 'wheat connection termination' operation, the initiating terminal stops pulling the second audio and video stream transmitted by the target terminal from the server, and when the target user initiates the 'wheat connection termination' operation, the target terminal stops uploading the locally acquired second audio and video stream to the server.
Similarly, the instruction for terminating the microphone connection is sent to the opposite terminal according to the preset time interval, so
After receiving a connecting wheat termination instruction of an initiating end, a target end sends a connecting wheat termination response to a main broadcasting end through a server, and after receiving the connecting wheat termination response, the initiating end cancels the sending of the connecting wheat termination instruction to the target end according to a preset time interval; or
And after receiving the continuous microphone termination response, the target end cancels the continuous microphone termination instruction sent to the main broadcasting end according to the preset time interval. The Lianmai termination response is PMiclinkStopAck.
In the embodiment of the present invention, the signaling and the response of the originating terminal and the target terminal are both transmitted through the server, and the server only analyzes and executes corresponding operations for part of the signaling, specifically:
after receiving an invitation signaling sent by an initiating terminal, a server analyzes the invitation signaling to obtain identity information of a target user, pre-allocates a microphone connecting position for the target user, configures a timer for the pre-allocated microphone connecting position at the same time, and is used for counting down when the microphone connecting time is out, and releases the microphone connecting position when the microphone connecting position is not confirmed to be used by the target user within the counting down time; in addition, after receiving a connection confirmation signaling sent by a target end, the server allocates pre-allocated microphone connecting positions to the target user, namely, the target user is added into a live broadcast channel of a main broadcast user, information of microphone position lists and microphone position states is broadcasted to all users in the live broadcast channel, and after each terminal in the live broadcast channel receives the information, local microphone position lists and microphone position state UI interfaces are updated.
Further, in the embodiment of the present invention, when there is a target user who is carrying out microphone connection, the server pushes a microphone list and microphone status information to each terminal in the live broadcast room at a preset time interval, when the originating terminal and/or the target terminal receives that the status information is inconsistent with the local microphone connection status, the server reports the local microphone connection status information to the server, and after the server receives the local microphone connection status information fed back by the originating terminal or the target terminal, the server updates the current microphone list and microphone status of the server, and simultaneously forwards the local microphone connection information fed back by the originating terminal to the target terminal or forwards the local microphone connection information fed back by the target terminal to the originating terminal, so that the originating terminal/the target terminal can perform corresponding correction processing. For example, a main broadcasting end is taken as an initiating end for explanation, a main broadcasting user finishes the wheat connection with a target user, but a wheat connection termination instruction is lost when the main broadcasting end does not reach a server or is lost when the main broadcasting end does not forward the instruction to the target end, at this time, after the main broadcasting end receives a wheat position list and wheat position state information pushed by the server, the main broadcasting end finds that the main broadcasting end is inconsistent with the local wheat connection state, the main broadcasting end actively reports the local wheat connection state information to the server again, and the server updates the current wheat position list and the wheat position state information and then sends the updated current wheat position list and wheat position state information to the target end, so that the target end terminates the wheat connection and stops uploading a second audio/video stream to the server, and the effect of the synchronization. Preferably, when a session of connecting to the microphone exists, the server pushes the microphone list and the microphone state information to each end once every 10s, so as to ensure that each end can maintain the latest state, when all sessions of connecting to the microphone end, the time interval of the microphone list and the microphone state information pushed by the server enters a doubling cycle, and the interval returns to the 10s cycle after increasing from 10s, 20s and 40s to 80s, so that the service pressure of the server is effectively reduced, and the flow consumption of each end is reduced.
Furthermore, in the embodiment of the present invention, during the mic connection period, the target user may close/open the local camera to perform pure audio/video switching by clicking the called/hidden mic interactive UI, and when the terminal state of the target changes, the target actively reports the latest state information to the server, so that the server updates the current mic list and mic state information, where the change in the terminal state of the target includes that the target user closes the camera acquiring the second video stream, and switches the live broadcast software to a system background operation state and the like.
In a second aspect, as shown in fig. 8, a flowchart of an embodiment of a live broadcast live telecast video stream push control method applying the live broadcast live telecast control method is shown, in this embodiment, a main broadcast end is used as an execution main body, and the method includes the following steps:
step S1000: responding to the completion of the wheat connecting operation between the anchor terminal and the target terminal, and pulling a second audio/video stream of at least one target terminal by the anchor terminal;
step S2000: processing the second audio and video stream and the locally acquired first audio and video stream to generate a third audio and video stream;
step S3000: and pushing the third audio and video stream to a server to enable each audience end in the live broadcast room to pull the third audio and video stream to be displayed and played.
In this embodiment, by applying the above-mentioned method for controlling a direct broadcast, after the target user accepts the direct broadcast invitation from the anchor user, the server adds the target user to a direct broadcast channel live broadcast by the anchor user, specifically, adds the identity information (i.e., the target user ID) of the target user to the direct broadcast channel, and the direct broadcast channel only retains the identity information (i.e., the anchor ID) of the anchor when there is no direct broadcast session. Specifically, the anchor terminal pulls a second audio and video stream of the target terminal and pushes a first audio stream collected locally, a third audio stream after the first audio stream and the second audio stream are synthesized and a third video stream after the first video stream and the second video stream are synthesized to the server, and the target terminal pushes a second audio and video stream collected locally to the server and pulls the first audio stream and the third video stream of the anchor terminal. During the microphone connecting period, a target user can close/open a local camera to switch pure audio/video by clicking the called/hidden microphone connecting interaction UI, so that the requirement of the target user on protecting personal privacy is met, and at the moment, an image display window of the second video stream is displayed by the head portrait of the target user. And each audience end in the live broadcast room only needs to pull the third audio-video stream and then display and play the third audio-video stream, and the target end only needs to pull the third video stream and the first audio stream and then replace a preview window of the third video stream with a locally acquired second video stream and then display and play the second video stream. For the anchor terminal, only one path of synthesized third video stream and two paths of audio streams need to be pushed, on the premise of ensuring that audience users synchronously watch a plurality of continuous microphone sessions, the coding and decoding pressure of the anchor terminal is reduced to the maximum extent, the problem of delay of audio-video interaction among the continuous microphone terminals is effectively solved, and the audio stream which is acquired and sent to the anchor terminal by a target terminal is prevented from being locally played.
Further, when there are multiple session connections, that is, there are multiple target users (such as target user a and target user B) in the live broadcast channel, the target user A, B pushes the locally acquired second video stream a, second audio stream a, second video stream B, and second audio stream B to the server, respectively, the anchor terminal pulls the second video stream a, second audio stream a, second video stream B, and second audio stream B, then synthesizes the second video stream a, second video stream B, and locally acquired first video stream into a third video stream, synthesizes the second audio stream a, second audio stream B, and locally acquired first audio stream into a third audio stream, then pushes the third video stream, third audio stream, and first audio stream to the server, the first audio stream is pulled by the target user a and target user B in the live broadcast channel, and the target user a pulls the third video stream, After the second audio stream B and the first audio stream, replacing a preview window of the third video stream with a second video stream A which is locally acquired; similarly, after the target user B pulls the third video stream, the second audio stream a, and the first audio stream, the preview window of the target user B in the third video stream is replaced with the second video stream B locally acquired by the target user B.
For audience users who do not have a connection with the main broadcasting user, when watching the live broadcasting content of the live broadcasting room, the third video stream and the third audio stream pushed by the main broadcasting end are pulled from the server and are locally decoded, rendered and displayed. Fig. 9 is a schematic diagram of an embodiment of a third video stream that is synthesized by an anchor terminal into a first video stream and a plurality of second video streams and then pushed to a server, where 91 denotes the first video stream, 92 denotes the second video stream a, and 93 denotes the second video stream B, and a viewer user in a live broadcast room only needs to pull the third video stream 90 and the third audio stream pushed by the anchor terminal, so as to reduce the requirement of the viewer terminal on network bandwidth.
Furthermore, the invention also provides a live broadcast room microphone connecting control device based on the live broadcast room microphone connecting control method according to the function modularization thinking of computer software. Referring specifically to fig. 10, the apparatus includes:
the invitation module 100: the device is used for responding to the microphone connecting operation initiated by the user, sending the invitation signaling to the server and forwarding the invitation signaling to the target end through the server;
the connection module 200: the device is used for sending a connection signaling to the target end to enable the target end to output a corresponding connection confirmation window when the target end meets the connecting condition;
the establishing module 300: and the server is used for receiving a connection confirmation signaling sent by the target end and forwarded by the server to establish a connection with the target end and pull the second audio/video stream transmitted by the target end.
The invitation module 100 responds to a wheat connecting operation initiated by a user, sends an invitation signaling to a server, takes an anchor as an initiating end, enters a 'wheat connecting calling in process' state at the moment, counts down a wheat connecting countdown to wait for the acceptance or rejection of a wheat connecting invitation of a target user, the invitation signaling carries a unique session identifier, a wheat position identifier and target user identity information, the server receives the invitation signaling, analyzes and acquires the target user identity information and pre-allocates a wheat position for the target user, and then forwards the invitation signaling to the target end. After receiving an invitation signaling forwarded by a server, a target end makes corresponding feedback information for the invitation signaling and sends the feedback information to an anchor end, wherein the feedback information is attached with the connecting condition information of the target end, if the target end meets the connecting condition, the feedback information carries a successful resCode representing the meeting of the connecting condition, otherwise, the feedback information carries a specific reason resCode, when the connecting module 200 confirms that the target end meets the connecting condition, the anchor end is still in a 'connecting call' state, meanwhile, a connecting video preview window of a target user is output on a user interface of the anchor end, and then the target end sends a connection signaling to enable the target end to output a corresponding connection confirmation window after receiving the connection signaling. The target terminal outputs a corresponding connection confirmation window after receiving a connection signaling sent by the anchor terminal, when a target user selects to accept a connecting request from the connection confirmation window, a corresponding connection confirmation signaling is generated and fed back to the anchor terminal through the server, the establishment module 300 establishes the connecting confirmation with the connecting confirmation of the target terminal after receiving the connection confirmation signaling, at this moment, the anchor terminal enters a 'connecting in the wheat' state, and a second audio/video stream transmitted by the target terminal is pulled from the server.
Furthermore, based on the live broadcast room microphone video stream push control method according to the function modularization thinking of computer software, the invention also provides a live broadcast room microphone video stream push control device. Referring specifically to fig. 11, the apparatus includes:
wheat connecting module 1000: the system comprises a main broadcasting terminal, a target terminal and at least one target terminal, wherein the main broadcasting terminal is used for responding to the fact that a main broadcasting terminal and the target terminal complete a microphone connecting operation and pulling a second audio/video stream of at least one target terminal;
the generation module 2000: the second audio/video stream and the locally acquired first audio/video stream are processed to generate a third audio/video stream;
push module 3000: and the third audio and video stream is pushed to a server so that each audience end in the live broadcast room pulls the third audio and video stream to be displayed and played.
The main broadcasting end is used as an initiating end for explanation, the connecting wheat control device is applied, when a target user accepts a connecting wheat invitation of the main broadcasting user, the connecting wheat module 1000 responds to the main broadcasting end and the target end to complete the connecting wheat operation, pulls a second audio and video stream of at least one target end, then the generation module 2000 processes the second audio and video stream and a first audio and video stream locally acquired by the main broadcasting end to generate a third audio and video stream, the push module 3000 pushes the first audio stream locally acquired, a third audio stream synthesized into the first audio stream and the second audio stream and a third video stream synthesized into the first video stream and the second video stream to a server, each audience end in a live broadcasting room only needs to pull the third audio and video stream for display and play, and the target end only needs to pull the third video stream and the first audio stream and then replaces a preview window of the third video stream with a second video stream locally acquired and then displays the third video stream, And (6) playing.
As shown in fig. 12, which is a schematic view of another embodiment of the live broadcast room microphone connecting video stream push control device of the present invention, the microphone connecting module 1000 includes an invitation module 100, a connection module 200, and an establishment module 300 of the microphone connecting control device, and establishes microphone connection between the main broadcast end and the target end through the invitation module 100, the connection module 200, and the establishment module 300 and pulls a second audio/video stream transmitted by the target end. The generating module 2000 processes the second audio/video stream and the first audio/video stream locally collected by the anchor terminal to generate a third audio/video stream; the push module 3000 pushes the locally acquired first audio stream, the third audio stream after synthesizing the first audio stream and the second audio stream, and the third video stream after synthesizing the first video stream and the second video stream to the server, so that the third audio stream is pulled by the audience and the target.
In a third aspect, the present invention further provides a terminal device, including a processor and a memory, where the memory stores a computer program, and the computer program, when executed by the processor, implements the following steps:
step S100: responding to the connecting operation initiated by the user, the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server;
step S200: when the target end meets the connecting condition, the initiating end sends a connection signaling to the target end to enable the target end to output a corresponding connection confirmation window;
step S300: and the initiating terminal receives the connection confirmation signaling transmitted by the target terminal and forwarded by the server to establish connection with the target terminal and pull the second audio/video stream transmitted by the target terminal.
Or
Step S1000: responding to the completion of the wheat connecting operation between the anchor terminal and the target terminal, and pulling a second audio/video stream of at least one target terminal by the anchor terminal;
step S2000: processing the second audio and video stream and the locally acquired first audio and video stream to generate a third audio and video stream;
step S3000: and pushing the third audio and video stream to a server to enable each audience end in the live broadcast room to pull the third audio and video stream to be displayed and played.
In the invention, through secondary signaling confirmation, the abnormal situation that the initiating terminal sends the invitation signaling once and the invitation signaling is overtime and has no response is effectively solved, but the initiating terminal cancels the connecting to the microphone but the invitation signaling delays to reach the target terminal and pushes the second audio and video stream to the server after the target terminal receives the invitation.
Meanwhile, the initiating end and the target end wait for receiving corresponding signaling response aiming at each signaling sent, all the signaling automatically retransmits when waiting for response overtime, and cancels retransmission when receiving response, thereby improving reliability of microphone connection and avoiding the condition of microphone connection function disorder caused by delayed arrival or loss of the signaling in the transmission process. Meanwhile, the multi-terminal continuous wheat states are kept consistent based on multi-terminal maintenance of the initiating terminal, the server and the target terminal, and the server only needs to maintain a wheat sequence list and a wheat position state according to a specific signaling, so that the complexity of server codes and the pressure for processing the signaling are reduced.
Moreover, based on a multi-end live broadcast connecting wheat scheme that a main broadcasting end integrates all audio and video streams in a live broadcast channel and pushes one path of synthesized audio and video stream to a server, for the main broadcasting end, only one path of synthesized third video stream and two paths of audio streams need to be pushed, under the premise that a plurality of connecting wheat sessions are synchronously watched by audience users, the coding and decoding pressure of the main broadcasting end is reduced to the maximum extent, the problem of delay of audio and video interaction among the multiple connecting wheat ends is effectively solved, and the problem that a target end locally plays the audio stream which is acquired and sent to the main broadcasting end is avoided; the audience only needs to pull the third video stream and the third audio stream pushed by the anchor end, so that the requirement of the audience on the network bandwidth is reduced, and the audience only needs to decode one path of audio and video stream, so that the decoding and playing pressure of the audience equipment is reduced, the heat productivity of the equipment is reduced, and the electric quantity consumption is reduced.
Although a few exemplary embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in these exemplary embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.

Claims (8)

1. A live broadcast room microphone connecting control method is characterized by comprising the following steps:
responding to the connecting operation initiated by the user, the initiating terminal sends the invitation signaling to the server and forwards the invitation signaling to the target terminal through the server; the invitation signaling carries the wheat position identification and the identity information of the target user; after receiving the invitation signaling, the server pre-allocates a microphone connecting position for the target user and acquires the identity information of the target user so as to forward the invitation signaling to the target end;
when the target end meets the connecting condition, the initiating end sends a connection signaling to the target end to enable the target end to output a corresponding connection confirmation window;
the method comprises the steps that an initiating terminal receives a connection confirmation signaling transmitted by a target terminal and forwarded by a server to establish a connection with a target terminal, and pulls a second audio and video stream transmitted by the target terminal, and after the server receives the connection confirmation signaling transmitted by the target terminal, the server distributes pre-distributed connection microphone positions to target users, updates microphone position information and then pushes the microphone position information to all terminals in a live broadcast room; the method comprises the steps that an initiating end and/or a target end receive the wheat position information pushed to each terminal in a live broadcast room by a server at a preset time interval, the wheat position information comprises a wheat position list and wheat position state information, and when the initiating end or the target end receives that the wheat position information pushed by the server is inconsistent with a local wheat connecting state, the local wheat connecting state is reported to the server so that the server updates the wheat position information and forwards the wheat position information to the target end or the initiating end.
2. The method of claim 1, wherein before determining that the target end satisfies the connecting condition after the initiating end sends the invitation signaling to the server and forwards the invitation signaling to the target end through the server, the method further comprises:
the initiating end receives an invitation response of the target end, and when the invitation response representation meets the wheat connecting condition, the target end is determined to meet the wheat connecting condition;
or, after the initiating terminal sends the connection signaling to the target terminal, before receiving the connection confirmation signaling sent by the target terminal and forwarded by the server, the method further includes:
receiving a connection response sent by a target end;
or, after the initiating terminal receives the connection confirmation signaling sent by the target terminal and forwarded by the server, when pulling the second audio/video stream transmitted by the target terminal, the method further includes:
and sending a connection confirmation response to the target end.
3. The method of claim 1, wherein before determining that the target end satisfies the connecting condition after the initiating end sends the invitation signaling to the server and forwards the invitation signaling to the target end through the server, the method further comprises:
the initiating end receives an invitation response of the target end, and when the invitation response representation meets the wheat connecting condition, the target end is determined to meet the wheat connecting condition;
and after the initiating terminal sends the connection signaling to the target terminal, before receiving the connection confirmation signaling sent by the target terminal and forwarded by the server, the method further comprises the following steps:
receiving a connection response sent by a target end;
and when the initiating terminal pulls the second audio/video stream transmitted by the target terminal after receiving the connection confirmation signaling sent by the target terminal and forwarded by the server, the method further comprises the following steps:
and sending a connection confirmation response to the target end.
4. The method according to any of claims 1-3, wherein the invite signaling, the connection signaling and the connection confirmation signaling sent by the initiator are repeatedly sent according to a preset time interval, and
when the initiating end receives the invitation response, the initiating end cancels the sending of the invitation signaling according to a preset time interval; or
When the initiating end receives the connection response, the initiating end cancels the sending of the connection signaling according to a preset time interval; or
And after receiving the connection confirmation response, the target end cancels the sending of the connection confirmation signaling according to a preset time interval.
5. The method of claim 1, further comprising:
responding to the termination of the microphone connecting operation of the initiating user, the initiating terminal sends a microphone connecting termination instruction to the server so that the server forwards the microphone connecting termination instruction to the target terminal, and stops pulling the second audio/video stream transmitted by the target terminal; or
And responding to the termination of the microphone connecting operation of the target user, the target end sends a microphone connecting termination instruction to the server so that the server forwards the microphone connecting termination instruction to the initiating end, and stops uploading the second audio and video stream to the server.
6. The method of claim 5, further comprising:
after the target end receives the connecting microphone termination instruction, a connecting microphone termination response is sent to the initiating end through the server, and uploading of a second audio and video stream to the server is terminated; or
And after the anchor terminal receives the connecting microphone termination instruction, sending a connecting microphone termination response to the target terminal through the server, and stopping pulling the second audio/video stream transmitted by the target terminal.
7. A live broadcast room wheat connecting control device is characterized by comprising:
an invitation module: the initiating terminal is used for responding to the connecting operation initiated by the user, sending the invitation signaling to the server and forwarding the invitation signaling to the target terminal through the server; the invitation signaling carries the wheat position identification and the identity information of the target user; after receiving the invitation signaling, the server pre-allocates a microphone connecting position for the target user and acquires the identity information of the target user so as to forward the invitation signaling to the target end;
a connecting module: the device is used for sending a connection signaling to the target end to enable the target end to output a corresponding connection confirmation window when the target end meets the connecting condition;
a building module: the server is used for receiving a connection confirmation signaling transmitted by the target end and forwarded by the server to establish a microphone connection with the target end and pulling a second audio and video stream transmitted by the target end, and after receiving the connection confirmation signaling transmitted by the target end, the server allocates the pre-allocated microphone connection position to a target user and updates the microphone position information and then pushes the microphone connection position information to each terminal in the live broadcast room; the method comprises the steps that an initiating end and/or a target end receive the wheat position information pushed to each terminal in a live broadcast room by a server at a preset time interval, the wheat position information comprises a wheat position list and wheat position state information, and when the initiating end or the target end receives that the wheat position information pushed by the server is inconsistent with a local wheat connecting state, the local wheat connecting state is reported to the server so that the server updates the wheat position information and forwards the wheat position information to the target end or the initiating end.
8. A terminal device comprising a processor and a memory, said memory having stored thereon a computer program, characterized in that the computer program realizes the steps of claims 1-6 when executed by the processor.
CN201710390575.2A 2017-05-27 2017-05-27 Live broadcast room microphone connection control method and device and corresponding terminal equipment Active CN107342978B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710390575.2A CN107342978B (en) 2017-05-27 2017-05-27 Live broadcast room microphone connection control method and device and corresponding terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710390575.2A CN107342978B (en) 2017-05-27 2017-05-27 Live broadcast room microphone connection control method and device and corresponding terminal equipment

Publications (2)

Publication Number Publication Date
CN107342978A CN107342978A (en) 2017-11-10
CN107342978B true CN107342978B (en) 2020-12-22

Family

ID=60221131

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710390575.2A Active CN107342978B (en) 2017-05-27 2017-05-27 Live broadcast room microphone connection control method and device and corresponding terminal equipment

Country Status (1)

Country Link
CN (1) CN107342978B (en)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107995501A (en) * 2017-12-18 2018-05-04 杭州雅顾科技有限公司 Video connects wheat method and system
CN108306942A (en) * 2018-01-09 2018-07-20 武汉斗鱼网络科技有限公司 Communication means, storage medium, electronic equipment and the system that multi-user is broadcast live simultaneously
CN109391851B (en) * 2018-01-09 2020-04-07 深圳市珍爱网信息技术有限公司 Video live broadcast method and device, computer equipment and storage medium
CN110225375B (en) * 2018-03-01 2022-02-22 武汉斗鱼网络科技有限公司 Live broadcast room microphone connection permission detection method, storage medium, equipment and system
CN108490947A (en) * 2018-04-17 2018-09-04 西安交通大学 One kind following barrier-avoiding method and its device automatically
CN108900919A (en) * 2018-06-29 2018-11-27 乐蜜有限公司 Company's wheat method, apparatus, server and terminal in a kind of live streaming
CN109348238A (en) * 2018-09-30 2019-02-15 武汉斗鱼网络科技有限公司 A kind of voice in live streaming connects wheat method, apparatus, server and storage medium
CN109257656A (en) * 2018-09-30 2019-01-22 武汉斗鱼网络科技有限公司 A kind of voice connects wheat method, apparatus, server and storage medium
CN109511007B (en) * 2018-11-29 2021-05-04 广州市百果园信息技术有限公司 Network live broadcast method, device, equipment and storage medium
CN109698963B (en) * 2018-12-29 2021-11-26 卓米私人有限公司 Live broadcast method and device, electronic equipment and readable storage medium
CN109756504B (en) * 2019-01-16 2021-11-09 武汉斗鱼鱼乐网络科技有限公司 Communication method based on live broadcast platform and related device
CN109862382A (en) * 2019-02-25 2019-06-07 广州虎牙信息科技有限公司 Multi-person speech method, server and computer storage medium
CN110213061B (en) * 2019-05-23 2020-06-05 北京力拓飞远科技有限公司 Synchronous communication method, synchronous communication device, synchronous communication apparatus, and medium
CN112295233B (en) * 2019-08-02 2024-04-12 厦门雅基软件有限公司 Control right transferring method and system
CN110324655B (en) * 2019-08-05 2021-07-06 北京字节跳动网络技术有限公司 Live broadcast room client connection method, device, equipment and storage medium
CN111372090B (en) * 2020-02-25 2022-09-09 北京达佳互联信息技术有限公司 Method and device for realizing wheat connection, electronic equipment and storage medium
CN111385666B (en) * 2020-03-04 2022-06-03 北京字节跳动网络技术有限公司 Communication link establishing method, device, equipment and storage medium
CN111918084B (en) * 2020-08-03 2022-04-22 北京达佳互联信息技术有限公司 Wheat loading method and device, server and terminal
CN112291316B (en) * 2020-10-19 2022-03-15 北京字节跳动网络技术有限公司 Connection processing method and device, electronic equipment and computer readable storage medium
CN113115114B (en) * 2021-03-02 2022-12-27 北京达佳互联信息技术有限公司 Interaction method, device, equipment and storage medium
CN113467674B (en) * 2021-05-31 2023-03-28 北京达佳互联信息技术有限公司 Virtual space operation method and device, electronic equipment and storage medium
CN115484469B (en) * 2021-06-15 2024-01-09 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
CN115484468B (en) * 2021-06-15 2024-01-09 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
CN113704280A (en) * 2021-08-26 2021-11-26 上海哔哩哔哩科技有限公司 Data list updating method and device
CN114430423A (en) * 2022-01-26 2022-05-03 百果园技术(新加坡)有限公司 Communication management method, device, equipment and storage medium between terminals
CN114710684B (en) * 2022-03-02 2023-11-17 百果园技术(新加坡)有限公司 Live broadcasting room wheat connecting method, device, equipment and storage medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8700723B2 (en) * 2010-06-15 2014-04-15 Netzyn, Inc. Hierarchical display-server system and method
CN103384181B (en) * 2012-05-04 2018-04-20 华为技术有限公司 The transmission method and equipment of data packet
CN103841353B (en) * 2014-02-24 2017-08-01 广州华多网络科技有限公司 Video interactive method, terminal, server and system
GB2527116B (en) * 2014-06-12 2017-09-20 Canon Kk Adaptative persistent push
CN105282803A (en) * 2014-07-25 2016-01-27 中兴通讯股份有限公司 Communication interface and information transfer method and system based on the same
CN106131583A (en) * 2016-06-30 2016-11-16 北京小米移动软件有限公司 A kind of live processing method, device, terminal unit and system
CN106303657A (en) * 2016-08-18 2017-01-04 北京奇虎科技有限公司 A kind of even method that wheat is live and main broadcaster's end equipment

Also Published As

Publication number Publication date
CN107342978A (en) 2017-11-10

Similar Documents

Publication Publication Date Title
CN107342978B (en) Live broadcast room microphone connection control method and device and corresponding terminal equipment
US8830294B2 (en) Method and system for video conference control, videoconferencing network equipment, and videoconferencing site
EP1519578B1 (en) Audio/video-conferencing using content based messaging
US7710450B2 (en) System and method for dynamic control of image capture in a video conference system
US20120246679A1 (en) Method and Apparatus for Initiating and Executing a Joint Viewing Session of a Programming Event
CN110012362B (en) Live broadcast voice processing method, device, equipment and storage medium
EP2448173A1 (en) System and method for realizing wireless video conference
CN111372092B (en) Communication link establishing method, device, equipment and storage medium
CN105763832A (en) Video interaction and control method and device
US20070216759A1 (en) System for Conducting Videoconferening Session over Television Network
EP2302866A1 (en) A method and apparatus for controlling the multimedia conference by the application server
CN110475094B (en) Video conference processing method and device and readable storage medium
CN102176713A (en) Method for realizing multiuser network video chat system for intensifying simplex video quality
CN111385666B (en) Communication link establishing method, device, equipment and storage medium
JP2003518840A (en) TV video conferencing system
CN113286190A (en) Cross-network and same-screen control method and device and cross-network and same-screen system
WO2014177082A1 (en) Video conference video processing method and terminal
CN116112721A (en) Method, system, and medium for synchronized media content playback on multiple devices
CN108156413B (en) Video conference transmission method and device and MCU
CN111901537B (en) Broadcast television interactive program production mode based on cloud platform
CN113179384B (en) Video conference sharing control method and device, terminal and conference flat plate
CN113726534A (en) Conference control method, conference control device, electronic equipment and storage medium
CN108495076A (en) A kind of method and system of live video stream embedded in real-time session
WO2012155732A1 (en) Mobile terminal and method for realizing remote conference based on mobile terminal
CN108011874B (en) Low-delay live broadcasting method and system for doll machine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20221123

Address after: 31a, 15th floor, building 30, maple commercial city, bangrang Road, Brazil

Patentee after: Baiguoyuan Technology (Singapore) Co.,Ltd.

Address before: Building B-1, North District, Wanda Commercial Plaza, Wanbo business district, No. 79, Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Patentee before: GUANGZHOU BAIGUOYUAN INFORMATION TECHNOLOGY Co.,Ltd.