CN107342978A - Direct broadcasting room connects wheat control method, device and corresponding terminal device - Google Patents

Direct broadcasting room connects wheat control method, device and corresponding terminal device Download PDF

Info

Publication number
CN107342978A
CN107342978A CN201710390575.2A CN201710390575A CN107342978A CN 107342978 A CN107342978 A CN 107342978A CN 201710390575 A CN201710390575 A CN 201710390575A CN 107342978 A CN107342978 A CN 107342978A
Authority
CN
China
Prior art keywords
wheat
destination end
signaling
server
destination
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710390575.2A
Other languages
Chinese (zh)
Other versions
CN107342978B (en
Inventor
杨良剑
李学凌
胡建强
姜健华
曾莹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bigo Technology Pte Ltd
Original Assignee
Guangzhou Baiguoyuan Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Baiguoyuan Information Technology Co Ltd filed Critical Guangzhou Baiguoyuan Information Technology Co Ltd
Priority to CN201710390575.2A priority Critical patent/CN107342978B/en
Publication of CN107342978A publication Critical patent/CN107342978A/en
Application granted granted Critical
Publication of CN107342978B publication Critical patent/CN107342978B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/12Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/18Automatic repetition systems, e.g. Van Duuren systems
    • H04L1/1812Hybrid protocols; Hybrid automatic repeat request [HARQ]
    • H04L1/1816Hybrid protocols; Hybrid automatic repeat request [HARQ] with retransmission of the same, encoded, message
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1083In-session procedures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/762Media network packet handling at the source 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/764Media network packet handling at the destination 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/55Push-based network services

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The present invention relates to net cast field, and in particular to a kind of direct broadcasting room connects wheat control method, device and corresponding terminal device, and methods described includes step:Connect wheat operation in response to Client-initiated, originating end will invite signaling to send to server and be forwarded to destination end by server;When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to export corresponding connection acknowledgement window to destination end;The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish the company wheat with destination end, and pulls the second audio/video flow that destination end is transmitted.Confirmed by secondary signaling, originating end single is efficiently solved to send invitation signaling and occur inviting signaling time-out unresponsive, and originating end has cancelled even wheat but has invited signaling to delay to reach destination end and after destination end is accepted the invitation to the abnormal conditions of the audio/video flow of server push second.

Description

Direct broadcasting room connects wheat control method, device and corresponding terminal device
【Technical field】
The present invention relates to net cast field, and in particular to a kind of direct broadcasting room connects wheat control method, device and corresponding end End equipment.
【Background technology】
With the development of Internet technology and intelligent mobile terminal equipment, various internet products are to the working of people, raw Living to bring many convenient and amusement, in recent years, all kinds of live platforms for net cast emerge in an endless stream, and net cast gives people Bring more real-time social experience.Wherein, company's wheat function in net cast has turned into very popular mutual in net cast Flowing mode, even wheat refer to main broadcaster user during live with other users while carrying out live function.Connect building for wheat at present It is vertical, exist due to unstable network and cause even wheat process signaling lose or delay to reach etc. abnormal conditions so as to the company of causing wheat The problem of failure, even the reliability that is successfully established of wheat cannot be guaranteed, signaling lose or delay to reach can also cause main broadcaster user, Even the terminal of wheat user and spectators user connect the problem of wheat state is inconsistent, have aggravated data receiver, the processing pressure of each terminal. Also, in the scheme transmitted at present for Lian Maihou audio/video flow, General Visitors user terminal needs to pull main broadcaster's use simultaneously Family and even wheat user at least two-way audio/video flow, can not ensure the synchronization of multichannel audio-video frequency stream well, and need to take more More network bandwidth resources, increase the requirement to network bandwidth and aggravate end loads.
【The content of the invention】
The primary and foremost purpose of the present invention is that providing a kind of direct broadcasting room connects wheat control method and device;
Another object of the present invention is to provide a kind of computer program and phase realized direct broadcasting room and connect wheat control method for this The terminal device answered.
To realize the purpose, the present invention adopts the following technical scheme that:
In a first aspect, one embodiment of the present of invention, which provides a kind of direct broadcasting room, connects wheat control method, comprise the following steps:
Connect wheat operation in response to Client-initiated, originating end will be invited signaling to send to server and be forwarded by server To destination end;
When destination end meets even wheat condition, originating end sends connection signaling to make destination end output corresponding to destination end Connect acknowledgement window;
The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish the company wheat with destination end, and Pull the second audio/video flow that destination end is transmitted.
Further, the originating end will invite signaling send to server and by server be forwarded to destination end it Afterwards, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, and destination end is determined when the invitation response characterizes and meets even wheat condition Meet even wheat condition;
Or, in the originating end after connection signaling is sent to destination end, the destination end of the reception server forwarding is sent Connection confirm signaling before, in addition to:
Receive connection replying for destination end transmission;
Or, after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull target When holding the second transmitted audio/video flow, in addition to:
Connection, which is sent, to destination end confirms response.
Preferably, the originating end will invite signaling send to server and by server be forwarded to destination end it Afterwards, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, and destination end is determined when the invitation response characterizes and meets even wheat condition Meet even wheat condition;
And in the originating end after connection signaling is sent to destination end, the destination end of the reception server forwarding is sent Connection confirm signaling before, in addition to:
Receive connection replying for destination end transmission;
And after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull target When holding the second transmitted audio/video flow, in addition to:
Connection, which is sent, to destination end confirms response.
Further, the connection that invitation signaling, connection signaling and the destination end that the originating end is sent are sent confirms signaling Repeat to send according to prefixed time interval, and
After originating end receives the invitation response, cancel and send the invitation signaling according to prefixed time interval;Or
After main broadcaster's termination receives described connection reply, cancel and send the connection signaling according to prefixed time interval;Or
After destination end, which receives the connection, confirms response, cancel and send the connection confirmation according to prefixed time interval Signaling.
Specifically, the invitation signaling carries even wheat session unique mark, wheat bit identification and targeted customer's identity information.
Specifically, the server pre-allocates Lian Maimai positions for targeted customer and obtained after the invitation signaling is received The identity information of targeted customer is taken so that the invitation signaling is forwarded into destination end.
Further, the server is after the connection for receiving destination end transmission confirms signaling, by the predistribution Lian Maimai bit allocations update each terminal push into direct broadcasting room after the information of wheat position to targeted customer.
Further, methods described also includes:
Termination in response to initiating user connects wheat operation, originating end to server send even wheat command for stopping to allow server The even wheat command for stopping is forwarded to destination end, and stops pulling the second audio/video flow that destination end is transmitted;Or
Termination in response to targeted customer connects wheat operation, destination end to server send even wheat command for stopping to allow server The even wheat command for stopping is forwarded to originating end, and stops uploading the second audio/video flow to server.
It is preferred that methods described also includes:
After destination end receives the even wheat command for stopping, even wheat is sent to originating end by server and terminates response, And terminate to server and upload the second audio/video flow;Or
After main broadcaster's termination receives the even wheat command for stopping, even wheat is sent to destination end by server and terminates response, And stop pulling the second audio/video flow that destination end is transmitted.
Further, the originating end and/or destination end receive the server with prefixed time interval to direct broadcasting room The wheat position information of interior each terminal push, wheat position information ranks table and wheat position status information including wheat, when originating end or mesh When mark termination receives the wheat position information and inconsistent company's wheat state of local of server push, local company wheat is reported to server State wheat position information described in server update and is forwarded to destination end or originating end to allow.
Second aspect, connect wheat control method applied to above-mentioned direct broadcasting room, the present invention, which also provides a kind of direct broadcasting room and connects wheat, to be regarded Frequency stream push control method, comprises the following steps:
Even wheat operation, originating end, which are completed, in response to originating end and destination end pulls the second audio frequency and video of at least one destination end Stream;
The first audio/video flow processing the 3rd sound of generation that originating end locally gathers second audio/video flow and originating end Video flowing;
3rd audio/video flow described in originating end to server push is to allow each viewer end in direct broadcasting room to pull the 3rd sound Show, play after video flowing.
Further, methods described also includes:
The first audio stream that originating end locally gathers to server push, after pulling first audio stream for destination end Play.
Specifically, methods described also includes:
The destination end is after the 3rd video flowing described in server pull, the second video flowing for will being included in the 3rd video flowing Display window be substituted for display after the second video flowing that destination end locally gathers, play.
Corresponding with first aspect, the present invention also provides a kind of direct broadcasting room and connects wheat control device, including:
Invite module:For connecting wheat operation in response to Client-initiated, signaling will be invited to send to server and pass through clothes Business device is forwarded to destination end;
Link block:For when destination end meets even wheat condition, sending connection signaling to destination end to make destination end defeated Go out corresponding connection acknowledgement window;
Establish module:The connection that destination end for the reception server forwarding is sent confirms signaling to establish and destination end Lian Mai, and pull the second audio/video flow that destination end is transmitted.
Corresponding with second aspect, the present invention also provides a kind of direct broadcasting room and connects wheat pushing video streaming control device, including:
Even wheat module:For completing even wheat operation in response to originating end and destination end, the of at least one destination end is pulled Two audio/video flows;
Generation module:The first audio/video flow for second audio/video flow and originating end locally to be gathered, which is handled, to be generated 3rd audio/video flow;
Pushing module:It is described for allowing in direct broadcasting room each viewer end to pull to the 3rd audio/video flow described in server push Show, play after 3rd audio/video flow.
The third aspect, the present invention also provide a kind of terminal device, including processor and memory, stored in the memory There is computer program, the computer program realizes above-mentioned first aspect or second aspect methods described when being executed by processor Step.
Compared with prior art, the present invention possesses following advantage:
1st, confirmed by secondary signaling, efficiently solve originating end single and send invitation signaling and occur inviting signaling time-out It is unresponsive, and originating end has cancelled even wheat but has invited signaling to delay to reach destination end and after destination end is accepted the invitation to server Push the abnormal conditions of the second audio/video flow.
2nd, originating end and destination end, which are directed to the signaling sent each time, can all wait corresponding signaling response to be received, and institute There is signaling to realize etc. that time-out to be answered is then automatic to retransmit, receive response and then cancel repeatings transmission, the reliability of the company of raising wheat, avoid letter Make and delay to reach or lose the disorderly situation of the company's of causing wheat function realization in transmitting procedure.Meanwhile based on originating end, server and The multiterminal of destination end, which are safeguarded, realizes that multiterminal connect wheat state and are consistent, and server only need to safeguard a wheat sequence according to specific signaling Table and wheat position state, reduce the complexity of code server and handle the pressure of signaling.
3rd, the sound synthesized all the way to server push after all audio/video flows in direct broadcasting room channel is integrated based on main broadcaster end The live even wheat scheme of multiterminal of video flowing, for main broadcaster end, it is only necessary to the 3rd video flowing and two-way that push synthesizes all the way Audio stream, on the premise of ensureing that spectators user synchronously watches multiple even wheat sessions, main broadcaster end is reduced to greatest extent Encoding and decoding pressure, and between the company's of efficiently solving wheat multiterminal audio frequency and video interact delay issue and avoid destination end locally play Itself gathers the audio stream for being sent to main broadcaster end;Viewer end only needs to pull the 3rd video flowing and the 3rd audio of the push of main broadcaster end Stream, requirement of the viewer end to network bandwidth is reduced, and because viewer end only needs decoding audio/video flow all the way, reduced The decoding of spectators' end equipment, pressure is played, and then reduce equipment heating amount, reduce electric quantity consumption.
Obviously, the above-mentioned description about advantage of the present invention is recapitulative, it is more the advantages of description will be embodied in it is follow-up During embodiment discloses, and, the content that those skilled in the art can also be disclosed reasonably finds its of the present invention His plurality of advantages.
The additional aspect of the present invention and advantage will be set forth in part in the description, and these will become from the following description Obtain substantially, or recognized by the practice of the present invention.
【Brief description of the drawings】
Fig. 1 is the embodiment schematic flow sheet that direct broadcasting room of the present invention connects wheat control method;
Fig. 2 is the user interface schematic diagram that main broadcaster end initiates when even wheat is invited in the present invention;
Fig. 3 is the user interface schematic diagram that main broadcaster end is in " even in wheat calling " state in the present invention;
Fig. 4 is the signal for the connection acknowledgement window that the destination end of the present invention exports after the connection signaling of originating end is received Figure;
Fig. 5 is the user interface schematic diagram that main broadcaster end is in " Lian Maizhong " state in the present invention;
Fig. 6 is another embodiment schematic flow sheet that direct broadcasting room of the present invention connects wheat control method;
Fig. 7 is the signaling of the embodiment of the present invention and the transmission schematic diagram of signaling response;
Fig. 8 direct broadcasting rooms of the present invention connect an embodiment schematic flow sheet of wheat pushing video streaming control method;
Fig. 9 is the schematic diagram that the main broadcaster end of the present invention is pushed to the 3rd video flowing of server;
Figure 10 is the embodiment schematic diagram that direct broadcasting room of the present invention connects wheat control device;
Figure 11 is the embodiment schematic diagram that direct broadcasting room of the present invention connects wheat pushing video streaming control device;
Figure 12 is another embodiment schematic diagram that direct broadcasting room of the present invention connects wheat pushing video streaming control device.
【Embodiment】
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached The embodiment of figure description is exemplary, is only used for explaining the present invention, and is not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art Language and scientific terminology), there is the general understanding identical meaning with the those of ordinary skill in art of the present invention.Should also Understand, those terms defined in such as general dictionary, it should be understood that have with the context of prior art The consistent meaning of meaning, and unless by specific definitions as here, idealization or the implication of overly formal otherwise will not be used To explain.
In embodiments of the present invention, the originating end, destination end are the user terminal in direct broadcasting room, can be direct broadcasting rooms The main broadcaster end of interior main broadcaster user or the viewer end of spectators user, when even wheat operation is initiated at main broadcaster end, main broadcaster end now is It is destination end for originating end, corresponding target audience user, when viewer end initiates even wheat operation, viewer end now is Destination end, corresponding main broadcaster end are destination end.In following embodiments, initiation is used as using main broadcaster end unless otherwise specified End, it will be understood by those skilled in the art that can also be realized using viewer end as originating end.
In a first aspect, be the embodiment schematic flow sheet that direct broadcasting room of the present invention connects wheat control method as shown in Figure 1, including Following steps:
Step S100:Connect wheat operation in response to Client-initiated, originating end will be invited signaling to send to server and be passed through Server is forwarded to destination end.
Even wheat function is that the important channel of direct broadcasting room atmosphere is enlivened in current live events, and even wheat function allows live by propagating Mode change is the interactive social patterns of equality, preferably draws in the distance between main broadcaster and spectators, passes through even wheat, spectators user The image and sound of oneself can be shared with main broadcaster while live, interactive on the same stage and into direct broadcasting room other spectators.
In the present embodiment, the even wheat operation is initiated using main broadcaster end as originating end to destination end.Specifically, user initiates Connect a kind of embodiment of wheat operation, the button that the company of initiation wheat is invited is configured with the user interface at main broadcaster end, main broadcaster user exists Such as " even wheat " button is clicked on main broadcaster's end subscriber interface, ejects corresponding user list, settable user need to meet certain bar Part could enter the list, and a certain user is then chosen in the user list and initiates even wheat operation as targeted customer;This reality The another embodiment of the company of initiation wheat operation in example is applied, main broadcaster user is entered by the user list in direct broadcasting room, public screen message Mouth opens the data card of wherein certain user, and the button of the company's of initiation wheat invitation, main broadcaster user are provided with the data card of user By clicking on such as button of " even wheat " on card, using the user as targeted customer and the wheat operation of the company of initiation.It is appreciated that It is, if the company of the initiation wheat operation using viewer end as originating end, is correspondingly provided with such as " application in the user interface of viewer end Even wheat " button, spectators user clicks on can also initiate even wheat operation to main broadcaster end.
Originating end connects wheat operation in response to Client-initiated, and signaling will be invited to send to server, still made with main broadcaster end Illustrated for originating end.Main broadcaster end will be invited signaling to send to server, now led in response to company's wheat operation of main broadcaster user Broadcast that end enters " even wheat calling in " state and the wheat countdown of company of progress is to wait the even wheat invitation of the receiving of targeted customer or refusal.Its In, the invitation signaling carries unique session identification, wheat bit identification and targeted customer's identity information, unique session identification It is the unique session-id (sessionId) that main broadcaster end connects wheat session distribution for each, the signaling for destination end identifies, target End only handles session identification identical signaling, avoids interfering between different sessions;The wheat bit identification is that wheat is ranked on table Wheat position sequence number, when server receive and parse it is described invitation signaling after, for targeted customer pre-allocate wheat position for target use Family subsequently uses;Targeted customer's identity information is targeted customer ID;Server is parsed and obtained after receiving the invitation signaling Take targeted customer's identity information therein and pre-allocate wheat position for targeted customer, then signaling will be invited to be forwarded to destination end.Such as It is an embodiment schematic diagram of the user interface at main broadcaster end shown in Fig. 2, main broadcaster user clicks on " even wheat " button pointed by arrow 21, initiate even wheat to targeted customer and invite, main broadcaster end, will after the company's wheat operation initiated in response to main broadcaster user to targeted customer Signaling is invited to send to server and be transmitted to destination end by server.
Step S200:When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to destination end The corresponding connection acknowledgement window of output.
After destination end receives the invitation signaling of server forwarding, corresponding feedback information is made simultaneously to the invitation signaling Main broadcaster end is sent to, wherein, company's wheat conditional information of destination end is included in the feedback information, if destination end meets even wheat bar Part, then feedback information, which carries, characterizes the successful resCode that satisfaction connects wheat condition, and otherwise the feedback information carries concrete reason resCode.Originating end, which is sent, invites company's wheat condition of signaling and confirmation destination end as originating end and the first time signaling of destination end Confirm.
Illustrated using main broadcaster end as originating end, when main broadcaster end confirms that destination end meets even wheat condition, now main broadcaster End is still within " even in wheat calling " state, while company's wheat video preview window of targeted customer is exported in the user interface at main broadcaster end Mouthful, then connection signaling, which is sent, to destination end to allow destination end to export corresponding connection after the connection signaling is received confirms window Mouthful.It is an embodiment schematic diagram of the user interface that main broadcaster end is in " even in wheat calling " state as shown in Figure 3, wherein, big window Mouth 31 is the local video pictures of main broadcaster user, and lower right corner wicket 32 is the preview window that targeted customer connects wheat video, pre- Window of looking at exports " waiting to be subjected "/" Connecting " pictures, and also export in the preview window targeted customer's head portrait and The information such as user name.
Step S300:The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish and destination end Company wheat, and pull the second audio/video flow that destination end is transmitted.
Destination end exports corresponding connection acknowledgement window after the connection signaling of originating end transmission is received, and works as targeted customer Selection, which receives to connect, from connection acknowledgement window generates corresponding connection confirmation signaling and by server feedback to hair after wheat is invited Origin or beginning, the second audio/video flow that then originating end is transmitted from server pull destination end.Likewise, initiation is used as using main broadcaster end End illustrates, and main broadcaster end confirms to establish after receiving the connection and confirming signaling with the company wheat of destination end, now main broadcaster end Into " Lian Maizhong " state, and the second audio/video flow transmitted from server pull destination end.It is understood that work as target User from connection acknowledgement window even invite selection refusal by wheat, and the signaling that destination end then feeds back to main broadcaster end characterizes refusal even wheat, Now connect wheat stopping, main broadcaster terminates at end " even in wheat calling " state.It is that destination end is receiving the connection of originating end as shown in Figure 4 One embodiment schematic diagram of the connection acknowledgement window exported after signaling, when " Accept " in targeted customer's selection window 41 is pressed Button, destination end confirm signaling to establish the company wheat with originating end to originating end feedback link.It is main broadcaster end and target as shown in Figure 5 Even wheat confirms to establish at end, and main broadcaster end enters an embodiment schematic diagram of " Lian Maizhong " state, and now, main broadcaster end has pulled destination end The second video flowing after on main broadcaster end show, play, wherein wicket 51 is the second video flowing that main broadcaster end pulls destination end. Originating end, which sends connection signaling and receives connection, confirms that signaling confirms for second of signaling of originating end and destination end.
Confirmed by secondary signaling, efficiently solve originating end single and send invitation signaling and occur inviting signaling time-out nothing Response, and originating end has cancelled even wheat but has invited signaling to delay to reach destination end and after destination end is accepted the invitation to server push Send the abnormal conditions of the second audio/video flow.
Further, direct broadcasting room of the present invention connects in a kind of embodiment of wheat control method, in the originating end by invitation letter After order sends to server and is forwarded to destination end by server, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, and target is then determined when the invitation response characterizes and meets even wheat condition End meets even wheat condition;
Or, in the originating end after connection signaling is sent to destination end, the destination end of the reception server forwarding is sent Connection confirm signaling before, in addition to:
Receive connection replying for destination end transmission;
Or, after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull target When holding the second transmitted audio/video flow, in addition to:
Connection, which is sent, to destination end confirms response.
In the present embodiment, the signaling that originating end/destination end is sent repeats to send according to prefixed time interval, and is connecing Cancel repetition transmission signaling after receiving corresponding signaling response, the signaling response is true for receiving signaling direction transmission signaling side Recognize and have been received by corresponding signaling.For example, in originating end signaling will be invited to send to server and target is forwarded to by server After end, the invitation response of destination end is received, then determines that destination end meets when the invitation response characterizes and meets even wheat condition Even wheat condition performs subsequent step again, it is preferred that it is that destination end is receiving that destination end, which is made to the invitation signaling and invites response, To invite signaling after make automatically process, be for targeted customer it is transparent, i.e., will not be in the user interface of destination end Upper output, displaying receive the processing procedure invited signaling and response is invited to inviting signaling to make;Or in originating end to mesh After marking end transmission connection signaling, connection replying for destination end transmission is received, then performs subsequent step again;Or initiating to terminate After the connection confirmation signaling for receiving the destination end transmission of server forwarding, send connection to destination end and confirm response, now establish With the company wheat of destination end, and the second audio/video flow that destination end is transmitted is pulled.
Further, it is another embodiment schematic flow sheet that direct broadcasting room of the present invention connects wheat control method as shown in Figure 6, bag Include following steps:
Step S100:Connect wheat operation in response to Client-initiated, originating end will be invited signaling to send to server and be passed through Server is forwarded to destination end;
Step S200:When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to destination end The corresponding connection acknowledgement window of output;
Step S300:The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish and destination end Company wheat, and pull the second audio/video flow that destination end is transmitted;
And after the originating end will invite signaling to send to server and be forwarded to destination end by server, really Before the end satisfaction that sets the goal connects wheat condition, in addition to:
Step S101:Originating end receives the invitation response of destination end, when the invitation response, which characterizes, meets even wheat condition Then determine that destination end meets even wheat condition;
And in the originating end after connection signaling is sent to destination end, the destination end of the reception server forwarding is sent Connection confirm signaling before, in addition to:
Step S201:Receive connection replying for destination end transmission;
And after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull target When holding the second transmitted audio/video flow, in addition to:
Step S301:Connection, which is sent, to destination end confirms response.
In the present embodiment, likewise, the connection for invitation signaling, connection signaling and the destination end feedback that the originating end is sent Confirm that signaling repeats to send according to prefixed time interval, further, originating end is operated according to pre- in response to the company wheat of user If time interval is answered after receiving the invitation signaling to destination end transmission invitation signaling, and destination end to originating end feedback invitation Answer, after originating end receives the invitation response, cancel and send the invitation signaling according to prefixed time interval, it is preferred that Destination end is made to the invitation signaling invites response to be destination end to invite that makes after signaling to automatically process receiving, for It is transparent for targeted customer, i.e., will not be exported in the user interface of destination end, show to receive and invite signaling and to inviting Please signaling make invite response processing procedure;Originating end meets the invitation of even wheat condition in the sign for receiving destination end transmission After response, connection signaling is sent to destination end according to prefixed time interval, and until receiving connection replying for destination end feedback Afterwards, cancel and send the connection signaling according to prefixed time interval;Likewise, destination end " receives company in response to targeted customer Wheat " operates, and sending connection to originating end according to prefixed time interval confirms signaling, and when destination end receives originating end feedback After connection confirms response, cancel and send the connection confirmation signaling according to prefixed time interval.It is in the present embodiment as shown in Figure 7 Signaling and the transmission schematic diagram of response, wherein, the invitation signaling is PMicLinkInvite, and the invitation response is PMicLinkInviteAck, it is described connection signaling be PMicLinkInviteConfirm, it is described connection reply for PMicLinkInviteConfirmAck, the connection confirm that signaling is PMicLinkInviteRes, and the connection confirms response For PMicLinkInviteResAck.Originating end can all wait destination end phase to be received for the signaling sent each time to destination end The signaling response answered, meanwhile, originating end also makees corresponding signaling response to the signaling for receiving destination end transmission;It is likewise, right In destination end, can then be waited after also making corresponding signaling response after receiving the signaling of originating end and sending signaling to originating end The signaling response at main broadcaster end to be received.It is the first of originating end and destination end that originating end, which sends and invites signaling and receive invitation response, Secondary signaling confirms;The connection signaling response of connection signaling and reception destination end that originating end is sent to destination end is second of signaling Confirm;The connection that destination end is sent confirms that the connection of signaling and reception originating end confirms that response confirms for third time signaling;Pass through Multiple signaling confirms the abnormal conditions for solving caused by signaling delay reaches;Also, all signalings such as realize at the time-out to be answered It is then automatic to retransmit, receive response and then cancel repeating transmission, the reliability of the company of raising wheat, avoid signaling from delaying to reach or lose in transmitting procedure Lose the company's of causing wheat function and realize disorderly situation.
Further, embodiments of the invention also include even wheat termination step, and even wheat command for stopping can be by initiating user Destination end is sent to by originating end or originating end is sent to by destination end by targeted customer, specifically:
Termination in response to initiating user connects wheat operation, originating end to server send even wheat command for stopping with by the company Wheat command for stopping is forwarded to destination end, while terminates the second audio/video flow uploaded from server pull destination end;Or
Termination in response to targeted customer connects wheat operation, destination end to server send even wheat command for stopping with by the company Wheat command for stopping is forwarded to originating end, while terminates the second audio/video flow for uploading to server and locally gathering.
Specifically, the operation button of such as " company of termination wheat ", user are provided with the user interface of originating end and destination end After touch-control " terminate even wheat " button, originating end/destination end can the company's of generation wheat command for stopping and send it to server with by Server is forwarded to destination end/originating end, and the even wheat command for stopping is PMicLinkStop.Meanwhile initiated when initiating user After " company of termination wheat " operation, originating end stops the second audio/video flow transmitted from server pull destination end, works as targeted customer After initiating " company of termination wheat " operation, destination end stops uploading the second audio/video flow locally gathered to server.
Likewise, the company of the termination wheat instruction is sent according to prefixed time interval to opposite end, therefore
After destination end receives company's wheat command for stopping of originating end, even wheat termination is sent to main broadcaster end by server and answered Answer, after originating end receives the even wheat termination response, cancel and referring to according to prefixed time interval to destination end transmission even wheat termination Order;Or
After originating end receives company's wheat command for stopping of destination end, even wheat termination is sent to destination end by server and answered Answer, after destination end receives the even wheat termination response, cancel and referring to according to prefixed time interval to main broadcaster end transmission even wheat termination Order.It is PMicLinkStopAck that the even wheat, which terminates response,.
In embodiments of the present invention, the signaling and response of originating end and destination end are transmitted by server, and are taken Device be engaged in only for part signaling resolution therein and performs corresponding operation, specifically:
Server parses the body that the invitation signaling obtains targeted customer after the invitation signaling that the originating end received is sent Part information, and Lian Maimai positions are pre-allocated for targeted customer, while configure a timer, use for the Lian Maimai positions of the predistribution In even wheat time-out countdown, when the wheat position does not have targeted customer to confirm in use, discharging the Lian Maimai in count down time Position;In addition, server gives the Lian Maimai bit allocations of predistribution to the mesh after the confirmation connection signaling of destination end transmission is received User is marked, i.e., is added targeted customer in the direct broadcasting room channel of main broadcaster user, and all users into direct broadcasting room broadcast wheat position List and the information of wheat position state, after each terminal in direct broadcasting room receives the information, update local wheat and rank table and wheat Position state UI interfaces.
Further, in embodiments of the present invention, when there are the targeted customer for connecting wheat, when server is to preset Between be spaced into direct broadcasting room each terminal push wheat rank table and wheat position status information, when originating end and/or destination end receive When the status information and inconsistent local company's wheat state, local company's wheat status information is reported to server, server connects Receive originating end or destination end feedback local connect wheat status information after, the current wheat of renewal server ranks table and Mai Weizhuan State, at the same by originating end feed back local connect wheat information be transmitted to destination end or by destination end feed back local connect wheat information forwarding To originating end, handled so that originating end/destination end carries out correspondingly correction.For example, illustrated using main broadcaster end as originating end, Main broadcaster user terminates the company wheat with targeted customer, but company's wheat command for stopping does not reach server and just loses or be not forwarded to destination end With regard to losing, now, after the wheat that main broadcaster's termination receives server push ranks table and wheat position status information, find and local company Wheat state is inconsistent, and main broadcaster end actively reports local company's wheat status information, the current wheat of server update to server again Destination end is sent to after ranking table and wheat position status information, to allow destination end to terminate even wheat and stop uploading the second sound to server Video flowing, preferably reach each end and connect the synchronous effect of wheat.Preferably, when even wheat session be present, server is per 10s to each end Wheat of push ranks table and wheat position status information, it is ensured that and each end can maintain last state, when all even wheat conversation ends, clothes The wheat that business device is pushed ranks table and the time interval of wheat position status information enters double circulation, is spaced from 10s, 20s, 40s and passs 10s circulations are returned to after increasing to 80s, are effectively reduced server service pressure, while reduce each end flow consumption.
Further, in the embodiment of the present invention, even targeted customer can be by clicking on the Lian Maijiao for resurrecting/hiding during wheat Mutual UI, close/open local camera carry out pure audio/audio frequency and video switching, also, when the SOT state of termination of destination end changes When, destination end actively reports newest status information to server, so that the current wheat of server update ranks table and Mai Weizhuan State information, the SOT state of termination of the destination end, which changes, closes camera, the mesh of the second video flowing of collection including targeted customer User is marked by live software exchange to the states such as system background operation.
Second aspect, it is that the direct broadcasting room for connecting wheat control method using above-mentioned direct broadcasting room connects wheat pushing video streaming as shown in Figure 8 One embodiment schematic flow sheet of control method, in the present embodiment, using main broadcaster end as executive agent, comprise the following steps:
Step S1000:Even wheat operation is completed in response to main broadcaster end and destination end, main broadcaster end pulls at least one destination end Second audio/video flow;
Step S2000:Second audio/video flow is regarded with the first audio/video flow processing the 3rd sound of generation locally gathered Frequency flows;
Step S3000:To the 3rd audio/video flow described in server push to allow each viewer end in direct broadcasting room to pull described Show, play after three audio/video flows.
In the present embodiment, using above-mentioned company's wheat control method, after the company wheat that targeted customer receives main broadcaster user is invited, Server adds targeted customer in the live direct broadcasting room channel of main broadcaster user, specifically by the identity information of targeted customer (i.e. targeted customer ID) is added in direct broadcasting room channel, and when not connecting wheat session, direct broadcasting room channel only retains the identity letter of main broadcaster Cease (i.e. main broadcaster ID).In same direct broadcasting room channel, main broadcaster end mutually sends audio/video flow with destination end, specifically, main broadcaster end is drawn The first audio stream for taking the second audio/video flow of destination end and locally being gathered to server push, the first audio stream of synthesis, second The 3rd video flowing after the first video flowing of the 3rd audio stream after audio stream and synthesis, the second video flowing, destination end is to server The second audio/video flow locally gathered is pushed, and pulls first audio stream and the 3rd video flowing at main broadcaster end.Even target during wheat The company wheat that user can resurrect/hide by clicking on interacts UI, and close/open local camera carries out pure audio/audio frequency and video and cut Change, meet the needs of targeted customer protects individual privacy, now the image display window of the second video flowing is with the head of targeted customer As being shown.Each viewer end need to only pull display, broadcasting after the 3rd audio/video flow in direct broadcasting room, and destination end need to only pull 3rd video flowing and the first audio stream and then the preview window of itself in the 3rd video flowing is substituted for the of own local collection Show, play after two video flowings.For main broadcaster end, it is only necessary to the 3rd video flowing and two-way audio that push synthesizes all the way Stream, on the premise of ensureing that spectators user synchronously watches multiple even wheat sessions, the volume solution at main broadcaster end is reduced to greatest extent Code pressure, and between company of efficiently solving wheat multiterminal audio frequency and video interact delay issue with avoid destination end from locally playing itself Collection is sent to the audio stream at main broadcaster end.
Further, when multiple even wheat sessions be present, i.e., there is multiple targeted customers (such as targeted customer A in direct broadcasting room channel And targeted customer B) when, the second video flowing A, the second audio stream A that targeted customer A, B locally gather to server push respectively and Second video flowing B, the second audio stream B, main broadcaster end pull the second video flowing A, the second audio stream A and the second video flowing B, Two audio stream B, the second video flowing A, the second video flowing B and the first video flowing locally gathered are then synthesized into the 3rd video Stream, synthesizes the 3rd audio stream, then to service by the second audio stream A, the second audio stream B and the first audio stream locally gathered Device pushes the 3rd video flowing, the 3rd audio stream and first audio stream, and first audio stream is supplied with direct broadcasting room channel Targeted customer A and targeted customer B are pulled, will after targeted customer A pulls the 3rd video flowing, the second audio stream B and the first audio stream The preview window of itself is substituted for the second video flowing A of own local collection in 3rd video flowing;Likewise, targeted customer B is drawn After taking the 3rd video flowing, the second audio stream A and the first audio stream, the preview window of itself in the 3rd video flowing is substituted for itself The the second video flowing B locally gathered.
, only need to be from service when watching the live content of the direct broadcasting room for the not spectators user with main broadcaster user Lian Mai Pulled on device after the 3rd video flowing and the 3rd audio stream that main broadcaster end is pushed in local decoding, render after display, play.Such as figure It is the implementation that main broadcaster end synthesizes the 3rd video flowing that server is pushed to after the first video flowing and multiple second video flowings shown in 9 Illustrate and be intended to, the second video flowing A are represented wherein 91 represent the first video flowings, 92,93 represent the second videos B, in direct broadcasting room Spectators user only needs to pull the 3rd video flowing 90 and the 3rd audio stream of the push of main broadcaster end, reduces viewer end to Netowrk tape Wide requirement, and because viewer end only needs decoding audio/video flow all the way, reduce the decoding of spectators' end equipment, play pressure Power, and then equipment heating amount is reduced, reduce electric quantity consumption.
Further, the function modoularization thinking according to computer software, connects wheat control based on a kind of foregoing direct broadcasting room Method, the present invention also provide a kind of direct broadcasting room and connect wheat control device.Referring specifically to Figure 10, the device includes:
Invite module 100:For connecting wheat operation in response to Client-initiated, signaling will be invited to send to server and passed through Server is forwarded to destination end;
Link block 200:For when destination end meets even wheat condition, sending connection signaling to destination end to allow destination end The corresponding connection acknowledgement window of output;
Establish module 300:The connection that destination end for the reception server forwarding is sent confirms signaling to establish and target The company wheat at end, and pull the second audio/video flow that destination end is transmitted.
Invite module 100 to connect wheat operation in response to Client-initiated, signaling will be invited to send to server, made with main broadcaster end For originating end, now main broadcaster end enter " even in wheat calling " state and the wheat countdown of the company of progress with wait the receiving of targeted customer or Refusal even invite by wheat, and the invitation signaling carries unique session identification, wheat bit identification and targeted customer's identity information, server Parsing obtains targeted customer's identity information therein and pre-allocates wheat position for targeted customer after receiving the invitation signaling, then Signaling will be invited to be forwarded to destination end.After destination end receives the invitation signaling of server forwarding, the invitation signaling is made Corresponding feedback information is simultaneously sent to main broadcaster end, wherein, the feedback information encloses company's wheat conditional information of destination end, if mesh Mark end and meet even wheat condition, then feedback information carries the successful resCode for characterizing and meeting even wheat condition, otherwise the feedback information The resCode of concrete reason is carried, when link block 200 confirms that destination end meets even wheat condition, now main broadcaster end is still located In " even in wheat calling " state, while company's wheat the video preview window of targeted customer is exported in the user interface at main broadcaster end, then Connection signaling is sent to destination end to allow destination end to export corresponding connection acknowledgement window after the connection signaling is received.Target Hold and corresponding connection acknowledgement window is exported after the connection signaling of main broadcaster end transmission is received, when targeted customer confirms window from connection Selection, which receives to connect, in mouthful generates corresponding connection confirmation signaling and gives main broadcaster end by server feedback after wheat is invited, establish module The 300 company wheat with destination end after receiving the connection and confirming signaling confirms to establish, and now main broadcaster end enters " Lian Maizhong " shape State, and the second audio/video flow transmitted from server pull destination end.
Further, the function modoularization thinking according to computer software, connects wheat video based on a kind of foregoing direct broadcasting room Stream push control method, the present invention also provide a kind of direct broadcasting room and connect wheat pushing video streaming control device., should referring specifically to Figure 11 Device includes:
Even wheat module 1000:For completing even wheat operation in response to main broadcaster end and destination end, at least one destination end is pulled The second audio/video flow;
Generation module 2000:For by second audio/video flow and the first audio/video flow processing generation for locally gathering Three audio/video flows;
Pushing module 3000:For allowing each viewer end in direct broadcasting room to pull to the 3rd audio/video flow described in server push Show, play after 3rd audio/video flow.
Illustrated using main broadcaster end as originating end, using above-mentioned company's wheat control device, when targeted customer receives main broadcaster After the company wheat of user is invited, even wheat module 1000 completes even wheat operation in response to main broadcaster end and destination end, pulls at least one mesh Second audio/video flow at end is marked, the first sound that then generation module 2000 gathers second audio/video flow and main broadcaster end Video flow processing generates the 3rd audio/video flow, the first audio stream that pushing module 3000 locally gathers to server push, synthesis The 3rd video flowing after the first video flowing of the 3rd audio stream and synthesis, the second video flowing after first audio stream, the second audio stream, Each viewer end need to only pull display, broadcasting after the 3rd audio/video flow in direct broadcasting room, and destination end need to only pull the 3rd video flowing And first audio stream then by the preview window of itself in the 3rd video flowing be substituted for own local collection the second video flowing after Display, play.
It is another embodiment schematic diagram that direct broadcasting room of the present invention connects wheat pushing video streaming control device as shown in figure 12, it is described Even wheat module 1000 includes connecting the invitation module 100 of wheat control device, link block 200, establishes module 300, by inviting mould Block 100, link block 200, establish module 300 and establish the company wheat at main broadcaster end and destination end and pull destination end is transmitted second Audio/video flow.The first audio/video flow that generation module 2000 gathers second audio/video flow and main broadcaster end, which is handled, to be generated 3rd audio/video flow;The first audio stream that pushing module 3000 locally gathers to server push, the first audio stream of synthesis, second The 3rd video flowing after the first video flowing of the 3rd audio stream and synthesis, the second video flowing after audio stream supplies viewer end and destination end Pull.
The third aspect, the present invention also provide a kind of terminal device, including processor and memory, stored in the memory There is computer program, the computer program realizes following steps when being executed by processor:
Step S100:Connect wheat operation in response to Client-initiated, originating end will be invited signaling to send to server and be passed through Server is forwarded to destination end;
Step S200:When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to destination end The corresponding connection acknowledgement window of output;
Step S300:The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish and destination end Company wheat, and pull the second audio/video flow that destination end is transmitted.
Or
Step S1000:Even wheat operation is completed in response to main broadcaster end and destination end, main broadcaster end pulls at least one destination end Second audio/video flow;
Step S2000:Second audio/video flow is regarded with the first audio/video flow processing the 3rd sound of generation locally gathered Frequency flows;
Step S3000:To the 3rd audio/video flow described in server push to allow each viewer end in direct broadcasting room to pull described Show, play after three audio/video flows.
In the present invention, confirmed by secondary signaling, efficiently solve originating end single and send invitation signaling and invite Signaling time-out is unresponsive, and originating end has cancelled even wheat but invited signaling to delay to reach destination end and after destination end is accepted the invitation To the abnormal conditions of the audio/video flow of server push second.
Meanwhile originating end and destination end can all wait corresponding signaling response to be received for the signaling sent each time, and And all signalings are realized etc. that time-out to be answered is then automatic and retransmitted, and receive response and then cancel repeatings transmission, the reliability of the company of raising wheat, keep away Exempt from signaling and delay to reach or lose the disorderly situation of the company's of causing wheat function realization in transmitting procedure.Meanwhile based on originating end, service Device and the multiterminal of destination end, which are safeguarded, realizes that multiterminal connect wheat state and are consistent, and server only need to safeguard a wheat according to specific signaling Sequence table and wheat position state, reduce the complexity of code server and handle the pressure of signaling.
Also, based on what is synthesized all the way to server push after all audio/video flows in main broadcaster end integration direct broadcasting room channel The live even wheat scheme of multiterminal of audio/video flow, for main broadcaster end, it is only necessary to the 3rd video flowing and two that push synthesizes all the way Road audio stream, on the premise of ensureing that spectators user synchronously watches multiple even wheat sessions, main broadcaster end is reduced to greatest extent Encoding and decoding pressure, and between the company's of efficiently solving wheat multiterminal audio frequency and video interact delay issue and avoid destination end from locally broadcasting Put the audio stream that itself collection is sent to main broadcaster end;Viewer end only needs to pull the 3rd video flowing and the 3rd sound of the push of main broadcaster end Frequency flows, and reduces requirement of the viewer end to network bandwidth, and because viewer end only needs decoding audio/video flow all the way, reduce The decodings of spectators' end equipments, pressure is played, and then reduce equipment heating amount, reduce electric quantity consumption.
Although having been illustrated with some exemplary embodiments of the present invention above, those skilled in the art will manage Solution, in the case where not departing from the principle or spirit of the present invention, these exemplary embodiments can be made a change, it is of the invention Scope is limited by claim and its equivalent.

Claims (12)

1. a kind of direct broadcasting room connects wheat control method, it is characterised in that comprises the following steps:
Connect wheat operation in response to Client-initiated, originating end will invite signaling to send to server and be forwarded to mesh by server Mark end;
When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to export corresponding connection to destination end Acknowledgement window;
The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish the company wheat with destination end, and pulls The second audio/video flow that destination end is transmitted.
2. according to the method for claim 1, it is characterised in that in the originating end signaling will be invited to send to server simultaneously After destination end being forwarded to by server, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, then determines that destination end expires when the invitation response characterizes and meets even wheat condition Foot connects wheat condition;
Or, in the originating end after connection signaling is sent to destination end, the company of the destination end transmission of the reception server forwarding Connect before confirming signaling, in addition to:
Receive connection replying for destination end transmission;
Or, after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull destination end institute During the second audio/video flow of transmission, in addition to:
Connection, which is sent, to destination end confirms response.
3. according to the method for claim 1, it is characterised in that in the originating end signaling will be invited to send to server simultaneously After destination end being forwarded to by server, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, then determines that destination end expires when the invitation response characterizes and meets even wheat condition Foot connects wheat condition;
And in the originating end after connection signaling is sent to destination end, the company of the destination end transmission of the reception server forwarding Connect before confirming signaling, in addition to:
Receive connection replying for destination end transmission;
And after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull destination end institute During the second audio/video flow of transmission, in addition to:
Connection, which is sent, to destination end confirms response.
4. according to any described methods of claim 1-3, it is characterised in that the invitation signaling of the originating end transmission, connection The connection that signaling and destination end are sent confirms that signaling repeats to send according to prefixed time interval, and
After originating end receives the invitation response, cancel and send the invitation signaling according to prefixed time interval;Or
After originating end receives described connection reply, cancel and send the connection signaling according to prefixed time interval;Or
After destination end, which receives the connection, confirms response, cancel and send the connection confirmation letter according to prefixed time interval Order.
5. according to the method for claim 1, it is characterised in that the invitation signaling carry even wheat session unique mark, Wheat bit identification and targeted customer's identity information.
6. according to the method for claim 1, it is characterised in that the server receive it is described invitation signaling after, be Targeted customer pre-allocates Lian Maimai positions and obtains the identity information of targeted customer so that the invitation signaling is forwarded into destination end.
7. according to the method for claim 6, it is characterised in that the server is true in the connection for receiving destination end transmission After recognizing signaling, by the Lian Maimai bit allocations of the predistribution to targeted customer, and each end into direct broadcasting room is updated after the information of wheat position End push.
8. according to the method for claim 1, it is characterised in that methods described also includes:
Termination in response to initiating user connects wheat operation, originating end to server send even wheat command for stopping to allow server by institute The company's of stating wheat command for stopping is forwarded to destination end, and stops pulling the second audio/video flow that destination end is transmitted;Or
Termination in response to targeted customer connects wheat operation, destination end to server send even wheat command for stopping to allow server by institute The company's of stating wheat command for stopping is forwarded to originating end, and stops uploading the second audio/video flow to server.
9. according to the method for claim 8, it is characterised in that methods described also includes:
After destination end receives the even wheat command for stopping, even wheat is sent to originating end by server and terminates response, and eventually Only the second audio/video flow is uploaded to server;Or
After main broadcaster's termination receives the even wheat command for stopping, even wheat is sent to destination end by server and terminates response, and is stopped Only pull the second audio/video flow that destination end is transmitted.
10. according to the method for claim 1, it is characterised in that methods described also includes:
The originating end and/or destination end receive what the server was pushed with each terminal of the prefixed time interval into direct broadcasting room Wheat position information, wheat position information ranks table and wheat position status information including wheat, when originating end or destination end receive server When the wheat position information of push and inconsistent local company's wheat state, local company's wheat state is reported to allow server more to server New wheat position information is simultaneously forwarded to destination end or originating end.
11. a kind of direct broadcasting room connects wheat control device, it is characterised in that including:
Invite module:For connecting wheat operation in response to Client-initiated, signaling will be invited to send to server and pass through server It is forwarded to destination end;
Link block:For when destination end meets even wheat condition, sending connection signaling to destination end to allow destination end to export phase The connection acknowledgement window answered;
Establish module:The connection that destination end for the reception server forwarding is sent confirms signaling to establish the company with destination end Wheat, and pull the second audio/video flow that destination end is transmitted.
12. a kind of terminal device, including processor and memory, computer program is stored with the memory, its feature exists In realization is such as the step of claim 1-10 when the computer program is executed by processor.
CN201710390575.2A 2017-05-27 2017-05-27 Live broadcast room microphone connection control method and device and corresponding terminal equipment Active CN107342978B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710390575.2A CN107342978B (en) 2017-05-27 2017-05-27 Live broadcast room microphone connection control method and device and corresponding terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710390575.2A CN107342978B (en) 2017-05-27 2017-05-27 Live broadcast room microphone connection control method and device and corresponding terminal equipment

Publications (2)

Publication Number Publication Date
CN107342978A true CN107342978A (en) 2017-11-10
CN107342978B CN107342978B (en) 2020-12-22

Family

ID=60221131

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710390575.2A Active CN107342978B (en) 2017-05-27 2017-05-27 Live broadcast room microphone connection control method and device and corresponding terminal equipment

Country Status (1)

Country Link
CN (1) CN107342978B (en)

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107995501A (en) * 2017-12-18 2018-05-04 杭州雅顾科技有限公司 Video connects wheat method and system
CN108306942A (en) * 2018-01-09 2018-07-20 武汉斗鱼网络科技有限公司 Communication means, storage medium, electronic equipment and the system that multi-user is broadcast live simultaneously
CN108490947A (en) * 2018-04-17 2018-09-04 西安交通大学 One kind following barrier-avoiding method and its device automatically
CN108900919A (en) * 2018-06-29 2018-11-27 乐蜜有限公司 Company's wheat method, apparatus, server and terminal in a kind of live streaming
CN109257656A (en) * 2018-09-30 2019-01-22 武汉斗鱼网络科技有限公司 A kind of voice connects wheat method, apparatus, server and storage medium
CN109348238A (en) * 2018-09-30 2019-02-15 武汉斗鱼网络科技有限公司 A kind of voice in live streaming connects wheat method, apparatus, server and storage medium
CN109391851A (en) * 2018-01-09 2019-02-26 深圳市珍爱网信息技术有限公司 Net cast method, apparatus, computer equipment and storage medium
CN109511007A (en) * 2018-11-29 2019-03-22 广州市百果园信息技术有限公司 A kind of live network broadcast method, device, equipment and storage medium
CN109698963A (en) * 2018-12-29 2019-04-30 乐蜜有限公司 A kind of live broadcasting method, device, electronic equipment and readable storage medium storing program for executing
CN109756504A (en) * 2019-01-16 2019-05-14 武汉斗鱼鱼乐网络科技有限公司 A kind of communication means and relevant apparatus based on live streaming platform
CN109862382A (en) * 2019-02-25 2019-06-07 广州虎牙信息科技有限公司 Multi-person speech method, server and computer storage medium
CN110213061A (en) * 2019-05-23 2019-09-06 北京力拓飞远科技有限公司 Synchronized communication method, synchronized communication means, synchronous communication equipment and medium
CN110225375A (en) * 2018-03-01 2019-09-10 武汉斗鱼网络科技有限公司 A kind of direct broadcasting room connects wheat permission detection method, storage medium, equipment and system
CN110324655A (en) * 2019-08-05 2019-10-11 北京字节跳动网络技术有限公司 A kind of bus connection method, device, equipment and the storage medium of direct broadcasting room client
CN111372090A (en) * 2020-02-25 2020-07-03 北京达佳互联信息技术有限公司 Method and device for realizing wheat connection, electronic equipment and storage medium
CN111385666A (en) * 2020-03-04 2020-07-07 北京字节跳动网络技术有限公司 Communication link establishing method, device, equipment and storage medium
CN111918084A (en) * 2020-08-03 2020-11-10 北京达佳互联信息技术有限公司 Wheat loading method and device, server and terminal
CN112291316A (en) * 2020-10-19 2021-01-29 北京字节跳动网络技术有限公司 Connection processing method and device, electronic equipment and computer readable storage medium
CN112295233A (en) * 2019-08-02 2021-02-02 厦门雅基软件有限公司 Control right transfer method and system
CN113115114A (en) * 2021-03-02 2021-07-13 北京达佳互联信息技术有限公司 Interaction method, device, equipment and storage medium
CN113704280A (en) * 2021-08-26 2021-11-26 上海哔哩哔哩科技有限公司 Data list updating method and device
CN114430423A (en) * 2022-01-26 2022-05-03 百果园技术(新加坡)有限公司 Communication management method, device, equipment and storage medium between terminals
CN114710684A (en) * 2022-03-02 2022-07-05 百果园技术(新加坡)有限公司 Live broadcast room wheat connecting method, device, equipment and storage medium
WO2022252598A1 (en) * 2021-05-31 2022-12-08 北京达佳互联信息技术有限公司 Virtual space operation method and apparatus
CN115484468A (en) * 2021-06-15 2022-12-16 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
CN115484469A (en) * 2021-06-15 2022-12-16 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103384181A (en) * 2012-05-04 2013-11-06 华为技术有限公司 Data packet transmission method and device
CN103841353A (en) * 2014-02-24 2014-06-04 广州华多网络科技有限公司 Video interaction method, terminal, server and system
GB2527116A (en) * 2014-06-12 2015-12-16 Canon Kk Adaptative persistent push
CN105282803A (en) * 2014-07-25 2016-01-27 中兴通讯股份有限公司 Communication interface and information transfer method and system based on the same
US20160241678A1 (en) * 2010-06-15 2016-08-18 Netzyn, Inc. Hierarchical display-server system and method
CN106131583A (en) * 2016-06-30 2016-11-16 北京小米移动软件有限公司 A kind of live processing method, device, terminal unit and system
CN106303657A (en) * 2016-08-18 2017-01-04 北京奇虎科技有限公司 A kind of even method that wheat is live and main broadcaster's end equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160241678A1 (en) * 2010-06-15 2016-08-18 Netzyn, Inc. Hierarchical display-server system and method
CN103384181A (en) * 2012-05-04 2013-11-06 华为技术有限公司 Data packet transmission method and device
CN103841353A (en) * 2014-02-24 2014-06-04 广州华多网络科技有限公司 Video interaction method, terminal, server and system
GB2527116A (en) * 2014-06-12 2015-12-16 Canon Kk Adaptative persistent push
CN105282803A (en) * 2014-07-25 2016-01-27 中兴通讯股份有限公司 Communication interface and information transfer method and system based on the same
CN106131583A (en) * 2016-06-30 2016-11-16 北京小米移动软件有限公司 A kind of live processing method, device, terminal unit and system
CN106303657A (en) * 2016-08-18 2017-01-04 北京奇虎科技有限公司 A kind of even method that wheat is live and main broadcaster's end equipment

Cited By (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107995501A (en) * 2017-12-18 2018-05-04 杭州雅顾科技有限公司 Video connects wheat method and system
WO2019136845A1 (en) * 2018-01-09 2019-07-18 武汉斗鱼网络科技有限公司 Multiple user simultaneous live communication method, storage medium, electronic device, and system
CN108306942A (en) * 2018-01-09 2018-07-20 武汉斗鱼网络科技有限公司 Communication means, storage medium, electronic equipment and the system that multi-user is broadcast live simultaneously
CN109391851B (en) * 2018-01-09 2020-04-07 深圳市珍爱网信息技术有限公司 Video live broadcast method and device, computer equipment and storage medium
CN109391851A (en) * 2018-01-09 2019-02-26 深圳市珍爱网信息技术有限公司 Net cast method, apparatus, computer equipment and storage medium
CN110225375A (en) * 2018-03-01 2019-09-10 武汉斗鱼网络科技有限公司 A kind of direct broadcasting room connects wheat permission detection method, storage medium, equipment and system
CN108490947A (en) * 2018-04-17 2018-09-04 西安交通大学 One kind following barrier-avoiding method and its device automatically
CN108900919A (en) * 2018-06-29 2018-11-27 乐蜜有限公司 Company's wheat method, apparatus, server and terminal in a kind of live streaming
CN109348238A (en) * 2018-09-30 2019-02-15 武汉斗鱼网络科技有限公司 A kind of voice in live streaming connects wheat method, apparatus, server and storage medium
CN109257656A (en) * 2018-09-30 2019-01-22 武汉斗鱼网络科技有限公司 A kind of voice connects wheat method, apparatus, server and storage medium
CN109511007B (en) * 2018-11-29 2021-05-04 广州市百果园信息技术有限公司 Network live broadcast method, device, equipment and storage medium
CN109511007A (en) * 2018-11-29 2019-03-22 广州市百果园信息技术有限公司 A kind of live network broadcast method, device, equipment and storage medium
CN109698963A (en) * 2018-12-29 2019-04-30 乐蜜有限公司 A kind of live broadcasting method, device, electronic equipment and readable storage medium storing program for executing
CN109698963B (en) * 2018-12-29 2021-11-26 卓米私人有限公司 Live broadcast method and device, electronic equipment and readable storage medium
CN109756504A (en) * 2019-01-16 2019-05-14 武汉斗鱼鱼乐网络科技有限公司 A kind of communication means and relevant apparatus based on live streaming platform
CN109756504B (en) * 2019-01-16 2021-11-09 武汉斗鱼鱼乐网络科技有限公司 Communication method based on live broadcast platform and related device
CN109862382A (en) * 2019-02-25 2019-06-07 广州虎牙信息科技有限公司 Multi-person speech method, server and computer storage medium
CN110213061A (en) * 2019-05-23 2019-09-06 北京力拓飞远科技有限公司 Synchronized communication method, synchronized communication means, synchronous communication equipment and medium
CN110213061B (en) * 2019-05-23 2020-06-05 北京力拓飞远科技有限公司 Synchronous communication method, synchronous communication device, synchronous communication apparatus, and medium
CN112295233B (en) * 2019-08-02 2024-04-12 厦门雅基软件有限公司 Control right transferring method and system
CN112295233A (en) * 2019-08-02 2021-02-02 厦门雅基软件有限公司 Control right transfer method and system
CN110324655A (en) * 2019-08-05 2019-10-11 北京字节跳动网络技术有限公司 A kind of bus connection method, device, equipment and the storage medium of direct broadcasting room client
CN111372090B (en) * 2020-02-25 2022-09-09 北京达佳互联信息技术有限公司 Method and device for realizing wheat connection, electronic equipment and storage medium
CN111372090A (en) * 2020-02-25 2020-07-03 北京达佳互联信息技术有限公司 Method and device for realizing wheat connection, electronic equipment and storage medium
CN111385666A (en) * 2020-03-04 2020-07-07 北京字节跳动网络技术有限公司 Communication link establishing method, device, equipment and storage medium
CN111918084A (en) * 2020-08-03 2020-11-10 北京达佳互联信息技术有限公司 Wheat loading method and device, server and terminal
CN112291316A (en) * 2020-10-19 2021-01-29 北京字节跳动网络技术有限公司 Connection processing method and device, electronic equipment and computer readable storage medium
CN112291316B (en) * 2020-10-19 2022-03-15 北京字节跳动网络技术有限公司 Connection processing method and device, electronic equipment and computer readable storage medium
CN113115114B (en) * 2021-03-02 2022-12-27 北京达佳互联信息技术有限公司 Interaction method, device, equipment and storage medium
CN113115114A (en) * 2021-03-02 2021-07-13 北京达佳互联信息技术有限公司 Interaction method, device, equipment and storage medium
WO2022252598A1 (en) * 2021-05-31 2022-12-08 北京达佳互联信息技术有限公司 Virtual space operation method and apparatus
CN115484468A (en) * 2021-06-15 2022-12-16 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
CN115484469A (en) * 2021-06-15 2022-12-16 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
WO2022262676A1 (en) * 2021-06-15 2022-12-22 北京字节跳动网络技术有限公司 Linked microphone system, method, and apparatus, and device and storage medium
CN115484469B (en) * 2021-06-15 2024-01-09 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
CN115484468B (en) * 2021-06-15 2024-01-09 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
CN113704280A (en) * 2021-08-26 2021-11-26 上海哔哩哔哩科技有限公司 Data list updating method and device
CN114430423A (en) * 2022-01-26 2022-05-03 百果园技术(新加坡)有限公司 Communication management method, device, equipment and storage medium between terminals
CN114710684A (en) * 2022-03-02 2022-07-05 百果园技术(新加坡)有限公司 Live broadcast room wheat connecting method, device, equipment and storage medium
CN114710684B (en) * 2022-03-02 2023-11-17 百果园技术(新加坡)有限公司 Live broadcasting room wheat connecting method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN107342978B (en) 2020-12-22

Similar Documents

Publication Publication Date Title
CN107342978A (en) Direct broadcasting room connects wheat control method, device and corresponding terminal device
CN104941181B (en) A kind of method and apparatus for realizing real-time interactive of playing between different intelligent terminal
CN103517142B (en) A kind of interaction comment information processing method and system based on intelligent television
US8416278B2 (en) System and method for real-time conversational tele-education service based on video conferencing service
CN111385592A (en) Cross-room live broadcast connection method and device, storage medium and server
CN108696772B (en) Real-time video transmission method and device
CN107027048A (en) A kind of live even wheat and the method and device of information displaying
US20120246679A1 (en) Method and Apparatus for Initiating and Executing a Joint Viewing Session of a Programming Event
CN110943959A (en) Business processing method, cloud management platform, terminal and storage medium
CN105763832A (en) Video interaction and control method and device
US8392943B2 (en) Communications between networked cable services system devices
CN104954882A (en) Message sharing method and client
CN106331881B (en) A kind of method and system for assisting management net cast based on wechat
CN104580995A (en) Communication method and device of video conference
CN103428538A (en) Method, device and system for interaction of interactive broadcast televisions
KR100722704B1 (en) Group-wise video conferencing uses 3D-graphics model of broadcast event
CN102176713A (en) Method for realizing multiuser network video chat system for intensifying simplex video quality
CN112383832B (en) Live broadcast room interaction method, electronic equipment and computer readable storage medium
CN110475094A (en) Video conference processing method, device and readable storage medium storing program for executing
CN103856809A (en) Method, system and terminal equipment for multipoint at the same screen
WO2014177082A1 (en) Video conference video processing method and terminal
WO2014161265A1 (en) Method and device for implementing social service based on video sharing
CN113382269B (en) Live interview realization method, system, equipment and storage medium
CN111901537B (en) Broadcast television interactive program production mode based on cloud platform
CN102438119A (en) Audio/video communication system of digital television

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20221123

Address after: 31a, 15th floor, building 30, maple commercial city, bangrang Road, Brazil

Patentee after: Baiguoyuan Technology (Singapore) Co.,Ltd.

Address before: Building B-1, North District, Wanda Commercial Plaza, Wanbo business district, No. 79, Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Patentee before: GUANGZHOU BAIGUOYUAN INFORMATION TECHNOLOGY Co.,Ltd.

TR01 Transfer of patent right