CN107342978A - Direct broadcasting room connects wheat control method, device and corresponding terminal device - Google Patents
Direct broadcasting room connects wheat control method, device and corresponding terminal device Download PDFInfo
- Publication number
- CN107342978A CN107342978A CN201710390575.2A CN201710390575A CN107342978A CN 107342978 A CN107342978 A CN 107342978A CN 201710390575 A CN201710390575 A CN 201710390575A CN 107342978 A CN107342978 A CN 107342978A
- Authority
- CN
- China
- Prior art keywords
- wheat
- destination end
- signaling
- server
- destination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 241000209140 Triticum Species 0.000 title claims abstract description 296
- 235000021307 Triticum Nutrition 0.000 title claims abstract description 296
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000011664 signaling Effects 0.000 claims abstract description 192
- 230000004044 response Effects 0.000 claims abstract description 86
- 230000005540 biological transmission Effects 0.000 claims description 37
- 240000000233 Melia azedarach Species 0.000 claims description 16
- 230000000977 initiatory effect Effects 0.000 claims description 14
- 238000012790 confirmation Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 7
- 230000002159 abnormal effect Effects 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 10
- 230000015572 biosynthetic process Effects 0.000 description 6
- 238000003786 synthesis reaction Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 238000005111 flow chemistry technique Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000010438 heat treatment Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000004087 circulation Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
- H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
- H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
- H04L1/1812—Hybrid protocols; Hybrid automatic repeat request [HARQ]
- H04L1/1816—Hybrid protocols; Hybrid automatic repeat request [HARQ] with retransmission of the same, encoded, message
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1083—In-session procedures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/764—Media network packet handling at the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present invention relates to net cast field, and in particular to a kind of direct broadcasting room connects wheat control method, device and corresponding terminal device, and methods described includes step:Connect wheat operation in response to Client-initiated, originating end will invite signaling to send to server and be forwarded to destination end by server;When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to export corresponding connection acknowledgement window to destination end;The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish the company wheat with destination end, and pulls the second audio/video flow that destination end is transmitted.Confirmed by secondary signaling, originating end single is efficiently solved to send invitation signaling and occur inviting signaling time-out unresponsive, and originating end has cancelled even wheat but has invited signaling to delay to reach destination end and after destination end is accepted the invitation to the abnormal conditions of the audio/video flow of server push second.
Description
【Technical field】
The present invention relates to net cast field, and in particular to a kind of direct broadcasting room connects wheat control method, device and corresponding end
End equipment.
【Background technology】
With the development of Internet technology and intelligent mobile terminal equipment, various internet products are to the working of people, raw
Living to bring many convenient and amusement, in recent years, all kinds of live platforms for net cast emerge in an endless stream, and net cast gives people
Bring more real-time social experience.Wherein, company's wheat function in net cast has turned into very popular mutual in net cast
Flowing mode, even wheat refer to main broadcaster user during live with other users while carrying out live function.Connect building for wheat at present
It is vertical, exist due to unstable network and cause even wheat process signaling lose or delay to reach etc. abnormal conditions so as to the company of causing wheat
The problem of failure, even the reliability that is successfully established of wheat cannot be guaranteed, signaling lose or delay to reach can also cause main broadcaster user,
Even the terminal of wheat user and spectators user connect the problem of wheat state is inconsistent, have aggravated data receiver, the processing pressure of each terminal.
Also, in the scheme transmitted at present for Lian Maihou audio/video flow, General Visitors user terminal needs to pull main broadcaster's use simultaneously
Family and even wheat user at least two-way audio/video flow, can not ensure the synchronization of multichannel audio-video frequency stream well, and need to take more
More network bandwidth resources, increase the requirement to network bandwidth and aggravate end loads.
【The content of the invention】
The primary and foremost purpose of the present invention is that providing a kind of direct broadcasting room connects wheat control method and device;
Another object of the present invention is to provide a kind of computer program and phase realized direct broadcasting room and connect wheat control method for this
The terminal device answered.
To realize the purpose, the present invention adopts the following technical scheme that:
In a first aspect, one embodiment of the present of invention, which provides a kind of direct broadcasting room, connects wheat control method, comprise the following steps:
Connect wheat operation in response to Client-initiated, originating end will be invited signaling to send to server and be forwarded by server
To destination end;
When destination end meets even wheat condition, originating end sends connection signaling to make destination end output corresponding to destination end
Connect acknowledgement window;
The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish the company wheat with destination end, and
Pull the second audio/video flow that destination end is transmitted.
Further, the originating end will invite signaling send to server and by server be forwarded to destination end it
Afterwards, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, and destination end is determined when the invitation response characterizes and meets even wheat condition
Meet even wheat condition;
Or, in the originating end after connection signaling is sent to destination end, the destination end of the reception server forwarding is sent
Connection confirm signaling before, in addition to:
Receive connection replying for destination end transmission;
Or, after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull target
When holding the second transmitted audio/video flow, in addition to:
Connection, which is sent, to destination end confirms response.
Preferably, the originating end will invite signaling send to server and by server be forwarded to destination end it
Afterwards, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, and destination end is determined when the invitation response characterizes and meets even wheat condition
Meet even wheat condition;
And in the originating end after connection signaling is sent to destination end, the destination end of the reception server forwarding is sent
Connection confirm signaling before, in addition to:
Receive connection replying for destination end transmission;
And after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull target
When holding the second transmitted audio/video flow, in addition to:
Connection, which is sent, to destination end confirms response.
Further, the connection that invitation signaling, connection signaling and the destination end that the originating end is sent are sent confirms signaling
Repeat to send according to prefixed time interval, and
After originating end receives the invitation response, cancel and send the invitation signaling according to prefixed time interval;Or
After main broadcaster's termination receives described connection reply, cancel and send the connection signaling according to prefixed time interval;Or
After destination end, which receives the connection, confirms response, cancel and send the connection confirmation according to prefixed time interval
Signaling.
Specifically, the invitation signaling carries even wheat session unique mark, wheat bit identification and targeted customer's identity information.
Specifically, the server pre-allocates Lian Maimai positions for targeted customer and obtained after the invitation signaling is received
The identity information of targeted customer is taken so that the invitation signaling is forwarded into destination end.
Further, the server is after the connection for receiving destination end transmission confirms signaling, by the predistribution
Lian Maimai bit allocations update each terminal push into direct broadcasting room after the information of wheat position to targeted customer.
Further, methods described also includes:
Termination in response to initiating user connects wheat operation, originating end to server send even wheat command for stopping to allow server
The even wheat command for stopping is forwarded to destination end, and stops pulling the second audio/video flow that destination end is transmitted;Or
Termination in response to targeted customer connects wheat operation, destination end to server send even wheat command for stopping to allow server
The even wheat command for stopping is forwarded to originating end, and stops uploading the second audio/video flow to server.
It is preferred that methods described also includes:
After destination end receives the even wheat command for stopping, even wheat is sent to originating end by server and terminates response,
And terminate to server and upload the second audio/video flow;Or
After main broadcaster's termination receives the even wheat command for stopping, even wheat is sent to destination end by server and terminates response,
And stop pulling the second audio/video flow that destination end is transmitted.
Further, the originating end and/or destination end receive the server with prefixed time interval to direct broadcasting room
The wheat position information of interior each terminal push, wheat position information ranks table and wheat position status information including wheat, when originating end or mesh
When mark termination receives the wheat position information and inconsistent company's wheat state of local of server push, local company wheat is reported to server
State wheat position information described in server update and is forwarded to destination end or originating end to allow.
Second aspect, connect wheat control method applied to above-mentioned direct broadcasting room, the present invention, which also provides a kind of direct broadcasting room and connects wheat, to be regarded
Frequency stream push control method, comprises the following steps:
Even wheat operation, originating end, which are completed, in response to originating end and destination end pulls the second audio frequency and video of at least one destination end
Stream;
The first audio/video flow processing the 3rd sound of generation that originating end locally gathers second audio/video flow and originating end
Video flowing;
3rd audio/video flow described in originating end to server push is to allow each viewer end in direct broadcasting room to pull the 3rd sound
Show, play after video flowing.
Further, methods described also includes:
The first audio stream that originating end locally gathers to server push, after pulling first audio stream for destination end
Play.
Specifically, methods described also includes:
The destination end is after the 3rd video flowing described in server pull, the second video flowing for will being included in the 3rd video flowing
Display window be substituted for display after the second video flowing that destination end locally gathers, play.
Corresponding with first aspect, the present invention also provides a kind of direct broadcasting room and connects wheat control device, including:
Invite module:For connecting wheat operation in response to Client-initiated, signaling will be invited to send to server and pass through clothes
Business device is forwarded to destination end;
Link block:For when destination end meets even wheat condition, sending connection signaling to destination end to make destination end defeated
Go out corresponding connection acknowledgement window;
Establish module:The connection that destination end for the reception server forwarding is sent confirms signaling to establish and destination end
Lian Mai, and pull the second audio/video flow that destination end is transmitted.
Corresponding with second aspect, the present invention also provides a kind of direct broadcasting room and connects wheat pushing video streaming control device, including:
Even wheat module:For completing even wheat operation in response to originating end and destination end, the of at least one destination end is pulled
Two audio/video flows;
Generation module:The first audio/video flow for second audio/video flow and originating end locally to be gathered, which is handled, to be generated
3rd audio/video flow;
Pushing module:It is described for allowing in direct broadcasting room each viewer end to pull to the 3rd audio/video flow described in server push
Show, play after 3rd audio/video flow.
The third aspect, the present invention also provide a kind of terminal device, including processor and memory, stored in the memory
There is computer program, the computer program realizes above-mentioned first aspect or second aspect methods described when being executed by processor
Step.
Compared with prior art, the present invention possesses following advantage:
1st, confirmed by secondary signaling, efficiently solve originating end single and send invitation signaling and occur inviting signaling time-out
It is unresponsive, and originating end has cancelled even wheat but has invited signaling to delay to reach destination end and after destination end is accepted the invitation to server
Push the abnormal conditions of the second audio/video flow.
2nd, originating end and destination end, which are directed to the signaling sent each time, can all wait corresponding signaling response to be received, and institute
There is signaling to realize etc. that time-out to be answered is then automatic to retransmit, receive response and then cancel repeatings transmission, the reliability of the company of raising wheat, avoid letter
Make and delay to reach or lose the disorderly situation of the company's of causing wheat function realization in transmitting procedure.Meanwhile based on originating end, server and
The multiterminal of destination end, which are safeguarded, realizes that multiterminal connect wheat state and are consistent, and server only need to safeguard a wheat sequence according to specific signaling
Table and wheat position state, reduce the complexity of code server and handle the pressure of signaling.
3rd, the sound synthesized all the way to server push after all audio/video flows in direct broadcasting room channel is integrated based on main broadcaster end
The live even wheat scheme of multiterminal of video flowing, for main broadcaster end, it is only necessary to the 3rd video flowing and two-way that push synthesizes all the way
Audio stream, on the premise of ensureing that spectators user synchronously watches multiple even wheat sessions, main broadcaster end is reduced to greatest extent
Encoding and decoding pressure, and between the company's of efficiently solving wheat multiterminal audio frequency and video interact delay issue and avoid destination end locally play
Itself gathers the audio stream for being sent to main broadcaster end;Viewer end only needs to pull the 3rd video flowing and the 3rd audio of the push of main broadcaster end
Stream, requirement of the viewer end to network bandwidth is reduced, and because viewer end only needs decoding audio/video flow all the way, reduced
The decoding of spectators' end equipment, pressure is played, and then reduce equipment heating amount, reduce electric quantity consumption.
Obviously, the above-mentioned description about advantage of the present invention is recapitulative, it is more the advantages of description will be embodied in it is follow-up
During embodiment discloses, and, the content that those skilled in the art can also be disclosed reasonably finds its of the present invention
His plurality of advantages.
The additional aspect of the present invention and advantage will be set forth in part in the description, and these will become from the following description
Obtain substantially, or recognized by the practice of the present invention.
【Brief description of the drawings】
Fig. 1 is the embodiment schematic flow sheet that direct broadcasting room of the present invention connects wheat control method;
Fig. 2 is the user interface schematic diagram that main broadcaster end initiates when even wheat is invited in the present invention;
Fig. 3 is the user interface schematic diagram that main broadcaster end is in " even in wheat calling " state in the present invention;
Fig. 4 is the signal for the connection acknowledgement window that the destination end of the present invention exports after the connection signaling of originating end is received
Figure;
Fig. 5 is the user interface schematic diagram that main broadcaster end is in " Lian Maizhong " state in the present invention;
Fig. 6 is another embodiment schematic flow sheet that direct broadcasting room of the present invention connects wheat control method;
Fig. 7 is the signaling of the embodiment of the present invention and the transmission schematic diagram of signaling response;
Fig. 8 direct broadcasting rooms of the present invention connect an embodiment schematic flow sheet of wheat pushing video streaming control method;
Fig. 9 is the schematic diagram that the main broadcaster end of the present invention is pushed to the 3rd video flowing of server;
Figure 10 is the embodiment schematic diagram that direct broadcasting room of the present invention connects wheat control device;
Figure 11 is the embodiment schematic diagram that direct broadcasting room of the present invention connects wheat pushing video streaming control device;
Figure 12 is another embodiment schematic diagram that direct broadcasting room of the present invention connects wheat pushing video streaming control device.
【Embodiment】
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, is only used for explaining the present invention, and is not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art
Language and scientific terminology), there is the general understanding identical meaning with the those of ordinary skill in art of the present invention.Should also
Understand, those terms defined in such as general dictionary, it should be understood that have with the context of prior art
The consistent meaning of meaning, and unless by specific definitions as here, idealization or the implication of overly formal otherwise will not be used
To explain.
In embodiments of the present invention, the originating end, destination end are the user terminal in direct broadcasting room, can be direct broadcasting rooms
The main broadcaster end of interior main broadcaster user or the viewer end of spectators user, when even wheat operation is initiated at main broadcaster end, main broadcaster end now is
It is destination end for originating end, corresponding target audience user, when viewer end initiates even wheat operation, viewer end now is
Destination end, corresponding main broadcaster end are destination end.In following embodiments, initiation is used as using main broadcaster end unless otherwise specified
End, it will be understood by those skilled in the art that can also be realized using viewer end as originating end.
In a first aspect, be the embodiment schematic flow sheet that direct broadcasting room of the present invention connects wheat control method as shown in Figure 1, including
Following steps:
Step S100:Connect wheat operation in response to Client-initiated, originating end will be invited signaling to send to server and be passed through
Server is forwarded to destination end.
Even wheat function is that the important channel of direct broadcasting room atmosphere is enlivened in current live events, and even wheat function allows live by propagating
Mode change is the interactive social patterns of equality, preferably draws in the distance between main broadcaster and spectators, passes through even wheat, spectators user
The image and sound of oneself can be shared with main broadcaster while live, interactive on the same stage and into direct broadcasting room other spectators.
In the present embodiment, the even wheat operation is initiated using main broadcaster end as originating end to destination end.Specifically, user initiates
Connect a kind of embodiment of wheat operation, the button that the company of initiation wheat is invited is configured with the user interface at main broadcaster end, main broadcaster user exists
Such as " even wheat " button is clicked on main broadcaster's end subscriber interface, ejects corresponding user list, settable user need to meet certain bar
Part could enter the list, and a certain user is then chosen in the user list and initiates even wheat operation as targeted customer;This reality
The another embodiment of the company of initiation wheat operation in example is applied, main broadcaster user is entered by the user list in direct broadcasting room, public screen message
Mouth opens the data card of wherein certain user, and the button of the company's of initiation wheat invitation, main broadcaster user are provided with the data card of user
By clicking on such as button of " even wheat " on card, using the user as targeted customer and the wheat operation of the company of initiation.It is appreciated that
It is, if the company of the initiation wheat operation using viewer end as originating end, is correspondingly provided with such as " application in the user interface of viewer end
Even wheat " button, spectators user clicks on can also initiate even wheat operation to main broadcaster end.
Originating end connects wheat operation in response to Client-initiated, and signaling will be invited to send to server, still made with main broadcaster end
Illustrated for originating end.Main broadcaster end will be invited signaling to send to server, now led in response to company's wheat operation of main broadcaster user
Broadcast that end enters " even wheat calling in " state and the wheat countdown of company of progress is to wait the even wheat invitation of the receiving of targeted customer or refusal.Its
In, the invitation signaling carries unique session identification, wheat bit identification and targeted customer's identity information, unique session identification
It is the unique session-id (sessionId) that main broadcaster end connects wheat session distribution for each, the signaling for destination end identifies, target
End only handles session identification identical signaling, avoids interfering between different sessions;The wheat bit identification is that wheat is ranked on table
Wheat position sequence number, when server receive and parse it is described invitation signaling after, for targeted customer pre-allocate wheat position for target use
Family subsequently uses;Targeted customer's identity information is targeted customer ID;Server is parsed and obtained after receiving the invitation signaling
Take targeted customer's identity information therein and pre-allocate wheat position for targeted customer, then signaling will be invited to be forwarded to destination end.Such as
It is an embodiment schematic diagram of the user interface at main broadcaster end shown in Fig. 2, main broadcaster user clicks on " even wheat " button pointed by arrow
21, initiate even wheat to targeted customer and invite, main broadcaster end, will after the company's wheat operation initiated in response to main broadcaster user to targeted customer
Signaling is invited to send to server and be transmitted to destination end by server.
Step S200:When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to destination end
The corresponding connection acknowledgement window of output.
After destination end receives the invitation signaling of server forwarding, corresponding feedback information is made simultaneously to the invitation signaling
Main broadcaster end is sent to, wherein, company's wheat conditional information of destination end is included in the feedback information, if destination end meets even wheat bar
Part, then feedback information, which carries, characterizes the successful resCode that satisfaction connects wheat condition, and otherwise the feedback information carries concrete reason
resCode.Originating end, which is sent, invites company's wheat condition of signaling and confirmation destination end as originating end and the first time signaling of destination end
Confirm.
Illustrated using main broadcaster end as originating end, when main broadcaster end confirms that destination end meets even wheat condition, now main broadcaster
End is still within " even in wheat calling " state, while company's wheat video preview window of targeted customer is exported in the user interface at main broadcaster end
Mouthful, then connection signaling, which is sent, to destination end to allow destination end to export corresponding connection after the connection signaling is received confirms window
Mouthful.It is an embodiment schematic diagram of the user interface that main broadcaster end is in " even in wheat calling " state as shown in Figure 3, wherein, big window
Mouth 31 is the local video pictures of main broadcaster user, and lower right corner wicket 32 is the preview window that targeted customer connects wheat video, pre-
Window of looking at exports " waiting to be subjected "/" Connecting " pictures, and also export in the preview window targeted customer's head portrait and
The information such as user name.
Step S300:The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish and destination end
Company wheat, and pull the second audio/video flow that destination end is transmitted.
Destination end exports corresponding connection acknowledgement window after the connection signaling of originating end transmission is received, and works as targeted customer
Selection, which receives to connect, from connection acknowledgement window generates corresponding connection confirmation signaling and by server feedback to hair after wheat is invited
Origin or beginning, the second audio/video flow that then originating end is transmitted from server pull destination end.Likewise, initiation is used as using main broadcaster end
End illustrates, and main broadcaster end confirms to establish after receiving the connection and confirming signaling with the company wheat of destination end, now main broadcaster end
Into " Lian Maizhong " state, and the second audio/video flow transmitted from server pull destination end.It is understood that work as target
User from connection acknowledgement window even invite selection refusal by wheat, and the signaling that destination end then feeds back to main broadcaster end characterizes refusal even wheat,
Now connect wheat stopping, main broadcaster terminates at end " even in wheat calling " state.It is that destination end is receiving the connection of originating end as shown in Figure 4
One embodiment schematic diagram of the connection acknowledgement window exported after signaling, when " Accept " in targeted customer's selection window 41 is pressed
Button, destination end confirm signaling to establish the company wheat with originating end to originating end feedback link.It is main broadcaster end and target as shown in Figure 5
Even wheat confirms to establish at end, and main broadcaster end enters an embodiment schematic diagram of " Lian Maizhong " state, and now, main broadcaster end has pulled destination end
The second video flowing after on main broadcaster end show, play, wherein wicket 51 is the second video flowing that main broadcaster end pulls destination end.
Originating end, which sends connection signaling and receives connection, confirms that signaling confirms for second of signaling of originating end and destination end.
Confirmed by secondary signaling, efficiently solve originating end single and send invitation signaling and occur inviting signaling time-out nothing
Response, and originating end has cancelled even wheat but has invited signaling to delay to reach destination end and after destination end is accepted the invitation to server push
Send the abnormal conditions of the second audio/video flow.
Further, direct broadcasting room of the present invention connects in a kind of embodiment of wheat control method, in the originating end by invitation letter
After order sends to server and is forwarded to destination end by server, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, and target is then determined when the invitation response characterizes and meets even wheat condition
End meets even wheat condition;
Or, in the originating end after connection signaling is sent to destination end, the destination end of the reception server forwarding is sent
Connection confirm signaling before, in addition to:
Receive connection replying for destination end transmission;
Or, after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull target
When holding the second transmitted audio/video flow, in addition to:
Connection, which is sent, to destination end confirms response.
In the present embodiment, the signaling that originating end/destination end is sent repeats to send according to prefixed time interval, and is connecing
Cancel repetition transmission signaling after receiving corresponding signaling response, the signaling response is true for receiving signaling direction transmission signaling side
Recognize and have been received by corresponding signaling.For example, in originating end signaling will be invited to send to server and target is forwarded to by server
After end, the invitation response of destination end is received, then determines that destination end meets when the invitation response characterizes and meets even wheat condition
Even wheat condition performs subsequent step again, it is preferred that it is that destination end is receiving that destination end, which is made to the invitation signaling and invites response,
To invite signaling after make automatically process, be for targeted customer it is transparent, i.e., will not be in the user interface of destination end
Upper output, displaying receive the processing procedure invited signaling and response is invited to inviting signaling to make;Or in originating end to mesh
After marking end transmission connection signaling, connection replying for destination end transmission is received, then performs subsequent step again;Or initiating to terminate
After the connection confirmation signaling for receiving the destination end transmission of server forwarding, send connection to destination end and confirm response, now establish
With the company wheat of destination end, and the second audio/video flow that destination end is transmitted is pulled.
Further, it is another embodiment schematic flow sheet that direct broadcasting room of the present invention connects wheat control method as shown in Figure 6, bag
Include following steps:
Step S100:Connect wheat operation in response to Client-initiated, originating end will be invited signaling to send to server and be passed through
Server is forwarded to destination end;
Step S200:When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to destination end
The corresponding connection acknowledgement window of output;
Step S300:The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish and destination end
Company wheat, and pull the second audio/video flow that destination end is transmitted;
And after the originating end will invite signaling to send to server and be forwarded to destination end by server, really
Before the end satisfaction that sets the goal connects wheat condition, in addition to:
Step S101:Originating end receives the invitation response of destination end, when the invitation response, which characterizes, meets even wheat condition
Then determine that destination end meets even wheat condition;
And in the originating end after connection signaling is sent to destination end, the destination end of the reception server forwarding is sent
Connection confirm signaling before, in addition to:
Step S201:Receive connection replying for destination end transmission;
And after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull target
When holding the second transmitted audio/video flow, in addition to:
Step S301:Connection, which is sent, to destination end confirms response.
In the present embodiment, likewise, the connection for invitation signaling, connection signaling and the destination end feedback that the originating end is sent
Confirm that signaling repeats to send according to prefixed time interval, further, originating end is operated according to pre- in response to the company wheat of user
If time interval is answered after receiving the invitation signaling to destination end transmission invitation signaling, and destination end to originating end feedback invitation
Answer, after originating end receives the invitation response, cancel and send the invitation signaling according to prefixed time interval, it is preferred that
Destination end is made to the invitation signaling invites response to be destination end to invite that makes after signaling to automatically process receiving, for
It is transparent for targeted customer, i.e., will not be exported in the user interface of destination end, show to receive and invite signaling and to inviting
Please signaling make invite response processing procedure;Originating end meets the invitation of even wheat condition in the sign for receiving destination end transmission
After response, connection signaling is sent to destination end according to prefixed time interval, and until receiving connection replying for destination end feedback
Afterwards, cancel and send the connection signaling according to prefixed time interval;Likewise, destination end " receives company in response to targeted customer
Wheat " operates, and sending connection to originating end according to prefixed time interval confirms signaling, and when destination end receives originating end feedback
After connection confirms response, cancel and send the connection confirmation signaling according to prefixed time interval.It is in the present embodiment as shown in Figure 7
Signaling and the transmission schematic diagram of response, wherein, the invitation signaling is PMicLinkInvite, and the invitation response is
PMicLinkInviteAck, it is described connection signaling be PMicLinkInviteConfirm, it is described connection reply for
PMicLinkInviteConfirmAck, the connection confirm that signaling is PMicLinkInviteRes, and the connection confirms response
For PMicLinkInviteResAck.Originating end can all wait destination end phase to be received for the signaling sent each time to destination end
The signaling response answered, meanwhile, originating end also makees corresponding signaling response to the signaling for receiving destination end transmission;It is likewise, right
In destination end, can then be waited after also making corresponding signaling response after receiving the signaling of originating end and sending signaling to originating end
The signaling response at main broadcaster end to be received.It is the first of originating end and destination end that originating end, which sends and invites signaling and receive invitation response,
Secondary signaling confirms;The connection signaling response of connection signaling and reception destination end that originating end is sent to destination end is second of signaling
Confirm;The connection that destination end is sent confirms that the connection of signaling and reception originating end confirms that response confirms for third time signaling;Pass through
Multiple signaling confirms the abnormal conditions for solving caused by signaling delay reaches;Also, all signalings such as realize at the time-out to be answered
It is then automatic to retransmit, receive response and then cancel repeating transmission, the reliability of the company of raising wheat, avoid signaling from delaying to reach or lose in transmitting procedure
Lose the company's of causing wheat function and realize disorderly situation.
Further, embodiments of the invention also include even wheat termination step, and even wheat command for stopping can be by initiating user
Destination end is sent to by originating end or originating end is sent to by destination end by targeted customer, specifically:
Termination in response to initiating user connects wheat operation, originating end to server send even wheat command for stopping with by the company
Wheat command for stopping is forwarded to destination end, while terminates the second audio/video flow uploaded from server pull destination end;Or
Termination in response to targeted customer connects wheat operation, destination end to server send even wheat command for stopping with by the company
Wheat command for stopping is forwarded to originating end, while terminates the second audio/video flow for uploading to server and locally gathering.
Specifically, the operation button of such as " company of termination wheat ", user are provided with the user interface of originating end and destination end
After touch-control " terminate even wheat " button, originating end/destination end can the company's of generation wheat command for stopping and send it to server with by
Server is forwarded to destination end/originating end, and the even wheat command for stopping is PMicLinkStop.Meanwhile initiated when initiating user
After " company of termination wheat " operation, originating end stops the second audio/video flow transmitted from server pull destination end, works as targeted customer
After initiating " company of termination wheat " operation, destination end stops uploading the second audio/video flow locally gathered to server.
Likewise, the company of the termination wheat instruction is sent according to prefixed time interval to opposite end, therefore
After destination end receives company's wheat command for stopping of originating end, even wheat termination is sent to main broadcaster end by server and answered
Answer, after originating end receives the even wheat termination response, cancel and referring to according to prefixed time interval to destination end transmission even wheat termination
Order;Or
After originating end receives company's wheat command for stopping of destination end, even wheat termination is sent to destination end by server and answered
Answer, after destination end receives the even wheat termination response, cancel and referring to according to prefixed time interval to main broadcaster end transmission even wheat termination
Order.It is PMicLinkStopAck that the even wheat, which terminates response,.
In embodiments of the present invention, the signaling and response of originating end and destination end are transmitted by server, and are taken
Device be engaged in only for part signaling resolution therein and performs corresponding operation, specifically:
Server parses the body that the invitation signaling obtains targeted customer after the invitation signaling that the originating end received is sent
Part information, and Lian Maimai positions are pre-allocated for targeted customer, while configure a timer, use for the Lian Maimai positions of the predistribution
In even wheat time-out countdown, when the wheat position does not have targeted customer to confirm in use, discharging the Lian Maimai in count down time
Position;In addition, server gives the Lian Maimai bit allocations of predistribution to the mesh after the confirmation connection signaling of destination end transmission is received
User is marked, i.e., is added targeted customer in the direct broadcasting room channel of main broadcaster user, and all users into direct broadcasting room broadcast wheat position
List and the information of wheat position state, after each terminal in direct broadcasting room receives the information, update local wheat and rank table and wheat
Position state UI interfaces.
Further, in embodiments of the present invention, when there are the targeted customer for connecting wheat, when server is to preset
Between be spaced into direct broadcasting room each terminal push wheat rank table and wheat position status information, when originating end and/or destination end receive
When the status information and inconsistent local company's wheat state, local company's wheat status information is reported to server, server connects
Receive originating end or destination end feedback local connect wheat status information after, the current wheat of renewal server ranks table and Mai Weizhuan
State, at the same by originating end feed back local connect wheat information be transmitted to destination end or by destination end feed back local connect wheat information forwarding
To originating end, handled so that originating end/destination end carries out correspondingly correction.For example, illustrated using main broadcaster end as originating end,
Main broadcaster user terminates the company wheat with targeted customer, but company's wheat command for stopping does not reach server and just loses or be not forwarded to destination end
With regard to losing, now, after the wheat that main broadcaster's termination receives server push ranks table and wheat position status information, find and local company
Wheat state is inconsistent, and main broadcaster end actively reports local company's wheat status information, the current wheat of server update to server again
Destination end is sent to after ranking table and wheat position status information, to allow destination end to terminate even wheat and stop uploading the second sound to server
Video flowing, preferably reach each end and connect the synchronous effect of wheat.Preferably, when even wheat session be present, server is per 10s to each end
Wheat of push ranks table and wheat position status information, it is ensured that and each end can maintain last state, when all even wheat conversation ends, clothes
The wheat that business device is pushed ranks table and the time interval of wheat position status information enters double circulation, is spaced from 10s, 20s, 40s and passs
10s circulations are returned to after increasing to 80s, are effectively reduced server service pressure, while reduce each end flow consumption.
Further, in the embodiment of the present invention, even targeted customer can be by clicking on the Lian Maijiao for resurrecting/hiding during wheat
Mutual UI, close/open local camera carry out pure audio/audio frequency and video switching, also, when the SOT state of termination of destination end changes
When, destination end actively reports newest status information to server, so that the current wheat of server update ranks table and Mai Weizhuan
State information, the SOT state of termination of the destination end, which changes, closes camera, the mesh of the second video flowing of collection including targeted customer
User is marked by live software exchange to the states such as system background operation.
Second aspect, it is that the direct broadcasting room for connecting wheat control method using above-mentioned direct broadcasting room connects wheat pushing video streaming as shown in Figure 8
One embodiment schematic flow sheet of control method, in the present embodiment, using main broadcaster end as executive agent, comprise the following steps:
Step S1000:Even wheat operation is completed in response to main broadcaster end and destination end, main broadcaster end pulls at least one destination end
Second audio/video flow;
Step S2000:Second audio/video flow is regarded with the first audio/video flow processing the 3rd sound of generation locally gathered
Frequency flows;
Step S3000:To the 3rd audio/video flow described in server push to allow each viewer end in direct broadcasting room to pull described
Show, play after three audio/video flows.
In the present embodiment, using above-mentioned company's wheat control method, after the company wheat that targeted customer receives main broadcaster user is invited,
Server adds targeted customer in the live direct broadcasting room channel of main broadcaster user, specifically by the identity information of targeted customer
(i.e. targeted customer ID) is added in direct broadcasting room channel, and when not connecting wheat session, direct broadcasting room channel only retains the identity letter of main broadcaster
Cease (i.e. main broadcaster ID).In same direct broadcasting room channel, main broadcaster end mutually sends audio/video flow with destination end, specifically, main broadcaster end is drawn
The first audio stream for taking the second audio/video flow of destination end and locally being gathered to server push, the first audio stream of synthesis, second
The 3rd video flowing after the first video flowing of the 3rd audio stream after audio stream and synthesis, the second video flowing, destination end is to server
The second audio/video flow locally gathered is pushed, and pulls first audio stream and the 3rd video flowing at main broadcaster end.Even target during wheat
The company wheat that user can resurrect/hide by clicking on interacts UI, and close/open local camera carries out pure audio/audio frequency and video and cut
Change, meet the needs of targeted customer protects individual privacy, now the image display window of the second video flowing is with the head of targeted customer
As being shown.Each viewer end need to only pull display, broadcasting after the 3rd audio/video flow in direct broadcasting room, and destination end need to only pull
3rd video flowing and the first audio stream and then the preview window of itself in the 3rd video flowing is substituted for the of own local collection
Show, play after two video flowings.For main broadcaster end, it is only necessary to the 3rd video flowing and two-way audio that push synthesizes all the way
Stream, on the premise of ensureing that spectators user synchronously watches multiple even wheat sessions, the volume solution at main broadcaster end is reduced to greatest extent
Code pressure, and between company of efficiently solving wheat multiterminal audio frequency and video interact delay issue with avoid destination end from locally playing itself
Collection is sent to the audio stream at main broadcaster end.
Further, when multiple even wheat sessions be present, i.e., there is multiple targeted customers (such as targeted customer A in direct broadcasting room channel
And targeted customer B) when, the second video flowing A, the second audio stream A that targeted customer A, B locally gather to server push respectively and
Second video flowing B, the second audio stream B, main broadcaster end pull the second video flowing A, the second audio stream A and the second video flowing B,
Two audio stream B, the second video flowing A, the second video flowing B and the first video flowing locally gathered are then synthesized into the 3rd video
Stream, synthesizes the 3rd audio stream, then to service by the second audio stream A, the second audio stream B and the first audio stream locally gathered
Device pushes the 3rd video flowing, the 3rd audio stream and first audio stream, and first audio stream is supplied with direct broadcasting room channel
Targeted customer A and targeted customer B are pulled, will after targeted customer A pulls the 3rd video flowing, the second audio stream B and the first audio stream
The preview window of itself is substituted for the second video flowing A of own local collection in 3rd video flowing;Likewise, targeted customer B is drawn
After taking the 3rd video flowing, the second audio stream A and the first audio stream, the preview window of itself in the 3rd video flowing is substituted for itself
The the second video flowing B locally gathered.
, only need to be from service when watching the live content of the direct broadcasting room for the not spectators user with main broadcaster user Lian Mai
Pulled on device after the 3rd video flowing and the 3rd audio stream that main broadcaster end is pushed in local decoding, render after display, play.Such as figure
It is the implementation that main broadcaster end synthesizes the 3rd video flowing that server is pushed to after the first video flowing and multiple second video flowings shown in 9
Illustrate and be intended to, the second video flowing A are represented wherein 91 represent the first video flowings, 92,93 represent the second videos B, in direct broadcasting room
Spectators user only needs to pull the 3rd video flowing 90 and the 3rd audio stream of the push of main broadcaster end, reduces viewer end to Netowrk tape
Wide requirement, and because viewer end only needs decoding audio/video flow all the way, reduce the decoding of spectators' end equipment, play pressure
Power, and then equipment heating amount is reduced, reduce electric quantity consumption.
Further, the function modoularization thinking according to computer software, connects wheat control based on a kind of foregoing direct broadcasting room
Method, the present invention also provide a kind of direct broadcasting room and connect wheat control device.Referring specifically to Figure 10, the device includes:
Invite module 100:For connecting wheat operation in response to Client-initiated, signaling will be invited to send to server and passed through
Server is forwarded to destination end;
Link block 200:For when destination end meets even wheat condition, sending connection signaling to destination end to allow destination end
The corresponding connection acknowledgement window of output;
Establish module 300:The connection that destination end for the reception server forwarding is sent confirms signaling to establish and target
The company wheat at end, and pull the second audio/video flow that destination end is transmitted.
Invite module 100 to connect wheat operation in response to Client-initiated, signaling will be invited to send to server, made with main broadcaster end
For originating end, now main broadcaster end enter " even in wheat calling " state and the wheat countdown of the company of progress with wait the receiving of targeted customer or
Refusal even invite by wheat, and the invitation signaling carries unique session identification, wheat bit identification and targeted customer's identity information, server
Parsing obtains targeted customer's identity information therein and pre-allocates wheat position for targeted customer after receiving the invitation signaling, then
Signaling will be invited to be forwarded to destination end.After destination end receives the invitation signaling of server forwarding, the invitation signaling is made
Corresponding feedback information is simultaneously sent to main broadcaster end, wherein, the feedback information encloses company's wheat conditional information of destination end, if mesh
Mark end and meet even wheat condition, then feedback information carries the successful resCode for characterizing and meeting even wheat condition, otherwise the feedback information
The resCode of concrete reason is carried, when link block 200 confirms that destination end meets even wheat condition, now main broadcaster end is still located
In " even in wheat calling " state, while company's wheat the video preview window of targeted customer is exported in the user interface at main broadcaster end, then
Connection signaling is sent to destination end to allow destination end to export corresponding connection acknowledgement window after the connection signaling is received.Target
Hold and corresponding connection acknowledgement window is exported after the connection signaling of main broadcaster end transmission is received, when targeted customer confirms window from connection
Selection, which receives to connect, in mouthful generates corresponding connection confirmation signaling and gives main broadcaster end by server feedback after wheat is invited, establish module
The 300 company wheat with destination end after receiving the connection and confirming signaling confirms to establish, and now main broadcaster end enters " Lian Maizhong " shape
State, and the second audio/video flow transmitted from server pull destination end.
Further, the function modoularization thinking according to computer software, connects wheat video based on a kind of foregoing direct broadcasting room
Stream push control method, the present invention also provide a kind of direct broadcasting room and connect wheat pushing video streaming control device., should referring specifically to Figure 11
Device includes:
Even wheat module 1000:For completing even wheat operation in response to main broadcaster end and destination end, at least one destination end is pulled
The second audio/video flow;
Generation module 2000:For by second audio/video flow and the first audio/video flow processing generation for locally gathering
Three audio/video flows;
Pushing module 3000:For allowing each viewer end in direct broadcasting room to pull to the 3rd audio/video flow described in server push
Show, play after 3rd audio/video flow.
Illustrated using main broadcaster end as originating end, using above-mentioned company's wheat control device, when targeted customer receives main broadcaster
After the company wheat of user is invited, even wheat module 1000 completes even wheat operation in response to main broadcaster end and destination end, pulls at least one mesh
Second audio/video flow at end is marked, the first sound that then generation module 2000 gathers second audio/video flow and main broadcaster end
Video flow processing generates the 3rd audio/video flow, the first audio stream that pushing module 3000 locally gathers to server push, synthesis
The 3rd video flowing after the first video flowing of the 3rd audio stream and synthesis, the second video flowing after first audio stream, the second audio stream,
Each viewer end need to only pull display, broadcasting after the 3rd audio/video flow in direct broadcasting room, and destination end need to only pull the 3rd video flowing
And first audio stream then by the preview window of itself in the 3rd video flowing be substituted for own local collection the second video flowing after
Display, play.
It is another embodiment schematic diagram that direct broadcasting room of the present invention connects wheat pushing video streaming control device as shown in figure 12, it is described
Even wheat module 1000 includes connecting the invitation module 100 of wheat control device, link block 200, establishes module 300, by inviting mould
Block 100, link block 200, establish module 300 and establish the company wheat at main broadcaster end and destination end and pull destination end is transmitted second
Audio/video flow.The first audio/video flow that generation module 2000 gathers second audio/video flow and main broadcaster end, which is handled, to be generated
3rd audio/video flow;The first audio stream that pushing module 3000 locally gathers to server push, the first audio stream of synthesis, second
The 3rd video flowing after the first video flowing of the 3rd audio stream and synthesis, the second video flowing after audio stream supplies viewer end and destination end
Pull.
The third aspect, the present invention also provide a kind of terminal device, including processor and memory, stored in the memory
There is computer program, the computer program realizes following steps when being executed by processor:
Step S100:Connect wheat operation in response to Client-initiated, originating end will be invited signaling to send to server and be passed through
Server is forwarded to destination end;
Step S200:When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to destination end
The corresponding connection acknowledgement window of output;
Step S300:The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish and destination end
Company wheat, and pull the second audio/video flow that destination end is transmitted.
Or
Step S1000:Even wheat operation is completed in response to main broadcaster end and destination end, main broadcaster end pulls at least one destination end
Second audio/video flow;
Step S2000:Second audio/video flow is regarded with the first audio/video flow processing the 3rd sound of generation locally gathered
Frequency flows;
Step S3000:To the 3rd audio/video flow described in server push to allow each viewer end in direct broadcasting room to pull described
Show, play after three audio/video flows.
In the present invention, confirmed by secondary signaling, efficiently solve originating end single and send invitation signaling and invite
Signaling time-out is unresponsive, and originating end has cancelled even wheat but invited signaling to delay to reach destination end and after destination end is accepted the invitation
To the abnormal conditions of the audio/video flow of server push second.
Meanwhile originating end and destination end can all wait corresponding signaling response to be received for the signaling sent each time, and
And all signalings are realized etc. that time-out to be answered is then automatic and retransmitted, and receive response and then cancel repeatings transmission, the reliability of the company of raising wheat, keep away
Exempt from signaling and delay to reach or lose the disorderly situation of the company's of causing wheat function realization in transmitting procedure.Meanwhile based on originating end, service
Device and the multiterminal of destination end, which are safeguarded, realizes that multiterminal connect wheat state and are consistent, and server only need to safeguard a wheat according to specific signaling
Sequence table and wheat position state, reduce the complexity of code server and handle the pressure of signaling.
Also, based on what is synthesized all the way to server push after all audio/video flows in main broadcaster end integration direct broadcasting room channel
The live even wheat scheme of multiterminal of audio/video flow, for main broadcaster end, it is only necessary to the 3rd video flowing and two that push synthesizes all the way
Road audio stream, on the premise of ensureing that spectators user synchronously watches multiple even wheat sessions, main broadcaster end is reduced to greatest extent
Encoding and decoding pressure, and between the company's of efficiently solving wheat multiterminal audio frequency and video interact delay issue and avoid destination end from locally broadcasting
Put the audio stream that itself collection is sent to main broadcaster end;Viewer end only needs to pull the 3rd video flowing and the 3rd sound of the push of main broadcaster end
Frequency flows, and reduces requirement of the viewer end to network bandwidth, and because viewer end only needs decoding audio/video flow all the way, reduce
The decodings of spectators' end equipments, pressure is played, and then reduce equipment heating amount, reduce electric quantity consumption.
Although having been illustrated with some exemplary embodiments of the present invention above, those skilled in the art will manage
Solution, in the case where not departing from the principle or spirit of the present invention, these exemplary embodiments can be made a change, it is of the invention
Scope is limited by claim and its equivalent.
Claims (12)
1. a kind of direct broadcasting room connects wheat control method, it is characterised in that comprises the following steps:
Connect wheat operation in response to Client-initiated, originating end will invite signaling to send to server and be forwarded to mesh by server
Mark end;
When destination end meets even wheat condition, originating end sends connection signaling to allow destination end to export corresponding connection to destination end
Acknowledgement window;
The connection that the destination end of originating end the reception server forwarding is sent confirms signaling to establish the company wheat with destination end, and pulls
The second audio/video flow that destination end is transmitted.
2. according to the method for claim 1, it is characterised in that in the originating end signaling will be invited to send to server simultaneously
After destination end being forwarded to by server, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, then determines that destination end expires when the invitation response characterizes and meets even wheat condition
Foot connects wheat condition;
Or, in the originating end after connection signaling is sent to destination end, the company of the destination end transmission of the reception server forwarding
Connect before confirming signaling, in addition to:
Receive connection replying for destination end transmission;
Or, after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull destination end institute
During the second audio/video flow of transmission, in addition to:
Connection, which is sent, to destination end confirms response.
3. according to the method for claim 1, it is characterised in that in the originating end signaling will be invited to send to server simultaneously
After destination end being forwarded to by server, before determining that destination end meets even wheat condition, in addition to:
Originating end receives the invitation response of destination end, then determines that destination end expires when the invitation response characterizes and meets even wheat condition
Foot connects wheat condition;
And in the originating end after connection signaling is sent to destination end, the company of the destination end transmission of the reception server forwarding
Connect before confirming signaling, in addition to:
Receive connection replying for destination end transmission;
And after the connection of the destination end transmission in originating end the reception server forwarding confirms signaling, pull destination end institute
During the second audio/video flow of transmission, in addition to:
Connection, which is sent, to destination end confirms response.
4. according to any described methods of claim 1-3, it is characterised in that the invitation signaling of the originating end transmission, connection
The connection that signaling and destination end are sent confirms that signaling repeats to send according to prefixed time interval, and
After originating end receives the invitation response, cancel and send the invitation signaling according to prefixed time interval;Or
After originating end receives described connection reply, cancel and send the connection signaling according to prefixed time interval;Or
After destination end, which receives the connection, confirms response, cancel and send the connection confirmation letter according to prefixed time interval
Order.
5. according to the method for claim 1, it is characterised in that the invitation signaling carry even wheat session unique mark,
Wheat bit identification and targeted customer's identity information.
6. according to the method for claim 1, it is characterised in that the server receive it is described invitation signaling after, be
Targeted customer pre-allocates Lian Maimai positions and obtains the identity information of targeted customer so that the invitation signaling is forwarded into destination end.
7. according to the method for claim 6, it is characterised in that the server is true in the connection for receiving destination end transmission
After recognizing signaling, by the Lian Maimai bit allocations of the predistribution to targeted customer, and each end into direct broadcasting room is updated after the information of wheat position
End push.
8. according to the method for claim 1, it is characterised in that methods described also includes:
Termination in response to initiating user connects wheat operation, originating end to server send even wheat command for stopping to allow server by institute
The company's of stating wheat command for stopping is forwarded to destination end, and stops pulling the second audio/video flow that destination end is transmitted;Or
Termination in response to targeted customer connects wheat operation, destination end to server send even wheat command for stopping to allow server by institute
The company's of stating wheat command for stopping is forwarded to originating end, and stops uploading the second audio/video flow to server.
9. according to the method for claim 8, it is characterised in that methods described also includes:
After destination end receives the even wheat command for stopping, even wheat is sent to originating end by server and terminates response, and eventually
Only the second audio/video flow is uploaded to server;Or
After main broadcaster's termination receives the even wheat command for stopping, even wheat is sent to destination end by server and terminates response, and is stopped
Only pull the second audio/video flow that destination end is transmitted.
10. according to the method for claim 1, it is characterised in that methods described also includes:
The originating end and/or destination end receive what the server was pushed with each terminal of the prefixed time interval into direct broadcasting room
Wheat position information, wheat position information ranks table and wheat position status information including wheat, when originating end or destination end receive server
When the wheat position information of push and inconsistent local company's wheat state, local company's wheat state is reported to allow server more to server
New wheat position information is simultaneously forwarded to destination end or originating end.
11. a kind of direct broadcasting room connects wheat control device, it is characterised in that including:
Invite module:For connecting wheat operation in response to Client-initiated, signaling will be invited to send to server and pass through server
It is forwarded to destination end;
Link block:For when destination end meets even wheat condition, sending connection signaling to destination end to allow destination end to export phase
The connection acknowledgement window answered;
Establish module:The connection that destination end for the reception server forwarding is sent confirms signaling to establish the company with destination end
Wheat, and pull the second audio/video flow that destination end is transmitted.
12. a kind of terminal device, including processor and memory, computer program is stored with the memory, its feature exists
In realization is such as the step of claim 1-10 when the computer program is executed by processor.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710390575.2A CN107342978B (en) | 2017-05-27 | 2017-05-27 | Live broadcast room microphone connection control method and device and corresponding terminal equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710390575.2A CN107342978B (en) | 2017-05-27 | 2017-05-27 | Live broadcast room microphone connection control method and device and corresponding terminal equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107342978A true CN107342978A (en) | 2017-11-10 |
CN107342978B CN107342978B (en) | 2020-12-22 |
Family
ID=60221131
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710390575.2A Active CN107342978B (en) | 2017-05-27 | 2017-05-27 | Live broadcast room microphone connection control method and device and corresponding terminal equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107342978B (en) |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107995501A (en) * | 2017-12-18 | 2018-05-04 | 杭州雅顾科技有限公司 | Video connects wheat method and system |
CN108306942A (en) * | 2018-01-09 | 2018-07-20 | 武汉斗鱼网络科技有限公司 | Communication means, storage medium, electronic equipment and the system that multi-user is broadcast live simultaneously |
CN108490947A (en) * | 2018-04-17 | 2018-09-04 | 西安交通大学 | One kind following barrier-avoiding method and its device automatically |
CN108900919A (en) * | 2018-06-29 | 2018-11-27 | 乐蜜有限公司 | Company's wheat method, apparatus, server and terminal in a kind of live streaming |
CN109257656A (en) * | 2018-09-30 | 2019-01-22 | 武汉斗鱼网络科技有限公司 | A kind of voice connects wheat method, apparatus, server and storage medium |
CN109348238A (en) * | 2018-09-30 | 2019-02-15 | 武汉斗鱼网络科技有限公司 | A kind of voice in live streaming connects wheat method, apparatus, server and storage medium |
CN109391851A (en) * | 2018-01-09 | 2019-02-26 | 深圳市珍爱网信息技术有限公司 | Net cast method, apparatus, computer equipment and storage medium |
CN109511007A (en) * | 2018-11-29 | 2019-03-22 | 广州市百果园信息技术有限公司 | A kind of live network broadcast method, device, equipment and storage medium |
CN109698963A (en) * | 2018-12-29 | 2019-04-30 | 乐蜜有限公司 | A kind of live broadcasting method, device, electronic equipment and readable storage medium storing program for executing |
CN109756504A (en) * | 2019-01-16 | 2019-05-14 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of communication means and relevant apparatus based on live streaming platform |
CN109862382A (en) * | 2019-02-25 | 2019-06-07 | 广州虎牙信息科技有限公司 | Multi-person speech method, server and computer storage medium |
CN110213061A (en) * | 2019-05-23 | 2019-09-06 | 北京力拓飞远科技有限公司 | Synchronized communication method, synchronized communication means, synchronous communication equipment and medium |
CN110225375A (en) * | 2018-03-01 | 2019-09-10 | 武汉斗鱼网络科技有限公司 | A kind of direct broadcasting room connects wheat permission detection method, storage medium, equipment and system |
CN110324655A (en) * | 2019-08-05 | 2019-10-11 | 北京字节跳动网络技术有限公司 | A kind of bus connection method, device, equipment and the storage medium of direct broadcasting room client |
CN111372090A (en) * | 2020-02-25 | 2020-07-03 | 北京达佳互联信息技术有限公司 | Method and device for realizing wheat connection, electronic equipment and storage medium |
CN111385666A (en) * | 2020-03-04 | 2020-07-07 | 北京字节跳动网络技术有限公司 | Communication link establishing method, device, equipment and storage medium |
CN111918084A (en) * | 2020-08-03 | 2020-11-10 | 北京达佳互联信息技术有限公司 | Wheat loading method and device, server and terminal |
CN112291316A (en) * | 2020-10-19 | 2021-01-29 | 北京字节跳动网络技术有限公司 | Connection processing method and device, electronic equipment and computer readable storage medium |
CN112295233A (en) * | 2019-08-02 | 2021-02-02 | 厦门雅基软件有限公司 | Control right transfer method and system |
CN113115114A (en) * | 2021-03-02 | 2021-07-13 | 北京达佳互联信息技术有限公司 | Interaction method, device, equipment and storage medium |
CN113704280A (en) * | 2021-08-26 | 2021-11-26 | 上海哔哩哔哩科技有限公司 | Data list updating method and device |
CN114430423A (en) * | 2022-01-26 | 2022-05-03 | 百果园技术(新加坡)有限公司 | Communication management method, device, equipment and storage medium between terminals |
CN114710684A (en) * | 2022-03-02 | 2022-07-05 | 百果园技术(新加坡)有限公司 | Live broadcast room wheat connecting method, device, equipment and storage medium |
WO2022252598A1 (en) * | 2021-05-31 | 2022-12-08 | 北京达佳互联信息技术有限公司 | Virtual space operation method and apparatus |
CN115484468A (en) * | 2021-06-15 | 2022-12-16 | 北京字节跳动网络技术有限公司 | Wheat connecting system, method, device, equipment and storage medium |
CN115484469A (en) * | 2021-06-15 | 2022-12-16 | 北京字节跳动网络技术有限公司 | Wheat connecting system, method, device, equipment and storage medium |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103384181A (en) * | 2012-05-04 | 2013-11-06 | 华为技术有限公司 | Data packet transmission method and device |
CN103841353A (en) * | 2014-02-24 | 2014-06-04 | 广州华多网络科技有限公司 | Video interaction method, terminal, server and system |
GB2527116A (en) * | 2014-06-12 | 2015-12-16 | Canon Kk | Adaptative persistent push |
CN105282803A (en) * | 2014-07-25 | 2016-01-27 | 中兴通讯股份有限公司 | Communication interface and information transfer method and system based on the same |
US20160241678A1 (en) * | 2010-06-15 | 2016-08-18 | Netzyn, Inc. | Hierarchical display-server system and method |
CN106131583A (en) * | 2016-06-30 | 2016-11-16 | 北京小米移动软件有限公司 | A kind of live processing method, device, terminal unit and system |
CN106303657A (en) * | 2016-08-18 | 2017-01-04 | 北京奇虎科技有限公司 | A kind of even method that wheat is live and main broadcaster's end equipment |
-
2017
- 2017-05-27 CN CN201710390575.2A patent/CN107342978B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160241678A1 (en) * | 2010-06-15 | 2016-08-18 | Netzyn, Inc. | Hierarchical display-server system and method |
CN103384181A (en) * | 2012-05-04 | 2013-11-06 | 华为技术有限公司 | Data packet transmission method and device |
CN103841353A (en) * | 2014-02-24 | 2014-06-04 | 广州华多网络科技有限公司 | Video interaction method, terminal, server and system |
GB2527116A (en) * | 2014-06-12 | 2015-12-16 | Canon Kk | Adaptative persistent push |
CN105282803A (en) * | 2014-07-25 | 2016-01-27 | 中兴通讯股份有限公司 | Communication interface and information transfer method and system based on the same |
CN106131583A (en) * | 2016-06-30 | 2016-11-16 | 北京小米移动软件有限公司 | A kind of live processing method, device, terminal unit and system |
CN106303657A (en) * | 2016-08-18 | 2017-01-04 | 北京奇虎科技有限公司 | A kind of even method that wheat is live and main broadcaster's end equipment |
Cited By (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107995501A (en) * | 2017-12-18 | 2018-05-04 | 杭州雅顾科技有限公司 | Video connects wheat method and system |
WO2019136845A1 (en) * | 2018-01-09 | 2019-07-18 | 武汉斗鱼网络科技有限公司 | Multiple user simultaneous live communication method, storage medium, electronic device, and system |
CN108306942A (en) * | 2018-01-09 | 2018-07-20 | 武汉斗鱼网络科技有限公司 | Communication means, storage medium, electronic equipment and the system that multi-user is broadcast live simultaneously |
CN109391851B (en) * | 2018-01-09 | 2020-04-07 | 深圳市珍爱网信息技术有限公司 | Video live broadcast method and device, computer equipment and storage medium |
CN109391851A (en) * | 2018-01-09 | 2019-02-26 | 深圳市珍爱网信息技术有限公司 | Net cast method, apparatus, computer equipment and storage medium |
CN110225375A (en) * | 2018-03-01 | 2019-09-10 | 武汉斗鱼网络科技有限公司 | A kind of direct broadcasting room connects wheat permission detection method, storage medium, equipment and system |
CN108490947A (en) * | 2018-04-17 | 2018-09-04 | 西安交通大学 | One kind following barrier-avoiding method and its device automatically |
CN108900919A (en) * | 2018-06-29 | 2018-11-27 | 乐蜜有限公司 | Company's wheat method, apparatus, server and terminal in a kind of live streaming |
CN109348238A (en) * | 2018-09-30 | 2019-02-15 | 武汉斗鱼网络科技有限公司 | A kind of voice in live streaming connects wheat method, apparatus, server and storage medium |
CN109257656A (en) * | 2018-09-30 | 2019-01-22 | 武汉斗鱼网络科技有限公司 | A kind of voice connects wheat method, apparatus, server and storage medium |
CN109511007B (en) * | 2018-11-29 | 2021-05-04 | 广州市百果园信息技术有限公司 | Network live broadcast method, device, equipment and storage medium |
CN109511007A (en) * | 2018-11-29 | 2019-03-22 | 广州市百果园信息技术有限公司 | A kind of live network broadcast method, device, equipment and storage medium |
CN109698963A (en) * | 2018-12-29 | 2019-04-30 | 乐蜜有限公司 | A kind of live broadcasting method, device, electronic equipment and readable storage medium storing program for executing |
CN109698963B (en) * | 2018-12-29 | 2021-11-26 | 卓米私人有限公司 | Live broadcast method and device, electronic equipment and readable storage medium |
CN109756504A (en) * | 2019-01-16 | 2019-05-14 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of communication means and relevant apparatus based on live streaming platform |
CN109756504B (en) * | 2019-01-16 | 2021-11-09 | 武汉斗鱼鱼乐网络科技有限公司 | Communication method based on live broadcast platform and related device |
CN109862382A (en) * | 2019-02-25 | 2019-06-07 | 广州虎牙信息科技有限公司 | Multi-person speech method, server and computer storage medium |
CN110213061A (en) * | 2019-05-23 | 2019-09-06 | 北京力拓飞远科技有限公司 | Synchronized communication method, synchronized communication means, synchronous communication equipment and medium |
CN110213061B (en) * | 2019-05-23 | 2020-06-05 | 北京力拓飞远科技有限公司 | Synchronous communication method, synchronous communication device, synchronous communication apparatus, and medium |
CN112295233B (en) * | 2019-08-02 | 2024-04-12 | 厦门雅基软件有限公司 | Control right transferring method and system |
CN112295233A (en) * | 2019-08-02 | 2021-02-02 | 厦门雅基软件有限公司 | Control right transfer method and system |
CN110324655A (en) * | 2019-08-05 | 2019-10-11 | 北京字节跳动网络技术有限公司 | A kind of bus connection method, device, equipment and the storage medium of direct broadcasting room client |
CN111372090B (en) * | 2020-02-25 | 2022-09-09 | 北京达佳互联信息技术有限公司 | Method and device for realizing wheat connection, electronic equipment and storage medium |
CN111372090A (en) * | 2020-02-25 | 2020-07-03 | 北京达佳互联信息技术有限公司 | Method and device for realizing wheat connection, electronic equipment and storage medium |
CN111385666A (en) * | 2020-03-04 | 2020-07-07 | 北京字节跳动网络技术有限公司 | Communication link establishing method, device, equipment and storage medium |
CN111918084A (en) * | 2020-08-03 | 2020-11-10 | 北京达佳互联信息技术有限公司 | Wheat loading method and device, server and terminal |
CN112291316A (en) * | 2020-10-19 | 2021-01-29 | 北京字节跳动网络技术有限公司 | Connection processing method and device, electronic equipment and computer readable storage medium |
CN112291316B (en) * | 2020-10-19 | 2022-03-15 | 北京字节跳动网络技术有限公司 | Connection processing method and device, electronic equipment and computer readable storage medium |
CN113115114B (en) * | 2021-03-02 | 2022-12-27 | 北京达佳互联信息技术有限公司 | Interaction method, device, equipment and storage medium |
CN113115114A (en) * | 2021-03-02 | 2021-07-13 | 北京达佳互联信息技术有限公司 | Interaction method, device, equipment and storage medium |
WO2022252598A1 (en) * | 2021-05-31 | 2022-12-08 | 北京达佳互联信息技术有限公司 | Virtual space operation method and apparatus |
CN115484468A (en) * | 2021-06-15 | 2022-12-16 | 北京字节跳动网络技术有限公司 | Wheat connecting system, method, device, equipment and storage medium |
CN115484469A (en) * | 2021-06-15 | 2022-12-16 | 北京字节跳动网络技术有限公司 | Wheat connecting system, method, device, equipment and storage medium |
WO2022262676A1 (en) * | 2021-06-15 | 2022-12-22 | 北京字节跳动网络技术有限公司 | Linked microphone system, method, and apparatus, and device and storage medium |
CN115484469B (en) * | 2021-06-15 | 2024-01-09 | 北京字节跳动网络技术有限公司 | Wheat connecting system, method, device, equipment and storage medium |
CN115484468B (en) * | 2021-06-15 | 2024-01-09 | 北京字节跳动网络技术有限公司 | Wheat connecting system, method, device, equipment and storage medium |
CN113704280A (en) * | 2021-08-26 | 2021-11-26 | 上海哔哩哔哩科技有限公司 | Data list updating method and device |
CN114430423A (en) * | 2022-01-26 | 2022-05-03 | 百果园技术(新加坡)有限公司 | Communication management method, device, equipment and storage medium between terminals |
CN114710684A (en) * | 2022-03-02 | 2022-07-05 | 百果园技术(新加坡)有限公司 | Live broadcast room wheat connecting method, device, equipment and storage medium |
CN114710684B (en) * | 2022-03-02 | 2023-11-17 | 百果园技术(新加坡)有限公司 | Live broadcasting room wheat connecting method, device, equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN107342978B (en) | 2020-12-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107342978A (en) | Direct broadcasting room connects wheat control method, device and corresponding terminal device | |
CN104941181B (en) | A kind of method and apparatus for realizing real-time interactive of playing between different intelligent terminal | |
CN103517142B (en) | A kind of interaction comment information processing method and system based on intelligent television | |
US8416278B2 (en) | System and method for real-time conversational tele-education service based on video conferencing service | |
CN111385592A (en) | Cross-room live broadcast connection method and device, storage medium and server | |
CN108696772B (en) | Real-time video transmission method and device | |
CN107027048A (en) | A kind of live even wheat and the method and device of information displaying | |
US20120246679A1 (en) | Method and Apparatus for Initiating and Executing a Joint Viewing Session of a Programming Event | |
CN110943959A (en) | Business processing method, cloud management platform, terminal and storage medium | |
CN105763832A (en) | Video interaction and control method and device | |
US8392943B2 (en) | Communications between networked cable services system devices | |
CN104954882A (en) | Message sharing method and client | |
CN106331881B (en) | A kind of method and system for assisting management net cast based on wechat | |
CN104580995A (en) | Communication method and device of video conference | |
CN103428538A (en) | Method, device and system for interaction of interactive broadcast televisions | |
KR100722704B1 (en) | Group-wise video conferencing uses 3D-graphics model of broadcast event | |
CN102176713A (en) | Method for realizing multiuser network video chat system for intensifying simplex video quality | |
CN112383832B (en) | Live broadcast room interaction method, electronic equipment and computer readable storage medium | |
CN110475094A (en) | Video conference processing method, device and readable storage medium storing program for executing | |
CN103856809A (en) | Method, system and terminal equipment for multipoint at the same screen | |
WO2014177082A1 (en) | Video conference video processing method and terminal | |
WO2014161265A1 (en) | Method and device for implementing social service based on video sharing | |
CN113382269B (en) | Live interview realization method, system, equipment and storage medium | |
CN111901537B (en) | Broadcast television interactive program production mode based on cloud platform | |
CN102438119A (en) | Audio/video communication system of digital television |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20221123 Address after: 31a, 15th floor, building 30, maple commercial city, bangrang Road, Brazil Patentee after: Baiguoyuan Technology (Singapore) Co.,Ltd. Address before: Building B-1, North District, Wanda Commercial Plaza, Wanbo business district, No. 79, Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province Patentee before: GUANGZHOU BAIGUOYUAN INFORMATION TECHNOLOGY Co.,Ltd. |
|
TR01 | Transfer of patent right |