CN107819833B - A kind of access live streaming connects the method and device of wheat - Google Patents
A kind of access live streaming connects the method and device of wheat Download PDFInfo
- Publication number
- CN107819833B CN107819833B CN201710999092.2A CN201710999092A CN107819833B CN 107819833 B CN107819833 B CN 107819833B CN 201710999092 A CN201710999092 A CN 201710999092A CN 107819833 B CN107819833 B CN 107819833B
- Authority
- CN
- China
- Prior art keywords
- server
- audio
- conversion server
- wheat
- data packet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 32
- 241000209140 Triticum Species 0.000 title claims abstract description 28
- 235000021307 Triticum Nutrition 0.000 title claims abstract description 28
- 230000005540 biological transmission Effects 0.000 claims abstract description 27
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 23
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 23
- 238000006243 chemical reaction Methods 0.000 claims description 67
- 230000004044 response Effects 0.000 claims description 29
- 238000012790 confirmation Methods 0.000 claims description 16
- 230000002194 synthesizing effect Effects 0.000 claims description 9
- 230000011664 signaling Effects 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 4
- 238000005457 optimization Methods 0.000 abstract description 3
- 240000000233 Melia azedarach Species 0.000 abstract 4
- 230000000007 visual effect Effects 0.000 abstract 1
- 230000003993 interaction Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of method and devices of access live streaming even wheat, even wheat synthesis server receives the company wheat request for being used to indicate at least one Lian Maiduan that main broadcaster end is sent, an at least change server is selected for the even wheat end, by the identification notification of change server to corresponding Lian Maiduan, the audio, video data that corresponding Lian Maiduan is received from change server, by the audio, video data of all Lian Maiduan with synthesized from the audio, video data that receives of main broadcaster's termination after be sent to CDN direct broadcast server.The present invention selects best access node to ensure that transmission line is best, and being improved by the packet header to transport protocol ensure that transmission quality；Audio optimization technology guarantees visual/audio effects.
Description
Technical Field
The invention relates to the technical field of internet, in particular to a method and a device for accessing live broadcast and wheat.
Background
When the interactive live broadcast service is initially started, audiences can only watch the anchor in one way; later, due to the interaction requirements of audiences, the interactive function of characters and barrages is gradually developed; in order to further enrich the interactive experience of the anchor and audiences, a live broadcast live-microphone service is generated, namely, the anchor can carry out multi-person audio-video interaction with a specific audience (which can be called as a microphone audience or a microphone fan), and a common audience can watch the audio-video interaction process of the anchor and the microphone audience.
In the prior art, a connecting management server receives a first live stream pushed by a first terminal receiving connecting to a microphone and a second live stream pushed by a second terminal, controls the first terminal and the second terminal receiving connecting to the microphone to perform connecting to interaction in a real-time video session mode, and accelerates the distribution of audio and video live data through a Content Delivery Network (CDN) node. The disadvantages of this approach are: the CDN node is mainly used for caching data, has poor support for real-time data transmission and has poor data security; CDN nodes are generally scheduled based on a localDNS, the scheduling is not accurate enough, and the selected access nodes and lines are probably not optimal; the existing transmission protocol is mainly adopted for live broadcast wheat connection, and the live broadcast wheat connection transmission is not specially optimized; poor resistance to network fluctuations and interference; the audio and video effect is not optimized, and the call quality is difficult to guarantee.
Disclosure of Invention
In order to solve the technical problem, the invention provides a method and a device for accessing live broadcast and wheat connection.
The invention provides a method for accessing live broadcast and wheat, which comprises the following steps:
the continuous-microphone synthesis server receives a continuous-microphone request which is sent by the main broadcast end and used for indicating at least one continuous-microphone end, selects at least one conversion server for the continuous-microphone end, informs the corresponding continuous-microphone end of the identification of the conversion server, receives the audio and video data of the corresponding continuous-microphone end from the conversion server, synthesizes the audio and video data of all the continuous-microphone ends with the audio and video data received from the main broadcast end, and sends the synthesized audio and video data to the CDN live broadcast server.
Further, selecting a conversion server for the connecting terminal comprises: and determining the home location of each connecting terminal, and selecting a conversion server in the large-area cluster node to which the home location belongs for the connecting terminals belonging to the same home location.
Further, selecting a conversion server in the large-area cluster node to which the home location belongs for the connecting terminal belonging to the same home location comprises: and/or obtaining the link delay of each conversion server in the large area cluster node and selecting the server with the link delay smaller than the preset link delay threshold value as the conversion server.
Further, the obtaining the load degree of each server in the large area cluster node includes: and acquiring the real-time load degree and the weighting coefficient of each server in the large-area cluster node, and taking the product of the real-time load degree and the weighting coefficient of each server as the load degree of the server.
Further, when the link aggregation server receives the data packet from the conversion server and returns the response information to the conversion server, the number of the confirmed continuous data packets is added to the length field of the selection confirmation data packet of the header of the response information, the start identifier of the confirmed continuous data packets is added to the start identifier field of the selection confirmation data packet of the header of the response information, and the end identifier of the confirmed continuous data packets is added to the end identifier field of the selection confirmation data packet of the header of the response information.
Further, when the linkman composition server receives the data packet from the conversion server, the media type of the data packet is known and recorded from the media type field of the packet header of the data packet, the media type is video or audio, and when the network transmission quality of the live broadcast network does not meet the preset standard, the linkman composition server discards part of the data packet of which the media type is video.
The invention also provides a device for accessing live broadcast wheat, which is applied to a wheat-connecting synthesis server and comprises the following components:
the first receiving module is used for receiving a microphone connecting request which is sent by a main broadcasting terminal and used for indicating at least one microphone connecting terminal;
the selection module is used for selecting at least one conversion server for the microphone connecting end;
the first sending module is used for notifying the identifier of the conversion server to the corresponding connecting terminal;
the second receiving module is used for receiving the audio and video data of the corresponding microphone connecting end from the conversion server;
the synthesis module is used for synthesizing the audio and video data of all the microphone connecting ends with the audio and video data received by the slave anchor end;
and the second sending module is used for sending the data synthesized by the synthesizing module to the CDN live broadcast server.
Further, the selection module is used for selecting at least one conversion server by using the following method and the connecting terminal: and determining the home location of each connecting terminal, and selecting a conversion server in the large-area cluster node to which the home location belongs for the connecting terminals belonging to the same home location.
Further, the selection module is further configured to obtain a load degree of each server in the large area cluster node and select a server with a load degree smaller than a preset load threshold as the conversion server, and/or obtain a link delay of each conversion server in the large area cluster node and select a server with a link delay smaller than the preset link delay threshold as the conversion server.
Further, the selection module is further configured to obtain the load degree of each server in the large area cluster node by using the following method: and acquiring the real-time load degree and the weighting coefficient of each server in the large-area cluster node, and taking the product of the real-time load degree and the weighting coefficient of each server as the load degree of the server.
The system further comprises a response module, configured to, when a response message is returned to the conversion server after receiving the data packet from the conversion server, add the number of confirmed consecutive data packets in the selective acknowledgement packet length field of the packet header of the response message, add the start identifier of the confirmed consecutive data packets in the selective acknowledgement packet start identifier field of the packet header of the response message, and add the end identifier of the confirmed consecutive data packets in the selective acknowledgement packet end identifier field of the packet header of the response message.
Further, the device comprises a processing module, which is used for acquiring and recording the media type of the data packet from the media type field of the packet header of the data packet when the data packet is received from the conversion server, wherein the media type is video or audio, and the Lianmai composition server discards part of the data packet with the media type being video when the network transmission quality of the live broadcast network does not meet the preset standard.
The advantages of the invention include: the optimal access node is selected to ensure that the transmission line is optimal, and the transmission quality is ensured by improving the packet header of the transmission protocol; the audio optimization technology ensures audio and video effects.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate an embodiment of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a flow chart of a method for accessing live microphone in an embodiment;
fig. 2 is a schematic diagram illustrating a part of fields of a header of response information in the embodiment;
fig. 3 is a block diagram of an apparatus for accessing live microphone in the embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
Fig. 1 is a flowchart of a method for accessing live broadcast and live broadcast in an embodiment, where the method includes:
step 1, a connecting and combining server receives a connecting and combining request which is sent by a main broadcasting terminal and used for indicating at least one connecting and combining terminal, and selects at least one conversion server for the connecting and combining terminal;
step 2, notifying the identification of the conversion server to a corresponding connecting terminal;
and 3, receiving the audio and video data of the corresponding microphone connecting end from the conversion server, synthesizing the audio and video data of all the microphone connecting ends with the audio and video data received from the main broadcasting end, and sending the synthesized audio and video data to the CDN live broadcasting server.
Wherein,
before step 1, a main broadcasting end and a connecting terminal log in a central connecting and combining server through an xmpp signaling, the main broadcasting selects some audiences in an online audience list, and a connecting and combining request is sent to the central connecting and combining server. And the connecting microphone synthesis server informs the connecting microphone end to start the audio and video push stream through a signaling, and returns an optimal turnserver for the p2p push stream of the connecting microphone end. Because the xmpp direct connection is adopted, the central synthesis server can directly obtain the login ip of the microphone connecting end, the scheduling is more accurate, meanwhile, the turnsver does not cache data and only carries out real-time transmission, and the conversation safety is ensured.
In step 1, the method for selecting the conversion server for the connecting terminal comprises the following steps: and determining the home location of each connecting terminal, and selecting a conversion server in the large-area cluster node to which the home location belongs for the connecting terminals belonging to the same home location. The large area can be divided according to regions such as China, south China, north China and the like, and can also be divided according to the specific layout condition of the servers. Specifically, selecting a conversion server in a large-area cluster node to which a home location belongs for a connecting terminal belonging to the same home location comprises: and/or obtaining the link delay of each conversion server in the large area cluster node and selecting the server with the link delay smaller than the preset link delay threshold value as the conversion server.
The method for acquiring the load degree of each server in the large area cluster node comprises the following steps: and acquiring the real-time load degree and the weighting coefficient of each server in the large-area cluster node, and taking the product of the real-time load degree and the weighting coefficient of each server as the load degree of the server. Because different machines have different performances, the same amount of the traffics can be borne, and the peak value of the traffics can be dynamically adjusted according to the performances of the machines through the weighting coefficient.
In the existing TCP sack mechanism, the ACK packet records the number of each message, and if the sequence number of the data packet received by the receiving end is greater than the expected sequence number of the data packet, which indicates that the data packet is lost or arrives in a delayed manner, the ACK packet is used for selective retransmission. For example, when a host develops a datagram for transmission, if a large amount of data is injected into the network immediately, congestion of the network may occur. The slow start algorithm is to detect the network condition when the host just starts sending the datagram, and if the network condition is good, the sender can correctly receive the confirmed message segment every time the sender sends the message segment. The size of the congestion window, i.e. the size of the send window, is increased from small to large. The fast retransmit algorithm requires that the receiver send a duplicate acknowledgement immediately after receiving an out-of-sequence segment, rather than waiting for the receiver to send data to piggyback. The receiver successfully accepts M1 and M2 sent by the sender and sends ACK respectively, and now the receiver does not receive M3, but receives M4, obviously the receiver cannot confirm M4 because M4 is an out-of-sequence segment. If the receiver does nothing according to the principle of reliable transmission, but according to a fast retransmission algorithm, when receiving messages such as M4, M5 and the like, the receiver continuously and repeatedly sends ACK of M2 to the sender, and if the receiver continuously receives three repeated ACK, the sender does not need to wait for the expiration of a retransmission timer, and the sender retransmits the unacknowledged messages as soon as possible.
UDTs build on top of UDP and introduce new congestion control and data reliability control mechanisms. UDTs are connection-oriented, bi-directional application-layer protocols that support both reliable data streaming and partially reliable datagram transmission. Since the UDT is implemented entirely over UDP, it can be applied to other application fields besides high-speed data transmission, such as point-to-point technology (P2P), firewall penetration, multimedia data transmission, and the like.
The method improves the packet header in the transmission protocol, adds a length field of a selective acknowledgement data packet, a starting identification field of the selective acknowledgement data packet and an ending identification field of the selective acknowledgement data packet, and is shown in the following table:
| SACK Length | SACK Start Mark | SACK end marker |
In the method, when the connecting synthesis server receives the data packet from the conversion server and returns the response information to the conversion server, the number of the confirmed continuous data packets is added in the length field of the selection confirmation data packet of the packet head of the response information, the start identification of the confirmed continuous data packets is added in the start identification field of the selection confirmation data packet of the packet head of the response information, and the end identification of the confirmed continuous data packets is added in the end identification field of the selection confirmation data packet of the packet head of the response information. By the method, the continuous data packets can be confirmed, the confirmation efficiency is higher compared with the mode that only a single message number can be recorded in the prior art, and the method is more beneficial to the execution of selective retransmission.
Fig. 2 shows a part of fields of a header of response information.
In order to perform reasonable packet loss operation when a live network is congested. In the method, the packet header in the transmission protocol is improved, a field for expressing the media type of a data packet is added to distinguish audio data from video data, and the video data is preferentially discarded when reasonable packet loss is required. The media type field may be set in an extension field of a header of a transport protocol, may include only the media type field, and may further include a media length, a timestamp, a reserved field, and the like. In the method, when the connecting synthesis server receives a data packet from the conversion server, the media type of the data packet is known and recorded from the media type field of the packet header of the data packet, the media type is video or audio, and when the network transmission quality of the live broadcast network does not meet the preset standard, the connecting synthesis server discards part of the data packet with the media type being video.
And step 4, further processing the audio and video data after synthesis. The method adopts a webrtc scheme for the audio data, performs operations such as echo cancellation, denoising, gain algorithm, silence detection and the like, and also performs sound mixing processing by using an audiomering module to optimize the popping phenomenon. And synthesizing the video data according to the default rendering templates such as one big template and one small template, and finally sending the audio and video synthetic data to the cdn server through the standard rtmp protocol.
Fig. 3 is a block diagram of an apparatus for accessing live microphone connection in an embodiment, which is applied to a microphone connection synthesis server, and includes:
the first receiving module is used for receiving a microphone connecting request which is sent by a main broadcasting terminal and used for indicating at least one microphone connecting terminal;
the selection module is used for selecting at least one conversion server for the microphone connecting end;
the first sending module is used for notifying the identifier of the conversion server to the corresponding connecting terminal;
the second receiving module is used for receiving the audio and video data of the corresponding microphone connecting end from the conversion server;
the synthesis module is used for synthesizing the audio and video data of all the microphone connecting ends with the audio and video data received by the slave anchor end;
and the second sending module is used for sending the data synthesized by the synthesizing module to the CDN live broadcast server.
Wherein,
the selection module is used for selecting at least one conversion server by using the following method and the connecting terminal: and determining the home location of each connecting terminal, and selecting a conversion server in the large-area cluster node to which the home location belongs for the connecting terminals belonging to the same home location. Specifically, the load degree of each server in the large area cluster node is obtained, and the server with the load degree smaller than a preset load threshold value is selected as the conversion server, and/or the link delay of each conversion server in the large area cluster node is obtained, and the server with the link delay smaller than the preset link delay threshold value is selected as the conversion server. The selection module is further configured to obtain a load level of each server in the large area cluster node using the following method: and acquiring the real-time load degree and the weighting coefficient of each server in the large-area cluster node, and taking the product of the real-time load degree and the weighting coefficient of each server as the load degree of the server.
The device also comprises a response module, which is used for adding the number of confirmed continuous data packets in the length field of the selective confirmation data packet of the packet head of the response information, adding the start identifier of the confirmed continuous data packets in the start identifier field of the selective confirmation data packet of the packet head of the response information and adding the end identifier of the confirmed continuous data packets in the end identifier field of the selective confirmation data packet of the packet head of the response information when the response information is returned to the conversion server after the data packets are received from the conversion server.
The device also comprises a processing module which is used for acquiring and recording the media type of the data packet from the media type field of the packet head of the data packet when the data packet is received from the conversion server, wherein the media type is video or audio, and the Lianmai synthesis server discards part of data packets with the media type being video when the network transmission quality of the live broadcast network does not meet the preset standard.
The advantages of the invention include: the optimal access node is selected to ensure that the transmission line is optimal, and the transmission quality is ensured by improving the packet header of the transmission protocol; the audio optimization technology ensures audio and video effects.
The above-described aspects may be implemented individually or in various combinations, and such variations are within the scope of the present invention.
It will be understood by those skilled in the art that all or part of the steps of the above methods may be implemented by instructing the relevant hardware through a program, and the program may be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the foregoing embodiments may also be implemented by using one or more integrated circuits, and accordingly, each module/unit in the foregoing embodiments may be implemented in the form of hardware, and may also be implemented in the form of a software functional module. The present invention is not limited to any specific form of combination of hardware and software.
It is to be noted that, in this document, the terms "comprises", "comprising" or any other variation thereof are intended to cover a non-exclusive inclusion, so that an article or apparatus including a series of elements includes not only those elements but also other elements not explicitly listed or inherent to such article or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of additional like elements in the article or device comprising the element.
The above embodiments are merely to illustrate the technical solutions of the present invention and not to limit the present invention, and the present invention has been described in detail with reference to the preferred embodiments. It will be understood by those skilled in the art that various modifications and equivalent arrangements may be made without departing from the spirit and scope of the present invention and it should be understood that the present invention is to be covered by the appended claims.
Claims (10)
1. A method for accessing live broadcast and wheat connection is characterized by comprising the following steps:
the method comprises the steps that a main broadcast end and a connecting wheat end log in a connecting wheat synthesis server through an xmpp signaling, the connecting wheat synthesis server receives a connecting wheat request which is sent by the main broadcast end and used for indicating at least one connecting wheat end, the connecting wheat synthesis server informs the connecting wheat end of starting audio and video push streams through the signaling, at least one conversion server is selected for the connecting wheat end and used for the connecting wheat end p2p push streams, and the conversion server does not cache data and only carries out real-time transmission; informing the mark of the conversion server to the corresponding wheat connecting end, receiving the audio and video data of the corresponding wheat connecting end from the conversion server, synthesizing the audio and video data of all the wheat connecting ends with the audio and video data received from the main broadcasting end, and then sending the synthesized audio and video data to the CDN live broadcast server;
the selecting a conversion server for the connecting terminal comprises:
and determining the home location of each connecting terminal, and selecting a conversion server in the large-area cluster node to which the home location belongs for the connecting terminals belonging to the same home location.
2. The method as claimed in claim 1, wherein said selecting a conversion server in the large area cluster node to which the home location belongs for the connected wheat terminal belonging to the same home location comprises: and/or obtaining link delay of each conversion server in the large area cluster node and selecting the server with the link delay smaller than a preset link delay threshold value as the conversion server.
3. The method of claim 2, wherein the obtaining the load level of each server in the large area cluster node comprises: and acquiring the real-time load degree and the weighting coefficient of each server in the large-area cluster node, and taking the product of the real-time load degree and the weighting coefficient of each server as the load degree of the server.
4. The method of accessing live microphone according to claim 1,
and when the connecting synthesis server returns response information to the conversion server after receiving the data packet from the conversion server, adding the number of the confirmed continuous data packets in the length field of the selective confirmation data packet of the header of the response information, adding the start identifier of the confirmed continuous data packets in the start identifier field of the selective confirmation data packet of the header of the response information, and adding the end identifier of the confirmed continuous data packets in the end identifier field of the selective confirmation data packet of the header of the response information.
5. The method of accessing live microphone according to claim 1,
when the connecting synthesis server receives the data packet from the conversion server, the media type of the data packet is known and recorded from the media type field of the packet header of the data packet, the media type is video or audio, and when the network transmission quality of the live broadcast network does not meet the preset standard, the connecting synthesis server discards part of the data packet with the media type being video.
6. A device for accessing live broadcast and wheat connection is applied to a wheat connection synthesis server and is characterized by comprising:
the system comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is used for receiving a connecting request which is sent by a main broadcasting terminal and used for indicating at least one connecting terminal, and the main broadcasting terminal and the connecting terminal log in a connecting synthesis server through an xmpp signaling;
a selection module, configured to select at least one conversion server for the connecting terminal by using the following method: determining the home location of each connecting terminal, selecting a conversion server in a large-area cluster node to which the home location belongs for the connecting terminals belonging to the same home location, wherein the conversion server is used for p2p plug flow of the connecting terminals, does not cache data, and only carries out real-time transmission; the connecting microphone synthesis server informs the connecting microphone end of starting the audio and video push stream through a signaling;
the first sending module is used for notifying the identifier of the conversion server to the corresponding connecting terminal;
the second receiving module is used for receiving the audio and video data of the corresponding microphone connecting end from the conversion server;
the synthesis module is used for synthesizing the audio and video data of all the microphone connecting ends with the audio and video data received by the slave anchor end;
and the second sending module is used for sending the data synthesized by the synthesizing module to the CDN live broadcast server.
7. An apparatus for accessing live microphone according to claim 6,
the selection module is further configured to obtain a load degree of each server in the large area cluster node and select a server with a load degree smaller than a preset load threshold as a conversion server, and/or obtain a link delay of each conversion server in the large area cluster node and select a server with a link delay smaller than a preset link delay threshold as a conversion server.
8. An apparatus for accessing live microphone according to claim 7,
the selection module is further configured to obtain a load degree of each server in the large area cluster node by using the following method: and acquiring the real-time load degree and the weighting coefficient of each server in the large-area cluster node, and taking the product of the real-time load degree and the weighting coefficient of each server as the load degree of the server.
9. An apparatus for accessing live microphone according to claim 6,
the system also comprises a response module used for adding the number of confirmed continuous data packets in the length field of the selective confirmation data packet of the packet head of the response information, adding the start identifier of the confirmed continuous data packets in the start identifier field of the selective confirmation data packet of the packet head of the response information and adding the end identifier of the confirmed continuous data packets in the end identifier field of the selective confirmation data packet of the packet head of the response information when the response information is returned to the conversion server after the data packets are received from the conversion server.
10. An apparatus for accessing live microphone according to claim 6,
the media type of the data packet is known and recorded from the media type field of the packet header of the data packet when the data packet is received from the conversion server, the media type is video or audio, and the Lianmai composition server discards part of the data packet with the media type being video when the network transmission quality of the live broadcast network does not meet the preset standard.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911175261.6A CN110881135B (en) | 2017-10-20 | 2017-10-20 | Method, device, equipment and medium for optimizing microphone-connected transmission protocol |
| CN201710999092.2A CN107819833B (en) | 2017-10-20 | 2017-10-20 | A kind of access live streaming connects the method and device of wheat |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710999092.2A CN107819833B (en) | 2017-10-20 | 2017-10-20 | A kind of access live streaming connects the method and device of wheat |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911175261.6A Division CN110881135B (en) | 2017-10-20 | 2017-10-20 | Method, device, equipment and medium for optimizing microphone-connected transmission protocol |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107819833A CN107819833A (en) | 2018-03-20 |
| CN107819833B true CN107819833B (en) | 2019-10-25 |
Family
ID=61608555
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911175261.6A Active CN110881135B (en) | 2017-10-20 | 2017-10-20 | Method, device, equipment and medium for optimizing microphone-connected transmission protocol |
| CN201710999092.2A Active CN107819833B (en) | 2017-10-20 | 2017-10-20 | A kind of access live streaming connects the method and device of wheat |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911175261.6A Active CN110881135B (en) | 2017-10-20 | 2017-10-20 | Method, device, equipment and medium for optimizing microphone-connected transmission protocol |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN110881135B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108881378A (en) * | 2018-05-02 | 2018-11-23 | 象翌微链科技发展有限公司 | A kind of transmission method of file, system and equipment |
| CN109286821B (en) * | 2018-09-30 | 2021-10-15 | 武汉斗鱼网络科技有限公司 | Live broadcast room recommendation method and device, server and storage medium |
| CN110311795B (en) * | 2019-07-02 | 2020-10-20 | 广州华多网络科技有限公司 | Method and system for creating friend group and server |
| CN110493610A (en) * | 2019-08-14 | 2019-11-22 | 北京达佳互联信息技术有限公司 | Method, apparatus, electronic equipment and the storage medium of chatroom unlatching video pictures |
| CN111405308B (en) * | 2020-03-24 | 2022-05-03 | 北京世纪好未来教育科技有限公司 | Method and device for sending live audio and video data |
| CN114205633B (en) * | 2020-08-31 | 2024-03-08 | 腾讯科技（深圳）有限公司 | Live interaction method and device, storage medium and electronic equipment |
| CN112135155B (en) * | 2020-09-11 | 2022-07-19 | 上海七牛信息技术有限公司 | Audio and video connecting and converging method and device, electronic equipment and storage medium |
| CN114125486B (en) * | 2021-12-01 | 2023-11-07 | 杭州米络星科技(集团)有限公司 | Wheat connecting scheduling method and device and electronic equipment |
| CN114554229B (en) * | 2022-02-28 | 2023-08-29 | 广州点云科技有限公司 | Method, device, terminal equipment and medium for identifying voice state of microphone user |
| CN115002502B (en) * | 2022-07-29 | 2023-01-03 | 广州市千钧网络科技有限公司 | Data processing method and server |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8132221B2 (en) * | 2007-11-16 | 2012-03-06 | At&T Intellectual Property I, L.P. | Methods, computer program products, and systems for packaging livecast electronic content for distribution |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101465711B (en) * | 2007-12-18 | 2012-11-28 | 国家广播电影电视总局广播科学研究院 | Method for transmitting multi-mode data business in mobile multimedia broadcasting system |
| CN102244608B (en) * | 2011-06-09 | 2014-02-19 | 杭州米加科技有限公司 | Streaming media content priority-adaptation transmission method |
| US20130053057A1 (en) * | 2011-08-31 | 2013-02-28 | The Directv Group, Inc. | Method and system for determining a location of a mobile device and utilizing the location in content services |
| CN102820957B (en) * | 2012-07-19 | 2016-03-30 | 福建先创通信有限公司 | A kind of data mode feedback packet and application thereof |
| CN105491393A (en) * | 2015-12-02 | 2016-04-13 | 北京暴风科技股份有限公司 | Method for implementing multi-user live video business |
| CN106488263A (en) * | 2016-10-24 | 2017-03-08 | 北京小米移动软件有限公司 | Push the method and device of live broadcast stream media data |
| CN106954100A (en) * | 2017-03-13 | 2017-07-14 | 网宿科技股份有限公司 | Live broadcasting method and system, company's wheat management server |
| CN107071584B (en) * | 2017-03-14 | 2019-12-24 | 北京潘达互娱科技有限公司 | Live broadcast wheat connecting method and device |
-
2017
- 2017-10-20 CN CN201911175261.6A patent/CN110881135B/en active Active
- 2017-10-20 CN CN201710999092.2A patent/CN107819833B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8132221B2 (en) * | 2007-11-16 | 2012-03-06 | At&T Intellectual Property I, L.P. | Methods, computer program products, and systems for packaging livecast electronic content for distribution |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110881135A (en) | 2020-03-13 |
| CN110881135B (en) | 2021-11-23 |
| CN107819833A (en) | 2018-03-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107819833B (en) | A kind of access live streaming connects the method and device of wheat | |
| CN109889543B (en) | Video transmission method, root node, child node, P2P server and system | |
| US10205971B2 (en) | Media data live broadcast method, device, and system | |
| WO2020034082A1 (en) | Slicing-based rtp stream transmission method, device, terminal and server | |
| US7185084B2 (en) | Server-side measurement of client-perceived quality of service | |
| US20110302320A1 (en) | Systems and methods for network content delivery | |
| US8463849B2 (en) | Method and apparatus for providing broadcast content and system using the same | |
| US20130114597A1 (en) | Proxy server, relay method, communication system, relay control program, and recording medium | |
| CN108696772B (en) | Real-time video transmission method and device | |
| CN105656910B (en) | Media transmission server, media transmission system, user terminal and media transmission method | |
| JP2024509728A (en) | Data retransmission processing method, device, computer equipment and computer program | |
| US20140074961A1 (en) | Efficiently Delivering Time-Shifted Media Content via Content Delivery Networks (CDNs) | |
| CN104641575B (en) | It is used for transmission the method, apparatus and user equipment of Media Stream | |
| CN107295364B (en) | For the real-time streaming transport control method of barrage video, control device | |
| CN111263240B (en) | IPTV4K audio and video playing management method and device and display equipment | |
| US11196631B2 (en) | Multi-unicast discovery of devices on a network | |
| CN113423008B (en) | Video data transmission method, server and viewer side equipment | |
| CN109640113A (en) | A kind of processing method and proxy server of dilatory video data | |
| CN110445723B (en) | Network data scheduling method and edge node | |
| EP1806870A1 (en) | Method for providing data and data transmission system | |
| CN107920072B (en) | Multimedia sharing method and system based on data characteristics | |
| US20090238183A1 (en) | Packet processing system and method thereof | |
| CN105376075B (en) | Chatroom voice broadcast system and voice broadcast method based on web | |
| CN110830821A (en) | RTP (real-time transport protocol) stream transmission method and device based on slices, terminal and server | |
| CN111262653A (en) | Data packet loss resisting method, sending end, receiving end and related server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 550003 Building No. 12 in the Southern Park of Gui'an High-end Equipment Industrial Park, Guizhou Province Applicant after: Guizhou Baishan cloud Polytron Technologies Inc Address before: 100015 5 floor, block E, 201 IT tower, electronic city, 10 Jiuxianqiao Road, Chaoyang District, Beijing. Applicant before: Guizhou white cloud Technology Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |