CN115473876A

CN115473876A - Method, device and system for transmitting real-time streaming media data and storage medium

Info

Publication number: CN115473876A
Application number: CN202211123708.7A
Authority: CN
Inventors: 柯于刚; 曹菲菲
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2022-09-15
Filing date: 2022-09-15
Publication date: 2022-12-13

Abstract

The present disclosure provides a transmission method, device, system and storage medium for real-time streaming media data, which relate to the technical field of artificial intelligence, specifically to cloud computing, video processing and media cloud technologies, and can be applied in intelligent cloud and low-delay live broadcast scenarios. The specific implementation scheme is as follows: after a streaming media playing request of a playing end is received, an IP address of the playing end is determined based on the streaming media playing request, a peer-to-peer content distribution network PCDN node matched with the playing end is obtained based on the IP address, and the PCDN node is controlled to send real-time streaming media data corresponding to a live channel identifier to the playing end under the condition that the PCDN node is in a survival state and the load capacity of the PCDN node is smaller than or equal to a preset load threshold value. Therefore, in the process of issuing the streaming media data to the playing end, the corresponding streaming media data can be sent to the playing end through the PCDN node, and the issuing cost of the CDN node can be reduced.

Description

Method, device and system for transmitting real-time streaming media data and storage medium

Technical Field

The present disclosure relates to the field of artificial intelligence, and more particularly to cloud computing, video processing, and media cloud technologies, which can be applied in intelligent cloud and low-latency live broadcast scenarios, and in particular to a method and an apparatus for transmitting real-time streaming media data,

A system and a storage medium.

Background

With the development of the internet, various services have appeared along with the internet. For example, live broadcast is a video service that appears through the internet.

The live broadcast system in the related art may specifically include a push streaming end, a Content Delivery Network (CDN) Yun Jiedian, and a plurality of playback ends. The stream pushing end acquires stream media data corresponding to the live channel identifier and sends the stream media data to the CDN Yun Jiedian; and the CDN terminal sends the streaming media data to the playing terminal under the condition that a playing request of the playing terminal for the live channel identifier is received, so that the playing terminal plays the streaming media data. However, all the playing terminals obtain the streaming media data from the CDN cloud node, so that the downloading pressure of the CDN cloud node is large, and the cost of downloading the streaming media data is high.

Disclosure of Invention

The present disclosure provides a transmission method, apparatus, system and storage medium for real-time streaming media data.

According to one aspect of the disclosure, a transmission method of real-time streaming media data is provided, and is applied to a content delivery network CDN cloud node, where the method includes: receiving a streaming media playing request of a playing end, wherein the streaming media playing request comprises a live channel identifier and an Internet Protocol (IP) address of the playing end; acquiring a PCDN (peer-to-peer content distribution network) node matched with the playing end according to the IP address of the Internet protocol; and sending a forwarding indication containing the live channel identifier to the PCDN node under the condition that the PCDN node is in a survival state and the load capacity of the PCDN node is less than or equal to a preset load threshold value, wherein the forwarding indication is used for indicating the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the playing end.

According to another aspect of the present disclosure, there is provided a transmission method of real-time streaming media data, applied to a PCDN node of a peer-to-peer content distribution network, the method including: receiving a forwarding instruction of a Content Delivery Network (CDN) cloud node, wherein the forwarding instruction is sent by the CDN cloud node after receiving a streaming media playing request of a playing end, the streaming media playing request comprises a live channel identifier, and the forwarding instruction is used for instructing the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the playing end; and sending the real-time streaming media data corresponding to the live channel identification to the playing end.

According to another aspect of the present disclosure, there is provided a transmission apparatus for real-time streaming media data, which is applied to a content delivery network CDN cloud node, the apparatus including: the first receiving module is used for receiving a streaming media playing request of a playing end, wherein the streaming media playing request comprises a live channel identifier and an Internet Protocol (IP) address of the playing end; the first acquisition module is used for acquiring a PCDN node of the peer-to-peer content distribution network matched with the playing end according to the IP address of the Internet protocol; and the first sending module is used for sending a forwarding indication containing the live channel identifier to the PCDN node under the condition that the PCDN node is in a survival state and the load capacity of the PCDN node is less than or equal to a preset load threshold value, wherein the forwarding indication is used for indicating the PCDN node to send the real-time streaming media data corresponding to the live channel identifier to the playing end.

According to another aspect of the present disclosure, there is provided a transmission apparatus for real-time streaming media data, which is applied to a PCDN node of a peer-to-peer content distribution network, the apparatus including: the device comprises a first receiving module, a first receiving module and a second receiving module, wherein the first receiving module is used for receiving a forwarding instruction of a CDN cloud node of a content delivery network, the forwarding instruction is sent by the CDN cloud node after receiving a streaming media playing request of a playing end, the streaming media playing request comprises a live channel identifier, and the forwarding instruction is used for indicating the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the playing end; and the first sending module is used for sending the real-time streaming media data corresponding to the live channel identifier to the playing end.

According to another aspect of the present disclosure, a transmission system of real-time streaming media data is provided, including a playing end, a content delivery network CDN cloud node, and a peer-to-peer content delivery network PCDN node, where: the playing end is used for sending a playing request to the CDN cloud node, wherein the streaming media playing request comprises a live channel identifier and an Internet Protocol (IP) address of the playing end; the CDN cloud node is used for receiving the streaming media playing request and acquiring a peer-to-Peer Content Distribution Network (PCDN) node matched with the playing end according to the Internet Protocol (IP) address; the PCDN node is used for sending a forwarding indication containing the live channel identifier to the PCDN node under the condition that the PCDN node is in a survival state and the load capacity of the PCDN node is less than or equal to a preset load threshold value, wherein the forwarding indication is used for indicating the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the playing end.

According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the transmission method of real-time streaming media data of the present disclosure.

According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform a transmission method of real-time streaming media data disclosed in the embodiments of the present disclosure.

According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the transmission method of real-time streaming media data of the present disclosure.

One embodiment in the above application has the following advantages or benefits:

after a streaming media playing request of a playing end is received, an IP address of the playing end is determined based on the streaming media playing request, a peer-to-peer content distribution network PCDN node matched with the playing end is obtained based on the IP address, and the PCDN node is controlled to send real-time streaming media data corresponding to a live broadcast channel identifier to the playing end under the condition that the PCDN node is in a survival state and the load capacity of the PCDN node is smaller than or equal to a preset load threshold value. Therefore, in the process of sending the streaming media data to the playing end, the corresponding streaming media data can be sent to the playing end through the PCDN node, the quality of the streaming media data on the playing end is not influenced, the sending flow of the CDN node can be reduced, and the sending cost of the CDN node is reduced.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

FIG. 1 is a schematic diagram according to a first embodiment of the present disclosure;

FIG. 2 is a schematic diagram according to a second embodiment of the present disclosure;

FIG. 3 is a schematic diagram according to a third embodiment of the present disclosure;

FIG. 4 is a schematic diagram according to a fourth embodiment of the present disclosure;

FIG. 5 is a schematic diagram according to a fifth embodiment of the present disclosure;

FIG. 6 is a schematic diagram according to a sixth embodiment of the present disclosure;

FIG. 7 is a schematic diagram according to a seventh embodiment of the present disclosure;

FIG. 8 is a schematic diagram according to an eighth embodiment of the present disclosure;

FIG. 9 is a schematic diagram according to a ninth embodiment of the present disclosure;

figure 10 is a schematic illustration according to a tenth embodiment of the present disclosure;

FIG. 11 is a schematic diagram according to an eleventh embodiment of the present disclosure;

fig. 12 is a block diagram of an electronic device for implementing a transmission method of real-time streaming media data according to an embodiment of the disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of embodiments of the present disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the related art, the CDN Yun Jiedian (i.e., a CDN cloud) in the live broadcast system generally provides real-time streaming media data corresponding to the live broadcast channel identifier to all the broadcast terminals, however, the CDN cloud node provides real-time streaming media data corresponding to the live broadcast channel identifier to all the broadcast terminals, which generally requires higher performance of the CDN cloud node and generally higher deployment cost of the CDN cloud node, and under the condition of more broadcast requests, the processing pressure of the CDN cloud node is higher and the delivery cost is higher.

After receiving a streaming media playing request of a playing end, determining an IP address of the playing end based on the streaming media playing request, acquiring a peer-to-peer content distribution network PCDN node matched with the playing end based on the IP address, and controlling the PCDN node to send real-time streaming media data corresponding to a live channel identifier to the playing end under the condition that the PCDN node is in a survival state and the load capacity of the PCDN node is less than or equal to a preset load threshold value. Therefore, in the process of issuing the streaming media data to the playing end, the corresponding streaming media data can be sent to the playing end through the PCDN node, the quality of the streaming media data on the playing end is not affected, and meanwhile the issuing flow of the CDN node can be reduced, so that the issuing cost of the CDN node is reduced.

A transmission method, an apparatus, a system, and a storage medium of real-time streaming media data according to embodiments of the present disclosure are described below with reference to the accompanying drawings.

Fig. 1 is a schematic diagram according to a first embodiment of the present disclosure, which provides a transmission method of real-time streaming media data.

As shown in fig. 1, the method for transmitting real-time streaming media data may include:

step 101, receiving a streaming media playing request of a playing end, wherein the streaming media playing request comprises a live channel identifier and an Internet Protocol (IP) address of the playing end.

It should be noted that an execution subject of the transmission method of the real-time streaming media data in this embodiment is a transmission device of the real-time streaming media data, the transmission device of the real-time streaming media data may be implemented by software and/or hardware, and the transmission device of the real-time streaming media data may be a CDN cloud node, or may be configured in the CDN cloud node.

The playing end in this example refers to a web page end, a client end and a video and audio device end capable of playing real-time streaming media data.

The webpage end is a webpage which runs in a browser of the electronic equipment and can play real-time streaming media data; the client is an application program installed in the electronic device and capable of playing real-time streaming media data; the video and audio device end is a hardware device capable of providing a video and audio playing function, such as a television box, a screen projection device, and the like, or an application program running in a device with a video and audio playing function, such as an intelligent television, an intelligent projection device, and the like. In addition, in a specific application, according to different types of electronic devices, the web page may include: PC (Personal Computer) web page side and mobile web page side, and the client may include: a PC client and a mobile client. The PC webpage end is a webpage operated in a browser of the PC; the mobile webpage end is a webpage operated in a browser of the mobile terminal; the PC client is an application installed in the PC; the mobile client is an application installed in the mobile terminal.

The real-time streaming media data in this example may be real-time audio and video data. That is, the real-time streaming media data in this example may be real-time audio-video data.

The CDN cloud node in this example may be a cloud server.

In some examples, in order to enable a subsequent PCDN node of the Peer-to-Peer Content Delivery Network (Peer-to-Peer Content Delivery Network) to send real-time streaming media data corresponding to the live channel identifier to the playing end, the CDN cloud node in this example may send a piece of real-time streaming media data to the PCDN node when receiving the real-time streaming media data corresponding to the live channel identifier.

In some exemplary embodiments, in order to ensure reliability and timeliness of data transmission, in the case of receiving real-time streaming media data corresponding to a live channel identifier, a real-time transport protocol RTP packet corresponding to the real-time streaming media data may be generated and sent to the PCDN node. That is, the real-time streaming media data may be transmitted between the CDN cloud node and the PCDN according to the real-time transport protocol RTP.

The PCDN node in this example refers to a terminal device in a PCDN in a peer-to-peer content distribution network, where the terminal device may serve as a node to communicate and interact with other nodes, and the terminal device serves as both a server and a client, i.e., a terminal. That is to say, the terminal device may send the real-time streaming media data to the playing end, and may also obtain the real-time streaming media data on other terminal devices.

The terminal device in this example may be a device including, but not limited to, a mobile phone, a tablet, a personal computer, and the like, and this embodiment is not particularly limited thereto.

In some examples, the real-time streaming media data corresponding to the live channel identifier in this example is sent to the CDN cloud node by the stream pushing end.

It should be noted that, in this embodiment, the playing end and the CDN cloud node may communicate with each other through any communication Protocol that can support the client and the server, for example, the communication Protocol between the playing end and the CDN cloud node may be a hypertext Transfer Protocol (HTTP), and correspondingly, the streaming media playing request in this example is an HTTP playing request. For another example, the communication protocol between the broadcast end and the CDN cloud node may be Network Address Translation (NAT) Session Traversal application (STUN), and correspondingly, in the process of communicating between the broadcast end and the CDN cloud node by using STUN, the streaming media play request in this example is a STUN play request. The IP address played in this example is located in Session Description Protocol (SDP) information in the STUN play request. It can be understood that, in the SDP information in this example, the streaming media format supported by the playing end and the capability information of the playing end may also be included, but are not limited to, so as to facilitate sending real-time streaming media data matched with the streaming media format and the capability information of the playing end to the playing end subsequently. The specific information included in the SDP information is only an exemplary description here, and other specific information included in the SDP information may refer to descriptions in the related art, and is not described here again.

And 102, acquiring a PCDN (personal content distribution network) node matched with the playing end according to the IP address of the Internet protocol.

In different application scenarios, it can be understood that, different implementations of acquiring a PCDN node of a peer-to-peer content distribution network matched with a play end according to an internet protocol IP address are different, and an exemplary implementation is as follows:

as an example, a node application request is sent to a PCDN scheduling server, wherein the node application request is used for instructing the PCDN scheduling server to acquire a PCDN node matched with a playing end based on an IP address; and receiving a response message returned by the PCDN scheduling server aiming at the node application request, wherein the response message comprises communication information of the PCDN node. Therefore, the PCDN node matched with the playing end can be accurately determined by communicating with the PCDN scheduling server.

In some exemplary embodiments, the PCDN scheduling server obtains a PCDN node matched with a play end based on an IP address of the play end in a possible implementation manner: the method comprises the steps of determining current position information and operator information of a playing end based on an IP address of the playing end, obtaining a plurality of candidate PCDN nodes according to the operator information, wherein the operator information of each candidate PCDN node is the same as the operator information of the playing end, determining at least one PCDN node which is within a preset distance from the current position information from the plurality of candidate PCDN nodes according to the position information corresponding to each candidate PCDN node, and taking the determined at least one PCDN node as a PCDN node matched with the playing end.

In other exemplary embodiments, the PCDN scheduling server obtains a PCDN node matched with a play end based on an IP address of the play end in a possible implementation manner that: the method comprises the steps of determining current position information and operator information of a playing end based on an IP address of the playing end, obtaining a plurality of candidate PCDN nodes which are within a preset distance from the current position information, determining at least one PCDN node with the operator information being the same as the operator information of the playing end from the candidate PCDN nodes, and taking the determined PCDN node as a PCDN node matched with the playing end.

In an actual application, a value of the preset distance may be preset according to an actual requirement, and this embodiment is not limited in particular.

As another example, based on the IP address of the playing end, the current location information and the operator information of the playing end are determined, a PCDN node with the current location information matched with the operator information is obtained from a plurality of PCDN nodes in the PCDN, and the obtained PCDN node is used as the PCDN node matched with the playing end.

103, sending a forwarding indication containing a live channel identifier to the PCDN node when the PCDN node is in a survival state and the load capacity of the PCDN node is less than or equal to a preset load threshold, wherein the forwarding indication is used for indicating the PCDN node to send real-time streaming media data corresponding to the live channel identifier to a playing end.

In some examples, whether heartbeat information of a PCDN node is received within a preset time may be determined, if the heartbeat information is received, it is determined that the PCDN node is in a survival state, a load amount in the heartbeat information is compared with a preset load threshold, and when the load amount in the heartbeat information is less than or equal to the preset load threshold, it is determined that the PCDN node meets a condition of sending real-time streaming media data to a playing end, at this time, a forwarding indication including a live channel identifier may be sent to the PCDN node, where the forwarding indication is used to indicate the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the playing end.

The preset time is a preset time, for example, 10 seconds, 20 seconds, 1 minute, or 2 minutes, and in practical application, a value of the preset time may be set according to a requirement of practical application, which is not specifically limited in this embodiment.

The method for transmitting real-time streaming media data according to the embodiment of the disclosure determines an IP address of a playing end based on a streaming media playing request after receiving the streaming media playing request of the playing end, acquires a PCDN node of a peer-to-peer content distribution network matched with the playing end based on the IP address, and controls the PCDN node to transmit real-time streaming media data corresponding to a live channel identifier to the playing end when the PCDN node is in a survival state and a load capacity of the PCDN node is less than or equal to a preset load threshold. Therefore, in the process of issuing the streaming media data to the playing end, the corresponding streaming media data can be sent to the playing end through the PCDN node, the quality of the streaming media data on the playing end is not affected, and meanwhile the issuing flow of the CDN node can be reduced, so that the issuing cost of the CDN node is reduced.

In some exemplary embodiments, sometimes a PCDN node is not in a live state, or although the PCDN node is in a live state and a load on the PCDN node is greater than a preset load threshold, if the PCDN node is continuously used to send real-time streaming media data to a playing end at this time, the playing end is prone to be jammed in the real-time streaming media data and has poor quality, and in this case, in order to ensure that the playing end can timely obtain real-time streaming media data with good quality, real-time streaming media data corresponding to a live channel identifier may be sent to the playing end through a CDN node. In order that the process may be clarified, this embodiment is exemplarily described below in connection with fig. 2, which fig. 2 is a schematic diagram according to a second embodiment of the present disclosure.

As shown in fig. 2, the method may include:

step 201, receiving a streaming media playing request of a playing end, wherein the streaming media playing request includes a live channel identifier and an internet protocol IP address of the playing end.

Step 202, according to the internet protocol IP address, a PCDN node of the peer-to-peer content distribution network matched with the playing end is obtained.

And 203, sending a forwarding indication containing a live channel identifier to the PCDN node under the condition that the PCDN node is in a survival state and the load capacity of the PCDN node is less than or equal to a preset load threshold, wherein the forwarding indication is used for indicating the PCDN node to send real-time streaming media data corresponding to the live channel identifier to a playing end.

It should be noted that, for specific implementation manners of step 201 to step 203, reference may be made to the relevant description of the foregoing embodiments, and details are not described herein again.

And step 204, acquiring real-time streaming media data corresponding to the live channel identifier when the PCDN node is not in a survival state, or when the PCDN node is in a survival state and the load capacity of the PCDN node is greater than a preset load threshold.

Step 205, sending the real-time streaming media data to a playing end.

Based on the above description, it can be seen that, after determining a PCDN node matched with a playback end device, the CDN cloud node in this example embodiment determines whether the PCDN node is not in a live state, determines whether a load of the PCDN node is greater than a preset load threshold, and determines, based on a determination result, whether the PCDN node is suitable for sending real-time streaming media data corresponding to a live channel identifier to the playback end; and under the condition that the PCDN node is determined to be suitable for sending the real-time streaming media data corresponding to the live channel identifier to the playing end, sending a forwarding instruction to the PCDN node, so that the PCDN node sends the real-time streaming media data corresponding to the live channel identifier to the playing end based on the forwarding instruction. That is to say, under the condition that the PCDN node is suitable for sending the real-time streaming media data corresponding to the live channel identifier to the playing end, the PCDN node preferentially sends the real-time streaming media data corresponding to the live channel identifier to the playing end, so as to reduce the issued traffic of the CDN cloud node, improve the bandwidth fan-out ratio of the PCDN node, and achieve the purpose of reducing the cost.

Correspondingly, under the condition that the PCDN node is not suitable for sending the real-time streaming media data corresponding to the live channel identifier to the playing end, the CDN node obtains the real-time streaming media data corresponding to the live channel identifier and sends the real-time streaming media data to the playing end. That is to say, under the condition that it is determined that the PCDN node is not suitable for sending the real-time streaming media data corresponding to the live channel identifier to the playing end, the CDN node immediately sends the corresponding real-time streaming media data to the playing end, thereby achieving a guaranteed delivery quality, generally not reducing the quality of the real-time streaming media data of the playing end, not affecting the playing of the real-time streaming media data of the playing end, and improving the playing effect of the real-time streaming media data of the playing end.

In this exemplary embodiment, when the PCDN node is suitable for sending the real-time streaming media data corresponding to the live channel identifier to the playback end, the PCDN node sends the real-time streaming media data corresponding to the live channel identifier to the playback end, which can reduce the delivery flow of the CDN node, thereby reducing the delivery cost of the CDN node. And under the condition that the PCDN node is not suitable for sending the real-time streaming media data corresponding to the live channel identifier to the playing end, the CDN node directly sends the real-time streaming media data corresponding to the live channel identifier to the playing end, so that the quality of the real-time streaming media data of the playing end is ensured, and the playing of the real-time streaming media data of the playing end is not influenced.

In order to clearly understand the present disclosure, the transmission method of the real-time streaming media data of the embodiment is exemplarily described below with reference to fig. 3.

Fig. 3 is a schematic diagram according to a third embodiment of the present disclosure.

As shown in fig. 3, the method may include:

step 301, receiving a streaming media playing request of a playing end, where the streaming media playing request includes a live channel identifier and an internet protocol IP address of the playing end.

And step 302, acquiring a PCDN node of the peer-to-peer content distribution network matched with the playing end according to the IP address of the Internet protocol.

It should be noted that, for specific implementation manners of step 301 and step 302, reference may be made to the relevant description of the embodiments of the present disclosure, and details are not described here again.

Step 303, sending a response message for the streaming media playing request to the playing end, where the response message includes communication information of the CDN cloud node and communication information of the PCDN node.

In this example, in order to enable the playing end to respectively establish an Interactive Connectivity Establishment (ICE) connection with the CDN cloud node and the PCDN node and send real-time streaming media data corresponding to the live channel identifier to the playing end through the ICE connection, this example may further return communication information of the CDN cloud node and communication information of the PCDN node to the playing end as a response message of the streaming media playing request.

The communication information of the CDN cloud node in this example may include an IP address and communication port information of the CDN cloud node.

The communication information of the PCDN node in this example may include an IP address and communication port information of the PCDN node.

Step 304, receiving a first interactive connection establishment ICE request containing communication information of the CDN cloud node.

Step 305, establishing a first ICE connection with the CDN cloud node according to the first interactive connection establishment ICE request.

Step 306, receiving a binding request sent by the PCDN node, where the binding request is sent to the CDN cloud node based on the communication information of the CDN cloud node when the PCDN node receives the binding request containing the communication information of the CDN cloud node, and the binding request is sent to the PCDN node by the play end.

And 307, responding to the binding request, and binding the communication information of the playing end, the communication information of the CDN cloud node and the communication information of the PCDN node.

And 308, sending a binding response to the playing end through the PCDN node, wherein the binding response is used for indicating that the binding among the playing end, the PCDN node and the CDN cloud node is finished.

In this example, the binding among the playing terminal, the PCDN node and the CDN cloud node is completed through the binding request, so that the control instruction is conveniently sent to the PCDN node based on the binding relationship in the following, and the corresponding real-time streaming media data is sent to the playing terminal.

And 309, establishing a second interactive connection with the PCDN node to establish an ICE connection.

And step 310, under the condition that the real-time streaming media data corresponding to the live channel identifier is received, sending a copy of the real-time streaming media data to the PCDN node through the second ICE connection.

In some exemplary embodiments, in order to ensure reliability and real-time performance of data transmission, in the case of receiving real-time streaming media data corresponding to the live channel identifier, a real-time transport protocol RTP packet corresponding to the real-time streaming media data may be generated and sent to the PCDN node through the second ICE connection.

And 311, sending a forwarding indication containing a live channel identifier to the PCDN node when the PCDN node is in a survival state and the load of the PCDN node is less than or equal to a preset load threshold, wherein the forwarding indication is used for indicating the PCDN node to send real-time streaming media data corresponding to the live channel identifier to a playing end.

Step 312, when the PCDN node is not in a survival state, or when the PCDN node is in a survival state and a load amount of the PCDN node is greater than a preset load threshold, acquiring real-time streaming media data corresponding to the live channel identifier.

Step 313, the real-time streaming media data is sent to the playing end through the first ICE connection.

In this example, after the PCDN node matched with the playback end is obtained, the communication information of the CDN cloud node and the communication information of the PCDN node are returned to the playback end, so that the playback end establishes ICE connection with the CDN cloud node and the PCDN node through the communication information of the CDN cloud node and the communication information of the PCDN node, respectively, to ensure security and timeliness of transmission between the playback end and the CDN cloud node, and between the playback end and the PCDN node.

Based on any of the above embodiments, the following further exemplarily describes the transmission method of real-time streaming media data of this embodiment with reference to fig. 4, where this embodiment further refines any of the above embodiments.

Fig. 4 is a schematic diagram according to a fourth embodiment of the present disclosure.

As shown in fig. 4, the method may include:

step 401, receiving a streaming media playing request of a playing end, where the streaming media playing request includes a live channel identifier and an internet protocol IP address of the playing end.

And step 402, acquiring a PCDN node of the peer-to-peer content distribution network matched with the playing end according to the IP address of the Internet protocol.

And step 403, sending a forwarding indication containing the live channel identifier to the PCDN node when the PCDN node is in a survival state and the load capacity of the PCDN node is less than or equal to a preset load threshold, where the forwarding indication is used for indicating the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the playing end.

It should be noted that, for specific implementation manners of step 301 to step 303, reference may be made to the relevant description of the embodiments of the present disclosure, and details are not described herein again.

And step 404, responding to the streaming media exit request of the playing end, and sending a forwarding stopping notification to the PCDN node, wherein the forwarding stopping notification is used for instructing the PCDN node to stop sending the real-time streaming media data to the playing end.

And the streaming media exit request is used for indicating the playing end to exit the live channel corresponding to the live channel identifier.

In this example, in the process of sending real-time streaming media data to the playing end through the PCDN node, when the CDN Yun Jiedian receives a streaming media exit request from the playing end, it indicates that the playing end has exited the live channel corresponding to the live channel identifier at this time, that is, it is not necessary to send corresponding real-time streaming media data to the playing end, and at this time, the CDN cloud node may send a forwarding stop notification to the PCDN node, so that the PCDN node stops sending real-time streaming media data to the playing end. Therefore, the PCDN node resources are released in time, the effect of network resource waste is avoided, and the reasonable utilization of the communication resources of the PCDN nodes is facilitated.

Fig. 5 is a schematic diagram according to a fifth embodiment of the present disclosure.

As shown in fig. 5, the method for transmitting real-time streaming media data may include:

step 501, receiving a forwarding instruction of a Content Delivery Network (CDN) cloud node, wherein the forwarding instruction is sent by the CDN cloud node after receiving a streaming media playing request of a playing end, and the streaming media playing request includes a live channel identifier.

It should be noted that, in this embodiment, the line main body of the transmission method of real-time streaming media data is a transmission device of real-time streaming media data, the transmission device of real-time streaming media data may be implemented by software and/or hardware, and the transmission device of real-time streaming media data may be a PCDN node of a peer-to-peer content distribution network, or may be configured in the PCDN node.

For the related description of the playing end, reference may be made to the related description implemented in the present disclosure, and details are not repeated here.

It should be noted that the forwarding indication in this example is used to instruct the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the play end.

It should be noted that the real-time streaming media data in the PCDN node may be sent by a CDN node, or sent by other PCDN nodes in the PCDN in which the PCDN node is located, or sent by a stream push end, and the embodiment does not specifically limit the manner of acquiring the real-time streaming media data in the PCDN node.

Step 502, sending real-time streaming media data corresponding to the live channel identifier to the playing end.

According to the transmission method of the real-time streaming media data provided by the embodiment of the disclosure, the real-time streaming media data corresponding to the live broadcast channel identifier is sent to the playing end through the PCDN node, so that the situation that all the playing ends acquire the real-time streaming media data from the CDN cloud node is avoided, the issuing flow of the CDN cloud node is reduced, and the purpose of reducing the issuing cost of issuing the real-time streaming media data by the CDN cloud node can be achieved.

In an embodiment of the disclosure, in order to establish a delivery path of streaming media data via a PCDN node, the PCDN node of the present disclosure receives a binding request containing communication information of a CDN cloud node sent by a play end, forwards the binding request to the CDN cloud node, receives a binding response returned by the CDN cloud node in response to the binding request, and forwards the binding response to the play end, where the binding response is used to indicate that binding among the play end, the PCDN node, and the CDN cloud node has been completed.

Correspondingly, the PCDN node also stores a piece of forwarding information, wherein the forwarding information comprises communication information of a playing end, communication information of the CDN cloud node and the like.

In some exemplary embodiments, after forwarding the binding request to the CDN cloud node, if it is detected that a binding response corresponding to the binding request is not received within a preset time, the PCDN node may further delete forwarding information including communication information of the playback end and communication information of the CDN cloud node, and send a prompt message to the playback end, where the prompt message is used to prompt that the binding fails.

In some exemplary embodiments, in order to enable the CDN cloud node to send the corresponding real-time streaming media data to the playout end by means of the PCDN node, the PCDN node in this example may further establish a first interactive connection with the playout end to establish an ICE connection, and establish a second interactive connection with the CDN cloud node to establish an ICE connection. Correspondingly, an ICE connection is established through the first interactive connection to receive the real-time streaming media data sent by the CDN cloud node, and the ICE connection is established through the second interactive connection to send the real-time streaming media data to the playing end. Therefore, the PCDN node can timely send the real-time streaming media data corresponding to the live channel identification to the playing end through the established issuing path, the efficiency of the playing end for obtaining the real-time streaming media data is improved, and the timeliness of real-time streaming media data transmission is improved.

In some exemplary embodiments, in order to enable the CDN node to obtain a current load of the PCDN node in time and determine whether to send the corresponding real-time streaming media data through the PCDN node based on the load, the PCDN node in this example may further send heartbeat information to the CDN cloud node, where the heartbeat information includes the current load corresponding to the PCDN node.

In some exemplary embodiments, in order to make reasonable use of resources of a PCDN node, a stop forwarding notification sent by a CDN cloud node is received, where the stop forwarding notification is sent by the CDN cloud node after receiving a streaming media exit request from a play end; and stopping sending the real-time streaming media data to the playing end according to the forwarding stopping notification. Therefore, the PCDN node resources are released in time, the effect of network resource waste is avoided, and the reasonable utilization of the communication resources of the PCDN nodes is facilitated.

In order to clearly understand the present disclosure, the transmission method of the real-time streaming media data according to the embodiment is exemplarily described below with reference to fig. 6.

Fig. 6 is a schematic diagram according to a sixth embodiment of the present disclosure.

As shown in fig. 6, the method for transmitting real-time streaming media data may include:

step 601, the playing end sends a playing request to the CDN cloud node.

The playing request may include communication information of the playing terminal, a live channel identifier, and other information.

In step 602, the cdn Yun Jiedian obtains a PCDN node matching the play end from the PCDN scheduling server.

In some exemplary embodiments, the CDN Yun Jiedian sends a node application request to the PCDN scheduling server, where the node application request is used to instruct the PCDN scheduling server to obtain a PCDN node matched with a play end based on an IP address; the CDN Yun Jiedian receives a response message returned by the PCDN scheduling server aiming at the node application request, wherein the response message comprises communication information of the PCDN node.

The specific implementation manner of the PCDN scheduling server obtaining the PCDN node matched with the play end based on the IP address may refer to the relevant description in the embodiments of the present disclosure, and is not described herein again.

It should be noted that the PCDN scheduling server in this example is used to manage the PCDN nodes. Correspondingly, the PCDN node may send a registration request to the PCDN scheduling service and send heartbeat information to the PCDN scheduling server, where the heartbeat information includes a load amount currently corresponding to the PCDN node.

In addition, the PCDN node in this example may also send an exit request to the PCDN scheduling server.

Step 603, the cdn cloud node sends a ready to forward readytoRelay request to the PCDN node.

The request to be forwarded may include a live channel identifier, a request unique identifier, and communication information of the CDN cloud node.

The request unique identifier in this example includes three pieces of information, which are respectively: the method includes the steps of broadcasting Universal Unique Identifier (UUID), IP address information of the CDN cloud node, and communication port number information of the CDN cloud node.

And the preparation forwarding request is used for indicating the PCDN node to forward the request to the CDN cloud node once the playing end sends the request containing the unique identifier of the request.

Step 604, a response message corresponding to the playing request is returned to the playing end.

The response message may include the request unique identifier, the communication information of the CDN cloud node, and the communication information of the PCDN node.

In some example embodiments, the request unique identifier may be configured in an ufrag field in the response message, and correspondingly, the communication information of the CDN cloud node and the communication information of the PCDN node may be configured in a Candidate field total in the response message.

And step 605, the playing end establishes ICE connection with the CDN cloud node according to the communication information of the CDN cloud node.

Step 606, the playing end sends a STUN bound request packet containing a unique request identifier to the communication information of the corresponding PCDN node based on the communication information of the PCDN node, correspondingly, the PCDN node forwards the binding request packet to the CDN cloud node under the condition that the binding request packet includes the unique request identifier, establishes ICE connection with the playing end, and establishes forwarding ICE connection with the CDN cloud node.

In step 607, after receiving the video data of the live channel, the cdn cloud node converts the video data into an RTP packet, and forwards an RTP packet to the PCDN node through the forwarding ICE connection, so that the PCDN node sends the RTP packet to the playback end through the ICE connection.

Correspondingly, the playing end decodes the received RTP data packet to obtain video data corresponding to the live channel identifier, and displays the video data.

Specifically, when the PCDN node is in a live state and the load capacity of the PCDN node is less than or equal to a preset load threshold, the CDN Yun Jiedian sends a forwarding indication to the PCDN node, so that the PCDN node sends video data corresponding to the live channel identifier to the play end based on the forwarding indication. Therefore, two issuing paths for issuing video data are established, corresponding video data are preferentially sent to the playing end through the issuing paths of the PCDN node, the issuing flow of the CDN node is reduced, the bandwidth fan-out ratio of the PCDN node is improved, and the purpose of reducing cost is achieved.

In addition, it should be noted that the playing end in this example can be implemented by using a standard webRTC technology without improvement, which reduces the cost of the live broadcast system.

Step 608, when the PCDN node is not in a live state, or the PCDN node is in a live state, and the load of the PCDN node is greater than a preset load threshold, the CDN node sends video data corresponding to the live channel identifier to the playback end through the ICE node.

It should be noted that, in this example, the playing end and the CDN cloud node interact based on a Real-time Transport Control Protocol (RTCP).

In this example, under the condition that the transmission quality of the PCDN is good, the PCDN node sends video data corresponding to the live channel identifier to the playback end, and under the condition that the transmission quality of the PCDN is poor, the CDN node directly sends video data corresponding to the live channel identifier to the playback end, that is, the playback end can not only obtain video data corresponding to the live channel identifier from the CDN node, but also obtain video data corresponding to the live channel identifier through the PCDN node, and thus, through two-way mutual backup, under the condition that the PCDN node cannot transmit video data, video data can be transmitted to the playback end through the CDN node, the quality of video data at the playback end is ensured, the playback of the video data at the playback end is not affected, and the smoothness of the video data at the playback end is improved.

In order to implement the foregoing embodiments, an embodiment of the present disclosure further provides a transmission device for real-time streaming media data.

Fig. 7 is a schematic diagram according to a seventh embodiment of the present disclosure, which provides a transmission apparatus of real-time streaming media data, where it should be noted that the transmission apparatus of real-time streaming media data in this exemplary embodiment is applied in a content delivery network CDN cloud node.

As shown in fig. 7, the apparatus 70 for transmitting real-time streaming media data may include a first receiving module 701, a first obtaining module 702, and a first sending module 703, wherein:

the first receiving module 701 is configured to receive a streaming media playing request of a playing end, where the streaming media playing request includes a live channel identifier and an internet protocol IP address of the playing end.

A first obtaining module 702, configured to obtain, according to the IP address of the internet protocol, a PCDN node of the peer-to-peer content distribution network that matches with the play end.

The first sending module 703 is configured to send a forwarding indication including a live channel identifier to the PCDN node when the PCDN node is in a live state and a load of the PCDN node is less than or equal to a preset load threshold, where the forwarding indication is used to indicate the PCDN node to send real-time streaming media data corresponding to the live channel identifier to a playing end.

The transmission device for real-time streaming media data of the embodiment determines an IP address of a playing end based on a streaming media playing request after receiving the streaming media playing request of the playing end, acquires a PCDN node of a peer-to-peer content distribution network matched with the playing end based on the IP address, and controls the PCDN node to send real-time streaming media data corresponding to a live channel identifier to the playing end when the PCDN node is in a survival state and a load capacity of the PCDN node is less than or equal to a preset load threshold. Therefore, in the process of issuing the streaming media data to the playing end, the corresponding streaming media data can be sent to the playing end through the PCDN node, the quality of the streaming media data on the playing end is not affected, and meanwhile the issuing flow of the CDN node can be reduced, so that the issuing cost of the CDN node is reduced.

In an embodiment of the present disclosure, as shown in fig. 8, the transmission device 80 of the real-time streaming media data may include: a first receiving module 801, a first obtaining module 802, a first sending module 803, a second obtaining module 804, a second sending module 805, a second receiving module 806, a first connection establishing module 807, a third receiving module 808, a binding module 809, a third sending module 810, a fourth sending module 811, a fifth sending module 812, a second connection establishing module 813, and a sixth sending module 814.

It should be noted that, for a detailed description of the first receiving module 801, reference may be made to the description of the first receiving module 701 in fig. 7, and a description thereof is omitted here.

In an embodiment of the present disclosure, the second obtaining module 804 is configured to obtain the real-time streaming media data corresponding to the live channel identifier when the PCDN node is not in the alive state, or when the PCDN node is in the alive state and a load of the PCDN node is greater than a preset load threshold.

A second sending module 805, configured to send the real-time streaming media data to the playing end.

In an embodiment of the present disclosure, the first obtaining module 802 is specifically configured to: sending a node application request to a PCDN (personal computer network address) scheduling server, wherein the node application request is used for indicating the PCDN scheduling server to acquire a PCDN node matched with a playing end based on an IP address; and receiving a response message returned by the PCDN scheduling server aiming at the node application request, wherein the response message comprises communication information of the PCDN node.

In an embodiment of the present disclosure, the second receiving module 806 is configured to receive a first interactive connection establishment ICE request including communication information of a CDN cloud node;

a first connection establishing module 807, configured to establish a first ICE connection with the CDN cloud node according to the first interactive connection establishment ICE request;

the second sending module 805 is specifically configured to: and transmitting the real-time streaming media data to the playing end through the first ICE connection.

In an embodiment of the present disclosure, the third receiving module 808 is configured to receive a binding request sent by a PCDN node, where the binding request is sent to the CDN cloud node based on communication information of the CDN cloud node when the PCDN node receives the binding request that includes the communication information of the CDN cloud node, and the binding request is sent to the PCDN node by a playing end;

the binding module 809 is configured to bind, in response to the binding request, the communication information of the playing end, the communication information of the CDN cloud node, and the communication information of the PCDN node;

a third sending module 810, configured to send a binding response to the playout end through the PCDN node, where the binding response is used to indicate that the binding among the playout end, the PCDN node, and the CDN cloud node is completed.

In an embodiment of the present disclosure, the fourth sending module 811 is configured to send, to the playing end, a response message for the streaming media playing request, where the response message includes communication information of the CDN cloud node and communication information of the PCDN node.

In an embodiment of the present disclosure, the fifth sending module 812 is configured to send a copy of the real-time streaming media data to the PCDN node when the real-time streaming media data corresponding to the live channel identifier is received.

In one embodiment of the present disclosure, the second connection establishing module 813 establishes a second interactive connection with the PCDN node to establish an ICE connection;

the fifth sending module 812 is specifically configured to: establishing an ICE connection to the live channel identification based on the second interactive connection when receiving the real-time streaming media data corresponding to the live channel identification

And the PCDN node sends a forwarding indication containing the live broadcast channel identification.

In an embodiment of the present disclosure, the fifth sending module 812 is specifically configured to: under the condition of receiving real-time streaming media data corresponding to the live channel identification, generating a real-time transport protocol (RTP) data packet corresponding to the real-time streaming media data; and establishing an ICE connection through the second interactive connection and sending the RTP data packet to the PCDN node.

In an embodiment of the present disclosure, the sixth sending module 814 is configured to send a stop-forwarding notification to the PCDN node in response to the streaming media exit request of the playout end, where the stop-forwarding notification is used to instruct the PCDN node to stop sending the real-time streaming media data to the playout end.

It should be noted that the explanation of the transmission method of real-time streaming media data is also applicable to the transmission apparatus of real-time streaming media data in this embodiment, and details of this embodiment are not repeated.

Fig. 9 is a schematic diagram according to a ninth embodiment of the present disclosure, which provides a transmission apparatus of real-time streaming media data, where it should be noted that the transmission apparatus of real-time streaming media data in this exemplary embodiment is applied in a PCDN node of a peer-to-peer content distribution network.

As shown in fig. 9, the apparatus for transmitting real-time streaming media data 90 may include a first receiving module 901 and a first sending module 902, wherein:

the first receiving module 901 is configured to receive a forwarding indication of a CDN cloud node of a content delivery network, where the forwarding indication is sent by the CDN cloud node after receiving a streaming media play request of a playing end, the streaming media play request includes a live channel identifier, and the forwarding indication is used to indicate the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the playing end.

A first sending module 902, configured to send real-time streaming media data corresponding to the live channel identifier to the play end.

The transmission device for real-time streaming media data provided by the embodiment of the disclosure sends real-time streaming media data corresponding to the live channel identifier to the playing end through the PCDN node, so that all the playing ends are prevented from acquiring the real-time streaming media data from the CDN cloud node, the delivery flow of the CDN cloud node is reduced, and the purpose of reducing the delivery cost of delivering the real-time streaming media data by the CDN cloud node can be achieved.

In an embodiment of the present disclosure, as shown in fig. 10, the apparatus 100 for transmitting real-time streaming media data may include: a first receiving module 1001, a first sending module 1002, a second sending module 1003, a second receiving module 1004, a third sending module 1005, a connection establishing module 1006, a third receiving module 1007, a fourth sending module 1008, a fourth receiving module 1009, and a stopping module 1010.

It should be noted that, for a detailed description of the first receiving module 1001, reference may be made to the description of the first receiving module 901 in fig. 9, and a description thereof is omitted here.

In an embodiment of the present disclosure, the second sending module 1003 is configured to forward, in response to a binding request containing communication information of a CDN cloud node sent by a play end, the binding request to the CDN cloud node;

a second receiving module 1004, configured to receive a binding response returned by the CDN cloud node for the binding request, where the binding response is used to indicate that the binding between the playout end, the PCDN node, and the CDN cloud node is completed;

a third sending module 1005, configured to forward the binding response to the play end.

In an embodiment of the present disclosure, the connection establishing module 1006 is configured to establish a first interactive connection with the playback end to establish an ICE connection, and establish a second interactive connection with the CDN cloud node to establish an ICE connection;

a third receiving module 1007, configured to establish an ICE connection through the first interactive connection to receive real-time streaming media data sent by the CDN cloud node;

the first sending module 1002 is specifically configured to: and establishing an ICE connection through the second interactive connection to send the real-time streaming media data to the playing end.

In an embodiment of the present disclosure, the fourth sending module 1008 is configured to send heartbeat information to the CDN cloud node, where the heartbeat information includes a current load amount corresponding to the PCDN node.

In an embodiment of the present disclosure, the fourth receiving module 1009 is configured to receive a forwarding stop notification sent by the CDN cloud node, where the forwarding stop notification is sent by the CDN cloud node after receiving a streaming media exit request of a playing end;

a stopping module 1010, configured to stop sending the real-time streaming media data to the playing end according to the forwarding stop notification.

Fig. 11 is a schematic diagram according to an eleventh embodiment of the present disclosure.

As shown in fig. 11, the transmission system 110 for real-time streaming media data may include: a broadcast end 1101, a content delivery network CDN cloud node 1102, and a peer-to-peer content delivery network PCDN node 1103, where:

the playing end 1101 is configured to send a playing request to the CDN cloud node 1102, where the streaming media playing request includes a live channel identifier and an internet protocol IP address of the playing end 1101.

And the CDN Yun Jiedian is configured to receive the streaming media playback request, and obtain, according to the internet protocol IP address, a peer-to-peer content delivery network PCDN node 1103 that matches the playback end 1101.

The PCDN node 1103 is configured to send a forwarding indication including a live channel identifier to the PCDN node 1103 when the PCDN node 1103 is in a live state and a load of the PCDN node 1103 is less than or equal to a preset load threshold, where the forwarding indication is used to indicate that the PCDN node 1103 sends real-time streaming media data corresponding to the live channel identifier to a play end.

The transmission system for real-time streaming media data provided by the embodiment of the disclosure determines an IP address of a playing end based on a streaming media playing request after receiving the streaming media playing request of the playing end, acquires a PCDN node of a peer-to-peer content distribution network matched with the playing end based on the IP address, and controls the PCDN node to send real-time streaming media data corresponding to a live channel identifier to the playing end when the PCDN node is in a survival state and a load capacity of the PCDN node is less than or equal to a preset load threshold. Therefore, in the process of sending the streaming media data to the playing end, the corresponding streaming media data can be sent to the playing end through the PCDN node, the quality of the streaming media data on the playing end is not influenced, the sending flow of the CDN node can be reduced, and the sending cost of the CDN node is reduced.

In one embodiment of the present disclosure, CDN Yun Jiedian, is further configured to: under the condition that the PCDN node 1103 is not in the alive state, or under the condition that the PCDN node 1103 is in the alive state and the load capacity of the PCDN node 1103 is greater than the preset load threshold, acquiring real-time streaming media data corresponding to the live channel identifier, and sending the real-time streaming media data to the play end 1101.

In one embodiment of the present disclosure, the system of this embodiment may further comprise a PCDN dispatch server. Correspondingly, the CDN Yun Jiedian 1102 is further configured to send a node application request to the PCDN scheduling server, where the node application request is used to instruct the PCDN scheduling server to obtain a PCDN node 1103 matched with the play end based on the IP address; and receiving a response message returned by the PCDN scheduling server aiming at the node application request, wherein the response message comprises the communication information of the PCDN node 1103.

The present disclosure also provides an electronic device and a readable storage medium and a computer program product according to embodiments of the present disclosure.

FIG. 12 shows a schematic block diagram of an example electronic device 1200, which can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 12, the electronic device 1200 may include a computing unit 1201, which may perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 1202 or a computer program loaded from a storage unit 1208 into a Random Access Memory (RAM) 1203. In the RAM 1203, various programs and data required for the operation of the device 1200 may also be stored. The computing unit 1201, the ROM 1202, and the RAM 1203 are connected to each other by a bus 1204. An input/output (I/O) interface 1205 is also connected to bus 1204.

Various components in the device 1200 are connected to the I/O interface 1205 including: an input unit 1206 such as a keyboard, a mouse, or the like; an output unit 1207 such as various types of displays, speakers, and the like; a storage unit 1208, such as a magnetic disk, optical disk, or the like; and a communication unit 1209 such as a network card, modem, wireless communication transceiver, etc. The communication unit 1209 allows the device 1200 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

The computing unit 1201 may be a variety of general purpose and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 1201 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The computing unit 1201 performs the various methods and processes described above, such as a transmission method of real-time streaming media data. For example, in some embodiments, the transmission method of real-time streaming media data may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 1208. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 1200 via the ROM 1202 and/or the communication unit 1209. When the computer program is loaded into the RAM 1203 and executed by the computing unit 1201, one or more steps of the transmission method of real-time streaming media data described above may be performed. Alternatively, in other embodiments, the computing unit 1201 may be configured by any other suitable means (e.g., by means of firmware) to perform the transmission method of the real-time streaming media data.

Various implementations of the devices and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), devices on a chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable device including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage device, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution apparatus, device, or apparatus. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor device, apparatus, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the apparatus and techniques described herein may be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The apparatus and techniques described here can be implemented in a computing device that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the apparatus and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the device can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), the internet, and blockchain networks.

The computer device may include a client and a server. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The Server can be a cloud Server, also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service ("Virtual Private Server", or simply "VPS"). The server may be a cloud server, a server of a distributed device, or a server combining a blockchain.

It should be noted that artificial intelligence is a subject for studying a computer to simulate some human thinking processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), and includes both hardware and software technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, and the like; the artificial intelligence software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, machine learning/deep learning, a big data processing technology, a knowledge map technology and the like.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A transmission method of real-time streaming media data is applied to a CDN cloud node of a content delivery network, and comprises the following steps:

receiving a streaming media playing request of a playing end, wherein the streaming media playing request comprises a live channel identifier and an Internet Protocol (IP) address of the playing end;

acquiring a PCDN node of the peer-to-peer content distribution network matched with the playing end according to the IP address of the Internet protocol;

and under the condition that the PCDN node is in a survival state and the load capacity of the PCDN node is less than or equal to a preset load threshold value, sending a forwarding indication containing the live channel identification to the PCDN node, wherein the forwarding indication is used for indicating the PCDN node to send real-time streaming media data corresponding to the live channel identification to the playing end.

2. The method of claim 1, wherein the method further comprises:

acquiring real-time streaming media data corresponding to the live channel identifier when the PCDN node is not in a survival state or when the PCDN node is in a survival state and the load capacity of the PCDN node is greater than the preset load threshold;

and sending the real-time streaming media data to the playing end.

3. The method of claim 2, wherein the obtaining a PCDN node of a peer-to-peer content distribution network matching the cast end according to the IP address comprises:

sending a node application request to a PCDN (private Central digital network) scheduling server, wherein the node application request is used for indicating the PCDN scheduling server to acquire the PCDN node matched with the playing end based on the IP address;

and receiving a response message returned by the PCDN scheduling server aiming at the node application request, wherein the response message comprises communication information of the PCDN node.

4. The method of claim 3, wherein the method further comprises:

receiving a first interactive connection establishment ICE request containing communication information of the CDN cloud node;

establishing an ICE request according to the first interactive connection, and establishing a first ICE connection with the CDN cloud node;

wherein, the sending the real-time streaming media data to the playing end includes:

and sending the real-time streaming media data to the playing end through the first ICE connection.

5. The method of claim 3, wherein the method further comprises:

receiving a binding request sent by the PCDN node, wherein the binding request is sent to the CDN cloud node based on the communication information of the CDN cloud node when the PCDN node receives the binding request containing the communication information of the CDN cloud node, and the binding request is sent to the PCDN node by the playing end;

responding to the binding request, and binding the communication information of the playing end, the communication information of the CDN cloud node and the communication information of the PCDN node;

sending a binding response to the playing end through the PCDN node, wherein the binding response is used for indicating that the binding among the playing end, the PCDN node and the CDN cloud node is finished.

6. The method of claim 4 or 5, wherein the method further comprises:

and sending a response message aiming at the streaming media playing request to the playing end, wherein the response message comprises communication information of the CDN cloud node and communication information of the PCDN node.

7. The method of claim 1, wherein the method further comprises:

and sending a copy of real-time streaming media data to the PCDN node under the condition of receiving the real-time streaming media data corresponding to the live channel identifier.

8. The method of claim 7, wherein the method further comprises:

establishing a second interactive connection with the PCDN node to establish an ICE connection;

wherein, the sending a copy of the real-time streaming media data to the PCDN node when receiving the real-time streaming media data corresponding to the live channel identifier includes:

and under the condition of receiving real-time streaming media data corresponding to the live channel identifier, establishing ICE connection based on the second interactive connection and sending a forwarding indication containing the live channel identifier to the PCDN node.

9. The method of claim 8, wherein the sending a forwarding indication including the live channel identification to the PCDN node based on the second interactive connection establishing an ICE connection upon receiving real-time streaming media data corresponding to the live channel identification comprises:

under the condition of receiving real-time streaming media data corresponding to the live channel identification, generating a real-time transport protocol (RTP) data packet corresponding to the real-time streaming media data;

and establishing an ICE connection through the second interactive connection and sending the RTP data packet to the PCDN node.

10. The method of claim 1, wherein the method further comprises:

and responding to a streaming media exit request of the playing end, and sending a forwarding stopping notification to the PCDN node, wherein the forwarding stopping notification is used for indicating the PCDN node to stop sending the real-time streaming media data to the playing end.

11. A transmission method of real-time streaming media data is applied to a PCDN node of a point-to-point content distribution network, and comprises the following steps:

receiving a forwarding instruction of a Content Delivery Network (CDN) cloud node, wherein the forwarding instruction is sent by the CDN cloud node after receiving a streaming media playing request of a playing end, the streaming media playing request comprises a live channel identifier, and the forwarding instruction is used for instructing the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the playing end;

and sending the real-time streaming media data corresponding to the live channel identification to the playing end.

12. The method of claim 11, wherein the method further comprises:

responding to a binding request containing the communication information of the CDN cloud node sent by the playing end, and forwarding the binding request to the CDN Yun Jiedian;

receiving a binding response returned by the CDN cloud node aiming at the binding request, wherein the binding response is used for indicating that the binding among the playing end, the PCDN node and the CDN cloud node is finished;

and forwarding the binding response to the playing end.

13. The method of claim 11, wherein the method further comprises:

establishing a first interactive connection with the playing end to establish an ICE connection, and establishing a second interactive connection with the CDN cloud node to establish the ICE connection;

establishing an ICE connection through the first interactive connection to receive the real-time streaming media data sent by the CDN cloud node;

the sending of the real-time streaming media data corresponding to the live channel identifier to the playing end includes:

and establishing an ICE connection through the second interactive connection to send the real-time streaming media data to the playing end.

14. The method of claim 11, wherein the method further comprises:

and sending heartbeat information to the CDN Yun Jiedian, wherein the heartbeat information comprises the current corresponding load capacity of the PCDN node.

15. The method according to any one of claims 11-14, wherein the method further comprises:

receiving a forwarding stopping notification sent by the CDN cloud node, wherein the forwarding stopping notification is sent by the CDN cloud node after receiving a streaming media exit request of the playing end;

and stopping sending the real-time streaming media data to the playing end according to the forwarding stopping notification.

16. A transmission device of real-time streaming media data is applied to a CDN cloud node of a content delivery network, and comprises:

the first receiving module is used for receiving a streaming media playing request of a playing end, wherein the streaming media playing request comprises a live channel identifier and an Internet Protocol (IP) address of the playing end;

the first acquisition module is used for acquiring a PCDN node of the peer-to-peer content distribution network matched with the playing end according to the IP address of the Internet protocol;

and the first sending module is used for sending a forwarding indication containing the live channel identifier to the PCDN node under the condition that the PCDN node is in a survival state and the load capacity of the PCDN node is less than or equal to a preset load threshold value, wherein the forwarding indication is used for indicating the PCDN node to send the real-time streaming media data corresponding to the live channel identifier to the playing end.

17. The apparatus of claim 16, wherein the apparatus further comprises:

a second obtaining module, configured to obtain real-time streaming media data corresponding to the live channel identifier when the PCDN node is not in a live state, or when the PCDN node is in a live state and a load of the PCDN node is greater than the preset load threshold;

and the second sending module is used for sending the real-time streaming media data to the playing end.

18. The apparatus according to claim 17, wherein the first obtaining module is specifically configured to:

sending a node application request to a PCDN scheduling server, wherein the node application request is used for indicating the PCDN scheduling server to acquire the PCDN node matched with the playing end based on the IP address;

19. The apparatus of claim 18, wherein the apparatus further comprises:

a second receiving module, configured to receive a first interactive connection establishment ICE request that includes communication information of the CDN cloud node;

the first connection establishing module is used for establishing an ICE request according to the first interactive connection and establishing a first ICE connection with the CDN cloud node;

the second sending module is specifically configured to:

20. The apparatus of claim 18, wherein the apparatus further comprises:

a third receiving module, configured to receive a binding request sent by the PCDN node, where the binding request is sent to the CDN cloud node based on communication information of the CDN cloud node when the PCDN node receives a binding request that includes the communication information of the CDN cloud node, and the binding request is sent to the PCDN node by the play end;

the binding module is used for responding to the binding request and binding the communication information of the playing end, the communication information of the CDN cloud node and the communication information of the PCDN node;

and a third sending module, configured to send a binding response to the playout end through the PCDN node, where the binding response is used to indicate that the binding among the playout end, the PCDN node, and the CDN cloud node has been completed.

21. The apparatus of claim 19 or 20, wherein the apparatus further comprises:

and a fourth sending module, configured to send a response message to the playing end, where the response message includes communication information of the CDN cloud node and communication information of the PCDN node.

22. The apparatus of claim 16, wherein the apparatus further comprises:

and a fifth sending module, configured to send a copy of the real-time streaming media data to the PCDN node when receiving the real-time streaming media data corresponding to the live channel identifier.

23. The apparatus of claim 22, wherein the apparatus further comprises:

the second connection establishing module is used for establishing a second interactive connection with the PCDN node to establish ICE connection;

the fifth sending module is specifically configured to:

and under the condition of receiving real-time streaming media data corresponding to the live channel identifier, establishing ICE connection based on the second interactive connection and sending a forwarding instruction containing the live channel identifier to the PCDN node.

24. The apparatus of claim 23, wherein the fifth sending module is specifically configured to:

25. The apparatus of claim 16, wherein the apparatus further comprises:

a sixth sending module, configured to send a forwarding stop notification to the PCDN node in response to a streaming media exit request of the playback end, where the forwarding stop notification is used to instruct the PCDN node to stop sending the real-time streaming media data to the playback end.

26. A transmission apparatus of real-time streaming media data, which is applied to a PCDN node of a peer-to-peer content distribution network, the apparatus comprising:

the first receiving module is used for receiving a forwarding instruction of a Content Delivery Network (CDN) cloud node, wherein the forwarding instruction is sent by the CDN cloud node after receiving a streaming media playing request of a playing end, the streaming media playing request comprises a live channel identifier, and the forwarding instruction is used for instructing the PCDN node to send real-time streaming media data corresponding to the live channel identifier to the playing end;

and the first sending module is used for sending the real-time streaming media data corresponding to the live channel identifier to the playing end.

27. The apparatus of claim 26, wherein the apparatus further comprises:

the second sending module is configured to respond to a binding request containing communication information of the CDN cloud node sent by the playback end, and forward the binding request to the CDN Yun Jiedian;

a second receiving module, configured to receive a binding response returned by the CDN cloud node for the binding request, where the binding response is used to indicate that the binding between the playback end, the PCDN node, and the CDN cloud node has been completed;

and the third sending module is used for forwarding the binding response to the playing end.

28. The apparatus of claim 26, wherein the apparatus further comprises:

the connection establishing module is used for establishing a first interactive connection with the playing end to establish an ICE connection and establishing a second interactive connection with the CDN cloud node to establish the ICE connection;

a third receiving module, configured to establish an ICE connection through the first interactive connection to receive the real-time streaming media data sent by the CDN cloud node;

the first sending module is specifically configured to:

29. The apparatus of claim 26, wherein the apparatus further comprises:

and the fourth sending module is configured to send heartbeat information to the CDN Yun Jiedian, where the heartbeat information includes a load amount currently corresponding to the PCDN node.

30. The apparatus of any one of claims 26-29, wherein the apparatus further comprises:

a fourth receiving module, configured to receive a forwarding stop notification sent by the CDN cloud node, where the forwarding stop notification is sent by the CDN cloud node after receiving a streaming media exit request of the playing end;

and the stopping module is used for stopping sending the real-time streaming media data to the playing end according to the forwarding stopping notification.

31. A transmission system of real-time streaming media data comprises a playing end, a Content Delivery Network (CDN) cloud node and a peer-to-Peer Content Delivery Network (PCDN) node, wherein:

the playing end is used for sending a playing request to the CDN cloud node, wherein the streaming media playing request comprises a live channel identifier and an Internet Protocol (IP) address of the playing end;

the CDN cloud node is used for receiving the streaming media playing request and acquiring a peer-to-Peer Content Distribution Network (PCDN) node matched with the playing end according to the Internet Protocol (IP) address;

the PCDN node is used for sending a forwarding indication containing the live channel identification to the PCDN node under the condition that the PCDN node is in a survival state and the load quantity of the PCDN node is smaller than or equal to a preset load threshold value, wherein the forwarding indication is used for indicating the PCDN node to send real-time streaming media data corresponding to the live channel identification to the playing end.

32. The system of claim 31 wherein the CDN Yun Jiedian is further configured to: and under the condition that the PCDN node is not in a survival state or the PCDN node is in a survival state and the load capacity of the PCDN node is greater than the preset load threshold value, acquiring real-time streaming media data corresponding to the live broadcast channel identifier and sending the real-time streaming media data to the playing end.

33. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-10, or the method of any one of claims 11-15.

34. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-10 or the method of any one of claims 11-15.

35. A computer program product comprising a computer program which, when executed by a processor, implements the steps of the method of any one of claims 1-10 or the steps of the method of any one of claims 11-15.