WO2023226949A1 - Real-time streaming media data transmission method and device, and storage medium - Google Patents

Abstract

The present application provides a real-time streaming media data transmission method and device, and a storage medium. According to the method provided by the present application, a communication link is established between a stream pulling client and multiple stream pulling nodes, and a communication link is established between the stream pulling nodes and stream pushing nodes to form multiple links for pulling streams. Different stream pulling nodes are used in different links. One link serves as a main link, and other links serve as candidate links. When the communication link between the stream pulling client and the stream pulling nodes in the main link does not meet a preset condition, one candidate link is switched to become the main link, and the streaming media data is pulled through the switched main link. When a jitter or network congestion happens to the communication link between the stream pulling client and the stream pulling nodes, the stream pulling nodes are switched in time to avoid freezing, delays and packet losses caused by the jitter or network congestion between the stream pulling client and the stream pulling nodes. Therefore, the transmission quality and timeliness of the streaming media data are improved.

Description

Methods, equipment and storage media for real-time streaming data transmission

This application claims priority to the Chinese patent application filed with the China Patent Office on May 23, 2022, with the application number 202210567651.3 and the application title "Method, equipment and storage medium for real-time streaming data transmission", the entire content of which is incorporated by reference. incorporated in this application.

Technical field

The present application relates to communication technology, and in particular, to a method, device and storage medium for real-time streaming media data transmission.

Background technique

With the development of communication technology, more and more users rely on real-time streaming media such as live video broadcasts and audio and video conferencing for interaction. Video live broadcast, especially low-latency live broadcast (Real-time Streaming, RTS), and audio and video conferencing and other real-time audio and video communication (Real-time Communication, RTC) scenarios have higher requirements on delay and transmission quality, and real-time data transmission. Sexual requirements are high.

Content Delivery Network (CDN) is a commonly used network for streaming media data transmission. In the CDN, the streaming client (i.e., the playback client) establishes a communication link with an edge node (i.e., the streaming node) in the CDN, and a single link is used for data transmission between the streaming client and the streaming node. When communication links jitter and other conditions occur, data transmission will cause phenomena such as stuck delays and packet loss, resulting in poor data transmission quality and making it difficult to meet the real-time requirements of streaming media data transmission in RTS, RTC and other scenarios.

Contents of the invention

This application provides a method, device and storage medium for real-time streaming media data transmission to solve the current problem of poor data transmission quality in CDN and difficulty in meeting the real-time requirements of streaming media data transmission in RTS, RTC and other scenarios.

In the first aspect, this application provides a real-time streaming media data transmission method, which is applied to the streaming client, including:

Receive the information of the target streaming node provided by the DNS server, and establish a first communication link with the target streaming node;

Send a first pull request to the target pull node, so that the target pull node establishes a second communication link with the push node, the first communication link and the second communication link Constitute the main link used to pull streaming media data;

Receive information about alternative nodes sent by the target streaming node, where the information about the alternative nodes is determined by the live broadcast center and sent to the target streaming node;

According to the information of the candidate nodes, select at least one candidate node as an alternative streaming node, and establish a third communication link with each of the candidate streaming nodes;

Send a second streaming request to each of the candidate streaming nodes, so that each of the candidate streaming nodes establishes a fourth communication link with the streaming node, and the third communication link and the streaming node are The fourth communication link constitutes an alternative link for pulling streaming media data;

When the first communication link does not meet the preset conditions, select an alternative link to switch to the main link, pull streaming media data through the switched main link, and switch the pre-switched main link to Alternative link.

In the second aspect, this application provides a real-time streaming media data transmission method, which is applied to the target streaming node, including:

Receive the first streaming request sent by the streaming client. The first streaming request carries media stream information, the access address of the streaming client, and information about whether a backup link is supported, where the media stream information includes streaming media data. domain name;

Send a first link request carrying the media stream information to the live broadcast center, and when it is determined that the streaming client supports the backup link, send an alternative node request to the live broadcast center, and the alternative node request carries streaming media data The domain name and the access address of the streaming client;

Receive the information of the second communication link sent by the live broadcast center, and establish a second communication link with the streaming node according to the information of the second communication link;

After receiving the information of the alternative node sent by the live broadcast center, the information of the alternative node is sent to the streaming client.

In the third aspect, this application provides a real-time streaming media data transmission method, which is applied to the live broadcast center, including:

Receive a first link request and an alternative node request sent by the target streaming node, the first link request carries media stream information, and the alternative node request carries the domain name of the streaming media data and the access address of the streaming client;

When the first link request is received, information on the second communication link between the target streaming node and the streaming node is generated according to the media stream information, and the information is sent to the target streaming node. Information on the second communication link;

When receiving the alternative node request, select at least one alternative node based on the domain name of the streaming media data and the access address of the streaming client, and send the information of the alternative node to the target streaming node. .

In a fourth aspect, the present application provides an electronic device, including: a processor, and a memory communicatively connected to the processor; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory, To implement any of the above methods.

In a fifth aspect, the present application provides a computer-readable storage medium in which computer-executable instructions are stored, and when executed by a processor, the computer-executable instructions are used to implement the method provided in any of the above aspects.

In the real-time streaming media data transmission method provided by this application, by establishing communication links between the streaming client and multiple streaming nodes, and establishing communication links between the streaming nodes and the streaming nodes, multiple users are formed. For streaming links, different streaming nodes are used in different links. One link serves as the primary link and the other links serve as backup links. When the communication link between the streaming client and the streaming node in the main link does not meet the preset conditions, an alternative link is switched to the main link, and streaming media data is pulled through the switched main link. When the communication link between the streaming client and the streaming node jitters or the network is congested, the streaming node used for streaming can be switched in a timely manner, thereby avoiding the communication link between the streaming client and the streaming node. It improves the transmission quality and real-time performance of streaming media data by preventing delays, packet loss, etc. caused by jitter on the road or network congestion.

Description of the drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.

Figure 1 is an example diagram of a communication link provided by this application;

Figure 2 is a flow chart of a method for performing real-time streaming media data transmission by a streaming client provided by an embodiment of the present application;

Figure 3 is a framework diagram of the establishment process of a streaming media data transmission main link provided by this application;

Figure 4 is an example diagram of a communication link between a pull node and a push node provided by this application;

Figure 5 is an example diagram of a communication link in which a target streaming node is used as a relay node provided by this application;

Figure 6 is a flow chart of a method for performing real-time streaming media data transmission by a target streaming node provided by an embodiment of the present application;

Figure 7 is a flow chart of a method for transmitting real-time streaming media data by a live broadcast center provided by an embodiment of the present application;

Figure 8 is a flow chart of a real-time streaming media data transmission method provided by an embodiment of the present application;

Figure 9 is a schematic structural diagram of a real-time streaming media data transmission device provided by an embodiment of the present application;

Figure 10 is a schematic structural diagram of a real-time streaming media data transmission device provided by another embodiment of the present application;

Figure 11 is a schematic structural diagram of a real-time streaming media data transmission device provided by another embodiment of the present application.

Through the above-mentioned drawings, clear embodiments of the present application have been shown, which will be described in more detail below. These drawings and text descriptions are not intended to limit the scope of the present application's concepts in any way, but are intended to illustrate the application's concepts for those skilled in the art with reference to specific embodiments.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatus and methods consistent with aspects of the application as detailed in the appended claims.

First, the terms involved in this application will be explained:

Streaming client: Also called playback client, it refers to the client that pulls streams from CDN to obtain streaming media data.

Streaming node: An edge node in the CDN that establishes a communication link with the streaming client. The streaming client pulls streams from the streaming node.

Push client: A client that pushes streaming media data to CDN.

Push node: an edge node in the CDN that establishes a communication link with the push client. The push client pushes streaming media data to the push node.

In this application, in order to distinguish multiple streaming nodes corresponding to the same streaming client, the target streaming node is used to refer to the streaming node designated by the DNS server for the first time for the streaming client, and the alternative streaming node is used to refer to A streaming node that establishes a communication link with the streaming client after the target streaming node.

In order to distinguish different communication links, the first communication link refers to the communication link between the streaming client and the target streaming node. road, the second communication link refers to the communication link between the target streaming node and the streaming node, the third communication link refers to the communication link between the streaming client and the alternative streaming node, and the fourth communication link Link refers to the communication link between the candidate pull node and the push node.

In addition, the first pull request refers to the pull request sent by the pull client to the target pull node, and the second pull request refers to the pull request sent by the pull client to the alternative pull node. The first link request refers to the link request sent by the target streaming node to the live broadcast center, and the second link request refers to the link request sent by the candidate streaming node to the live broadcast center.

At present, CDN mainly includes CDN centers and nodes deployed in various places. Among them, the center of CDN includes live broadcast center, scheduling system, etc. The nodes deployed in various places are usually divided into two parts: one part is the edge node, which can usually be used as a pull node or a push node to establish communication connections with the client; the other part of the nodes is only responsible for the communication between the pull node and the push node. Relay node for the relay role.

In the traditional CDN-based streaming media data transmission method, the streaming client establishes a communication connection with a streaming node, and a single link is used for data transmission between the streaming client and the streaming node. When the communication link between streaming nodes jitters, it will cause phenomena such as stuck delays and packet loss in data transmission. The quality of streaming data transmission is poor and it is difficult to meet the real-time requirements of streaming media data transmission in RTC, RTS and other scenarios. .

The real-time streaming data transmission method provided by this application can be applied to RTS, RTC and other scenarios that require high real-time performance, such as live video broadcasts, audio and video conferencing and other scenarios. The method of this application establishes communication links between the streaming client and multiple streaming nodes, and establishes communication links between the streaming nodes and the streaming nodes to form multiple links for streaming. Different links Use different pull nodes in the road. One link serves as the primary link and the other links serve as backup links. When the communication link between the streaming client and the streaming node in the main link does not meet the preset conditions, an alternative link is switched to the main link, and streaming media data is pulled through the switched main link. When the communication link between the streaming client and the streaming node jitters or the network is congested, the streaming node used for streaming can be switched in a timely manner, thereby avoiding the communication link between the streaming client and the streaming node. It improves the transmission quality and real-time performance of streaming media data due to jitter on the road or delays and packet loss caused by network congestion.

Exemplarily, Figure 1 is an example diagram of a communication link provided by this application. As shown in Figure 1, there is a first communication link between the streaming client 100 and the streaming node 20, and the streaming node 20 and the pushing node 20 have a first communication link. There is a second communication link between the streaming nodes 30, and the first communication link and the second communication link together form a link for pulling streams. There is a third communication link between the pull client 100 and the pull node 40, and a fourth communication link between the pull node 40 and the push node 30. The third communication link and the fourth communication link together form another communication link. The link used to pull streams. Among them, the streaming node 20 and the streaming node 40 are two different edge nodes in the CDN, and the streaming client 100 establishes communication links with two different edge nodes respectively. Among the above two links used for pulling streams, one link is used as the main link and the other is used as an alternative link. The streaming client 100 pulls streaming media data through the main link and the alternative link is kept connected. status. When the first link in the main link (such as the first communication link or the third communication link) does not meet the preset conditions, the alternative link is switched to the main link, and the streaming client 100 passes the switched The main link pulls the streaming media data, switches the main link before switching to the alternative link, and enters the state of maintaining connection.

In addition, the second communication link and the fourth communication link in Figure 1 use dotted lines to indicate that in the communication link between the pull node and the push node, the pull node and the push node can be directly connected, or through a or Multiple relay nodes are connected. Figure 1 only takes the establishment of one alternative link as an example for illustration. In other examples, multiple alternative links can also be established.

The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.

FIG. 2 is a flow chart of a method for transmitting real-time streaming media data by a streaming client provided by an embodiment of the present application. As shown in Figure 2, the specific steps of this method are as follows:

Step S201: Receive information about the target streaming node provided by the DNS server, and establish a first communication link with the target streaming node.

In practical applications, when users want to play streaming media data, they access the domain name of the streaming media data through the streaming client. The streaming client sends a resolution request for the domain name of the streaming media data to the DNS server, and the DNS server resolves the stream. The domain name of the media data, and selects an edge node in the CDN as the target streaming node corresponding to the streaming client, and returns the information of the target streaming node to the streaming client.

Among them, the information of the target streaming node provided by the DNS server at least includes the IP of the target streaming node. The streaming client establishes a communication link with the target streaming node based on the IP of the target streaming node.

Step S202: Send a first pull request to the target pull node, so that the target pull node establishes a second communication link with the push node. The first communication link and the second communication link constitute a pull request. The main link for streaming data.

After establishing the first communication link with the target streaming node, the streaming client sends a first streaming request to the target streaming node through the first communication link. The first streaming request carries the media stream information of the streaming media data that the streaming client wants to pull. After receiving the first pull request, the target streaming node will parse out the media stream information and send the first link request carrying the media stream information to the CDN's live broadcast center. After receiving the first link request, the live broadcast center parses the streaming media information, determines the information of the streaming node based on the streaming media information, and generates the information of the second communication link between the target streaming node and the streaming node, Feed back the information of the second communication link to the target streaming node. The target streaming node establishes a second communication link with the streaming node based on the information of the second communication link.

The first communication link and the second communication link constitute a link between the pull client and the push node for streaming, and serve as the main link for the pull client to pull streaming media data. The communication link between the push client and the push node, together with the main link, forms a streaming media data transmission path of "push client → push node → target pull node → pull client" Full link. In addition, the second communication link between the target streaming node and the streaming node may not include a relay node, or may include at least one relay node.

After the main link is established, the streaming client can pull streaming media data through the main link.

Illustratively, taking the video live broadcast scenario as an example, the framework of the establishment process of the streaming media data transmission main link is shown in Figure 3. The anchor, as the live video publisher, publishes the collected live video data through the push streaming client 200 To a push node 30 in the CDN. When a user wants to watch a live video, he can access the domain name of the live video through the streaming client 100. For example, the domain name of the live video is "www.######.com", and the streaming client 100 will request DNS The server 11 initiates a resolution request for the live video domain name. The DNS server 11 parses the live video domain name and selects an edge node in the CDN as the target streaming node 20 corresponding to the streaming client 100, and sets the target streaming node 20 The IP is returned to the streaming client 100. The streaming client 100 establishes a first communication link with the target streaming node 20 according to the IP of the target streaming node 20 . The streaming client 100 sends a streaming request to the target streaming node 20 . After receiving the streaming request, the target streaming node 20 sends a link request to the live broadcast center 12 . The live broadcast center 12 generates the information of the second communication link between the target streaming node 20 and the streaming node 30 based on the link request, and feeds back the information of the second communication link to the target streaming node 20 . The target streaming node 20 establishes a second communication link with the streaming node 30 according to the information of the second communication link. The target streaming node 20 can pull the live video stream from the streaming node 30 through the second communication link, and send the live video stream to the streaming client 100 . The streaming client 100 plays the live video stream for viewers to watch online.

It should be noted that the second communication link between the target streaming node 20 and the streaming node 30 may not include a relay node, or may include one or more relay nodes. In FIG. 3 , the second communication link includes one The relay node 40 is taken as an example for illustrative explanation.

Step S203: Receive the information of the candidate nodes sent by the target streaming node. The information of the candidate nodes is determined by the live broadcast center and sent to the target streaming node.

In this embodiment, the live broadcast center can select one or more edge nodes from the CDN edge nodes as alternative nodes according to the request of the target streaming node, and send the information of the alternative nodes to the target streaming node. The streaming node forwards the information of the alternative nodes to the streaming client.

In addition, when the live broadcast center selects alternative nodes, it can adopt the same selection strategy as the DNS server selects the streaming node for the streaming client, which will not be described again here.

Step S204: Select at least one candidate node as a candidate streaming node according to the information of the candidate nodes, and establish a third communication link with each candidate streaming node.

After receiving the information of the candidate nodes, the streaming client selects one or more candidate nodes as the candidate streaming nodes, and establishes a communication link with each candidate streaming node, so that the streaming client communicates with multiple streaming nodes. A communication link is established with each streaming node to realize a multi-link connection method between the streaming client and multiple streaming nodes.

In one possible case, the streaming client only receives information about one candidate node. In this step, the streaming client directly uses the candidate node as the candidate streaming node and communicates with the candidate streaming node. Establish a third communication link.

Step S205: Send a second streaming request to each candidate streaming node, so that each candidate streaming node establishes a fourth communication link, a third communication link and a fourth communication link with the streaming node. The path constitutes an alternative link for pulling streaming media data.

After establishing the third communication link with the candidate streaming node, the streaming client sends a second streaming request to the candidate streaming node through the third communication link. The second pull request carries media stream information of the streaming media data that the pull client wants to pull. After receiving the second streaming request, the alternative streaming node parses out the media stream information and sends a second link request carrying the media stream information to the live broadcast center of the CDN. After receiving the second link request, the live broadcast center parses the streaming media information, determines the information of the streaming node based on the streaming media information, and generates the information of the fourth communication link between the alternative streaming node and the streaming node , feedback the information of the fourth communication link to the candidate streaming node. Alternative pull node root Establish a fourth communication link with the streaming node based on the information of the fourth communication link.

Through the third communication link and the fourth communication link, an alternative link for pulling streaming media data is established between the streaming client and the streaming node. The communication link between the push client and the push node, together with each alternative link, forms a piece of streaming media data such as "push client → push node → alternative pull node → pull client" The entire transmission link. The fourth communication link between the alternative pull node and the push node may not include a relay node, or may include at least one relay node.

After the alternative link is established, the alternative link remains connected and is temporarily not used to transmit streaming media data.

Step S206: When the first communication link does not meet the preset conditions, select an alternative link to switch to the main link, pull streaming media data through the switched main link, and switch the pre-switched main link. as an alternative link.

Among them, the preset conditions are used to constrain the quality information of the communication link. When the communication link does not meet the preset conditions, it means that the quality of the communication link is poor; when the communication link meets the preset conditions, it means that the quality of the communication link is good.

For example, the quality information of the communication link may be a quality detection result of the communication link, or a transmission quality indicator calculated based on the actual situation of the communication link transmitting streaming media data (for example, the transmission quality indicator may include lagging. rate, delay, packet loss rate), or other information that can measure the communication quality of the communication link.

The preset conditions can be set according to the requirements of the communication link between the streaming client and the streaming node in the specific application scenario. Different preset conditions can be set in different application scenarios.

In this step, the preset condition is used to constrain the quality information of the first communication link. When the first communication link between the streaming client and the target streaming node experiences jitter or network congestion, causing the first communication link to fail to meet the preset conditions, the communication quality of the first communication link can be determined. It is poor and does not meet the quality requirements of the communication link in the current application scenario. The streaming client selects an alternative link whose communication link meets the preset conditions and switches the alternative link to the main link. , pulling streaming media data through the switched main link.

After switching the main link, the streaming client switches the main link before the switch to the alternative link. The link enters the maintained connection state and is not used for the transmission of streaming media data.

It should be noted that when the link between the streaming client and the streaming node in the main link currently used to pull streaming media data does not meet the preset conditions, link switching can continue and a backup The selected link is switched to the main link, and the main link before switching is switched to the alternative link.

In this embodiment, after establishing a main link such as "pushing node → target streaming node → streaming client", at least one candidate streaming node is selected, and a "push streaming node" is established based on each candidate streaming node. An alternative link such as "streaming node → alternative streaming node → streaming client", when the communication link between the streaming client in the main link and the target streaming node does not meet the preset conditions, you can add a The alternative link that meets the preset conditions for this communication link is switched to the main link. That is, the communication link between the streaming client and a streaming node meets the preset conditions due to jitter, network congestion, etc. When conditions are met, you can switch to another streaming node in time and pull streams through the communication link between the streaming client and another streaming node, which can avoid the communication link between the streaming client and the streaming node being damaged. The transmission quality and real-time performance of streaming media data are improved due to jitter, delays, packet loss, etc. caused by network congestion.

In an optional embodiment, the attribute information of the edge node in the CDN can be configured so that the edge node has Has properties that can serve as relay nodes. In this way, more relay nodes can be selected when establishing communication links, and communication links can be directly established between two edge nodes. The combination of links is more flexible, and communication links with better communication quality can be established.

For example, in one possible situation, when the distance between the pull node and the push node to establish a communication link is very close, the pull node directly establishes a communication link (excluding relays) with the push node. node), the communication quality may be better than the communication link containing the relay node. At this time, the pull node directly establishes a communication link with the push node.

For example, as shown in Figure 4, edge node A is the pull node 20, and edge node B is the push node 30 that the pull node 20 wants to establish a communication link. The solid line (1) represents the connection between edge node A and edge node B. A directly established communication link that does not include relay nodes. The communication link composed of dotted lines (2) and (3) is another communication link based on traditional components between edge node A and edge node B. This communication link includes a relay node C. When edge node A and edge node B are very close, the communication link of the solid line (1) is better than the communication link composed of the dotted lines (2) and (3). The communication between the pull node and the push node is established. When linking, establish the communication link shown by the solid line (1).

Specifically, when the candidate streaming node establishes the fourth communication link with the streaming node, other streaming nodes or streaming nodes in the CDN may be used as relay nodes.

In one possible case, the fourth communication link between the candidate streaming node and the streaming node may not include any relay node, so that the established communication link between the candidate streaming node and the streaming node The quality of the fourth communication link is better.

In another possible situation, among the fourth communication links between each candidate pull node and the push node, at least one fourth communication link may include a relay node, and the relay node may include a relay node in the CDN. Pull streaming node or push streaming node. In this way, the link combination method is more flexible, more optional links are available when determining the fourth communication link, and the quality of the established fourth communication link can be improved.

In another possible situation, the fourth communication link between the candidate streaming node and the streaming node includes a relay node, and the relay node includes the target streaming node. In this way, when the communication quality between the streaming client and the target streaming node is poor, but the communication quality of the second communication link between the target streaming node and the pushing node is good, the streaming client can use the alternative The streaming node establishes a communication link with the target streaming node, and still uses the second communication link to pull streaming media data to improve the quality and real-time performance of streaming media data transmission.

For example, as shown in Figure 5, the dotted line (4) represents the second communication link between the target pull node 20 and the push node 30, and the dotted line (4) and the solid line (5) constitute the candidate pull node 40 and the push node. The fourth communication link between flow nodes 30. When the communication quality of the first communication link is good, the streaming client 100 can pull streaming media data through (4) and the first communication link. When the communication quality of the first communication link is poor, the streaming client 100 can pull streaming media data through (4), (5) and the third communication link.

In an optional embodiment, the streaming client can obtain the communication quality information of the first communication link and the third communication link in real time, so as to realize the connection between the streaming client and the pulling client in the main link and the alternative link. Real-time quality monitoring of this communication link between flow nodes enables timely switching to an alternative link with better communication link quality when the quality of this communication link in the main link is poor, thereby Improve the quality and real-time performance of streaming media data transmission.

Optionally, the alternative link is in a stay-connected state and has the ability to implement quality detection. The streaming client can To receive the quality detection results of the first communication link and the third communication link in real time, and based on the quality detection results and the preset conditions, the streaming client can determine the communication quality status of the first communication link and the third communication link. .

Optionally, the streaming client can calculate indicator information such as packet loss rate and delay based on the actual data transmission with the target streaming node as the communication quality information of the first communication link. In the same way, the streaming client can also calculate indicator information such as packet loss rate and delay based on the actual data transmission with the candidate streaming node as the communication quality information of the third communication link.

In an optional embodiment, the first streaming request carries media stream information, the access address of the streaming client, and information about whether the streaming client supports backup links.

The media stream information carried in the first pull request is used to generate information on the second communication link. By carrying the media stream information in the first stream pull request, the target stream pull node sends a first link request to the live broadcast center based on the media stream information after receiving the first stream pull request. After receiving the first link request, the live broadcast center will generate the information of the second communication link based on the media stream information, and feed back the information of the second communication link to the target streaming node. After receiving the information of the second communication link, the target streaming node establishes the second communication link with the streaming node.

The access address of the streaming client and information about whether the streaming client supports backup links are the information based on which candidate nodes are selected. By carrying the access address of the streaming client and information about whether the streaming client supports the backup link in the first streaming request, the target streaming node can, after receiving the first streaming request, perform a request based on whether the streaming client supports backup. The link information determines whether to request alternative node information from the live broadcast center. If the streaming client supports backup links, the target streaming node sends an alternative node request to the live broadcast center, so that the live broadcast center feeds back information about the alternative nodes to the target streaming node. After the target streaming node receives the information of the alternative node, it sends the information of the alternative node to the streaming client. In addition, if the streaming client does not support backup links, the target streaming node will not send an alternative node request to the live broadcast center.

The second pull request carries media stream information and backup link tag information. The media stream information carried in the second pull request is used to generate information on the second communication link. By carrying the media stream information in the second stream pull request, the candidate stream pull node sends a second link request to the live broadcast center based on the media stream information after receiving the second stream pull request. After receiving the second link request, the live broadcast center will generate the information of the fourth communication link based on the media stream information, and feed back the information of the fourth communication link to the alternative streaming node. After receiving the information of the fourth communication link, the candidate streaming node establishes a fourth communication link with the streaming node.

The backup link tag information is used to inform the alternative streaming node that the fourth communication link to be established belongs to the alternative link, and there is no need to request information about the alternative node.

By carrying different information in the streaming requests sent to the target streaming node and the alternative streaming node, the target streaming node has the ability to obtain the information of the alternative streaming node, and the alternative streaming node can be established and pushed normally. Communication links between nodes without unnecessary processing of requesting alternative node information.

In an optional embodiment, the information of the candidate node may include the access address (IP) and selection priority of the candidate node.

Among them, the alternative node is determined by the live broadcast center based on the IP of the alternative streaming node, combined with at least one of the information such as the location of the edge node in the CDN, its operator, load and health status, to determine the communication quality with the streaming client. better side edge node. The selection priority refers to the priority of the candidate node selected as the candidate streaming node.

After receiving the information of the alternative nodes, the streaming client can selectively select at least one alternative node as the alternative streaming node based on the selection priority of the alternative nodes, thereby establishing a third communication link with higher communication quality.

When establishing a third communication link with each candidate streaming node, the streaming client establishes a third communication link with each candidate streaming node based on the access address of each candidate streaming node.

Figure 6 is a flow chart of a method for performing real-time streaming media data transmission by a target streaming node provided by an embodiment of the present application. As shown in Figure 6, the specific steps of this method are as follows:

Step S601: Receive the first streaming request sent by the streaming client. The first streaming request carries media stream information, the access address of the streaming client, and information about whether a backup link is supported, where the media stream information includes the streaming media data. domain name.

The media stream information carried in the first pull request is used to generate information on the second communication link.

The access address of the streaming client and information about whether the streaming client supports backup links are used to determine information about alternative nodes.

After receiving the first streaming request, the target streaming node parses the first streaming request to obtain the media stream information carried therein, the access address of the streaming client, and information about whether backup links are supported.

Step S602: Send a first link request carrying media stream information to the live broadcast center.

After parsing the media stream information, the target streaming node can send the first link request carrying the media stream information to the live broadcast center. After receiving the first link request, the live broadcast center will generate the information of the second communication link based on the media stream information, and feed back the information of the second communication link to the target streaming node.

Step S603: When it is determined that the streaming client supports the backup link, an alternative node request is sent to the live broadcast center. The alternative node request carries the domain name of the streaming media data and the access address of the streaming client.

After parsing the information about whether the streaming client supports backup links, confirming that the streaming client supports backup links, and parsing the access address of the streaming client and the domain name of the streaming media data in the media streaming information, the target pull stream The node sends an alternative node request to the live broadcast center. After receiving the alternative node request, the live broadcast center selects the target streaming node based on the domain name of the streaming media data and the access address of the streaming client, combined with the location, operator, load and health status of the edge node in the CDN. The alternative edge node is used as an alternative node, and the information of the alternative node is fed back to the target streaming node.

Step S604: Receive the information of the second communication link sent by the live broadcast center, and establish a second communication link with the streaming node according to the information of the second communication link.

The information of the second communication link includes path information of the second communication link, and may specifically include address information of each hop node in the second communication link.

After receiving the information of the second communication link, the target streaming node establishes a second communication link with the streaming node based on the information of the second communication link.

Step S605: After receiving the information of the alternative node sent by the live broadcast center, send the information of the alternative node to the streaming client.

After the target streaming node receives the information of the alternative node, it sends the information of the alternative node to the streaming client, so that The streaming client selects at least one candidate node as a candidate streaming node based on the information of the candidate streaming node, establishes a third communication link with each candidate streaming node, and sends a third communication link to each candidate streaming node. The second pull request is to enable each candidate pull node to establish a fourth communication link with the push node, thus solidifying the establishment of at least one candidate link.

In this embodiment, the target streaming node can request the information of the alternative nodes from the live broadcast center, and send the received information of the alternative nodes to the streaming client, thereby providing at least one alternative node to the streaming client, causing the streaming client to select at least one candidate node as an alternative streaming node, establish a third communication link, and request the alternative streaming node to establish a fourth communication link with the streaming node, the third communication link The route and the fourth communication link together form an alternative link. When the communication link between the streaming client and the target streaming node in the main link does not meet the preset conditions due to jitter, network congestion, etc., the streaming client can make this communication link meet the preset conditions. The alternative link of the condition is switched to the main link, thereby switching the alternative streaming node used to pull streaming media data in a timely manner, which can avoid jitter or network failure in the communication link between the streaming client and the streaming node. Stuttering delays, packet loss and other conditions caused by congestion improve the transmission quality and real-time performance of streaming media data.

In an optional implementation, the fourth communication link includes a relay node, and the relay node includes a target streaming node.

In a possible situation, in the fourth communication link, the target streaming node is a relay node directly connected to the alternative streaming node. The fourth communication link can be expressed as "alternative streaming node ← target streaming node Node ←…←Push node”, where the direction of the arrow indicates the flow direction of streaming media data when pulling streams. The target pull node and the push node may not include a relay node, or may include at least one other relay node.

As a relay node, the target streaming node can receive the streaming link establishment request sent by the alternative streaming node, and establish a communication link with the alternative streaming node; parse the streaming link establishment request to obtain the fourth communication carried by it According to the information of the fourth communication link, a pull link establishment request is sent to the next node in the fourth communication link to establish a communication link with the next node.

Specifically, according to the fourth communication link information, the target streaming node can determine the information of the next node that needs to establish a connection. When establishing the fourth communication link, a communication link between two adjacent nodes is established sequentially in the order of "alternative streaming node → target streaming node → ... → streaming node". The next node refers to the "backup streaming node". Select the next node in the link "Pull Node → Target Pull Node → ... → Push Node" to the target pull node in the direction of the arrow, which may be a relay node or a push node.

In this way, the target streaming node serves as a relay node in the fourth communication link. The communication quality of the communication link between the streaming client and the target streaming node is poor, but the communication quality between the target streaming node and the pushing node is poor. When the communication quality of the second communication link is very good, the streaming client can establish a connection with the target streaming node through the alternative streaming node, and still use the second communication link with good communication quality to pull streaming media data. To establish a fourth communication link with better communication quality.

Figure 7 is a flow chart of a method for transmitting real-time streaming media data by a live broadcast center provided by an embodiment of the present application. The real-time streaming media data transmission method provided in this embodiment can be specifically applied to the live broadcast center in the CDN. As shown in Figure 7, the specific steps of this method are as follows:

Step S701: Receive a first link request and an alternative node request sent by the target streaming node. The first link request carries media stream information, and the alternative node request carries the domain name of the streaming media data and the access address of the streaming client.

Step S702: When receiving the first link request, generate the information of the second communication link between the target streaming node and the streaming node according to the media stream information, and send the information of the second communication link to the target streaming node. .

After receiving the first link request carrying media stream information, the live broadcast center generates the information of the second communication link based on the media stream information, and feeds back the information of the second communication link to the target streaming node, so that the target pulls the stream The node establishes a second communication link with the streaming node according to the information of the second communication link.

Step S703: When an alternative node request is received, at least one alternative node is selected based on the domain name of the streaming media data and the access address of the streaming client, and information about the alternative node is sent to the target streaming node.

The information of the candidate node at least includes the access address of the candidate node, so that the streaming client can establish a communication link with the candidate node based on the access address of the candidate node.

When receiving the alternative node request, the live broadcast center selects at least one edge node from the CDN that can be an alternative to the target streaming node based on the domain name of the streaming media data and the access address of the streaming client as the alternative node, and Send the information of the alternative node to the target streaming node, so that the target streaming node forwards the information of the alternative node to the streaming client. After receiving the information of the candidate nodes, the streaming client will select at least one candidate node as the candidate streaming node based on the information of the candidate nodes, establish a third communication link with each candidate streaming node, and send Each candidate streaming node sends a second streaming request, so that each candidate streaming node establishes a fourth communication link with the streaming node, thereby achieving the establishment of at least one candidate link.

In this embodiment, the live broadcast center has the function of selecting and providing information about alternative nodes, so that the streaming client establishes a third communication link with at least one alternative streaming node among the alternative nodes, and requests the alternative streaming node. The node establishes a fourth communication link with the streaming node, and the second communication link and the fourth communication link constitute an alternative link for pulling streaming media data. When the communication link between the streaming client and the target streaming node in the main link does not meet the preset conditions due to jitter, network congestion, etc., the streaming client can make this communication link meet the preset conditions. The alternative link of the condition is switched to the main link, thereby switching to the alternative streaming node in a timely manner, which can avoid delays caused by jitter in the communication link between the streaming client and the streaming node or network congestion. , packet loss, etc., which improves the transmission quality and real-time performance of streaming media data.

In an optional embodiment, at least one candidate node is selected based on the domain name of the streaming media data and the access address of the streaming client. Specifically, it can be implemented in the following manner:

According to the access address of the streaming client, as well as the location information, operator information, load information and health status information of the edge node in the CDN, at least one edge node is selected as a backup from the edge nodes covered by the scheduling domain of the domain name of the streaming media data. Select node.

Specifically, the scheduling domain of the domain name of the streaming media data can be determined according to the domain name of the streaming media data, and then the edge nodes covered by the scheduling domain in the CDN are determined. Among these edge nodes, the streaming client is determined according to the access address of the streaming client. Based on the location of the client and the operator it belongs to, combined with the location information, operator information, load information and health status information of the edge node in the CDN, the edge node with better communication quality with the streaming client can be selected as an alternative node.

For example, in the edge node covered by the scheduling domain of the domain name of the streaming media data, the streaming client can be The access address can determine the location and operator of the streaming client. Combined with the location information and operator information of the edge node in the CDN, the edge node in the same area of the same operator as the streaming client is determined, and then based on The load information and health status information select edge nodes with less load and better health status as alternative nodes.

Among them, the area where the edge node is located can be divided geographically according to administrative regions, cities, etc., or in other ways, and there is no specific limit here.

In this embodiment, the live broadcast center can select an edge node with less load and better health status as an alternative node for the streaming client, so that the communication quality can be established between the streaming client and each alternative node. third communication link.

In an optional embodiment, the live broadcast center sends alternative node information to the target streaming node, which specifically includes:

Obtain the access address of the alternative node, and determine the selection priority of the alternative node based on the access address of the streaming client, as well as the location information, operator information, load information and health status information of the alternative node; pull streams to the target The node sends the access address and selection priority of the alternative node.

In this embodiment, the live broadcast center can determine and provide the selection priority of the alternative node, so that the streaming client can selectively select the alternative streaming node according to the selection priority of the alternative node.

In an optional embodiment, the live broadcast center may also provide the required fourth communication link information to the candidate streaming node to assist the candidate streaming node and the streaming node in establishing the fourth communication link.

Specifically, the live broadcast center receives the second link request sent by the alternative streaming node, and the second link request carries media stream information and backup link mark information. When the live broadcast center parses the second link request and can obtain the backup link tag information, it can determine that the communication link information requested by the link request is used to establish the fourth communication link among the alternative links, without To obtain the information of the alternative node, only the information of the fourth communication link is generated and fed back.

Further, the live broadcast center generates information about the fourth communication link between the candidate streaming node and the streaming node according to the media stream information, and sends the information about the fourth communication link to the candidate streaming node.

By carrying backup link tag information in the second link request sent by the alternative streaming node, the live broadcast center can be informed that the current link request is a request from the alternative streaming node and the requested communication link information It is used to establish the fourth communication link among the alternative links. The live broadcast center does not need to feed back the information of the alternative nodes, so as to distinguish the link requests of the alternative streaming nodes and the target streaming nodes.

In an optional embodiment, the attribute information of the edge node in the CDN can be configured so that the edge node has attributes that can serve as a relay node. In this way, more relay nodes can be selected when establishing communication links, and communication links can be directly established between two edge nodes. The combination of links is more flexible and can improve the quality of the established communication links.

Specifically, when generating the information of the fourth communication link between the alternative pull node and the push node based on the media flow information, the live broadcast center can, based on the media flow information, use the pull node or the push node in the content distribution network to The node serves as an available relay node and generates information of the fourth communication link.

In one possible case, in the generated information about the fourth communication link, the fourth communication link may not include any relay node, so as to determine the fourth communication link with better communication quality.

In another possible situation, in the generated information of the fourth communication link, the fourth communication link may include relay nodes, and these relay nodes include pull nodes or push nodes in the CDN. In this way, The combination method of the fourth communication link is more flexible, there are more optional links, and the fourth communication link with better communication quality can be determined.

In another possible situation, when generating the information of the fourth communication link, the target streaming node can be used as a relay node, and "alternative streaming node ← target streaming node ←...← streaming node" can be established like this A fourth communications link. When the communication quality between the pull client and the target pull node is poor, but the communication quality of the second communication link between the target pull node and the push node is good, the pull client can use the alternative pull The streaming node establishes a connection with the target streaming node, and still uses the second communication link with good communication quality to pull streaming media data to establish a fourth communication link with better communication quality.

Figure 8 is a flow chart of a real-time streaming media data transmission method provided by an embodiment of the present application. As shown in Figure 8, the specific steps of this method are as follows:

Step S801: The streaming client receives the information of the target streaming node provided by the DNS server.

Step S802: The streaming client establishes a first communication link with the target streaming node.

Step S803: The streaming client sends a first streaming request to the target streaming node.

The first streaming request carries media stream information, the access address of the streaming client, and information about whether a backup link is supported. The media stream information includes the domain name of the streaming media data.

Step S804: The target streaming node sends a first link request carrying media stream information to the live broadcast center.

Among them, the first link request carries media stream information.

Step S805: When the target streaming node determines that the streaming client supports the backup link, it sends an alternative node request to the live broadcast center.

Among them, the alternative node requests the domain name carrying the streaming media data and the access address of the streaming client.

Step S806: When receiving the first link request, the live broadcast center generates information on the second communication link between the target streaming node and the streaming node according to the media stream information.

Step S807: The live broadcast center sends the information of the second communication link to the target streaming node.

Step S808: The target streaming node establishes a second communication link with the streaming node according to the information of the second communication link. The first communication link and the second communication link constitute the main link for pulling streaming media data.

Step S809: When receiving an alternative node request, the live broadcast center selects at least one alternative node based on the domain name of the streaming media data and the access address of the streaming client.

Step S810: The live broadcast center sends the information of the candidate node to the target streaming node.

Step S811: After receiving the information of the alternative node sent by the live broadcast center, the target streaming node sends the information of the alternative node to the streaming client.

Step S812: The streaming client selects at least one candidate node as an alternative streaming node based on the information of the candidate nodes.

Step S813: The streaming client establishes a third communication link with the candidate streaming node.

Step S814: The streaming client sends a second streaming request to the candidate streaming node.

The second pull request carries media stream information and backup link tag information.

Step S815: The live broadcast center generates information about the fourth communication link between the candidate streaming node and the streaming node according to the media stream information.

Step S816: The live broadcast center sends the information of the fourth communication link to the candidate streaming node.

Step S817: The alternative pull node establishes a fourth communication link with the push node based on the information of the fourth communication link. The third communication link and the fourth communication link constitute an alternative link for pulling streaming media data. .

Step S818: When the first communication link does not meet the preset conditions, select an alternative link to switch to the main link, pull streaming media data through the switched main link, and switch the pre-switched main link. as an alternative link.

In this embodiment, the specific implementation of each step can be found in the previous embodiments, and will not be described again here.

Figure 9 is a schematic structural diagram of a real-time streaming media data transmission device provided by an embodiment of the present application. The device provided by this embodiment is applied to a streaming client. As shown in Figure 9, the real-time streaming media data transmission device 90 includes: communication Module 91, alternative link establishment module 92 and link switching module 93.

Among them, the communication module 91 is used to receive the information of the target streaming node provided by the DNS server, establish a first communication link with the target streaming node, and send a first streaming request to the target streaming node, so that the target streaming node is established With the second communication link between the streaming node and the first communication link and the second communication link, the first communication link and the second communication link constitute the main link for pulling streaming media data; receiving the information of the alternative node sent by the target streaming node, and preparing The node selection information is determined by the live broadcast center and sent to the target streaming node.

The alternative link establishment module 92 is configured to select at least one candidate node as an alternative streaming node according to the information of the candidate node, and establish a third communication link with each candidate streaming node.

The communication module 91 is also configured to send a second streaming request to each candidate streaming node, so that each candidate streaming node establishes a fourth communication link with the streaming node, the third communication link and the third communication link. Four communication links constitute alternative links for pulling streaming media data.

The link switching module 93 is used to select an alternative link to switch to the main link when the first communication link does not meet the preset conditions, pull streaming media data through the switched main link, and transfer the pre-switched link to the main link. The primary link is switched to the backup link.

In an optional embodiment, at least one fourth communication link includes a relay node, and the relay node includes a pull node or a push node in the content distribution network.

In an optional embodiment, the relay node includes a target streaming node.

In an optional embodiment, the communication module is also configured to obtain communication quality information of the first communication link and the third communication link in real time.

In an optional embodiment, the first streaming request carries media stream information, the access address of the streaming client, and information about whether the streaming client supports backup links; the second streaming request carries media stream information and backup links. Tag information.

In an optional embodiment, the information of the candidate node includes the access address and selection priority of the candidate node,

When implementing the method of selecting at least one candidate node as an alternative streaming node based on the information of the candidate node, the alternative link establishment module is also used to: select at least one candidate node as a backup node based on the selection priority of the candidate node. Select the streaming node.

When establishing the third communication link with each candidate streaming node, the candidate streaming node determination module is also used to: root According to the access address of each candidate streaming node, a third communication link is established with each candidate streaming node.

The device provided in this embodiment can be specifically used to execute the solution executed by the streaming client in any of the above method embodiments. The specific functions and technical effects that can be achieved will not be described again here.

Figure 10 is a schematic structural diagram of a real-time streaming media data transmission device provided by another embodiment of the present application. The device provided by this embodiment is applied to the target streaming node. As shown in Figure 10, the real-time streaming media data transmission device 1000 includes : Communication module 1001, alternative node request module 1002 and link establishment module 1003.

The communication module 1001 is configured to receive a first streaming request sent by a streaming client. The first streaming request carries media stream information, the access address of the streaming client, and information about whether a backup link is supported, where the media stream information includes streaming media. The domain name of the data.

The communication module 1001 is also used to send a first link request carrying media stream information to the live broadcast center.

The alternative node request module 1002 is configured to send an alternative node request to the live broadcast center when it is determined that the streaming client supports the backup link. The alternative node request carries the domain name of the streaming media data and the access address of the streaming client.

The communication module 1001 is also used to receive the information of the second communication link sent by the live broadcast center.

The link establishment module 1003 is configured to establish a second communication link with the streaming node according to the information of the second communication link.

The communication module 1001 is also configured to send the information of the alternative node to the streaming client after receiving the information of the alternative node sent by the live broadcast center.

In an optional embodiment, the communication module is also configured to receive a pull link establishment request sent by the alternative pull node, where the pull link establishment request carries a fourth communication link between the alternative pull node and the push node. The fourth communication link includes a relay node, and the relay node includes a target streaming node;

The link establishment module is also used to establish communication links with alternative streaming nodes.

The communication module is also configured to send a pull link establishment request to the next node in the fourth communication link according to the information of the fourth communication link.

The link establishment module is also used to establish a communication link with the next node.

The device provided in this embodiment can be specifically used to execute the solution executed by the target streaming node in any of the above method embodiments. The specific functions and achievable technical effects will not be described again here.

Figure 11 is a schematic structural diagram of a real-time streaming media data transmission device provided by another embodiment of the present application. The device provided by this embodiment is applied to the live broadcast center of a CDN. As shown in Figure 11, the real-time streaming media data transmission device 1100 includes : Communication module 1101, link information generation module 1102 and candidate node determination module 1103.

The communication module 1101 is used to receive a first link request and an alternative node request sent by the target streaming node. The first link request carries media stream information, and the alternative node request carries the domain name of the streaming media data and the access address of the streaming client. .

The link information generation module 1102 is configured to, when receiving the first link request, generate information on the second communication link between the target pull node and the push node according to the media stream information.

The communication module 1101 is also used to send the information of the second communication link to the target streaming node.

The alternative node determination module 1103 is configured to, when receiving an alternative node request, select at least one alternative node based on the domain name of the streaming media data and the access address of the streaming client.

The communication module 1101 is also used to send information about alternative nodes to the target streaming node.

In an optional embodiment, when selecting at least one alternative node based on the domain name of the streaming media data and the access address of the streaming client, the alternative node determination module is also used to:

According to the access address of the streaming client, as well as the location information, operator information, load information and health status information of the edge nodes in the content distribution network, multiple edge nodes are selected from the edge nodes covered by the scheduling domain of the domain name of the streaming media data. as an alternative node.

In an optional embodiment, the alternative node determination module 1103 is also used to obtain the access address of the alternative node, and based on the access address of the streaming client, as well as the location information, operator information, load information and Health status information determines the selection priority of alternative nodes.

When implementing information about sending alternative nodes to the target streaming node, it includes:

The communication module 1101 is also used to send the access address and selection priority of the alternative node to the target streaming node.

In an optional embodiment, the communication module is also configured to receive a second link request sent by the alternative streaming node, where the second link request carries media stream information and backup link tag information.

The link information generation module is also configured to generate information on a fourth communication link between the candidate streaming node and the streaming node based on the media stream information, and send the information on the fourth communication link to the candidate streaming node.

In an optional embodiment, when generating information about the fourth communication link between the alternative pull node and the push node based on the media stream information, the link information generation module is also used to:

According to the media stream information, the pull node or the push node in the content distribution network is used as an available relay node to generate information of the fourth communication link.

In an optional embodiment, when generating information about the fourth communication link between the alternative pull node and the push node based on the media stream information, the link information generation module is also used to:

According to the media stream information, the target streaming node is used as a relay node to generate information of the fourth communication link.

The device provided in this embodiment can be specifically used to execute the solution executed by the live broadcast center in any of the above method embodiments. The specific functions and the technical effects that can be achieved will not be described again here.

This application also provides electronic equipment for realizing real-time streaming data transmission, including equipment loaded with streaming clients, edge nodes in CDN as target streaming nodes, or CDN live broadcast centers.

This application provides a device loaded with a streaming client, including: a processor, and a memory communicatively connected to the processor. The memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to implement any of the above methods. The solution implemented by the streaming client in the example, the specific functions and the technical effects it can achieve will not be described again here.

This application provides an edge node, including: a processor, and a memory communicatively connected to the processor. The memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to achieve the target flow in any of the above method embodiments. The solutions implemented by the nodes, the specific functions and the technical effects that can be achieved will not be described again here.

This application provides a live broadcast center, including: a processor, and a memory communicatively connected to the processor. The memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to implement any of the above methods. The solution implemented by the live broadcast center in the embodiment, the specific functions and the technical effects that can be achieved will not be described again here.

This application also provides a computer-readable storage medium. Computer-executable instructions are stored in the computer-readable storage medium. When executed by the processor, the computer-executable instructions are used to implement the streaming client and target streaming in any of the above method embodiments. The solutions implemented by nodes or live broadcast centers, the specific functions and the technical effects that can be achieved will not be described again here.

This application also provides a computer program product. The computer program product includes: a computer program. The computer program is stored in a readable storage medium. At least one processor of the electronic device can read the computer program from the readable storage medium. At least one processor The computer program is executed by the computer so that the electronic device executes the solution executed by the streaming client, the target streaming node, or the live broadcast center in any of the above method embodiments. The specific functions and the technical effects that can be achieved will not be described in detail here. The specific functions And the technical effects that can be achieved will not be repeated here.

In addition, some of the processes described in the above embodiments and drawings include multiple operations that appear in a specific order, but it should be clearly understood that these operations may not be performed in the order in which they appear in this document or may be performed in parallel. , is only used to distinguish different operations, and the sequence number itself does not represent any execution order. Additionally, these processes may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that the descriptions such as "first" and "second" in this article are used to distinguish different messages, devices, modules, etc., and do not represent the order, nor do they limit "first" and "second" are different types. "Plural" means more than two, unless otherwise clearly and specifically limited.

Other embodiments of the present application will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary technical means in the technical field that are not disclosed in this application. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.

It is to be understood that the present application is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims (16)

1. A real-time streaming media data transmission method, which is characterized in that it is applied to the streaming client and includes:

   Receive the information of the target streaming node provided by the DNS server, and establish a first communication link with the target streaming node;

   Send a first pull request to the target pull node, so that the target pull node establishes a second communication link with the push node, the first communication link and the second communication link Constitute the main link used to pull streaming media data;

   Receive information about alternative nodes sent by the target streaming node, where the information about the alternative nodes is determined by the live broadcast center and sent to the target streaming node;

   According to the information of the candidate nodes, select at least one candidate node as an alternative streaming node, and establish a third communication link with each of the candidate streaming nodes;

   Send a second streaming request to each of the candidate streaming nodes, so that each of the candidate streaming nodes establishes a fourth communication link with the streaming node, and the third communication link and the streaming node are The fourth communication link constitutes an alternative link for pulling streaming media data;

   When the first communication link does not meet the preset conditions, select an alternative link to switch to the main link, pull streaming media data through the switched main link, and switch the pre-switched main link to Alternative link.
2. The method according to claim 1, characterized in that at least one of the fourth communication links includes a relay node, and the relay node includes a pull node or a push node in a content distribution network.
3. The method according to claim 2, characterized in that the relay node includes the target streaming node.
4. The method according to claim 1, further comprising:

   Communication quality information of the first communication link and the third communication link is obtained in real time.
5. The method according to claim 1, characterized in that the first streaming request carries media stream information, the access address of the streaming client, and information about whether the streaming client supports a backup link;

   The second pull request carries media stream information and backup link tag information.
6. The method according to any one of claims 1-5, characterized in that the information of the candidate node includes the access address and selection priority of the candidate node,

   Selecting at least one alternative node as an alternative streaming node based on the information of the alternative node includes:

   Select at least one alternative node as an alternative streaming node according to the selection priority of the alternative node;

   The establishing a third communication link with each of the candidate streaming nodes includes:

   Establish a third communication link with each candidate streaming node according to the access address of each candidate streaming node.
7. A real-time streaming media data transmission method, which is characterized in that it is applied to the target streaming node and includes:

   Receive the first streaming request sent by the streaming client. The first streaming request carries media stream information, the access address of the streaming client, and information about whether a backup link is supported, where the media stream information includes streaming media data. domain name;

   Send a first link request carrying the media stream information to the live broadcast center, and when it is determined that the streaming client supports the backup link, send an alternative node request to the live broadcast center, and the alternative node request carries streaming media data The domain name and the access address of the streaming client;

   Receive the information of the second communication link sent by the live broadcast center, and establish a second communication link with the streaming node based on the information of the second communication link;

   After receiving the information of the alternative node sent by the live broadcast center, the information of the alternative node is sent to the streaming client.
8. The method according to claim 7, characterized in that after establishing the second communication link with the streaming node according to the information of the second communication link, it further includes:

   Receive a streaming link establishment request sent by an alternative streaming node. The streaming link establishment request carries information about a fourth communication link between the alternative streaming node and the streaming node. The fourth communication The link includes a relay node, and the relay node includes the target streaming node;

   Establish a communication link with the alternative streaming node;

   According to the information of the fourth communication link, send a pull link establishment request to the next node in the fourth communication link;

   Establish a communication link with the next node.
9. A real-time streaming media data transmission method, characterized in that it is applied to a live broadcast center and includes:

   Receive a first link request and an alternative node request sent by the target streaming node, the first link request carries media stream information, and the alternative node request carries the domain name of the streaming media data and the access address of the streaming client;

   When the first link request is received, information on the second communication link between the target streaming node and the streaming node is generated according to the media stream information, and the information is sent to the target streaming node. Information on the second communication link;

   When receiving the alternative node request, select at least one alternative node based on the domain name of the streaming media data and the access address of the streaming client, and send the information of the alternative node to the target streaming node. .
10. The method according to claim 9, characterized in that selecting at least one candidate node based on the domain name of the streaming media data and the access address of the streaming client includes:

    According to the access address of the streaming client and at least one of the location information of the edge node in the content distribution network, operator information, load information and health status information, the scheduling domain coverage of the domain name of the streaming media data is Select at least one edge node from the edge nodes as a candidate node.
11. The method according to claim 10, characterized in that said sending the information of the candidate node to the target streaming node includes:

    Obtain the access address of the alternative node, and determine the access address of the alternative node based on the access address of the streaming client and the location information, operator information, load information and health status information of the alternative node. Select priority;

    Send the access address and selection priority of the candidate node to the target streaming node.
12. The method according to any one of claims 9-11, further comprising:

    Receive a second link request sent by the alternative streaming node, where the second link request carries media stream information and backup link tag information;

    Generate information on the fourth communication link between the candidate streaming node and the streaming node according to the media stream information, Send the information of the fourth communication link to the candidate streaming node.
13. The method according to claim 12, wherein generating, according to the media stream information, information about the fourth communication link between the candidate streaming node and the streaming node includes:

    According to the media stream information, the pull node or the push node in the content distribution network is used as an available relay node to generate the information of the fourth communication link.
14. The method according to claim 13, characterized in that generating information about the fourth communication link between the candidate streaming node and the streaming node according to the media stream information includes:

    According to the media stream information, the target streaming node is used as a relay node to generate information of the fourth communication link.
15. An electronic device, characterized by comprising: a processor, and a memory communicatively connected to the processor;

    The memory stores computer execution instructions;

    The processor executes computer-executable instructions stored in the memory to implement the method according to any one of claims 1-14.
16. A computer-readable storage medium, characterized in that computer-executable instructions are stored in the computer-readable storage medium, and when executed by a processor, the computer-executable instructions are used to implement any one of claims 1-14. method described.