WO2023061060A1 - Procédé de planification de flux de codes audio et vidéo, système, support et appareil électronique - Google Patents

Procédé de planification de flux de codes audio et vidéo, système, support et appareil électronique Download PDF

Info

Publication number
WO2023061060A1
WO2023061060A1 PCT/CN2022/114618 CN2022114618W WO2023061060A1 WO 2023061060 A1 WO2023061060 A1 WO 2023061060A1 CN 2022114618 W CN2022114618 W CN 2022114618W WO 2023061060 A1 WO2023061060 A1 WO 2023061060A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
streaming media
media service
service node
code stream
Prior art date
Application number
PCT/CN2022/114618
Other languages
English (en)
Chinese (zh)
Inventor
华新海
王晶晶
江涛
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2023061060A1 publication Critical patent/WO2023061060A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests

Definitions

  • the present disclosure relates to the field of audio and video stream scheduling, and in particular, to a scheduling method, system, medium and electronic device for audio and video streams.
  • CDN Content Delivery Network
  • the operation and management personnel Before pushing the audio and video code stream, the operation and management personnel need to successfully create a channel on the management platform in advance, and the player requests the service from the streaming media service node specified by the channel, otherwise, the player will not be able to play the audio without the channel Video stream. If a certain streaming media service node is abnormal during playback, the operation and management personnel need to restore the streaming media service node in time or recreate the channel on the management platform to notify the live broadcast front-end to push the stream to the new streaming media service node, otherwise it will As a result, channels distributed on the streaming media service and nodes cannot be played. In addition, in the related technical solution, when the management platform is abnormal, there may be a problem of being unable to access new channels, which affects the user experience of the user.
  • Embodiments of the present disclosure provide a method, system, medium, and electronic device for scheduling audio and video code streams, so as to at least solve the problem in the related art that it is impossible to realize the scheduling of audio and video code streams while reducing the dependence on manual management.
  • the problem of intelligent scheduling is a problem that it is impossible to realize the scheduling of audio and video code streams while reducing the dependence on manual management.
  • a method for scheduling audio and video code streams which is applied to a content scheduling node, including: obtaining key information from the received audio and video code streams, and determining the key information according to the key information
  • the channel identifier of the audio and video code stream determine the target streaming service node corresponding to the channel identifier of the audio and video code stream according to the first correspondence, wherein the channel identifier and the streaming media service node are stored in the content scheduling node
  • the first corresponding relationship when the online status of the target streaming media service node is online, push the audio and video code stream to the target streaming media service node.
  • a scheduling system for audio and video streams including: a content scheduling node, and a plurality of streaming media service nodes connected to the content scheduling node, wherein the content scheduling node
  • the node is configured to parse key information from the received audio and video code stream, and determine the channel identifier of the audio and video code stream according to the key information; and determine the channel of the audio and video code stream according to the first correspondence Identify the corresponding target streaming media service node, and push the audio and video code stream to the target streaming media service node when the online status of the target streaming media service node is online, wherein the content
  • the scheduling node stores the first corresponding relationship between the channel identifier and the streaming media service node.
  • a computer-readable storage medium where a computer program is stored in the computer-readable storage medium, wherein the computer program is configured to execute the above-mentioned audio and video code when running.
  • the scheduling method for the stream is also provided.
  • an electronic device including a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the above-mentioned sound through the computer program.
  • the scheduling method of the video code stream including a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the above-mentioned sound through the computer program.
  • the content scheduling node determines the target streaming media service node corresponding to the channel ID of the audio and video stream according to the first correspondence, wherein the content scheduling node stores the channel ID and the streaming media service node A first correspondence; and when the online status of the target streaming media service node is online, pushing the audio and video code stream to the target streaming media service node.
  • Fig. 1 is a schematic diagram of a scheduling system of audio and video streams in the related art
  • FIG. 2 is a block diagram of the hardware structure of a content scheduling node executing a scheduling method for audio and video code streams according to an embodiment of the present disclosure
  • FIG. 3 is a flowchart (1) of a method for scheduling audio and video code streams according to an embodiment of the present disclosure
  • FIG. 4 is a schematic diagram of a scheduling system for implementing an audio and video code stream according to an embodiment of the present disclosure
  • FIG. 5 is a flowchart (2) of a method for scheduling audio and video code streams according to an embodiment of the present disclosure
  • FIG. 6 is a flowchart (3) of a method for scheduling audio and video code streams according to an embodiment of the present disclosure
  • FIG. 7 is a schematic structural diagram of a system for scheduling audio and video streams according to an embodiment of the disclosure.
  • CDN Content Delivery Network
  • CDN Content Delivery Network
  • VR Virtual Reality, Virtual Reality
  • VR Virtual Reality, Virtual Reality
  • VR is a computer-generated, interactive three-dimensional environment that comprehensively utilizes computer graphics systems and various reality and control interface devices.
  • AR Augmented Reality
  • Augmented Reality is a technology that calculates the position and angle of the camera image in real time and adds the corresponding image.
  • UGC User Generated Content, User Generated Content
  • User Generated Content is an emerging network information resource creation and organization model in the Web environment, that is, users display or provide personally edited content to other users through the Internet platform.
  • RTMP Real Time Messaging Protocol, Real-time Message Transmission Protocol
  • TCP Transmission Control Protocol
  • RTMP basic protocol and other variant protocols used for real-time data communication
  • application software and standard protocols such as support
  • the software of this protocol includes Adobe, and the standard protocol supported is Adobe's Real Time Messaging Protocol.
  • RTSP Real Time Streaming Protocol, real-time streaming protocol
  • RFC2326 Real Time Streaming Protocol, real-time streaming protocol
  • FLV Flash Video, streaming media format
  • FLV Flash Video, streaming media format
  • HLS HTTP Live Streaming
  • RFC8216 HTTP Live Streaming
  • URL Uniform/Universal Resource Locator, Uniform Resource Locator
  • Uniform Resource Locator is a representation of the location and access method of resources that can be obtained from the Internet.
  • FIG. 2 is a block diagram of a hardware structure of a content scheduling node executing a method for scheduling audio and video code streams according to an embodiment of the present disclosure.
  • the content scheduling node may include one or more (only one is shown in FIG.
  • processor 202 may include but not limited to a microprocessor (MicroprocessorUnit, MPU for short) or programmable logic device (Programmable logic device, PLD for short)) and a memory 204 configured to store data
  • the content scheduling node may further include a transmission device 206 and an input/output device 208 configured as a communication function.
  • the structure shown in FIG. 2 is only for illustration, and it does not limit the structure of the above-mentioned content scheduling node.
  • the content scheduling node may also include more or fewer components than those shown in FIG. 2, or have a different configuration with functions equivalent to those shown in FIG. 2 or more functions than those shown in FIG.
  • the memory 204 can be set to store computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the scheduling method of audio and video code streams in the embodiments of the present disclosure, and the processor 202 runs the computer program stored in the memory 204 program, so as to execute various functional applications and data processing, that is, to realize the above-mentioned method.
  • the memory 204 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.
  • memory 204 may further include memory located remotely from processor 202, and these remote memories may be connected to content scheduling nodes through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the transmission device 206 is arranged to receive or transmit data via a network.
  • the specific example of the above network may include a wireless network provided by the communication provider of the content scheduling node.
  • the transmission device 206 includes a network interface controller (NIC for short), which can be connected to other network devices through a base station so as to communicate with the Internet.
  • the transmission device 206 may be a radio frequency (Radio Frequency, referred to as RF) module, which is configured to communicate with the Internet in a wireless manner.
  • RF radio frequency
  • FIG. 3 is a flow chart (1) of a method for scheduling audio and video code streams according to an embodiment of the present disclosure, as shown in FIG. 3 The process includes the following steps:
  • step S302 key information is obtained by parsing the received audio and video code stream, and a channel identifier of the audio and video code stream is determined according to the key information.
  • Step S304 determine the target streaming media service node corresponding to the channel ID of the audio and video code stream according to the first correspondence, wherein the first correspondence between the channel ID and the streaming media service node is saved in the content scheduling node.
  • Step S306 when the online status of the target streaming media service node is online, push the audio and video code stream to the target streaming media service node.
  • the key information is obtained by parsing the received audio and video code stream, and the channel identification of the audio and video code stream is determined according to the key information, and the channel identification of the audio and video code stream is determined according to the first correspondence
  • the corresponding target streaming media service node wherein, the first corresponding relationship between the channel identifier and the streaming media service node is stored in the content scheduling node, and when the online status of the target streaming media service node is online, the The audio and video code stream is pushed to the target streaming media service node, and the content scheduling node can automatically select a suitable streaming media service node for audio and video processing according to the key information of the audio and video code stream and the online status of the streaming media service node.
  • the retweeting and service of code stream realizes the intelligent scheduling of audio and video code stream while reducing the dependence on manual management.
  • the content scheduling node is configured to perform content and service scheduling on audio and video streams, therefore, the content scheduling node can also be expressed as a content and service scheduling node.
  • the content scheduling node can be understood as a server, and the server is divided according to the different functions realized by the content scheduling node, for example, the server is divided into the first functional area, the second functional area and the third functional area area, the first functional area is set to analyze the received audio and video code stream to determine the channel identifier of the audio and video code stream, and the second functional area is set to determine the channel of the audio and video code stream according to the first correspondence
  • the corresponding target streaming media service node is identified, and the third functional area is set to push the audio and video code stream to the target streaming media service node when the online status of the target streaming media service node is online.
  • the first correspondence can be understood as a mapping relationship between target streaming media service nodes corresponding to channel identifiers of audio and video code streams.
  • the first corresponding relationship may be expressed in the form of a data table, for example, a data table will be generated according to the channel identifier of the audio and video code stream and the node information of the target streaming media service node.
  • the remaining information can be determined according to the channel information table.
  • the above channel identifier can be understood as a unique identifier for determining a channel, expressed as (Channel Identification, CID).
  • the calculation method for the CID includes a string concatenation method or a fixed-length encoding, and the present disclosure does not limit the specific calculation method.
  • the technical solution after determining the target streaming media service node corresponding to the channel identifier of the audio and video code stream according to the first correspondence includes: acquiring the device identifier of the target streaming media service node Obtain the online state of the device corresponding to the device identifier of the target streaming media service node according to the second correspondence, and use the online state of the device as the online state of the target streaming media service node, wherein the content scheduling node
  • the second corresponding relationship between the device identifier and the online status of the device is stored in .
  • the second correspondence can be understood as a mapping relationship between the device identifier of the streaming media service node and the online status of the streaming media service node.
  • the second corresponding relationship may be embodied in the form of a hash table, and the hash table may include the device identifier of the streaming media service node and the online status of the streaming media service node.
  • the online status of the streaming media service node can be determined through the heartbeat information of the streaming media service node. For example, in one embodiment, if the heartbeat of streaming media service node A is not detected, it is considered that streaming media service node A is abnormal. Wherein, the heartbeat message includes information such as current inbound traffic and outbound traffic of the streaming media service node. In one embodiment, if it is detected that the number of heartbeats of streaming media service node B is abnormal, the online status of all streaming media service nodes will be re-determined, and a hash table of streaming media service nodes will be regenerated.
  • the above-mentioned second corresponding relationship can also represent the mapping relationship between the device identifier of the streaming media service node and the service address of the streaming media service node, because the corresponding Server, therefore, when the service address corresponding to the device identifier is known, the server that provides the service can be further determined. For example, in the case that the streaming media service node with the device identifier q1 cannot work normally, if it is determined that the device identifier is q1 If the service address corresponding to the streaming media service node is 000.000.000.00, it may prompt the manual maintenance of the server Q corresponding to the service address 000.000.000.00.
  • step S304 determines the target streaming media service node corresponding to the channel identifier of the audio and video code stream according to the first correspondence
  • obtain the incoming traffic and outgoing traffic of each online streaming media service node determine according to the incoming traffic and outgoing traffic of each streaming media service node The streaming media service node to which the audio and video code stream is to be pushed.
  • the inbound traffic of each streaming media service node is monitored in real time through code and outgoing traffic, and pull the incoming traffic and outgoing traffic of each streaming media service node to the hash table of the streaming media service node in real time, and then obtain the latest incoming traffic and outgoing traffic of each streaming media service node through the hash table Flow, by recording the current incoming flow and outgoing flow of the streaming media service node in real time, the pressure of flow monitoring can be alleviated, the query speed of the current incoming flow and outgoing flow of the streaming media service node can be improved, and the speed of determining the sound can be improved. Efficiency of the streaming media service node to which the video code stream is to be pushed.
  • the inbound traffic and outbound traffic of each streaming media service node pulled by the code can also be directly used to determine the streaming media service node to which the audio and video code stream is to be pushed.
  • the technical solution for determining the streaming media service node to which the audio and video code stream is to be pushed according to the incoming traffic and outgoing traffic of each streaming media service node includes: determining the ingress traffic from each streaming media service node The minimum value and the minimum value of the egress traffic; when the weight of the ingress traffic is less than the weight of the egress traffic, the streaming media service node corresponding to the minimum value of the egress traffic is determined as the audio and video code stream to be pushed Streaming media service node; when the weight of the ingress traffic is greater than the weight of the egress traffic, determine the streaming media service node corresponding to the minimum value of the ingress traffic as the streaming media service to be pushed by the audio and video code stream node.
  • the preset threshold may be 100Mb/s, 10Mb/s, 1Mb/s, but not limited thereto, and the present disclosure does not impose any limitation on the preset threshold.
  • the preset threshold is 100Mb/s
  • the preset first weight of incoming traffic is 0.3
  • the second weight of outgoing traffic is 0.7.
  • the ingress traffic of streaming media service node E is the smallest value and the minimum export flow are 50Mb/s and 10Mb/s respectively
  • the minimum entry flow and the minimum exit flow of the streaming media service node F are 30Mb/s and 20Mb/s respectively
  • the node flow of the streaming service node E is (50 ⁇ 0.3+10 ⁇ 0.7) Mb/s
  • the node traffic of streaming media service node F is (30 ⁇ 0.3+20 ⁇ 0.7) Mb/s
  • the streaming media service node E has less traffic pressure, so the streaming media service node E is used as the streaming media service node to push the audio and video code stream.
  • the technical solution for determining the streaming media service node to which the audio and video code stream is to be pushed further includes: setting the incoming traffic and the outgoing traffic respectively in advance. For the first weight and the second weight, if the preset first weight is greater than the second weight, the streaming media service node whose incoming traffic is less than the preset threshold is directly used as the streaming media service node to which the audio and video code stream is to be pushed. For example, in one embodiment, the preset first weight of incoming traffic is 0.9, and the second weight of outgoing traffic is 0.4.
  • the streaming media service node C is the streaming media service node to which the audio and video streams are to be pushed.
  • the technical solution that the second weight is greater than the first weight may refer to the above-mentioned technical solution that the first weight is greater than the second weight, and the present disclosure does not repeat it here.
  • the event type of the audio and video code stream by determining the event type of the audio and video code stream; when the event type indicates that the event for obtaining the audio and video code stream is a start event, determine according to the first correspondence The target streaming media service node corresponding to the channel identification of the audio and video code stream; in the case where the event type indicates that the event of obtaining the audio and video code stream is an end event, the channel identification of the audio and video code stream Deleted from the first correspondence.
  • there is also provided a technical solution when there are multiple content scheduling nodes including: receiving at any one of the multiple content scheduling nodes In the case of adding a channel operation or deleting a channel operation, determine the first corresponding relationship after the channel adding operation or deleting the channel operation is performed, and obtain the third corresponding relationship; and synchronize the third corresponding relationship to other content scheduling nodes, wherein the The other content scheduling nodes are other nodes in the plurality of content retrieval nodes except any one of the content retrieval nodes.
  • the above-mentioned third corresponding relationship can be understood as the first corresponding relationship determined after the operation of adding a channel or the operation of deleting a channel is performed, that is, the operation of adding a channel received by any one of the plurality of content scheduling nodes Or the channel deletion operation is synchronized to the rest of the content scheduling nodes in real time, so as to enhance the stability of the audio and video stream scheduling method.
  • the content scheduling node and the streaming media service node can be co-located, that is, deployed on the same server, or deployed separately.
  • the node information of the streaming media service node can be directly synchronized to the content scheduling node in real time on the same server.
  • messages can be sent between servers, or proxy services can be used to obtain changes in the server corresponding to the content scheduling node and further forwarded to the streaming media service The server corresponding to the node.
  • the servers corresponding to multiple content scheduling nodes and the servers corresponding to streaming media service nodes can share a database, and the retweet information of the audio and video code streams of each channel is stored in the database, which can ensure that any stream When the channel service corresponding to the server corresponding to the media service node is abnormal, other channel services can still be performed normally.
  • step S302 in order to better understand how to obtain key information from the received audio and video code stream in step S302, it is possible to determine the protocol type of the audio and video code stream;
  • the key information is obtained by analyzing the code stream.
  • the form of the key information parsed from the audio and video code stream can be determined according to the protocol used by the audio and video code stream. For example, in one embodiment, if the audio and video code stream protocol used is the RTMP protocol, Then domain, app, and name field information can be extracted from the URL as key information of the channel. If the audio and video stream protocol used is the RTSP protocol, the abs_path and content_name field information can be extracted from the URL as the key information of the channel. If the audio and video code stream protocol used is other than RTMP protocol and RTSP protocol, similar key information can also be extracted to identify a unique channel. The type of audio and video code stream protocol used in this disclosure is not Do limit.
  • the audio and video stream scheduling method in this disclosure can be applied to live broadcast systems based on various types of protocols.
  • the live broadcast system can be deployed as an edge live broadcast system on edge CDN nodes in the 5G Internet environment, or as a live broadcast system on the cloud. In the cloud center, no matter which node in the Internet environment the live broadcast system is on, it has no effect on the scheduling method of the audio and video streams of the present disclosure.
  • this disclosure takes the live broadcast system at the edge CDN node as an example for introduction.
  • Fig. 4 is a schematic diagram of a scheduling system for implementing audio and video code streams according to an embodiment of the present disclosure.
  • the audio and video stream scheduling system may include a live broadcast front-end, a player, a management platform, a content and service scheduling node, and a streaming media service node.
  • the content and service scheduling node (equivalent to the content scheduling node in Figure 3 above) can be co-located with the streaming media service node, that is, deployed on the same server, or deployed separately.
  • multiple content and service scheduling nodes and streaming media service nodes (such as streaming media service node 1, streaming media service node 2 and streaming media service node n in FIG. 4 ) can be deployed on the scheduling system of audio and video streams.
  • the management platform is responsible for configuration management and log management of all content and service scheduling nodes and streaming media service nodes.
  • the content and service scheduling node is set to monitor all streaming media service nodes, and intelligently forward audio and video streams and playback requests to corresponding streaming media service nodes.
  • the content and service scheduling node may include a node management module, a content scheduling module and a service scheduling module, and the main functions of each module are as follows:
  • the node management module is configured to monitor and manage all streaming media service nodes, regularly detect the heartbeat information of each streaming media service node, and determine the online status of each streaming media service node according to the heartbeat information.
  • the heartbeat message includes information such as current incoming and outgoing traffic of the streaming media service node. For example, if the heartbeat of the streaming media service node D cannot be detected, the online status of the streaming media service node D is considered to be offline, and each time the content and service scheduling node detects that the online status of the streaming media service node changes, it will change according to The online status of the subsequent streaming media service node regenerates a hash table of the online streaming media service node.
  • the content scheduling module is set to realize the load balancing of the content of the live channel at the front end of the live broadcast, forward the audio and video code stream to the streaming media service node, and store the key information in the audio and video code stream and the information of the streaming media service node in the channel information table (equivalent to the above data table), when there is an audio and video stream coming, first look up the corresponding streaming media service node from the channel information table, if it cannot be found or the corresponding streaming media service node is not online, then according to the key information and The information of the streaming media service node selects an online streaming media service node to forward, and re-updates the channel information table.
  • the service scheduling module is set to forward the play service request from the player to the corresponding streaming media service node, search the corresponding streaming media service node in the channel information table according to the key information of the channel in the play service request, and forward the play service request to the streaming media service node.
  • FIG. 5 is a flowchart (2) of a method for scheduling audio and video code streams according to an embodiment of the present disclosure.
  • the scheduling method of the audio and video push stream is described in conjunction with FIG. 5.
  • the implementation steps of the scheduling method of the audio and video push stream are as follows:
  • Step S502 Receive the audio and video code stream from the live broadcast front-end.
  • Step S504 the content and service scheduling node extracts key information from the audio and video code stream.
  • the audio and video stream protocol is the RTMP protocol
  • the domain, app, and name field information can be extracted from the URL as the key information of the channel
  • the audio and video stream protocol is the RTSP protocol
  • it can be extracted from the URL
  • the abs_path and content_name field information is used as the key information of the channel.
  • other audio and video code stream protocols can also extract similar key information to uniquely identify a channel, and there is no restriction on audio and video code stream protocols in this disclosure.
  • Step S506 Calculate the channel identifier CID according to the key information in the code stream.
  • the string concatenation method or fixed-length encoding can be used, and the specific calculation method is not limited in this disclosure.
  • Step S508 the content and service scheduling node extracts the event type of the code stream, and determines whether the event type of the code stream is a start event.
  • Step S510 When the event type of the code stream is a start event, start pushing the audio and video code stream.
  • Step S512 Inquire whether the channel corresponding to the CID exists in the channel information table according to the CID. If it exists, it is determined that the query is successful, and step S520 is executed. If not, the query is determined to be failed, and step S514 is executed.
  • Step S514 Determine which streaming media service node to select according to the CID and the incoming traffic and outgoing traffic of each streaming media service node.
  • step S516 it is necessary to check whether the streaming media service node corresponding to the channel is online, and if it is online, execute step S520; if the streaming media service node is not online or the channel does not exist in the channel information table, then Execute step S516.
  • the selection method can use methods such as hash algorithm or sorting algorithm.
  • This disclosure does not limit the specific method of selection, as long as it is ensured that the online streaming media service node with low inbound and outbound traffic has a higher probability of being selected. Yes, so as to achieve the purpose of content and service load balancing.
  • Step S516 forward the audio and video code stream to the streaming media service node selected in step S514, and add the CID of the channel and node information corresponding to the information of the streaming media service node to the channel information table.
  • Step S518 sending a channel synchronization message to other content and service scheduling nodes.
  • the content and service scheduling node when the content and service scheduling node adds node information of streaming media service node information in the channel information table, it needs to send channel synchronization messages to other content and service scheduling nodes.
  • Step S520 forward the audio and video code stream to the corresponding streaming media service node.
  • Step S522 After the streaming media service node receives the audio and video code stream, check the protocol type of the code stream, convert the code stream into RTMP, FLV, HLS protocols, and generate an HLS index file (m3u8 file) and ts in the specified directory of the server Fragmentation.
  • Step S524 In the case that the event type of the code stream is an end event, check whether the channel already exists in the channel information table according to the CID. If it exists, it is determined that the query is successful, and step S526 is executed. If it does not exist, it is determined that the query fails , execute step S530.
  • Step S526 Delete the node information of the streaming media service node in the channel information table.
  • Step S528 When the content and service scheduling node finds that a channel needs to be added or deleted, it needs to send a channel synchronization message to other content and service scheduling nodes, so that when there is a playback request, other content and scheduling nodes can also normally schedule the corresponding channels. on the streaming media service node.
  • Step S530 Not processed.
  • the above embodiments provide a method and system for scheduling audio and video push streams.
  • the audio and video push stream scheduling system simplifies the functions of the management platform.
  • the management platform does not need to manage channel information, and provides a unified and fixed push stream address and service address externally.
  • the content and service scheduling node automatically selects a suitable streaming media service node for content retweeting and service according to the key information of the audio and video code stream and the online status of the streaming media service node, so as to realize the function of intelligent scheduling of content and service, both It avoids excessive reliance on operation and management personnel, and ensures the balanced distribution of channel content and normal service under abnormal circumstances, thereby improving user experience and enhancing system stability and reliability.
  • FIG. 6 is a flowchart (3) of a method for scheduling audio and video code streams according to an embodiment of the present disclosure.
  • the scheduling method of the audio and video push stream is described in conjunction with FIG. 6.
  • the implementation steps of the scheduling method of the audio and video push stream are as follows:
  • Step S602 the content and service scheduling node receives the play request from the player.
  • Step S604 the content and service scheduling node extracts the key information of the channel in the request message.
  • Step S606 Calculate the channel identifier CID according to the key information.
  • Step S608 Search the channel information table for the streaming media service node corresponding to the channel according to the CID. If the query is successful, execute step S610, and if the query fails, execute step S614.
  • Step S610 Forward the play service request to the corresponding streaming media service node.
  • the streaming media service node judges the protocol type of the request. If the protocol type is RTMP, it will directly forward the RTMP protocol code stream to the player; if the protocol type is FLV, it will directly encapsulate the RTMP code stream into FLV in real time. Protocol code stream, return the FLV code stream to the player; if the protocol type is HLS, the player will first request an m3u8 file, which will contain a list of ts files, and play them sequentially through the given ts file address, during live broadcast , the player will continue to request m3u8 files, and check whether there are new ts slices in the ts list.
  • Step S612 Return the code stream of the corresponding channel through the streaming media service node.
  • Step S614 Since the streaming media service node corresponding to the channel has not been queried, returning the information of the streaming media service node corresponding to the channel fails.
  • This disclosure provides a method for content intelligent scheduling based on live streams, which does not require operators to create and delete channels on the management platform, and the management platform does not need to manage channel information, and the content and service scheduling nodes uniformly perform intelligent scheduling of channel content and services. Scheduling not only avoids excessive reliance on operation and management personnel, but also greatly improves resource utilization and effectively reduces operation and maintenance costs. Streaming media service nodes can be added and deleted at any time according to actual conditions without affecting existing services , which not only realizes the flexibility of deployment, but also ensures the stability of the service and improves the user experience.
  • All the above-mentioned embodiments can be applied to fields such as Internet live broadcast, video monitoring, or video conferencing.
  • the method according to the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation.
  • the technical solution of the present disclosure can be embodied in the form of a software product in essence or the part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to make a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) execute the methods of various embodiments of the present disclosure.
  • a scheduling system for audio and video code streams is also provided.
  • the system is used to implement the above embodiments and preferred implementation modes, and what has been explained will not be repeated.
  • the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.
  • Fig. 7 is a schematic structural diagram of an audio and video code stream scheduling system according to an embodiment of the present disclosure, as shown in Fig. 7 , including:
  • a content scheduling node 72 a plurality of streaming media service nodes 74 connected to the content scheduling node, wherein the content scheduling node 72 is configured to analyze and obtain key information from the received audio and video code stream, and according to the The key information determines the channel identifier of the audio and video code stream; and determines the target streaming media service node corresponding to the channel identifier of the audio and video code stream according to the first correspondence, and the online status of the target streaming media service node In the case of being online, push the audio and video code stream to the target streaming media service node, wherein the content scheduling node 72 stores the first corresponding relationship between the channel identifier and the streaming media service node 74 .
  • the key information is obtained by parsing the received audio and video code stream, and the channel identification of the audio and video code stream is determined according to the key information, and the channel identification of the audio and video code stream is determined according to the first correspondence
  • the corresponding target streaming media service node wherein, the first corresponding relationship between the channel identifier and the streaming media service node is stored in the content scheduling node, and when the online status of the target streaming media service node is online, the The audio and video code stream is pushed to the target streaming media service node, and the content scheduling node can automatically select a suitable streaming media service node for audio and video processing according to the key information of the audio and video code stream and the online status of the streaming media service node.
  • the retweeting and service of code stream realizes the intelligent scheduling of audio and video code stream while reducing the dependence on manual management.
  • the content scheduling node is further configured to obtain the device identifier of the target streaming media service node; and obtain the online status of the device corresponding to the device identifier of the target streaming media service node according to the second correspondence, and The online state of the device is used as the online state of the target streaming media service node, wherein the content scheduling node stores a second corresponding relationship between the device identifier and the online state of the device.
  • the online status includes at least one of the following: online, not online.
  • the content scheduling node is further configured to not determine the target streaming service node corresponding to the channel identifier of the audio and video code stream according to the first correspondence, or according to the second correspondence
  • obtain the incoming traffic and outgoing traffic of each online streaming media service node and according to the incoming traffic and outgoing traffic of each streaming media service node Determine the streaming media service node to which the audio and video code stream is to be pushed.
  • the content scheduling node is further configured to determine the minimum value of ingress traffic and the minimum value of egress traffic from the respective streaming media service nodes; when the weight of the ingress traffic is less than the weight of the egress traffic , determining the streaming media service node corresponding to the minimum value of the egress traffic as the streaming media service node to be pushed to the audio and video code stream; when the weight of the ingress traffic is greater than the weight of the egress traffic, the The streaming media service node corresponding to the minimum value of the ingress traffic is determined as the streaming media service node to which the audio and video code stream is to be pushed.
  • the content scheduling node is further configured to determine the event type of the audio and video code stream; if the event type indicates that the event for obtaining the audio and video code stream is a start event, according to the first corresponding The relationship determines the target streaming media service node corresponding to the channel identifier of the audio and video code stream; when the event type indicates that the event of obtaining the audio and video code stream is an end event, the audio and video code stream will be The channel identifier is deleted from the first correspondence.
  • any one of the multiple content scheduling nodes is configured to determine to add a channel when receiving an operation to add a channel or to delete a channel.
  • Channel operation or deletion of the first corresponding relationship after the channel operation is executed to obtain a third corresponding relationship; and synchronizing the third corresponding relationship to other content scheduling nodes, wherein the other content scheduling nodes are the multiple content scheduling nodes Get other nodes in the node except any content calling node.
  • the content scheduling node is further configured to determine the protocol type of the audio and video code stream; and obtain the key information by parsing the audio and video code stream according to the protocol type.
  • the key information is obtained by parsing the received audio and video code stream, and the channel identification of the audio and video code stream is determined according to the key information, and the channel identification of the audio and video code stream is determined according to the first correspondence relationship
  • the corresponding target streaming media service node wherein, the first corresponding relationship between the channel identifier and the streaming media service node is stored in the content scheduling node, and when the online status of the target streaming media service node is online, the The audio and video code stream is pushed to the target streaming media service node, and the content scheduling node can automatically select a suitable streaming media service node for audio and video processing according to the key information of the audio and video code stream and the online status of the streaming media service node.
  • the retweeting and service of code stream realizes the intelligent scheduling of audio and video code stream while reducing the dependence on manual management.
  • the above-mentioned computer-readable storage medium may include but not limited to: U disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM) , mobile hard disk, magnetic disk or optical disk and other media that can store computer programs.
  • ROM read-only memory
  • RAM random access memory
  • mobile hard disk magnetic disk or optical disk and other media that can store computer programs.
  • Embodiments of the present disclosure also provide an electronic device, including a memory and a processor, where a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.
  • the above-mentioned processor may be configured to execute the following steps through a computer program:
  • the electronic device may further include a transmission device and an input and output device, wherein the transmission device is connected to the processor, and the input and output device is connected to the processor.
  • each module or each step of the above-mentioned disclosure can be realized by a general-purpose computing device, and they can be concentrated on a single computing device, or distributed in a network composed of multiple computing devices
  • they can be implemented in program code executable by a computing device, and thus, they can be stored in a storage device to be executed by a computing device, and in some cases, can be executed in an order different from that shown here.
  • steps, or they are made into individual integrated circuit modules, or multiple modules or steps among them are made into a single integrated circuit module to realize.
  • the present disclosure is not limited to any specific combination of hardware and software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

La présente divulgation concerne un procédé de planification de flux de code audio et vidéo, ainsi qu'un système, un support et un appareil électronique. Le procédé est appliqué à un nœud de planification de contenu et consiste à : analyser et obtenir des informations clés à partir d'un flux de code audio et vidéo reçu, puis déterminer un identifiant de canal du flux de code audio et vidéo en fonction des informations clés ; selon une première correspondance, déterminer un nœud de service multimédia en continu cible correspondant à l'identifiant de canal du flux de code audio et vidéo, la première correspondance entre l'identifiant de canal et le nœud de service multimédia en continu étant stockée dans le nœud de planification de contenu ; et lorsqu'un état en ligne du nœud de service multimédia en continu cible est en ligne, transférer le flux de code audio et vidéo au nœud de service multimédia en continu cible.
PCT/CN2022/114618 2021-10-15 2022-08-24 Procédé de planification de flux de codes audio et vidéo, système, support et appareil électronique WO2023061060A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111204424.6 2021-10-15
CN202111204424.6A CN114222086B (zh) 2021-10-15 2021-10-15 音视频码流的调度方法、系统、介质及电子装置

Publications (1)

Publication Number Publication Date
WO2023061060A1 true WO2023061060A1 (fr) 2023-04-20

Family

ID=80696060

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/114618 WO2023061060A1 (fr) 2021-10-15 2022-08-24 Procédé de planification de flux de codes audio et vidéo, système, support et appareil électronique

Country Status (2)

Country Link
CN (1) CN114222086B (fr)
WO (1) WO2023061060A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114222086B (zh) * 2021-10-15 2023-01-31 中兴通讯股份有限公司 音视频码流的调度方法、系统、介质及电子装置
CN114501161B (zh) * 2022-04-11 2022-08-02 中兴通讯股份有限公司 音视频系统、接入方法、路由转发方法及可读存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101102312A (zh) * 2007-06-11 2008-01-09 华为技术有限公司 一种网络通信数据处理方法、网络通信系统及客户端
WO2017096830A1 (fr) * 2015-12-08 2017-06-15 乐视控股（北京）有限公司 Procédé de distribution de contenu et serveur mandataire de planification pour plate-forme cdn
US20180097741A1 (en) * 2016-10-03 2018-04-05 Verizon Patent And Licensing Inc. Channel acquisition management
CN109525867A (zh) * 2017-09-18 2019-03-26 中兴通讯股份有限公司 负载均衡方法、装置及移动终端
CN112260961A (zh) * 2020-09-23 2021-01-22 北京金山云网络技术有限公司 一种网络流量调度方法、装置、电子设备及存储介质
CN114222086A (zh) * 2021-10-15 2022-03-22 中兴通讯股份有限公司 音视频码流的调度方法、系统、介质及电子装置

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100531384C (zh) * 2006-09-29 2009-08-19 中兴通讯股份有限公司 一种集群式流媒体系统中动态节目的分发和服务方法
EP2287800A1 (fr) * 2009-08-13 2011-02-23 Clarendon Foundation Inc. Systèmes et procédés pour la distribution de publicité et de contenu
US8978078B2 (en) * 2011-05-02 2015-03-10 At&T Intellectual Property I, L.P. System and method of selecting a multimedia stream
WO2013026081A1 (fr) * 2011-08-19 2013-02-28 Regency Cumulus Pty Ltd Système et procédé de transmission multimédia en continu à sécurité améliorée
CN109729397A (zh) * 2019-01-29 2019-05-07 网宿科技股份有限公司 一种推流方法、系统及服务器
CN111193788A (zh) * 2019-12-24 2020-05-22 视联动力信息技术股份有限公司 一种音视频流负载均衡方法和装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101102312A (zh) * 2007-06-11 2008-01-09 华为技术有限公司 一种网络通信数据处理方法、网络通信系统及客户端
WO2017096830A1 (fr) * 2015-12-08 2017-06-15 乐视控股（北京）有限公司 Procédé de distribution de contenu et serveur mandataire de planification pour plate-forme cdn
US20180097741A1 (en) * 2016-10-03 2018-04-05 Verizon Patent And Licensing Inc. Channel acquisition management
CN109525867A (zh) * 2017-09-18 2019-03-26 中兴通讯股份有限公司 负载均衡方法、装置及移动终端
CN112260961A (zh) * 2020-09-23 2021-01-22 北京金山云网络技术有限公司 一种网络流量调度方法、装置、电子设备及存储介质
CN114222086A (zh) * 2021-10-15 2022-03-22 中兴通讯股份有限公司 音视频码流的调度方法、系统、介质及电子装置

Also Published As

Publication number Publication date
CN114222086B (zh) 2023-01-31
CN114222086A (zh) 2022-03-22

Similar Documents

Publication Publication Date Title
US11350139B2 (en) Video live broadcast method and apparatus
EP3595268B1 (fr) Procédé de distribution de ressources multimédias de diffusion en continu, système, noeud périphérique et système de distribution central
WO2023061060A1 (fr) Procédé de planification de flux de codes audio et vidéo, système, support et appareil électronique
US20180070149A1 (en) Streaming with Optional Broadcast Delivery of Data Segments
JP6444398B2 (ja) セグメント化コンテンツのストリーミング
RU2647654C2 (ru) Система и способ доставки аудиовизуального контента в клиентское устройство
US9173006B2 (en) Method for live broadcasting in a distributed network and apparatus for the same
CN104023250B (zh) 基于流媒体的实时互动方法和系统
WO2015034752A1 (fr) Systèmes côté serveur et procédés de communication de flux de données
CN108696588B (zh) 一种信息的发送方法及设备
CN108924609B (zh) 流媒体数据传输的方法、电子设备、装置及存储介质
US11005975B2 (en) Rapid optimization of media stream bitrate
CN109561137B (zh) 建立p2p网络的方法、装置、终端设备及介质
CN112367527A (zh) 一种传送流文件生成方法、装置、设备及存储介质
CN107920072B (zh) 一种基于数据特征的多媒体共享方法及系统
CN112311874A (zh) 媒体数据处理方法、装置、存储介质及电子设备
KR20160138044A (ko) 미디어 데이터를 스트리밍하기 위한 목표된 광고 삽입
CN107645475B (zh) 异质网络中的文件资源分发系统与方法
WO2015009828A1 (fr) Procédé et système permettant la détection de flux par contournement en direct
CN108632681B (zh) 播放媒体流的方法、服务器及终端
US11356716B2 (en) System for inserting supplemental content within a media stream
CN113825015B (zh) 一种大规模并发视频推流加速和管理方法
WO2017071524A1 (fr) Procédé et appareil de publication de ressources multimédia
JP6009501B2 (ja) データセグメントのオプションのブロードキャスト配信によるストリーミング
CN118338026A (zh) 一种请求处理方法、集群、组件、系统及介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22880007

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE