CN115277569A

CN115277569A - Multimedia communication method, system, related equipment and storage medium

Info

Publication number: CN115277569A
Application number: CN202210873534.XA
Authority: CN
Inventors: 李雪松
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2022-07-21
Filing date: 2022-07-21
Publication date: 2022-11-01

Abstract

The embodiment of the application discloses a multimedia communication method, a system, related equipment and a storage medium, wherein the system comprises: the system comprises at least two edge nodes, at least two central nodes, a node scheduler, a terminal, at least two gateways and a multimedia server; a node dispatcher receives a target call message sent by a target edge node accessed by a terminal and identifies a target service type of the target call message; determining a target gateway from at least two gateways according to the load capacity of each gateway corresponding to the target service type, and determining a target central node corresponding to the target gateway; the node dispatcher sends the target call message to a target central node, and the target central node transmits the target call message to the multimedia server through a target gateway so as to establish a signaling link between the terminal and the multimedia server. By implementing the embodiment of the application, the server can be subjected to refined load scheduling at a business layer, and the usability of the multimedia communication system can be enhanced.

Description

Multimedia communication method, system, related equipment and storage medium

Technical Field

The present application relates to the field of communications technologies, and in particular, to a multimedia communication method, system, related device, and storage medium.

Background

Data transmission between two or more devices in a multimedia communication system is often involved in online conferences, network video chatting and other scenes, and multimedia data interaction between the devices can be called a multimedia session. In the prior art, establishment, modification and termination of a multimedia Session may be performed through an application layer Protocol such as a Session Initiation Protocol (SIP) Protocol, a GB28181 Protocol or a Real Time Streaming Protocol (RTSP) Protocol. The participants of a multimedia session typically need to negotiate signaling based on the aforementioned protocols before conducting a multimedia data transmission.

The process of signaling negotiation requires the participation of a session protocol server. However, as the number of services and access devices increases, the amount of concurrency that the session protocol server needs to carry is also larger and larger, which easily exceeds the bearing range of the server, and reduces the availability of the multimedia communication system.

Disclosure of Invention

The embodiment of the application discloses a multimedia communication method, a multimedia communication system, related equipment and a storage medium, which can perform refined load scheduling on a server at a business layer and are beneficial to enhancing the usability of the multimedia communication system.

The embodiment of the application discloses a multimedia communication method, which is applied to a node scheduler in a multimedia communication system, wherein the multimedia communication system further comprises: the system comprises edge nodes of at least two session protocol server clusters, central nodes of the at least two session protocol server clusters, terminals, at least two gateways and a multimedia server; the node scheduler is respectively in communication connection with each edge node and each central node; each gateway corresponds to at least one of the central nodes; the method comprises the following steps: receiving a target calling message sent by a target edge node, and identifying a target service type of the target calling message; the target edge node is the edge node to which the terminal is accessed in each edge node; determining a target gateway from the at least two gateways according to the load amount of each gateway corresponding to the target service type; determining a target central node corresponding to the target gateway from the at least two central nodes; and sending the target call message to the target central node so that the target call message is transmitted to the multimedia server through the target central node and the target gateway to establish a signaling link between the terminal and the multimedia server.

The embodiment of the application discloses a multimedia communication method, which is applied to a network load balancer in a multimedia communication system; the multimedia communication system further comprises: the system comprises edge nodes of at least two session protocol server clusters, central nodes of the at least two session protocol server clusters, a node scheduler, a terminal, at least two gateways and a multimedia server; the node dispatcher is respectively connected with each edge node and each central node; the terminal is connected with the network load balancer, and the network load balancer is also connected with each edge node respectively; each gateway corresponds to at least one of the central nodes; the method comprises the following steps: receiving a target call message sent by the terminal; determining target edge nodes from the edge nodes according to the load capacity of the edge nodes; sending the target call message to the target edge node to be sent to the node dispatcher by the target edge node, so that the target call message reaches the multimedia server through the node dispatcher, a target central node and a target gateway to establish a signaling link between the terminal and the multimedia server; wherein the target central node is a central node of the at least two central nodes corresponding to the target gateway; and the target gateway is determined from each gateway according to the load quantity of each gateway corresponding to the target service type after the node dispatcher identifies the target service type of the target call message.

The embodiment of the application discloses a multimedia communication system, including: the system comprises edge nodes of at least two session protocol server clusters, center nodes of the at least two session protocol server clusters, a node scheduler, a terminal, at least two gateways and a multimedia server; the node scheduler is respectively connected with each edge node and each central node; each gateway corresponds to at least one of the central nodes; the terminal is used for initiating a target calling message and sending the target calling message to a target edge node; the target edge node is the edge node to which the terminal is accessed in each edge node; the target edge node is used for sending the target call message to the node dispatcher; the node scheduler is used for determining a target gateway from the at least two gateways according to the load capacity of each gateway corresponding to the target service type; determining a target central node corresponding to the target gateway from the at least two central nodes, and sending the target call message to the target central node; the target central node is used for sending the target call message to the target gateway; and the target gateway is used for sending the target call message to the multimedia server so as to establish a signaling link between the terminal and the multimedia server.

The embodiment of the application discloses a node scheduler, which is applied to a multimedia communication system, and the multimedia communication system further comprises: the system comprises edge nodes of at least two session protocol server clusters, central nodes of the at least two session protocol server clusters, terminals, at least two gateways and a multimedia server; the node scheduler is respectively in communication connection with each edge node and each central node; each gateway corresponds to at least one of the central nodes; the node scheduler includes: the communication module is used for receiving a target calling message sent by a target edge node and identifying a target service type of the target calling message; the target edge node is the edge node to which the terminal is accessed in each edge node; the determining module is used for determining a target gateway from the at least two gateways according to the load amount of each gateway corresponding to the target service type; determining a target central node corresponding to the target gateway from the at least two central nodes; the communication module is further configured to send the target call message to the target central node, so that the target call message is transmitted to the multimedia server through the target central node and the target gateway, so as to establish a signaling link between the terminal and the multimedia server.

The embodiment of the application discloses a network load balancer, which is applied to a multimedia communication system; the multimedia communication system further comprises: the system comprises edge nodes of at least two session protocol server clusters, central nodes of the at least two session protocol server clusters, a node scheduler, a terminal, at least two gateways and a multimedia server; the node scheduler is respectively connected with each edge node and each central node; the terminal is connected with the network load balancer, and the network load balancer is also connected with each edge node respectively; each gateway corresponds to at least one of the central nodes; the network load balancer comprises: the receiving and sending module is used for receiving a target call message sent by the terminal; the balancing module is used for determining a target edge node from each edge node according to the load capacity of each edge node; the transceiver module is further configured to send the target call message to the target edge node, so as to send the target call message to the node dispatcher through the target edge node, so that the target call message reaches the multimedia server via the node dispatcher, a target central node and a target gateway, so as to establish a signaling link between the terminal and the multimedia server; wherein the target central node is a central node corresponding to the target gateway in the at least two central nodes; and the target gateway is determined from each gateway according to the load quantity of each gateway corresponding to the target service type after the node dispatcher identifies the target service type of the target call message.

The embodiment of the application discloses a service device, which comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor is enabled to realize any multimedia communication method disclosed by the embodiment of the application.

The embodiment of the application discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and when the computer program is executed by a processor, the computer program realizes any one of the multimedia communication methods disclosed by the embodiment of the application.

Compared with the related art, the embodiment of the application has the following beneficial effects:

the multimedia communication system may comprise a cluster of session protocol servers comprising a plurality of edge nodes and a plurality of central nodes, and a node scheduler may be arranged between the edge nodes and the central nodes. After the terminal initiates the target call message, the node dispatcher may receive the target call message sent by the target edge node to which the terminal accesses, and identify a target service type of the target call message. The node scheduler can further determine a target gateway from at least two gateways according to the load of each gateway corresponding to the target service type, so as to determine a target central node corresponding to the target gateway according to the corresponding relation between the gateways and the central node. The node dispatcher may send the target call message to the target central node such that the target call message is transmitted to the multimedia server via the target central node and the target gateway to establish a signaling link between the terminal and the multimedia server.

Therefore, in the embodiment of the application, by setting the node scheduler between the edge node and the central node to perform the scheduling scheme of internal service bridging, refined load balancing can be performed on a service level according to the service type of the call, which is beneficial to reducing the problem of server overload and enhancing the availability of the multimedia communication system. In addition, compared with a framework in which the edge node is directly connected with the central node, the bridge scheduling function provided by the node scheduler can realize efficient cluster scheduling of the session protocol server.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic diagram of a multimedia communication system in the related art;

fig. 2 is a schematic diagram of a multimedia communication system according to an embodiment of the present application;

fig. 3 is a method flow diagram of a method of multimedia communication according to an embodiment of the present application;

fig. 4 is a schematic block diagram of another multimedia communication system disclosed in an embodiment of the present application;

FIG. 5 is a method flow diagram of another method of multimedia communication as disclosed in one embodiment of the present application;

FIG. 6 is a block diagram of a node scheduler according to an embodiment of the present application;

FIG. 7 is a block diagram of a network load balancer, according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a service device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.

It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the examples and figures of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

In order to more clearly describe the multimedia communication method, the multimedia communication system, the related device and the storage medium disclosed in the embodiments of the present application, the following description first refers to a multimedia communication method in the related art.

For convenience of description, the following description will be made taking the SIP protocol as an example. Referring to fig. 1, fig. 1 is a schematic diagram illustrating a multimedia communication system in the related art. As shown in fig. 1, the multimedia communication system may include: a Real-Time audio Communication (RTC) system 110, a session protocol server cluster 120, a SIP terminal 130, a database cluster 140, and an RTC terminal 150.

The RTC system 110 may include: a gateway Cluster 111, a plurality of multimedia servers, and a signaling server Cluster (SignalServer-Cluster) 113. The gateway cluster 111 may be connected to each multimedia server through a signaling server cluster 113, where the signaling server cluster 113 and the gateway cluster 111 may communicate based on a hypertext Transfer Protocol (HTTP), and the signaling server cluster 113 and each multimedia server may communicate based on Remote Procedure Calls (RPCs).

Gateway cluster 111 may include a plurality of gateways. The gateway is an interface that converts the SIP protocol and the multimedia communication protocol. For example, if the gateway cluster 111 and the signaling service cluster 113 communicate via the HTTP protocol, the gateway cluster 111 may be configured to convert data transmitted via the SIP protocol into data corresponding to the HTTP protocol.

The multimedia server 112 may provide an encoding and decoding service for audio and video data, and provide a service support for multimedia data for application scenes such as online conferences, audio and video calls, cloud games, live broadcasts, and the like.

Signaling server cluster 113 may provide signaling interaction services for gateway cluster 111 and multimedia server 112.

The session protocol server cluster 120 may include edge nodes directly facing the SIP terminals 130 and a central node facing the gateway cluster 111. The session protocol server cluster 120 may include a plurality of edge nodes and a plurality of center nodes, such as edge node 121 and center node 122 shown in fig. 1. Wherein each central node is communicatively connectable to one or more edge nodes.

The database cluster 140 may be used to store various data written by the session protocol server cluster 120 and the RTC system 110 and provide data querying functions.

The RTC terminal 150 can be any terminal that accesses the RTC system 110. The RTC terminal 150 can perform multimedia data transmission with the SIP terminal 130 through the RTC system 110 and the session protocol server cluster 120.

The SIP protocol is a text-based application-layer control protocol that supports the following various transport-layer protocols: transmission Control Protocol (TCP), user Datagram Protocol (UDP), and Transport Layer Security (TLS). The SIP protocol specifies standards for interactive communication between one or more session participants, which can be used to establish, modify and terminate two-or multi-party multimedia sessions over a network. Therefore, the participants of the multimedia session need to perform a signaling negotiation before transmitting multimedia data to each other. After the signaling negotiation is completed, each participant may establish a transmission channel of multimedia data based on a communication Protocol such as Real-time Transport Protocol (RTP) or Secure Real-time Transport Protocol (SRTP).

Based on the multimedia communication system shown in fig. 1, the following describes the flow of signaling negotiation and multimedia data transmission in the related art.

The SIP terminal 130 originates a call and sends a SIP call message corresponding to the call to the accessed edge node 121. After receiving the SIP call message, the edge node 121 to which the SIP terminal 130 accesses sends the SIP call message to the center node 122 communicatively connected to the edge node 121. Center node 122 sends the SIP call message to gateway cluster 111 such that center node 122 accesses gateway cluster 111. Gateway cluster 111 performs protocol conversion on the SIP call message, converts the SIP call message from SIP signaling to HTTP signaling, and sends the converted SIP call message to multimedia server 112 via signaling server cluster 113.

Based on this, a signaling link between the SIP terminal 130 and the multimedia server 112 is established, and the signaling link connection relationship in the signaling link includes: SIP terminal 130 is connected to edge node 121, edge node 121 is connected to center node 122, center node 122 is connected to gateway cluster 111, and gateway cluster 111 is connected to multimedia server 112.

After receiving the SIP call message, the multimedia server 112 may generate an SIP response message, and send the SIP response message to the accessed gateway cluster 111, the gateway cluster 111 performs protocol conversion, converts the SIP response message from the HTTP signaling into an SIP signaling, and sends the converted SIP response message to the center node 122, the center node 122 sends the SIP response message to the edge node 121, and then sends the SIP response message to the SIP terminal 130 via the edge node 121.

The SIP call message sent by the SIP terminal 130 may include connection information related to the SIP terminal 130, such as a port, an IP address, a life cycle, multimedia capability, a supported codec protocol, etc. of the SIP terminal 130; the SIP response message sent by multimedia server 112 may include connection information related to multimedia server 112, such as the port, IP address, life cycle, multimedia capabilities, supported codec protocol, etc. of multimedia server 112.

The SIP terminal 130 and the multimedia server 112 complete signaling negotiation based on the SIP call message and the SIP response message. Based on the connection information of the SIP terminal 130 received by the multimedia server 112 and the connection information of the SIP terminal 1300 received by the multimedia server 112, the SIP terminal 130 may establish a communication link based on the RTP protocol with the multimedia server 112 and perform transmission of multimedia data through the communication link of the RTP protocol.

It should be noted that the RTC terminal 150 may perform signaling negotiation with the signaling server cluster 113 based on WebSocket (WS) connection, establish a communication link based on an RTP protocol with the multimedia server 112 after the signaling negotiation, and transmit multimedia data through the communication link based on the RTP protocol.

It can be seen that based on the multimedia communication system as shown in fig. 1, the edge nodes and the central node in the session protocol server cluster have an important role in the signaling negotiation between the multimedia server and the SIP terminal. However, when the number of terminals accessed by the edge node is large, or when the terminals initiate calls too frequently in a short time, the load capacity of the session protocol server such as the edge node or the central node may be increased, and the server may be crashed or down, thereby reducing the availability of the entire multimedia communication system.

Based on this, the embodiment of the application discloses a multimedia communication method, a multimedia communication system, related equipment and a storage medium, which can perform refined load scheduling on a server at a business layer, and are beneficial to enhancing the availability of the multimedia communication system.

Referring to fig. 2, fig. 2 is a schematic structural diagram of a multimedia communication system according to an embodiment. As shown in fig. 2, the multimedia communication system may include: RTC system 210, session protocol server cluster 220, terminal 230. Wherein, the session protocol server cluster can apply SIP, GB28181 or RTSP and other stateful application layer protocols. For convenience of description, the following description will be made taking the SIP protocol as an example.

The terminal 230 may be any SIP device, such as a conference collaboration terminal or a personal terminal such as a smart phone.

The RTC system 210 may include: at least two gateways and a multimedia server 214. As shown in fig. 2, the RTC system 210 may include three gateways, a gateway 211, a gateway 212, and a gateway 213.

It should be noted that the RTC system may further include other service devices such as a signaling server cluster, each gateway may communicate with the multimedia server 214, and a communication process between the gateway and the multimedia server 214 is not limited.

The session protocol server cluster 220 may include: at least two edge nodes, at least two hub nodes, and a node scheduler 223. As shown in fig. 2, the session protocol server cluster may include a center node 221, a center node 222, and an edge node 224. The node scheduler 223 is communicatively coupled to each of the edge nodes and the central node, respectively.

The session protocol server cluster comprises individual edge nodes and central nodes, which may be SIP Proxy (SIP Proxy) servers, operable to provide SIP signaling and multimedia data transfer services.

Also, each gateway included in the RTC system 210 may correspond to one or more central nodes, and each gateway may establish a communication connection with the corresponding central node and transmit data to each other based on the SIP protocol. Taking the gateway 212 as an example, the gateway 212 may correspond to the central node 221 and the central node 222 in the session protocol server cluster 220, respectively, and the gateway 212 may transmit SIP messages with the central node 221 and the central node 222.

It should be noted that the node scheduler may be an independent service device, or a processing module that is built in any edge node and is bound to the edge node, and is not limited specifically.

Optionally, the multimedia communication system may further include: a database 240. The database 240 may be connected to each gateway and node scheduler 223 comprised by the RTC system, respectively. Each gateway may write the current load amount to the database 240, and the node scheduler 223 may query the load amount of each gateway by accessing the database 240. The load of each gateway can be represented by the concurrency of the call task being processed by the gateway, but is not limited thereto.

Referring to fig. 3, fig. 3 is a flowchart illustrating a multimedia communication method according to an embodiment of the present invention, which can be applied to the node scheduler. As shown in fig. 3, the method may include the steps of:

310. and receiving a target calling message sent by a target edge node accessed by the terminal, and identifying the target service type of the target calling message.

The target edge node is an edge node to which a terminal is accessed among a plurality of edge nodes included in the multimedia communication system, and the determination method of the target edge node is not limited in the embodiment of the present application. Illustratively, the target edge node may be the edge node that is closest in physical distance to the terminal.

The target call message may be a SIP message generated by the terminal when the call is initiated.

In the embodiment of the present application, the RTC system can be applied to many different types of services, including but not limited to: teleconferencing, video telephony, game interaction. When the terminal initiates a call, the terminal may determine the target service type corresponding to the call according to the type of the application program triggering the call, and write the target service type into the target call message, for example, different service types may be represented by different codes. After receiving the target call message, the node dispatcher can read the target service type from the target call message.

320. And determining the target gateway from the at least two gateways according to the load capacity of each gateway corresponding to the target service type.

In the embodiment of the present application, the RTC system includes gateways that can each be used to handle calls of one or more different service types. When the gateway is capable of handling calls of two or more different traffic types, the corresponding load amount may be divided for calls of each traffic type. For example, if the gateway can handle two types of service calls, namely, a teleconference service call and a game service call, the gateway can respectively count a load amount a corresponding to the teleconference service call and a load amount B corresponding to the game service call.

It should be noted that the load of the gateway can be represented by the concurrency of the call, and the concurrency of the call can have different descriptions according to different service types. For example, for a call whose traffic type is a teleconference, the concurrency may be described as the number of participants in the teleconference; for a call whose traffic type is videotelephony, the concurrency may be described as the number of simultaneous calls for videotelephony; for calls whose business type is game interaction, concurrency can be described as the number of simultaneous online people for game interaction.

After identifying the target service type corresponding to the call, the node scheduler may obtain a load amount corresponding to each gateway in the plurality of gateways and the target service type. For example, if the target service type is a teleconference and the RTC system includes 3 gateways, which are gateway 1, gateway 2, and gateway 3, the node scheduler may obtain respective load amounts of gateway 1, gateway 2, and gateway 3 corresponding to the teleconference.

The load of each gateway acquired by the node scheduler may be that the gateway sends the load to a corresponding central node, and the central node sends the received load data to the node scheduler. Alternatively, the first and second liquid crystal display panels may be,

as an alternative implementation, if the multimedia communication system includes the aforementioned database, the database may store respective load amounts when each gateway processes calls of two or more different service types. The node scheduler can inquire the load amount of each gateway corresponding to the target service type from the database, and can accelerate the speed of acquiring the load amount of the gateway.

In this embodiment, the node scheduler may select a gateway with a smaller load amount corresponding to the target service type from the gateways included in the RTC system as the target gateway.

As an alternative implementation, the node scheduler may set a threshold corresponding to a load amount, and compare the load amount corresponding to each gateway and the target service type with the threshold. If the load amount corresponding to a certain gateway and the target service type is lower than the threshold value, the node scheduler may determine the gateway as the target gateway. Optionally, if there are multiple gateways whose load amounts corresponding to the service types are lower than the threshold, the node scheduler may randomly determine one gateway as the target gateway from the multiple gateways whose load amounts are lower than the threshold; alternatively, the node scheduler may also sequentially select the target gateways from the plurality of gateways with the load amounts lower than the threshold value according to a preset sequence, which is not limited specifically.

As another optional embodiment, the node scheduler may sort, according to a load amount of each gateway corresponding to the target service type, each gateway included in the RTC system, and determine a gateway with the minimum corresponding load amount as the target gateway.

330. And determining a target central node corresponding to the target gateway from the at least two central nodes.

In this embodiment, if the target gateway corresponds to one central node, the node scheduler may directly determine the central node corresponding to the target gateway as the target central node.

If the target gateway corresponds to two or more central nodes, the node scheduler may randomly select one central node from the central nodes corresponding to the target gateway as the target central node. Or, the node scheduler may determine the target central node from the plurality of central nodes corresponding to the target node according to the operating states of the plurality of central nodes corresponding to the target gateway or the load capacity of each central node.

As an optional implementation manner, the node scheduler may monitor whether each central node included in the session protocol server cluster is down; if a certain central node is monitored to be down, the node scheduler can record the down central node; when the target call message is dispatched and distributed, the node dispatcher can ignore the central node which is out of operation, and distribute the target call message to the central node which corresponds to the target gateway and is not out of operation. That is, the node scheduler may determine a central node that corresponds to the target gateway and that is not down as the target central node. If the multimedia communication system comprises a database, the node scheduler can record the information of the down central node to the database. When the target call message is dispatched and distributed, the node dispatcher can inquire the information of the central node which is in the downtime from the database, so that the central node which is not in the downtime is determined.

340. And sending the target call message to the target center node so that the target call message is transmitted to the multimedia server through the target center node and the target gateway to establish a signaling link between the terminal and the multimedia server.

When the target call message reaches the multimedia server, the signaling link establishment between the terminal and the multimedia server is completed, and signaling such as a call response message, a call release message and the like can be transmitted on the signaling link.

In some possible embodiments, the signaling link may include: the terminal is connected with the target edge node, the target edge node is connected with the target center node, the target center node is connected with the target gateway, and the target gateway is connected with the multimedia server. Because the edge nodes and the central nodes of the session protocol server cluster are in the same cluster and based on session keep-alive mechanisms of session protocols such as the SIP protocol and the like, after the node scheduler determines the target central node and sends the target call message from the target edge node to the target central node, the target central node can acquire the information of the target edge node from the node scheduler. After the signaling link is established, the target central node can directly communicate with the target edge node, and data forwarding is not required to be performed through the node scheduler, so that the pressure of the node scheduler can be relieved to a certain extent.

In other possible embodiments, the signaling link may also include a node scheduler, and the node scheduler may also serve as a bridge between the target central node and the target edge node, and forward the signaling sent by the target central node to the target edge node, and/or forward the signaling sent by the target edge node to the target central node.

For example, with reference to the multimedia communication system shown in fig. 2 and the multimedia communication method shown in fig. 3, the following describes a flow of performing signaling negotiation and multimedia data transmission based on the multimedia communication system disclosed in the embodiment of the present application.

The terminal 230 may send the target call message to the target edge node 224, the target edge node 224 sends the target call message to the node scheduler 223, and the node scheduler 224 may identify a target service type of the target call message and query the database 240 for a load amount corresponding to the target service type for each gateway included in the RTC system 210. The node scheduler 224 determines the gateway 212 as a target gateway according to the load of each gateway, and determines the central node 221 as a target central node according to the correspondence between the gateway 212 and the central node. The node dispatcher 224 sends the target call message to the target central node 221, the target central node 221 sends the target call message to the target gateway 212, and the target gateway 212 sends the target call message to the multimedia server 214 after performing protocol conversion on the target call message.

Based on this, a signaling link between the terminal 230 and the multimedia server 214 is established, and the signaling link connection relationship in the signaling link includes: the terminal 230 is connected to the target edge node 224, the target edge node 224 is connected to the target center node 221, the target center node 221 is connected to the target gateway 212, and the target gateway 212 is connected to the multimedia server 214.

Multimedia server 214 may generate a target response message after receiving the call message. The target response message is returned to the terminal 230 along the signaling link described above, completing the signaling negotiation.

The target edge node 224 may establish an SRTP connection with the terminal 230 according to the connection information of the terminal 230 in the received target call message; and the target edge node 224 may establish an RTP connection with the multimedia server 214 according to the connection message of the multimedia server 214 in the received target response message. The multimedia server 214 and the terminal 230 can interact with multimedia data through SRTP connection and RTP connection with the target edge node. The terminal 230 and the target edge node 224 may be in different networks, and therefore, the SRTP connection may be used for multimedia data transmission, so as to improve the security of the multimedia data transmission.

In addition, at the time of call release, the call release message initiated by the terminal 230 or the multimedia server 214 will be performed along the original signaling link. That is, the call release message initiated by the terminal 230 reaches the multimedia server 211 via the target edge node 224, the target center node 221 and the target gateway 212, thereby completing the call release. Alternatively, the call release message initiated by the multimedia server 211 reaches the terminal 230 via the target gateway 212, the target central node 221 and the target edge node 224, thereby completing the call release.

Therefore, in the foregoing embodiment, by setting the node scheduler for performing the scheduling scheme of internal service bridging between the edge node and the central node, refined load balancing can be performed on a service level according to the service type of the call, which is beneficial to reducing the problem of server overload and enhancing the availability of the multimedia communication system. In addition, compared with a framework in which the edge node is directly connected with the central node, the bridge scheduling function provided by the node scheduler can realize efficient cluster scheduling of the session protocol server.

Further, in the foregoing embodiment, each gateway may correspond to multiple central nodes, and the node scheduler may monitor the central nodes, and if a central node is down, the node scheduler may skip the down server during scheduling and distributing, and send the target call message to the central node that is not down. That is, multiple central nodes corresponding to the same gateway may back up each other, so that the cluster disaster tolerance capability can be achieved, and the availability of the entire multimedia communication system can be enhanced.

Referring to fig. 4, fig. 4 is a schematic structural diagram of another multimedia communication system according to an embodiment. The multimedia communication system shown in fig. 4 can be optimized on the basis of the multimedia communication system shown in fig. 2. Compared to the system shown in fig. 2, the multimedia communication system shown in fig. 4 may further include: network load balancer 250.

A network load balancer 250 may be provided between the terminal 230 and the edge node 221, and the network load balancer may be connected with the terminal 230 and each edge node, respectively.

The Network Load balancer 250 may be any service device, and provides a Network Load Balancing (NLB) service.

The network load balancer 250 may assign a domain name or a Virtual IP Address (VIP) to the terminal 230. A plurality of terminals included in the multimedia communication system may uniformly access each edge node through a domain name bound to each terminal or a VIP assigned to each terminal, and an actual IP address of the edge node is not visible to the terminal. Thus, the terminal sends the target call message to the network load balancer based on the assigned domain name or VIP, which determines to which edge node the target call message is routed.

Referring to fig. 5, fig. 5 is a flowchart illustrating another multimedia communication method according to an embodiment. The method may be applied to the network load balancer described previously. As shown in fig. 5, the method may include the steps of:

510. and receiving the target call message sent by the terminal.

520. And determining target edge nodes from the edge nodes according to the load capacity of the edge nodes.

In the embodiment of the present application, the load amount of the edge node may be represented by the concurrency amount of the call task being processed by the edge node. The network load balancer can determine the target edge node from the plurality of edge nodes based on a polling algorithm, a hash algorithm and the like.

As an optional implementation manner, the network load balancer may further monitor whether each edge node is down, and after receiving the target call message, the network load balancer may skip the edge nodes that are down, and determine the edge nodes that are not down and have a smaller load amount as the target edge nodes. The edge node with a smaller load may be the edge node with the smallest load among the plurality of edge nodes, or the edge node with a load lower than a preset load among the plurality of edge nodes, and is not particularly limited.

That is, the network load balancer may skip when an edge node hangs up

530. And sending the target call message to the target edge node.

After the network equalizer sends the target call message to the target edge node, the target edge node may continue to send the target call message to the aforementioned node scheduler, and the node scheduler performs server scheduling to send the target call message to the RTC multimedia server, thereby establishing a signaling link between the terminal and the multimedia server.

It should be noted that, if the multimedia communication system includes the network load balancer, the signaling link between the terminal and the multimedia server may include the network load balancer, and the terminal and the target edge node are connected by the network load balancer.

In addition, the network load balancer stores the connection relationship of the target edge node and the terminal initiating the call in the signaling link. At call release, a call release message initiated by a terminal or multimedia server needs to be forwarded via a network load balancer to ensure that the initiation and release of the call is completed via a consistent signaling link.

After the signaling link is established, a call release message initiated by the terminal is sent to the target edge node by the network load balancer according to the signaling link connection relation and reaches the multimedia server through the target edge node, the target center node and the target gateway; alternatively, the first and second electrodes may be,

after the signaling link is established, the call release message initiated by the multimedia server is transmitted to the network load balancer through the target gateway, the target center node and the target edge node, and the network load balancer transmits the message to the terminal according to the connection relation of the signaling link.

It can be seen that, in the foregoing embodiment, the network load balancer can uniformly access each terminal included in the multimedia communication system to the session protocol server cluster, and connect the terminal and the edge node through the network load balancer, so that each edge node has an equivalent function, the edge node in the session protocol server cluster can be infinitely expanded, and the terminals registered on the edge node can also be expanded in the same proportion, so that the entire multimedia communication system can theoretically support unlimited access of the terminals, and provide strong performance support for the SIP access capability of the RTC.

The embodiment of the application discloses a multimedia communication system, the system architecture of which can be shown in fig. 2, the multimedia communication system comprises edge nodes of at least two session protocol server clusters, a central node of at least two session protocol server clusters, a node scheduler, a terminal, at least two gateways and a multimedia server; the node scheduler is respectively connected with each edge node and each central node; each gateway corresponds to at least one central node;

the terminal is used for initiating a target calling message and sending the target calling message to the target edge node; the target edge node is an edge node to which a terminal is accessed in each edge node;

the target edge node is used for sending the target call message to the node dispatcher;

the node scheduler is used for determining a target gateway from at least two gateways according to the load capacity corresponding to each gateway and the target service type; determining a target central node corresponding to the target gateway from the at least two central nodes, and sending a target call message to the target central node;

the target central node is used for sending the target call message to the target gateway;

and the target gateway is used for sending the target call message to the multimedia server so as to establish a signaling link between the terminal and the multimedia server.

In one embodiment, the multimedia communication system further comprises: a network load balancer; and the network load balancer is respectively connected with the terminal and each edge node. The system architecture of a multimedia communication system including a network load balancer can be seen in fig. 4.

The network load balancer is used for receiving a target call message sent by the terminal;

the network load balancer is also used for determining a target edge node from at least two edge nodes according to the load capacity of each edge node;

and the network load balancer is also used for sending the target call message to the target edge node.

Referring to fig. 6, fig. 6 is a schematic structural diagram of a node scheduler according to an embodiment. The node scheduler may be applied to any of the multimedia communication systems described above. As shown in fig. 6, node scheduler 600 may include: a communication module 610 and a determination module 620.

A communication module 610, configured to receive a target call message sent by a target edge node, and identify a target service type of the target call message; the target edge node is an edge node accessed by a terminal in each edge node;

a determining module 620, configured to determine a target gateway from at least two gateways according to a load amount corresponding to each gateway and a target service type; determining a target central node corresponding to the target gateway from the at least two central nodes;

the communication module 610 is further configured to send the target call message to the target central node, so that the target call message is transmitted to the multimedia server via the target central node and the target gateway, so as to establish a signaling link between the terminal and the multimedia server.

In an embodiment, the determining module 620 may be further configured to determine, from the at least two gateways, a target gateway whose load amount corresponding to the target service type is lower than a threshold; or, determining the target gateway with the minimum load corresponding to the target service type from the at least two gateways.

In one embodiment, the multimedia communication system further comprises: a database; the database is respectively connected with each gateway and the node dispatcher; each gateway processes calls of at least two different service types, and the database stores the load amounts respectively corresponding to the calls of the different service types processed by each gateway;

the determining module 620 may be further configured to query the database for the load amount of each gateway of the at least two gateways corresponding to the target service type before determining the target gateway from the at least two gateways according to the load amount of each gateway corresponding to the target service type.

In one embodiment, the node scheduler 600 may further include: and a monitoring module.

The monitoring module may be configured to monitor whether each central node included in the at least two central nodes is down before the determining module 620 determines the target gateway from the at least two gateways according to the load amount of each gateway corresponding to the target service type;

the determining module 620 may be further configured to determine, from the at least two central nodes, a central node that is not down and corresponds to the target gateway as the target central node.

Therefore, by implementing the node scheduler disclosed in the foregoing embodiment, internal service bridging can be performed between the edge node and the central node through the node scheduler, and refined load balancing is performed on a service level according to the service type of the call, which is beneficial to reducing the problem of server overload and enhancing the availability of the multimedia communication system. In addition, compared with the architecture in which the edge node is directly connected with the central node, the bridge scheduling function provided by the node scheduler can realize efficient cluster scheduling of the session protocol server.

Referring to fig. 7, fig. 7 is a schematic structural diagram of a network load balancer according to an embodiment. The network load balancer can be applied to any one of the multimedia communication systems. As shown in fig. 7, the network load balancer 700 may include: a transceiver module 710 and an equalization module 720.

A transceiver module 710, configured to receive a target call message sent by a terminal;

the balancing module 720 is configured to determine a target edge node from each edge node according to a load of each edge node;

the transceiving module 710 is further configured to send the target call message to the target edge node, so as to send the target call message to the node dispatcher through the target edge node, so that the target call message reaches the multimedia server via the node dispatcher, the target central node and the target gateway, so as to establish a signaling link between the terminal and the multimedia server;

the target central node is a central node corresponding to the target gateway in at least two central nodes; and the target gateway is determined from each gateway according to the load quantity corresponding to each gateway and the target service type after the node dispatcher identifies the target service type of the target call message.

In an embodiment, the balancing module 720 may be further configured to monitor whether each edge node is down, and determine, according to a load of each edge node, an edge node that is not down from the at least two edge nodes as the target edge node.

In one embodiment, the transceiver module 710 is further configured to send the terminal-initiated call release message to the target edge node according to the stored signaling link connection relationship between the target edge node and the terminal in the signaling link, so that the terminal-initiated call release message reaches the multimedia server via the target edge node, the target center node, and the target gateway.

Or, the transceiver module 710 may be further configured to receive a call release message initiated by the multimedia server and transmitted by the target edge node, and send the call release message initiated by the multimedia server to the terminal according to the stored signaling link connection relationship between the target edge node and the terminal in the signaling link; the calling release message initiated by the multimedia server is transmitted to the target edge node through the target gateway and the target central node.

It can be seen that, by implementing the network load balancer disclosed in the foregoing embodiment, each terminal included in the multimedia communication system can be uniformly accessed to the session protocol server cluster, and the terminal and the edge node are connected by the network load balancer, so that each edge node has an equivalent function, the edge node in the session protocol server cluster can be infinitely expanded, and the terminals registered on the edge node can also be expanded in the same proportion, so that the whole multimedia communication system can theoretically support unlimited access of the terminals, and provide strong performance support for the SIP access capability of the RTC.

Referring to fig. 8, fig. 8 is a schematic structural diagram of a service device according to an embodiment. The service device may be the aforementioned node scheduler or network load balancer. As shown in fig. 8, the node scheduler may include:

a memory 810 storing executable program code;

a processor 820 coupled to the memory 810;

the processor 820 calls the executable program code stored in the memory 810 to execute any one of the multimedia communication methods disclosed in the embodiments of the present application.

The embodiment of the application discloses a computer readable storage medium, which stores a computer program, wherein the computer program realizes any one of the multimedia communication methods applied to the node scheduler when being executed by a processor.

The embodiment of the application discloses a computer readable storage medium, which stores a computer program, wherein when the computer program is executed by a processor, the computer program can implement any one of the multimedia communication methods using a network load balancer disclosed in the embodiment of the application.

Embodiments of the present application disclose a computer program product comprising a non-transitory computer readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform any one of the multimedia communication methods disclosed in the embodiments of the present application as applied to a node scheduler or a network load balancer.

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art should also appreciate that the embodiments described in this specification are all alternative embodiments and that the acts and modules involved are not necessarily required for this application.

In various embodiments of the present application, it should be understood that the size of the serial number of each process described above does not mean that the execution sequence is necessarily sequential, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present application, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, may be embodied in the form of a software product, stored in a memory, including several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of the embodiments of the present application.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be implemented by program instructions associated with hardware, and the program may be stored in a computer-readable storage medium, which includes Read-Only Memory (ROM), random Access Memory (RAM), programmable Read-Only Memory (PROM), erasable Programmable Read-Only Memory (EPROM), one-time Programmable Read-Only Memory (OTPROM), electrically Erasable Programmable Read-Only Memory (EEPROM), an optical Disc-Read-Only Memory (CD-ROM) or other storage medium, a magnetic tape, or any other medium capable of storing data for a computer or other computer.

The multimedia communication method, system, related devices and storage medium disclosed in the embodiments of the present application are described in detail above, and the principles and embodiments of the present application are described herein using specific examples, and the description of the above embodiments is only used to help understand the method and core ideas of the present application. Meanwhile, for a person skilled in the art, according to the idea of the present application, the specific implementation manner and the application scope may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A multimedia communication method, applied to a node scheduler in a multimedia communication system, the multimedia communication system further comprising: the system comprises edge nodes of at least two session protocol server clusters, central nodes of the at least two session protocol server clusters, terminals, at least two gateways and a multimedia server; the node scheduler is respectively in communication connection with each edge node and each central node; each gateway corresponds to at least one of the central nodes; the method comprises the following steps:

receiving a target calling message sent by a target edge node, and identifying a target service type of the target calling message; the target edge node is the edge node to which the terminal is accessed in each edge node;

determining a target gateway from the at least two gateways according to the load capacity of each gateway corresponding to the target service type;

determining a target central node corresponding to the target gateway from the at least two central nodes;

and sending the target call message to the target central node so that the target call message is transmitted to the multimedia server through the target central node and the target gateway to establish a signaling link between the terminal and the multimedia server.

2. The method according to claim 1, wherein the determining a target gateway from the at least two gateways according to a load amount corresponding to each gateway and the target service type includes:

determining a target gateway with the load amount corresponding to the target service type lower than a threshold value from the at least two gateways; alternatively, the first and second electrodes may be,

and determining the target gateway with the minimum load corresponding to the target service type from the at least two gateways.

3. The method of claim 1, wherein the multimedia communication system further comprises: a database; the database is respectively connected with each gateway and the node dispatcher; each gateway processes calls of at least two different service types, and the database stores the load amounts respectively corresponding to the calls of the different service types processed by each gateway;

before determining a target gateway from the at least two gateways according to the load amount corresponding to each gateway and the target service type, the method further includes:

and inquiring the load quantity corresponding to the target service type of each gateway in the at least two gateways from the database.

4. The method of claim 1, wherein prior to determining a target central node corresponding to the target gateway from the at least two central nodes, the method further comprises:

monitoring whether each central node included in the at least two central nodes is down;

and the step of determining a target central node corresponding to the target gateway from the at least two central nodes comprises:

and determining a central node which is not down and corresponds to the target gateway from the at least two central nodes as a target central node.

5. The method of claim 1, wherein the multimedia communication system further comprises: a network load balancer; the network load balancer is respectively connected with the terminal and each edge node, and the terminal is accessed to the target edge node through a domain name or a virtual IP address distributed by the load balancer;

the target edge node is determined from the at least two edge nodes according to the load capacity of each edge node after the network load balancer receives the target call message sent by the terminal; the target call message is sent by the network load balancer to the target edge node.

6. The method according to claim 5, wherein the target edge node is an edge node that is not down, which is determined by the network load balancer from the at least two edge nodes according to the load capacity of each of the edge nodes.

7. The method according to claim 5, wherein the network load balancer stores the signaling link connection relationship between the target edge node and the terminal in the signaling link;

after the signaling link is established, the call release message initiated by the terminal is sent to the target edge node by the network load balancer according to the signaling link connection relation, and reaches the multimedia server through the target edge node, the target central node and the target gateway; alternatively, the first and second electrodes may be,

after the signaling link is established, the call release message initiated by the multimedia server is transmitted to the network load balancer through the target gateway, the target central node and the target edge node, and the network load balancer sends the message to the terminal according to the connection relation of the signaling link.

8. A multimedia communication method is characterized in that the method is applied to a network load balancer in a multimedia communication system; the multimedia communication system further comprises: the system comprises edge nodes of at least two session protocol server clusters, central nodes of the at least two session protocol server clusters, a node scheduler, a terminal, at least two gateways and a multimedia server; the node dispatcher is respectively connected with each edge node and each central node; the terminal is connected with the network load balancer, and the network load balancer is also connected with each edge node respectively; each gateway corresponds to at least one central node; the method comprises the following steps:

receiving a target call message sent by the terminal;

determining a target edge node from each edge node according to the load capacity of each edge node;

sending the target call message to the target edge node to send the target call message to the node dispatcher through the target edge node, so that the target call message reaches the multimedia server through the node dispatcher, a target central node and a target gateway to establish a signaling link between the terminal and the multimedia server;

wherein the target central node is a central node corresponding to the target gateway in the at least two central nodes; and the target gateway is determined from each gateway according to the load quantity of each gateway corresponding to the target service type after the node dispatcher identifies the target service type of the target call message.

9. A multimedia communication system, comprising: the system comprises edge nodes of at least two session protocol server clusters, center nodes of the at least two session protocol server clusters, a node scheduler, a terminal, at least two gateways and a multimedia server; the node scheduler is respectively connected with each edge node and each central node; each gateway corresponds to at least one of the central nodes;

the terminal is used for initiating a target calling message and sending the target calling message to a target edge node; the target edge node is the edge node to which the terminal is accessed in each edge node;

the node scheduler is used for determining a target gateway from the at least two gateways according to the load capacity of each gateway corresponding to the target service type; determining a target central node corresponding to the target gateway from the at least two central nodes, and sending the target call message to the target central node;

10. The system of claim 9, wherein the multimedia communication system further comprises: a network load balancer; the network load balancer is respectively connected with the terminal and each edge node;

the network load balancer is used for receiving the target call message sent by the terminal;

the network load balancer is further configured to determine a target edge node from the at least two edge nodes according to the load capacity of each edge node;

the network load balancer is further configured to send the target call message to the target edge node.

11. A node scheduler, wherein the node scheduler is applied to a multimedia communication system, and wherein the multimedia communication system further comprises: the system comprises edge nodes of at least two session protocol server clusters, central nodes of the at least two session protocol server clusters, terminals, at least two gateways and a multimedia server; the node scheduler is respectively in communication connection with each edge node and each central node; each gateway corresponds to at least one of the central nodes; the node scheduler includes:

the communication module is used for receiving a target calling message sent by a target edge node and identifying a target service type of the target calling message; the target edge node is the edge node to which the terminal is accessed in each edge node;

the determining module is used for determining a target gateway from the at least two gateways according to the load amount of each gateway corresponding to the target service type; determining a target central node corresponding to the target gateway from the at least two central nodes;

the communication module is further configured to send the target call message to the target central node, so that the target call message is transmitted to the multimedia server through the target central node and the target gateway, so as to establish a signaling link between the terminal and the multimedia server.

12. A network load balancer, wherein the network load balancer is applied to a multimedia communication system; the multimedia communication system further comprises: the system comprises edge nodes of at least two session protocol server clusters, central nodes of the at least two session protocol server clusters, a node scheduler, a terminal, at least two gateways and a multimedia server; the node scheduler is respectively connected with each edge node and each central node; the terminal is connected with the network load balancer, and the network load balancer is also connected with each edge node respectively; each gateway corresponds to at least one of the central nodes; the network load balancer comprises:

the receiving and sending module is used for receiving a target call message sent by the terminal;

the balancing module is used for determining a target edge node from each edge node according to the load capacity of each edge node;

the transceiver module is further configured to send the target call message to the target edge node, so as to send the target call message to the node dispatcher through the target edge node, so that the target call message reaches the multimedia server via the node dispatcher, a target central node and a target gateway, so as to establish a signaling link between the terminal and the multimedia server;

wherein the target central node is a central node of the at least two central nodes corresponding to the target gateway; and the target gateway is determined from each gateway according to the load quantity of each gateway corresponding to the target service type after the node dispatcher identifies the target service type of the target call message.

13. A service device comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to implement the method of any one of claims 1 to 7 or 8.

14. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1 to 7 or 8.