CN114666264A - Multi-path transmission method and device - Google Patents
Multi-path transmission method and device Download PDFInfo
- Publication number
- CN114666264A CN114666264A CN202210249242.9A CN202210249242A CN114666264A CN 114666264 A CN114666264 A CN 114666264A CN 202210249242 A CN202210249242 A CN 202210249242A CN 114666264 A CN114666264 A CN 114666264A
- Authority
- CN
- China
- Prior art keywords
- transmission
- path
- data stream
- transmission path
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 358
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000004891 communication Methods 0.000 claims abstract description 162
- 238000012544 monitoring process Methods 0.000 claims description 46
- 230000011664 signaling Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 12
- 238000009499 grossing Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 8
- 238000012163 sequencing technique Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/24—Multipath
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
Abstract
The present disclosure provides a multipath transmission method and apparatus, applied to a real-time communication system, where the real-time communication system includes at least two communication nodes, and the communication nodes share a scheduling service and a transmission service, and the method specifically includes: acquiring data flow request information through the scheduling service; acquiring path nodes through a scheduling service based on the data stream request information; calling the transmission service to create a transmission path group based on the path node, and selecting a target transmission path from the transmission path group; and carrying out data stream transmission between the communication nodes based on the target transmission path. The method and the device have the advantages that the multiple transmission paths are generated among the communication nodes, the target transmission path is determined among the multiple transmission paths for data stream transmission, and the reliability and the efficiency of data stream transmission are improved.
Description
Technical Field
The present disclosure relates to the field of communications technologies, and in particular, to a multipath transmission method and apparatus.
Background
In a real-time communication system, when communication nodes are located in different regions, the communication nodes usually access different servers, and communication data needs to be transmitted across the wide area network. In the prior art, single-path transmission is usually performed at a communication node, however, single-path transmission is poor in reliability, if a path is interrupted, communication data transmission between the communication nodes is interrupted, and time consumption is increased when a transmission path is reestablished.
Disclosure of Invention
The disclosure provides a multi-path transmission method and a multi-path transmission device, which enable a plurality of transmission paths to be generated between communication nodes, and determine a target transmission path among the plurality of transmission paths to transmit a data stream, thereby improving the reliability and efficiency of data stream transmission.
In a first aspect, the present disclosure provides a multipath transmission method applied to a real-time communication system, where the real-time communication system includes at least two communication nodes, and the communication nodes share a scheduling service and a transmission service, and the method specifically includes:
acquiring data flow request information through the scheduling service;
acquiring path nodes through a scheduling service based on the data stream request information;
calling the transmission service to create a transmission path group based on the path node, and selecting a target transmission path from the transmission path group;
and carrying out data stream transmission between the communication nodes based on the target transmission path.
According to the multipath transmission method provided by the present disclosure, the selecting a target transmission path in the transmission path group includes:
monitoring the transmission paths in the transmission path group in real time through the transmission service to obtain the monitoring result of the transmission paths;
and selecting a target transmission path based on the monitoring result.
According to the multipath transmission method provided by the present disclosure, the real-time communication system further includes a signaling service;
before the obtaining of the data flow request information by the scheduling service, the method includes:
adding the communication node to a preset conference room through the signaling service;
and correspondingly setting a media node for the communication node through the scheduling service, wherein the media node is used for sending and/or receiving the data stream.
According to the multipath transmission method provided by the present disclosure, the monitoring the transmission paths in the transmission path group in real time through the transmission service, and acquiring the monitoring result of the transmission path includes:
calling the transmission service to periodically send a heartbeat packet to the transmission path from the communication node corresponding to the source end to the communication node corresponding to the target end, receiving the heartbeat packet through the communication node corresponding to the target end and feeding back a heartbeat response packet to the communication node corresponding to the source end to generate path delay;
sequentially performing smoothing processing and fitting processing on the path delay through the transmission service to generate a delay growth rate corresponding to the transmission path;
and sequencing the delay increase rates corresponding to the transmission paths from small to large through the transmission service to obtain the monitoring result of the transmission paths.
According to the multipath transmission method provided by the present disclosure, the data stream comprises an audio data stream and a video data stream;
the selecting a target transmission path based on the monitoring result comprises:
selecting a transmission path corresponding to the minimum value of the delay growth rate from the monitoring result as a target transmission path under the condition that the data stream is a video data stream;
and under the condition that the data stream is an audio data stream, selecting a transmission path corresponding to the minimum value and the second minimum value of the delay growth rate from the monitoring result as a target transmission path.
According to the multi-path transmission method provided by the present disclosure, the transmitting data streams between the communication nodes based on the target transmission path includes:
under the condition that the data stream is a video data stream, performing video data stream transmission between the communication nodes by taking the transmission path corresponding to the minimum delay growth rate as a target transmission path;
and under the condition that the data stream is an audio data stream, taking the transmission path corresponding to the minimum value and the second minimum value of the delay growth rate as a target transmission path to simultaneously transmit the audio data stream between the communication nodes.
In a second aspect, the present disclosure provides a multi-path transmission apparatus, applied to a real-time communication system, where the real-time communication system includes a sending end and a receiving end, and the sending end and the receiving end share a scheduling service and a transmission service, and the apparatus specifically includes:
a first obtaining module, configured to obtain data flow request information through the scheduling service;
a second obtaining module, configured to obtain a path node through a scheduling service based on the data flow request information;
a creating module, configured to invoke the transmission service to create a transmission path group based on the path node, and select a target transmission path in the transmission path group;
and the transmission module is used for carrying out data stream transmission between the communication nodes based on the target transmission path.
In a third aspect, the present disclosure provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor executes the program to implement the steps of the multipath transmission method according to any one of the above-mentioned embodiments.
In a fourth aspect, the present disclosure provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the multipath transmission method as in any one of the above.
In a fifth aspect, the present disclosure provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of the multipath transmission method as claimed in any one of the preceding claims.
The invention provides a multi-path transmission method and a device, in a real-time communication system, when communication is carried out between communication nodes, firstly, data flow request information is obtained through a scheduling service, and path nodes for carrying out data flow transmission between the communication nodes are obtained through the scheduling service based on the data flow request information; and finally, selecting a target transmission path from the transmission path group to carry out data stream transmission between the communication nodes. The method and the device realize the generation of a plurality of transmission paths among the communication nodes and the determination of the target transmission path in the plurality of transmission paths for the transmission of the data stream, and improve the reliability and the efficiency of the transmission of the data stream.
Drawings
In order to more clearly illustrate the technical solutions of the present disclosure or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic flowchart of a multipath transmission method according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of an acquired latency growth rate provided by an embodiment of the present disclosure;
fig. 3 is a block diagram of a user a and a user B performing multi-path transmission according to an embodiment of the present disclosure;
fig. 4 is a schematic flowchart of a multi-path transmission performed by a user a and a user B according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a multipath transmission device according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of an electronic device provided by the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are some, but not all, of the embodiments of the present disclosure. All other embodiments, which can be obtained by a person skilled in the art without making creative efforts based on the embodiments of the present disclosure, belong to the protection scope of the embodiments of the present disclosure.
The multipath transmission method provided by the embodiment of the disclosure is applied to a real-time communication system, wherein the real-time communication system comprises at least two communication nodes, and the communication nodes share scheduling service and transmission service.
In the embodiment of the present disclosure, the real-Time communication system may be understood as an RTC real-Time communication service system, an RTC (real Time communication) real-Time communication service, that is, a data stream communication technology implemented based on an IP technology and realizing real-Time interaction. The purpose is to forward data flow in real time, and enable users to communicate and interact in real time.
A communication node may be understood as a client to which communication between two or more parties in a real-time communication system corresponds. A client may correspond to a user and may therefore also be understood as a communication between two or more users.
Scheduling service refers to a service in a real-time communication system, and serves a communication node or a user corresponding to the communication node.
The transmission service belongs to a type of service in a real-time communication system, and is applied to data stream transmission between communication nodes or users corresponding to the communication nodes.
In the real-time communication system, the scheduling service and the transmission service are shared between the communication nodes, and the embodiment of the present disclosure is described by taking two communication nodes as an example.
Referring to fig. 1, a flowchart of a multipath transmission method provided in the embodiment of the present disclosure is shown, where the method specifically includes:
and 110, acquiring data stream request information through the scheduling service.
In this step, the communication node is set as two-party clients, and it can be understood that the two-party clients respectively correspond to the user a and the user B for communication. User a and user B share the scheduling service while communicating.
Correspondingly, if the communication between the user a and the user B is to be realized, the user a and the user B need to subscribe to the data stream of the other party, and taking the example that the user B subscribes to the data stream of the user a, the data stream request information is obtained through the scheduling service, that is, the user B sends the request information for obtaining the data stream of the user a to the scheduling service.
And 120, acquiring path nodes through a scheduling service based on the data flow request information.
In this step, the scheduling service receives request information for acquiring a data stream of the user a sent by the user B, and acquires a path node for data stream transmission between the user B and the user a based on the received request information.
The path node may understand each node required for generating the transmission path, and in the embodiment of the present disclosure, the path node may be a relay node, and the relay node is a forwarding node of a data stream in the real-time communication system, and similar to a device responsible for receiving and forwarding the data stream, receives the data stream of one communication node, and then forwards the received data stream to another communication node.
Specifically, the scheduling service acquires a path node required for data stream transmission between the user B and the user a based on the received data stream request information.
And 130, calling the transmission service to create a transmission path group based on the path nodes, and selecting a target transmission path from the transmission path group.
In this step, the transmission service is a type of service that creates a transmission path for data streaming between communication nodes in a real-time communication system.
The transmission service establishes a connection relation for the acquired path nodes, thereby creating a transmission path group, wherein the transmission path group comprises a plurality of transmission paths, and the data stream transmission between the user B and the user A can be realized by selecting a target transmission path from the plurality of transmission paths.
140, performing data stream transmission between the communication nodes based on the target transmission path.
In this step, when the user B subscribes to the data stream of the user a, the data stream of the user a is transmitted to the user B based on the target transmission path.
Correspondingly, in the case that the user a subscribes to the data stream of the user B, the data stream of the user B is transmitted to the user a based on the target transmission path.
The multi-path transmission method includes that when communication is carried out between communication nodes in a real-time communication system, data flow request information is obtained through scheduling service, and path nodes for carrying out data flow transmission between the communication nodes are obtained through the scheduling service based on the data flow request information; and finally, selecting a target transmission path from the transmission path group to carry out data stream transmission between the communication nodes. The method and the device realize the generation of a plurality of transmission paths among the communication nodes and the determination of the target transmission path in the plurality of transmission paths for the transmission of the data stream, and improve the reliability and the efficiency of the transmission of the data stream.
Based on any of the above embodiments, the step 130 specifically includes the following steps 131 to 132:
step 131, monitoring the transmission paths in the transmission path group in real time through the transmission service, and obtaining the monitoring result of the transmission paths.
In this step, the transmission service in the real-time communication system also has another function, that is, a function of maintaining the transmission path, where maintaining the transmission path refers to performing real-time monitoring on the transmission path, where the real-time monitoring is mainly performed for transmission delay on the transmission path.
Step 132, selecting a target transmission path based on the monitoring result.
In this step, a target transmission path is selected based on a monitoring result of transmission delay on each path.
Based on any of the above embodiments, the real-time communication system further comprises a signaling service.
The signaling service refers to a service for coordinating communication of each communication node in a real-time communication system.
The method comprises the following steps 111-112 before the step 110:
and step 111, adding the communication node into a preset conference room through the signaling service.
In this step, the communication node may be understood as a corresponding client during communication, and the client may correspond to a user, so that the communication node may be understood as communication between the user a and the user B, that is, data stream transmission between the user a and the user B. In order to implement data stream transmission between the user a and the user B, the client a and the client B corresponding to the user a and the user B need to be added to the same preset conference room in advance.
Adding the client A and the client B corresponding to the user A and the user B into the same preset conference room is completed through signaling service in a real-time communication system.
And 112, setting a media node for the communication node through the scheduling service, wherein the media node is used for transmitting and/or receiving the data stream.
In this step, the scheduling service is specifically a service for accessing the media node and the acquisition path node for the communication node.
A media node is a node for receiving and transmitting data streams in said real-time communication system. For example, a user B subscribes to a data stream of the user a, and needs to transmit the data stream of the user a to the user B through a target transmission path, where a media node set by the user a is a sending node and a media node set by the user B is a receiving node.
Based on any of the above embodiments, in the case that the user B subscribes to the data stream of the user a, the transmission Path group created by the transmission service may include the following transmission paths, and in the embodiment of the present disclosure, taking the transmission Path group including two transmission paths as an example, Path 1: media node a-relay node 1-media node B, Path2 media node a-relay node 2-media node B.
Correspondingly, in the case that the user a subscribes to the data stream of the user B, the transmission Path group created by the transmission service may include the following transmission paths, and in the embodiment of the present disclosure, taking the transmission Path group including two transmission paths as an example, Path 1: media node B-relay node 1-media node a, Path2 media node B-relay node 2-media node a.
Based on any of the above embodiments, the step 131 specifically includes the following steps 1311 to 1313:
the main mode adopted for real-time monitoring of the transmission paths in the transmission path group through the transmission service is a path quality monitoring algorithm, and the path quality monitoring algorithm specifically comprises delay acquisition, delay smoothing, delay fitting and delay sequencing.
Step 1311 is a delay acquisition part in the path quality monitoring algorithm, step 1312 is a delay smoothing and delay fitting part in the path quality monitoring algorithm, and step 1313 is a delay sorting part in the path quality monitoring algorithm.
Step 1311, invoking the transmission service to periodically send a heartbeat packet to the transmission path from the communication node corresponding to the source end to the communication node corresponding to the target end, receiving the heartbeat packet by the communication node corresponding to the target end, and feeding back a heartbeat response packet to the communication node corresponding to the source end to generate a path delay.
In the step, the method belongs to a delayed acquisition part, and the specific acquisition process comprises the following steps: on each transmission path, the transmission service periodically sends a heartbeat packet from the communication node corresponding to the source end to the communication node corresponding to the target end, and the communication node corresponding to the target end sends a heartbeat response packet to the communication node corresponding to the source end after receiving the heartbeat packet, so as to generate path delay.
In the embodiment of the present disclosure, the specific path delay may be:
cost_time＝heartbeat_response_time－heartbeat_send_time (1)
wherein, cost _ time is the heartbeat delay, heartbeat _ send _ time is the sending time of the heartbeat packet, and heartbeat _ response _ time is the time of receiving the heartbeat response packet.
The periodicity may be set to send a heartbeat every 10s, and if a timeout occurs, delay takes a large value of 500 ms.
Step 1312, sequentially performing smoothing processing and fitting processing on the path delay through the transmission service, and generating a delay increase rate corresponding to the transmission path.
In this step, the smoothing process is performed as follows:
delay(t)＝b*cost_time(t)+(1－b)*delay(t－1) (2)
in the embodiment of the present disclosure, b is a smoothing coefficient, where b is 0.3, and the parameter may be set according to a specific application scenario, and is not limited in this disclosure.
The smooth processing of the path delay can avoid the large fluctuation of delay data caused by the influence of network jitter in the process of acquiring the path delay.
The process of performing the fitting process is as follows:
referring to fig. 2, which is a schematic diagram of the obtained delay growth rate provided by the embodiment of the present disclosure, specifically, the path delay after n times of smoothing is taken, and the delay growth rate is fitted by using a least square method, and the result is:
where x represents time, y represents path delay after smoothing processing, i.e., delay, and k represents a delay growth rate.
Step 1313, sorting the delay increase rates corresponding to the transmission paths in the order from small to large through the transmission service, and obtaining the monitoring result of the transmission path.
In this step, the delay growth rates corresponding to all the transmission paths in the transmission path group are sorted in the order from small to large, and the monitoring result of the transmission paths, that is, the sorting result of the delay growth rates corresponding to the transmission paths is obtained.
According to any of the above embodiments, the data stream comprises an audio data stream and a video data stream;
the step 132 specifically includes the following steps 1321 to 1322:
step 1321, in a case that the data stream is a video data stream, selecting a transmission path corresponding to the minimum value of the delay growth rate from the monitoring result as a target transmission path.
In this step, the smaller the delay growth rate of the transmission path, the better the quality of the transmission path, so the transmission path corresponding to the minimum value of the delay growth rate is selected as the target transmission path for transmitting the video data stream.
Step 1322, in a case that the data stream is an audio data stream, selecting a transmission path corresponding to the minimum value and the second minimum value of the delay growth rate from the monitoring result as a target transmission path.
In this step, for example, in the case that the application scene is a conference, in view of the importance of the audio data stream to the conference and the characteristic that the audio data amount is small, the transmission path corresponding to the minimum value of the delay growth rate and the second minimum value is selected as the target transmission path to increase the arrival rate of the audio data stream and ensure that the conference is smoothly performed.
Based on any of the above embodiments, the step 140 specifically includes the following steps 141 to 142:
and step 141, when the data stream is a video data stream, performing video data stream transmission between the communication nodes by using the transmission path corresponding to the minimum delay growth rate as a target transmission path.
And 142, taking the transmission path corresponding to the minimum value and the second minimum value of the delay growth rate as a target transmission path to simultaneously transmit the audio data streams between the communication nodes under the condition that the data streams are the audio data streams.
Further, supplementary explanation is further made on implementation of the present disclosure, taking communication nodes as user a and user B as an example.
Referring to fig. 3, it can be seen that the whole RTC real-time communication system includes a user a corresponding to a client a, a user B corresponding to a client B, a media node a, a media node B, a relay node, a scheduling service, and a signaling service.
Correspondingly, media node a and media node B are set for user a and user B, respectively, through a scheduling service. The relay node is acquired by scheduling a service. Before communication between the user A and the user B, the client A and the client B corresponding to the user A and the user B respectively need to be added into the same conference room in advance through signaling service.
Specifically, for example, the user a and the user B need to perform audio-video data stream communication. The client A and the client B corresponding to the user A and the user B respectively join the same room under the coordination of the signaling service, and the user A and the user B subscribe the audio and video data stream of the other side mutually through the signaling service. User a and user table B access the RTC system from media node a and media node B, respectively, with the help of a scheduling service. Specifically, taking the example that the user B sends the request information for acquiring the audio and video data stream of the user a to the scheduling service, based on the request information, the Path node is acquired through the scheduling service, the transmission service establishes a connection relationship with the Path node, and a transmission Path group is created, where the transmission Path group includes Path1, Path2, …, and PathN; the transmission service monitors the transmission delay on each transmission path in real time, acquires the corresponding delay growth rate, and considers that the quality of the transmission path is better when the delay growth rate is smaller. And selecting the transmission path corresponding to the minimum delay growth rate value for the video data stream to transmit, and selecting the transmission paths corresponding to the minimum delay growth rate value and the second minimum delay growth rate value to simultaneously transmit in view of the importance of audio to the conference and the characteristic of small audio data volume, so as to improve the audio arrival rate and ensure the smooth operation of the conference.
Specifically, referring to fig. 4, a schematic flow diagram of a multi-path transmission performed by a user a and a user B according to the embodiment of the present disclosure, taking a data stream of the user a subscribed by the user B as an example, specifically includes steps 410 to 480:
user B sends 410 a request message to the scheduling service to get the data stream of user a.
And 420, receiving the request information through the scheduling service and acquiring the relay node.
Invoking the transport service creates a transport path group based on the relay node and the preset media node 430.
Specifically, the transmission Path through which the user B obtains the data stream of the user a may be, in the embodiment of the present disclosure, two paths are taken as an example, and are respectively Path 1: media node a-relay node 1-media node B, Path2 media node a-relay node 2-media node B.
If the request information is the request information for the user a to send the data stream of the user B to the scheduling service, the corresponding transmission Path is Path 1: media node B-relay node 1-media node a, Path2 media node B-relay node 2-media node a.
And 440, invoking a transmission service to periodically send a heartbeat packet to each transmission path in the transmission path group from the user A to the user B, receiving the heartbeat packet through the user B and feeding back a heartbeat response packet to the user A to generate path delay.
And 450, sequentially performing smoothing processing and fitting processing on the path delay through the transmission service to generate a delay growth rate k corresponding to the transmission path.
And 460, sequencing the delay growth rates k corresponding to the transmission paths from small to large through the transmission service, and acquiring the monitoring result of the transmission paths.
Specifically, the transmission Path group includes two transmission paths Path1 and Path2, and delay increase rates k1 and k2 of Path1 and Path2 are obtained and sorted, and as a result, k1 is less than k 2.
470, when the data stream is a video data stream, the video data stream is transmitted between the user a and the user B by using the transmission path corresponding to the minimum value of the delay growth rate k as the target transmission path.
Specifically, the transmission Path group includes two transmission paths Path1 and Path2, and the delay growth rates k1< k2 of the paths 1 and 2, so that the Path1 corresponding to k1 is selected as the target transmission Path to perform video data stream transmission between the user a and the user B.
And 480, when the data stream is an audio data stream, simultaneously transmitting the audio data stream between the user a and the user B by using the transmission path corresponding to the minimum value and the second minimum value of the delay growth rate k as a target transmission path.
Specifically, the transmission Path group includes two transmission paths Path1 and Path2, and the delay growth rates k1< k2 of the paths 1 and Path2, so that the paths 1 and 2 corresponding to the paths 1 and k2 corresponding to the paths 1 are simultaneously selected as target transmission paths to perform audio data stream transmission between the user a and the user B.
In the following, a multi-path transmission apparatus provided by an embodiment of the present disclosure is described, and a multi-path transmission apparatus described below and a multi-path transmission method described above may be referred to in correspondence with each other.
Referring to fig. 5, a schematic structural diagram of a multipath transmission apparatus provided in an embodiment of the present disclosure is a schematic structural diagram, and is applied to a real-time communication system, where the real-time communication system includes a sending end and a receiving end, and the sending end and the receiving end share a scheduling service and a transmission service, and the apparatus specifically includes:
a first obtaining module 510, configured to obtain data flow request information through the scheduling service;
a second obtaining module 520, configured to obtain a path node through a scheduling service based on the data flow request information;
a creating module 530, configured to invoke the transmission service to create a transmission path group based on the path node, and select a target transmission path in the transmission path group;
a transmission module 540, configured to perform data stream transmission between the communication nodes based on the target transmission path.
The disclosed multipath transmission device, in a real-time communication system, when communication is performed between communication nodes, firstly, data stream request information is obtained through a scheduling service, and path nodes for data stream transmission between the communication nodes are obtained through the scheduling service based on the data stream request information; and calling a transmission service to establish a connection relation between the path nodes, creating a transmission path group, wherein the transmission path group comprises a plurality of transmission paths, so that the transmission interruption and the poor transmission efficiency of a single transmission path can be avoided, and finally, selecting a target transmission path from the transmission path group to carry out data stream transmission between the communication nodes. The method and the device realize the generation of a plurality of transmission paths among the communication nodes, determine the target transmission path in the plurality of transmission paths to transmit the data stream, and improve the transmission reliability and efficiency of the data stream.
Based on any of the above embodiments, the creating module 530 includes:
the monitoring unit is used for monitoring the transmission paths in the transmission path group in real time through the transmission service to obtain the monitoring result of the transmission paths;
and the selecting unit is used for selecting a target transmission path based on the monitoring result.
In this step, the transmission service in the real-time communication system also has another function, that is, a function of maintaining the transmission path, where maintaining the transmission path refers to performing real-time monitoring on the transmission path, where the real-time monitoring is mainly performed for transmission delay on the transmission path. And selecting a target transmission path based on the monitoring result of the transmission delay on each path.
Based on any of the above embodiments, the real-time communication system further comprises a signaling service;
before the first obtaining module 510, the method includes:
the joining module is used for joining the communication node into a preset conference room through the signaling service;
and the setting module is used for correspondingly setting a media node for the communication node through the scheduling service, wherein the media node is used for sending and/or receiving the data stream.
Based on any of the above embodiments, the monitoring unit is specifically configured to:
calling the transmission service to periodically send a heartbeat packet to the transmission path from the communication node corresponding to the source end to the communication node corresponding to the target end, receiving the heartbeat packet through the communication node corresponding to the target end and feeding back a heartbeat response packet to the communication node corresponding to the source end to generate path delay;
sequentially performing smoothing processing and fitting processing on the path delay through the transmission service to generate a delay growth rate corresponding to the transmission path;
and sequencing the delay increase rates corresponding to the transmission paths from small to large through the transmission service to obtain the monitoring result of the transmission paths.
According to any of the above embodiments, the data stream comprises an audio data stream and a video data stream;
the selecting unit is specifically configured to:
selecting a transmission path corresponding to the minimum value of the delay growth rate from the monitoring result as a target transmission path under the condition that the data stream is a video data stream;
and under the condition that the data stream is an audio data stream, selecting a transmission path corresponding to the minimum value and the second minimum value of the delay growth rate from the monitoring result as a target transmission path.
Based on any of the above embodiments, the transmission module 540 is specifically configured to:
under the condition that the data stream is a video data stream, performing video data stream transmission between the communication nodes by taking the transmission path corresponding to the minimum delay growth rate as a target transmission path;
and under the condition that the data stream is an audio data stream, simultaneously carrying out audio data stream transmission between the communication nodes by taking the transmission path corresponding to the minimum value and the second minimum value of the delay growth rate as a target transmission path.
Fig. 6 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 6: a processor (processor)610, a communication Interface (Communications Interface)620, a memory (memory)630 and a communication bus 640, wherein the processor 610, the communication Interface 620 and the memory 630 communicate with each other via the communication bus 640. The processor 610 may invoke logic instructions in the memory 630 to perform a multipath transmission method for a real-time communication system, the real-time communication system including at least two communication nodes sharing a scheduling service and a transmission service therebetween, the method specifically including: acquiring data flow request information through the scheduling service; acquiring path nodes through a scheduling service based on the data stream request information; calling the transmission service to create a transmission path group based on the path node, and selecting a target transmission path from the transmission path group; and carrying out data stream transmission between the communication nodes based on the target transmission path.
In addition, the logic instructions in the memory 630 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present disclosure. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
In another aspect, the present disclosure also provides a computer program product, including a computer program stored on a non-transitory computer readable storage medium, the computer program including program instructions, when the program instructions are executed by a computer, the computer being capable of executing a multipath transmission method provided by the above methods, and being applied to a real-time communication system, the real-time communication system including at least two communication nodes, the communication nodes sharing a scheduling service and a transmission service therebetween, the method specifically including: acquiring data flow request information through the scheduling service; acquiring path nodes through a scheduling service based on the data stream request information; calling the transmission service to create a transmission path group based on the path node, and selecting a target transmission path from the transmission path group; and carrying out data stream transmission between the communication nodes based on the target transmission path.
In yet another aspect, the present disclosure also provides a non-transitory computer-readable storage medium, on which a computer program is stored, which when executed by a processor is implemented to perform the multipath transmission method provided in each of the above aspects, and is applied to a real-time communication system, where the real-time communication system includes at least two communication nodes, and the communication nodes share a scheduling service and a transmission service therebetween, and the method specifically includes: acquiring data flow request information through the scheduling service; acquiring path nodes through a scheduling service based on the data flow request information; calling the transmission service to create a transmission path group based on the path node, and selecting a target transmission path from the transmission path group; and carrying out data stream transmission between the communication nodes based on the target transmission path.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solutions of the present disclosure, not to limit them; although the present disclosure has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present disclosure.
Claims (10)
1. A multi-path transmission method is applied to a real-time communication system, the real-time communication system comprises at least two communication nodes, and scheduling service and transmission service are shared between the communication nodes, and the method specifically comprises the following steps:
acquiring data flow request information through the scheduling service;
acquiring path nodes through a scheduling service based on the data flow request information;
calling the transmission service to create a transmission path group based on the path node, and selecting a target transmission path from the transmission path group;
and carrying out data stream transmission between the communication nodes based on the target transmission path.
2. The multi-path transmission method as claimed in claim 1, wherein the selecting a target transmission path from the transmission path group comprises:
monitoring the transmission paths in the transmission path group in real time through the transmission service to obtain the monitoring result of the transmission paths;
and selecting a target transmission path based on the monitoring result.
3. The multi-path transmission method as claimed in claim 1, wherein the real-time communication system further includes a signaling service;
before the obtaining of the data flow request information by the scheduling service, the method includes:
adding the communication node to a preset conference room through the signaling service;
and correspondingly setting a media node for the communication node through the scheduling service, wherein the media node is used for sending and/or receiving the data stream.
4. The multi-path transmission method as claimed in claim 2, wherein the monitoring the transmission paths in the transmission path group in real time by the transmission service, and the obtaining the monitoring result of the transmission paths comprises:
calling the transmission service to periodically send a heartbeat packet to the transmission path from the communication node corresponding to the source end to the communication node corresponding to the target end, receiving the heartbeat packet through the communication node corresponding to the target end and feeding back a heartbeat response packet to the communication node corresponding to the source end to generate path delay;
performing smoothing processing and fitting processing on the path delay sequentially through the transmission service to generate a delay growth rate corresponding to the transmission path;
and sequencing the delay increase rates corresponding to the transmission paths from small to large through the transmission service to obtain the monitoring result of the transmission paths.
5. The multi-path transmission method as claimed in claim 4, wherein the data streams include audio data streams and video data streams;
the selecting a target transmission path based on the monitoring result comprises:
selecting a transmission path corresponding to the minimum value of the delay growth rate from the monitoring result as a target transmission path under the condition that the data stream is a video data stream;
and under the condition that the data stream is an audio data stream, selecting a transmission path corresponding to the minimum value and the second minimum value of the delay growth rate from the monitoring result as a target transmission path.
6. The multi-path transmission method as claimed in claim 5, wherein the transmitting data streams between the communication nodes based on the target transmission path comprises:
under the condition that the data stream is a video data stream, performing video data stream transmission between the communication nodes by taking the transmission path corresponding to the minimum delay growth rate as a target transmission path;
and under the condition that the data stream is an audio data stream, taking the transmission path corresponding to the minimum value and the second minimum value of the delay growth rate as a target transmission path to simultaneously transmit the audio data stream between the communication nodes.
7. A multipath transmission apparatus, applied to a real-time communication system, where the real-time communication system includes at least two communication nodes, and a scheduling service and a transmission service are shared between the communication nodes, the apparatus specifically includes:
a first obtaining module, configured to obtain data flow request information through the scheduling service;
a second obtaining module, configured to obtain a path node through a scheduling service based on the data flow request information;
a creating module, configured to invoke the transmission service to create a transmission path group based on the path node, and select a target transmission path in the transmission path group;
and the transmission module is used for carrying out data stream transmission between the communication nodes based on the target transmission path.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the multi-path transmission method as claimed in any one of claims 1 to 6 when executing the program.
9. A non-transitory computer readable storage medium having a computer program stored thereon, wherein the computer program when executed by a processor implements the steps of the multi-path transmission method as claimed in any one of claims 1 to 6.
10. A computer program product comprising a computer program which, when executed by a processor, performs the steps of the multi-path transmission method as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210249242.9A CN114666264B (en) | 2022-03-14 | 2022-03-14 | Multipath transmission method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210249242.9A CN114666264B (en) | 2022-03-14 | 2022-03-14 | Multipath transmission method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114666264A true CN114666264A (en) | 2022-06-24 |
| CN114666264B CN114666264B (en) | 2024-02-02 |
Family
ID=82029903
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210249242.9A Active CN114666264B (en) | 2022-03-14 | 2022-03-14 | Multipath transmission method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114666264B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160301599A1 (en) * | 2013-11-19 | 2016-10-13 | Telefonaktiebolaget L M Ericsson (Publ) | Method and first network node for managing a first ip path used by a connection |
| WO2017101400A1 (en) * | 2015-12-14 | 2017-06-22 | 乐视控股（北京）有限公司 | Data transmission method, apparatus and system |
| CN107743092A (en) * | 2017-10-27 | 2018-02-27 | 深圳友讯达科技股份有限公司 | Path selecting method and device |
| CN107889183A (en) * | 2017-10-27 | 2018-04-06 | 深圳友讯达科技股份有限公司 | Data transmission method and device |
| US20180152976A1 (en) * | 2016-11-30 | 2018-05-31 | Microsoft Technology Licensing, Llc | Discovering and protecting data streams in multi-path communication environments |
| CN108234309A (en) * | 2017-12-27 | 2018-06-29 | 宁波菊风系统软件有限公司 | A kind of transmission method of network data |
| US20180204186A1 (en) * | 2017-01-19 | 2018-07-19 | Samsung Electronics Co., Ltd. | Method for sharing schedule and electronic device implementing the same |
| CN111343093A (en) * | 2020-02-28 | 2020-06-26 | 腾讯科技（深圳）有限公司 | Service data transmission method and device |
| CN113423143A (en) * | 2021-03-26 | 2021-09-21 | 阿里巴巴新加坡控股有限公司 | Multipath data transmission method and device and electronic equipment |
| WO2022005346A1 (en) * | 2020-06-29 | 2022-01-06 | Telefonaktiebolaget Lm Ericsson (Publ) | Method for scheduling multiple replicated data flows over a number of wireless transmission paths |
-
2022
- 2022-03-14 CN CN202210249242.9A patent/CN114666264B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160301599A1 (en) * | 2013-11-19 | 2016-10-13 | Telefonaktiebolaget L M Ericsson (Publ) | Method and first network node for managing a first ip path used by a connection |
| WO2017101400A1 (en) * | 2015-12-14 | 2017-06-22 | 乐视控股（北京）有限公司 | Data transmission method, apparatus and system |
| US20180152976A1 (en) * | 2016-11-30 | 2018-05-31 | Microsoft Technology Licensing, Llc | Discovering and protecting data streams in multi-path communication environments |
| US20180204186A1 (en) * | 2017-01-19 | 2018-07-19 | Samsung Electronics Co., Ltd. | Method for sharing schedule and electronic device implementing the same |
| CN107743092A (en) * | 2017-10-27 | 2018-02-27 | 深圳友讯达科技股份有限公司 | Path selecting method and device |
| CN107889183A (en) * | 2017-10-27 | 2018-04-06 | 深圳友讯达科技股份有限公司 | Data transmission method and device |
| CN108234309A (en) * | 2017-12-27 | 2018-06-29 | 宁波菊风系统软件有限公司 | A kind of transmission method of network data |
| CN111343093A (en) * | 2020-02-28 | 2020-06-26 | 腾讯科技（深圳）有限公司 | Service data transmission method and device |
| WO2022005346A1 (en) * | 2020-06-29 | 2022-01-06 | Telefonaktiebolaget Lm Ericsson (Publ) | Method for scheduling multiple replicated data flows over a number of wireless transmission paths |
| CN113423143A (en) * | 2021-03-26 | 2021-09-21 | 阿里巴巴新加坡控股有限公司 | Multipath data transmission method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114666264B (en) | 2024-02-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8134587B2 (en) | Aggregation of video receiving capabilities | |
| US8868773B2 (en) | Efficiently distributing video content using a combination of a peer-to-peer network and a content distribution network | |
| US8737397B2 (en) | Method for converting between unicast sessions and multicast session | |
| CN109995741B (en) | Method and system for realizing wheat connection in network live broadcast | |
| EP2076998A2 (en) | Method and apparatus for establishing multicast groups | |
| CN111541860B (en) | Real-time audio transmission system and using method thereof | |
| US9473546B2 (en) | Reducing real time media traffic in a network environment | |
| EP2936803B1 (en) | Method and a device for optimizing large scaled video conferences | |
| US20170359187A1 (en) | Scalable real-time videoconferencing over WebRTC | |
| KR20160003024A (en) | Data communication system and method | |
| CN114666264B (en) | Multipath transmission method and device | |
| Safaei et al. | Large-scale immersive video conferencing by altering video quality and distribution based on the virtual context | |
| US8976225B2 (en) | Method, computer program and device for managing media stream in video conferencing | |
| Bartczak et al. | Lightweight PIM—a new multicast routing protocol | |
| WO2013001276A1 (en) | Apparatuses, methods and computing software products for operating real-time multiparty multimedia communications | |
| Papalini et al. | On the scalability of WebRTC with information-centric networking | |
| Hossain et al. | Distributed dynamic MCU for video conferencing in peer-to-peer network | |
| CN107846634B (en) | Audio and video file sharing method, device and system, storage medium and terminal equipment | |
| Kern et al. | Client-Based Distributed Video Conferencing via WebRTC | |
| CN114827097B (en) | Communication network construction method and device and computer equipment | |
| Walkowiak et al. | ILP modeling of many-to-many replicated multimedia communication | |
| US11546398B1 (en) | Real-time transport (RTC) with low latency and high scalability | |
| Walkowiak et al. | Ilp modeling of many-to-many transmissions in computer networks | |
| CN114710642A (en) | Media data transmission system and method | |
| Jia et al. | Topology-aware optimal subgrouping and subscheduling for generalized explicit multicasting on Internet |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |