CN113038065B - Data transmission method and data transmission device of video conference system - Google Patents
Data transmission method and data transmission device of video conference system Download PDFInfo
- Publication number
- CN113038065B CN113038065B CN202110582421.XA CN202110582421A CN113038065B CN 113038065 B CN113038065 B CN 113038065B CN 202110582421 A CN202110582421 A CN 202110582421A CN 113038065 B CN113038065 B CN 113038065B
- Authority
- CN
- China
- Prior art keywords
- media node
- node
- terminal
- auxiliary
- main
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 59
- 238000000034 method Methods 0.000 title claims abstract description 59
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims abstract description 74
- 238000012546 transfer Methods 0.000 claims description 14
- 238000012163 sequencing technique Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 8
- 238000001914 filtration Methods 0.000 claims description 6
- 238000004080 punching Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 description 14
- 230000000694 effects Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
- H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level
Abstract
The invention provides a data transmission method and a data transmission device of a video conference system, wherein the method comprises the following steps: the management node selects a main media node and an auxiliary media node according to the characteristics of the terminal and the current instantaneous flow of the media nodes; the terminal is connected with the main media node to upload or download data; if the continuous preset time of the main media node exceeds the first waterline, the terminal is not allowed to access any more; if the instantaneous flow of the main media node continuously exceeds the second water level line for the preset time, judging whether the auxiliary media node has the capability of forwarding, if so, transferring the rest data packets to the auxiliary media node by the main media node, and transmitting the rest data packets by the auxiliary media node according to the preset destination address. The invention can forward the residual data packets of the media nodes which exceed the instantaneous bearing capacity to the pre-appointed standby media nodes, thereby leading the terminal to be capable of always receiving continuous data packets and solving the problem that the video conference system is jammed and displayed due to the instantaneous overload of the server.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a data transmission method for a video conference system, a data transmission method for another video conference system, a data transmission apparatus for a video conference system, a non-transitory computer-readable storage medium, and a computer device.
Background
In the large-capacity video conference, because the number of participants is large, the video conference system adopts a media forwarding mechanism, the media forwarding service does not mix audio and video, and after receiving audio and video streams sent by a certain terminal, the audio and video streams are directly forwarded to other terminals in a room. The system provides a plurality of media service nodes to form a media forwarding cluster, and the load balancing management service is used for distributing the media nodes.
In the related art, the following technical scheme is generally adopted: the method comprises the following steps that firstly, a terminal sets a predicted maximum consumption bandwidth value according to the current coding and decoding capacity; step two, limiting the terminal to perform uploading transmission below the maximum consumption bandwidth value; and step three, the server side counts the consumption condition of the terminal and performs kicking-out operation on the terminal with abnormal flow.
However, the above technical solutions have the following drawbacks:
it is difficult to fully utilize the network bandwidth, the uploading code rate is usually under the set consumption bandwidth value, and when other terminals are set according to the expected maximum consumption bandwidth value during playing, if the maximum consumption bandwidth value is set too high, the network bandwidth of the server is not fully utilized; if the maximum consumption bandwidth value is set to be too low, smooth meeting effect may not be ensured;
in the actual conference process, the uploaded code rate is difficult to be completely controlled within a certain range, if hardware coding is adopted, the actual code stream size depends on the implementation algorithm of the hardware coding, various terminals have differences, even if the coded data is subjected to smoothing processing subsequently, the code rate range is difficult to be completely ensured, if the coding is strictly limited, strategies such as frame dropping and packet dropping are required to be adopted, and the overall effect is influenced;
in actual use, the bandwidth occupied by the terminal often fluctuates up and down, if a video picture of a certain person is watched by a plurality of persons, the fluctuation of the audio and video bandwidth of the person can affect the severe fluctuation of the downlink flow of the server, and the situation of instantaneous overload can be caused, and if the video picture is not effectively processed, the problems of video conference frame data loss or picture blocking and the like are finally caused.
Disclosure of Invention
The invention provides a data transmission method of a video conference system for solving the technical problems, which can forward the residual data packets of the media nodes which exceed the instantaneous bearing capacity to the pre-designated standby media nodes, thereby leading the terminal to always receive continuous data packets in the receiving process, solving the problems that the media nodes generate data congestion or packet loss after bandwidth overload in a video conference scene to finally cause poor conference effect and the media server resources can not be fully utilized, meeting the fair distribution strategy of the forwarding service bandwidth of the video conference system and taking the sharing principle into consideration, and leading the resources to be maximally utilized.
The invention also provides another data transmission method of the video conference system.
The invention also provides a data transmission device of the video conference system.
The invention also proposes a non-transitory computer-readable storage medium.
The invention also provides computer equipment.
To achieve the above object, an embodiment of a first aspect of the present invention provides a data transmission method for a video conference system, where the video conference system includes: the data transmission method comprises the following steps: the management node receives a media access resource application of the terminal, and selects a main media node and an auxiliary media node according to the characteristics of the terminal and the current instantaneous flow of the media nodes, wherein the characteristics comprise: the area, the operator and the maximum code rate value are obtained, and the addresses of the main media node and the auxiliary media node are returned to the terminal; the terminal is connected with the main media node to upload or download data, and meanwhile, the main media node subscribes instantaneous flow data of the auxiliary media node; the management node counts the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, and performs data transmission control according to the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, wherein if the continuous preset time of the instantaneous flow of the main media node exceeds a first water level line, the management node prohibits other terminals from accessing the main media node; if the instant flow of the main media node is continuous and the preset time exceeds a second water level line, the management node checks the corresponding instant flow of the auxiliary media node, if the instant flow of the auxiliary media node is continuous and the preset time does not exceed the first water level line, the main media node temporarily transfers the rest data packets to the auxiliary media node, after receiving the data packets, the auxiliary media node analyzes the data packets to obtain a preset destination address, and transmits the rest data packets according to the preset destination address, wherein the first water level line is smaller than the second water level line.
The data transmission method of the video conference system provided by the invention can also have the following additional technical characteristics:
according to an embodiment of the present invention, the terminal connecting to the main media node for uploading or downloading data includes: the terminal simultaneously performs UDP (User Datagram Protocol) punching operation on the main media node and the auxiliary media node; and the terminal establishes an access session with the main media node and attaches the address of the auxiliary media node so as to enable the terminal to upload or download data from the main media node.
According to an embodiment of the present invention, when the terminal uploads data, metadata extracted or added from a packaged data rtp (Real-time Transport Protocol) packet is stored in a sending queue, and the data packet and a destination address padding packet header are stored in a cache queue.
According to an embodiment of the present invention, the terminal performs data packet transmission every preset time while performing data upload, wherein,
and Δ t is the preset time.
According to an embodiment of the present invention, further comprising: and if the continuous preset time of the instantaneous flow data of the auxiliary media node exceeds the first water level line, stopping sending the rest data packets, improving the priority of the rest data packets, and preferentially processing the data packets with high priority when the next sending period is reached.
According to an embodiment of the present invention, the selecting, by the management node, a primary media node and an auxiliary media node according to the characteristics of the terminal and the current instantaneous traffic of the media nodes includes: filtering media nodes which do not cover the operator attribute according to the operator type of the terminal; selecting media nodes in the same area or adjacent areas according to the area of the terminal for sequencing; judging whether the media nodes are overloaded or not according to the current instantaneous flow of the media nodes and the maximum code rate value of the terminal, and filtering the overloaded media nodes in the sequencing result; and taking the ranking result with the highest ranking as the main media node and the ranking result with the highest ranking as the auxiliary media node.
To achieve the above object, a second aspect of the present invention provides a data transmission method for a video conference system, where the video conference system includes: the data transmission method comprises the following steps: receiving a media access resource application of the terminal, and selecting a main media node and an auxiliary media node according to the characteristics of the terminal and the current instantaneous flow of the media nodes, wherein the characteristics comprise: the area, the operator and the maximum code rate value are obtained, and the addresses of the main media node and the auxiliary media node are returned to the terminal; counting the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, and performing data transmission control according to the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, wherein if the instantaneous flow of the main media node continuously exceeds a first water level line for a preset time, other terminals are forbidden to access the main media node; if the instant flow of the main media node is continuous and the preset time exceeds a second water level line, checking the corresponding instant flow of the auxiliary media node, if the instant flow of the auxiliary media node is continuous and the preset time does not exceed the first water level line, controlling the main media node to temporarily transfer the rest data packets to the auxiliary media node, so that after the auxiliary media node receives the data packets, analyzing the data packets to obtain preset destination addresses, and transmitting the rest data packets according to the preset destination addresses, wherein the first water level line is smaller than the second water level line.
To achieve the above object, a third aspect of the present invention provides a data transmission apparatus of a video conference system, the video conference system including: a plurality of media nodes and a plurality of terminals, the apparatus comprising: a receiving module, configured to receive a media access resource application of the terminal, and select a main media node and an auxiliary media node according to a characteristic of the terminal and a current instantaneous flow of the media node, where the characteristic includes: the area, the operator and the maximum code rate value are obtained, and the addresses of the main media node and the auxiliary media node are returned to the terminal; the statistical module is used for counting the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node; the control module is used for prohibiting other terminals from accessing the main media node when the continuous preset time of the instantaneous flow of the main media node is judged to exceed a first water level line, checking the corresponding instantaneous flow of the auxiliary media node when the continuous preset time of the instantaneous flow of the main media node is judged to exceed a second water level line, if the continuous preset time of the instantaneous flow of the auxiliary media node does not exceed the first water level line, controlling the main media node to temporarily transfer the rest data packets to the auxiliary media node, so that after the auxiliary media node receives the data packets, the data packets are analyzed to obtain preset destination addresses, and the rest data packets are transmitted according to the preset destination addresses, wherein the first water level line is smaller than the second water level line.
To achieve the above object, a fourth aspect of the present invention provides a non-transitory computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the data transmission method of the video conference system according to the second aspect of the present invention.
To achieve the above object, a fifth embodiment of the present invention provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the processor implements the data transmission method of the video conference system according to the second embodiment of the present invention.
The invention has the beneficial effects that:
the invention can forward the residual data packets of the media nodes which exceed the instantaneous bearing capacity to the pre-appointed standby media nodes, thereby leading the terminal to receive continuous data packets all the time in the receiving process, solving the problems that the media nodes generate data congestion or packet loss after bandwidth overload in a video conference scene and finally lead to poor conference effect and the resources of the media server can not be fully utilized, satisfying the fair distribution strategy of the forwarding service bandwidth of the video conference system, and considering the sharing principle, leading the resources to be utilized to the maximum.
Drawings
Fig. 1 is a flowchart of a data transmission method of a video conference system according to one embodiment of the present invention;
FIG. 2 is a schematic diagram of a data transmission method of a video conference system according to one embodiment of the present invention;
fig. 3 is a flowchart of a data transmission method of a video conference system according to another embodiment of the present invention;
fig. 4 is a flowchart of a data transmission method of a video conference system according to still another embodiment of the present invention;
fig. 5 is a block schematic diagram of a data transmission device of a video conference system according to one embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart of a data transmission method of a video conference system according to an embodiment of the present invention, wherein, as shown in fig. 2, the video conference system includes: the management node is used for counting the instantaneous flow of each media node, carrying out flow balance according to a certain strategy and distributing reasonable media nodes for the terminal to access. The media nodes are used for accessing audio and video streams of the terminal and receiving and forwarding the audio and video streams, the media nodes can report current instantaneous flow of the media nodes periodically, and double water level lines are set according to the actual bandwidth capacity of each media node for monitoring. The terminal is used for uploading and playing audio and video stream, and controlling according to the limited maximum code rate value, so that the bandwidth occupied by the uplink and the downlink is below the maximum code rate value.
As shown in fig. 1, the data transmission method includes the following steps:
s1, the management node receives the media access resource application of the terminal, and selects the main media node and the auxiliary media node according to the characteristics of the terminal and the current instantaneous flow of the media node, wherein the characteristics of the terminal include: area, operator, maximum code rate value, and return the addresses of the main media node and the auxiliary media node to the terminal.
Further, according to an embodiment of the present invention, the selecting, by the management node, the primary media node and the secondary media node according to the characteristics of the terminal and the current instantaneous traffic of the media node includes: filtering media nodes which do not cover the operator attribute according to the operator type of the terminal; selecting media nodes in the same area or adjacent areas according to the area of the terminal for sequencing; judging whether the media nodes are overloaded or not according to the current instantaneous flow of the media nodes and the maximum code rate value of the terminal, and filtering the overloaded media nodes in the sequencing result; and taking the media node with the highest ranking in the sequencing result as a main media node and taking the media node with the highest ranking as an auxiliary media node.
Specifically, the terminal applies for the media access resource from the management node, where the application includes an operator of a network currently used by the terminal, a code of an area where the network used by the terminal is located, and a code rate value (uplink or downlink) of the maximum consumption of the access resource of the current application; the management node firstly filters media nodes which do not cover the operator attribute according to the operator type of the terminal, then selects media nodes in the same region or adjacent regions according to the terminal region for sequencing, then filters media nodes overloaded in the sequencing, and finally selects 2 media nodes according to the sequencing name, wherein the media node with the highest ranking is used as a main media node, the media node with the highest ranking is used as an auxiliary media node, and the addresses of the main media node and the auxiliary media node are returned to the terminal;
and S2, the terminal is connected with the main media node to upload or download data, and simultaneously, the main media node subscribes the instant flow data of the auxiliary media node.
Further, according to an embodiment of the present invention, the connecting of the terminal to the main media node for uploading or downloading data includes: the terminal simultaneously carries out UDP (user Datagram protocol) hole punching operation to the main media node and the auxiliary media node (namely, a ping message is sent to a receiving and sending stream port of the media node and is used for keeping smooth receiving and sending stream from the main media node and the auxiliary media node at any time); the terminal establishes an access session with the main media node and attaches the address of the auxiliary media node so as to enable the terminal to upload or download data from the main media node.
S3, the management node counts the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, and performs data transmission control according to the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, wherein if the instantaneous flow of the main media node continuously exceeds the first water level line for a preset time, the management node prohibits other terminals from accessing the main media node; if the continuous preset time of the instantaneous flow of the main media node exceeds the second water level line, the management node checks the instantaneous flow of the corresponding auxiliary media node, if the continuous preset time of the instantaneous flow of the auxiliary media node does not exceed the first water level line, the main media node temporarily transfers the rest data packets to the auxiliary media node, after the auxiliary media node receives the data packets, the data packets are analyzed to obtain a preset destination address, and the rest data packets are transmitted according to the preset destination address, wherein the first water level line is smaller than the second water level line, and the preset time, the first water level line and the second water level line can be preset according to actual conditions.
Specifically, as shown in fig. 2, a solid line in fig. 2 is signaling interaction, a dotted line is data transceiving, in a video conference system, a terminal acquires its own audio and video for uploading, receives and plays audio and video data of other terminals, an image at one terminal is often played by many people at the same time, which is a most typical scenario, and a media service is a cluster formed by a plurality of media nodes and is responsible for accessing the terminal and network transceiving of the audio and video data, and partial processing is performed on the audio and video data sent by a plurality of terminals, and the audio and video data is forwarded to other participant terminals. The invention can make the terminal normally receive data without perception by properly transferring the excess part, thereby avoiding data reception after instantaneous overload, simultaneously improving the bandwidth utilization rate of the media node and improving the final audio and video fluency and stability.
Specifically, the management node performs matching according to the characteristics (area, operator, maximum code rate value) of the terminal, selects two optimal media nodes (a main media node and an auxiliary media node) corresponding to the current terminal, and returns the addresses of the main media node and the auxiliary media node to the terminal. The terminal is connected with the main media node to upload or download data (audio and video), the main media node subscribes instantaneous flow to the auxiliary media node, and the auxiliary media node reports the instantaneous flow at that time periodically.
The management node counts and calculates the instantaneous flow of the current main media node and the instantaneous flow of the auxiliary media node, if the instantaneous flow of the main media node does not exceed the first water level line for the duration preset time, the flow of the current main media node is rich, and the terminal is directly connected with the main media node to upload or download data. If the instantaneous flow of the main media node continuously exceeds the first water level line for the preset time, the flow of the current main media node is larger, and the management node does not allow the distribution terminal to access the main media node until the instantaneous flow is continuously lower than the first water level line; if the instantaneous flow of the main media node continuously exceeds the second waterline for the preset time, the management node judges whether the current auxiliary media node has the capability of forwarding, if not, the management node waits for sending in the next period, if so, the main media node temporarily transfers the rest data packets to the auxiliary media node, after receiving the data packets, the auxiliary media node analyzes the data packet header to obtain the preset destination address for sending, the terminal always receives continuous data, and no perception exists in the overload switching and transferring process of the main media node.
Therefore, the residual data packets of the media nodes exceeding the instantaneous bearing capacity can be forwarded to the pre-designated standby media nodes, so that the terminal can always receive continuous data packets in the receiving process, the problems that the conference effect is poor and the media server resources cannot be fully utilized due to data congestion or packet loss generated by the media nodes after bandwidth overload in a video conference scene are solved, the fair bandwidth allocation strategy of the forwarding service of a video conference system is met, the sharing principle is considered, and the resources are utilized to the maximum extent.
In the embodiment of the invention, when the terminal uploads the data, the encapsulated data rtp packet is extracted or added with metadata and stored in a sending queue, and the data packet and a destination address filling packet header are stored in a buffer queue.
When the terminal uploads the data, the data packet is sent at preset time intervals, wherein,
Δ t is a preset time, for example 5 ms.
In an embodiment of the present invention, as shown in fig. 3, the method further includes:
and S4, if the continuous preset time of the instantaneous flow data of the auxiliary media node exceeds the first water level line, stopping sending the rest data packets, improving the priority of the rest data packets, and preferentially processing the data packets with high priority when the next sending period is reached.
Specifically, data uploaded by the terminal enters a media node and is distributed to a subscribed terminal, metadata (a sequence number, an SSRC synchronous information source, priority and the like) extracted or added from a packaged video rtp packet is stored in a sending queue, and an original frequency data packet and a destination address filling packet header are stored in a cache queue. Transmitting data at intervals of 5ms, and calculating the maximum number of bytes transmitted according to the second waterline, i.e. the maximum number of bytes
。
The management node circularly processes the sending queue of each path, records the number of bytes sent when sending a packet, and deducts the number of bytes from the single maximum number of bytes sent until the single maximum number of bytes sent is consumed or all the sending party queues are processed; if unsent data exist, the current instantaneous data are overloaded, the remaining data need to be transferred, the load condition of each path of corresponding auxiliary media node is checked before sending, and if the continuous preset time of the instantaneous flow does not exceed the first water level line, the data packet is directly sent to the node; if the continuous preset time of the instantaneous flow exceeds the first water level line, the data packet is not sent, the priority of the packet is improved, the auxiliary media node directly sends the data packet according to the destination address information of the packet header after receiving the data packet without carrying out additional session information, and the data packet can smoothly reach the terminal side because the terminal continuously carries out UDP (user Datagram protocol) punching operation on the media receiving and sending stream port of the main and auxiliary nodes; and in the next sending period, the data packet with high priority is processed preferentially, so that the data transmitted in a delay way in the previous period can still arrive in an effective time slice without influencing the processing at the terminal side.
It can be understood that, in the video conference system, the terminal is allowed to float 10% above the limited maximum bit rate value, when the media forwarding service exceeds the sending bearing capacity instantaneously, the remaining data packets are automatically forwarded to the pre-designated standby forwarding media node (auxiliary media node), the terminal receives continuous data packets all the time in the receiving process, the problem of screen blockage and screen overflow caused by instantaneous overload of the server in the video conference is solved, the bandwidth fair distribution strategy of the video conference media forwarding service is met, and the sharing principle is considered, so that the maximum utilization of resources is realized.
In summary, according to the data transmission method of the video conference system in the embodiment of the present invention, the management node selects the main media node and the auxiliary media node according to the characteristics of the terminal and the current instantaneous flow of the media node; the terminal is connected with the main media node and uploads or downloads data; if the main media node continuously exceeds the first water level line for a preset time, the management node does not allow the terminal to access any more; if the instant flow of the main media node continuously exceeds the second water level line for the preset time, the management node checks the instant flow of the corresponding auxiliary media node, if the instant flow of the auxiliary media node continuously does not exceed the first water level line for the preset time, the main media node temporarily transfers the rest data packets to the auxiliary media node, and after receiving the data packets, the auxiliary media node analyzes the data packets to transmit the rest data packets according to the preset destination address. Therefore, the residual data packets of the media nodes exceeding the instantaneous bearing capacity can be forwarded to the pre-designated standby media nodes, so that the terminal can always receive continuous data packets in the receiving process, the problems that the conference effect is poor and the media server resources cannot be fully utilized due to data congestion or packet loss generated by the media nodes after bandwidth overload in a video conference scene are solved, the fair bandwidth allocation strategy of the forwarding service of a video conference system is met, the sharing principle is considered, and the resources are utilized to the maximum extent.
The present invention further provides another data transmission method for a video conference system, where an execution subject of the method is the management node, and details that are not disclosed in the method may refer to the data transmission method for the video conference system, and are not described in detail in this embodiment. Wherein, the video conference system includes: as shown in fig. 4, the data transmission method includes the following steps:
s10, receiving a media access resource application of the terminal, and selecting a main media node and an auxiliary media node according to the characteristics of the terminal and the current instantaneous flow of the media node, wherein the characteristics of the terminal include: area, operator, maximum code rate value, and return the addresses of the main media node and the auxiliary media node to the terminal.
And S20, counting the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, and performing data transmission control according to the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, wherein if the continuous preset time of the instantaneous flow of the main media node exceeds the first water level line, other terminals are forbidden to access the main media node.
And S30, if the continuous preset time of the instantaneous flow of the main media node exceeds the second water level line, checking the instantaneous flow of the corresponding auxiliary media node, if the continuous preset time of the instantaneous flow of the auxiliary media node does not exceed the first water level line, controlling the main media node to temporarily transfer the remaining data packets to the auxiliary media node, so that after the auxiliary media node receives the data packets, analyzing the data packets to obtain preset destination addresses, and transmitting the remaining data packets according to the preset destination addresses, wherein the first water level line is smaller than the second water level line.
According to the data transmission method of the video conference system, a main media node and an auxiliary media node are selected according to the characteristics of a terminal and the current instantaneous flow of the media nodes, the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node are counted, and if the main media node continuously exceeds a first water line for a preset time, a management node does not allow the terminal to access any more; and if the continuous preset time of the instantaneous flow of the main media node exceeds the second water level line, checking the instantaneous flow of the corresponding auxiliary media node, if the continuous preset time of the instantaneous flow of the auxiliary media node does not exceed the first water level line, temporarily transferring the rest data packets to the auxiliary media node by the main media node, and after receiving the data packets, analyzing the data packets by the auxiliary media node to transmit the rest data packets according to the preset destination address. Therefore, the residual data packets of the media nodes exceeding the instantaneous bearing capacity can be forwarded to the pre-designated standby media nodes, so that the terminal can always receive continuous data packets in the receiving process, the problems that the conference effect is poor and the media server resources cannot be fully utilized due to data congestion or packet loss generated by the media nodes after bandwidth overload in a video conference scene are solved, the fair bandwidth allocation strategy of the forwarding service of a video conference system is met, the sharing principle is considered, and the resources are utilized to the maximum extent.
In addition, the invention also provides a data transmission device of the video conference system. The video conference system includes: a plurality of media nodes and a plurality of terminals, as shown in fig. 5, the apparatus comprising: the device comprises a receiving module 1, a counting module 2 and a control module 3.
The receiving module 1 is used for receiving a media access resource application of a terminal, and selecting a main media node and an auxiliary media node according to the characteristics of the terminal and the current instantaneous flow of the media node, wherein the characteristics include: the area, the operator and the maximum code rate value are used, and the addresses of the main media node and the auxiliary media node are returned to the terminal; the statistic module 2 is used for counting the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node; the control module 3 is configured to prohibit other terminals from accessing the main media node when it is determined that the instantaneous flow continuous preset time of the main media node exceeds the first water line, and check the instantaneous flow of the corresponding auxiliary media node when it is determined that the instantaneous flow continuous preset time of the main media node exceeds the second water line, and if the instantaneous flow continuous preset time of the auxiliary media node does not exceed the first water line, control the main media node to temporarily transfer the remaining data packets to the auxiliary media node, so that the auxiliary media node analyzes the data packets to obtain a preset destination address after receiving the data packets, and transmits the remaining data packets according to the preset destination address, where the first water line is smaller than the second water line.
According to the data transmission device of the video conference system of the embodiment of the invention, a receiving module receives a media access resource application of a terminal, a main media node and an auxiliary media node are selected according to the characteristics of the terminal and the current instantaneous flow of the media node, the addresses of the main media node and the auxiliary media node are returned to the terminal, a counting module counts the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, a control module prohibits other terminals from accessing the main media node when judging that the continuous preset time of the instantaneous flow of the main media node exceeds a first water line, checks the instantaneous flow of the corresponding auxiliary media node when judging that the continuous preset time of the instantaneous flow of the main media node exceeds a second water line, and controls the main media node to temporarily transfer the rest data packets to the auxiliary media node if the continuous preset time of the instantaneous flow of the auxiliary media node does not exceed the first water line, after receiving the data packet, the auxiliary media node analyzes the data packet to obtain a preset destination address, and transmits the rest data packets according to the preset destination address. Therefore, the device can forward the residual data packets of the media nodes exceeding the instantaneous bearing capacity to the pre-designated standby media nodes, so that the terminal can always receive continuous data packets in the receiving process, the problems that the conference effect is poor and the media server resources cannot be fully utilized due to data congestion or packet loss generated by the media nodes after bandwidth overload in a video conference scene are solved, the bandwidth fair distribution strategy of the forwarding service of a video conference system is met, the sharing principle is considered, and the resources are utilized to the maximum extent.
Furthermore, the present invention also proposes a non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the data transmission method of the video conference system of the present invention described above.
According to the non-transitory computer readable storage medium of an embodiment of the present invention, when a computer program stored thereon is executed by a processor, a main media node and an auxiliary media node are selected according to a characteristic of a terminal and a current instantaneous flow of the media node, the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node are counted, if a continuous preset time of the main media node exceeds a first water line, a management node no longer allows the terminal to access, if a continuous preset time of the instantaneous flow of the main media node exceeds a second water line, the instantaneous flow of the corresponding auxiliary media node is checked, if a continuous preset time of the instantaneous flow of the auxiliary media node does not exceed the first water line, the main media node temporarily transfers remaining data packets to the auxiliary media node, and after receiving the data packets, the auxiliary media node parses the data packets to transmit the remaining data packets according to a preset destination address, therefore, the terminal can always receive continuous data packets in the receiving process, the problems that the conference effect is poor and the resources of the media server cannot be fully utilized due to data congestion or packet loss generated by the media nodes after bandwidth overload in a video conference scene are solved, the fair distribution strategy of the forwarding service bandwidth of the video conference system is met, the sharing principle is considered, and the resources are utilized to the maximum extent.
The invention also provides a computer device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein when the processor executes the program, the data transmission method of the video conference system is realized.
According to the computer device of the embodiment of the invention, when the processor executes the computer program stored on the memory, the main media node and the auxiliary media node are selected according to the characteristics of the terminal and the current instantaneous flow of the media node, the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node are counted, if the continuous preset time of the main media node exceeds the first water line, the management node does not allow the terminal to access any more, if the continuous preset time of the instantaneous flow of the main media node exceeds the second water line, the instantaneous flow of the corresponding auxiliary media node is checked, if the continuous preset time of the instantaneous flow of the auxiliary media node does not exceed the first water line, the main media node temporarily transfers the rest data packets to the auxiliary media node, and after the auxiliary media node receives the data packets, the data packets are analyzed to transmit the rest data packets according to the preset destination address, therefore, the terminal can always receive continuous data packets in the receiving process, the problems that the conference effect is poor and the resources of the media server cannot be fully utilized due to data congestion or packet loss generated by the media nodes after bandwidth overload in a video conference scene are solved, the fair distribution strategy of the forwarding service bandwidth of the video conference system is met, the sharing principle is considered, and the resources are utilized to the maximum extent.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (8)
1. A data transmission method of a video conference system, the video conference system comprising: the data transmission method comprises the following steps:
the management node receives a media access resource application of the terminal, and selects a main media node and an auxiliary media node according to the characteristics of the terminal and the current instantaneous flow of the media nodes, wherein the characteristics of the terminal comprise: the area, the operator and the maximum code rate value are obtained, and the addresses of the main media node and the auxiliary media node are returned to the terminal;
the terminal simultaneously performs UDP hole punching operation on the main media node and the auxiliary media node;
the terminal and the main media node establish an access session and attach the address of the auxiliary media node so that the terminal uploads or downloads data from the main media node, and meanwhile, the main media node subscribes instantaneous flow data of the auxiliary media node;
the management node counts the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, and performs data transmission control according to the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, wherein,
if the continuous preset time of the instantaneous flow of the main media node exceeds a first water level line, the management node prohibits other terminals from accessing the main media node;
if the instant flow of the main media node is continuous for the preset time and exceeds a second water level line, the management node checks the corresponding instant flow of the auxiliary media node, if the instant flow of the auxiliary media node is continuous for the preset time and does not exceed the first water level line, the main media node temporarily transfers the rest data packets to the auxiliary media node, after receiving the data packets, the auxiliary media node analyzes the data packets to obtain preset destination addresses and transmits the rest data packets according to the preset destination addresses, if the instant flow data of the auxiliary media node is continuous for the preset time and exceeds the first water level line, the transmission of the rest data packets is stopped, the priority of the rest data packets is improved, and the data packets with high priority are preferentially processed when the next transmission period is reached, wherein the first water line is smaller than the second water line.
2. The data transmission method of the video conference system according to claim 1,
when the terminal uploads data, the encapsulated data rtp packet is extracted or added with metadata and stored in a sending queue, and the data packet and a destination address filling packet header are stored in a cache queue.
3. The data transmission method of the video conference system according to claim 1, wherein when the terminal uploads data, data packet transmission is performed at intervals of a preset time, where Δ t is the preset time.
4. The data transmission method of the video conference system according to claim 1, wherein the management node selects a primary media node and a secondary media node according to the characteristics of the terminal and the current instantaneous flow of the media nodes, and comprises:
filtering media nodes which do not cover the operator attribute according to the operator type of the terminal;
selecting media nodes in the same area or adjacent areas according to the area of the terminal for sequencing;
judging whether the media nodes are overloaded or not according to the current instantaneous flow of the media nodes and the maximum code rate value of the terminal, and filtering the overloaded media nodes in the sequencing result;
and taking the media node with the highest ranking in the sequencing result as the main media node, and taking the media node with the highest ranking as the auxiliary media node.
5. A data transmission method of a video conference system, the video conference system comprising: the data transmission method comprises the following steps:
receiving a media access resource application of the terminal, and selecting a main media node and an auxiliary media node according to the characteristics of the terminal and the current instantaneous flow of the media node, wherein the characteristics of the terminal comprise: the area, the operator and the maximum code rate value are obtained, and the addresses of the main media node and the auxiliary media node are returned to the terminal;
controlling the terminal to simultaneously carry out UDP hole punching operation on the main media node and the auxiliary media node;
controlling the terminal to establish an access session with the main media node and attaching the address of the auxiliary media node so as to enable the terminal to upload or download data from the main media node;
counting the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, and controlling data transmission according to the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node, wherein,
if the continuous preset time of the instantaneous flow of the main media node exceeds a first water level line, prohibiting other terminals from accessing the main media node;
if the instant flow of the main media node is continuous for the preset time and exceeds a second water level line, checking the corresponding instant flow of the auxiliary media node, if the instant flow of the auxiliary media node is continuous for the preset time and does not exceed the first water level line, controlling the main media node to temporarily transfer the rest data packets to the auxiliary media node, so that after the auxiliary media node receives the data packets, analyzing the data packets to obtain preset destination addresses, and transmitting the rest data packets according to the preset destination addresses, if the instant flow data of the auxiliary media node is continuous for the preset time and exceeds the first water level line, stopping the transmission of the rest data packets, increasing the priority of the rest data packets, and preferentially processing the data packets with high priority when the next transmission period is reached, wherein, the first water line is smaller than the second water line.
6. A data transmission apparatus of a video conference system, the video conference system comprising: a plurality of media nodes and a plurality of terminals, the apparatus comprising:
a receiving module, configured to receive a media access resource application of the terminal, and select a main media node and an auxiliary media node according to the characteristics of the terminal and the current instantaneous traffic of the media node, where the characteristics of the terminal include: the area, the operator and the maximum code rate value are obtained, and the addresses of the main media node and the auxiliary media node are returned to the terminal;
the control module is used for controlling the terminal to simultaneously carry out UDP (user Datagram protocol) hole punching operation on the main media node and the auxiliary media node, controlling the terminal to establish an access session with the main media node and attaching the address of the auxiliary media node so as to enable the terminal to upload or download data from the main media node;
the statistical module is used for counting the instantaneous flow of the main media node and the instantaneous flow of the auxiliary media node;
the control module is further configured to prohibit other terminals from accessing the main media node when it is determined that the instantaneous flow of the main media node is continuous for a preset time exceeding a first water line, and check the corresponding instantaneous flow of the auxiliary media node when it is determined that the instantaneous flow of the main media node is continuous for the preset time exceeding a second water line, if the instantaneous flow of the auxiliary media node is continuous for the preset time not exceeding the first water line, control the main media node to temporarily transfer remaining data packets to the auxiliary media node, so that the auxiliary media node, after receiving the data packets, parses the data packets to obtain a preset destination address, and transmits the remaining data packets according to the preset destination address, and if the instantaneous flow data of the auxiliary media node is continuous for the preset time exceeding the first water line, stopping sending the rest data packets, improving the priority of the rest data packets, and preferentially processing the data packets with high priority when the next sending period is reached, wherein the first water level line is smaller than the second water level line.
7. A non-transitory computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, implementing the data transmission method of the video conference system according to claim 5.
8. Computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the data transmission method of a video conferencing system according to claim 5 when executing the program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110582421.XA CN113038065B (en) | 2021-05-27 | 2021-05-27 | Data transmission method and data transmission device of video conference system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110582421.XA CN113038065B (en) | 2021-05-27 | 2021-05-27 | Data transmission method and data transmission device of video conference system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113038065A CN113038065A (en) | 2021-06-25 |
| CN113038065B true CN113038065B (en) | 2021-10-29 |
Family
ID=76455818
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110582421.XA Active CN113038065B (en) | 2021-05-27 | 2021-05-27 | Data transmission method and data transmission device of video conference system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113038065B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104852857A (en) * | 2014-02-14 | 2015-08-19 | 航天信息股份有限公司 | Distributed data transmission method and system based on load balancing |
| CN109840139A (en) * | 2017-11-29 | 2019-06-04 | 北京金山云网络技术有限公司 | Method, apparatus, electronic equipment and the storage medium of resource management |
| CN111432158A (en) * | 2020-02-28 | 2020-07-17 | 浙江华创视讯科技有限公司 | Load balancing method and device for media nodes, storage medium and electronic device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9467383B2 (en) * | 2012-06-19 | 2016-10-11 | Hewlett Packard Enterprise Development Lp | Iterative optimization method for site selection in global load balance |
| US10146593B2 (en) * | 2017-02-17 | 2018-12-04 | Sas Institute Inc. | Techniques for decentralized load balancing |
-
2021
- 2021-05-27 CN CN202110582421.XA patent/CN113038065B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104852857A (en) * | 2014-02-14 | 2015-08-19 | 航天信息股份有限公司 | Distributed data transmission method and system based on load balancing |
| CN109840139A (en) * | 2017-11-29 | 2019-06-04 | 北京金山云网络技术有限公司 | Method, apparatus, electronic equipment and the storage medium of resource management |
| CN111432158A (en) * | 2020-02-28 | 2020-07-17 | 浙江华创视讯科技有限公司 | Load balancing method and device for media nodes, storage medium and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113038065A (en) | 2021-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10044633B2 (en) | Method for distributing available bandwidth of a network amongst ongoing traffic sessions run by devices of the network, corresponding device | |
| US9014048B2 (en) | Dynamic bandwidth re-allocation | |
| US11258724B2 (en) | Method and devices for domain name bandwidth adjustment | |
| EP3063918B1 (en) | Method and device for reserving bandwidth for an adaptive streaming client | |
| US20110087765A1 (en) | Network bandwidth management system | |
| AU2020257112A1 (en) | Distribution of bandwidth in a network | |
| CN110445723A (en) | A kind of network data dispatching method and fringe node | |
| EP3641273B1 (en) | Edge node control | |
| Ramamurthi et al. | Video-QoE aware resource management at network core | |
| US8797865B2 (en) | Providing quality of service for sub-flows in a multiple grants per interval service flow | |
| AU2019201095A1 (en) | System and method for automatic encoder adjustment based on transport data | |
| CN113038065B (en) | Data transmission method and data transmission device of video conference system | |
| US11627358B2 (en) | Communication entity and a method for transmitting a video data stream | |
| CN112533020B (en) | Load balancing dynamic networking system and method for television live broadcast system | |
| EP3013013B1 (en) | Networking device and method for buffer management in video streaming over a network | |
| US11973814B2 (en) | Method and controller for audio and/or video content delivery | |
| EP2375633B1 (en) | Method of processing a service request in a multichannel network and server using the same | |
| WO2022002003A1 (en) | Information determining method and device | |
| JP4247888B2 (en) | Video distribution system and video distribution method | |
| EP2869523A1 (en) | Method and device for reserving bandwidth for an adaptive streaming client |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Data transmission methods and devices for video conferencing systems Granted publication date: 20211029 Pledgee: China Zheshang Bank Co.,Ltd. Changzhou Branch Pledgor: Jiangsu huaiye Information Technology Co.,Ltd. Registration number: Y2024980003042 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |