CN105450651B - Method and device for monitoring dynamic routing of video code stream - Google Patents
Method and device for monitoring dynamic routing of video code stream Download PDFInfo
- Publication number
- CN105450651B CN105450651B CN201510883692.3A CN201510883692A CN105450651B CN 105450651 B CN105450651 B CN 105450651B CN 201510883692 A CN201510883692 A CN 201510883692A CN 105450651 B CN105450651 B CN 105450651B
- Authority
- CN
- China
- Prior art keywords
- media stream
- frame transmission
- routing
- packet loss
- priority
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/22—Traffic shaping
- H04L47/225—Determination of shaping rate, e.g. using a moving window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/61—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources taking into account QoS or priority requirements
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method and a device for monitoring dynamic routing selection of video code streams, which are applied to an outlet network device at a coding side, wherein the method comprises the following steps: the method comprises the steps that the encoding side exit network device calculates the priority of a plurality of routing paths in the network by using a routing protocol, generates an initial routing entry from high to low according to the priority, and transmits a media stream to the decoding side exit network device through the routing path with the highest priority in the network, and further comprises the following steps: after receiving frame transmission delay or packet loss rate fed back by the decoding side exit network device, the priority of the next route entry is raised according to the order of the initial route entries, and then the route path with the highest priority in the network after raising the priority is selected to transmit the media stream. The invention can solve the problem of burst or delay of the media stream forwarded by the coding equipment and solve the problem of unsmooth and unsmooth video decoded and output by the decoding equipment.
Description
Technical Field
The invention belongs to the field of communication, and particularly relates to a method and a device for monitoring dynamic routing of video code streams.
Background
With the development of the IP video monitoring service, monitoring applications across a wide area network are more and more, and the network quality of the wide area network, such as bandwidth, time delay, packet loss and the like, is difficult to guarantee; some industry customers can build private networks by themselves, but all the industry mechanisms are distributed in all places, the scale of the private networks is also large, along with the continuous expansion of the scale of the private networks, the reliability and the quality of the private networks also have certain problems, and some private networks also need to be transmitted through a wide area network.
When the wide area network and the private network are transmitted in a long distance in a networking mode, the bandwidth and the quality of an intermediate transmission link are difficult to guarantee. In the prior art, the network transmission quality of a media stream is generally determined by a frame transmission delay, a frame transmission rate or a packet loss rate. When a video of a video camera is watched remotely, if a video stream sent by a coding device on the side of the video camera, such as an IPC (Internet Protocol camera) or a coder, has a problem of burst or delay, and is then transmitted through an intermediate link and affected by network quality such as bandwidth limitation, delay, jitter, etc., quality problems such as packet loss, too large frame transmission delay, too large frame transmission rate (i.e., burst of stream), etc., may occur in the video stream that the video stream reaches a decoding device (client or decoder), and at this time, a video image decoded and output by the decoding device may have a phenomenon of video unsmooth and unsmooth flow. Factors influencing the video jam of the monitoring client are the size of an I-frame (Intra-coded Picture), the sending rate of the I-frame, the sending delay of the I-frame and the interval of a related P-frame (Predictive-coded Picture), wherein the sending rate of the I-frame, the sending delay of the I-frame and the interval of the related P-frame are all influenced by the quality of an intermediate network.
The video code stream is generally sent to the network after being smoothed by the coding equipment, so that packet loss and delay caused by impact on intermediate network equipment due to overlarge instantaneous code stream are avoided, and a receiving module on the decoding equipment side starts a large cache according to the condition of the received video packet to buffer the delayed video code stream, so that the transmission delay of a media stream frame sent to the decoding equipment can meet the requirement. However, the problem that the transmission quality of the intermediate network is not controllable, such as insufficient bandwidth, jitter, and delay, still causes burst of code stream or excessive frame transmission delay when the video packet arrives at the decoding device, and at this time, the buffer data amount of the decoding device needs to be increased, but if the buffer setting of the decoding device is too large, the decoded image delay is large, and the video viewing and operating requirements of the client on real-time performance cannot be met.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a method and a device for monitoring dynamic routing selection of video code streams, which are used for solving the problem of burst or delay of media streams forwarded by coding equipment and solving the problem that when the media streams are transmitted through a network, the media streams are influenced by network quality such as network broadband limitation, delay, jitter and the like, so that when the media streams reach decoding equipment, the video decoded and output by the decoding equipment is unsmooth in blocking due to packet loss, overlarge frame transmission delay or overlarge frame transmission rate.
The purpose of the invention is realized as follows: a method for monitoring dynamic routing of video code stream is applied to an outlet network device at a coding side, and comprises the following steps: the method comprises the steps that the encoding side exit network device calculates the priority of a plurality of routing paths in the network by using a routing protocol, generates an initial routing entry from high to low according to the priority, and transmits a media stream to the decoding side exit network device through the routing path with the highest priority in the network, and further comprises the following steps:
after receiving frame transmission delay or packet loss rate fed back by the decoding side exit network device, the priority of the next route entry is raised according to the order of the initial route entries, and then the route path with the highest priority in the network after raising the priority is selected to transmit the media stream.
Further, the frame transmission delay or the packet loss rate is fed back to the encoding side exit network device when the frame transmission delay or the packet loss rate is greater than or equal to a respective preset threshold.
Further, after the encoding-side egress network device receives the frame transmission rate or the packet loss rate fed back by the decoding-side egress network device, the encoding-side egress network device performs traffic shaping on the subsequently transmitted media stream.
Further, the frame transmission rate is fed back to the encoding side exit network device when the frame transmission rate is greater than or equal to a preset threshold value of the frame transmission rate.
Further, the traffic shaping is realized by adjusting the number of the frame messages sent per second, wherein the number of the frame messages sent per second is less than or equal to a preset threshold value of the frame transmission rate/the average size of the packets.
Further, when the frame transmission rate is greater than or equal to the frame transmission rate preset threshold, the decoding side exit network device performs traffic shaping on the received media stream.
The invention also provides a device for monitoring the dynamic routing selection of the video code stream by utilizing the method.
A monitor video code stream dynamic route selection device is applied to coding side network equipment, and the device comprises: the device comprises a routing module, a media stream sending module and a media stream quality monitoring module, wherein the routing module calculates the priority of a plurality of routing paths in the network through a routing protocol and generates an initial routing entry according to the priority from high to low, and the media stream sending module transmits a media stream to the decoding side network equipment through the routing path with the highest priority in the network;
after receiving the routing path selection signal, the routing module raises the priority of the next routing entry according to the order of the initial routing entry, and the media stream sending module selects the routing path with the highest priority in the network after raising the priority to transmit the media stream.
Further, the frame transmission delay or the packet loss rate is fed back to the media stream quality monitoring module at the encoding side when the frame transmission delay or the packet loss rate is greater than or equal to the respective preset threshold.
The system further comprises a coding side media stream flow shaping module, wherein the coding side media stream quality monitoring module sends a flow shaping signal to the coding side media stream flow shaping module after receiving the frame transmission rate or the packet loss rate fed back by the decoding side network device;
and the coding side media stream flow shaping module carries out flow shaping on the subsequently transmitted media stream after receiving the flow shaping signal.
Further, the frame transmission rate is fed back to the media stream quality monitoring module at the encoding side when the frame transmission rate is greater than or equal to a preset threshold value of the frame transmission rate.
The invention has the beneficial effects that: the invention integrates a media stream quality monitoring module in a network device of a network outlet where a coding device is positioned, and the coding side outlet network device re-selects a routing path to transmit a media stream according to the received frame transmission delay or packet loss rate of a received media stream data packet fed back by the decoding side outlet network device when the frame transmission delay or the packet loss rate is abnormal. The outlet network equipment at the encoding side dynamically selects a transmission route in a targeted manner according to the transmission quality parameters of the media stream, thereby realizing the high-quality transmission of the media stream.
Similarly, a media stream flow shaping module is integrated in the network device at the network outlet where the encoding device is located, the media stream flow shaping module at the encoding side outlet can judge that the frame transmission rate is abnormal or the packet loss rate is abnormal according to the frame transmission rate or the packet loss rate fed back by the network device at the decoding side outlet, and starts to carry out flow shaping on the media code stream with a large burst, so that the network device at the encoding side outlet sends a message outwards at a uniform speed, and packet loss caused by the fact that the instantaneous code stream transmitted to the decoding device is too large and exceeds the receiving and buffering capacity of a downstream network is avoided. Meanwhile, when the decoding side outlet network device detects that the transmission rate of the received media stream frame is abnormal, the media stream flow shaping module integrated in the decoding side outlet network device also starts to carry out flow shaping on the media stream with larger burst, so as to smooth the code stream, and further avoid the unsmooth flow of the output video after decoding.
When detecting the frame transmission delay and the frame transmission rate of the media stream, the invention only detects the transmission delay and the frame transmission rate of the I frame because the data volume of the I frame in the media stream is larger and the influence on the transmission quality of the media stream is the largest.
By adding the detected media stream transmission quality parameter information in the RTCP message extension field, the decoding side outlet network equipment can feed back a plurality of media stream transmission quality parameter information to the encoding side outlet network equipment at one time, and the encoding side outlet network equipment can process the forwarded media stream more comprehensively to obtain a media stream with better quality.
Drawings
FIG. 1 is a schematic diagram of a dynamic routing apparatus for surveillance video according to an embodiment of the present invention;
FIG. 2 is a waveform diagram of a media stream transmission rate according to an embodiment of the present invention;
fig. 3 is a schematic diagram of network distribution according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the following embodiments, which are illustrative only and not limiting, and the scope of the present invention is not limited thereby.
Referring to fig. 1, the method for monitoring dynamic routing of video code stream of the present invention is applied to an exit network device at the encoding side, and the method includes: calculating the priorities of a plurality of routing paths in a network (here, an intermediate network) by using a routing protocol by using an encoding side exit network device, generating initial routing entries according to the priorities from high to low, and transmitting a media stream to a decoding side exit network device by the encoding side exit network device through the routing path with the highest priority in the network, wherein the target addresses of the plurality of routing paths are the same, the encoding side exit network device selects one routing path to forward the media stream according to the optimal matching of the parameters such as the priority, cost and the like of each routing entry, and transmits the media stream to the decoding side exit network device through the routing path in the network; the decoding side network device detects and judges the transmission quality parameters of the received media stream such as frame transmission delay, frame transmission rate, packet loss rate and the like, and specifically, if the detected frame transmission rate is greater than or equal to a frame transmission rate preset threshold (a set media stream receiving rate here) within a period of time, the decoding side outlet network device performs flow shaping on the subsequently received media stream, smoothes the code stream and improves the quality of the subsequently forwarded media stream to the decoding device; if the frame transmission rate, the packet loss rate or the frame transmission delay is detected to be greater than or equal to respective preset thresholds (which respectively correspond to a frame transmission rate preset threshold, a packet loss rate preset threshold and a frame transmission delay preset threshold), the decoding-side network device feeds back the frame transmission rate (i.e. code stream burst), the packet loss rate, the frame transmission delay and other media stream transmission quality parameters of the media stream to the encoding-side exit network device through an RTCP (Real-time Transport Protocol Control Protocol) message extension signaling, and after receiving the RTCP message, the encoding-side exit network device analyzes the media stream transmission quality parameters fed back by the decoding-side exit network device in the RTCP message, and then analyzes the media stream transmission quality parameters, specifically as follows:
if the frame transmission rate or the packet loss rate field is not empty, that is, the encoding side outlet network device receives the frame transmission rate or the packet loss rate information fed back by the decoding side outlet network device, which indicates that the frame transmission rate is too high or there is a packet loss problem when the media stream is received at the decoding side, the encoding side outlet network device performs flow shaping on the subsequently forwarded media stream, smoothes the stream, so that the encoding side outlet network device sends a message outwards at a relatively uniform speed, and avoids packet loss caused by that the instantaneous stream transmitted to the decoding device is too large and exceeds the receiving and buffering capabilities of a downstream network, thereby avoiding the phenomenon that the decoding device outputs a video without smooth blocking;
if the field of the frame transmission delay or the packet loss rate is not empty, that is, after the encoding-side egress network device receives the frame transmission delay or the packet loss rate information fed back by the decoding-side egress network device, the encoding-side egress network device raises the priority of the next routing entry according to the order of the initial routing entry, that is, raises the priority of the next routing entry with the same target address but lower priority in the initial routing entry, so that the priority of the next routing entry is higher than the priority of the previously matched routing entry, and then selects the routing path with the highest priority in the routing entry after raising the priority to transmit the media stream, thereby avoiding the influence on the transmission quality of the media stream due to insufficient network bandwidth or poor quality of the original matching routing path with the highest priority, that is, the encoding-side egress network device feeds back the frame transmission delay or the packet loss rate according to the received frame transmission delay or the packet loss rate of the decoding-side egress network device, dynamically selecting a routing path for transmitting the media stream; if the encoding side outlet network equipment does not receive the frame transmission delay and the packet loss rate, the encoding side outlet network equipment continues to forward the media stream according to the originally matched routing path with the highest priority.
For setting the frame transmission delay preset threshold and the frame transmission rate preset threshold, referring to fig. 2, the unit of the Y axis is bit, the X axis is time, when the media stream is actually transmitted, the data packet is not continuously transmitted, but a certain time interval exists, for example, the size of an I frame transmitted between 2.08 and 2.10 seconds is about 1000Kbit, the instantaneous rate is 1000Kbit/0.02s is 50000Kbit/s, i.e., 50Mbps, and the actual media stream transmission rate at the encoding end is 4Mbps, it is seen that the burst situation of the code stream exists, and if the situation is not solved in time, the quality of the video decoded and output by the subsequent decoding device is affected. The thicker column in fig. 2 is the position of the last packet of each frame, and the transmission delay of the I frame is the difference between 2.100 seconds of the last packet of the I frame and 2.042 seconds of the last packet of the previous frame, which is 0.058 seconds, i.e. 58 ms. Certain empirical value can be accumulated through actual test of decoding effect, in order to avoid introducing larger delay, the transmission delay of the general I frame is not more than 150ms, and the maximum value of the transmission rate of the I frame is not more than 60 Mbps. Since the data amount of the I frame is generally several times of that of the P frame, and the probability of problems occurring in the transmission delay, transmission rate burst, and packet loss of the I frame is also high, in this embodiment, the preset threshold of the frame transmission delay is set to 150ms, and the preset threshold of the frame transmission rate is set to 60 Mbps. For the setting of the preset threshold of the packet loss rate, the preset threshold of the packet loss rate in this embodiment may be dynamically set according to actual requirements, and is set to be 0.5%.
The invention also provides a device for monitoring the dynamic routing of the video code stream, which is applied to the outlet network equipment at the encoding side and comprises a media stream quality monitoring module and a media stream flow shaping module, wherein the media stream quality monitoring module in the outlet network equipment at the encoding side is called as the media stream quality monitoring module at the encoding side, the media stream quality monitoring module in the outlet network equipment at the decoding side is called as the media stream quality monitoring module at the decoding side, the media stream flow shaping module in the outlet network equipment at the encoding side is called as the media stream flow shaping module at the encoding side, and the media stream flow shaping module in the outlet network equipment at the decoding side is called as the media stream flow shaping module at the decoding side. Specifically, the media stream quality monitoring module and the media stream traffic shaping module may be integrated into the network device, and then placed at the network outlet where the encoding device and the decoding device are located. The encoding side egress network device is placed at a network exit of the encoding device, the decoding side egress network device is placed at a network exit of the decoding device, and the encoding side egress network device further includes a media stream sending module (not shown in fig. 1) that transmits a media stream to the decoding device, where the encoding side egress network device and the decoding side egress network device may select a router or a switch.
The apparatus of this embodiment further includes a routing module disposed at an exit of the network where the encoding device is located, and the routing module may also be integrated into an existing router or switch, and then disposed at the exit of the network where the encoding device is located.
The routing module calculates the priority of a plurality of routing paths in the network through a routing protocol and generates an initial routing entry according to the priority from high to low, the media stream sending module transmits the media stream to the decoding network equipment through the routing path with the highest priority in the network, the decoding side media stream quality monitoring module detects and judges the frame transmission delay and the packet loss rate of the received media stream, if the frame transmission delay or the packet loss rate is greater than or equal to the respective preset threshold, the decoding side media stream quality monitoring module feeds back the parameter value greater than or equal to the respective preset threshold to the encoding side media stream quality monitoring module, the encoding side media stream quality monitoring module sends a routing path selection signal to the routing module after receiving the frame transmission delay or the packet loss rate, and the routing module promotes the priority of the next routing entry according to the sequence of the initial routing entry after receiving the message of reselecting the routing path, and then, the media stream sending module selects the routing path with the highest priority in the network after the priority is improved to transmit the media stream.
The coding side media stream quality monitoring module receives a feedback message of the decoding side media stream quality monitoring module, when the coding side media stream quality monitoring module receives a frame transmission rate or a packet loss rate, a flow shaping signal is sent to the coding side media stream flow shaping module, and the coding side media stream flow shaping module carries out flow shaping on a subsequently transmitted media stream after receiving the flow shaping signal; when the media stream quality monitoring module at the encoding side monitors frame transmission delay or packet loss rate, a routing path selection signal is sent to the routing module, after the routing module receives a message of reselecting a routing path, the priority of the next routing entry is promoted according to the sequence of the initial routing entries, and then the media stream sending module selects the routing path with the highest priority in the network after the priority is promoted to transmit the media stream.
The decoding side media stream quality monitoring module analyzes the received media stream, counts various types of media stream packets (such as RTP or TS), calculates and judges media stream transmission quality parameters such as packet loss rate, frame transmission delay, frame transmission rate and the like, and informs the decoding side media stream flow shaping module of carrying out flow shaping on the subsequent received media stream if the frame transmission rate is greater than or equal to a frame transmission rate preset threshold value; if the transmission rate, the packet loss rate or the frame transmission delay of the same frame is greater than or equal to the respective preset threshold, the frame transmission rate, the packet loss rate or the transmission delay greater than or equal to the respective preset threshold is fed back to the media stream quality monitoring module at the encoding side through the RTCP message extension signaling, and after receiving the media stream quality parameters, the media stream quality monitoring module at the encoding side further informs the media stream shaping module at the encoding side of performing flow shaping on the subsequently transmitted media stream or informs the routing module of performing reselection on the transmission routing path of the media stream according to the received media stream quality parameters.
Among them, RTP (Real-time Transport Protocol) is used for Real-time data transmission, and the information provided by the Protocol includes: time stamps (for synchronization), sequence numbers (for packet loss and reordering detection), and payload format (for specifying the coding format of the data). TS (Transport Stream) is transmitted in packets, each of which is 188 bytes long. The packet has a structure in which the header is 4 bytes and the payload is 184 bytes. Many types of data, such as video, audio, custom information, etc., can be filled in the TS stream.
The calculation of the packet loss rate is relatively simple, and the packet loss rate of all the media stream data to be transmitted is counted in this embodiment. For the calculation of the frame transmission delay and the frame transmission rate, since the influence of the I frame on the entire transmission quality is the largest, in order to reduce the calculation complexity, only the transmission delay and the transmission rate of the I frame may be calculated. Specifically, the packet loss rate may be calculated by a sequence number of an RTP or TS header, and in a statistical period, the calculation formula of the packet loss rate is as follows: the packet loss rate is the number of lost packets/total number of packets;
the RTP message head can analyze the ending mark bit (namely RTP marker) of each frame, the packet with the ending mark bit equal to 1 is the last packet of the frame, the media stream quality monitoring module at the decoding side analyzes the RTP message to obtain the time corresponding to the ending positions of the I frame and the P frame in the media stream, and the transmission delay of the I frame can be calculated according to the analysis result: i-frame transmission delay (time of last packet received in current I-frame) - (time of last packet received in last P-frame).
The TS packet may also find the end positions of the I frame and the P frame according to the interpretation in "TS judges the I frame and the P frame mode" in the abbreviation and the key term definition, and obtain the time corresponding to the end positions of the I frame and the P frame, thereby calculating the transmission delay of the I frame: i-frame transmission delay (time of last packet received in current I-frame) - (time of last packet received in last P-frame). That is, the formula for calculating the I-frame transmission delay by the RTP or TS packet is the same, but the way of identifying the I-frame and the P-frame end identifier is different.
The formula for calculating the transmission rate of the I frame is as follows: the I-frame transmission rate is the sum of the data sizes in all the data packets of the I-frame/the total transmission duration of the I-frame.
The decoding side media stream quality monitoring module counts a period of time, for example, within 60 seconds, calculates media stream transmission quality parameters such as packet loss rate, I-frame transmission delay, I-frame transmission rate, and the like, and performs judgment, and if one or more of the quality parameters are greater than or equal to respective preset thresholds, the corresponding parameters are marked as abnormal quality parameters, the decoding side exit network device feeds the abnormal quality parameters back to the encoding side exit network device through RTCP messages, and notifies the encoding side exit network device to operate.
In this embodiment, the content shown in table 1 is added to the RTCP packet extension field, where the media stream identifier and the media stream network information field provide information necessary for the encoding-side egress network device to process the media stream, and the packet loss rate, the I-frame transmission delay, and the I-frame transmission rate are added to the RTCP packet, so that the decoding-side egress network device can feed back the transmission quality parameters of multiple media streams to the encoding-side egress network device at a time, and the encoding-side egress network device processes the transmitted media streams according to the fed-back quality parameters, thereby more comprehensively avoiding the quality problem of media stream transmission.
In table 1, the code stream type is RTP or TS, the corresponding media streams are represented by SSRC (synchronization source identifier, 32 bits, identifying synchronization source), PID (unique identification mark in TS stream, used for identifying data carried by TS packet), the media stream network information includes information of source IP, source port, destination IP and destination port, the decoding side media stream quality monitoring module detects that the average frame delay is 180ms, the frame transmission rate is 80Mbps, the average packet loss rate is 0.5%, and determines that the frame transmission delay is greater than the preset frame transmission delay value, the frame transmission rate is greater than the preset frame transmission rate value, the average packet loss rate is equal to the preset packet loss rate threshold, the decoding side media stream quality monitoring module notifies the decoding side traffic shaping module to perform traffic shaping on the media stream, and simultaneously, the frame transmission delay, the frame transmission rate and the packet loss rate are fed back to the encoding side media stream quality monitoring module through RTCP messages, and after the media stream quality monitoring module at the encoding side judges the received frame transmission delay, the frame transmission rate and the packet loss rate, informing the flow shaping module at the encoding side to carry out flow shaping, simultaneously informing the routing module to promote the priority of the next routing entry according to the sequence of the initial routing entry, and after the routing priority is promoted, selecting the routing path with the highest priority in the network by the media stream sending module to transmit the media stream.
The encoding side media stream flow shaping module and the decoding side media stream flow shaping module respectively receive the messages of the encoding side media stream quality monitoring module and the decoding side media stream quality monitoring module, and carry out smooth adjustment on the frame transmission rate of the media stream. The frame transmission rate preset threshold may be set as required, and in this embodiment, the size of the frame transmission rate preset threshold is 60Mbps, which is the maximum value of the frame transmission rate under the bandwidth of 100 Mbps. The average packet size is determined according to different media streams of different encapsulation types, and currently, the common encapsulation formats of the media stream packets generally include RTP, TS, and the like. If the average size of the RTP media stream packets is 1300 bytes, the maximum rate of sending frame packets is 60Mbit/(1300 × 8) bits, which is equal to about 5769 packets/sec.
In one embodiment, referring to fig. 3, the decoding-side egress switch is configured with an address of a coding-side switch corresponding to a network, for example, the address of the coding-side egress switch of the 1.1.1.10 network is 1.1.1.1, and then when it is determined that the received media stream transmission is abnormal, a destination IP address of the feedback RTCP packet, that is, an IP address of the coding-side egress switch, may be determined according to a source address of the packet. The destination port of the RTCP message can be configured.
The route from the encoding side exit switch to the decoding device (destination IP address is 2.2.2.20) has three routing paths, and three initial routing entries are generated in the routing table according to the priority level by the routing protocol, wherein the routing protocol can be set according to the requirement or is a conventional routing protocol in the prior art. When the encoding device (IPC, webcam) transmits the media stream to the decoding device (PC, Personal computer, etc.), the default condition is to match the 1 st routing entry, that is, select the routing path with address 3.3.3.1 in the routing table to forward the media stream, and the route of the initial routing entry is expressed as follows:
| routing entry | Destination address | Priority level | Next hop address |
| 1 | 2.2.2.20/24 | 1 | 3.3.3.1 |
| 2 | 2.2.2.20/24 | 2 | 4.4.4.1 |
| 3 | 2.2.2.20/24 | 3 | 5.5.5.1 |
The decoding side outlet switch receives a media stream sent by IPC (IP address is 1.1.1.10), a media stream quality monitoring module in the decoding side outlet switch detects and calculates media stream transmission quality parameters such as I frame transmission delay, I frame transmission rate, packet loss rate and the like of the media stream, if the I frame transmission delay, the I frame transmission rate or the packet loss rate are more than or equal to respective preset threshold values, the corresponding parameters are marked as abnormal parameters, a media stream shaping module in the decoding side outlet switch starts flow shaping operation on the received media stream, and the decoding side outlet switch sends RTCP messages carrying the abnormal parameters to the encoding side outlet switch.
The media stream quality monitoring module in the encoding side exit switch receives and analyzes the RTCP message of the decoding side exit switch, for example, the media stream source address 1.1.1.10, the source port is 10002, the destination address 2.2.2.20, and the destination port is 20000, which are fed back by the RTCP message. If the media stream quality monitoring module in the coding side outlet switch analyzes the RTCP message and then judges the received I frame transmission rate or packet loss rate, the coding side outlet switch sends a message to a media stream shaping module in the equipment of the coding side outlet switch, and starts the operation of flow shaping of the subsequent forwarding media stream. If the RTCP message is analyzed and it is determined that I-frame transmission delay or packet loss rate is received, the encoding side egress switch notifies a routing module in the device of the RTCP message to increase the priority of the 2 nd routing entry according to the order of the initial routing entries in the network routing table, and the routing table after the priority of the network routing entry is increased is represented as follows:
| routing entry | Destination address | Priority level | Next hop address |
| 1 | 2.2.2.20/24 | 2 | 3.3.3.1 |
| 2 | 2.2.2.20/24 | 1 | 4.4.4.1 |
| 3 | 2.2.2.20/24 | 3 | 5.5.5.1 |
The outlet switch of the encoding side selects the routing path of the 2 nd routing entry when forwarding the media stream message next time, so that the influence on the transmission of the media stream caused by the poor network quality of the routing path of the 1 st routing entry is avoided.
The encoding side exit switch dynamically selects a routing forwarding path according to an RTCP message fed back by the decoding side exit switch, for example, in a next statistical period, a media stream quality monitoring module in the decoding side exit switch monitors that a packet loss rate or an I-frame transmission delay of a media stream forwarded by a routing path of a 2 nd routing entry is still abnormal, and may notify the encoding side exit switch again through the RTCP message, and the encoding side exit switch raises a routing priority of a 3 rd routing entry, and selects a routing path of the 3 rd routing entry to forward the media stream.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and all simple modifications, changes and equivalent structural changes made to the above embodiment according to the technical spirit of the present invention still belong to the protection scope of the technical solution of the present invention.
Claims (10)
1. A method for monitoring dynamic routing of video code stream is applied to an outlet network device at a coding side, and comprises the following steps: the method comprises the steps that the encoding side exit network device calculates the priority of a plurality of routing paths in the network by utilizing a routing protocol, generates an initial routing entry from high to low according to the priority, and transmits a media stream to the decoding side exit network device through the routing path with the highest priority in the network, and is characterized by further comprising the following steps:
after receiving frame transmission delay or packet loss rate fed back by the decoding side outlet network equipment, raising the priority of the next route entry according to the sequence of the initial route entry, and then selecting the route path with the highest priority in the network after raising the priority to transmit the media stream;
the decoding side outlet network equipment expands the RTCP protocol message and supports the feedback of the quality parameters of the media stream to the encoding side outlet network equipment, wherein the quality parameters comprise frame transmission rate, packet loss rate and frame transmission delay, and the encoding side outlet network equipment performs corresponding actions according to the feedback quality parameters: if the frame transmission rate field is not empty, the encoding side outlet network equipment carries out flow shaping and smoothes the code stream; if the frame transmission delay or the packet loss rate information is not null, the encoding side outlet network equipment adjusts the routing table item;
and expanding the RTCP, and feeding back the transmission delay of the I frame and the packet loss rate of the media stream data to the outlet network equipment at the encoding side.
2. The method according to claim 1, wherein the frame transmission delay or the packet loss rate is fed back to the encoding-side exit network device when the frame transmission delay or the packet loss rate is greater than or equal to a respective preset threshold.
3. The method according to claim 1, wherein after the encoding-side egress network device receives a frame transmission rate or a packet loss rate fed back by the decoding-side egress network device, the encoding-side egress network device performs traffic shaping on a subsequently transmitted media stream.
4. The method of claim 3, wherein the frame transmission rate is fed back to the encoding-side egress network device when the frame transmission rate is greater than or equal to a preset threshold frame transmission rate.
5. The method according to claim 3 or 4, wherein the traffic shaping is performed by adjusting the number of transmitted frame packets per second, the number of transmitted frame packets per second being less than or equal to a predetermined threshold of frame transmission rate per packet average size.
6. The method according to claim 3 or 4, wherein the decoding side egress network device performs traffic shaping on the received media stream when the frame transmission rate is greater than or equal to a preset frame transmission rate threshold.
7. A monitor video code stream dynamic route selection device is applied to the exit network equipment of the coding side, and the device comprises: the device comprises a routing module and a media stream sending module, wherein the routing module calculates the priority of a plurality of routing paths in the network through a routing protocol and generates an initial routing entry according to the priority from high to low, and the media stream sending module transmits a media stream to the decoding side outlet network equipment through the routing path with the highest priority in the network;
after receiving a routing path selection signal, the routing module raises the priority of the next routing entry according to the order of the initial routing entry, and the media stream sending module selects the routing path with the highest priority in the network after raising the priority to transmit the media stream;
the decoding side outlet network equipment expands the RTCP protocol message and supports the feedback of the media stream quality parameters to the encoding side outlet network equipment, wherein the quality parameters comprise frame transmission rate, packet loss rate and frame transmission delay, and the encoding side outlet network equipment performs corresponding actions according to the feedback quality parameters: if the frame transmission rate field is not empty, the encoding side outlet network equipment carries out flow shaping and smoothes the code stream; if the frame transmission delay or the packet loss rate information is not null, the encoding side outlet network equipment adjusts the routing table item;
and expanding the RTCP, and feeding back the transmission delay of the I frame and the packet loss rate of the media stream data to the outlet network equipment at the encoding side.
8. The apparatus according to claim 7, wherein the frame transmission delay or the packet loss rate is fed back to the media stream quality monitoring module at the encoding side when the frame transmission delay or the packet loss rate is greater than or equal to a respective preset threshold.
9. The apparatus for monitoring dynamic routing of video code streams according to claim 7, further comprising a media stream traffic shaping module at the encoding side, wherein the media stream quality monitoring module at the encoding side sends a traffic shaping signal to the media stream traffic shaping module at the encoding side after receiving a frame transmission rate or a packet loss rate fed back by the exit network device at the decoding side;
and the coding side media stream flow shaping module carries out flow shaping on the subsequently transmitted media stream after receiving the flow shaping signal.
10. The apparatus of claim 9, wherein the frame transmission rate is fed back to the media stream quality monitoring module at the encoding side when the frame transmission rate is greater than or equal to a preset threshold of the frame transmission rate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510883692.3A CN105450651B (en) | 2015-12-04 | 2015-12-04 | Method and device for monitoring dynamic routing of video code stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510883692.3A CN105450651B (en) | 2015-12-04 | 2015-12-04 | Method and device for monitoring dynamic routing of video code stream |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105450651A CN105450651A (en) | 2016-03-30 |
| CN105450651B true CN105450651B (en) | 2021-07-02 |
Family
ID=55560428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510883692.3A Active CN105450651B (en) | 2015-12-04 | 2015-12-04 | Method and device for monitoring dynamic routing of video code stream |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105450651B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109391847B (en) * | 2017-08-08 | 2021-10-12 | 中国电信股份有限公司 | Monitoring method and monitoring device for blocking of streaming media |
| CN109587531A (en) * | 2017-09-28 | 2019-04-05 | 华为技术有限公司 | Video transmission method, apparatus and system |
| CN109982008B (en) * | 2017-12-28 | 2021-07-20 | 浙江宇视科技有限公司 | Round-robin switching method and device and electronic equipment |
| CN109348282A (en) * | 2018-11-19 | 2019-02-15 | 深圳市炬力北方微电子有限公司 | A kind of wireless method and device for throwing screen time delay of reduction |
| CN109951722A (en) * | 2019-02-27 | 2019-06-28 | 腾讯科技（深圳）有限公司 | The transmission method and transmitting device of video data |
| CN111586349B (en) * | 2020-04-16 | 2022-01-11 | 浙江大华技术股份有限公司 | Data outage and continuous transmission method and system for monitoring equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101075957A (en) * | 2007-06-26 | 2007-11-21 | 上海大学 | Method for controlling AVS fluid-medium transmission |
| CN101611601A (en) * | 2007-02-14 | 2009-12-23 | 朗讯科技公司 | The signaling architecture that is used for the wireless communication system streaming media service based on the agency |
| CN104602133A (en) * | 2014-11-21 | 2015-05-06 | 腾讯科技（北京）有限公司 | Multimedia file shearing method and terminal as well as server |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6901010B1 (en) * | 2002-04-08 | 2005-05-31 | Advanced Micro Devices, Inc. | Erase method for a dual bit memory cell |
| US7164890B2 (en) * | 2003-11-21 | 2007-01-16 | Telefonaktiebologet Lm Ericsson (Publ) | Link adaptation for point-to-multipoint channel |
| CN1852141A (en) * | 2005-08-16 | 2006-10-25 | 华为技术有限公司 | Method for realizing upward link back-up |
| US7907520B2 (en) * | 2007-09-27 | 2011-03-15 | Verizon Patent And Licensing Inc. | Path testing and switching |
| CN101510991B (en) * | 2009-04-03 | 2010-09-29 | 杭州华三通信技术有限公司 | Method, system and multi-point control unit for implementing port thermal backup of video signal conference |
| CN101888664B (en) * | 2010-06-25 | 2013-04-24 | 陶洋 | Video multi-path parallel transfer method in wireless self-organization network |
| CN102098198B (en) * | 2010-12-31 | 2013-07-31 | 北京华环电子股份有限公司 | Ethernet protection method and device |
| CN102523486A (en) * | 2011-12-31 | 2012-06-27 | 北京佳讯飞鸿电气股份有限公司 | Method for realizing self adaptation to dynamic code stream bandwidth in video scheduling system |
| CN102546425B (en) * | 2012-01-31 | 2014-11-05 | 华为技术有限公司 | Crossed ring network protection method, equipment and system |
| CN103152284B (en) * | 2013-03-18 | 2016-06-01 | 神州数码网络(北京)有限公司 | A kind of router multipath exports method and the router of intelligent load equilibrium |
-
2015
- 2015-12-04 CN CN201510883692.3A patent/CN105450651B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101611601A (en) * | 2007-02-14 | 2009-12-23 | 朗讯科技公司 | The signaling architecture that is used for the wireless communication system streaming media service based on the agency |
| CN101075957A (en) * | 2007-06-26 | 2007-11-21 | 上海大学 | Method for controlling AVS fluid-medium transmission |
| CN104602133A (en) * | 2014-11-21 | 2015-05-06 | 腾讯科技（北京）有限公司 | Multimedia file shearing method and terminal as well as server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105450651A (en) | 2016-03-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105450651B (en) | Method and device for monitoring dynamic routing of video code stream | |
| Matsuzono et al. | Low latency low loss streaming using in-network coding and caching | |
| JP3662907B2 (en) | Data transmission / reception method, transmission apparatus, reception apparatus, transmission / reception system, and program | |
| JP5094593B2 (en) | Transmitting apparatus, receiving apparatus, method, and program | |
| CN101909060B (en) | Qos control method suitable for real-time streaming media transmission of mobile videos | |
| EP3042301B1 (en) | System and method for real-time traffic delivery | |
| KR100651486B1 (en) | Apparatus and Method for transporting MPEG contents through Internet Protocol Network | |
| EP2950473B1 (en) | Anti-packet-loss real-time communication method, system and related device based on hierarchical coding | |
| CN103944834B (en) | Audio and video transmission control method and system | |
| CN104980819A (en) | Video transmission method and device | |
| EP3547690B1 (en) | Real-time video transmission method of multipath network | |
| EP1825621B1 (en) | System and method for improving the quality of real time multimedia sessions | |
| US8904024B2 (en) | System and method for low delay fast update for video streaming | |
| EP2485441B1 (en) | A video packet scheduling method for multimedia streaming | |
| US10341047B2 (en) | Method and system for controlling the forwarding of error correction data | |
| JP5877960B2 (en) | Receiving apparatus, system, program and method for controlling video frame rate based on transmission bit rate | |
| US20200260327A1 (en) | Device and Method for Detecting and Mitigating Digital Data Network Congestion | |
| TWI801835B (en) | Round-trip estimation | |
| KR101107325B1 (en) | Method and System for Measuring Quality by Network Interval for Real-time Multimedia Service | |
| Dhamodaran et al. | Adaptive Queue Management Scheme for Flexible Dual TCP/UDP Streaming Protocol | |
| KR101384125B1 (en) | Apparatus and method for generating quality of service parameter about mac layer in communication system | |
| WO2014087764A1 (en) | Terminal and communication system | |
| RU2013129160A (en) | VIDEO FLOW RATE CONTROL METHOD | |
| Yunus et al. | Proposed Technique for Transport Protocol in Wireless Sensor Network (WSN) for Multimedia Application | |
| Park et al. | Network-Adaptive Video Streaming over Wireless Multi-Hop Networks: Cross-Layered Hop-by-Hop Control |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20160330 Assignee: Zhejiang Yushi System Technology Co., Ltd Assignor: ZHEJIANG UNIVIEW TECHNOLOGIES Co.,Ltd. Contract record no.: X2021330000197 Denomination of invention: A method and device for dynamic routing of monitoring video code stream Granted publication date: 20210702 License type: Common License Record date: 20210831 |