WO2010054551A1 - 视频流传输的方法、装置和系统 - Google Patents

视频流传输的方法、装置和系统 Download PDF

Info

Publication number
WO2010054551A1
WO2010054551A1 PCT/CN2009/072190 CN2009072190W WO2010054551A1 WO 2010054551 A1 WO2010054551 A1 WO 2010054551A1 CN 2009072190 W CN2009072190 W CN 2009072190W WO 2010054551 A1 WO2010054551 A1 WO 2010054551A1
Authority
WO
WIPO (PCT)
Prior art keywords
data packet
video data
video
visual sensitivity
identification information
Prior art date
Application number
PCT/CN2009/072190
Other languages
English (en)
French (fr)
Inventor
荀永生
郑合文
秦霞
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP09825726.4A priority Critical patent/EP2348730B1/en
Publication of WO2010054551A1 publication Critical patent/WO2010054551A1/zh
Priority to US13/109,715 priority patent/US8730800B2/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
    • H04L47/2416—Real-time traffic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/32—Flow control; Congestion control by discarding or delaying data units, e.g. packets or frames
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2381—Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/6437—Real-time Transport Protocol [RTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network
    • H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets

Definitions

  • the present invention relates to network technologies, and in particular, to a method, device and system for video stream transmission. Background technique
  • IP QoS IP QoS
  • TCP Real-time Transport Protocol
  • discarding packets will cause the receiver to request retransmission of the lost packets.
  • this mechanism is real-time for audio or video.
  • Streaming multicast networks are less feasible because of the limited buffer space at the receiving end and insufficient time for requesting and accepting retransmitted packets for highly real-time traffic.
  • the loss of different IPTV data packets has a great difference to the user's visual experience. That is, after different IPTV data packets are discarded, the visual sensitivity of the end users is very different. After some IPTV packets are discarded, the impact on the screen is small, and the end users will not feel the difference. When some IPTV packets are lost, the impact on the screen is large. For example, an abnormal phenomenon such as a flower screen can be felt immediately. To.
  • the random discarding scheme adopted in the traditional network device congestion processing does not take into account the difference in the influence of different IPTV packets on the receiving end screen.
  • a video stream consists of a series of GOPs (Group of Pictures). a GOP Medium, including one I frame, multiple P frames, and multiple B frames.
  • GOPs Group of Pictures
  • the prior art has proposed an intelligent frame loss strategy based on service awareness: when a network has congestion and has to discard some data packets, the network device selectively discards data of different frame types. package.
  • NRI NAL Reference Indicator, NAL Reference Relationship
  • the NAL layer Network Abstraction Layer
  • DSLAM Digital Subscriber Line Access Multiplexer
  • the DSLAM network node performs priority discarding when it is congested; when discarding, the B frame is preferentially discarded, and then P-frames and I-frames. If one of the corresponding IP packets is discarded, the IP packets of the entire frame will be discarded.
  • This discarding scheme has the following disadvantages:
  • Embodiments of the present invention provide a method of video stream transmission, which is capable of differentiating processing of video streams of different encoding and packaging mechanisms according to visual sensitivity.
  • a method of video stream transmission comprising:
  • Evaluating the video data packet obtaining visual sensitivity identification information of the video data packet; carrying the visual sensitivity identification information in a video data packet, where the visual sensitivity identification information is used to identify the video data packet loss The extent of influence on the terminal screen;
  • the video data packet is transmitted, and the video data packet is processed according to the visual sensitivity identification information during transmission.
  • the video streaming method of the embodiment of the present invention obtains the visual sensitivity identification information of the video data packet by evaluating the video data packet, and the identification information of the visual sensitivity is carried in the video data packet, and the video is The data packet is transmitted, and the video data packet is processed according to the identification information during transmission, so that the video stream of different encoding and encapsulation mechanisms can be intelligently processed according to visual sensitivity.
  • Another embodiment of the present invention provides a network device for video streaming, which is capable of differentiating processing of video streams of different encoding and encapsulation mechanisms according to visual sensitivity.
  • a network device for video streaming comprising:
  • An obtaining unit configured to evaluate a video data packet and obtain visual sensitivity identification information of the video data packet, where the visual sensitivity identification information is used to identify a degree of influence on the terminal image after the video data packet is lost;
  • a carrying unit configured to carry the visual sensitivity identification information in a video data packet
  • a transmitting unit configured to transmit the video data packet, and process the video data packet according to the visual sensitivity identification information during transmission .
  • the network device for video streaming transmits the video data packet by the acquiring unit and obtains the visual sensitivity identification information of the video data packet, and the carrying unit carries the visual sensitivity identification information in the video data packet, and transmits
  • the unit is configured to transmit the video data packet, and perform differentiating processing on the video data packet according to the identifier information, so that the video stream of different encoding and encapsulation mechanisms can be intelligentized according to visual sensitivity when the network is congested. deal with.
  • the embodiment of the invention further provides a system for video stream transmission, comprising:
  • a video source configured to evaluate a video data packet and obtain visual sensitivity identification information of the video data packet, and carry the identification information in a video data packet of the video stream and transmit the data to the network device, where the visual sensitivity is
  • the identification information is used to identify the degree of influence on the terminal picture after the video data packet is lost;
  • An embodiment of the present invention further provides another video streaming system, including: a video source end, configured to transmit a video data packet to a network device;
  • a network device configured to receive a video data packet from the video source, evaluate a video data packet, and obtain visual sensitivity identification information of the video data packet, and carry the identification information in a video data packet of the video stream according to The visual sensitivity identification information is used to process the video data packet, where the visual sensitivity identification information is used to identify the degree of influence on the terminal image after the video data packet is lost.
  • the system for transmitting video stream by setting a video source end and a network device, evaluating a video data packet by a video source end or a network, and obtaining visual sensitivity identification information of the video data packet, where the identification information is
  • the video data packet is carried in the video stream, or the video source only publishes the video data packet, and the network device carries the visual sensitivity identification information on the video data packet by analyzing, and the network device identifies the visual sensitivity according to the visual sensitivity.
  • the information processing the video data packet enables intelligent processing of video streams of different encoding and encapsulation mechanisms according to visual sensitivity.
  • FIG. 1 is a flowchart of a method for video stream transmission according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a method for video stream transmission according to another embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a method for video stream transmission according to still another embodiment of the present invention.
  • FIG. 4 is a schematic diagram of carrying identification information according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of carrying identification information according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of carrying identification information according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of carrying identification information according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of carrying identification information according to an embodiment of the present invention
  • FIG. 9 is a schematic diagram of a network device for video stream transmission according to an embodiment of the present invention
  • FIG. 8 is a schematic diagram of carrying identification information according to an embodiment of the present invention
  • FIG. 9 is a schematic diagram of a network device for video stream transmission according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a network device for video stream transmission according to another embodiment of the present invention.
  • a method for video stream transmission includes:
  • the video data packet is evaluated, and the visual sensitivity identifier information of the video data packet is obtained, where the visual sensitivity identifier information is used to identify a degree of impact on the terminal screen after the video data packet is lost.
  • the video data packet is transmitted, and the video data packet is processed according to the identifier information during transmission.
  • the evaluation video data packet is specifically: evaluating according to one or more combinations of a motion vector of the video picture, a frame type, a position of the video data packet in the picture, and color and brightness, and obtaining a video according to the result of the evaluation.
  • the visual sensitivity identification information of the packet is used to identify the degree of influence on the terminal picture after the video data packet is lost.
  • Video packets can be evaluated at the video source or on the edge network device and the corresponding visual sensitivity identification information can be obtained.
  • the video streaming method of the embodiment of the present invention obtains the visual sensitivity identification information of the video data packet by evaluating the video data packet, and the identification information of the visual sensitivity is carried in the video data packet, and the video data is The packet is transmitted, and the video data packet is differentiated according to the identification information during transmission, so that the video stream of different encoding and encapsulation mechanisms can be intelligently processed according to visual sensitivity during transmission.
  • a method for video stream transmission includes: S201.
  • the video data packet in the video data stream is evaluated for visual sensitivity on a video source end, and the visual sensitivity identifier information is carried in the video data packet.
  • the visual sensitivity identification information identifies the degree of influence on the terminal picture after the video data packet is lost.
  • the factors affecting the visual sensitivity include the motion vector of the video picture, the frame type, the position of the video data packet in the picture, and the color and brightness. The most important factor is the motion vector of the video frame, followed by the frame type.
  • the video data packets in the video data stream may be evaluated for visual sensitivity and carry visual sensitivity identification information on an edge network device close to the video source.
  • the video source transmits the data packet to the edge network device close to the video source, and obtains the visual sensitivity identification information of the data packet on the edge network device and carries the information to the video data packet.
  • the visual sensitivity identification information is carried in the video data packet in any of the following manners: (1) As shown in FIG. 4, the TOS (Type of Service) field in the IPv4 packet header or the IPv6 header is used. The unused fields in the TC (Traffic Class) field carry the identification information. The ToS field is the IPv4 service type field, and the TC field in IPv6 represents the same function.
  • the identification information may be carried in the last two bit fields that are not used by the ToS and the TC. When the network node is congested, the information carried by the field may be checked. Selective discarding to ensure the user's visual experience while mitigating congestion pressure. The two digits marked as 6, 7 are unused fields.
  • the identification information is carried by two unused bits in the DSCP (Differential Service Code Point).
  • the identification information is carried by unused bits in the field DSCP in IPv4 or IPv6.
  • the last two bits in the DSCP that is, two bits labeled as 6, 7 are used.
  • DSCP is a classification standard for QoS by IETF (The Internet Engineering Task Force). DSCP utilizes the TOS field in IPv4 or the TC field in IPv6. These fields currently only use the first six bits. The latter two are currently defined in the latest IETF congestion notifications, but the network supports very few network devices, so they can be used. Carrying the identification information.
  • the identifier information is carried by the IPv4 new option header.
  • There is a variable length option field in the IPv4 header ie the options field shown in Figure 6 can carry multiple option headers.
  • the format of the specific option header can be TLV.
  • the visual sensitivity identification information is carried in the newly defined option header, and any network node supporting the information may perform selective discarding processing or other differential service processing when the network is congested.
  • the content of the option header is used as a flexible definition, and new definitions such as video frames, video streams, and the like can be added to subsequent video processing to improve function coverage.
  • the identification information is carried by defining a new IPv6 extension header.
  • the service classification identifier extension header may contain two parts profile ID (category identifier) and profile (category) content, the classification may define multiple profiles, each profile is a classification space; different classification spaces, the coding may be repeated; the same classification Space, encoding can not be repeated; video applications can exist as a classification space, and other classification spaces can be defined as needed to improve scalability.
  • a new IPv6 extension header is defined, and the type is Service Class.
  • the identifier is carried in the content of the extension header.
  • the next extension of the IPv6 packet header may be checked first.
  • the header type if the extension header of the service class is checked, obtains the content of the extension header, and obtains the visual sensitivity identification information carried in the data packet by parsing the content, so that the priority selection has no influence on the user visual experience. Or the packets that affect the small packets are discarded to alleviate the congestion pressure.
  • the network node can also perform other differential service processing based on the information.
  • the visual sensitivity identification information is carried by the extension header in the RTP protocol.
  • the visual sensitivity identification information in this embodiment may also be carried by an extension field in the RTP protocol. If the bit X in the header of the RTP as shown in FIG. 8 is set to 1, it indicates that there is one and only one extension header after the fixed header of the RTP.
  • the identifier information may be carried in the extended header of the RTP, and any device in the network that can parse the extended header may be in the information when the network is congested. Capable, selectively differentiates video data packets.
  • the data packet carrying the identification information is transmitted from the video source end to the network device.
  • the network device here may be any node that supports network congestion management, such as: a core network router, an aggregation network router, and the like.
  • the network device 1 when the network is congested, the network device 1 selectively discards the video data packet according to the identifier information: when the network is congested, the network device determines the visuality of the data packet according to the identifier information carried in the video data packet.
  • the degree of sensitivity preferentially discarding low visual acuity packets. It is also possible to set a visual sensitivity threshold. If the visual sensitivity is below the threshold, then such a packet is considered to be too low in visual sensitivity and therefore discarded preferentially. It can also be judged based on the defined visual sensitivity threshold when the video source evaluates and obtains the visual sensitivity identification information.
  • Such a method of selectively discarding the video data packet according to the identification information may also be referred to as intelligent discarding.
  • the data packet carrying the identification information and partially discarded is transmitted from the network device 1 to the network device 2.
  • the network device 2 When the network is congested, the network device 2 selectively discards the video data packet according to the identifier information. In the event of network congestion, network device 2 preferentially discards low-visibility data packets, while mitigating congestion pressure, while ensuring that dropped packets have minimal or no impact on the user experience. Such a method of selectively discarding the video data packet according to the identification information may also be referred to as intelligent discarding.
  • steps S204 and S205 should be determined according to the number of network devices in the network, and thus are optional steps. If there are multiple network devices in the network, and these devices have the function of selective discarding based on the visual sensitivity identification information of the video packets, these two steps are repeated. Of course, if there is only network device 1 in the network, skip these steps and perform the following steps.
  • the data packet carrying the identification information and partially discarded is transmitted from the network device 2 to the decoding end. 5207.
  • the decoding end decodes the received video data packet.
  • the decoder sends a retransmission request.
  • the decoding end determines that some packets are lost according to the decoding characteristics, and therefore sends a retransmission request to the video source.
  • the video source end is a retransmission server.
  • it may also be a network device with a retransmission function as a retransmission server. As shown in FIG. 3, the network device 2 has a proxy retransmission function.
  • the video source end in FIG. 2 receives the retransmission request, determines the visual sensitivity identification information of the request retransmission data packet, and selects an important data packet with high visual sensitivity.
  • the network device 2 having the proxy retransmission function captures a retransmission request of the decoding end, determines the visual sensitivity identification information of the request retransmission data packet, and selects a visual sensitivity high. Packets are transmitted and these visually sensitive video packets are transmitted.
  • FIG. 2 is that the video source retransmits the important data packet obtained in S209 to the decoding end;
  • FIG. 3 shows that the network device 2 retransmits the important data packet obtained in S209 to the decoding end.
  • the receiving end After receiving the retransmitted data packet, the receiving end continues to perform decoding and playing.
  • the above steps are not limited to the above embodiments, and video packets may be transmitted in different orders in different cases.
  • the method for video stream transmission in the embodiment of the present invention may be implemented by a video source or a network device.
  • the video stream transmission method of the embodiment of the present invention determines the importance of the video data packet to the visual sensitivity according to the visual sensitivity identification information when the network is congested, adopts intelligent discarding, or retransmits the request according to the identifier information.
  • the lost video packets are selectively retransmitted, so that video streams of different encoding and encapsulation mechanisms are intelligently processed according to visual sensitivity.
  • the embodiment of the present invention solves the problem of versatility, and is applicable to the MPEG-2 encoding format, the H.264 or even the VC-1 encoding format; and is applicable to the MPEG2-TS encapsulation format and the H.264 NAL over RTP encapsulation format.
  • Embodiments of the present invention are capable of minimizing or having no impact on the user experience while discarding congestion pressure while mitigating congestion stress.
  • the embodiment of the invention further provides a network device for video stream transmission, which can discard video streams of different encoding and encapsulation mechanisms according to visual sensitivity.
  • a network device for video streaming includes:
  • the obtaining unit 100 is configured to evaluate a video data packet and obtain visual sensitivity identification information of the video data packet, where the visual sensitivity identification information is used to identify a degree of influence on the terminal image after the video data packet is lost.
  • the video data packet can be evaluated based on any combination of one or more of motion vector, frame type, picture position, color, or brightness.
  • the carrying unit 200 is configured to carry the visual sensitivity identifier information in a video data packet.
  • the visual sensitivity identification information is carried in any of a spare field, an unused field, a new option header, or an extended header in a message corresponding to each video data packet.
  • the transmission unit 300 is configured to transmit the video data packet, and process the video data packet according to the visual sensitivity identification information during transmission.
  • the network device for video stream transmission in the embodiment of the present invention may be applied to a video source end, and may also be applied to an edge network device or other network device.
  • the network device for video streaming transmits the video data packet by the acquiring unit and obtains the visual sensitivity identification information of the video data packet, and the carrying unit carries the visual sensitivity identification information in the video data packet, and transmits
  • the unit is configured to transmit the video data packet, and perform differentiating processing on the video data packet according to the identifier information, so that the video stream of different encoding and encapsulation mechanisms can be intelligentized according to visual sensitivity when the network is congested. deal with.
  • a network device for video streaming in a preferred embodiment of the present invention includes: an obtaining unit 100, a carrying unit 200, and a transmitting unit 300.
  • the obtaining unit 100 is configured to evaluate a video data packet and obtain visual sensitivity identification information of the video data packet, where the visual sensitivity identification information is used to identify that the video data packet is lost after the end The degree of influence of the end screen.
  • the carrying unit 200 is configured to carry the visual sensitivity identifier information in a video data packet.
  • the acquiring unit 100 and the carrying unit 200 may be disposed at the video source end or on an edge network device close to the video source end.
  • the transmission unit 300 includes: a packet transmission module 310, a discarding module 320, and a selective retransmission module 330.
  • the data packet transmission module 310 is configured to transmit a video data packet.
  • the discarding module 320 is configured to selectively discard video data packets transmitted by the data packet transmission module 310 according to the visual sensitivity identification information when the network is congested.
  • the discarding module 320 is typically disposed on a network device, such as network device 1 and network device 2 shown in Figures 2, 3. Specifically, when the network is congested, the discarding module 320 may preferentially discard the video data packets transmitted by the data packet transmission module 310 and having low visual sensitivity according to the visual sensitivity identification information.
  • the selective retransmission module 330 is configured to selectively retransmit the video data packet according to the identification information when receiving the retransmission request in the process of transmitting the video data packet by the data packet transmission module.
  • the retransmission request is usually sent by the decoder.
  • the selective retransmission module is generally arranged on a network device that provides a function of retransmitting video data packets, such as a video server or some special network device, such as a proxy server.
  • the selective retransmission module 330 in this embodiment may be disposed in the network device 2 as shown in FIG. 3 or the video source shown in FIG. 2.
  • the network device for video streaming in the embodiment of the present invention may also include only one of the discarding module 320 or the retransmission module 330.
  • the network device for video stream transmission in the embodiment of the present invention can be applied to a video source end.
  • the network device of the video stream transmission of the embodiment of the present invention evaluates and acquires the visual sensitivity identification information of the video data packet by the acquiring unit, and the carrying unit carries the visual sensitivity identification information in each video data packet, and if If the network is congested, the data packets of different identification information are selectively discarded by the network device, and if the network device receives the retransmission request, according to the vision
  • the sensitivity identification information performs selective retransmission of the video data packet, thereby realizing that the video stream of different encoding and encapsulation mechanisms is differentiated according to the visual sensitivity.
  • the embodiment of the invention solves the problem of universality, and is applicable to the MPEG-2 encoding format and the H.264 or even the VC-1 encoding format; and is also applicable to the MPEG2-TS encapsulation format and the H.264 NAL over RTP encapsulation format.
  • Embodiments of the present invention are capable of minimizing or having no impact on the user experience while discarding congestion pressure while mitigating congestion stress.
  • the embodiment of the invention further provides a system for video stream transmission, comprising a video source end and a network device.
  • the video source is configured to evaluate a video data packet and obtain visual sensitivity identification information of the video data packet, and carry the visual sensitivity identification information in a video data packet of the video stream and transmit the data to the network device,
  • the network device is configured to receive a video data packet from the video source end, and process the video data packet according to the visual sensitivity identifier information, where the visual sensitivity identifier information is used to identify the video data packet.
  • the network device includes a first network device and a second network device.
  • the first network device is configured to receive the video data packet, and according to the visual sensitivity identification information, refer to the network device 1 shown in FIG. 2;
  • the second network device is configured to receive the video data packet, and when receiving the retransmission request, selectively retransmit the video data packet that is requested to be retransmitted according to the identifier information, as shown in FIG. Network device 2.
  • the first network device and the second network device may also be alternatively configured.
  • the second network device may also be disposed before the first network device.
  • the video source may be further configured to selectively retransmit the video data packet that is requested to be retransmitted according to the identifier information when receiving the retransmission request, as shown in FIG. 2 Video source.
  • Embodiments of the present invention also provide another system for video streaming, including a video source and a network device.
  • the video source end is configured to transmit a video data packet to a network device
  • the network device is configured to receive a video data packet from the video source, evaluate a video data packet, and obtain visual sensitivity identification information of the video data packet, and carry the visual sensitivity identifier information in a video stream. And processing, in the data packet, the video data packet according to the visual sensitivity identifier information, where the visual sensitivity identifier information is used to identify a degree of influence on the terminal screen after the video data packet is lost.
  • the network device includes:
  • a first network device configured to receive the video data packet, evaluate the video data packet, and obtain visual sensitivity identification information of the video data packet, and carry the identification information in a video data packet of the video stream.
  • the first network device is further configured to selectively discard the video data packet according to the visual sensitivity identifier information. There may be more than one first network device.
  • a second network device configured to receive the video data packet, and, when receiving the retransmission request, selectively retransmit the video data packet that is requested to be retransmitted according to the visual sensitivity identifier information.
  • the video source may be further configured to selectively retransmit the video data packet requested to be retransmitted according to the visual sensitivity identification information when receiving the retransmission request.
  • the video stream transmission system provided by the embodiment of the invention can realize the intelligent processing of the video stream of different coding and encapsulation mechanisms according to the visual sensitivity by setting the video source end and the network device.
  • the visual sensitivity identification information may be obtained by the video source or the network device and carried in the video data packet.
  • the network data packet may be selectively discarded by the network device according to the identification information, and may be a network device or a video source.
  • the terminal performs selective retransmission of the data packet according to the identifier information, so that the embodiment of the present invention can implement intelligent processing on video packets of various encoding and encapsulation mechanisms, and reduce the impact on the receiving end screen to Minimum or no impact.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Description

视频流传输的方法、 装置和系统 本申请要求了 2008年 11月 17日提交的、 申请号为 200810176542.9、 发 明名称为视频流传输的方法、 装置和系统的中国专利申请的优先权， 其全部 内容通过引用结合在本申请中。
技术领域
本发明涉及网络技术， 尤其涉及一种视频流传输的方法、 装置和系统。 背景技术
随着网络技术的快速发展，网络通信业务日益丰富，如 VoIP(Voice over IP, 基于 IP的语音）、 IPTV( Internet Protocol Television, IP电视）、 HIS ( High Speed Internet, 高速上网）等业务都在大规模开展。 用户规模的迅速增加， 带来了 巨大的网络带宽需求， 服务提供商的承载网特别是汇集网络， 不可避免地出 现拥塞。 当前用于 IP QoS ( Quality of Service, 服务质量 )算法的丟弃机制采 用随机丟弃方案， 在选择丟弃哪些拥塞的报文时并不考虑丟弃的报文对接收 端的具体影响。
对于部分数据传输协议， 如 TCP ( Real-time Transport Protocol, 实时传输 协议）， 丟弃报文将会导致接收端请求对丟失的报文进行重传， 然而这种机制 对于音频或视频这样的实时流进行多播的网络却不太可行， 因为接收端的緩 冲器空间有限， 对于实时性艮高的业务没有足够的时间用于请求和接受重传 的分组。
在 IPTV的视频传输中， 不同 IPTV数据包的丟失对用户视觉体验存在很 大的差异， 即不同 IPTV数据包丟弃后， 终端用户视觉敏感度差别非常大。 有 的 IPTV数据包丟弃后，对画面冲击艮小，终端用户不会感觉到差异；有的 IPTV 数据包丟失后， 对画面冲击较大， 比如出现花屏等异常现象， 终端用户立即 就能感受到。 传统的网络设备拥塞处理时采用的随机丟弃方案没有考虑到不 同的 IPTV数据包对终端接收端画面的影响的差异。
一个视频流由一系列 GOP ( Group of Pictures, 图像组）组成。 一个 GOP 中， 包含一个 I帧、 多个 P帧以及多个 B帧。 针对基于 H.264的 IPTV系统， 现有 技术已经提出了基于业务感知的智能丟帧策略： 在网络出现拥塞不得不丟弃 部分数据包时， 网络设备有选择性的丟弃不同帧类型的数据包。 首先在 DSLAM ( Digital Subscriber Line Access Multiplexer , 数字用户线路接入复用 器 )上检测 H.264的 NAL层 ( Network Abstraction Layer, 网络抽象层 )报文头 的字段 NRI ( NAL Reference Indicator, NAL参考关系标识）； 然后基于 NRI作 出丟弃判断， 若 NRI为 0时， 表示视频帧为非参考帧， DSLAM网络节点在拥 塞时， 进行优先丟弃处理； 丟弃时优先丟弃 B帧， 然后依次是 P帧、 I帧， 若各 帧中有一个对应的 IP报文被丟弃， 整个帧的 IP报文都将丟弃。这种丟弃方案有 如下缺点：
( 1 ) 受限于编码机制： 必须使用 H.264编码， 不支持 MPEG-2编码；
( 2 )受限于封装机制： 只支持 RTP封装的 H.264视频流， 不支持 RTP封 装 MPEG2和 MPEG2-TS封装的视频流；
( 3 ) NRI标记的是帧类型,一个帧对应多个 IP包， 多个 IP包中并不是每 个包的丟失都会对终端画面有影响的， 因此， 根据 NRI标记作为丟弃的判断 依据时， 丟弃时是将整个帧进行丟弃， 不能满足网络设备逐包调度和转发的 处理从而引起接收端的用户体验的下降。
发明内容
本发明的实施例提供一种视频流传输的方法， 能够对不同编码和封装机 制的视频流根据视觉敏感度进行差异化处理。
为达到上述目的， 本发明的实施例采用如下技术方案：
一种视频流传输的方法， 包括：
评估视频数据包， 获得所述视频数据包的视觉敏感度标识信息； 将所述视觉敏感度的标识信息携带在视频数据包中， 其中所述视觉敏感度标 识信息用于标识该视频数据包丟失后对终端画面的影响程度；
将所述视频数据包进行传输， 传输时根据所述视觉敏感度标识信息对所 述视频数据包进行处理。 本发明的实施例视频流传输的方法通过评估视频数据包， 获得所述视频 数据包的视觉敏感度标识信息， 将所述视觉敏感度的标识信息携带在视频数 据包中， 并将所述视频数据包进行传输， 在传输时根据所述标识信息对所述 视频数据包进行处理， 从而能够实现对不同编码和封装机制的视频流根据视 觉敏感度进行智能化处理。
本发明的另一实施例提供了一种视频流传输的网络设备， 能够对不同编 码和封装机制的视频流根据视觉敏感度进行差异化处理。
为达到上述目的， 本发明的实施例采用如下技术方案：
一种视频流传输的网络设备， 包括：
获取单元， 用于评估视频数据包并获得所述视频数据包的视觉敏感度标 识信息， 其中所述视觉敏感度标识信息用于标识该视频数据包丟失后对终端 画面的影响程度；
携带单元， 用于将所述视觉敏感度标识信息携带在视频数据包中； 传输单元， 用于传输所述视频数据包， 传输时根据所述视觉敏感度标识 信息对所述视频数据包进行处理。
本发明的实施例视频流传输的网络设备通过获取单元评估视频数据包并 获得所述视频数据包的视觉敏感度标识信息， 携带单元将所述视觉敏感度标 识信息携带在视频数据包中， 传输单元用于传输所述视频数据包， 根据所述 标识信息对所述视频数据包进行差异化处理， 从而实现了在网络拥塞时能够 对不同编码和封装机制的视频流根据视觉敏感度进行智能化处理。
本发明实施例还提供了一种视频流传输的系统， 包括：
视频源端， 用于评估视频数据包并获得所述视频数据包的视觉敏感度标 识信息， 将所述标识信息携带在视频流的视频数据包中并传输给网络设备， 其中所述视觉敏感度标识信息用于标识该视频数据包丟失后对终端画面的影 响程度；
网络设备， 用于接收来自所述视频源端的视频数据包并根据所述视觉敏 感度标识信息对所述视频数据包进行处理。 本发明的实施例还提供了另一种视频流传输的系统， 包括： 视频源端， 用于将视频数据包传输给网络设备；
网络设备， 用于接收来自所述视频源端的视频数据包， 评估视频数据包 并获得所述视频数据包的视觉敏感度标识信息， 将所述标识信息携带在视频 流的视频数据包中并根据所述视觉敏感度标识信息对所述视频数据包进行处 理， 其中所述视觉敏感度标识信息用于标识该视频数据包丟失后对终端画面 的影响程度。
本发明实施例提供的视频流传输的系统， 通过设置视频源端和网络设备， 由视频源端或网络评估视频数据包并获得所述视频数据包的视觉敏感度标识 信息， 将所述标识信息携带在视频流的视频数据包中， 或者视频源端仅发布 视频数据包， 而由网络设备通过分析在所述视频数据包上携带视觉敏感度标 识信息， 网络设备再根据所述视觉敏感度标识信息对所述视频数据包进行处 理， 能够实现对不同编码和封装机制的视频流根据视觉敏感度进行智能化处 理。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案， 下面将对实 施例或现有技术描述中所需要使用的附图作简单地介绍， 显而易见地， 下面 描述中的附图仅仅是本发明的一些实施例， 对于本领域普通技术人员来讲， 在不付出创造性劳动的前提下， 还可以根据这些附图获得其它的附图。
图 1为本发明实施例视频流传输的方法的流程图；
图 2为本发明另一实施例视频流传输的方法的示意图；
图 3为本发明再一实施例视频流传输的方法的示意图；
图 4为本发明实施例一种标识信息携带示意图；
图 5为本发明实施例一种标识信息携带示意图；
图 6为本发明实施例一种标识信息携带示意图；
图 7为本发明实施例一种标识信息携带示意图；
图 8为本发明实施例一种标识信息携带示意图； 图 9为本发明实施例视频流传输的网络设备的示意图；
图 10为本发明另一实施例视频流传输的网络设备的示意图。
具体实施方式
下面结合附图对本发明实施例视频流传输的方法、 装置和系统进行详细 描述。
应当明确， 所描述的实施例仅仅是本发明一部分实施例， 而不是全部的 实施例。 基于本发明中的实施例， 本领域普通技术人员在没有作出创造性劳 动前提下所获得的所有其他实施例， 都属于本发明保护的范围。
如图 1所示， 本发明的实施例视频流传输的方法， 包括：
5101、 评估视频数据包， 获得所述视频数据包的视觉敏感度标识信息， 其中所述视觉敏感度标识信息用于标识该视频数据包丟失后对终端画面的影 响程度；
5102、 将所述视觉敏感度的标识信息携带在视频数据包中；
5103、 将所述视频数据包进行传输， 传输时根据所述标识信息对所述视 频数据包进行处理。
评估视频数据包具体为： 根据视频画面的运动矢量、 帧类型、 所述视频 数据包位于画面中的位置、 以及色彩和亮度等中的一项或多项组合进行评估， 根据评估的结果获得视频数据包的视觉敏感度标识信息。 所述视觉敏感度标 识信息用于标识该视频数据包丟失后对终端画面的影响程度。 可以在视频源 端， 也可以在边缘网络设备上对视频数据包进行评估， 并获得相应的视觉敏 感度标识信息。
本发明的实施例视频流传输的方法通过评估视频数据包， 获得所述视频 数据包的视觉敏感度标识信息， 将所述视觉敏感度的标识信息携带在视频数 据包中， 将所述视频数据包进行传输， 在传输时根据所述标识信息对所述视 频数据包进行差异化处理， 从而实现了在传输时能够对不同编码和封装机制 的视频流根据视觉敏感度进行智能化处理。
如图 2、 图 3所示， 在本发明另一实施例中， 视频流传输的方法包括： S201、 在视频源端对视频数据流中的视频数据包逐包评估视觉敏感度， 并将所述视觉敏感度标识信息携带在视频数据包中。
所述视觉敏感度标识信息标识该视频数据包丟失后对终端画面的影响程 度。 影响视觉敏感度因素包括视频画面的运动矢量、 帧类型、 所述视频数据 包位于画面中的位置、 以及色彩和亮度等。 最重要的影响因素是视频画面的 运动矢量， 帧类型次之。
本发明并不局限于此， 还可以在靠近视频源端的边缘网络设备上对视频 数据流中的视频数据包逐包评估视觉敏感度并携带视觉敏感度标识信息。 例 如， 先由视频源端把数据包传输到靠近视频源端的边缘网络设备， 并在边缘 网络设备上获取数据包的视觉敏感度标识信息并携带到视频数据包中。
把视觉敏感度标识信息通过以下任一种方式携带在视频数据包中： ( 1 )如图 4所示， 通过 IPv4报文头中的 TOS ( Type of Service,服务类 型）字段或 IPv6报头中的 TC ( Traffic Class, 通信级别） 字段中未使用的字 段携带所述标识信息。 ToS字段为 IPv4的服务类型字段， 和 IPv6中的 TC字 段代表着相同的功能。 视频数据报文的视觉敏感度经过评估量化后， 所述标 识信息即可以携带在 ToS和 TC未使用的后两个比特字段中，网络节点在拥塞 时， 可以通过检查该字段携带的信息， 进行选择性的丟弃处理， 在緩解拥塞 压力的同时， 确保用户的视觉体验。 其中标记为 6、 7的两位即为未使用的字 段。
( 2 )如图 5所示， 通过 DSCP ( Differentiated Services Code Point, 差分 服务点 ) 中未使用的两个比特位携带所述标识信息。 将所述标识信息由 IPv4或 IPv6中的字段 DSCP中未用的比特位携带， 例如图 5中， 所述 DSCP 中后两个比特位， 即， 标记为 6、 7的两位。
DSCP是 IETF ( The Internet Engineering Task Force , 互联网工程任务组 ) 关于 QoS的一个分类标准， DSCP利用了 IPv4中的 TOS字段或 IPv6中的 TC 字段。 这些字段目前只使用了前六位比特， 后两位目前虽然在最新的 IETF的 拥塞通告中有定义使用， 但是现网支持的网络设备很少， 因而可以利用起来 携带所述标识信息。
( 3 )如图 6所示， 通过 IPv4新增选项头携带所述标识信息。 在 IPv4的报文 头中有可变长度的选项字段， 即图 6中所示的 options (选项）字段可以携带多 个选项头。 定义新的选项头， 具体的选项头的格式可以是 TLV
( Tag-Length- Value, 标签-长度-取值）格式， 也可以是其他的数据格式。 在 新定义的选项头中携带所述视觉敏感度标识信息， 任何支持该信息的网络节 点， 均可以在网络拥塞的时候， 进行选择性的丟弃处理， 或其他的差分服务 处理。 该选项头的内容作为一个灵活的定义， 还可以在后续的视频处理中添 加新的定义， 如视频帧、 视频流等标识信息， 提高功能覆盖范围。
( 4 )如图 7所示， 通过定义新的 IPv6的扩展头携带所述标识信息。
业务分类标识扩展头可以包含两个部分 profile ID (类别标识） 和 profile (类别）内容， 分类可以定义多个 profile,每个 profile是一个分类空间； 不同的 分类空间， 编码可以重复； 同一个分类空间， 编码不可以重复； 视频应用可以 作为一个分类空间存在， 又可以根据需要定义其他分类空间，提高扩展性。
具体为： 定义新的 IPv6扩展头， 类型为 Service Class (服务类型） ， 在该 扩展头的内容中携带所述标识信息， 网络节点在拥塞时， 可以首先逐个检查 IPv6报文头的下一个扩展头类型， 若检查到类型为 Service Class的扩展头， 则 获取该扩展头的内容， 通过对内容的解析， 得到数据包中携带的视觉敏感度 标识信息， 即可优先选择对用户视觉体验没有影响或影响小的数据包进行丟 弃， 緩解拥塞压力， 网络节点还可以根据该信息进行其他的差分服务处理。
(5) 如图 8所示， 通过 RTP协议中的扩展头携带视觉敏感度标识信息。 本实施例中的视觉敏感度标识信息也可以通过 RTP协议中的扩展字段携 带。 如图 8所示的 RTP的报文头中的比特位 X如果设置为 1 , 表示 RTP的固 定头之后有且只有一个扩展头。 基于约定的信息， 可以在 RTP的扩展报头中携带所述标识信息， 网络中 任意可以解析该扩展报头的设备， 均可以在网络出现拥塞时， 根据该信息内 容， 对视频数据报文进行选择性的差异化处理。
5202、将携带标识信息的数据包从视频源端传输到网络设备 1 , 这里的网 络设备可以是任意支持网络拥塞管理的节点， 如： 核心网路由器、 汇聚网路 由器等。
5203、 在网络拥塞时， 网络设备 1根据所述标识信息对所述视频数据包 进行选择性丟弃： 遇到网络拥塞时， 网络设备根据视频数据包中携带的标识 信息， 判断数据包的视觉敏感度程度， 优先将低视觉敏感度数据包丟弃。 还 可以设定视觉敏感度阈值， 如果视觉敏感度低于阈值， 则认为这样的数据包 视觉敏感度过低， 因而优先丟弃。 也可以根据视频源端在评估并获取视觉敏 感度标识信息时， 所定义的视觉敏感度阈值进行判断。 这种根据所述标识信 息对所述视频数据包进行选择性丟弃的方法， 也可以称为智能丟弃。
这样做， 在緩解拥塞压力的同时， 确保丟弃的数据包对用户的体验影响 最小化或没有影响。
5204、 将携带着标识信息、 且部分丟弃的数据包从网络设备 1传输到网 络设备 2。
5205、 在网络拥塞时， 网络设备 2根据所述标识信息对所述视频数据包 进行选择性丟弃。 遇到网络拥塞时， 网络设备 2将低视觉敏感度数据包优先 丟弃， 在緩解拥塞压力的同时， 确保丟弃的数据包对用户的体验影响最小化 或没有影响。 这种根据所述标识信息对所述视频数据包进行选择性丟弃的方 法， 也可以称为智能丟弃。
需要说明的是， 步骤 S204、 S205应当依据网络中的网络设备的个数进行 确定， 因而为可选步骤。 如果网络中有多个网络设备， 并且这些设备都具有 根据视频数据包的视觉敏感度标识信息进行选择性丟弃的功能， 则重复执行 这两个步骤。 当然， 如果网络中只有网络设备 1 , 则跳过这些步骤执行以下步 骤。
5206、 将携带着标识信息、 且部分丟弃的数据包从网络设备 2传输到解 码端。 5207、 解码端对接收到的视频数据包进行解码。
5208、 解码端发出重传请求。
具体为： 解码端根据解码特性判断发现有一些报文丟失， 因而向视频源 端发出重传请求。 在本实施例中视频源端为重传服务器。
在其它的实施例中， 也可以是具有重传功能的网络设备作为重传服务器。 如图 3所示， 网络设备 2具有代理重传功能。
5209、 图 2 中的视频源端接收到重传请求， 判断请求重传数据包的视觉 敏感度标识信息， 选择出视觉敏感度高的重要数据包。
在本发明其它的实施例中， 如图 3所示， 具有代理重传功能的网络设备 2 捕获解码端的重传请求， 判断请求重传数据包的视觉敏感度标识信息， 选择 出视觉敏感度高的数据包， 并将这些视觉敏感度高的视频数据包进行传输。
5210、 图 2为视频源端将在 S209中得到的重要数据包重传给解码端； 图 3为网络设备 2将 S209中得到的重要数据包重传给解码端。
5211、 接收端接收到重传的数据包后， 继续进行解码播放。
以上步骤并不局限于上述实施例， 在不同的情况下可以采用不同的顺序 对视频数据包进行传输。 本发明实施例视频流传输的方法可以由视频源端或 网络设备来实现。
本发明的实施例视频流传输的方法在出现网络拥塞时根据视觉敏感度标 识信息确定视频数据包对视觉敏感度重要性， 采取智能化性丟弃， 或者根据 所述标识信息对请求重传的丟失的视频数据包进行选择性重传， 从而实现了 不同编码和封装机制的视频流根据视觉敏感度进行智能化处理。 本发明实施 例解决了通用性的问题， 适用于 MPEG-2编码格式、 H.264甚至 VC-1编码格 式； 适用于 MPEG2-TS封装格式和 H.264 NAL over RTP封装格式。
本发明的实施例能够实现在緩解拥塞压力的同时， 确保丟弃的数据包对 用户的体验影响最小化或没有影响。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流 程， 是可以通过计算机程序来指令相关的硬件来完成， 所述的程序可存储于 一计算机可读取存储介质中， 该程序在执行时， 可包括如上述各方法的实施 例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体（ Read-Only Memory, ROM )或随机存^ ^己忆体 ( Random Access Memory, RAM )等。 本发明实施例还提供了一种视频流传输的网络设备， 能够对不同编码和 封装机制的视频流根据视觉敏感度进行丟弃。
如图 9所示， 本发明实施例视频流传输的网络设备， 包括：
获取单元 100,用于评估视频数据包并获得所述视频数据包的视觉敏感度 标识信息， 其中所述视觉敏感度标识信息用于标识该视频数据包丟失后对终 端画面的影响程度。 具体可以根据运动矢量、 帧类型、 画面位置、 色彩或亮 度的一种或多种的任意组合评估视频数据包。
携带单元 200, 用于将所述视觉敏感度标识信息携带在视频数据包中。 具 体为： 将视觉敏感度标识信息携带在与各个视频数据包相应的报文中的空余 字段、 未使用字段、 新增选项头或扩展头的任意一种中。
传输单元 300, 用于传输所述视频数据包，传输时根据所述视觉敏感度标 识信息对所述视频数据包进行处理。
本发明实施例视频流传输的网络设备可以应用于视频源端， 也可以应用 于边缘网络设备或其它网络设备。
本发明的实施例视频流传输的网络设备通过获取单元评估视频数据包并 获得所述视频数据包的视觉敏感度标识信息， 携带单元将所述视觉敏感度标 识信息携带在视频数据包中， 传输单元用于传输所述视频数据包， 根据所述 标识信息对所述视频数据包进行差异化处理， 从而实现了在网络拥塞时能够 对不同编码和封装机制的视频流根据视觉敏感度进行智能化处理。
如图 10所示， 在本发明一较佳实施例中视频流传输的网络设备包括： 获 取单元 100、 携带单元 200和传输单元 300。
获取单元 100,用于评估视频数据包并获得所述视频数据包的视觉敏感度 标识信息， 其中所述视觉敏感度标识信息用于标识该视频数据包丟失后对终 端画面的影响程度。
携带单元 200, 用于将所述视觉敏感度标识信息携带在视频数据包中。 所述获取单元 100和携带单元 200可以设置于视频源端， 也可以设置于 靠近视频源端的边缘网络设备上。
传输单元 300包括： 数据包传输模块 310、丟弃模块 320和选择性重传模 块 330。
所述数据包传输模块 310, 用于传输视频数据包。
所述丟弃模块 320,用于在网络拥塞时根据所述视觉敏感度标识信息对所 述数据包传输模块 310传输的视频数据包进行选择性丟弃。
丟弃模块 320通常设置于网络设备上， 例如图 2、 图 3中所示的网络设备 1和网络设备 2。 具体地， 在网络拥塞时丟弃模块 320可以根据所述视觉敏感 度标识信息， 将所述数据包传输模块 310传输的、 视觉敏感度低的视频数据 包优先丟弃。
选择性重传模块 330,用于在所述数据包传输模块传输视频数据包的过程 中， 接收到重传请求时根据所述标识信息对视频数据包进行选择性重传。 重 传请求通常由解码端发出。 、
选择性重传模块一般设置于提供重传视频数据包功能的网络设备上， 如 视频服务器或一些特殊的网络设备， 如代理服务器等。 本实施例中选择性重 传模块 330可以设置于如图 3所示的网络设备 2,或者是图 2中所示的视频源 端。
本发明的实施例视频流传输的网络设备中也可以只包括丟弃模块 320或 重传模块 330 中的任一个。 本发明实施例视频流传输的网络设备可以应用于 视频源端。
本发明的实施例视频流传输的网络设备通过获取单元评估并获取视频数 据包的视觉敏感度标识信息， 携带单元将视觉敏感度标识信息携带在与各个 视频数据包中， 在传输过程中如果遇上网络拥塞， 则通过网络设备对不同标 识信息的数据包进行选择性丟弃， 如果网络设备接收到重传请求则根据视觉 敏感度标识信息进行视频数据包的选择性重传， 从而实现了不同编码和封装 机制的视频流根据视觉敏感度进行差异化处理。
本发明实施例解决了通用性的问题， 适用于 MPEG-2编码格式和 H.264 甚至 VC-1编码格式； 同时还适用于 MPEG2-TS封装格式和 H.264 NAL over RTP封装格式。
本发明的实施例能够实现在緩解拥塞压力的同时， 确保丟弃的数据包对 用户的体验影响最小化或没有影响。
本发明实施例还提供了一种视频流传输的系统， 包括视频源端和网络设 备。
所述视频源端， 用于评估视频数据包并获得所述视频数据包的视觉敏感 度标识信息， 将所述视觉敏感度标识信息携带在视频流的视频数据包中并传 输给网络设备， 参照图 2所示的视频源端；
所述网络设备， 用于接收来自所述视频源端的视频数据包并根据所述视 觉敏感度标识信息对所述视频数据包进行处理， 其中所述视觉敏感度标识信 息用于标识该视频数据包丟失后对终端画面的影响程度。 其中， 所述网络设 备包括第一网络设备和第二网络设备。
所述第一网络设备， 用于接收所述视频数据包， 并根据所述视觉敏感度 标识信息， 参照图 2所示的网络设备 1； 和
所述第二网络设备， 用于接收所述视频数据包， 并在接收到重传请求时， 根据所述标识信息对请求重传的视频数据包进行选择性重传， 参照图 3 所示 的网络设备 2。
第一网络设备和第二网络设备还可以择一设置。 另外， 第一网络设备还 可以有多个， 那么在数据流传输时， 多次根据视觉敏感度标识信息将视频数 据包进行选择性丟弃。 并且， 第二网络设备也可以设置于第一网络设备之前。
在本发明的较佳实施例中， 视频源端也可以用于在接收到重传请求时， 根据所述标识信息对请求重传的视频数据包进行选择性重传， 参照图 2所示 的视频源端。 本发明的实施例还提供了另一种视频流传输的系统， 包括视频源端和网 络设备。
所述视频源端， 用于将视频数据包传输给网络设备；
所述网络设备， 用于接收来自所述视频源端的视频数据包， 评估视频数 据包并获得所述视频数据包的视觉敏感度标识信息， 将所述视觉敏感度标识 信息携带在视频流的视频数据包中， 并根据所述视觉敏感度标识信息对所述 视频数据包进行处理， 其中所述视觉敏感度标识信息用于标识该视频数据包 丟失后对终端画面的影响程度。
其中， 所述网络设备包括：
第一网络设备， 用于接收所述视频数据包， 评估视频数据包并获得所述 视频数据包的视觉敏感度标识信息， 将所述标识信息携带在视频流的视频数 据包中。 在本发明的一较佳实施例中， 第一网络设备还用于并根据所述视觉 敏感度标识信息对所述视频数据包进行选择性丟弃。 第一网络设备可以不只 一个。
第二网络设备， 用于接收所述视频数据包， 并在接收到重传请求时， 根 据所述视觉敏感度标识信息对请求重传的视频数据包进行选择性重传。
在本发明的另一较佳实施例中， 视频源端也可以用于在接收到重传请求 时， 根据所述视觉敏感度标识信息对请求重传的视频数据包进行选择性重传。
本发明实施例提供的视频流传输的系统， 通过设置视频源端和网络设备， 能够实现对不同编码和封装机制的视频流根据视觉敏感度进行智能化处理。 可以由视频源端或网络设备获取视觉敏感度标识信息并携带在视频数据包 中， 可以由网络设备根据所述标识信息对所述视频数据包进行选择性丟弃， 可以由网络设备或视频源端根据所述标识信息进行数据包的选择性重传， 因 而本发明的实施例能够实现对各种不同的编码和封装机制的视频数据包进行 智能处理， 并且将对接收端画面的影响降到最低或没有影响。
以上所述， 仅为本发明的具体实施方式， 但本发明的保护范围并不局限 于此， 任何熟悉本技术领域的技术人员在本发明揭露的技术范围内， 可轻易 想到的变化或替换， 都应涵盖在本发明的保护范围之内。 因此， 本发明的保 护范围应以权利要求的保护范围为准。

Claims

权利 要求 书
1、 一种视频流传输的方法， 其特征在于， 包括：
评估视频数据包， 获得所述视频数据包的视觉敏感度标识信息， 其中所述视觉 敏感度标识信息用于标识该视频数据包丟失后对终端画面的影响程度；
将所述视觉敏感度标识信息携带在视频数据包中；
将所述视频数据包进行传输， 传输时根据所述标识信息对所述视频数据包 进行处理。
2、 根据权利要求 1所述的视频流传输的方法， 其特征在于， 传输时将所述 视觉敏感度标识信息携带在视频数据包中的步骤具体为：
将视觉敏感度标识信息携带在与各个视频数据包相应的报文中的空余字 段、 未使用字段、 新增选项头或扩展头的任意一种中。
3、 根据权利要求 1所述的视频流传输的方法， 其特征在于， 所述传输时根 据所述视觉敏感度标识信息对所述视频数据包进行处理的步骤包括：
在出现网络拥塞时， 接收所述数据包， 并根据所述视觉敏感度标识信息对 数据包进行选择性丟弃。
4、 根据权利要求 1所述的视频流传输的方法， 其特征在于， 所述传输时根 据所述视觉敏感度标识信息对所述视频数据包进行处理的步骤， 包括：
在接收到重传请求时， 根据所述视觉敏感度标识信息对请求重传的视频数 据包进行选择性重传。
5、 根据权利要求 1所述的视频流传输的方法， 其特征在于， 所述评估视频 数据包的步骤具体为：
根据运动矢量、 帧类型、 画面位置、 色彩或亮度的一种或多种的任意组合 评估视频数据包。
6、 根据权利要求 1至 5任一项所述的视频流传输的方法， 其特征在于， 所 述视频流传输的方法由视频源端或网络设备来实现。
7、 一种视频流传输的网络设备， 其特征在于， 包括：
获取单元， 用于评估视频数据包并获得所述视频数据包的视觉敏感度标识 信息， 其中所述视觉敏感度标识信息用于标识该视频数据包丟失后对终端画面 的影响程度；
携带单元， 用于将所述视觉敏感度标识信息携带在所述视频数据包中； 传输单元， 用于传输所述视频数据包， 传输时根据所述视觉敏感度标识信 息对所述视频数据包进行处理。
8、 根据权利要求 7所述的视频流传输的网络设备， 其特征在于， 所述传输 单元包括：
数据包传输模块， 用于传输视频数据包；
所述丟弃模块， 用于在网络拥塞时根据所述视觉敏感度标识信息对所述数 据包传输模块传输的视频数据包进行选择性丟弃。
9、 根据权利要求 7所述的视频流传输的网络设备， 其特征在于， 所述传输 单元还包括：
数据包传输模块， 用于传输视频数据包；
选择性重传模块， 用于在所述数据包传输模块传输视频数据包的过程中， 接收到重传请求时根据所述视觉敏感度标识信息对请求重传的视频数据包进行 选择性重传。
10、 根据权利要求 7或 8或 9所述的视频流传输的网络设备， 其特征在于， 所述视频流传输的网络设备应用于视频源端。
11、 一种视频流传输的系统， 其特征在于， 包括：
视频源端， 用于评估视频数据包并获得所述视频数据包的视觉敏感度标识 信息， 将所述视觉敏感度标识信息携带在视频流的视频数据包中并传输给网络 设备， 其中所述视觉敏感度标识信息用于标识该视频数据包丟失后对终端画面 的影响程度；
所述网络设备， 用于接收来自视频源端的视频数据包并根据所述视觉敏感 度标识信息对所述视频数据包进行处理。
12、 根据权利要求 11所述的视频流传输的系统， 其特征在于， 所述网络设 备包括： 第一网络设备， 用于接收所述视频数据包， 并根据所述视觉敏感度标识信 息对所述视频数据包进行选择性丟弃； 和 /或
第二网络设备， 用于接收所述视频数据包， 并在接收到重传请求时， 根据 所述视觉敏感度标识信息对请求重传的视频数据包进行选择性重传。
13、 根据权利要求 11所述的视频流传输的系统， 其特征在于， 所述视频源 端还用于在接收到重传请求时， 根据所述视觉敏感度标识信息对请求重传的视 频数据包进行选择性重传。
14、 一种视频流传输的系统， 其特征在于， 包括：
视频源端， 用于将视频数据包传输给网络设备；
所述网络设备， 用于接收所述视频数据包， 评估视频数据包并获得所述视 频数据包的视觉敏感度标识信息， 将所述视觉敏感度标识信息携带在视频流的 视频数据包中并根据所述视觉敏感度标识信息对所述视频数据包进行处理， 其 中所述视觉敏感度标识信息用于标识该视频数据包丟失后对终端画面的影响程 度。
15、 根据权利要求 14所述的视频流传输的系统， 其特征在于， 所述网络设 备包括：
第一网络设备， 用于接收所述视频数据包， 评估视频数据包并获得所述视 频数据包的视觉敏感度标识信息， 将所述视觉敏感度标识信息携带在视频流的 视频数据包中；
第二网络设备， 用于接收所述视频数据包， 并在接收到重传请求时， 根据 所述视觉敏感度标识信息对请求重传的视频数据包进行选择性重传。
16、 根据权利要求 15所述的视频流传输的系统， 其特征在于， 所述第一网 络设备还用于根据所述视觉敏感度标识信息对所述视频数据包进行选择性丟 弃。
17、 根据权利要求 14所述的视频流传输的系统， 其特征在于， 所述视频源 端还用于在接收到重传请求时， 根据所述视觉敏感度标识信息对请求重传的视 频数据包进行选择性重传。
PCT/CN2009/072190 2008-11-17 2009-06-09 视频流传输的方法、装置和系统 WO2010054551A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP09825726.4A EP2348730B1 (en) 2008-11-17 2009-06-09 Method, device and system for video stream transmission
US13/109,715 US8730800B2 (en) 2008-11-17 2011-05-17 Method, apparatus, and system for transporting video streams

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200810176542.9 2008-11-17
CN200810176542.9A CN101741752B (zh) 2008-11-17 2008-11-17 视频流传输的方法、装置和系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/109,715 Continuation US8730800B2 (en) 2008-11-17 2011-05-17 Method, apparatus, and system for transporting video streams

Publications (1)

Publication Number Publication Date
WO2010054551A1 true WO2010054551A1 (zh) 2010-05-20

Family

ID=42169617

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2009/072190 WO2010054551A1 (zh) 2008-11-17 2009-06-09 视频流传输的方法、装置和系统

Country Status (4)

Country Link
US (1) US8730800B2 (zh)
EP (1) EP2348730B1 (zh)
CN (1) CN101741752B (zh)
WO (1) WO2010054551A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110211416A (zh) * 2019-06-06 2019-09-06 泉州市华祥工业设计有限公司 物联网智能车库的信息传输方法及系统

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9350657B2 (en) * 2013-07-08 2016-05-24 Nicira, Inc. Encapsulating data packets using an adaptive tunnelling protocol
CN106330714B (zh) * 2015-07-02 2020-05-29 中兴通讯股份有限公司 一种实现业务功能链的方法和装置
CN109151612B (zh) 2017-06-27 2020-10-16 华为技术有限公司 一种视频传输方法、设备及系统
WO2019081021A1 (en) 2017-10-26 2019-05-02 Huawei Technologies Co., Ltd. DEVICE AND METHOD FOR DETECTING AND MITIGATING DIGITAL DATA NETWORK CONGESTION

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0701376A2 (en) * 1994-09-12 1996-03-13 AT&T IPM Corp. Method of and apparatus for video bitstream transmission over packet networks
CN1505888A (zh) * 2001-03-23 2004-06-16 �Ƚ�΢װ�ù�˾ 网络设备中的选择式数据帧丢失
CN1675931A (zh) * 2002-08-15 2005-09-28 皇家飞利浦电子股份有限公司 家庭多媒体传输方法和系统
CN1739101A (zh) * 2001-12-15 2006-02-22 汤姆森许可公司 用于以不同优先级传送多种数据类型的数据流的系统和方法
CN101077010A (zh) * 2004-12-15 2007-11-21 皇家飞利浦电子股份有限公司 用于通过无线网络的数字视频传输的方法和系统

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5510844A (en) 1994-11-18 1996-04-23 At&T Corp. Video bitstream regeneration using previously agreed to high priority segments
US6498865B1 (en) 1999-02-11 2002-12-24 Packetvideo Corp,. Method and device for control and compatible delivery of digitally compressed visual data in a heterogeneous communication network
CN1169325C (zh) * 2002-08-23 2004-09-29 清华大学 显式优先级信元中继方法和通信实现系统
US20070201365A1 (en) 2006-01-23 2007-08-30 Frederick Skoog Video packet multiplexer with intelligent packet discard
US7609709B2 (en) 2006-01-23 2009-10-27 Alcatel-Lucent Usa Inc. Video aware traffic management
US9025673B2 (en) * 2006-04-05 2015-05-05 Qualcomm Incorporated Temporal quality metric for video coding
US7848237B2 (en) 2007-01-18 2010-12-07 Ineoquest Technologies, Inc. System and method for selective packet discard for the transport of multiple transportation streams of streaming media in packet-based networks

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0701376A2 (en) * 1994-09-12 1996-03-13 AT&T IPM Corp. Method of and apparatus for video bitstream transmission over packet networks
CN1505888A (zh) * 2001-03-23 2004-06-16 �Ƚ�΢װ�ù�˾ 网络设备中的选择式数据帧丢失
CN1739101A (zh) * 2001-12-15 2006-02-22 汤姆森许可公司 用于以不同优先级传送多种数据类型的数据流的系统和方法
CN1675931A (zh) * 2002-08-15 2005-09-28 皇家飞利浦电子股份有限公司 家庭多媒体传输方法和系统
CN101077010A (zh) * 2004-12-15 2007-11-21 皇家飞利浦电子股份有限公司 用于通过无线网络的数字视频传输的方法和系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2348730A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110211416A (zh) * 2019-06-06 2019-09-06 泉州市华祥工业设计有限公司 物联网智能车库的信息传输方法及系统

Also Published As

Publication number Publication date
EP2348730B1 (en) 2014-04-30
CN101741752A (zh) 2010-06-16
CN101741752B (zh) 2015-08-19
US8730800B2 (en) 2014-05-20
EP2348730A4 (en) 2012-03-28
EP2348730A1 (en) 2011-07-27
US20110274121A1 (en) 2011-11-10

Similar Documents

Publication Publication Date Title
KR101644215B1 (ko) 신뢰성 있는 데이터 통신을 위한 네트워크 추상화 계층을 파싱하는 방법 및 장치
JP6067378B2 (ja) 再送決定する方法及び装置
US8717897B2 (en) Method and system for packet discard precedence for video transport
US11316799B2 (en) Method and apparatus for transmitting a multimedia data packet using cross-layer optimization
KR101757771B1 (ko) 상호 계층 최적화를 이용한 멀티미디어 데이터 패킷을 송신하는 방법 및 장치
EP3742746A1 (en) Method and device for realizing video service, and communication system and computer-readable storage medium
WO2012094998A1 (zh) 流媒体传输方法、系统与装置
WO2010054551A1 (zh) 视频流传输的方法、装置和系统
CN106100803A (zh) 用于作出重发决定的方法和装置
Shih et al. A transparent loss recovery scheme using packet redirection for wireless video transmissions

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09825726

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2009825726

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE