WO2012094998A1 - Method, system and device for transferring streaming media - Google Patents

Method, system and device for transferring streaming media Download PDF

Info

Publication number
WO2012094998A1
WO2012094998A1 PCT/CN2012/070215 CN2012070215W WO2012094998A1 WO 2012094998 A1 WO2012094998 A1 WO 2012094998A1 CN 2012070215 W CN2012070215 W CN 2012070215W WO 2012094998 A1 WO2012094998 A1 WO 2012094998A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
media stream
psi
information
adaptation
Prior art date
Application number
PCT/CN2012/070215
Other languages
French (fr)
Chinese (zh)
Inventor
刘继年
陈光亮
赵宇
王芳
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2012094998A1 publication Critical patent/WO2012094998A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/70Media network packetisation

Definitions

  • the present invention relates to the field of multimedia data transmission technologies, and in particular, to a method, system and device for streaming media transmission.
  • the streaming media server packs media content such as audio, video, subtitles or animation into a media stream, and the media stream is continuously transmitted in real time on the network in groups.
  • the client does not have to wait for the media content to be completely downloaded, and only needs to delay a few seconds or ten. Playback can be started in a few seconds, while the media stream is played and played until the media content is played or the client aborts.
  • Application of streaming media transmission technology can significantly shorten media playback latency and reduce client cache requirements.
  • the QoS type refers to various QoS mechanisms already provided by the underlying network of media transmission, and the QoS level refers to the magnitude of QoS.
  • QoS transmission is different from best-effort transmission, and transmission quality can be guaranteed.
  • the standards organization has defined the QoS mechanisms for Layer 2 and Layer 3 networks. Taking the traditional IPv4 packet as an example, the 8-bit TOS (Type of Service) field in the packet is used to specify the processing preference in the packet transmission process.
  • the RFC 791 divides the first three bits into eight priorities and can be applied. Traffic classification, which also provides services with different delays, throughput, and reliability for data packets; RFC 2474 redefines TOS and defines the first six bits as DSCP (Differential Services Code Point). Used to support up to 64 different kinds of traffic priority settings.
  • the technical problem to be solved by the present invention is to provide a streaming media transmission method, system and device to improve streaming media transmission quality.
  • the present invention provides a streaming media transmission method, the method comprising: a streaming media server sending a media stream, where the media transport layer priority information is carried;
  • the underlying network device or the media forwarding server receives the media stream, and performs mapping processing on the media transport layer priority information in the media stream according to a preset priority mapping policy;
  • the underlying network device or the media forwarding server processes the media stream according to the media transport layer priority information after the mapping process.
  • the media transport layer priority information in the media stream sent by the streaming media server includes one or more of the following: a data type priority, a service type priority, an encoding type priority, and an application layer user experience quality (QoE) mechanism priority. , Adaptation priority.
  • QoE application layer user experience quality
  • the transmission information part or the data part of the streaming media carries the media transport layer priority information.
  • the media stream sent by the streaming media server further carries the adaptation information, where the adaptation information includes an adaptation type and/or an adaptation priority, where the adaptation type includes reducing PSI transmission redundancy, packet loss processing, or filtering.
  • An enhancement layer where the media forwarding server performs an adaptation process according to the adaptation information.
  • the media stream received by the media forwarding server carries the adaptation information that reduces the PSI transmission redundancy. After receiving the media stream, the media forwarding server performs the following adaptation process:
  • the present invention also provides a streaming media transmission system, where the system includes a streaming media server and an underlying network device or a media forwarding server, where:
  • the streaming media server is configured to send a media stream, where the media transport layer priority information is carried;
  • the underlying network device or the media forwarding server includes:
  • a receiving module configured to receive the media stream
  • mapping processing module configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy
  • the media stream processing module is configured to process the media stream according to the media transport layer priority information after the mapping process.
  • the present invention also provides an underlying network device, including:
  • a receiving module configured to receive a media stream sent by the streaming media, where the media stream carries media transport layer priority information
  • mapping processing module configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy; and a media stream processing module configured to prioritize media transport layer according to mapping processing The level information processes the media stream.
  • the present invention also provides a media forwarding server, which includes:
  • a receiving module configured to receive a media stream sent by the streaming media, where the media stream carries media transport layer priority information
  • mapping processing module configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy; and a media stream processing module configured to prioritize media transport layer according to mapping processing The level information processes the media stream.
  • the above media forwarding server can also have the following features:
  • the media stream received by the media forwarding server carries adaptation information that reduces program specific information (PSI) transmission redundancy;
  • PSI program specific information
  • the media stream processing module includes:
  • Extracting a cache sub-module configured to: extract and cache PSI in the media stream according to the adaptation information; and update the cached PSI when detecting the PSI change
  • a forwarding submodule configured to: forward the processed media stream, and send the updated PSI to the client when the PSI changes are detected.
  • the present invention also provides another streaming media transmission method, the method comprising:
  • the streaming media server sends a media stream, where the media stream carries adaptation information that reduces PSI transmission redundancy;
  • the media forwarding server forwards the processed media stream, and when detecting the PSI change, updates the cached PSI, and sends the updated PSI to the client.
  • the media stream sent by the streaming media server further carries the packet loss processing or the adaptation information of the filtering enhancement layer, and the data stream forwarded by the media forwarding server is the adapted media stream.
  • the present invention also provides a streaming media transmission system, the system comprising a streaming media server and a media forwarding server, wherein:
  • a streaming media server configured to send a media stream, where the media stream carries adaptation information that reduces PSI transmission redundancy
  • the media forwarding server includes:
  • a receiving module configured to receive the media stream
  • Extracting a cache module configured to extract and cache the media stream according to the adaptation information
  • the forwarding module is configured to forward the processed media stream, and send the updated PSI to the client when the PSI change is detected.
  • the present invention also provides a media forwarding server, which includes:
  • a receiving module configured to receive a media stream sent by the streaming media server, the media stream carrying adaptation information that reduces program specific information (PSI) transmission redundancy; and an extraction buffer module configured to extract according to the adaptation information And buffering the media stream PSI; when the PSI change is detected, updating the cached PSI;
  • PSI program specific information
  • a forwarding module configured to forward the processed media stream and send the updated PSI to the client when the PSI change is detected.
  • the streaming media transmission method and the streaming media server sending media stream in the system carry priority information conforming to the media transport layer priority mechanism; in the network transmission process of the media stream, the underlying network or the media forwarding server performs the preset priority mapping policy. After the mapping process, the media stream is processed according to the priority information after the mapping process, thereby improving the media transmission efficiency.
  • FIG. 1 is a schematic diagram of an embodiment of a streaming media transmission method of the present invention
  • FIG. 2 is a block diagram showing the structure of an embodiment of a streaming media transmission system according to the present invention
  • FIG. 3 is a schematic structural diagram of a module of an embodiment of a media forwarding server according to the present invention.
  • FIG. 4 is a schematic diagram of a specific example of a communication system
  • FIG. 5 is a schematic diagram showing an example of a media packet structure
  • FIG. 6 is a schematic diagram showing an example of a media layer priority field structure
  • Figure 7 illustrates a processing flow of a streaming media forwarding server in an adapted embodiment for reducing PSI transmission redundancy
  • Figure 8 depicts a streaming media client endpoint broadcast procedure in an adapted embodiment that reduces PSI transmission redundancy.
  • embodiments of the present invention require media streams to provide comprehensive and direct media transport layer priority from top to bottom.
  • the level information quickly identifies the media stream processing priority for the underlying network (including the Layer 2 network or the Layer 3 network), and implements a direct mapping of the media transport layer priority to the underlying QoS mechanism level.
  • the streaming media server sends a media stream, and the media stream carries priority information that conforms to the media transport layer priority mechanism; in the network transmission process of the media stream, the underlying network or the media forwarding server is configured according to After the preset priority mapping policy is mapped, the media stream is processed according to the priority information after the mapping process, thereby improving the media transmission efficiency and obtaining the optimal media transmission effect.
  • a logical or physical device that provides a media transport layer forwarding function in a media stream transmission process is referred to as a media forwarding server.
  • the streaming media transmission method of the embodiment of the present invention includes:
  • Step 101 The streaming media server sends a media stream, where the media stream carries media transport layer priority information.
  • the media transport layer priority information in the media stream sent by the streaming media server includes but is not limited to the following media transport layer priority information: data type priority, service type priority, coding type priority, and application layer user experience quality (The priority of the mechanism and the priority of the adaptation are used. In the specific implementation, one of the media transport layer priority information or the plurality of media transport layer priority information may be used, which is not limited by the present invention.
  • the data information also known as the data type priority
  • the data type can be divided into at least three types of business data, program data, and media data.
  • the business data provides information such as the service provider, program type, program relationship, event, time, etc., such as Digital Video Broadcasting (DVB) service information (SI);
  • program data provides a single media Program information in the stream, Information such as the composition and relationship of the program, such as Program Specific Information (PSI) of the TS;
  • the media data includes media types such as a video stream, an audio stream, a subtitle stream, and a picture.
  • business information also known as business type priority
  • the service type Indicates the priority of the service type carried in the media stream packet. Different service types have different priorities when transmitting. According to the transmission characteristics including code rate, delay, buffering, jitter, and packet loss, the service type can be classified into at least IPTV live broadcast, IPTV on-demand, audio broadcast, video surveillance, visual communication, subtitle, etc. Not limited.
  • the encoding information also known as the encoding type priority
  • the media frame type is related to the encoding type.
  • the H264 video encoding can be divided into Instantaneous Decode Refresh (IDR), Intra, B, and P.
  • IDR Instantaneous Decode Refresh
  • B Intra
  • P P
  • SVC SVC encoding
  • the basic layer and the enhancement layer can be divided, and the MVC encoding can be performed. Divide the primary and secondary perspectives.
  • AppQoEtools information also known as the application layer QoE mechanism priority
  • QoE application layer user quality of experience
  • ARQ Automatic Repeat Requst
  • FEC Forward Error Correction
  • the adaptation information is also adapted to the priority
  • the adaptation process refers to the function of adapting the media layer transmission, such as SVC adaptation, service data, and program data. Match the media layer adaptation function.
  • the router performs packet loss processing on the media stream according to its own cache state; for example, at the application layer or the media transport layer, the media forwarding server performs a Scalable Video Coding (SVC) enhancement layer according to the underlying network condition. Filter, and so on.
  • SVC Scalable Video Coding
  • a transmission quantization level of each priority is established, and each specific type has a corresponding quantization value.
  • a rendering side of the transport layer priority The formula is to directly display the quantized values of various priorities, and the other way is to calculate a comprehensive value according to the quantized values of the respective priorities, and the calculation rule is not limited. Regardless of which of the above presentation methods is adopted, the underlying network does not need to know the media information, and can quickly map the streaming media transport layer priority mechanism to the underlying network QoS mechanism.
  • a streaming media packet carried on the underlying network usually consists of three parts: transmission information, load information, and data.
  • the media transport layer priority information may be placed in the transport information portion for carrying.
  • the MPEG-2 TS header or RTP header is extended to carry the media transport layer priority in an extension field.
  • the media transport layer priority information may also be carried in the data part, for example, extending the PSI of the MPEG-2 TS, and carrying the media transport layer priority in the PSI extended data. level.
  • the media transport layer priority is carried by the transport information portion only in the exceptional case.
  • Step 102 The underlying network device or the media forwarding server receives the media stream, and performs mapping processing on the priority information in the media stream according to a preset priority mapping policy.
  • the underlying network device reads the media transport layer priority information from the media stream, and quickly maps to the underlying network QoS priority according to the mapping policy.
  • the media forwarding server (such as the network internal forwarding server or the network edge forwarding server) identifies the media transmission layer priority information, and quickly maps to the corresponding forwarding priority according to the mapping policy.
  • the mapping policy synthesizes various types of information in the media transmission priority mechanism, and different QoS mechanisms can capture different mapping strategies.
  • the media transmission priority of the media stream remains unchanged during the transmission process, which can well support the network to use different QoS transmission mechanisms and levels.
  • Step 103 The underlying network device or the media forwarding server processes the media stream according to the mapping priority information.
  • the media stream sent by the streaming media server further carries the adaptation information.
  • the adaptation information includes an adaptation type and/or an adaptation priority, where the adaptation type includes a PSI transmission redundancy reduction, a packet loss processing, or a filtering enhancement layer, and the media forwarding server performs the adaptation according to the adaptation information. With processing.
  • the media forwarding server performs the following adaptation process:
  • the present invention further provides a streaming media transmission system.
  • the system includes a streaming media server, an underlying network device, or a media forwarding server, where:
  • a streaming media server configured to send a media stream, where the media stream carries media transport layer priority information
  • the underlying network device or media forwarding server includes:
  • a receiving module configured to receive the media stream
  • mapping processing module configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy
  • the media stream processing module is configured to process the media stream according to the media transport layer priority information after the mapping process.
  • the media transport layer priority information in the media stream sent by the streaming media server includes one or more of the following: a data type priority, a service type priority, an encoding type priority, and an application layer user experience quality (QoE). ) Mechanism priority, adaptation priority. Each priority information is as described above.
  • the transmission information part or the data part of the streaming media carries the media transport layer priority information.
  • the media stream sent by the streaming media server further carries the adaptation information, where the adaptation information includes an adaptation type and/or an adaptation priority, where the adaptation type includes reducing PSI transmission redundancy and packet loss processing. Or filtering the enhancement layer, and the media forwarding server performs an adaptation process according to the adaptation information.
  • the media stream processing module of the media forwarding server includes:
  • Extracting a cache submodule configured to extract and cache the media stream according to the adaptation information
  • the forwarding submodule is configured to forward the processed media stream, and when detecting the PSI change, send the updated PSI to the client.
  • Fig. 4 shows a specific example of a communication system in which the network 1 includes a streaming media server 10, a router 11, a router 12a and a media forwarding server 12b, the network 2 includes a router 13, and the network 3 includes a router 14.
  • the communication system is used for network transmission and forwarding of packet data such as audio, video, subtitles, and data.
  • the communication system network layer uses the IP protocol, and the data link layer uses DWDM or ATM.
  • the forwarding steps of the media stream in the communication system are as follows:
  • Step A In the network 1, the streaming server 10 outputs various media streams in real time.
  • FIG. 5 shows an example of a media packet structure in which the media transport format uses MPEG-TS and the QoS mechanism uses Diff-Serv.
  • the media packet consists of four parts: IPv4 header, TS header, PES header and media data.
  • the ToS field in the IPv4 header is used to differentiate services (Different Services, Diff-Serv).
  • Diff-Serv Different Services
  • the value of the ToS field changes during media streaming, and the router assigns different Diff-Servs.
  • the transport layer priority field in the TS header is an extension field, and the extension method follows the TS standard. Used to carry the priority described in the present invention.
  • One way to present the priority of the transport layer is to directly display the quantized values of each dimension.
  • the other way to present is to calculate a composite value based on the quantized values of each dimension.
  • the priority presentation method for calculating the integrated value is very simple, and only the media layer priority field needs to support a certain quantization level, for example, the 8-bit length supports the quantization level of 0-255. It is slightly more complicated to capture the representation of the quantized values of each dimension, and the domain needs to be further divided in the media layer priority field.
  • Fig. 6 shows an example of a structure of a media layer priority field that exhibits quantized values for each dimension amount.
  • An example media layer priority field is composed of six fields, namely: a data information field, a service information field, an encoded information field, an AppQoEtools domain, an adaptation information domain, and a reserved domain.
  • the length of the media layer priority field is 32 bits.
  • the first four fields occupy 4 bits, the range of field values is 0-15, and the corresponding priority is from low to high.
  • the adaptation information field occupies 8 bits.
  • the first 4 bits are priority bits. 0-15, the corresponding priority is from low to high, the last 4 bits are type bits, the field value range is 0-15, corresponding to the adaptation type; one domain of the reserved domain occupies 8 bits.
  • a media layer priority field of an IPTV multicast live stream providing Forward Error Correction (FEC), which is a Scalable Video Codeing (SVC) grading is as follows:
  • Service Information Domain Give priority to IPTV live broadcast 1 ;
  • the coded information field assigns priority 0 to the IDR of the video SVC base layer, priority 1 to the non IDR of the video SVC base layer, and priority 2 to the IDR of the video S VC enhancement layer, which is the non IDR of the video SVC enhancement layer. Give priority 3;
  • AppQoEtools domain The priority of the FEC mechanism is 2;
  • the adaptation type is to reduce PSI transmission redundancy, and the priority is 0;
  • Step B The media stream flows through the router 11.
  • the router 11 applies the Diff-serv to the media stream, applies the local policy to map the media layer priority field of the media stream to the ToS field of the IPv4 packet header, and then transmits the media stream QoS to the router 12a.
  • Step C After receiving the media stream, the router 12a performs mapping processing and forwards the packet to the media forwarding server 12b of the same node.
  • the media forwarding server 12b performs mapping processing and media layer adaptation according to the characteristics of the network 2 and the network 3.
  • the matched media streams are QoS transmitted to the router 13 of the network 2 and the router 14 of the network 3 via the router 12a.
  • the router 12a can execute a new Diff-serv policy, apply a local policy to change the ToS value of the media stream IP header, or apply other QoS mechanisms, such as applying a local policy to map the media layer priority to a multi-protocol label switching (Multi-Protocol). Label Switching, MPLS ).
  • Multi-Protocol Multi-Protocol. Label Switching
  • Step D The router 13 transmits the media stream QoS to the network nodes 15a and 15b, and the router 14 transmits the media stream QoS to the network nodes 15d and 15e for media playback.
  • Example of media layer adaptation 1 Example of media layer adaptation 1 :
  • the media video encoding type uses SVC.
  • the streaming media server 10 outputs the spatial domain-classified SVC video stream, where the SVC base layer size is QVGA and the SVC enhancement layer size is VAG.
  • the network 2 is oriented to mobile handheld devices such as 15a and 15b, and the video resolution is QVGA; the network 3 is for PCs and TVs such as 15d and 15e, and the video resolution is VGA.
  • the media forwarding server 12b carries the SVC adaptation indication according to the adaptation priority information of the media stream, and filters the S VC enhancement stream in the video stream for the network 2, and does not perform any adaptation processing for the network 3.
  • the PSI transmission redundancy is reduced, and the media forwarding server identifies the adaptation information field in the media stream, filters the media packet from the media stream, caches it locally, and maintains the update.
  • the cached PSI is sent only when the client 15c joins the multicast live broadcast or the PSI changes.
  • Figure 7 and Figure 8 give a detailed description of the process flow.
  • FIG. 7 depicts the processing flow of a streaming media forwarding server in an adapted embodiment for reducing PSI redundant information transmission in MPEG-TS. The process is as follows:
  • Step 701 The streaming media server 10 sends the multicast media stream with the original PSI in the above example.
  • Step 703 The media forwarding server 12b filters (ie, extracts) the original PSI in the media stream, and caches it locally.
  • Step 704 The media forwarding server 12b applies another media transmission adaptation policy.
  • the SVC enhanced flow in the video stream is filtered out for the network 2, where PSI update may be involved herein;
  • Step 705 the media forwarding server 12b detects whether the PSI changes, if the change is performed, step 706, otherwise step 708;
  • Step 706 The media forwarding server 12b caches the changed PSI.
  • Step 707 The media forwarding server 12b sends the updated PSI.
  • Step 708 The media forwarding server 12b forwards the adapted media stream.
  • Figure 8 depicts a streaming media client endpoint broadcast procedure in an adapted embodiment that reduces PSI transmission redundancy. The process is as follows:
  • Step 801 The client 15c selects an IPTV multicast live broadcast.
  • Step 802 The client 15c joins the multicast group.
  • Step 803 the router 12a notifies the media forwarding server 12b;
  • Step 804 The media forwarding server 12b sends the buffered PSI.
  • Step 805 The client 15c initializes the decoding resource according to the PSI.
  • Step 806 the media forwarding server 12b performs other media adaptation, and forwards the code stream to the router 12a, and the router 12a forwards the media stream to the client 15c;
  • Step 807 The client 15c decodes and presents the received multicast media stream.
  • the above process is an implementation of an adaptation method for reducing PSI transmission redundancy, and any method for reducing redundant information transmission in a TS stream or the like by using the design idea and any equivalent transformation thereof belongs to the present invention. protected range.
  • the embodiment of the present invention further provides another streaming media transmission method, where the method focuses on the adaptation of the media forwarding server according to the adaptation information, which specifically includes:
  • the streaming media server sends a media stream, where the media stream carries adaptation information that reduces PSI transmission redundancy;
  • the media forwarding server receives, by the media forwarding server, the media stream, and extracting and buffering the PSI in the media stream according to the adaptation information;
  • the media forwarding server forwards the processed media stream, and when detecting the PSI change, updates the cached PSI, and sends the updated PSI to the client.
  • the media stream sent by the streaming media server may also carry the packet loss processing or the adaptation information of the filtering enhancement layer, and the data stream forwarded by the media forwarding server is the adapted media stream.
  • the present invention also provides another streaming media transmission system, the system comprising a streaming media server and a media forwarding server, wherein:
  • a streaming media server configured to send a media stream, where the media stream carries adaptation information that reduces PSI transmission redundancy
  • the media forwarding server includes:
  • a receiving module configured to receive the media stream
  • Extracting a cache module configured to extract and cache the media stream according to the adaptation information
  • the forwarding module is configured to forward the processed media stream, and send the updated PSI to the client when the PSI change is detected.
  • the media stream sent by the streaming media server further carries the packet loss processing or the filtering enhancement layer adaptation information, and the data forwarding packet forwarded by the media forwarding server is the adapted media stream.
  • the streaming media transmission method and system proposed by the present invention proposes a new media transport layer priority mechanism, which establishes a fast mapping of the media transport layer priority to the underlying network priority, and supports media adaptation in the media forwarding network. Supports various underlying QoS transport mechanisms, which can effectively improve the quality of streaming media transmission. It should be noted that the specific embodiments in the present invention are merely enumerating individual examples of the present invention, and the streaming media transmission method and system using the design idea of the present invention and any equivalent transformation thereof are all within the scope of protection of the present invention. .
  • the streaming media server sends a media stream carrying priority information conforming to the media transport layer priority mechanism; in the network transmission process of the media stream, the underlying network or the media forwarding server according to the preset priority After the mapping policy is mapped, the media stream is processed according to the priority information after the mapping process, thereby improving media transmission efficiency.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention relates to a method, system and device for transferring streaming media, wherein the method includes: sending, by a streaming media server, media stream carrying priority information about the media transfer layer; receiving, by an underlying network device or a media forwarding server, the media stream and carrying out mapping processing on the priority information about the media transfer layer in the media stream according to a preset priority mapping policy; carrying out, by the underlying network device or the media forwarding server, processing on the media stream according to the priority information about the media transfer layer after the mapping processing. By using the method and system for transferring streaming media according to the present invention, the transmission quality of streaming media can be improved effectively.

Description

流媒体传输方法、 系统与装置  Streaming media transmission method, system and device
技术领域 Technical field
本发明涉及多媒体数据传输技术领域,具体涉及一种流媒体传输的方法、 系统与装置。  The present invention relates to the field of multimedia data transmission technologies, and in particular, to a method, system and device for streaming media transmission.
背景技术 Background technique
随着网络技术的普及和多媒体技术的广泛应用, 对音频、 视频、 字幕或 动画等多媒体内容进行实时传送的流媒体传输技术应运而生。  With the popularization of network technologies and the wide application of multimedia technologies, streaming media transmission technology for real-time transmission of multimedia content such as audio, video, subtitles or animation has emerged.
流媒体服务器把音频、 视频、 字幕或动画等媒体内容打包为媒体流, 媒 体流以分组的形式在网络上进行实时连续传输, 客户端不必等待媒体内容全 部下载完毕, 只需延迟几秒或十几秒就可以开始播放, 媒体流边传输边播放 直到媒体内容播放完毕或客户端中止操作。 应用流媒体传输技术, 可以显著 缩短媒体播放等待时间、 降低客户端緩存要求。  The streaming media server packs media content such as audio, video, subtitles or animation into a media stream, and the media stream is continuously transmitted in real time on the network in groups. The client does not have to wait for the media content to be completely downloaded, and only needs to delay a few seconds or ten. Playback can be started in a few seconds, while the media stream is played and played until the media content is played or the client aborts. Application of streaming media transmission technology can significantly shorten media playback latency and reduce client cache requirements.
在流媒体传输过程中支持不同的 QoS ( Quality of Service, 服务质量)类 型和等级。 QoS类型是指媒体传输底层网络现已提供的各种 QoS机制, QoS 等级是指 QoS程度量值。 QoS传输有别于尽力而为的传输, 传输质量可以得 到保证。标准组织已经定义了二层网络和三层网络的 QoS机制。以传统的 IPv4 分组为例, 分组中 8bit的 TOS ( Type of Service, 业务类型)字段用来指定分 组传输过程中的处理优选权, RFC 791对前三位划分成了 8个优先级可以应 用于流分类, 另外还对数据包提供不同时延、 吞吐量和可靠性的服务; RFC 2474对 TOS进行了重新的定义,把前六位定义成 DSCP( Differentiated Services Code Point, 差分服务代码点) , 用于支持多达 64种不同种类的流量优先级 设置。  Different QoS (Quality of Service) types and levels are supported during streaming media transmission. The QoS type refers to various QoS mechanisms already provided by the underlying network of media transmission, and the QoS level refers to the magnitude of QoS. QoS transmission is different from best-effort transmission, and transmission quality can be guaranteed. The standards organization has defined the QoS mechanisms for Layer 2 and Layer 3 networks. Taking the traditional IPv4 packet as an example, the 8-bit TOS (Type of Service) field in the packet is used to specify the processing preference in the packet transmission process. The RFC 791 divides the first three bits into eight priorities and can be applied. Traffic classification, which also provides services with different delays, throughput, and reliability for data packets; RFC 2474 redefines TOS and defines the first six bits as DSCP (Differential Services Code Point). Used to support up to 64 different kinds of traffic priority settings.
但这种 QoS机制仅适用于二层网络和三层网络, 并不能从根本上提升用 户体验。 发明内容 本发明要解决的技术问题是提供一种流媒体传输方法、 系统和装置, 以 提升流媒体传输质量。 However, this QoS mechanism is only applicable to Layer 2 networks and Layer 3 networks, and does not fundamentally improve the user experience. Summary of the invention The technical problem to be solved by the present invention is to provide a streaming media transmission method, system and device to improve streaming media transmission quality.
为解决以上技术问题, 本发明提供了一种流媒体传输方法, 该方法包括: 流媒体服务器发送媒体流, 其中携带媒体传输层优先级信息;  To solve the above technical problem, the present invention provides a streaming media transmission method, the method comprising: a streaming media server sending a media stream, where the media transport layer priority information is carried;
底层网络设备或媒体转发服务器接收所述媒体流, 根据预置的优先级映 射策略对所述媒体流中的媒体传输层优先级信息进行映射处理;  The underlying network device or the media forwarding server receives the media stream, and performs mapping processing on the media transport layer priority information in the media stream according to a preset priority mapping policy;
所述底层网络设备或媒体转发服务器根据映射处理后的媒体传输层优先 级信息对所述媒体流进行处理。  The underlying network device or the media forwarding server processes the media stream according to the media transport layer priority information after the mapping process.
上述方法还可具有以下特点:  The above method can also have the following characteristics:
所述流媒体服务器发送的媒体流中的媒体传输层优先级信息包括以下一 个或多个: 数据类型优先级、 业务类型优先级、 编码类型优先级、 应用层用 户体验质量(QoE )机制优先级、 适配优先级。  The media transport layer priority information in the media stream sent by the streaming media server includes one or more of the following: a data type priority, a service type priority, an encoding type priority, and an application layer user experience quality (QoE) mechanism priority. , Adaptation priority.
上述方法还可具有以下特点:  The above method can also have the following characteristics:
所述流媒体的传输信息部分或数据部分携带所述媒体传输层优先级信 息。  The transmission information part or the data part of the streaming media carries the media transport layer priority information.
上述方法还可具有以下特点:  The above method can also have the following characteristics:
所述流媒体服务器发送的媒体流中还携带适配信息, 所述适配信息包括 适配类型和 /或适配优先级, 所述适配类型包括降低 PSI传输冗余、 丟包处理 或过滤增强层, 所述媒体转发服务器根据所述适配信息进行适配处理。  The media stream sent by the streaming media server further carries the adaptation information, where the adaptation information includes an adaptation type and/or an adaptation priority, where the adaptation type includes reducing PSI transmission redundancy, packet loss processing, or filtering. An enhancement layer, where the media forwarding server performs an adaptation process according to the adaptation information.
上述方法还可具有以下特点:  The above method can also have the following characteristics:
所述媒体转发服务器接收的媒体流中携带降低 PSI传输冗余的适配信息; 媒体转发服务器接收所述媒体流后, 执行以下适配处理:  The media stream received by the media forwarding server carries the adaptation information that reduces the PSI transmission redundancy. After receiving the media stream, the media forwarding server performs the following adaptation process:
根据所述适配信息提取并緩存所述媒体流中的 PSI;  Extracting and buffering PSI in the media stream according to the adaptation information;
转发处理后的媒体流, 且检测到所述 PSI变化时, 更新緩存的 PSI, 并向 客户端发送更新的 PSI。  Forwarding the processed media stream, and detecting the PSI change, updating the cached PSI, and sending the updated PSI to the client.
为解决以上技术问题, 本发明还提供了一种流媒体传输系统, 该系统包 括流媒体服务器以及底层网络设备或媒体转发服务器, 其中: 流媒体服务器, 设置为发送媒体流, 其中携带媒体传输层优先级信息; 底层网络设备或媒体转发服务器包括: To solve the above technical problem, the present invention also provides a streaming media transmission system, where the system includes a streaming media server and an underlying network device or a media forwarding server, where: The streaming media server is configured to send a media stream, where the media transport layer priority information is carried; the underlying network device or the media forwarding server includes:
接收模块, 设置为接收所述媒体流;  a receiving module, configured to receive the media stream;
映射处理模块, 设置为根据预置的优先级映射策略对所述媒体流中的媒 体传输层优先级信息进行映射处理;  a mapping processing module, configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy;
媒体流处理模块, 设置为根据映射处理后的媒体传输层优先级信息对所 述媒体流进行处理。  The media stream processing module is configured to process the media stream according to the media transport layer priority information after the mapping process.
本发明还提供一种底层网络设备, 其包括:  The present invention also provides an underlying network device, including:
接收模块, 其设置为接收流媒体发送的媒体流, 所述媒体流中携带媒体 传输层优先级信息;  a receiving module, configured to receive a media stream sent by the streaming media, where the media stream carries media transport layer priority information;
映射处理模块, 其设置为根据预置的优先级映射策略对所述媒体流中的 媒体传输层优先级信息进行映射处理; 以及 媒体流处理模块, 其设置为根据映射处理后的媒体传输层优先级信息对 所述媒体流进行处理。  a mapping processing module, configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy; and a media stream processing module configured to prioritize media transport layer according to mapping processing The level information processes the media stream.
本发明还提供一种媒体转发服务器, 其包括:  The present invention also provides a media forwarding server, which includes:
接收模块, 其设置为接收流媒体发送的媒体流, 所述媒体流中携带媒体 传输层优先级信息;  a receiving module, configured to receive a media stream sent by the streaming media, where the media stream carries media transport layer priority information;
映射处理模块, 其设置为根据预置的优先级映射策略对所述媒体流中的 媒体传输层优先级信息进行映射处理; 以及 媒体流处理模块, 其设置为根据映射处理后的媒体传输层优先级信息对 所述媒体流进行处理。  a mapping processing module, configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy; and a media stream processing module configured to prioritize media transport layer according to mapping processing The level information processes the media stream.
上述媒体转发服务器还可具有以下特点:  The above media forwarding server can also have the following features:
所述媒体转发服务器接收的媒体流中携带降低节目特定信息 ( PSI )传输 冗余的适配信息;  The media stream received by the media forwarding server carries adaptation information that reduces program specific information (PSI) transmission redundancy;
所述媒体流处理模块包括:  The media stream processing module includes:
提取緩存子模块, 其设置为: 根据所述适配信息提取并緩存所述媒体流 中的 PSI; 且检测到所述 PSI变化时, 更新緩存的 PSI, 以及 转发子模块, 其设置为: 转发处理后的媒体流, 且检测到所述 PSI变化 时, 向客户端发送更新的 PSI。 Extracting a cache sub-module, configured to: extract and cache PSI in the media stream according to the adaptation information; and update the cached PSI when detecting the PSI change, and And a forwarding submodule, configured to: forward the processed media stream, and send the updated PSI to the client when the PSI changes are detected.
为降低 PSI传输冗余, 本发明还提供了另一种流媒体传输方法, 该方法 包括:  To reduce PSI transmission redundancy, the present invention also provides another streaming media transmission method, the method comprising:
流媒体服务器发送媒体流, 所述媒体流携带降低 PSI传输冗余的适配信 息;  The streaming media server sends a media stream, where the media stream carries adaptation information that reduces PSI transmission redundancy;
媒体转发服务器接收所述媒体流, 根据所述适配信息提取并緩存所述媒 体流中的 PSI;  Receiving, by the media forwarding server, the media stream, and extracting and buffering the PSI in the media stream according to the adaptation information;
所述媒体转发服务器转发处理后的媒体流, 且检测到所述 PSI变化时, 更新緩存的 PSI, 并向客户端发送更新的 PSI。  The media forwarding server forwards the processed media stream, and when detecting the PSI change, updates the cached PSI, and sends the updated PSI to the client.
上述方法还可具有以下特点:  The above method can also have the following characteristics:
所述流媒体服务器发送的媒体流中还携带丟包处理或过滤增强层的适配 信息, 所述媒体转发服务器转发的数据流是经过适配处理后的媒体流。  The media stream sent by the streaming media server further carries the packet loss processing or the adaptation information of the filtering enhancement layer, and the data stream forwarded by the media forwarding server is the adapted media stream.
对应于以上方法, 本发明还提供了一种流媒体传输系统, 该系统包括流 媒体服务器和媒体转发服务器, 其中:  Corresponding to the above method, the present invention also provides a streaming media transmission system, the system comprising a streaming media server and a media forwarding server, wherein:
流媒体服务器, 设置为发送媒体流, 所述媒体流携带降低 PSI传输冗余 的适配信息;  a streaming media server, configured to send a media stream, where the media stream carries adaptation information that reduces PSI transmission redundancy;
媒体转发服务器包括:  The media forwarding server includes:
接收模块, 设置为接收所述媒体流;  a receiving module, configured to receive the media stream;
提取緩存模块, 设置为根据所述适配信息提取并緩存所述媒体流中的 Extracting a cache module, configured to extract and cache the media stream according to the adaptation information
PSI; 检测到所述 PSI变化时, 更新緩存的 PSI; PSI; when the PSI change is detected, updating the cached PSI;
转发模块, 设置为转发处理后的媒体流, 并在检测到所述 PSI变化时向 客户端发送更新的 PSI。  The forwarding module is configured to forward the processed media stream, and send the updated PSI to the client when the PSI change is detected.
本发明还提供一种媒体转发服务器, 其包括:  The present invention also provides a media forwarding server, which includes:
接收模块, 其设置为接收流媒体服务器发送的媒体流, 所述媒体流携带 降低节目特定信息 (PSI )传输冗余的适配信息; 以及 提取緩存模块, 其设置为根据所述适配信息提取并緩存所述媒体流中的 PSI; 检测到所述 PSI变化时, 更新緩存的 PSI; a receiving module, configured to receive a media stream sent by the streaming media server, the media stream carrying adaptation information that reduces program specific information (PSI) transmission redundancy; and an extraction buffer module configured to extract according to the adaptation information And buffering the media stream PSI; when the PSI change is detected, updating the cached PSI;
转发模块, 其设置为转发处理后的媒体流, 并在检测到所述 PSI变化时 向客户端发送更新的 PSI。  And a forwarding module configured to forward the processed media stream and send the updated PSI to the client when the PSI change is detected.
上述流媒体传输方法与系统中流媒体服务器发送媒体流携带符合媒体传 输层优先级机制的优先级信息; 在媒体流的网络传输过程中, 底层网络或者 媒体转发服务器根据预置的优先级映射策略进行映射处理后, 再根据映射处 理后的优先级信息对媒体流进行处理, 从而提升媒体传输效率。 The streaming media transmission method and the streaming media server sending media stream in the system carry priority information conforming to the media transport layer priority mechanism; in the network transmission process of the media stream, the underlying network or the media forwarding server performs the preset priority mapping policy. After the mapping process, the media stream is processed according to the priority information after the mapping process, thereby improving the media transmission efficiency.
附图概述 BRIEF abstract
图 1是本发明流媒体传输方法实施例的示意图;  1 is a schematic diagram of an embodiment of a streaming media transmission method of the present invention;
图 2是本发明流媒体传输系统实施例的模块结构示意图;  2 is a block diagram showing the structure of an embodiment of a streaming media transmission system according to the present invention;
图 3是本发明媒体转发服务器实施例的模块结构示意图;  3 is a schematic structural diagram of a module of an embodiment of a media forwarding server according to the present invention;
图 4是一个通信系统的具体实例示意图;  4 is a schematic diagram of a specific example of a communication system;
图 5是媒体分组结构示例示意图;  FIG. 5 is a schematic diagram showing an example of a media packet structure;
图 6是一个媒体层优先级字段结构示例示意图;  6 is a schematic diagram showing an example of a media layer priority field structure;
图 7描述降低 PSI传输冗余的适配实施例中流媒体转发服务器的处理流 程;  Figure 7 illustrates a processing flow of a streaming media forwarding server in an adapted embodiment for reducing PSI transmission redundancy;
图 8描述降低 PSI传输冗余的适配实施例中流媒体客户端点播流程。  Figure 8 depicts a streaming media client endpoint broadcast procedure in an adapted embodiment that reduces PSI transmission redundancy.
本发明的较佳实施方式 Preferred embodiment of the invention
面临跨网络及异构网络的流媒体应用新场景, 为了提升最终用户体验必 须提升流媒体传输质量, 本发明的实施方式在要求媒体流能够自上而下提供 综合的和直接的媒体传输层优先级信息, 为底层网络(包括二层网络或三层 网络)快速识别出媒体流处理优先权, 实现媒体传输层优先级到底层 QoS机 制等级的直接映射。  In the new scenario of streaming media applications across networks and heterogeneous networks, in order to improve the quality of streaming media transmission in order to improve the end user experience, embodiments of the present invention require media streams to provide comprehensive and direct media transport layer priority from top to bottom. The level information quickly identifies the media stream processing priority for the underlying network (including the Layer 2 network or the Layer 3 network), and implements a direct mapping of the media transport layer priority to the underlying QoS mechanism level.
相关流媒体传输协议中,比如,标准组织 IETF的实时传输协议(Real-time Transport protocol, RTP )的 RTP 固定包头(Fix Header )和 RTP负载包头均 没有携带优先级信息; 标准组织 ISO 的运动图像专家组 (Moving Pictures Experts Group, MPEG-2 )传输流( Transport Stream, TS )只定义一个 bit的 优先级标识, 所提供信息不足实现上述要求。 以下对本发明进行说明。 In related streaming media transmission protocols, for example, the real-time transport protocol of the standard organization IETF (Real-time) Transport Protocol, RTP) RTP Fixed Header and RTP Load Header do not carry priority information; Standard Organization ISO Moving Pictures Experts Group (MPEG-2) Transport Stream (TS) Only one bit of the priority identifier is defined, and the information provided is insufficient to achieve the above requirements. The invention is described below.
本发明实施方式的流媒体传输方法与系统, 流媒体服务器发送媒体流, 媒体流携带符合媒体传输层优先级机制的优先级信息; 在媒体流的网络传输 过程中, 底层网络或者媒体转发服务器根据预置的优先级映射策略进行映射 处理后, 再根据映射处理后的优先级信息对媒体流进行处理, 从而提升媒体 传输效率, 取得最佳媒体传输效果。  In the streaming media transmission method and system of the embodiment of the present invention, the streaming media server sends a media stream, and the media stream carries priority information that conforms to the media transport layer priority mechanism; in the network transmission process of the media stream, the underlying network or the media forwarding server is configured according to After the preset priority mapping policy is mapped, the media stream is processed according to the priority information after the mapping process, thereby improving the media transmission efficiency and obtaining the optimal media transmission effect.
本发明实施方式中, 把媒体流传输过程中提供媒体传输层转发功能的逻 辑或者物理设备称为媒体转发服务器,  In the embodiment of the present invention, a logical or physical device that provides a media transport layer forwarding function in a media stream transmission process is referred to as a media forwarding server.
下文中将结合附图对本发明的实施例进行详细说明。 需要说明的是, 在 不冲突的情况下, 本申请中的实施例及实施例中的特征可以相互组合。  Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.
如图 1所示, 本发明实施例的流媒体传输方法包括:  As shown in FIG. 1, the streaming media transmission method of the embodiment of the present invention includes:
步骤 101 : 流媒体服务器发送媒体流, 所述媒体流携带媒体传输层优先 级信息;  Step 101: The streaming media server sends a media stream, where the media stream carries media transport layer priority information.
所述流媒体服务器发送的媒体流中的媒体传输层优先级信息包括但不限 于以下媒体传输层优先级信息: 数据类型优先级、 业务类型优先级、 编码类 型优先级、 应用层用户体验质量(QoE )机制优先级、 适配优先级, 具体实 现时, 可以釆用其中一种媒体传输层优先级信息或多种媒体传输层优先级信 息, 本发明不做限定。  The media transport layer priority information in the media stream sent by the streaming media server includes but is not limited to the following media transport layer priority information: data type priority, service type priority, coding type priority, and application layer user experience quality ( The priority of the mechanism and the priority of the adaptation are used. In the specific implementation, one of the media transport layer priority information or the plurality of media transport layer priority information may be used, which is not limited by the present invention.
以下对各种媒体传输层优先级信息进行说明:  The following describes the various media transport layer priority information:
一、 数据信息 (也称数据类型优先级)  First, the data information (also known as the data type priority)
指示承载在媒体流分组的数据类型优先级, 不同数据类型在传输时具有 不同的优先级。 数据类型至少可以划分为业务数据、 节目数据、 媒体数据三 类, 更多补充不限。 其中, 业务数据提供 Λ良务商、 节目类型、 节目的相互关 系、 事件、 时间等信息, 例如数字视频广播 (Digital Video Broadcasting, DVB) 的业务信息 (Service Information, SI);节目数据提供单个媒体流中的节目信息、 节目的组成以及相互关系等信息, 例如 TS的节目特定信息 (Program Specific Information, PSI); 媒体数据包括视频流、 音频流、 字幕流、 图片等媒体类型。 Indicates the priority of the data type carried in the media stream packet, and the different data types have different priorities when transmitting. The data type can be divided into at least three types of business data, program data, and media data. Among them, the business data provides information such as the service provider, program type, program relationship, event, time, etc., such as Digital Video Broadcasting (DVB) service information (SI); program data provides a single media Program information in the stream, Information such as the composition and relationship of the program, such as Program Specific Information (PSI) of the TS; the media data includes media types such as a video stream, an audio stream, a subtitle stream, and a picture.
二、 业务信息, 也称业务类型优先级  Second, business information, also known as business type priority
指示承载在媒体流分组的业务类型优先级, 不同业务类型在传输时具有 不同的优先级。 根据传输(traffic )特征包括码率、 时延、 緩冲、 抖动、 丟包, 业务类型至少可以划分为 IPTV直播、 IPTV点播、 音频广播、 视频监控、 可 视通信、 字幕等类型, 更多补充不限。  Indicates the priority of the service type carried in the media stream packet. Different service types have different priorities when transmitting. According to the transmission characteristics including code rate, delay, buffering, jitter, and packet loss, the service type can be classified into at least IPTV live broadcast, IPTV on-demand, audio broadcast, video surveillance, visual communication, subtitle, etc. Not limited.
三、 编码信息, 也称编码类型优先级  Third, the encoding information, also known as the encoding type priority
指示承载在媒体流分组的媒体帧类型优先级, 不同媒体帧类型在传输时 具有不同的优先级。媒体帧类型与编码类型相关, 例如对 H264视频编码, 可 以划分为瞬时解码刷新 (Instantaneous Decode Refresh, IDR)、 Intra, B、 P, 对 于 SVC编码,可以划分基本层和增强层,对 MVC编码可以划分主次视角等。  Indicates the priority of the media frame type carried in the media stream packet, and different media frame types have different priorities when transmitting. The media frame type is related to the encoding type. For example, the H264 video encoding can be divided into Instantaneous Decode Refresh (IDR), Intra, B, and P. For SVC encoding, the basic layer and the enhancement layer can be divided, and the MVC encoding can be performed. Divide the primary and secondary perspectives.
四、应用层 QoE机制信息, 简称 AppQoEtools信息, 也称应用层 QoE机 制优先级  Fourth, the application layer QoE mechanism information, referred to as AppQoEtools information, also known as the application layer QoE mechanism priority
指示承载在媒体流分组的应用层用户体验质量 (quality of experience , QoE) 机制优先级, 不同应用层 QoE机制类型在传输时具有不同的优先级。 包括但 不限于现有的 QoE机制, 例如自动重传 ( Automatic Repeat Requst, ARQ ) , 前向纠错 ( Forward Error Correction, FEC )等。  Indicates the application layer user quality of experience (QoE) mechanism priority that is carried in the media stream packet. Different application layer QoE mechanism types have different priorities when transmitting. Including but not limited to existing QoE mechanisms, such as Automatic Repeat Requst (ARQ), Forward Error Correction (FEC), etc.
五、 适配信息, 也成适配优先级  Fifth, the adaptation information is also adapted to the priority
指示承载在媒体流分组的媒体层适配优先级, 不同的适配处理对应不同 的优先级, 适配处理指对媒体层传输进行适配的功能, 例如 SVC适配、 业务 数据和节目数据适配等媒体层适配功能。  Indicates the media layer adaptation priority of the media stream packet, and the different adaptation processes correspond to different priorities. The adaptation process refers to the function of adapting the media layer transmission, such as SVC adaptation, service data, and program data. Match the media layer adaptation function.
在媒体流传输过程中进行适配。 例如在网络层, 路由器根据自身緩存状 态对媒体流进行丟包处理; 例如在应用层或者媒体传输层, 媒体转发服务器 根据底层网络状况对可分层视频编码( Scalable Video Coding, SVC )增强层 进行过滤, 等等。  Adaptation during media streaming. For example, at the network layer, the router performs packet loss processing on the media stream according to its own cache state; for example, at the application layer or the media transport layer, the media forwarding server performs a Scalable Video Coding (SVC) enhancement layer according to the underlying network condition. Filter, and so on.
针对上述媒体传输优先级机制中的各优先级信息, 建立每种优先级的传 输量化等级, 每种具体类型都有对应的量化值。 传输层优先级的一种呈现方 式是直接展现各种优先级的量化值, 另一种呈现方式是根据各优先级的量化 值计算出一个综合值, 计算规则不限。 不论釆取上述哪种呈现方式, 底层网 络都不需要了解媒体信息, 就能快速的把流媒体传输层优先级机制映射到底 层网络 QoS机制。 For each priority information in the media transmission priority mechanism, a transmission quantization level of each priority is established, and each specific type has a corresponding quantization value. a rendering side of the transport layer priority The formula is to directly display the quantized values of various priorities, and the other way is to calculate a comprehensive value according to the quantized values of the respective priorities, and the calculation rule is not limited. Regardless of which of the above presentation methods is adopted, the underlying network does not need to know the media information, and can quickly map the streaming media transport layer priority mechanism to the underlying network QoS mechanism.
根据现有流媒体传输协议, 承载于底层网络之上的流媒体分组通常由传 输信息、 负载信息和数据三部分构成。 According to the existing streaming media transmission protocol, a streaming media packet carried on the underlying network usually consists of three parts: transmission information, load information, and data.
可以将所述媒体传输层优先级信息放置于传输信息部分携带。 例如, 对 MPEG-2 TS包头或者 RTP包头进行扩展,在扩展字段中携带所述媒体传输层 优先级。  The media transport layer priority information may be placed in the transport information portion for carrying. For example, the MPEG-2 TS header or RTP header is extended to carry the media transport layer priority in an extension field.
考虑到冗余信息的优化传输, 也可以把所述媒体传输层优先级信息放置 于数据部分携带, 例如, 对 MPEG-2 TS的 PSI进行扩展, 在 PSI扩展数据中 携带所述媒体传输层优先级。 只在特例情况下通过上述传输信息部分携带所 述媒体传输层优先级。  Considering the optimized transmission of the redundant information, the media transport layer priority information may also be carried in the data part, for example, extending the PSI of the MPEG-2 TS, and carrying the media transport layer priority in the PSI extended data. level. The media transport layer priority is carried by the transport information portion only in the exceptional case.
步骤 102: 底层网络设备或媒体转发服务器接收所述媒体流, 根据预置 的优先级映射策略对所述媒体流中的优先级信息进行映射处理; Step 102: The underlying network device or the media forwarding server receives the media stream, and performs mapping processing on the priority information in the media stream according to a preset priority mapping policy.
在网络传输过程中底层网络设备从媒体流中读取所述媒体传输层优先级 信息, 根据映射策略快速映射为底层网络 QoS优先级。  During the network transmission process, the underlying network device reads the media transport layer priority information from the media stream, and quickly maps to the underlying network QoS priority according to the mapping policy.
在网络传输中媒体转发服务器(比如网络内部转发服务器或者网络边缘 转发服务器, )识别出所述媒体传输层优先级信息, 根据映射策略快速映射 为相应的转发优先级。  In the network transmission, the media forwarding server (such as the network internal forwarding server or the network edge forwarding server) identifies the media transmission layer priority information, and quickly maps to the corresponding forwarding priority according to the mapping policy.
映射策略综合所述媒体传输优先级机制中各类信息, 不同 QoS机制可以 釆取不同映射策略。 媒体流的媒体传输优先级在传输过程中始终保持不变, 能够很好的支持途径网络釆用不同 QoS传输机制和等级。  The mapping policy synthesizes various types of information in the media transmission priority mechanism, and different QoS mechanisms can capture different mapping strategies. The media transmission priority of the media stream remains unchanged during the transmission process, which can well support the network to use different QoS transmission mechanisms and levels.
步骤 103: 所述底层网络设备或媒体转发服务器根据映射处理后的优先 级信息对所述媒体流进行处理。  Step 103: The underlying network device or the media forwarding server processes the media stream according to the mapping priority information.
为了进行适配处理,所述流媒体服务器发送的媒体流中还携带适配信息, 所述适配信息包括适配类型和 /或适配优先级, 所述适配类型包括降低 PSI传 输冗余、 丟包处理或过滤增强层, 所述媒体转发服务器根据所述适配信息进 行适配处理。 In order to perform the adaptation process, the media stream sent by the streaming media server further carries the adaptation information. The adaptation information includes an adaptation type and/or an adaptation priority, where the adaptation type includes a PSI transmission redundancy reduction, a packet loss processing, or a filtering enhancement layer, and the media forwarding server performs the adaptation according to the adaptation information. With processing.
若所述媒体转发服务器接收的媒体流中携带降低 PSI传输冗余的适配信 息; 媒体转发服务器接收所述媒体流后, 执行以下适配处理:  If the media stream received by the media forwarding server carries the adaptation information that reduces PSI transmission redundancy; after receiving the media stream, the media forwarding server performs the following adaptation process:
根据所述适配信息提取并緩存所述媒体流中的 PSI;  Extracting and buffering PSI in the media stream according to the adaptation information;
转发处理后的媒体流, 且检测到所述 PSI变化时, 更新緩存的 PSI, 并向 客户端发送更新的 PSI。  Forwarding the processed media stream, and detecting the PSI change, updating the cached PSI, and sending the updated PSI to the client.
对应于以上方法, 本发明还提供了一种流媒体传输系统, 如图 2所示, 该系统包括流媒体服务器、 底层网络设备或媒体转发服务器, 其中: Corresponding to the above method, the present invention further provides a streaming media transmission system. As shown in FIG. 2, the system includes a streaming media server, an underlying network device, or a media forwarding server, where:
流媒体服务器, 设置为发送媒体流, 所述媒体流携带媒体传输层优先级 信息;  a streaming media server, configured to send a media stream, where the media stream carries media transport layer priority information;
底层网络设备或媒体转发服务器包括:  The underlying network device or media forwarding server includes:
接收模块, 设置为接收所述媒体流;  a receiving module, configured to receive the media stream;
映射处理模块, 设置为根据预置的优先级映射策略对所述媒体流中的媒 体传输层优先级信息进行映射处理;  a mapping processing module, configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy;
媒体流处理模块, 设置为根据映射处理后的媒体传输层优先级信息对所 述媒体流进行处理。  The media stream processing module is configured to process the media stream according to the media transport layer priority information after the mapping process.
可选的, 所述流媒体服务器发送的媒体流中的媒体传输层优先级信息包 括以下一个或若干个: 数据类型优先级、 业务类型优先级、 编码类型优先级、 应用层用户体验质量(QoE )机制优先级、 适配优先级。 各优先级信息具体 如前文所述。  Optionally, the media transport layer priority information in the media stream sent by the streaming media server includes one or more of the following: a data type priority, a service type priority, an encoding type priority, and an application layer user experience quality (QoE). ) Mechanism priority, adaptation priority. Each priority information is as described above.
可选的, 所述流媒体的传输信息部分或数据部分携带所述媒体传输层优 先级信息。  Optionally, the transmission information part or the data part of the streaming media carries the media transport layer priority information.
所述流媒体服务器发送的媒体流中还携带适配信息, 所述适配信息包括 适配类型和 /或适配优先级, 所述适配类型包括降低 PSI传输冗余、 丟包处理 或过滤增强层, 所述媒体转发服务器根据所述适配信息进行适配处理。 The media stream sent by the streaming media server further carries the adaptation information, where the adaptation information includes an adaptation type and/or an adaptation priority, where the adaptation type includes reducing PSI transmission redundancy and packet loss processing. Or filtering the enhancement layer, and the media forwarding server performs an adaptation process according to the adaptation information.
所述媒体转发服务器接收的媒体流中携带降低 PSI传输冗余的适配信息 时, 与底层网络设备不同的是, 如图 3所示, 媒体转发服务器的媒体流处理 模块包括:  When the media stream received by the media forwarding server carries the adaptation information for reducing PSI transmission redundancy, different from the underlying network device, as shown in FIG. 3, the media stream processing module of the media forwarding server includes:
提取緩存子模块, 设置为根据所述适配信息提取并緩存所述媒体流中的 Extracting a cache submodule, configured to extract and cache the media stream according to the adaptation information
PSI; 且检测到所述 PSI变化时, 更新緩存的 PSI, PSI; and when the PSI change is detected, the cached PSI is updated,
转发子模块, 设置为转发处理后的媒体流, 且检测到所述 PSI变化时, 向客户端发送更新的 PSI。  The forwarding submodule is configured to forward the processed media stream, and when detecting the PSI change, send the updated PSI to the client.
下面结合附图及具体实施例对本发明进行详细说明。 The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.
图 4给出了一个通信系统的具体实例, 其中网络 1中包括流媒体服务器 10, 路由器 11 , 路由器 12a和媒体转发服务器 12b, 网络 2中包括路由器 13 , 网络 3中包括路由器 14。 该通信系统用于音频、 视频、 字幕、 数据等分组数 据的网络传输和转发。 该通信系统网络层使用 IP协议, 数据链路层釆用 DWDM或者 ATM等不限。  Fig. 4 shows a specific example of a communication system in which the network 1 includes a streaming media server 10, a router 11, a router 12a and a media forwarding server 12b, the network 2 includes a router 13, and the network 3 includes a router 14. The communication system is used for network transmission and forwarding of packet data such as audio, video, subtitles, and data. The communication system network layer uses the IP protocol, and the data link layer uses DWDM or ATM.
媒体流在该通信系统的转发步骤如下:  The forwarding steps of the media stream in the communication system are as follows:
步骤 A、 在网络 1中, 流媒体服务器 10实时输出各种媒体流。  Step A: In the network 1, the streaming server 10 outputs various media streams in real time.
图 5给出媒体分组结构示例, 该实例中, 媒体传输格式釆用 MPEG-TS, QoS机制釆用 Diff-Serv。媒体分组由 IPv4包头、 TS包头、 PES包头和媒体数 据四部分构成。 IPv4包头中的 ToS字段用于区分服务( Differentiated Services, Diff-Serv ) 。 ToS 字段的值在媒体流传输过程中改变, 路由器赋予不同的 Diff-Serv。 TS 包头中的传输层优先级字段为扩展字段, 扩展方式遵循 TS标 准。 用于承载本发明所述优先级。  Figure 5 shows an example of a media packet structure in which the media transport format uses MPEG-TS and the QoS mechanism uses Diff-Serv. The media packet consists of four parts: IPv4 header, TS header, PES header and media data. The ToS field in the IPv4 header is used to differentiate services (Different Services, Diff-Serv). The value of the ToS field changes during media streaming, and the router assigns different Diff-Servs. The transport layer priority field in the TS header is an extension field, and the extension method follows the TS standard. Used to carry the priority described in the present invention.
传输层优先级的一种呈现方式是直接展现各维度量化值, 另一种呈现方 式是根据各维度量化值计算出一个综合值。 釆取计算综合值的优先级呈现方 式很简单, 只需要媒体层优先级字段支持一定量化分级即可, 比如 8bit长度 支持 0-255 的量化分级。 釆取展现各维度量化值的呈现方式稍微复杂些, 需 要在媒体层优先级字段中进一步划分域。 图 6给出展现各维度量量化值的媒体层优先级字段结构示例。 示例的媒 体层优先级字段由六个域(field )构成, 分别是: 数据信息域, 业务信息域, 编码信息域, AppQoEtools域、 适配信息域和保留域。 媒体层优先级字段长 度比如是 32bit; 前四个域各占用 4bit, 域值范围 0-15 , 对应优先级从低到高; 适配信息域占用 8bit, 前 4bit为优先级位, 域值范围 0-15 , 对应优先级从低 到高, 后 4bit为类型位, 域值范围 0-15 , 对应适配类型; 保留域一个域占用 8bit。 One way to present the priority of the transport layer is to directly display the quantized values of each dimension. The other way to present is to calculate a composite value based on the quantized values of each dimension. The priority presentation method for calculating the integrated value is very simple, and only the media layer priority field needs to support a certain quantization level, for example, the 8-bit length supports the quantization level of 0-255. It is slightly more complicated to capture the representation of the quantized values of each dimension, and the domain needs to be further divided in the media layer priority field. Fig. 6 shows an example of a structure of a media layer priority field that exhibits quantized values for each dimension amount. An example media layer priority field is composed of six fields, namely: a data information field, a service information field, an encoded information field, an AppQoEtools domain, an adaptation information domain, and a reserved domain. The length of the media layer priority field is 32 bits. The first four fields occupy 4 bits, the range of field values is 0-15, and the corresponding priority is from low to high. The adaptation information field occupies 8 bits. The first 4 bits are priority bits. 0-15, the corresponding priority is from low to high, the last 4 bits are type bits, the field value range is 0-15, corresponding to the adaptation type; one domain of the reserved domain occupies 8 bits.
基于上述示例, 一个视频为可分级编码 (Scalable Video Codeing, SVC)两 个分级、 提供前向纠错 (Forward Error Correction, FEC)的 IPTV组播直播流的 媒体层优先级字段如下:  Based on the above example, a media layer priority field of an IPTV multicast live stream providing Forward Error Correction (FEC), which is a Scalable Video Codeing (SVC) grading, is as follows:
数据信息域: 为 PSI赋予优先级 0, 为 SI赋予优先级 1 , 为音频数据赋 予优先级 2, 为视频数据赋予优先级 3;  Data information field: Give priority to PSI 0, give priority to SI 1 , assign priority to audio data 2, give priority to video data 3;
业务信息域: 为 IPTV直播赋予优先级 1 ;  Service Information Domain: Give priority to IPTV live broadcast 1 ;
编码信息域: 为视频 SVC基本层的 IDR赋予优先级 0, 为视频 SVC基 本层的 non IDR赋予优先级 1 , 为视频 S VC增强层的 IDR赋予优先级 2 , 为 视频 SVC增强层的 non IDR赋予优先级 3;  The coded information field: assigns priority 0 to the IDR of the video SVC base layer, priority 1 to the non IDR of the video SVC base layer, and priority 2 to the IDR of the video S VC enhancement layer, which is the non IDR of the video SVC enhancement layer. Give priority 3;
AppQoEtools域: FEC机制对应的优先级为 2;  AppQoEtools domain: The priority of the FEC mechanism is 2;
适配信息域: 适配类型为降低 PSI传输冗余, 优先级为 0;  Adaptation information field: The adaptation type is to reduce PSI transmission redundancy, and the priority is 0;
保留域: 默认为 0。  Reserved field: The default is 0.
步骤 B、 媒体流流经路由器 11 , 路由器 11对媒体流应用 Diff-serv, 应用 本地策略把媒体流的媒体层优先级字段映射为 IPv4包头的 ToS字段,然后把 媒体流 QoS传输给路由器 12a。 Step B: The media stream flows through the router 11. The router 11 applies the Diff-serv to the media stream, applies the local policy to map the media layer priority field of the media stream to the ToS field of the IPv4 packet header, and then transmits the media stream QoS to the router 12a.
步骤 C、 路由器 12a接收到媒体流后, 进行映射处理后转发给同节点的 媒体转发服务器 12b;媒体转发服务器 12b根据网络 2和网络 3的特点对媒体 流进行映射处理、 媒体层适配, 适配后的媒体流经过路由器 12a分别 QoS传 输给网络 2的路由器 13和网络 3的路由器 14。 这里路由器 12a可以执行新的 Diff-serv策略, 应用本地策略改变媒体流 IP包头的 ToS值; 或者应用其他的 QoS机制, 比如应用本地策略把媒体层优 先级映射为多协议标签交换( Multi-Protocol Label Switching, MPLS ) 。 Step C: After receiving the media stream, the router 12a performs mapping processing and forwards the packet to the media forwarding server 12b of the same node. The media forwarding server 12b performs mapping processing and media layer adaptation according to the characteristics of the network 2 and the network 3. The matched media streams are QoS transmitted to the router 13 of the network 2 and the router 14 of the network 3 via the router 12a. Here, the router 12a can execute a new Diff-serv policy, apply a local policy to change the ToS value of the media stream IP header, or apply other QoS mechanisms, such as applying a local policy to map the media layer priority to a multi-protocol label switching (Multi-Protocol). Label Switching, MPLS ).
步骤 D、路由器 13把媒体流 QoS传输给网络节点 15a和 15b,路由器 14 把媒体流 QoS传输给网络节点 15d和 15e, 进行媒体播放。 Step D: The router 13 transmits the media stream QoS to the network nodes 15a and 15b, and the router 14 transmits the media stream QoS to the network nodes 15d and 15e for media playback.
以下对媒体转发服务器的适配进行详细说明:  The following describes the adaptation of the media forwarding server in detail:
媒体层适配的示例 1 :  Example of media layer adaptation 1 :
媒体视频编码类型釆用 SVC。 流媒体服务器 10输出空域分级的 SVC视 频流, 其中 SVC基本层大小为 QVGA, SVC增强层大小为 VAG。  The media video encoding type uses SVC. The streaming media server 10 outputs the spatial domain-classified SVC video stream, where the SVC base layer size is QVGA and the SVC enhancement layer size is VAG.
网络 2面向的终端为 15a、 15b等移动手持设备,视频分辨率釆用 QVGA; 网络 3面向 15d、 15e等 PC和电视设备, 视频分辨率釆用 VGA。  The network 2 is oriented to mobile handheld devices such as 15a and 15b, and the video resolution is QVGA; the network 3 is for PCs and TVs such as 15d and 15e, and the video resolution is VGA.
媒体转发服务器 12b根据媒体流的适配优先级信息中携带 SVC适配指 示, 面向网络 2过滤掉视频流中的 S VC增强流, 面向网络 3不做任何适配处 理。  The media forwarding server 12b carries the SVC adaptation indication according to the adaptation priority information of the media stream, and filters the S VC enhancement stream in the video stream for the network 2, and does not perform any adaptation processing for the network 3.
媒体层适配的示例 2:  Example of media layer adaptation 2:
降低 PSI传输冗余, 媒体转发服务器识别出媒体流中的适配信息域, 把 该媒体分组从媒体流中过滤出来,緩存于本地并维护更新。只有当客户端 15c 加入组播直播或者 PSI变化的时候才发送緩存的 PSI。图 7和图 8给出详细的 处理流程描述。  The PSI transmission redundancy is reduced, and the media forwarding server identifies the adaptation information field in the media stream, filters the media packet from the media stream, caches it locally, and maintains the update. The cached PSI is sent only when the client 15c joins the multicast live broadcast or the PSI changes. Figure 7 and Figure 8 give a detailed description of the process flow.
图 7描述降低 MPEG-TS中 PSI冗余信息传输的适配实施例中流媒体转发 服务器的处理流程。 过程如下:  Figure 7 depicts the processing flow of a streaming media forwarding server in an adapted embodiment for reducing PSI redundant information transmission in MPEG-TS. The process is as follows:
步骤 701、 流媒体服务器 10发送上述示例中带原始 PSI的组播媒体流; 步骤 702、 媒体转发服务器 12b接收组播媒体流, 媒体转发服务器 12b 识别出媒体流中的适配信息域;  Step 701: The streaming media server 10 sends the multicast media stream with the original PSI in the above example. Step 702: The media forwarding server 12b receives the multicast media stream, and the media forwarding server 12b identifies the adaptation information field in the media stream.
步骤 703、 媒体转发服务器 12b过滤 (即抽取)媒体流中的原始 PSI, 并 緩存于本地; 步骤 704、 媒体转发服务器 12b应用其他媒体传输适配策略, 这里比如 上述示例中面向网络 2过滤掉视频流中的 SVC增强流, 此处可能涉及 PSI更 新; Step 703: The media forwarding server 12b filters (ie, extracts) the original PSI in the media stream, and caches it locally. Step 704: The media forwarding server 12b applies another media transmission adaptation policy. Here, for example, in the foregoing example, the SVC enhanced flow in the video stream is filtered out for the network 2, where PSI update may be involved herein;
步骤 705、 媒体转发服务器 12b检测 PSI是否变化, 如变化则执行步骤 706, 否则执行步骤 708;  Step 705, the media forwarding server 12b detects whether the PSI changes, if the change is performed, step 706, otherwise step 708;
步骤 706、 媒体转发服务器 12b緩存变化的 PSI;  Step 706: The media forwarding server 12b caches the changed PSI.
步骤 707、 媒体转发服务器 12b发送更新的 PSI;  Step 707: The media forwarding server 12b sends the updated PSI.
步骤 708、 媒体转发服务器 12b转发适配后的媒体流。  Step 708: The media forwarding server 12b forwards the adapted media stream.
图 8描述降低 PSI传输冗余的适配实施例中流媒体客户端点播流程。 过 程如下:  Figure 8 depicts a streaming media client endpoint broadcast procedure in an adapted embodiment that reduces PSI transmission redundancy. The process is as follows:
步骤 801、 客户端 15c选择 IPTV组播直播;  Step 801: The client 15c selects an IPTV multicast live broadcast.
步骤 802、 客户端 15c加入组播组;  Step 802: The client 15c joins the multicast group.
步骤 803、 路由器 12a通知媒体转发服务器 12b;  Step 803, the router 12a notifies the media forwarding server 12b;
步骤 804、 媒体转发服务器 12b发送緩存的 PSI;  Step 804: The media forwarding server 12b sends the buffered PSI.
步骤 805、 客户端 15c根据 PSI初始化解码资源;  Step 805: The client 15c initializes the decoding resource according to the PSI.
步骤 806、 媒体转发服务器 12b进行其他媒体适配, 把码流转发给路由 器 12a, 路由器 12a把媒体流转发给客户端 15c;  Step 806, the media forwarding server 12b performs other media adaptation, and forwards the code stream to the router 12a, and the router 12a forwards the media stream to the client 15c;
步骤 807、 客户端 15c对接收到的组播媒体流进行解码呈现。  Step 807: The client 15c decodes and presents the received multicast media stream.
上述过程是降低 PSI传输冗余的适配方法的一种实现, 任何利用该设计 思想及其任何等效变换实现降低 TS流或类似传输流中冗余信息传输的方法, 均应属于本发明的保护范围。  The above process is an implementation of an adaptation method for reducing PSI transmission redundancy, and any method for reducing redundant information transmission in a TS stream or the like by using the design idea and any equivalent transformation thereof belongs to the present invention. protected range.
本发明实施例还提供了另一种流媒体传输方法, 该方法重点在于媒体转 发服务器根据适配信息进行适配, 具体包括:  The embodiment of the present invention further provides another streaming media transmission method, where the method focuses on the adaptation of the media forwarding server according to the adaptation information, which specifically includes:
流媒体服务器发送媒体流, 所述媒体流携带降低 PSI传输冗余的适配信 息;  The streaming media server sends a media stream, where the media stream carries adaptation information that reduces PSI transmission redundancy;
媒体转发服务器接收所述媒体流, 根据所述适配信息提取并緩存所述媒 体流中的 PSI; 所述媒体转发服务器转发处理后的媒体流, 且检测到所述 PSI变化时, 更新緩存的 PSI, 并向客户端发送更新的 PSI。 Receiving, by the media forwarding server, the media stream, and extracting and buffering the PSI in the media stream according to the adaptation information; The media forwarding server forwards the processed media stream, and when detecting the PSI change, updates the cached PSI, and sends the updated PSI to the client.
另外, 所述流媒体服务器发送的媒体流中还可携带丟包处理或过滤增强 层的适配信息, 所述媒体转发服务器转发的数据流是经过适配处理后的媒体 流。  In addition, the media stream sent by the streaming media server may also carry the packet loss processing or the adaptation information of the filtering enhancement layer, and the data stream forwarded by the media forwarding server is the adapted media stream.
对应以上方法, 本发明还提供了另一种流媒体传输系统, 该系统包括流 媒体服务器和媒体转发服务器, 其中:  Corresponding to the above method, the present invention also provides another streaming media transmission system, the system comprising a streaming media server and a media forwarding server, wherein:
流媒体服务器, 设置为发送媒体流, 所述媒体流携带降低 PSI传输冗余 的适配信息;  a streaming media server, configured to send a media stream, where the media stream carries adaptation information that reduces PSI transmission redundancy;
媒体转发服务器包括:  The media forwarding server includes:
接收模块, 设置为接收所述媒体流;  a receiving module, configured to receive the media stream;
提取緩存模块, 设置为根据所述适配信息提取并緩存所述媒体流中的 Extracting a cache module, configured to extract and cache the media stream according to the adaptation information
PSI; 检测到所述 PSI变化时, 更新緩存的 PSI; PSI; when the PSI change is detected, updating the cached PSI;
转发模块, 设置为转发处理后的媒体流, 并在检测到所述 PSI变化时向 客户端发送更新的 PSI。  The forwarding module is configured to forward the processed media stream, and send the updated PSI to the client when the PSI change is detected.
可选的, 所述流媒体服务器发送的媒体流中还携带丟包处理或过滤增强 层的适配信息, 所述媒体转发服务器转发的数据流是经过适配处理后的媒体 流。  Optionally, the media stream sent by the streaming media server further carries the packet loss processing or the filtering enhancement layer adaptation information, and the data forwarding packet forwarded by the media forwarding server is the adapted media stream.
本发明提出的流媒体传输方法与系统, 提出一种全新的媒体传输层优先 级机制, 建立起媒体传输层优先级到底层网络优先级的快速映射, 支持在媒 体转发网络中进行媒体适配, 支持底层各种 QoS传输机制, 能有效的提升流 媒体传输质量。 这里需要指出的是, 本发明中的具体实施例只是列举了本发明的个别实 例, 使用本发明的设计思想及其任何等效变换实现流媒体传输方法和系统, 均应属于本发明的保护范围。  The streaming media transmission method and system proposed by the present invention proposes a new media transport layer priority mechanism, which establishes a fast mapping of the media transport layer priority to the underlying network priority, and supports media adaptation in the media forwarding network. Supports various underlying QoS transport mechanisms, which can effectively improve the quality of streaming media transmission. It should be noted that the specific embodiments in the present invention are merely enumerating individual examples of the present invention, and the streaming media transmission method and system using the design idea of the present invention and any equivalent transformation thereof are all within the scope of protection of the present invention. .
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序 来指令相关硬件完成, 所述程序可以存储于计算机可读存储介质中, 如只读 存储器、 磁盘或光盘等。 可选地, 上述实施例的全部或部分步骤也可以使用 一个或多个集成电路来实现。 相应地, 上述实施例中的各模块可以釆用硬件 的形式实现, 也可以釆用软件功能模块的形式实现。 本发明不限制于任何特 定形式的硬件和软件的结合。 One of ordinary skill in the art will appreciate that all or a portion of the above steps may be performed by a program to instruct the associated hardware, such as a read only memory, a magnetic disk, or an optical disk. Optionally, all or part of the steps of the above embodiments may also be used. One or more integrated circuits are implemented. Correspondingly, each module in the foregoing embodiment may be implemented in the form of hardware, or may be implemented in the form of a software function module. The invention is not limited to any specific form of combination of hardware and software.
工业实用性 上述流媒体传输方法与系统中流媒体服务器发送媒体流携带符合媒体传 输层优先级机制的优先级信息; 在媒体流的网络传输过程中, 底层网络或者 媒体转发服务器根据预置的优先级映射策略进行映射处理后, 再根据映射处 理后的优先级信息对媒体流进行处理, 从而提升媒体传输效率。 Industrial Applicability In the above streaming media transmission method and system, the streaming media server sends a media stream carrying priority information conforming to the media transport layer priority mechanism; in the network transmission process of the media stream, the underlying network or the media forwarding server according to the preset priority After the mapping policy is mapped, the media stream is processed according to the priority information after the mapping process, thereby improving media transmission efficiency.

Claims

权 利 要 求 书 Claim
1、 一种流媒体传输方法, 该方法包括: 1. A streaming media transmission method, the method comprising:
流媒体服务器发送媒体流, 其中携带媒体传输层优先级信息;  The streaming media server sends a media stream, where the media transport layer priority information is carried;
底层网络设备或媒体转发服务器接收所述媒体流, 根据预置的优先级映 射策略对所述媒体流中的媒体传输层优先级信息进行映射处理; 以及  Receiving, by the underlying network device or the media forwarding server, the media stream, and mapping the media transport layer priority information in the media stream according to a preset priority mapping policy;
所述底层网络设备或媒体转发服务器根据映射处理后的媒体传输层优先 级信息对所述媒体流进行处理。  The underlying network device or the media forwarding server processes the media stream according to the media transport layer priority information after the mapping process.
2、 如权利要求 1所述的方法, 其中: 所述流媒体服务器发送的媒体流中 的媒体传输层优先级信息包括以下一个或多个: 数据类型优先级、 业务类型 优先级、 编码类型优先级、 应用层用户体验质量(QoE )机制优先级、 适配 优先级。 2. The method according to claim 1, wherein: the media transport layer priority information in the media stream sent by the streaming media server comprises one or more of the following: a data type priority, a service type priority, and an encoding type priority. Level, application layer user experience quality (QoE) mechanism priority, adaptation priority.
3、 如权利要求 1所述的方法, 其中: 所述流媒体的传输信息部分或数据 部分携带所述媒体传输层优先级信息。 3. The method according to claim 1, wherein: the transmission information part or the data part of the streaming media carries the media transmission layer priority information.
4、 如权利要求 1所述的方法, 其中: 所述流媒体服务器发送的媒体流中 还携带适配信息, 所述适配信息包括适配类型和 /或适配优先级, 所述适配类 型包括降低节目特定信息 (PSI )传输冗余、 丟包处理或过滤增强层, 4. The method according to claim 1, wherein: the media stream sent by the streaming media server further carries adaptation information, where the adaptation information includes an adaptation type and/or an adaptation priority, and the adaptation Types include reduced program specific information (PSI) transmission redundancy, packet loss processing, or filtering enhancement layers.
所述媒体转发服务器根据映射处理后的媒体传输层优先级信息对所述媒 体流进行处理的包括:所述媒体转发服务器根据所述适配信息进行适配处理。  The media forwarding server processes the media stream according to the media transport layer priority information after the mapping processing, and the media forwarding server performs an adaptation process according to the adaptation information.
5、 如权利要求 1所述的方法, 其中: 所述媒体转发服务器接收的媒体流 中携带降低 PSI传输冗余的适配信息; 所述媒体转发服务器根据映射处理后 的媒体传输层优先级信息对所述媒体流进行处理的包括: 5. The method according to claim 1, wherein: the media stream received by the media forwarding server carries adaptation information that reduces PSI transmission redundancy; and the media forwarding server performs media transmission layer priority information according to mapping processing. Processing the media stream includes:
根据所述适配信息提取并緩存所述媒体流中的 PSI;  Extracting and buffering PSI in the media stream according to the adaptation information;
转发处理后的媒体流, 且检测到所述 PSI变化时, 更新緩存的 PSI, 并向 客户端发送更新的 PSI。  Forwarding the processed media stream, and detecting the PSI change, updating the cached PSI, and sending the updated PSI to the client.
6、 一种流媒体传输系统, 该系统包括流媒体服务器以及底层网络设备或 媒体转发服务器, 其中: 6. A streaming media transmission system, the system comprising a streaming media server and an underlying network device or Media forwarding server, where:
所述流媒体服务器设置为: 发送媒体流, 其中携带媒体传输层优先级信 息;  The streaming media server is configured to: send a media stream, where the media transport layer priority information is carried;
所述底层网络设备或所述媒体转发服务器包括:  The underlying network device or the media forwarding server includes:
接收模块, 其设置为接收所述媒体流;  a receiving module, configured to receive the media stream;
映射处理模块, 其设置为根据预置的优先级映射策略对所述媒体流中的 媒体传输层优先级信息进行映射处理; 以及 媒体流处理模块, 其设置为根据映射处理后的媒体传输层优先级信息对 所述媒体流进行处理。  a mapping processing module, configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy; and a media stream processing module configured to prioritize media transport layer according to mapping processing The level information processes the media stream.
7、 如权利要求 6所述的系统, 其中: 所述流媒体服务器发送的媒体流中 的媒体传输层优先级信息包括以下一个或多个: 数据类型优先级、 业务类型 优先级、 编码类型优先级、 应用层用户体验质量(QoE )机制优先级、 适配 优先级。 7. The system according to claim 6, wherein: the media transport layer priority information in the media stream sent by the streaming media server comprises one or more of the following: a data type priority, a service type priority, and an encoding type priority. Level, application layer user experience quality (QoE) mechanism priority, adaptation priority.
8、 如权利要求 6所述的系统, 其中: 所述流媒体的传输信息部分或数据 部分携带所述媒体传输层优先级信息。 8. The system according to claim 6, wherein: the transmission information part or the data part of the streaming media carries the media transmission layer priority information.
9、 如权利要求 6所述的系统, 其中: 所述流媒体服务器发送的媒体流中 还携带适配信息, 所述适配信息包括适配类型和 /或适配优先级, 所述适配类 型包括降低节目特定信息(PSI )传输冗余、 丟包处理或过滤增强层, 所述媒 体流处理模块是设置为根据所述适配信息进行适配处理。 9. The system according to claim 6, wherein: the media stream sent by the streaming media server further carries adaptation information, where the adaptation information includes an adaptation type and/or an adaptation priority, and the adaptation The type includes a reduced program specific information (PSI) transmission redundancy, a packet loss processing or a filtering enhancement layer, and the media stream processing module is configured to perform an adaptation process according to the adaptation information.
10、 如权利要求 6所述的系统, 其中: 所述媒体转发服务器接收的媒体 流中携带降低 PSI传输冗余的适配信息; 媒体转发服务器的媒体流处理模块 包括: The system of claim 6, wherein: the media stream received by the media forwarding server carries the adaptation information that reduces PSI transmission redundancy; and the media stream processing module of the media forwarding server includes:
提取緩存子模块, 其设置为: 根据所述适配信息提取并緩存所述媒体流 中的 PSI; 且检测到所述 PSI变化时, 更新緩存的 PSI, 以及  Extracting a cache submodule, configured to: extract and cache PSI in the media stream according to the adaptation information; and update a cached PSI when detecting the PSI change, and
转发子模块, 其设置为: 转发处理后的媒体流, 且检测到所述 PSI变化 时, 向客户端发送更新的 PSI。 And a forwarding submodule, configured to: forward the processed media stream, and send the updated PSI to the client when the PSI changes are detected.
11、 一种底层网络设备, 其包括: 11. An underlying network device, comprising:
接收模块, 其设置为接收流媒体发送的媒体流, 所述媒体流中携带媒体 传输层优先级信息;  a receiving module, configured to receive a media stream sent by the streaming media, where the media stream carries media transport layer priority information;
映射处理模块, 其设置为根据预置的优先级映射策略对所述媒体流中的 媒体传输层优先级信息进行映射处理; 以及  a mapping processing module, configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy;
媒体流处理模块, 其设置为根据映射处理后的媒体传输层优先级信息对 所述媒体流进行处理。  The media stream processing module is configured to process the media stream according to the media transport layer priority information after the mapping process.
12、 一种媒体转发服务器, 其包括:  12. A media forwarding server, comprising:
接收模块, 其设置为接收流媒体发送的媒体流, 所述媒体流中携带媒体 传输层优先级信息;  a receiving module, configured to receive a media stream sent by the streaming media, where the media stream carries media transport layer priority information;
映射处理模块, 其设置为根据预置的优先级映射策略对所述媒体流中的 媒体传输层优先级信息进行映射处理; 以及 媒体流处理模块, 其设置为根据映射处理后的媒体传输层优先级信息对 所述媒体流进行处理。  a mapping processing module, configured to perform mapping processing on media transport layer priority information in the media stream according to a preset priority mapping policy; and a media stream processing module configured to prioritize media transport layer according to mapping processing The level information processes the media stream.
13、 如权利要求 12所述的媒体转发服务器, 其中: 所述媒体转发服务器 接收的媒体流中携带降低节目特定信息 (PSI )传输冗余的适配信息; The media forwarding server according to claim 12, wherein: the media stream received by the media forwarding server carries adaptation information that reduces program specific information (PSI) transmission redundancy;
所述媒体流处理模块包括:  The media stream processing module includes:
提取緩存子模块, 其设置为: 根据所述适配信息提取并緩存所述媒体流 中的 PSI; 且检测到所述 PSI变化时, 更新緩存的 PSI, 以及  Extracting a cache submodule, configured to: extract and cache PSI in the media stream according to the adaptation information; and update a cached PSI when detecting the PSI change, and
转发子模块, 其设置为: 转发处理后的媒体流, 且检测到所述 PSI变化 时, 向客户端发送更新的 PSI。  And a forwarding submodule, configured to: forward the processed media stream, and send the updated PSI to the client when the PSI change is detected.
14、 一种流媒体传输方法, 该方法包括: 14. A streaming media transmission method, the method comprising:
流媒体服务器发送媒体流, 所述媒体流携带降低节目特定信息(PSI )传 输冗余的适配信息;  The streaming server sends a media stream, the media stream carrying adaptation information that reduces program specific information (PSI) transmission redundancy;
媒体转发服务器接收所述媒体流, 根据所述适配信息提取并緩存所述媒 体流中的 PSI; 所述媒体转发服务器转发处理后的媒体流, 且检测到所述 PSI变化时, 更新緩存的 PSI, 并向客户端发送更新的 PSI。 Receiving, by the media forwarding server, the media stream, and extracting and buffering the PSI in the media stream according to the adaptation information; The media forwarding server forwards the processed media stream, and when detecting the PSI change, updates the cached PSI, and sends the updated PSI to the client.
15、 如权利要求 14所述的方法, 其中: 所述流媒体服务器发送的媒体流 中还携带丟包处理或过滤增强层的适配信息, 所述媒体转发服务器转发的媒 体流是经过适配处理后的媒体流。 The method of claim 14, wherein: the media stream sent by the streaming media server further carries packet loss processing or filtering enhancement layer adaptation information, and the media forwarding server forwards the media stream to be adapted. Processed media stream.
16、 一种流媒体传输系统, 该系统包括流媒体服务器和媒体转发服务器, 其中: 16. A streaming media transmission system, the system comprising a streaming media server and a media forwarding server, wherein:
所述流媒体服务器设置为: 发送媒体流, 所述媒体流携带降低节目特定 信息 (PSI )传输冗余的适配信息;  The streaming media server is configured to: send a media stream, where the media stream carries adaptation information that reduces program specific information (PSI) transmission redundancy;
所述媒体转发服务器包括:  The media forwarding server includes:
接收模块, 其设置为接收所述媒体流; 以及  a receiving module configured to receive the media stream;
提取緩存模块, 其设置为根据所述适配信息提取并緩存所述媒体流中的 Extracting a cache module, configured to extract and cache the media stream according to the adaptation information
PSI; 检测到所述 PSI变化时, 更新緩存的 PSI; PSI; when the PSI change is detected, updating the cached PSI;
转发模块, 其设置为转发处理后的媒体流, 并在检测到所述 PSI变化时 向客户端发送更新的 PSI。  And a forwarding module configured to forward the processed media stream and send the updated PSI to the client when the PSI change is detected.
17、 如权利要求 16所述的系统, 其特征在于: 所述流媒体服务器发送的 媒体流中还携带丟包处理或过滤增强层的适配信息, 所述转发模块是设置为 转发经过适配处理后的媒体流。 The system according to claim 16, wherein: the media stream sent by the streaming media server further carries the packet loss processing or the adaptation information of the filtering enhancement layer, and the forwarding module is configured to be forwarded and adapted. Processed media stream.
18、 一种媒体转发服务器, 其包括: 18. A media forwarding server, comprising:
接收模块, 其设置为接收流媒体服务器发送的媒体流, 所述媒体流携带 降低节目特定信息 (PSI )传输冗余的适配信息; 以及 提取緩存模块, 其设置为根据所述适配信息提取并緩存所述媒体流中的 a receiving module, configured to receive a media stream sent by the streaming media server, the media stream carrying adaptation information that reduces program specific information (PSI) transmission redundancy; and an extraction buffer module configured to extract according to the adaptation information And buffering the media stream
PSI; 检测到所述 PSI变化时, 更新緩存的 PSI; PSI; when the PSI change is detected, updating the cached PSI;
转发模块, 其设置为转发处理后的媒体流, 并在检测到所述 PSI变化时 向客户端发送更新的 PSI。  And a forwarding module configured to forward the processed media stream and send the updated PSI to the client when the PSI change is detected.
19、 如权利要求 18所述的媒体转发服务器, 其特征在于: 所述流媒体服 务器发送的媒体流中还携带丟包处理或过滤增强层的适配信息, 所述转发模 块是设置为转发经过适配处理后的媒体流。 19. The media forwarding server according to claim 18, wherein: said streaming media service The media stream sent by the server further carries the packet loss processing or the adaptation information of the filtering enhancement layer, and the forwarding module is configured to forward the media stream after the adaptation processing.
PCT/CN2012/070215 2011-01-11 2012-01-11 Method, system and device for transferring streaming media WO2012094998A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110004651.4A CN102594774B (en) 2011-01-11 2011-01-11 Flow-medium transmission method and system
CN201110004651.4 2011-01-11

Publications (1)

Publication Number Publication Date
WO2012094998A1 true WO2012094998A1 (en) 2012-07-19

Family

ID=46482982

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/070215 WO2012094998A1 (en) 2011-01-11 2012-01-11 Method, system and device for transferring streaming media

Country Status (2)

Country Link
CN (1) CN102594774B (en)
WO (1) WO2012094998A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103795996B (en) * 2012-11-01 2016-08-03 上海贝尔股份有限公司 3D delivery of video method and apparatus
CN105357144B (en) * 2014-08-20 2019-10-29 联想(北京)有限公司 A kind of data processing method and electronic equipment
CN106330845A (en) * 2015-07-02 2017-01-11 中兴通讯股份有限公司 Method and apparatus for transmitting streaming media data
CN105142181B (en) * 2015-08-07 2018-05-18 上海斐讯数据通信技术有限公司 A kind of radio reception device message priority-level mapping method and system
CN106559683B (en) * 2016-11-16 2020-05-19 浙江宇视科技有限公司 QoS priority dynamic adjustment method and device for monitoring service
CN109005126B (en) * 2017-06-06 2020-06-02 华为技术有限公司 Data stream processing method, device and computer readable storage medium
CN109166606A (en) * 2018-08-31 2019-01-08 上海轩昂医疗科技有限公司 A kind of electronic health record online editing platform and its implementation
CN115242891A (en) * 2021-04-23 2022-10-25 花瓣云科技有限公司 Data transmission method, system and related device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030055920A1 (en) * 2001-09-17 2003-03-20 Deepak Kakadia Method and apparatus for automatic quality of service configuration based on traffic flow and other network parameters
CN101568027A (en) * 2009-05-22 2009-10-28 华为技术有限公司 Method, device and system for forwarding video data

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030055920A1 (en) * 2001-09-17 2003-03-20 Deepak Kakadia Method and apparatus for automatic quality of service configuration based on traffic flow and other network parameters
CN101568027A (en) * 2009-05-22 2009-10-28 华为技术有限公司 Method, device and system for forwarding video data

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"RTP Header Extension for Communications Resource Priority", IETF, 14 November 2001 (2001-11-14), Retrieved from the Internet <URL:URL:http://tools.ietf.org/id/draft-polk-avt-rtpext-res-pri-00.txt> [retrieved on 20120321] *
HAN, XINQI ET AL.: "District Mapping Model for QoS Mapping", COMPUTER ENGINEERING AND APPLICATIONS, 31 October 2003 (2003-10-31), pages 162 - 163, 226 *

Also Published As

Publication number Publication date
CN102594774A (en) 2012-07-18
CN102594774B (en) 2016-09-28

Similar Documents

Publication Publication Date Title
US11196786B2 (en) Interface apparatus and method for transmitting and receiving media data
US20210352125A1 (en) Devices, systems, and methods for converting or translating dynamic adaptive streaming over http (dash) to http live streaming (hls)
WO2012094998A1 (en) Method, system and device for transferring streaming media
EP2385707B1 (en) Channel switching method, device, and system
KR101757771B1 (en) Apparatus and method for tranmitting a multimedia data packet using cross layer optimization
WO2010054543A1 (en) Method, device and system for channel switching
US11316799B2 (en) Method and apparatus for transmitting a multimedia data packet using cross-layer optimization
US20200021867A1 (en) Broadcast signal transmitting and receiving method and device
WO2010048825A1 (en) Lost packet retransmission suppressing method, network node and system
WO2007045140A1 (en) A real-time method for transporting multimedia data
KR20120084202A (en) Apparatus and method for tranmitting a multimedia data packet
US8730800B2 (en) Method, apparatus, and system for transporting video streams
KR102014882B1 (en) Apparatus and method for tranmitting a multimedia data packet
KR20130058539A (en) Methods of synchronization in hybrid delivery

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12734019

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12734019

Country of ref document: EP

Kind code of ref document: A1