WO2012094994A1 - Method and system for realizing lost package retransmission in streaming media - Google Patents

Method and system for realizing lost package retransmission in streaming media Download PDF

Info

Publication number
WO2012094994A1
WO2012094994A1 PCT/CN2012/070207 CN2012070207W WO2012094994A1 WO 2012094994 A1 WO2012094994 A1 WO 2012094994A1 CN 2012070207 W CN2012070207 W CN 2012070207W WO 2012094994 A1 WO2012094994 A1 WO 2012094994A1
Authority
WO
WIPO (PCT)
Prior art keywords
retransmission
configuration information
packet loss
packet
retransmission configuration
Prior art date
Application number
PCT/CN2012/070207
Other languages
French (fr)
Chinese (zh)
Inventor
王芳
刘继年
赵宇
孙健
陈光亮
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2012094994A1 publication Critical patent/WO2012094994A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless

Definitions

  • the present invention relates to the field of streaming media technologies, and more particularly to a method and system for implementing streaming media packet loss retransmission in a streaming media application. Background technique
  • a transport stream is carried over a real-time transport protocol (TS over RTP, Transport Stream over Real-time Transport Protocol) or a transport stream is carried over a User Datagram Protocol (TS over UDP, Transport Stream over User Datagram Protocol).
  • TS real-time transport protocol
  • UDP User Datagram Protocol
  • Transport Stream transport Stream over User Datagram Protocol
  • the receiving end may propose a feedback request for packet loss retransmission, and the transmitting end resends the lost or erroneous data packet to the receiving end to solve the problem.
  • the receiving end needs to feed back the lost data packet information to the transmitting end, and also needs to be able to identify the normal code stream and the retransmitted code stream from the code stream sent by the transmitting end.
  • MPEG-2 Moving Pictures Experts Group M Transport Stream (TS) specification was originally designed for data broadcasting, lacking notification and feedback mechanisms for such packet loss signaling.
  • the current common practice is to provide the TS in an out-of-band manner by hosting the TS on the Real-time Transport Protocol (RTP) and then implementing the Real-time Streaming Protocol (RTSP) architecture.
  • RTP Real-time Transport Protocol
  • RTSP Real-time Streaming Protocol
  • Signaling notification and feedback for packet loss retransmission That is, the SDP is first used to notify the receiving end of the retransmission specifications supported by the system, including the method of packet loss feedback, the transmission channel and format of the retransmission code stream.
  • the receiver After the receiver detects the loss of the packet, it passes the Real-time Transport Control Protocol (RTCP) or RTSP. Way, feedback to the sender.
  • RTCP Real-time Transport Control Protocol
  • RTSP Real-time Transport Control Protocol
  • the receiving end may lack such means to obtain information such as retransmission specifications through an out-of-band method such as SDP.
  • SDP Service Specific Information
  • the Program Specific Information (PSI) of the TS includes detailed information of each internal media stream, such as media stream type, encoding format, and identifier, and the TS stream carries the PT (payload Type, RTP) on the RTP.
  • the value of the PT field in the header is used to identify the payload type. The value is also determined. Therefore, whether TS over UDP or TS over RTP, the receiver can receive the stream and decode it.
  • the technical problem to be solved by the present invention is to provide a streaming media packet loss retransmission implementation method and system to improve streaming media transmission reliability.
  • a streaming media packet loss retransmission implementation method includes:
  • the transmitting end sends the retransmission configuration information by using the same transmission manner as the media code stream, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification identifier;
  • the receiving end When the receiving end detects the packet loss, the receiving end constructs and sends a packet loss feedback message according to the cached retransmission configuration information;
  • the sending end After receiving the packet loss feedback message, the sending end constructs a retransmission packet according to the retransmission configuration information and sends the packet;
  • the receiving end receives the retransmission packet according to the cached retransmission configuration information.
  • the retransmission configuration information further includes a retransmission flow identifier or a retransmission window supported by the server. small.
  • the step of the sending end transmitting the retransmission configuration information by using the same transmission manner as the media code stream includes:
  • the sending end periodically sends the retransmission configuration information.
  • the method also includes:
  • the sending end sends the updated retransmission configuration information;
  • the receiving end constructs a packet loss feedback message according to the updated retransmission configuration information;
  • the transmitting end constructs a retransmission packet according to the updated retransmission configuration information.
  • the retransmission configuration information is sent based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
  • MPEG Moving Picture Experts Group
  • RTP Real Time Transport Protocol
  • a transmitting device for packet loss processing of a streaming media comprising: a transceiver module and a retransmission processing module, wherein: the transceiver module is configured to: transmit retransmission configuration information by using the same transmission mode as the media code stream, and receive and receive the data according to the buffer a packet loss feedback message constructed by retransmitting the configuration information, and sending a retransmission packet, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification identifier;
  • the retransmission processing module is configured to: after receiving the packet loss feedback message, construct the retransmission packet according to the retransmission configuration information.
  • the retransmission configuration information further includes a retransmission flow identifier or a retransmission window size supported by the server.
  • the transceiver module is configured to send retransmission configuration information according to the following manner:
  • the retransmission configuration information is periodically sent.
  • the transceiver module is further configured to: send updated retransmission configuration information;
  • the retransmission processing module is further configured to: construct a retransmission packet according to the updated retransmission configuration information.
  • the retransmission configuration information is sent based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
  • MPEG Moving Picture Experts Group
  • RTP Real Time Transport Protocol
  • a receiving device for streaming packet loss processing comprising a second transceiver module and a packet loss feedback message construction module, wherein:
  • the second transceiver module is configured to: receive, by the sending end, the retransmission configuration information sent by using the same transmission mode as the media code stream, and configure the retransmission configuration information, and send the packet loss feedback message to the sending end, And receiving, according to the retransmitted configuration information of the cache, a retransmission packet configured according to the retransmission configuration information after the sending end receives the packet loss feedback message, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification Identification
  • the packet loss feedback message constructing module is configured to: when the packet loss is detected, construct the packet loss feedback message according to the cached retransmission configuration information.
  • the retransmission configuration information further includes a retransmission flow identifier or a retransmission window size supported by the server. among them:
  • the packet loss feedback message constructing module is further configured to: construct a packet loss feedback message according to the updated retransmission configuration information sent by the sending end.
  • the retransmission configuration information is sent based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
  • MPEG Moving Picture Experts Group
  • RTP Real Time Transport Protocol
  • a streaming media packet loss retransmission implementation system comprising: any one of the transmitting devices as described above and any one of the receiving devices described above.
  • a streaming media packet loss retransmission implementation system where the system includes a transmitting end and a receiving end, where the transmitting end includes a transceiver module and a retransmission processing module, where:
  • the transceiver module is configured to: transmit retransmission configuration information, receive a packet loss feedback message, and send a retransmission packet by using the same transmission manner as the media code stream, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification Identification
  • the retransmission processing module is configured to: after receiving the packet loss feedback message, construct the retransmission packet according to the retransmission configuration information;
  • the receiving end includes a second transceiver module and a packet loss feedback message construction module, where: The second transceiver module is configured to: receive and configure the retransmission configuration information, send the packet loss feedback message, and receive the retransmission packet according to the buffered retransmission configuration information;
  • the packet loss feedback message constructing module is configured to: when the packet loss is detected, construct the packet loss feedback message according to the cached retransmission configuration information.
  • the retransmission configuration information further includes a retransmission flow identifier or a retransmission window size supported by the server.
  • the transceiver module is configured to send retransmission configuration information according to the following manner:
  • the retransmission configuration information is periodically sent.
  • the transceiver module is further configured to: send updated retransmission configuration information;
  • the packet loss feedback message constructing module is further configured to: construct a packet loss feedback message according to the updated retransmission configuration information;
  • the retransmission processing module is further configured to: construct a retransmission packet according to the updated retransmission configuration information.
  • the retransmission configuration information is sent based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
  • MPEG Moving Picture Experts Group
  • RTP Real Time Transport Protocol
  • the foregoing technical solution transmits the retransmission configuration information in an in-band manner, so that as long as the receiving end can receive the media code stream, the corresponding retransmission configuration information can be obtained, and the dynamic update of the information can be conveniently implemented.
  • FIG. 1 is a schematic diagram of a method for implementing packet loss retransmission of a streaming media according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a code stream for transmitting retransmission configuration information by using an RTP channel
  • 3 is an RTP extension header structure for transmitting retransmission configuration information
  • 4 is a data structure for transmitting a retransmission configuration information parameter in an RTP packet
  • FIG. 5 is a schematic structural diagram of a module of a streaming media packet loss retransmission implementation system according to an embodiment of the present invention. Preferred embodiment of the invention
  • the embodiment of the present invention transmits the retransmission configuration information in an in-band manner, so that as long as the receiving end can receive the media code stream, the corresponding retransmission configuration information can be obtained, and the dynamic update of the information can be conveniently implemented.
  • the method for implementing packet loss retransmission in the embodiment of the present invention includes:
  • Step 101 The sending end sends the retransmission configuration information by using the same transmission mode as the media code stream.
  • the transmitting end encapsulates and packs the retransmission configuration information, and sends the retransmission configuration information by using the same transmission mode as the media code stream.
  • the retransmission configuration information may be carried by adding a relevant field in the media data packet, or by defining a new data packet format, and then multiplexing the transmission channel of the media code stream, and transmitting with the media code stream. This program does not limit this.
  • the retransmission configuration information includes but is not limited to including the following information:
  • Retransmission Specification Identifiers can have different retransmission packet formats, as well as mapping rules for retransmitting packets to the original packet. This parameter is mandatory so that the receiver can correctly parse the retransmission packet. ;
  • the feedback specifications followed identify different feedback specifications and can have different feedback message formats and feedback mechanisms. This parameter is required for the receiving end to correctly construct and send the packet loss feedback message;
  • the size of the retransmission window supported by the server - the server provides a retransmission service for the data packets in the retransmission window.
  • the receiving end may determine, according to the parameter, whether it is necessary to initiate a packet loss retransmission request to minimize the transmission of the invalid feedback message. When this parameter is missing, the receiving end can make decisions according to its own policy, as well as the current network status and cache play status of the receiving end. Correct In the case of the live stream, the retransmission configuration information may be periodically sent to ensure that the receiving end of the new access can obtain related information in time.
  • the sender constructs the relevant information according to the new parameters, and then sends the updated information as described above.
  • Step 102 The receiving end receives and configures the retransmission configuration information.
  • the receiving end When receiving the media code stream, the receiving end also receives the retransmission configuration information transmitted in the same manner as the media code stream, and the receiving end parses the information, and configures according to the configuration, specifically, the receiving end records the information locally. It can be saved in memory, for example, directly modifying the parameters of related object instances in the program, or it can be recorded on a storage device, such as a file.
  • the specific configuration mode is determined by the specific implementation of the receiving end. As long as the receiving end can ensure that the media stream can be processed according to the information obtained here. .
  • Step 103 When the receiving end detects the packet loss, the receiving end constructs and sends a packet loss feedback message according to the cached retransmission configuration information.
  • the receiving end After receiving the updated retransmission configuration information, the receiving end updates the cached retransmission configuration information and processes the updated parameters.
  • the packet loss feedback message is also referred to as an automatic retransmission request message.
  • Step 104 After receiving the packet loss feedback message, the sending end constructs a retransmission packet according to the retransmission configuration information and sends the packet.
  • the server After receiving the packet loss feedback from the receiving end, the server obtains the specified media packet from the history cache, constructs a retransmission packet according to the manner specified in the retransmission configuration information, and sends the packet to the receiving end.
  • Step 105 The receiving end receives the retransmission packet according to the cached retransmission configuration information.
  • the sending end sends the updated retransmission configuration information, and the sending end and the receiving end respectively construct a packet loss feedback message and a retransmission packet according to the updated retransmission configuration information.
  • the retransmission configuration information may be transmitted based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
  • MPEG Moving Picture Experts Group
  • RTP Real Time Transport Protocol
  • This embodiment implements the in-band mode to transmit retransmission configuration information on the basis of MPEG-2 TS.
  • ⁇ MPEG-2 TS is extended with the following technical solutions:
  • the uimsbf in the table indicates unsigned integer (mostly significant bit first, see the related definition in ISO/IEC13818-1 for details), the same below.
  • descriptor_tag 129, indicating that the descriptor is arq_signal_descriptor.
  • Other fields have the following meanings:
  • Descriptor_length indicates the length of the arq_signal_descriptor, see
  • Rtx window — Indicates the size of the retransmission window supported by the server, which is a 32-bit number in milliseconds.
  • the retransmission data packet is transmitted as a separate ES (Elementary Stream), and the PID is separately allocated to be distinguished from the feedback packet and the media packet. So you need to add a stream_type type to identify the retransmission stream, for example, 3 ⁇ 4. Stream—the type is OxFD, the table Show that the corresponding PID stream is used to transmit the retransmission packet;
  • descriptor_tag 129, indicating that the descriptor is arq_label_descriptor.
  • Other fields have the following meanings:
  • the retransmission packet needs to contain information about the original media packet, so that the receiving end associates the retransmission packet with the original packet. For example, it can be defined as follows:
  • Table_ id 8 uimsbf section— syntax—indicator 1 bslbf private—indicator 1 bslbf reserved 2 bslbf private— section—length 12 uimsbf rtx_packet— number 8 uimsbf for(i 0; i ⁇ rtx_packet number; i++) uimsbf
  • the bslbf in the table indicates the bit string (Bit string, left bit first, see the related definition in ISO/IEC13818-1 for details).
  • Rpchof denotes the coefficient of the remainder polynomial coefficients (Remainder polynomial coefficients, highest order first, see the relevant definition in the ISO/IEC13818-1 standard). The same as below.
  • Table_id is used to mark i.
  • the section type is arq_packet_section, and the value is OxFl; the section-syntax_indicator has a value of 0. For the meaning, see MPEG-2 TS standard.
  • Private_section_length — indicates the length of the data in the arq_packet_ section after the private_section_length field
  • Rtx_packet_ number indicates the number of retransmission packets contained in the arq_packet_ section; orig_pid - indicates the PID of the corresponding source TS packet;
  • Orig_packet_id - indicates the identity of the corresponding source TS packet, see the related description in the packet loss feedback message
  • Orig_packet_length - indicates the length of the corresponding source TS packet. After this field, it is the source TS packet data of the retransmission;
  • Packet_ id - indicates the identifier of the first TS packet that is lost.
  • the identifier needs to be guaranteed to be unique to the TS packets in the same PID stream within a certain time range, and the sequence is incremented. Since the CC field of the TS packet wraps around too fast, it is not suitable for identification when the packet is fed back unless it is extended. This may require the server to add an additional identifier field in the original TS packet. For example, the private_data field of the TS may be used to add the identifier;
  • Mask_ length - used to indicate the length of the following mask field, in bytes; mask_ byte - mask field, each bit corresponds to a TS packet. That is, starting from the data packet identified by packet_id, the data packet within the subsequent mask range, if a loss occurs, the corresponding bit position in the mask is 1;
  • the processing flow of the sender (such as a streaming media server) and the receiving end (such as a terminal) is as follows:
  • the relevant regulations for PMT transmission can follow the relevant provisions of MPEG-2 TS. Since the retransmission signaling is sent along with the PMT, it can ensure that the new access receiver can obtain relevant information in time. The update of the retransmission signaling can also be ensured. (2) After receiving the packet loss information fed back by the receiving end, the corresponding original TS packet is obtained from the history buffer, packaged and packaged according to regulations, and then multiplexed into the TS. Sent in the stream.
  • the packet loss feedback is constructed according to the specified feedback specification.
  • the retransmission signaling is transmitted through the RTP/RTCP, and the in-band mode retransmission configuration information is implemented.
  • the related retransmission configuration information can be encapsulated in the RTP/RTCP packet and transmitted through the RTP/RTCP channel.
  • Figure 2 shows an illustration of the transmission of retransmission configuration information using the RTP channel.
  • the retransmitted RTP packet can be used as an RTP stream, multiplexed with the RTP channel of the media stream, or transmitted using the new RTP channel.
  • RTP extension header to identify which specification the RTP packet format that conveys the retransmission configuration information follows. Only valid when the PT value is equal to 126.
  • the extension header definition is shown in Figure 3, following the relevant definition of RFC3550.
  • the defined by profile field can be set to a special value, such as the ASCII character "RT”, to indicate the corresponding RTP payload, which is used to pass the retransmission configuration information.
  • the different values of the Identifier field in the extension header indicate the corresponding specifications, and different specifications may correspond to different RTP packet format definitions. For example, when the value of the Identifier is ASCII character "ZARQ", the format of the retransmission configuration information carried in the following RTP payload is in accordance with the relevant provisions in this embodiment;
  • TLV Type-Length-Value
  • the RTP packet carrying the retransmission configuration information may be periodically sent; when the retransmission configuration information changes, according to the changed retransmission Configuration information, construct a message packet in RTP format, and then send it according to the above rules.
  • the corresponding original RTP packet is obtained from the history buffer, encapsulated and packaged according to the regulations, and then multiplexed by the RTP channel for transmission, or sent through the RTCP channel.
  • the embodiment of the present invention further provides a streaming media packet loss retransmission implementation system.
  • the system includes a transmitting end and a receiving end, where:
  • the sending end includes a transceiver module and a retransmission processing module, where:
  • the transceiver module is configured to: send retransmission configuration information by using the same transmission mode as the media code stream, receive a packet loss feedback message, and send a retransmission packet;
  • the retransmission processing module is configured to: after receiving the packet loss feedback message, construct a retransmission packet according to the retransmission configuration information;
  • the receiving end includes a second transceiver module and a packet loss feedback message constructing module, where: the second transceiver module is configured to: receive and configure the retransmission configuration information, detect packet loss, and send the packet loss feedback message, And receiving the retransmission packet according to the cached retransmission configuration information.
  • the packet loss feedback message constructing module is configured to: when the packet loss is detected, construct the packet loss feedback message according to the cached retransmission configuration information.
  • the retransmission configuration information includes a feedback specification identifier and a retransmission specification identifier.
  • the retransmission configuration information further includes a retransmission stream identifier or a retransmission window size supported by the server.
  • the sending end may periodically send the retransmission configuration information.
  • the transceiver module of the sending end sends the updated retransmission configuration information, and the packet loss feedback message constructing module of the receiving end and the retransmission processing module of the transmitting end according to the updated retransmission module.
  • the configuration information constructs a packet loss feedback message and a retransmission packet, respectively.
  • the retransmission configuration information is transmitted based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP) as previously described.
  • MPEG Moving Picture Experts Group
  • RTP Real Time Transport Protocol
  • the user can conveniently obtain the relevant retransmission configuration information while receiving the media code stream. Therefore, packet loss feedback and retransmission packet reception and repair are smoothly implemented.
  • the server can also notify the receiving end in time to make corresponding adjustments.
  • the above technical solution transmits the retransmission configuration information in an in-band manner, so that as long as the receiving end can receive the media code stream, the corresponding retransmission configuration information can be obtained, and the information can be dynamically updated. Therefore, the present invention has industrial utility.

Abstract

A method and system for streaming media lost package retransmission, the method comprising: a transmitter sending retransmission configuration information in the same transmission manner as for media code stream, the retransmission configuration information including a feedback specification identifier and a retransmission specification identifier; a receiver receiving and configuring the retransmission configuration information; the receiver, when detecting a lost package, constructing and sending a lost package feedback message according to the buffered retransmission configuration information; the transmitter constructing and sending a retransmission package according to the retransmission configuration information after receiving the lost package feedback message; the receiver receiving the retransmission package according to the buffered retransmission configuration information. Reliability of streaming media transmission can be improved by means of the above technical solution.

Description

流媒体丢包重传实现方法和系统  Streaming media packet loss retransmission implementation method and system
技术领域 Technical field
本发明涉及流媒体技术领域, 更具体地, 涉及一种流媒体应用中, 流媒 体丟包重传实现的方法和系统。 背景技术  The present invention relates to the field of streaming media technologies, and more particularly to a method and system for implementing streaming media packet loss retransmission in a streaming media application. Background technique
随着宽带网的普及和多媒体技术的发展, 流媒体技术的应用也越来越广 泛, 如数字广播业务、 交互式网络电视(IPTV )业务、 移动流媒体业务等。 这些业务的共同特点, 都是将多媒体数据按一定规则封装打包后, 通过底层 的通信网络, 进行数据的分发。 例如 IPTV应用中, 使用传输流承载在实时传 输协议上 ( TS over RTP, Transport Stream over Real-time Transport Protocol ) 或者传输流承载在用户数据报协议上(TS over UDP, Transport Stream over User Datagram Protocol ) 的方式, 通过 IP网络进行分发。 数字广播领域, 更 是将传输流(TS, Transport Stream )直接承载在链路层上进行数据的分发。 由于底层网络的传输不可靠性, 将不可避免的存在数据包发生误码、 丟失等 情况。 此时, 可以通过接收端提出丟包重传的反馈请求, 发送端将丟失或错 误的数据包重新发送给接收端, 来解决这个问题。  With the popularization of broadband networks and the development of multimedia technologies, the application of streaming media technologies has become more and more extensive, such as digital broadcasting services, interactive network television (IPTV) services, and mobile streaming media services. The common feature of these services is that the multimedia data is packaged and packaged according to certain rules, and the data is distributed through the underlying communication network. For example, in an IPTV application, a transport stream is carried over a real-time transport protocol (TS over RTP, Transport Stream over Real-time Transport Protocol) or a transport stream is carried over a User Datagram Protocol (TS over UDP, Transport Stream over User Datagram Protocol). The way to distribute through the IP network. In the field of digital broadcasting, the transport stream (TS, Transport Stream) is directly carried on the link layer for data distribution. Due to the unreliable transmission of the underlying network, there will inevitably be a case where the data packet is mis-coded or lost. At this time, the receiving end may propose a feedback request for packet loss retransmission, and the transmitting end resends the lost or erroneous data packet to the receiving end to solve the problem.
要做丟包重传, 就需要接收端能够向发送端反馈所丟失的数据包信息, 同时也需要能从发送端发送的码流中识别出正常的码流和重传的码流。 而运 动图像专家组( MPEG-2 , Moving Pictures Experts Group M专输流( TS , Transport Stream )规范最初设计出来, 只是用于数据广播领域, 缺乏这种丟包信令的 通知和反馈机制。  To perform packet loss retransmission, the receiving end needs to feed back the lost data packet information to the transmitting end, and also needs to be able to identify the normal code stream and the retransmitted code stream from the code stream sent by the transmitting end. The Motion Picture Experts Group (MPEG-2, Moving Pictures Experts Group M Transport Stream (TS) specification was originally designed for data broadcasting, lacking notification and feedback mechanisms for such packet loss signaling.
目前常见的做法, 是通过将 TS承载在实时传输协议(RTP, Real-time Transport protocol ) 上, 然后通过实时流协议 ( RTSP, Real-time Streaming Protocol ) /RTP 的架构, 以带外的方式提供丟包重传的信令通知和反馈。 即 首先通过 SDP的方式, 通知接收端, 系统支持的重传规范, 包括丟包反馈的 方式、 重传码流的传输通道和格式等。 接收端检测到数据包丟失后, 则通过 实时传送控制协议( RTCP, Real-time Transport Control Protocol )或 RTSP的 方式, 向发送端反馈。 The current common practice is to provide the TS in an out-of-band manner by hosting the TS on the Real-time Transport Protocol (RTP) and then implementing the Real-time Streaming Protocol (RTSP) architecture. Signaling notification and feedback for packet loss retransmission. That is, the SDP is first used to notify the receiving end of the retransmission specifications supported by the system, including the method of packet loss feedback, the transmission channel and format of the retransmission code stream. After the receiver detects the loss of the packet, it passes the Real-time Transport Control Protocol (RTCP) or RTSP. Way, feedback to the sender.
但是在某些情况下, 接收端可能缺少这种通过 SDP等带外方式获取重传 规范等信息的手段。 例如目前很多 IPTV应用中,对于直播频道,接收端通常 只能获取到对应于频道码流的一个组播地址和端口。由于 TS的节目特定信息 ( PSI, Program Specific Information ) 中包含有内部各个媒体流的详细信息, 例如媒体流类型、 编码格式、 标识等信息, 而且 TS流承载在 RTP上的 PT ( Payload Type, RTP包头中的 PT字段, 用于标识负载类型)值也是确定的, 所以无论是 TS over UDP还是 TS over RTP ,这种方式接收端都可以正常接收 码流并解码播放。 没有 RTSP链接, 没有 SDP, 则上述的重传规范等信息, 接收端都无从获取。 而且, 当该信息有变化时, 也无法及时通知接收端。 另 夕卜,依靠 RTSP/RTCP的方式, 反馈丟包信息, 也存在需要维护多个链接的问 题, 在有 NAT防火墙时, 问题也比较多, 处理比较复杂。  However, in some cases, the receiving end may lack such means to obtain information such as retransmission specifications through an out-of-band method such as SDP. For example, in many IPTV applications, for a live channel, the receiving end usually only obtains a multicast address and port corresponding to the channel code stream. The Program Specific Information (PSI) of the TS includes detailed information of each internal media stream, such as media stream type, encoding format, and identifier, and the TS stream carries the PT (payload Type, RTP) on the RTP. The value of the PT field in the header is used to identify the payload type. The value is also determined. Therefore, whether TS over UDP or TS over RTP, the receiver can receive the stream and decode it. If there is no RTSP link and no SDP, the above retransmission specifications and other information are not available to the receiving end. Moreover, when the information changes, the receiving end cannot be notified in time. In addition, relying on RTSP/RTCP to feedback packet loss information also has the problem of maintaining multiple links. When there is a NAT firewall, there are more problems and more complicated processing.
发明内容 Summary of the invention
本发明要解决的技术问题是提供一种流媒体丟包重传实现方法和系统, 以提高流媒体传输可靠性。  The technical problem to be solved by the present invention is to provide a streaming media packet loss retransmission implementation method and system to improve streaming media transmission reliability.
为解决以上技术问题, 釆用如下技术方案: 一种流媒体丟包重传实现方法, 该方法包括:  To solve the above technical problem, the following technical solutions are used: A streaming media packet loss retransmission implementation method, the method includes:
发送端釆用与媒体码流相同的传输方式发送重传配置信息, 所述重传配 置信息包括反馈规范标识及重传规范标识;  The transmitting end sends the retransmission configuration information by using the same transmission manner as the media code stream, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification identifier;
接收端接收并配置所述重传配置信息;  Receiving and configuring the retransmission configuration information by the receiving end;
所述接收端检测到丟包时, 按照緩存的重传配置信息构造并发送丟包反 馈消息;  When the receiving end detects the packet loss, the receiving end constructs and sends a packet loss feedback message according to the cached retransmission configuration information;
所述发送端接收所述丟包反馈消息后, 根据所述重传配置信息构造重传 包并发送;  After receiving the packet loss feedback message, the sending end constructs a retransmission packet according to the retransmission configuration information and sends the packet;
所述接收端根据緩存的重传配置信息接收所述重传包。 其中: 所述重传配置信息还包括重传流标识或服务器支持的重传窗口大 小。 其中, 所述发送端釆用与媒体码流相同的传输方式发送重传配置信息的 步骤包括: The receiving end receives the retransmission packet according to the cached retransmission configuration information. The retransmission configuration information further includes a retransmission flow identifier or a retransmission window supported by the server. small. The step of the sending end transmitting the retransmission configuration information by using the same transmission manner as the media code stream includes:
所述发送端周期性发送所述重传配置信息。 该方法还包括:  The sending end periodically sends the retransmission configuration information. The method also includes:
所述重传配置信息有修改时, 所述发送端发送更新后的重传配置信息; 所述接收端根据更新后的重传配置信息构造丟包反馈消息;  When the retransmission configuration information is modified, the sending end sends the updated retransmission configuration information; the receiving end constructs a packet loss feedback message according to the updated retransmission configuration information;
所述发送端根据更新后的重传配置信息构造重传包。 其中: 所述重传配置信息基于扩展的运动图像专家组(MPEG )协议或 扩展的实时传输协议( RTP )发送。 一种流媒体丟包处理的发送装置, 包括收发模块和重传处理模块, 其中: 所述收发模块设置成: 釆用与媒体码流相同的传输方式发送重传配置信 息, 接收接收端根据緩存的重传配置信息构造的丟包反馈消息, 以及发送重 传包, 其中所述重传配置信息包括反馈规范标识及重传规范标识;  The transmitting end constructs a retransmission packet according to the updated retransmission configuration information. Wherein: the retransmission configuration information is sent based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP). A transmitting device for packet loss processing of a streaming media, comprising: a transceiver module and a retransmission processing module, wherein: the transceiver module is configured to: transmit retransmission configuration information by using the same transmission mode as the media code stream, and receive and receive the data according to the buffer a packet loss feedback message constructed by retransmitting the configuration information, and sending a retransmission packet, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification identifier;
所述重传处理模块设置成: 在接收到所述丟包反馈消息后, 根据所述重 传配置信息构造所述重传包。 其中: 所述重传配置信息还包括重传流标识或服务器支持的重传窗口大 小。 其中: 所述收发模块设置成按照以下方式发送重传配置信息:  The retransmission processing module is configured to: after receiving the packet loss feedback message, construct the retransmission packet according to the retransmission configuration information. The retransmission configuration information further includes a retransmission flow identifier or a retransmission window size supported by the server. The transceiver module is configured to send retransmission configuration information according to the following manner:
周期性发送所述重传配置信息。 其中: 所述收发模块还设置成: 发送更新后的重传配置信息;  The retransmission configuration information is periodically sent. The transceiver module is further configured to: send updated retransmission configuration information;
所述重传处理模块还设置成: 根据更新后的重传配置信息构造重传包。 其中: 所述重传配置信息基于扩展的运动图像专家组(MPEG )协议或 扩展的实时传输协议(RTP )发送。 一种流媒体丟包处理的接收装置, 包括第二收发模块及丟包反馈消息构 造模块, 其中: The retransmission processing module is further configured to: construct a retransmission packet according to the updated retransmission configuration information. Wherein: the retransmission configuration information is sent based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP). A receiving device for streaming packet loss processing, comprising a second transceiver module and a packet loss feedback message construction module, wherein:
所述第二收发模块设置成: 接收发送端釆用与媒体码流相同的传输方式 发送的重传配置信息并配置所述重传配置信息, 向所述发送端发送所述丟包 反馈消息, 以及根据緩存的重传配置信息接收所述发送端接收到所述丟包反 馈消息后根据所述重传配置信息构造的重传包; 其中所述重传配置信息包括 反馈规范标识及重传规范标识;  The second transceiver module is configured to: receive, by the sending end, the retransmission configuration information sent by using the same transmission mode as the media code stream, and configure the retransmission configuration information, and send the packet loss feedback message to the sending end, And receiving, according to the retransmitted configuration information of the cache, a retransmission packet configured according to the retransmission configuration information after the sending end receives the packet loss feedback message, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification Identification
所述丟包反馈消息构造模块设置成: 在检测到丟包时, 按照緩存的重传 配置信息构造所述丟包反馈消息。 其中: 所述重传配置信息还包括重传流标识或服务器支持的重传窗口大 小。 其中:  The packet loss feedback message constructing module is configured to: when the packet loss is detected, construct the packet loss feedback message according to the cached retransmission configuration information. The retransmission configuration information further includes a retransmission flow identifier or a retransmission window size supported by the server. among them:
所述丟包反馈消息构造模块还设置成: 根据发送端发送的更新后的重传 配置信息构造丟包反馈消息。 其中: 所述重传配置信息基于扩展的运动图像专家组(MPEG )协议或 扩展的实时传输协议(RTP )发送。 一种流媒体丟包重传实现系统, 该系统包括: 如上所述的任意一种发送装置和如上所述的任意一种接收装置。 一种流媒体丟包重传实现系统, 该系统包括发送端和接收端, 其中, 所 述发送端包括收发模块和重传处理模块, 其中:  The packet loss feedback message constructing module is further configured to: construct a packet loss feedback message according to the updated retransmission configuration information sent by the sending end. Wherein: the retransmission configuration information is sent based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP). A streaming media packet loss retransmission implementation system, comprising: any one of the transmitting devices as described above and any one of the receiving devices described above. A streaming media packet loss retransmission implementation system, where the system includes a transmitting end and a receiving end, where the transmitting end includes a transceiver module and a retransmission processing module, where:
所述收发模块设置成: 釆用与媒体码流相同的传输方式发送重传配置信 息, 接收丟包反馈消息, 以及发送重传包, 其中所述重传配置信息包括反馈 规范标识及重传规范标识;  The transceiver module is configured to: transmit retransmission configuration information, receive a packet loss feedback message, and send a retransmission packet by using the same transmission manner as the media code stream, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification Identification
所述重传处理模块设置成: 在接收到所述丟包反馈消息后, 根据所述重 传配置信息构造所述重传包;  The retransmission processing module is configured to: after receiving the packet loss feedback message, construct the retransmission packet according to the retransmission configuration information;
所述接收端包括第二收发模块和丟包反馈消息构造模块, 其中: 所述第二收发模块设置成: 接收并配置所述重传配置信息, 发送所述丟 包反馈消息, 以及根据緩存的重传配置信息接收所述重传包; The receiving end includes a second transceiver module and a packet loss feedback message construction module, where: The second transceiver module is configured to: receive and configure the retransmission configuration information, send the packet loss feedback message, and receive the retransmission packet according to the buffered retransmission configuration information;
所述丟包反馈消息构造模块设置成: 在检测到丟包时, 按照緩存的重传 配置信息构造所述丟包反馈消息。 其中: 所述重传配置信息还包括重传流标识或服务器支持的重传窗口大 小。 其中: 所述收发模块设置成按照以下方式发送重传配置信息:  The packet loss feedback message constructing module is configured to: when the packet loss is detected, construct the packet loss feedback message according to the cached retransmission configuration information. The retransmission configuration information further includes a retransmission flow identifier or a retransmission window size supported by the server. The transceiver module is configured to send retransmission configuration information according to the following manner:
周期性发送所述重传配置信息。 其中: 所述收发模块还设置成: 发送更新后的重传配置信息;  The retransmission configuration information is periodically sent. The transceiver module is further configured to: send updated retransmission configuration information;
所述丟包反馈消息构造模块还设置成: 根据所述更新后的重传配置信息 构造丟包反馈消息;  The packet loss feedback message constructing module is further configured to: construct a packet loss feedback message according to the updated retransmission configuration information;
所述重传处理模块还设置成: 根据所述更新后的重传配置信息构造重传 包。  The retransmission processing module is further configured to: construct a retransmission packet according to the updated retransmission configuration information.
其中: 所述重传配置信息基于扩展的运动图像专家组(MPEG )协议或 扩展的实时传输协议 ( RTP )发送。  Wherein: the retransmission configuration information is sent based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
上述技术方案通过带内方式传递重传配置信息, 这样只要接收端能够收 到媒体码流, 就可以获取到相应的重传配置信息, 并可以方便的实现该信息 的动态更新。 The foregoing technical solution transmits the retransmission configuration information in an in-band manner, so that as long as the receiving end can receive the media code stream, the corresponding retransmission configuration information can be obtained, and the dynamic update of the information can be conveniently implemented.
附图概述 BRIEF abstract
图 1 是本发明实施例的流媒体丟包重传实现方法的示意图;  1 is a schematic diagram of a method for implementing packet loss retransmission of a streaming media according to an embodiment of the present invention;
图 2 是利用 RTP通道传输重传配置信息的码流示意图;  2 is a schematic diagram of a code stream for transmitting retransmission configuration information by using an RTP channel;
图 3是用于传递重传配置信息的 RTP扩展头结构;  3 is an RTP extension header structure for transmitting retransmission configuration information;
图 4是用于在 RTP包中传递重传配置信息参数的数据结构;  4 is a data structure for transmitting a retransmission configuration information parameter in an RTP packet;
图 5是本发明实施例的流媒体丟包重传实现系统的模块结构示意图。 本发明的较佳实施方式 FIG. 5 is a schematic structural diagram of a module of a streaming media packet loss retransmission implementation system according to an embodiment of the present invention. Preferred embodiment of the invention
本发明的实施方式通过带内方式传递重传配置信息, 这样只要接收端能 够收到媒体码流, 就可以获取到相应的重传配置信息, 并可以方便的实现该 信息的动态更新。  The embodiment of the present invention transmits the retransmission configuration information in an in-band manner, so that as long as the receiving end can receive the media code stream, the corresponding retransmission configuration information can be obtained, and the dynamic update of the information can be conveniently implemented.
下文中将结合附图对本发明的实施例进行详细说明。 需要说明的是, 在 不冲突的情况下, 本申请中的实施例及实施例中的特征可以相互组合。  Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.
如图 1所示, 本发明实施例的流媒体丟包重传实现方法包括:  As shown in FIG. 1, the method for implementing packet loss retransmission in the embodiment of the present invention includes:
步骤 101 : 发送端釆用与媒体码流相同的传输方式发送重传配置信息; 发送端将重传配置信息进行封装打包, 釆用与媒体码流相同的传输方式 发送所述重传配置信息。 重传配置信息可以通过在媒体数据包中增加相关字 段携带, 也可以通过定义新的数据包格式, 然后复用媒体码流的传输通道的 方式, 随媒体码流发送。 本方案对此不作限制。  Step 101: The sending end sends the retransmission configuration information by using the same transmission mode as the media code stream. The transmitting end encapsulates and packs the retransmission configuration information, and sends the retransmission configuration information by using the same transmission mode as the media code stream. The retransmission configuration information may be carried by adding a relevant field in the media data packet, or by defining a new data packet format, and then multiplexing the transmission channel of the media code stream, and transmitting with the media code stream. This program does not limit this.
其中重传配置信息包括但不限于包括如下信息:  The retransmission configuration information includes but is not limited to including the following information:
重传规范标识——不同的重传规范可以有不同的重传包格式, 以及重传 包到原始包的映射规则。 该参数是必选的, 以便接收端可以正确的解析重传 包。 ;  Retransmission Specification Identifiers - Different retransmission specifications can have different retransmission packet formats, as well as mapping rules for retransmitting packets to the original packet. This parameter is mandatory so that the receiver can correctly parse the retransmission packet. ;
所遵循的反馈规范标识一一不同的反馈规范, 可以有不同的反馈消息格 式和反馈机制。 该参数是必须的, 以便接收端正确地构造和发送丟包反馈消 息;  The feedback specifications followed identify different feedback specifications and can have different feedback message formats and feedback mechanisms. This parameter is required for the receiving end to correctly construct and send the packet loss feedback message;
重传流标识——如果缺少了该参数, 接收端可以通过排除所有可以识别 的码流, 来识别出重传流, 但是存在干扰码流的时候, 可能会导致误判。 所 以优选地在重传配置信息中始终包含该参数, 以便接收端能够明确识别出重 传码流;  Re-transmitting stream identification - If this parameter is missing, the receiving end can identify the retransmission stream by excluding all identifiable code streams, but when there is interference stream, it may lead to misjudgment. Therefore, the parameter is always included in the retransmission configuration information, so that the receiving end can clearly identify the retransmission code stream;
服务器支持的重传窗口大小一一服务器对处于重传窗口内的数据包提供 重传服务。 优选地, 接收端可以根据该参数判断, 是否有必要发起丟包重传 请求, 以尽量减少无效的反馈消息的发送。 当缺少该参数时, 接收端可以根 据自己的策略, 以及接收端当前的网络状况和緩存播放状态等进行决策。 对 于直播码流的情况, 该重传配置信息可以周期性的发送, 以保证新接入的接 收端可以及时获取到相关信息。 The size of the retransmission window supported by the server - the server provides a retransmission service for the data packets in the retransmission window. Preferably, the receiving end may determine, according to the parameter, whether it is necessary to initiate a packet loss retransmission request to minimize the transmission of the invalid feedback message. When this parameter is missing, the receiving end can make decisions according to its own policy, as well as the current network status and cache play status of the receiving end. Correct In the case of the live stream, the retransmission configuration information may be periodically sent to ensure that the receiving end of the new access can obtain related information in time.
当重传配置信息有修改更新时, 发送端按照新的参数构造相关信息, 然 后按上述方式发送更新后的信息。  When the retransmission configuration information is modified and updated, the sender constructs the relevant information according to the new parameters, and then sends the updated information as described above.
步骤 102: 接收端接收并配置所述重传配置信息;  Step 102: The receiving end receives and configures the retransmission configuration information.
接收端接收媒体码流的同时, 也会接收到与媒体码流釆用相同方式传送 的重传配置信息, 接收端解析该信息, 并据此进行配置, 具体指接收端在本 地记录这些信息, 可以保存在内存中, 例如直接修改程序中相关对象实例的 参数, 也可以是记录在存储设备上, 例如文件中。 具体配置方式由接收端的 具体实现决定。 只要保证接收端后续能按照这里获取到的信息处理媒体码流 即可。 。  When receiving the media code stream, the receiving end also receives the retransmission configuration information transmitted in the same manner as the media code stream, and the receiving end parses the information, and configures according to the configuration, specifically, the receiving end records the information locally. It can be saved in memory, for example, directly modifying the parameters of related object instances in the program, or it can be recorded on a storage device, such as a file. The specific configuration mode is determined by the specific implementation of the receiving end. As long as the receiving end can ensure that the media stream can be processed according to the information obtained here. .
步骤 103 : 所述接收端检测到丟包时, 按照緩存的重传配置信息构造并 发送丟包反馈消息;  Step 103: When the receiving end detects the packet loss, the receiving end constructs and sends a packet loss feedback message according to the cached retransmission configuration information.
如接收端接收到更新后的重传配置信息后,则更新緩存的重传配置信息, 并按照更新后的参数进行处理。  After receiving the updated retransmission configuration information, the receiving end updates the cached retransmission configuration information and processes the updated parameters.
丟包反馈消息也称为自动重传请求消息。  The packet loss feedback message is also referred to as an automatic retransmission request message.
步骤 104: 所述发送端接收到所述丟包反馈消息后, 根据所述重传配置 信息构造重传包并发送;  Step 104: After receiving the packet loss feedback message, the sending end constructs a retransmission packet according to the retransmission configuration information and sends the packet.
服务器收到接收端的丟包反馈后, 从历史緩存中获取指定的媒体包, 按 重传配置信息中指定的方式, 构造重传包, 发送给接收端。  After receiving the packet loss feedback from the receiving end, the server obtains the specified media packet from the history cache, constructs a retransmission packet according to the manner specified in the retransmission configuration information, and sends the packet to the receiving end.
步骤 105: 所述接收端根据緩存的重传配置信息接收所述重传包。  Step 105: The receiving end receives the retransmission packet according to the cached retransmission configuration information.
所述重传配置信息有修改时, 所述发送端发送更新后的重传配置信息, 所述发送端和接收端根据所述更新后的重传配置信息分别构造丟包反馈消息 和重传包。  When the retransmission configuration information is modified, the sending end sends the updated retransmission configuration information, and the sending end and the receiving end respectively construct a packet loss feedback message and a retransmission packet according to the updated retransmission configuration information. .
所述重传配置信息可以基于扩展的运动图像专家组(MPEG )协议或扩 展的实时传输协议(RTP )发送。  The retransmission configuration information may be transmitted based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
以下就这两种协议的扩展分别给出具体实施例: 实施例 1 Specific examples are given below for the extension of these two protocols: Example 1
本实施例在 MPEG-2 TS基础上,实现带内方式传递重传配置信息。例如, 釆用如下的技术方案对 MPEG-2 TS作扩展:  This embodiment implements the in-band mode to transmit retransmission configuration information on the basis of MPEG-2 TS. For example, 扩展 MPEG-2 TS is extended with the following technical solutions:
1、 在节目映射表 ( PMT, Program Map Table)中增加一个节目级别的 arq_signal— descriptor , 定义如下:  1. Add a program level arq_signal_descriptor in the Program Map Table (PMT), defined as follows:
Figure imgf000010_0001
Figure imgf000010_0001
注: 表中的 uimsbf表示无符号整数 ( Unsigned integer, most significant bit first, 具体参见 ISO/IEC13818-1标准中的相关定义) , 以下同。  Note: The uimsbf in the table indicates unsigned integer (mostly significant bit first, see the related definition in ISO/IEC13818-1 for details), the same below.
定义 descriptor— tag: 129, 表明该 descriptor为 arq_signal— descriptor。 其他 各字段的含义如下:  Define descriptor_tag: 129, indicating that the descriptor is arq_signal_descriptor. Other fields have the following meanings:
descriptor— length 表明该 arq_signal— descriptor 的长度, 参见 Descriptor_length indicates the length of the arq_signal_descriptor, see
ISO/IEC13818-1标准中的相关定义; Relevant definitions in the ISO/IEC 13818-1 standard;
arq_profile— identifier —— 表明所釆用的重传规范,例如当为 ASCII字符 "ZARQ" 时, 表明重传包的格式、 传送方式等, 具体参见后续 "重传包格 式" 一节的相关内容;  Arq_profile— identifier —— indicates the retransmission specification used, for example, when the ASCII character is “ZARQ”, indicating the format and transmission mode of the retransmission packet. For details, refer to the related content of the “Retransmission Packet Format” section.
fb_profile— identifier —— 表明所釆用的反馈规范, 例如当为 ASCII字符 "AFBP" 时, 表明反馈消息的格式和反馈方式等, 具体参见后续 "丟包反馈 消息的格式" 一节的相关内容;  Fb_profile— identifier —— indicates the feedback specification used, for example, when the ASCII character is “AFBP”, indicating the format and feedback mode of the feedback message. For details, refer to the related content of the “Format of Packet Loss Feedback Message” section.
rtx— window —— 表明服务器所支持的重传窗口的大小,为一个 32位数, 以毫秒为单位。  Rtx — window — Indicates the size of the retransmission window supported by the server, which is a 32-bit number in milliseconds.
2、 在本实施例中, 重传数据包作为单独的 ES ( Elementary Stream, 基本 码流) 流传送, 单独分配 PID, 以便与反馈包和媒体包区分。 所以需要增加 一个 stream— type类型, 用于标识重传流, 例 ¾。 stream— type值为 OxFD时, 表 示相应的 PID流是用于传送重传包的; 2. In this embodiment, the retransmission data packet is transmitted as a separate ES (Elementary Stream), and the PID is separately allocated to be distinguished from the feedback packet and the media packet. So you need to add a stream_type type to identify the retransmission stream, for example, 3⁄4. Stream—the type is OxFD, the table Show that the corresponding PID stream is used to transmit the retransmission packet;
3、 在 PMT中增加 ES级别的 arq_label— descriptor, 用于给 ES流添加一 个重传标签, 这样可以标识媒体码流与重传码流的对应关系。 标签值相同的 媒体流对应于同一个重传流。 定义如下:  3. Add an ES level arq_label_descriptor to the PMT to add a retransmission label to the ES stream, which can identify the correspondence between the media stream and the retransmission stream. Media streams with the same tag value correspond to the same retransmission stream. The definition is as follows:
Figure imgf000011_0001
Figure imgf000011_0001
其中 descriptor— tag: 129, 表明该 descriptor为 arq_label— descriptor。 其他 各字段的含义如下:  Where descriptor_tag: 129, indicating that the descriptor is arq_label_descriptor. Other fields have the following meanings:
label 一一 标签值, 具有同样标签值的媒体流的数据包, 在重传时, 使 用具有同样标签值的重传流。  Label A tag value, a packet of a media stream having the same tag value, and a retransmission stream having the same tag value when retransmitting.
当该 arqjabel— descriptor()在所有 ES流中都不存在 , JLPMT中 stream— type 为 OxFD的 PID流只有一个时, 表明所有媒体 PID的重传包都通过这个唯一 的重传 PID流传送。  When the arqjabel_descriptor() does not exist in all ES streams, there is only one PID stream with stream_type OxFD in JLPMT, indicating that all media PID retransmission packets are transmitted through this unique retransmission PID stream.
重传包的格式:  Retransmission package format:
重传包中需要包含原始媒体包的相关信息, 以便接收端将重传包和原始 包对应起来。 例如可以作如下定义:  The retransmission packet needs to contain information about the original media packet, so that the receiving end associates the retransmission packet with the original packet. For example, it can be defined as follows:
位数 ( No. 助记符 语法 ( Syntax )  Number of digits ( No. mnemonic syntax ( Syntax )
of bits ) ( Mnemonic ) arq_packet_section() {  Of bits ) ( Mnemonic ) arq_packet_section() {
table— id 8 uimsbf section— syntax— indicator 1 bslbf private— indicator 1 bslbf reserved 2 bslbf private— section— length 12 uimsbf rtx_packet— number 8 uimsbf for(i=0; i<rtx_packet number; i++) uimsbf Table_ id 8 uimsbf section— syntax—indicator 1 bslbf private—indicator 1 bslbf reserved 2 bslbf private— section—length 12 uimsbf rtx_packet— number 8 uimsbf for(i=0; i<rtx_packet number; i++) uimsbf
{ 一 bslbf reserved 3 uimsbf orig_pid 13 uimsbf orig_packet_id 32
Figure imgf000012_0001
{ a bslbf reserved 3 uimsbf orig_pid 13 uimsbf orig_packet_id 32
Figure imgf000012_0001
注: 表中的 bslbf 表示比特串 (Bit string, left bit first , 具体参见 ISO/IEC13818-1 标准中的相关定义) 。 rpchof 表示余数多项式的系数 ( Remainder polynomial coefficients, highest order first , 具体参见 ISO/IEC13818-1标准中的相关定义) 。 以下同。  Note: The bslbf in the table indicates the bit string (Bit string, left bit first, see the related definition in ISO/IEC13818-1 for details). Rpchof denotes the coefficient of the remainder polynomial coefficients (Remainder polynomial coefficients, highest order first, see the relevant definition in the ISO/IEC13818-1 standard). The same as below.
其中各字段的含义如下:  The meaning of each field is as follows:
table— id 用于标 i只该 section类型为 arq_packet— section,取值为 OxFl ; section— syntax— indicator 取值为 0 , 含义参见 MPEG-2 TS 标准 Table_id is used to mark i. The section type is arq_packet_section, and the value is OxFl; the section-syntax_indicator has a value of 0. For the meaning, see MPEG-2 TS standard.
《ISO/IEC 13818-1 :2007》 中, 关于 private— section的相关定义; In ISO/IEC 13818-1:2007, the relevant definition of private_section;
private— indicator ——根据 ISO/IEC13818-1标准中的相关定义,该字段取 默认值 0;  Private—indicator—This field takes the default value of 0 according to the relevant definition in the ISO/IEC13818-1 standard;
private— section— length — — 表 示 arq_packet— section 中 , 在 private— section— length字段之后的数据长度;  Private_section_length — — indicates the length of the data in the arq_packet_ section after the private_section_length field;
rtx_packet— number 表示该 arq_packet— section中包含的重传包数目; orig_pid ——表示相应的源 TS包的 PID;  Rtx_packet_ number indicates the number of retransmission packets contained in the arq_packet_ section; orig_pid - indicates the PID of the corresponding source TS packet;
orig_packet_id ——表示相应的源 TS包的标识, 参见丟包反馈消息中的 相关说明;  Orig_packet_id - indicates the identity of the corresponding source TS packet, see the related description in the packet loss feedback message;
orig_packet— length —— 表示相应的源 TS包的长度, 该字段后, 即为重 传的源 TS包数据;  Orig_packet_length - indicates the length of the corresponding source TS packet. After this field, it is the source TS packet data of the retransmission;
CRC— 32 —— 用于对数据提供校验的, 参见 MPEG-2 TS 标准 (即 ISO/IEC13818-1 ) 中的相关定义。  CRC—32 – For the verification of data, see the relevant definitions in the MPEG-2 TS standard (ie ISO/IEC13818-1).
丟包反馈消息的格式:  The format of the packet loss feedback message:
当 arq_signal— descriptor()中的 fec_profile— identifier为 ASCII字符 "ZFBP" 时, 丟包反馈的消息格式定义如下: When the fec_profile_ identifier in arq_signal_descriptor() is the ASCII character "ZFBP" The message format of the packet loss feedback is defined as follows:
Figure imgf000013_0001
Figure imgf000013_0001
其中 message— type的值为 0x01时, 为丟包反馈消息 arq_fb_message() , 其定义如下:  When the value of message_type is 0x01, it is the packet loss feedback message arq_fb_message() , which is defined as follows:
Figure imgf000013_0002
Figure imgf000014_0001
Figure imgf000013_0002
Figure imgf000014_0001
其中各字段的含义如下:  The meaning of each field is as follows:
packet— id ——表示丟失的第一个 TS包的标识, 该标识需要保证在一定 时间范围内对同一个 PID流中的 TS包唯一, 且顺序递增。 由于 TS包的 CC 字段回绕太快, 除非对其作扩展, 否则不适合在丟包反馈时, 用其作标识。 这样可能需要服务器在原始 TS包中,额外添加一个标识字段,例如可以利用 TS的 private— data字段来添加标识;  Packet_ id - indicates the identifier of the first TS packet that is lost. The identifier needs to be guaranteed to be unique to the TS packets in the same PID stream within a certain time range, and the sequence is incremented. Since the CC field of the TS packet wraps around too fast, it is not suitable for identification when the packet is fed back unless it is extended. This may require the server to add an additional identifier field in the original TS packet. For example, the private_data field of the TS may be used to add the identifier;
mask— length ——用于指明后面掩码字段的长度, 以字节为单位; mask— byte —— 掩码字段, 每一位对应一个 TS包。 即从 packet— id标识 的数据包开始, 后续掩码范围内的数据包, 如果发生了丟失, 则将掩码中对 应的比特位置 1 ;  Mask_ length - used to indicate the length of the following mask field, in bytes; mask_ byte - mask field, each bit corresponds to a TS packet. That is, starting from the data packet identified by packet_id, the data packet within the subsequent mask range, if a loss occurs, the corresponding bit position in the mask is 1;
对于支持上述 MPEG-2 TS扩展的流媒体系统来说, 其发送端(比如流媒 体服务器)和接收端 (比如终端) 的处理流程如下: For a streaming media system supporting the above MPEG-2 TS extension, the processing flow of the sender (such as a streaming media server) and the receiving end (such as a terminal) is as follows:
发送端  Sending end
( 1 )根据上述对 MPEG-2 TS的扩展, 在 PMT中增加相关的重传配置信 息并发送;  (1) adding relevant retransmission configuration information in the PMT according to the above extension to the MPEG-2 TS and transmitting;
PMT发送的相关规定, 例如发送频率、 更新等, 可以遵循 MPEG-2 TS 的相关规定。 由于重传信令会随着 PMT—起周期发送,从而可以保证新接入 接收端可以及时获取相关信息。同样也可以保证重传信令发生变化时的更新; ( 2 )收到接收端反馈的丟包信息后, 从历史緩存中获取对应的原始 TS 包, 按规定进行封装打包后, 复用到 TS流中发送。  The relevant regulations for PMT transmission, such as transmission frequency, update, etc., can follow the relevant provisions of MPEG-2 TS. Since the retransmission signaling is sent along with the PMT, it can ensure that the new access receiver can obtain relevant information in time. The update of the retransmission signaling can also be ensured. (2) After receiving the packet loss information fed back by the receiving end, the corresponding original TS packet is obtained from the history buffer, packaged and packaged according to regulations, and then multiplexed into the TS. Sent in the stream.
接收端  Receiving end
( 1 )接收 TS码流, 解析其中的 PMT, 从中获取媒体码流的相关信息, 和重传配置信息;  (1) receiving the TS code stream, parsing the PMT therein, obtaining related information of the media code stream, and retransmitting the configuration information;
( 2 )当检测到媒体码流发生丟包时, 按指定反馈规范, 构造丟包反馈消 息发送; (2) When a packet loss occurs in the media stream, the packet loss feedback is constructed according to the specified feedback specification. Send
( 3 )根据 PMT,从 TS流中解复用,得到媒体包和重传包,作码流修复。  (3) According to the PMT, demultiplexing from the TS stream, obtaining a media packet and a retransmission packet, and performing code stream repair.
实施例 2 Example 2
本实施例通过 RTP/RTCP传递重传信令, 实现带内方式传递重传配置信 息。  In this embodiment, the retransmission signaling is transmitted through the RTP/RTCP, and the in-band mode retransmission configuration information is implemented.
当码流通过 RTP流传输时(例如 TS over RTP ) , 可以将相关的重传配 置信息封装在 RTP/RTCP包中, 通过 RTP/RTCP通道进行传输。 图 2给出了 利用 RTP通道传送重传配置信息的示意。 重传的 RTP包可以作为一路 RTP 流, 复用媒体码流的 RTP通道, 或者使用新的 RTP通道进行传输。  When the code stream is transmitted through the RTP stream (for example, TS over RTP), the related retransmission configuration information can be encapsulated in the RTP/RTCP packet and transmitted through the RTP/RTCP channel. Figure 2 shows an illustration of the transmission of retransmission configuration information using the RTP channel. The retransmitted RTP packet can be used as an RTP stream, multiplexed with the RTP channel of the media stream, or transmitted using the new RTP channel.
例如,当使用 RTP通道传送重传配置信息时,可以釆用如下的技术方案, 对 RTP作扩展:  For example, when using the RTP channel to transmit retransmission configuration information, you can use the following technical solution to extend RTP:
( 1 )分配一个专门的 PT值, 例如 126, 用于标识相应的 RTP流是用于 传递重传配置信息的。 这样用于传递重传配置信息的 RTP包, 就可以有自己 独立的序号空间, 避免对正常的 RTP码流造成干扰;  (1) Assign a special PT value, for example 126, to identify that the corresponding RTP stream is used to pass the retransmission configuration information. In this way, the RTP packet used to transmit the retransmission configuration information can have its own independent sequence space to avoid interference with the normal RTP code stream.
( 2 )定义一个 RTP扩展头, 用于标识传递重传配置信息的 RTP包格式 遵循哪个规范。 仅在 PT值等于 126时有效。 扩展头定义如图 3所示, 遵循 RFC3550的相关定义。 可以设定 defined by profile字段为一个特殊值, 例如 ASCII字符 "RT" , 以标明相应的 RTP负载, 是用于传递重传配置信息的。 扩展头中的 Identifier字段的不同取值, 表明相应的规范, 不同的规范可能对 应不同的 RTP包格式定义。 例如 Identifier取值为 ASCII字符 "ZARQ" 时, 则表明后面跟的 RTP负载中, 所携带的重传配置信息的格式遵循本实施例中 的相关规定;  (2) Define an RTP extension header to identify which specification the RTP packet format that conveys the retransmission configuration information follows. Only valid when the PT value is equal to 126. The extension header definition is shown in Figure 3, following the relevant definition of RFC3550. The defined by profile field can be set to a special value, such as the ASCII character "RT", to indicate the corresponding RTP payload, which is used to pass the retransmission configuration information. The different values of the Identifier field in the extension header indicate the corresponding specifications, and different specifications may correspond to different RTP packet format definitions. For example, when the value of the Identifier is ASCII character "ZARQ", the format of the retransmission configuration information carried in the following RTP payload is in accordance with the relevant provisions in this embodiment;
( 3 )定义重传配置信息相关参数在 RTP 包中的格式。 由于重传配置信 息中的部分参数可能是可选的, 为便于构造消息, 可以对信令中的参数釆用 Type-Length-Value ( TLV ) 的结构。 即基本结构如图 4所示。 首先通过 Type 字段标明不同的参数类型, 然后通过 Length字段标明该参数值的长度, 然后 在 Value字段携带具体的参数值。 如果有多个参数, 则 RTP负载中就是相应 的多个 TLV结构。 需要支持的重传信令参数如下所示: (3) Define the format of the retransmission configuration information related parameters in the RTP package. Since some parameters in the retransmission configuration information may be optional, in order to facilitate the construction of the message, the structure of the Type-Length-Value (TLV) may be used for the parameters in the signaling. The basic structure is shown in Figure 4. First, the different parameter types are marked by the Type field, and then the length of the parameter value is indicated by the Length field, and then the specific parameter value is carried in the Value field. If there are multiple parameters, then the corresponding RTP load is Multiple TLV structures. The retransmission signaling parameters that need to be supported are as follows:
Figure imgf000016_0001
Figure imgf000016_0001
对于支持上述 RTP扩展的流媒体系统来说, 其发送端和接收端的处理流 程如下:  For a streaming media system that supports the above RTP extension, the processing processes of the sender and the receiver are as follows:
发送端  Sending end
( 1 )根据上述对 RTP的扩展, 将重传配置信息封装到 RTP包中; (1) Encapsulating the retransmission configuration information into the RTP packet according to the foregoing extension of the RTP;
( 2 )使用媒体包的 RTP通道, 发送携带了重传配置信息的 RTP包; 携带了重传配置信息的 RTP包可以周期发送; 当重传配置信息发生变化 时, 则根据变化后的重传配置信息, 构造 RTP格式的消息包, 然后按上述规 则发送。 (2) using the RTP channel of the media packet, sending an RTP packet carrying the retransmission configuration information; the RTP packet carrying the retransmission configuration information may be periodically sent; when the retransmission configuration information changes, according to the changed retransmission Configuration information, construct a message packet in RTP format, and then send it according to the above rules.
( 3 )收到接收端反馈的丟包信息后,从历史緩存中获取对应的原始 RTP 包, 按规定进行封装打包后, 复用 RTP通道发送, 或通过 RTCP通道发送。  (3) After receiving the packet loss information fed back by the receiving end, the corresponding original RTP packet is obtained from the history buffer, encapsulated and packaged according to the regulations, and then multiplexed by the RTP channel for transmission, or sent through the RTCP channel.
接收端 Receiving end
( 1 )接收 RTP包, 解复用出携带重传配置信息的 RTP包;  (1) receiving an RTP packet, and demultiplexing the RTP packet carrying the retransmission configuration information;
( 2 ) 当检测到媒体 RTP流发生丟包时, 按照重传配置信息中指定的方 式, 发送丟包反馈消息; ( 3 )从 RTP流中解复用, 得到重传包, 修复码流。 (2) When detecting that a packet loss occurs in the media RTP stream, sending a packet loss feedback message according to the manner specified in the retransmission configuration information; (3) Demultiplexing from the RTP stream, obtaining a retransmission packet, and repairing the code stream.
对应于以上方法,本发明实施例还提供了一种流媒体丟包重传实现系统, 如图 5所示, 该系统包括发送端和接收端, 其中: Corresponding to the above method, the embodiment of the present invention further provides a streaming media packet loss retransmission implementation system. As shown in FIG. 5, the system includes a transmitting end and a receiving end, where:
所述发送端包括收发模块和重传处理模块, 其中:  The sending end includes a transceiver module and a retransmission processing module, where:
所述收发模块设置成: 釆用与媒体码流相同的传输方式发送重传配置信 息, 接收丟包反馈消息, 以及发送重传包;  The transceiver module is configured to: send retransmission configuration information by using the same transmission mode as the media code stream, receive a packet loss feedback message, and send a retransmission packet;
所述重传处理模块设置成: 在接收所述丟包反馈消息后, 根据所述重传 配置信息构造重传包;  The retransmission processing module is configured to: after receiving the packet loss feedback message, construct a retransmission packet according to the retransmission configuration information;
所述接收端包括第二收发模块和丟包反馈消息构造模块, 其中: 所述第二收发模块设置成: 接收并配置所述重传配置信息, 检测丟包, 发送所述丟包反馈消息, 以及根据緩存的重传配置信息接收所述重传包; 所述丟包反馈消息构造模块设置成: 在检测到丟包时, 按照緩存的重传 配置信息构造所述丟包反馈消息。  The receiving end includes a second transceiver module and a packet loss feedback message constructing module, where: the second transceiver module is configured to: receive and configure the retransmission configuration information, detect packet loss, and send the packet loss feedback message, And receiving the retransmission packet according to the cached retransmission configuration information. The packet loss feedback message constructing module is configured to: when the packet loss is detected, construct the packet loss feedback message according to the cached retransmission configuration information.
其中, 所述重传配置信息包括反馈规范标识及重传规范标识。 优选地, 所述重传配置信息还包括重传流标识或服务器支持的重传窗口大小。  The retransmission configuration information includes a feedback specification identifier and a retransmission specification identifier. Preferably, the retransmission configuration information further includes a retransmission stream identifier or a retransmission window size supported by the server.
其中, 发送端可以周期性发送所述重传配置信息。  The sending end may periodically send the retransmission configuration information.
所述重传配置信息有修改时, 所述发送端的收发模块发送更新后的重传 配置信息, 所述接收端的丟包反馈消息构造模块和发送端的重传处理模块根 据所述更新后的重传配置信息分别构造丟包反馈消息和重传包。  When the retransmission configuration information is modified, the transceiver module of the sending end sends the updated retransmission configuration information, and the packet loss feedback message constructing module of the receiving end and the retransmission processing module of the transmitting end according to the updated retransmission module. The configuration information constructs a packet loss feedback message and a retransmission packet, respectively.
所述重传配置信息基于如前文所述的扩展的运动图像专家组(MPEG ) 协议或扩展的实时传输协议(RTP )发送。  The retransmission configuration information is transmitted based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP) as previously described.
可理解的, 以上系统中所提及的功能模块是本发明区别于现有技术的相 关内容, 本技术方案中, 发送端和接收端并不排除有新的或现有的功能模块。  It can be understood that the functional modules mentioned in the above system are related to the prior art, and in the technical solution, the transmitting end and the receiving end do not exclude new or existing functional modules.
釆用本发明的技术方案, 可以使用户在接收媒体码流的同时, 方便地获 取到相关的重传配置信息。 从而顺利地实现丟包反馈和重传包的接收修复。 同时, 当重传配置信息有所更改时, 服务器也可以及时地通知接收端, 作出 相应的调整。 With the technical solution of the present invention, the user can conveniently obtain the relevant retransmission configuration information while receiving the media code stream. Therefore, packet loss feedback and retransmission packet reception and repair are smoothly implemented. At the same time, when the retransmission configuration information is changed, the server can also notify the receiving end in time to make corresponding adjustments.
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序 来指令相关硬件完成, 所述程序可以存储于计算机可读存储介质中, 如只读 存储器、 磁盘或光盘等。 可选地, 上述实施例的全部或部分步骤也可以使用 一个或多个集成电路来实现。 相应地, 上述实施例中的各模块可以釆用硬件 的形式实现, 也可以釆用软件功能模块的形式实现。 本发明不限制于任何特 定形式的硬件和软件的结合。  One of ordinary skill in the art will appreciate that all or a portion of the above steps may be accomplished by a program instructing the associated hardware, such as a read-only memory, a magnetic disk, or an optical disk. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module in the foregoing embodiment may be implemented in the form of hardware, or may be implemented in the form of a software function module. The invention is not limited to any specific combination of hardware and software.
工业实用性 上述技术方案通过带内方式传递重传配置信息, 这样只要接收端能够收 到媒体码流, 就可以获取到相应的重传配置信息, 并可以方便的实现该信息 的动态更新。 因此本发明具有^ 虽的工业实用性。 Industrial Applicability The above technical solution transmits the retransmission configuration information in an in-band manner, so that as long as the receiving end can receive the media code stream, the corresponding retransmission configuration information can be obtained, and the information can be dynamically updated. Therefore, the present invention has industrial utility.

Claims

权 利 要 求 书 Claim
1、 一种流媒体丟包重传实现方法, 该方法包括: A method for implementing packet loss retransmission of a streaming media, the method comprising:
发送端釆用与媒体码流相同的传输方式发送重传配置信息, 所述重传配 置信息包括反馈规范标识及重传规范标识;  The transmitting end sends the retransmission configuration information by using the same transmission manner as the media code stream, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification identifier;
接收端接收并配置所述重传配置信息;  Receiving and configuring the retransmission configuration information by the receiving end;
所述接收端检测到丟包时, 按照緩存的重传配置信息构造并发送丟包反 馈消息;  When the receiving end detects the packet loss, the receiving end constructs and sends a packet loss feedback message according to the cached retransmission configuration information;
所述发送端接收所述丟包反馈消息后, 根据所述重传配置信息构造重传 包并发送;  After receiving the packet loss feedback message, the sending end constructs a retransmission packet according to the retransmission configuration information and sends the packet;
所述接收端根据緩存的重传配置信息接收所述重传包。  The receiving end receives the retransmission packet according to the cached retransmission configuration information.
2、 如权利要求 1所述的流媒体丟包重传实现方法, 其中: 所述重传配置 信息还包括重传流标识或服务器支持的重传窗口大小。 2. The streaming media packet loss retransmission implementation method according to claim 1, wherein: the retransmission configuration information further includes a retransmission flow identifier or a retransmission window size supported by the server.
3、 如权利要求 1所述的流媒体丟包重传实现方法, 其中, 所述发送端釆 用与媒体码流相同的传输方式发送重传配置信息的步骤包括: The method for implementing the retransmission configuration of the streaming media packet of claim 1, wherein the step of the transmitting end transmitting the retransmission configuration information by using the same transmission mode as the media code stream includes:
所述发送端周期性发送所述重传配置信息。  The sending end periodically sends the retransmission configuration information.
4、 如权利要求 1所述的流媒体丟包重传实现方法, 该方法还包括: 所述重传配置信息有修改时, 所述发送端发送更新后的重传配置信息; 所述接收端根据更新后的重传配置信息构造丟包反馈消息; The method for implementing the packet loss retransmission of the streaming media according to claim 1, the method further includes: when the retransmission configuration information is modified, the sending end sends the updated retransmission configuration information; Constructing a packet loss feedback message according to the updated retransmission configuration information;
所述发送端根据更新后的重传配置信息构造重传包。  The transmitting end constructs a retransmission packet according to the updated retransmission configuration information.
5、 如权利要求 1所述的流媒体丟包重传实现方法, 其中: 所述重传配置 信息基于扩展的运动图像专家组( MPEG )协议或扩展的实时传输协议( RTP ) 发送。 5. The streaming media packet loss retransmission implementation method according to claim 1, wherein: the retransmission configuration information is sent based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
6、 一种流媒体丟包处理的发送装置, 包括收发模块和重传处理模块, 其 中: 6. A transmitting device for streaming packet loss processing, comprising a transceiver module and a retransmission processing module, wherein:
所述收发模块设置成: 釆用与媒体码流相同的传输方式发送重传配置信 息, 接收接收端根据緩存的重传配置信息构造的丟包反馈消息, 以及发送重 传包, 其中所述重传配置信息包括反馈规范标识及重传规范标识; The transceiver module is configured to: send a retransmission configuration letter by using the same transmission mode as the media code stream And receiving a packet loss feedback message configured by the receiving end according to the cached retransmission configuration information, and sending a retransmission packet, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification identifier;
所述重传处理模块设置成: 在接收到所述丟包反馈消息后, 根据所述重 传配置信息构造所述重传包。  The retransmission processing module is configured to: after receiving the packet loss feedback message, construct the retransmission packet according to the retransmission configuration information.
7、 如权利要求 6所述的发送装置, 其中: 所述重传配置信息还包括重传 流标识或服务器支持的重传窗口大小。 7. The transmitting apparatus according to claim 6, wherein: the retransmission configuration information further comprises a retransmission stream identifier or a retransmission window size supported by the server.
8、 如权利要求 6所述的发送装置, 其中: 所述收发模块设置成按照以下 方式发送重传配置信息: 8. The transmitting apparatus according to claim 6, wherein: the transceiver module is configured to transmit retransmission configuration information in the following manner:
周期性发送所述重传配置信息。  The retransmission configuration information is periodically sent.
9、 如权利要求 6所述的发送装置, 其中: 9. The transmitting device according to claim 6, wherein:
所述收发模块还设置成: 发送更新后的重传配置信息;  The transceiver module is further configured to: send updated retransmission configuration information;
所述重传处理模块还设置成: 根据更新后的重传配置信息构造重传包。  The retransmission processing module is further configured to: construct a retransmission packet according to the updated retransmission configuration information.
10、 如权利要求 6所述的发送装置, 其中: 所述重传配置信息基于扩展 的运动图像专家组(MPEG )协议或扩展的实时传输协议(RTP )发送。 10. The transmitting apparatus according to claim 6, wherein: said retransmission configuration information is transmitted based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
11、 一种流媒体丟包处理的接收装置, 包括第二收发模块及丟包反馈消 息构造模块, 其中: A receiving device for streaming packet loss processing, comprising a second transceiver module and a packet loss feedback message structure module, wherein:
所述第二收发模块设置成: 接收发送端釆用与媒体码流相同的传输方式 发送的重传配置信息并配置所述重传配置信息, 向所述发送端发送所述丟包 反馈消息, 以及根据緩存的重传配置信息接收所述发送端接收到所述丟包反 馈消息后根据所述重传配置信息构造的重传包; 其中所述重传配置信息包括 反馈规范标识及重传规范标识;  The second transceiver module is configured to: receive, by the sending end, the retransmission configuration information sent by using the same transmission mode as the media code stream, and configure the retransmission configuration information, and send the packet loss feedback message to the sending end, And receiving, according to the retransmitted configuration information of the cache, a retransmission packet configured according to the retransmission configuration information after the sending end receives the packet loss feedback message, where the retransmission configuration information includes a feedback specification identifier and a retransmission specification Identification
所述丟包反馈消息构造模块设置成: 在检测到丟包时, 按照緩存的重传 配置信息构造所述丟包反馈消息。  The packet loss feedback message constructing module is configured to: when the packet loss is detected, construct the packet loss feedback message according to the cached retransmission configuration information.
12、 如权利要求 11所述的接收装置, 其中: 所述重传配置信息还包括重 传流标识或服务器支持的重传窗口大小。 12. The receiving apparatus according to claim 11, wherein: the retransmission configuration information further comprises a retransmission stream identifier or a retransmission window size supported by the server.
13、 如权利要求 11所述的接收装置, 其中: 13. The receiving device according to claim 11, wherein:
所述丟包反馈消息构造模块还设置成: 根据发送端发送的更新后的重传 配置信息构造丟包反馈消息。  The packet loss feedback message constructing module is further configured to: construct a packet loss feedback message according to the updated retransmission configuration information sent by the sending end.
14、 如权利要求 11所述的接收装置, 其中: 所述重传配置信息基于扩展 的运动图像专家组(MPEG )协议或扩展的实时传输协议(RTP )发送。 14. The receiving apparatus according to claim 11, wherein: said retransmission configuration information is transmitted based on an extended Moving Picture Experts Group (MPEG) protocol or an extended Real Time Transport Protocol (RTP).
15、 一种流媒体丟包重传实现系统, 该系统包括: 15. A streaming media packet loss retransmission implementation system, the system comprising:
如权利要求 6-10中任一项所述的发送装置和如权利要求 11-14中任一项 所述的接收装置。  A transmitting device according to any one of claims 6 to 10 and a receiving device according to any one of claims 11-14.
PCT/CN2012/070207 2011-01-11 2012-01-11 Method and system for realizing lost package retransmission in streaming media WO2012094994A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110004889.7 2011-01-11
CN201110004889.7A CN102595251B (en) 2011-01-11 2011-01-11 Streaming media packet loss retransmission realizes method and system

Publications (1)

Publication Number Publication Date
WO2012094994A1 true WO2012094994A1 (en) 2012-07-19

Family

ID=46483382

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/070207 WO2012094994A1 (en) 2011-01-11 2012-01-11 Method and system for realizing lost package retransmission in streaming media

Country Status (2)

Country Link
CN (1) CN102595251B (en)
WO (1) WO2012094994A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106209915A (en) * 2016-08-31 2016-12-07 深圳聚点互动科技有限公司 A kind of real time flow medium radio transmitting method and system thereof
CN106911699B (en) * 2017-03-03 2020-02-11 天地伟业技术有限公司 Method for realizing I frame retransmission based on RTP protocol
CN108809489B (en) * 2017-05-04 2020-01-31 维沃移动通信有限公司 Reporting method of status report, terminal and network side equipment
CN109391605B (en) * 2017-08-14 2021-01-26 杭州海康威视数字技术股份有限公司 Data transmission method, device and system
CN110768753A (en) * 2018-07-25 2020-02-07 成都鼎桥通信技术有限公司 Packet loss retransmission method and system
CN111385158B (en) * 2018-12-27 2021-11-12 北京紫荆视通科技有限公司 Communication method and communication device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155311A (en) * 2006-09-27 2008-04-02 中兴通讯股份有限公司 Video code stream error detecting and processing method in video communication
CN101511013A (en) * 2009-03-26 2009-08-19 华为技术有限公司 Method, equipment and system for processing video message
CN101616316A (en) * 2009-06-10 2009-12-30 中兴通讯股份有限公司 A kind of transmission of video data, receiving system and sending, receiving method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3318362B2 (en) * 1992-09-01 2002-08-26 富士通株式会社 Inter-station packet loss avoidance system
KR20010035779A (en) * 1999-10-02 2001-05-07 윤종용 Packet loss compensating method in user datagram protocol
CN101030839A (en) * 2007-02-13 2007-09-05 华为技术有限公司 Method for re-transmitting data
CN101867453B (en) * 2010-06-04 2012-08-22 北京佳讯飞鸿电气股份有限公司 RTP anti-packet-loss method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155311A (en) * 2006-09-27 2008-04-02 中兴通讯股份有限公司 Video code stream error detecting and processing method in video communication
CN101511013A (en) * 2009-03-26 2009-08-19 华为技术有限公司 Method, equipment and system for processing video message
CN101616316A (en) * 2009-06-10 2009-12-30 中兴通讯股份有限公司 A kind of transmission of video data, receiving system and sending, receiving method

Also Published As

Publication number Publication date
CN102595251A (en) 2012-07-18
CN102595251B (en) 2016-07-27

Similar Documents

Publication Publication Date Title
KR102265909B1 (en) Method and device for transmitting and receiving broadcast service in hybrid broadcast system on basis of connection of terrestrial broadcast network and internet protocol network
US8358670B2 (en) Method and apparatus for processing packet
KR20190085899A (en) Interface apparatus and method for transmitting and receiving media data
RU2750337C2 (en) Method and device for transmitting media data in multimedia transport system
US10911510B2 (en) Apparatus and method for transmitting multimedia data in a broadcast system
TWI388170B (en) Streaming data content in a network
JP2018515976A (en) Method and apparatus for transmitting and receiving service signaling for broadcast service
US20160088321A1 (en) Transmission apparatus, transmission method, reproduction apparatus, reproduction method and reception apparatus
WO2012094915A1 (en) Method and system for implementing forward error correction for streaming media
JP6276392B2 (en) Method and apparatus for processing signaling data between layers in IP-based digital broadcasting system
WO2012094994A1 (en) Method and system for realizing lost package retransmission in streaming media
US9621617B2 (en) Method and server for sending a data stream to a client and method and client for receiving a data stream from a server
KR101991388B1 (en) Contents Transmission Method in Heterogeneous Network and Apparatus therefor
US20170134763A1 (en) Method for compressing transmission packet in ip-based broadcast network
JP5296224B2 (en) Method and device for ensuring reliability during transmission of television data in a television system based on internet protocol
JP6811613B2 (en) Transmitter, transmitter, receiver and receiver
GB2533775A (en) In-band quality data
KR101757459B1 (en) Method and apparatus for processing packet
JP2020074589A (en) Transmission method
KR102421791B1 (en) Method and apparatus for transmitting media time information in mmt network system
KR20150072772A (en) Method of processing mmt message for performing arq of terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12734692

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12734692

Country of ref document: EP

Kind code of ref document: A1