WO2013189428A2 - 基于分层编码的抗丢包实时通信方法、系统及相关设备 - Google Patents

基于分层编码的抗丢包实时通信方法、系统及相关设备 Download PDF

Info

Publication number
WO2013189428A2
WO2013189428A2 PCT/CN2013/082203 CN2013082203W WO2013189428A2 WO 2013189428 A2 WO2013189428 A2 WO 2013189428A2 CN 2013082203 W CN2013082203 W CN 2013082203W WO 2013189428 A2 WO2013189428 A2 WO 2013189428A2
Authority
WO
WIPO (PCT)
Prior art keywords
parameters
data
packet loss
load
parameter
Prior art date
Application number
PCT/CN2013/082203
Other languages
English (en)
French (fr)
Other versions
WO2013189428A3 (zh
Inventor
林亚
李加周
阮亚平
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to PL13807346T priority Critical patent/PL2950473T3/pl
Priority to US14/769,626 priority patent/US20160006667A1/en
Priority to EP13807346.5A priority patent/EP2950473B1/en
Publication of WO2013189428A2 publication Critical patent/WO2013189428A2/zh
Publication of WO2013189428A3 publication Critical patent/WO2013189428A3/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0002—Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission rate
    • H04L1/0003—Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission rate by switching between different modulation schemes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/70—Admission control; Resource allocation
    • H04L47/80—Actions related to the user profile or the type of traffic
    • H04L47/805—QOS or priority aware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0056—Systems characterized by the type of code used
    • H04L1/007—Unequal error protection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823—Errors, e.g. transmission errors
    • H04L43/0829—Packet loss
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852—Delays
    • H04L43/0858—One way delays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852—Delays
    • H04L43/087—Jitter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30—Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32—Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/324—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the data link layer [OSI layer 2], e.g. HDLC
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a layered coding-based anti-drop packet real-time communication method, system and related device. Background technique
  • audio and video media are usually transmitted using the user data packet protocol. Since the user data packet protocol is a connectionless transmission protocol and cannot provide reliable transmission services, packet loss will inevitably occur in the network. The phenomenon that the sound is not continuous, the video screen is paused, etc., seriously affects the call quality.
  • the reason for packet loss is generally divided into random packet loss and congestion packet loss.
  • the methods for anti-drop packet are generally: interleaving and retransmission.
  • the above anti-drop packet method cannot adjust the transmission bit rate in real time according to network conditions. The transmission position, so that the anti-drop performance is poor, needs to be further improved. Summary of the invention
  • the present invention aims to provide a method, system and related equipment for anti-drop packet real-time communication based on layered coding, so as to further improve the anti-loss performance of the network.
  • the embodiment of the invention provides a real-time anti-lost communication method based on layered coding, and the method includes:
  • the transmitting end generates a load containing the encoded data and the protected data at a time according to the set encoding parameter and the packing parameter, and sends the load to the receiving end;
  • the transmitting end adjusts the encoding parameter and the packing parameter in real time according to the network condition parameter, and generates a load of the encoded data and the protection data at a time according to the adjusted encoding parameter and the packing parameter.
  • the method further comprises:
  • the receiving end determines whether the encoded data packet is lost according to the received load, and after determining the lost encoded data packet, finds the protection data corresponding to the lost encoded data packet according to the received indication information in the load, and Encode the packet for recovery.
  • the network condition parameter includes one or more of the following: a packet loss rate, a continuous packet loss rate, a delay, a jitter, or a target code rate.
  • the sending end adjusts the encoding parameter and the packaging parameter in real time according to the network condition parameter, including:
  • the transmitting end sets a target bit rate according to the network condition parameter, and adjusts the encoding parameter and the packing parameter in real time according to the target code rate and the packet loss rate.
  • adjusting the encoding parameter and the packing parameter in real time according to the target code rate and the packet loss rate including:
  • the packet loss rate is less than or equal to the preset packet loss rate threshold, the data is not set according to the target code rate, and the packet loss rate is greater than the preset packet loss rate. And increasing the protection data rate according to the target code rate, where the coding parameter includes the coded data rate, and the packet parameter includes the protection data code rate.
  • the method further comprises:
  • the embodiment of the invention further provides an anti-lost packet real-time communication system based on layered coding, the system comprising: a transmitting end and a receiving end;
  • the sending end is configured to generate, according to the set encoding parameter and the packing parameter, a load including the encoded data and the packed data, and send the load to the receiving end; and adjust the encoding parameter and the real-time according to the network condition parameter sent by the receiving end. Decoding a parameter, and generating a load of the encoded data and the protected data at a time according to the adjusted encoding parameter and the packing parameter;
  • the receiving end is configured to receive the load sent by the sending end, and collect the network status parameter according to the load and send the data to the sending end.
  • the receiving end is further configured to: determine, according to the load sent by the sending end, whether the encoded data packet is lost, and after determining that the encoded data packet is lost, find the lost encoded data packet according to the indication information in the load. Corresponding protection data and recovery of lost encoded packets.
  • the embodiment of the present invention further provides a sending end, where the sending end includes:
  • a setting unit configured to set an encoding parameter and a packing parameter according to a network condition difference, and send the encoding parameter and the packing parameter to the encoding unit;
  • the coding unit is configured to generate the coded data and the protection data at a time according to the coding parameter sent by the setting unit and the coding parameter and the packing parameter sent by the packing parameter or the adjustment unit. Load and send to the receiving end;
  • the adjusting unit is configured to adjust the encoding parameter and the packing parameter in real time according to a network condition parameter sent by the receiving end, and send the adjusted encoding parameter and the packing parameter to the coding unit .
  • the adjusting unit is configured to set a target code rate according to a network condition parameter sent by the receiving end, and when the packet loss rate is less than or equal to a preset packet loss rate, the protection data is not added. And setting a coded data rate according to the target code rate, and when the packet loss rate is greater than the preset packet loss rate threshold, increasing a protection data rate under the limitation of the target code rate,
  • the encoding parameter includes the coded data rate
  • the packing parameter includes the protected data code rate, and further, part or all of the encoded data corresponding to the transmission position of the protected data is further intercepted according to the adjusted packing parameter.
  • the code stream is used as the protection data.
  • the transmission location of the protection data is placed in the next frame, and the continuous packet loss rate is higher than the preset continuous drop rate.
  • the transmission position of the protection data is placed in the next frame.
  • the embodiment of the present invention further provides a receiving end, including:
  • a receiving unit configured to receive a payload of the encoded data and the protection data sent by the sending end
  • a statistical unit configured to send, according to the load statistics network status parameter received by the receiving unit, the sending to the sending end.
  • the method further includes: a determining unit, configured to determine, according to the load received by the receiving unit, whether the encoded data packet is lost, and after determining that the encoded data packet is lost, finding a loss according to the received indication information in the load Encodes the protection data corresponding to the data packet and recovers the lost encoded data packet.
  • a determining unit configured to determine, according to the load received by the receiving unit, whether the encoded data packet is lost, and after determining that the encoded data packet is lost, finding a loss according to the received indication information in the load Encodes the protection data corresponding to the data packet and recovers the lost encoded data packet.
  • the current network condition parameter is collected in real time by the receiving end, and the network status parameter is sent to the sending end, and the sending end is based on the current network.
  • the status parameter adjusts the encoding parameter and the packing parameter in real time, and allocates the encoded data rate and the protected data rate in the packed load according to the encoding parameter and the packing parameter, that is, the real-time communication occurs in the network in the embodiment of the present invention.
  • Packet loss or congestion for adaptive processing adjusts the code rate and transmission position of the protection data in real time according to the network conditions, thereby effectively avoiding the occurrence of sound discontinuity, image blooming or pause of the client, thereby improving the user experience.
  • FIG. 1 is a flowchart of a layered coding-based anti-drop packet real-time communication method according to Embodiment 1 of the present invention
  • 2 is a schematic structural diagram of a packaging load in Embodiment 1 of the present invention
  • Embodiment 3 is a schematic structural diagram of a transmitting end in Embodiment 3 of the present invention.
  • Embodiment 4 is a schematic structural diagram of a receiving end in Embodiment 4 of the present invention. detailed description
  • the embodiment of the invention provides a real-time communication method against packet loss based on layered coding.
  • the method includes:
  • the sending end sets an encoding parameter and a packing parameter.
  • the sending end initially sets the encoding parameters and the packing parameters according to the scene with poor network conditions.
  • the poor network conditions include continuous packet loss, low available bandwidth, or high packet loss rate.
  • the protection data in the load in the embodiment of the present invention is part or all of the data of the encoded data.
  • the receiving end receives the load sent by the sending end, according to the load statistics network status parameter, and sends the statistics network status parameter to the sending end;
  • the network status parameter in the embodiment of the present invention includes one or more of the following: packet loss rate, delay, jitter, target code rate, or continuous packet loss rate.
  • the receiving end determines whether there is a packet loss. After determining that the packet is lost, recovering the data of the packet according to the received load. S105.
  • the sending end adjusts the encoding parameter and the packing parameter in real time according to the network condition parameter sent by the receiving end, and generates a load of the encoded data and the protection data at a time according to the encoding parameter and the packing parameter.
  • the step specifically includes: the sending end sets a target code rate according to the network condition parameter sent by the receiving end, and adjusts the coding parameter and the packing parameter according to the target code rate and the packet loss rate.
  • the packet loss rate is less than or equal to the preset packet loss rate threshold, the data is not set according to the target code rate, and the packet loss rate is greater than the preset loss rate.
  • the protection data rate is increased under the limitation of the target code rate, where the coding parameter includes the coded data rate, and the packet parameter includes the protection data rate.
  • FIG. 2 is a structural diagram of a packed load in an embodiment of the present invention, including a load header, encoded data, and protection data, wherein the load header indicates a length indication and a position indication of the protection data.
  • the method further includes: intercepting part or all of the code stream from the encoded data corresponding to the transmission position of the protection data as the protection data according to the adjusted packing parameter, when the continuous packet loss rate is lower than a preset continuous packet loss rate threshold. And placing the transmission location of the protection data in the next frame, and when the continuous packet loss rate is higher than the preset continuous packet loss rate threshold, placing the transmission location of the protection data in the next frame, and indicating the transmission location Information is entered into the load
  • the embodiment of the invention provides a real-time communication method against packet loss based on layered coding.
  • the method collects current network condition parameters in real time through the receiving end, and sends network condition parameters to the sending end, and the sending end according to the current network condition.
  • the parameter adjusts the encoding parameter and the packing parameter in real time, and allocates the encoded data rate and the protected data rate in the packed load according to the encoding parameter and the packing parameter, that is, the lost network occurs in the real-time communication in the embodiment of the present invention.
  • Packet or congestion for adaptive processing adjusts the code rate and transmission position of the protection data in real time according to network conditions, effectively avoiding the client's sound discontinuity, image blooming or pause, thereby improving the user experience.
  • Example 2 The embodiment of the invention further provides an anti-lost packet real-time communication system based on layered coding, the system comprising: a transmitting end and a receiving end;
  • the sending end is configured to initially set an encoding parameter and a packing parameter according to a network condition difference, and generate a load including the encoded data and the packed data at a time according to the encoding parameter and the packing parameter, and send the load to the receiving end. And adjusting, according to the network condition parameter sent by the receiving end, the encoding parameter and the packing parameter, and generating a load of the encoded data and the protection data at a time according to the adjusted encoding parameter and the packing parameter;
  • the receiving end is configured to receive the load sent by the sending end, and send the network status parameter according to the load to the sending end, and determine, according to the encoded coded data sent by the sending end, Whether the encoded data packet is lost, and when it is determined that the encoded data packet is lost, the lost encoded data packet is recovered according to the received load.
  • Example 3
  • the embodiment of the present invention provides a transmitting end.
  • the transmitting end includes: a setting unit 31, an encoding unit 32, and an adjusting unit 33.
  • the setting unit 31 is configured to initially set the encoding parameter and the packing parameter according to the difference of the storage network condition, and send the encoding parameter and the packing parameter to the encoding unit 32;
  • the encoding unit 32 is configured to generate the load including the encoded data and the protection data at a time according to the encoding parameter sent by the setting unit 31 and the encoding parameter and the packing parameter sent by the packing parameter or the adjusting unit. Send to the receiving end;
  • the adjusting unit 33 is configured to set a target bit rate according to the network condition parameter sent by the receiving end, and when the packet loss rate is less than or equal to a preset packet loss rate, the protection data is not added, and only the target bit rate is used. And setting a coded data rate.
  • the packet loss rate is greater than the preset packet loss rate threshold, increasing a protection data rate according to the target code rate, where the coding parameter includes the coding a data rate, the packing parameter includes the protection data rate; and further, according to the adjusted packing parameter, part or all of the code is extracted from the encoded data corresponding to the transmission position of the protection data. The flow is used as the protection data.
  • the embodiment of the present invention provides a receiving end.
  • the receiving end includes: a receiving unit 41, a statistic unit 42 and a statistic unit 43;
  • the receiving unit 41 is configured to receive the payload of the encoded data and the protection data sent by the sending end;
  • the statistic unit 42 is configured to count the network status parameter according to the load received by the receiving unit 41 and send it to the sending end.
  • the determining unit 43 is configured to determine whether the encoded data packet is lost according to the load received by the receiving unit 41, and after determining that the encoded data packet is lost, recover the lost encoded data packet according to the received load.
  • the embodiment of the present invention provides a method, system, and related device for real-time communication against packet loss based on layered coding, which collects current network condition parameters in real time through a receiving end, and sends network status parameters to the transmitting end.
  • the sending end adjusts the encoding parameter and the packing parameter in real time according to the current network condition parameter, and allocates the encoded data rate and the protected data rate in the packed load according to the encoding parameter and the packing parameter, that is, the real-time embodiment of the present invention
  • the packet loss or congestion occurring in the network is adaptively processed.
  • the code rate and the transmission position of the protection data are adjusted in real time according to the network condition, thereby effectively preventing the client from having a discontinuous sound, an image blooming or a pause phenomenon, thereby improving the user.
  • Experience the code rate and the transmission position of the protection data are adjusted in real time according to the network condition, thereby effectively preventing the client from having a discontinuous sound, an image blooming or a pause phenomenon, thereby improving
  • the current network condition parameter is collected in real time by the receiving end, and the network status parameter is sent to the sending end, and the sending end is based on the current network.
  • the status parameter adjusts the encoding parameter and the packing parameter in real time, and allocates the encoded data rate and the protected data rate in the packed load according to the encoding parameter and the packing parameter, that is, the embodiment of the present invention occurs in the network in real-time communication.
  • Packet loss or congestion for adaptive processing adjust the code rate and transmission position of the protection data in real time according to network conditions, effectively avoiding the client's sound discontinuity, image blooming or pause, thereby improving the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Quality & Reliability (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本发明公开了一种基于分层编码的抗丟包实时通信方法、系统及相关设备，发送端初始按照网络条件差设置编码参数和打包参数，根据编码参数和打包参数一次生成包含编码数据和保护数据的负载并发送给接收端，接收端根据接收到的负载统计网络状况参数并发送给发送端，发送端根据网络状况参数实时调整编码参数和打包参数，并根据调整后的编码参数和打包参数一次生成编码数据和保护数据的负载，本发明在实时通信中对网络中发生的丟包或拥塞进行自适应处理——根据网络条件实时调整保护数据的码率和传输位置，有效避免客户端出现声音不连续、图像花屏或停顿现象，从而提高了用户的体验。

Description

基于分层编码的抗丢包实时通信方法、 系统及相关设备 技术领域
本发明涉及通信技术领域， 尤其涉及一种基于分层编码的抗丢包实时 通信方法、 系统及相关设备。 背景技术
在实时通信中， 音视频媒体通常使用用户数据包协议进行传输， 由于 用户数据包协议是一种无连接的传输协议， 无法提供可靠的传输服务， 因 此网络中不可避免会发生丟包， 从而导致声音不连续、 视频花屏停顿等现 象， 严重影响通话质量。
丢包的原因一般可分为随机丢包和拥塞丢包， 目前用于抗丢包的方法 一般有： 交织和重传， 然而， 上述抗丟包的方法无法根据网络条件实时调 整传输码率及传输位置， 从而抗丢包性能欠佳， 还有待进一步提高。 发明内容
鉴于上述的分析， 本发明旨在提供一种基于分层编码的抗丢包实时通 信方法、 系统及相关设备， 以进一步提高网络的抗丟包的性能。
本发明的目的主要是通过以下技术方案实现的：
本发明实施例提供了一种基于分层编码的抗丢包实时通信方法， 该方 法包括：
发送端根据设置的编码参数和打包参数一次生成包含编码数据和保护 数据的负载并发送给接收端；
所述接收端根据接收到的所述负载统计网络状况参数并发送给所述发 送端； 所述发送端才艮据所述网络状况参数实时调整所述编码参数和所述打包 参数， 并根据调整后的所述编码参数和所述打包参数一次生成编码数据和 保护数据的负载。
优选地， 该方法还包括：
所述接收端根据接收到所述负载判断是否丟失编码数据包， 当确定丢 失编码数据包后， 根据接收到的所述负载中的指示信息找到丟失编码数据 包对应的保护数据， 并对丢失的编码数据包进行恢复。
优选地，， 所述网络状况参数包括以下一项或多项： 丢包率、 连续丟包 率、 时延、 抖动或目标码率。
优选地， 所述发送端根据所述网络状况参数实时调整所述编码参数和 所述打包参数， 包括：
所述发送端根据所述网络状况参数设置目标码率， 根据所述目标码率 及所述丟包率实时调整所述编码参数和所述打包参数。
优选地， 根据所述目标码率及所述丢包率实时调整所述编码参数和所 述打包参数， 包括：
当所述丟包率小于等于预设的丟包率阈值时， 不加保护数据， 仅根据 所述目标码率设定编码数据码率； 当所述丢包率大于所述预设的丢包率阈 值时， 在所述目标码率的限制下增加保护数据码率， 其中， 所述编码参数 包括所述编码数据码率， 所述打包参数包括所述保护数据码率。
优选地， 该方法还包括：
根据调整后的所述打包参数从保护数据的传输位置对应的编码数据中 截取部分或全部码流作为保护数据， 当所述连续丟包率低于预设的连续丟 包率阁值时， 将保护数据的传输位置放在下一帧， 当所述连续丟包率高于 预设的连续丟包率阈值时， 将保护数据的传输位置放在下下帧， 同时将所 述传输位置的指示信息打入所述负栽中。 本发明实施例还提供了一种基于分层编码的抗丢包实时通信系统， 该 系统包括： 发送端和接收端；
所述发送端， 配置为根据设置的编码参数和打包参数一次生成包含编 码数据和打包数据的负载发送给接收端； 以及根据所述接收端发送来的网 络状况参数实时调整所述编码参数和所述打包参数， 并根据调整后的所述 编码参数和所述打包参数一次生成编码数据和保护数据的负载；
所述接收端， 配置为接收所述发送端发送来的所述负载， 根据所述负 载统计网络状况参数并发送给所述发送端。
优选地， 所述接收端还配置为， 根据所述发送端发送来的所述负载判 断是否丢失编码数据包， 当确定丟失编码数据包后， 根据所述负载中的指 示信息找到丢失编码数据包对应的保护数据， 并对丢失的编码数据包进行 恢复。
本发明实施例又提供了一种发送端， 该发送端包括：
设置单元， 配置为按照网络条件差设置编码参数和打包参数， 并将所 述编码参数和所述打包参数发送给编码单元；
所述编码单元， 配置为根据所述设置单元发送来的所述编码参数和所 述打包参数或调整单元发送来调整后的所述编码参数和所述打包参数一次 生成包含编码数据和保护数据的负载并发送给接收端；
所述调整单元， 配置为根据所述接收端发送来的网络状况参数实时调 整所述编码参数和所述打包参数， 并将调整后的所述编码参数和所述打包 参数发送给所述编码单元。
优选地， 所述调整单元具体配置为， 根据所述接收端发送来的网络状 况参数设置目标码率， 当所述丢包率小于等于预设的丢包率阔值时， 不加 保护数据， 仅根据所述目标码率设定编码数据码率， 当所述丢包率大于所 述预设的丢包率阈值时， 在所述目标码率的限制下增加保护数据码率， 其 中， 所述编码参数包括所述编码数据码率， 所述打包参数包括所述保护数 据码率； 还根据调整后的所述打包参数从保护数据的传输位置对应的编码 数据中截取部分或全部码流作为保护数据， 当所述连续丟包率低于预设的 连续丢包率阈值时， 将保护数据的传输位置放在下一帧， 当所述连续丢包 率高于预设的连续丟包率阔值时， 将保护数据的传输位置放在下下帧。
本发明实施例再提供了一种接收端， 包括：
接收单元， 配置为接收所述发送端发送来的编码数据和保护数据的负 载；
统计单元， 配置为根据所述接收单元接收到的所述负载统计网络状况 参数并发送给所述发送端。
优选地， 还包括： 判断单元， 配置为根据所述接收单元收到的所述负 载判断是否丢失编码数据包， 当确定丢失编码数据包后， 根据接收到的所 述负载中的指示信息找到丟失编码数据包对应的保护数据， 并对丢失的编 码数据包进行恢复。
本发明实施例提供的基于分层编码的抗丢包实时通信方法、 系统及相 关设备， 通过接收端实时统计当前的网络状况参数， 并将网络状况参数发 送给发送端， 发送端根据当前的网络状况参数实时调整编码参数和打包参 数， 并根据所述编码参数和所述打包参数分配打包负载中的编码数据码率 和保护数据码率， 即本发明实施例在实时通信中对网络中发生的丢包或拥 塞进行自适应处理 根据网络条件实时调整保护数据的码率和传输位 置， 有效避免了客户端出现声音不连续、 图像花屏或停顿现象， 从而提高 了用户的体验。 附图说明
图 1为本发明实施例 1 中的基于分层编码的抗丢包实时通信方法的流 程图； 图 2为本发明实施例 1中的打包负载的结构示意图;
图 3为本发明实施例 3中的发送端结构示意图；
图 4为本发明实施例 4中的接收端结构示意图。 具体实施方式
下面结合附图来具体描述本发明的优选实施例， 其中， 附图构成本申 请一部分， 并与本发明的实施例一起用于阐释本发明的原理。 为了清楚和 简化目的， 当其可能使本发明的主题模糊不清时， 将省略本文所描述的器 件中已知功能和结构的详细具体说明。
实施例 1
本发明实施例提供了一种基于分层编码的抗丟包实时通信方法， 参见 图 1， 该方法包括：
5101、 发送端设置编码参数和打包参数；
需要说明的是， 发送端初始按照网络条件较差的场景设置编码参数和 打包参数。 其中， 所述网络条件较差包括存在连续丢包、 可用带宽较小或 丢包率较高等情况。
5102、 根据所述编码参数和所述打包参数一次生成编码数据和保护数 据的负载， 将所述负载发送给接收端；
其中， 本发明实施例中负载中的保护数据是所述编码数据的部分或全 部数据。
5103、 接收端接收所述发送端发送来的所述负载， 根据所述负载统计 网络状况参数， 并将统计的网络状况参数发送给所述发送端；
本发明实施例中的所述网络状况参数包括以下一项或多项： 丢包率、 时延、 抖动、 目标码率或连续丟包率。
5104、 接收端判断是否存在丟包， 当确定存在丟包后， 根据接收到的 所述负载对丟包的数据进行恢复； S105、 发送端根据所述接收端发送来的网络状况参数实时调整所述编 码参数和所述打包参数， 并根据所述编码参数和所述打包参数一次生成编 码数据和保护数据的负载。
该步骤具体包括： 所述发送端根据所述接收端发送来的所述网络状况 参数设置目标码率， 并根据所述目标码率及所述丟包率调整所述编码参数 和所述打包参数， 当所述丟包率小于等于预设的丟包率阈值时， 不加保护 数据， 仅根据所述目标码率设定编码数据码率； 当所述丢包率大于所述预 设的丢包率阔值时， 在所述目标码率的限制下增加保护数据码率， 其中， 所述编码参数包括所述编码数据码率， 所述打包参数包括所述保护数据码 率。 从图 2中可以看到本发明实施例中的打包负载的結构图， 包括负载头、 编码数据和保护数据， 其中， 负载头指示保护数据的长度指示及位置指示。
还包括： 根据调整后的所述打包参数从保护数据的传输位置对应的编 码数据中截取部分或全部码流作为保护数据， 当所述连续丟包率低于预设 的连续丢包率阈值时， 将保护数据的传输位置放在下一帧， 当所述连续丢 包率高于预设的连续丢包率阈值时， 将保护数据的传输位置放在下下帧， 同时将所述传输位置的指示信息打入所述负载中
本发明实施例提供了一种基于分层编码的抗丢包实时通信方法， 该方 法通过接收端实时统计当前的网络状况参数， 并将网络状况参数发送给发 送端， 发送端根据当前的网络状况参数实时调整编码参数和打包参数， 并 根据所述编码参数和所述打包参数分配打包负载中的编码数据码率和保护 数据码率， 即本发明实施例在实时通信中对网络中发生的丢包或拥塞进行 自适应处理 根据网络条件实时调整保护数据的码率和传输位置， 有效 避免客户端出现声音不连续、 图像花屏或停顿现象， 从而提高了用户的体 验。 实施例 2 本发明实施例还提供了一种基于分层编码的抗丢包实时通信系统， 该 系统包括： 发送端和接收端；
所述发送端， 配置为初始按照网络条件差设置编码参数和打包参数， 并根据所述编码参数和所述打包参数一次生成包含编码数据和打包数据的 负载， 将所述负载发送给接收端， 根据所述接收端发送来的网络状况参数 实时调整所述编码参数和所述打包参数， 并根据调整后的所述编码参数和 所述打包参数一次生成编码数据和保护数据的负载；
所述接收端， 配置为接收所述发送端发送来的所述负载， 根据所述负 载统计网络状况参数并发送给所述发送端， 并根据所述发送端发送来的编 码后的编码数据判断是否丢失编码数据包， 当确定丢失编码数据包后， 根 据接收到的所述负载对丢失的编码数据包进行恢复。 实施例 3
本发明实施例提供了一种发送端， 参见图 3， 该发送端包括： 设置单元 31、 编码单元 32和调整单元 33 ; 其中，
设置单元 31，配置为初始按照存网络条件差设置编码参数和打包参数， 并将所述编码参数和所述打包参数发送给编码单元 32;
编码单元 32，配置为根据设置单元 31发送来的所述编码参数和所述打 包参数或调整单元发送来调整后的所述编码参数和所述打包参数一次生成 包含编码数据和保护数据的负载并发送给接收端；
调整单元 33，配置为根据接收端发送来的网络状况参数设置目标码率， 当所述丟包率小于等于预设的丢包率阁值时， 不加保护数据， 仅根据所述 目标码率设定编码数据码率， 当所述丢包率大于所述预设的丢包率阈值时， 在所述目标码率的限制下增加保护数据码率， 其中， 所述编码参数包括所 述编码数据码率， 所述打包参数包括所述保护数据码率； 还根据调整后的 所述打包参数从保护数据的传输位置对应的编码数据中截取部分或全部码 流作为保护数据， 当所述连续丢包率低于预设的连续丢包率阈值时， 将保 护数据的传输位置放在下一帧， 当所述连续丢包率高于预设的连续丢包率 阈值时， 将保护数据的传输位置放在下下帧。 实施例 4
本发明实施例提供了一种接收端， 参见图 4， 该接收端包括： 接收单元 41、 统计单元 42和统计单元 43; 其中，
接收单元 41， 配置为接收所述发送端发送来的编码数据和保护数据的 负载；
统计单元 42 ,配置为根据接收单元 41接收到的所述负载统计网络状况 参数并发送给所述发送端。
判断单元 43，配置为根据接收单元 41收到的所述负载判断是否丢失编 码数据包， 当确定丢失编码数据包后， 根据接收到的所述负载对丢失的编 码数据包进行恢复。
综上所述， 本发明实施例提供了一种基于分层编码的抗丟包实时通信 方法、 系统及相关设备， 通过接收端实时统计当前的网络状况参数， 并将 网络状况参数发送给发送端， 发送端根据当前的网络状况参数实时调整编 码参数和打包参数， 并根据所述编码参数和所述打包参数分配打包负载中 的编码数据码率和保护数据码率， 即本发明实施例在实时通信中对网络中 发生的丢包或拥塞进行自适应处理一一根据网络条件实时调整保护数据的 码率和传输位置， 有效避免客户端出现声音不连续、 图像花屏或停顿现象， 从而提高了用户的体验。
以上所述， 仅为本发明较佳的具体实施方式， 但本发明的保护范围并 不局限于此， 任何熟悉本技术领域的技术人员在本发明揭露的技术范围内， 可轻易想到的变化或替换， 都应涵盖在本发明的保护范围之内。 因此， 本 发明的保护范围应该以权利要求书的保护范围为准。 工业实用性
本发明实施例提供的基于分层编码的抗丟包实时通信方法、 系统及相 关设备， 通过接收端实时统计当前的网络状况参数， 并将网络状况参数发 送给发送端， 发送端根据当前的网络状况参数实时调整编码参数和打包参 数， 并根据所述编码参数和所述打包参数分配打包负栽中的编码数据码率 和保护数据码率， 即本发明实施例在实时通信中对网络中发生的丢包或拥 塞进行自适应处理——根据网络条件实时调整保护数据的码率和传输位 置， 有效避免了客户端出现声音不连续、 图像花屏或停顿现象， 从而提高 了用户的体验。

Claims

权利要求书
1、 一种基于分层编码的抗丟包实时通信方法， 其中， 该方法包括： 发送端根据设置的编码参数和打包参数一次生成包含编码数据和保护 数据的负载并发送给接收端；
所述接收端根据接收到的所述负载统计网络状况参数并发送给所述发 送端；
所述发送端才艮据所述网络状况参数实时调整所述编码参数和所述打包 参数， 并根据调整后的所述编码参数和所述打包参数一次生成编码数据和 保护数据的负载。
2、 根据权利要求 1所述的方法， 其中， 该方法还包括：
所述接收端根据接收到所述负载判断是否丟失编码数据包， 当确定丟 失编码数据包后， 根据接收到的所述负载中的指示信息找到丢失编码数据 包对应的保护数据， 并对丢失的编码数据包进行恢复。
3、 根据权利要求 1或 2所述的方法， 其中， 所述网络状况参数包括以 下一项或多项： 丢包率、 连续丢包率、 时延、 抖动或目标码率。
4、 根据权利要求 3所述的方法， 其中， 所述发送端根据所述网络状况 参数实时调整所述编码参数和所述打包参数， 包括：
所述发送端根据所述网络状况参数设置目标码率， 根据所述目标码率 及所述丢包率实时调整所述编码参数和所述打包参数。
5、 根据权利要求 4所述的方法， 其中， 根据所述目标码率及所述丟包 率实时调整所述编码参数和所述打包参数， 包括：
当所述丢包率小于等于预设的丢包率阈值时， 不加保护数据， 仅根据 所述目标码率设定编码数据码率； 当所述丟包率大于所述预设的丟包率阈 值时， 在所述目标码率的限制下增加保护数据码率， 其中， 所述编码参数 包括所述编码数据码率， 所述打包参数包括所述保护数据码率。
6、 根据权利要求 5所述的方法， 其中， 该方法还包括：
根据调整后的所述打包参数从保护数据的传输位置对应的编码数据中 截取部分或全部码流作为保护数据， 当所述连续丟包率低于预设的连续丟 包率阈值时， 将保护数据的传输位置放在下一帧， 当所述连续丢包率高于 预设的连续丢包率阈值时， 将保护数据的传输位置放在下下帧， 同时将所 述传输位置的指示信息打入所述负载中。
7、 一种基于分层编码的抗丟包实时通信系统， 其中， 该系统包括： 发 送端和接收端；
所述发送端， 配置为根据设置的编码参数和打包参数一次生成包含编 码数据和打包数据的负载发送给接收端； 以及根据所述接收端发送来的网 络状况参数实时调整所述编码参数和所述打包参数， 并根据调整后的所述 编码参数和所述打包参数一次生成编码数据和保护数据的负载；
所述接收端， 配置为接收所述发送端发送来的所述负载， 根据所述负 载统计网络状况参数并发送给所述发送端。
8、 根据权利要求 7所述的系统， 其中，
所述接收端还配置为， 根据所述发送端发送来的所述负载判断是否丟 失编码数据包， 当确定丟失编码数据包后， 根据所述负载中的指示信息找 到丢失编码数据包对应的保护数据， 并对丢失的编码数据包进行恢复。
9、 一种发送端， 其中， 该发送端包括：
设置单元， 配置为设置编码参数和打包参数， 并将所述编码参数和所 述打包参数发送给编码单元；
所述编码单元， 配置为根据所述设置单元发送来的所述编码参数和所 述打包参数或调整单元发送来调整后的所述编码参数和所述打包参数一次 生成包含编码数据和保护数据的负载并发送给接收端；
所述调整单元， 配置为根据所述接收端发送来的网络状况参数实时调 整所述编码参数和所述打包参数， 并将调整后的所述编码参数和所述打包 参数发送给所述编码单元。
10、 根据权利要求 9所述的发送端， 其中，
所述调整单元具体配置为， 根据所述接收端发送来的网络状况参数设 置目标码率， 当所述丢包率小于等于预设的丟包率阈值时， 不加保护数据， 仅根据所述目标码率设定编码数据码率， 当所述丟包率大于所述预设的丟 包率阈值时， 在所述目标码率的限制下增加保护数据码率， 其中， 所述编 码参数包括所述编码数据码率， 所述打包参数包括所述保护数据码率； 还 根据调整后的所述打包参数从保护数据的传输位置对应的编码数据中截取 部分或全部码流作为保护数据， 当所述连续丟包率低于预设的连续丟包率 阈值时， 将保护数据的传输位置放在下一帧， 当所述连续丢包率高于预设 的连续丢包率阈值时， 将保护数据的传输位置放在下下帧。
11、 一种接收端， 其中， 该接收端包括：
接收单元， 配置为接收发送端发送来的编码数据和保护数据的负载； 统计单元， 配置为根据所述接收单元接收到的所述负载统计网络状况 参数并发送给所述发送端。
12、 根据权利要求 11所述的接收端， 其中， 还包括：
判断单元， 配置为根据所述接收单元收到的所述负载判断是否丢失编 码数据包， 当确定丟失编码数据包后， 根据接收到的所述负载中的指示信 息找到丟失编码数据包对应的保护数据， 并对丟失的编码数据包进行恢复。
PCT/CN2013/082203 2013-02-22 2013-08-23 基于分层编码的抗丢包实时通信方法、系统及相关设备 WO2013189428A2 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PL13807346T PL2950473T3 (pl) 2013-02-22 2013-08-23 Sposób, system i powiązane urządzenie dla łączności czasu rzeczywistego zapobiegające utracie pakietów na podstawie kodowania hierarchicznego
US14/769,626 US20160006667A1 (en) 2013-02-22 2013-08-23 Anti-packet-loss real-time communication method, system and related device based on hierarchical coding
EP13807346.5A EP2950473B1 (en) 2013-02-22 2013-08-23 Anti-packet-loss real-time communication method, system and related device based on hierarchical coding

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310057423.2A CN104009819B (zh) 2013-02-22 2013-02-22 基于分层编码的抗丢包实时通信方法、系统及相关设备
CN201310057423.2 2013-02-22

Publications (2)

Publication Number Publication Date
WO2013189428A2 true WO2013189428A2 (zh) 2013-12-27
WO2013189428A3 WO2013189428A3 (zh) 2014-02-20

Family

ID=49769569

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/082203 WO2013189428A2 (zh) 2013-02-22 2013-08-23 基于分层编码的抗丢包实时通信方法、系统及相关设备

Country Status (5)

Country Link
US (1) US20160006667A1 (zh)
EP (1) EP2950473B1 (zh)
CN (1) CN104009819B (zh)
PL (1) PL2950473T3 (zh)
WO (1) WO2013189428A2 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104967915A (zh) * 2015-06-19 2015-10-07 美国掌赢信息科技有限公司 一种即时视频传输过程中的编码方法和电子设备
CN106464952A (zh) * 2014-06-02 2017-02-22 索尼公司 用于用户设备的基于上下文的自适应流处理算法

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105989844B (zh) * 2015-01-29 2019-12-13 中国移动通信集团公司 一种音频传输的自适应方法及装置
CN105100675B (zh) * 2015-09-11 2019-07-09 Tcl集团股份有限公司 一种终端视频通信的质量调节方法及系统
CN105656602B (zh) * 2015-12-31 2019-05-14 小米科技有限责任公司 数据传输方法及装置
CN105681826B (zh) * 2016-01-08 2019-08-23 全时云商务服务股份有限公司 视频数据传输系统和方法以及视频数据解码方法
CN105812097B (zh) * 2016-03-16 2019-04-23 北京邮电大学 一种基于网络状态的amr编码速率自适应调整方法
CN107770473B (zh) * 2016-08-16 2020-05-26 大唐移动通信设备有限公司 一种音视频数据传输控制方法和装置
WO2018076376A1 (zh) * 2016-10-31 2018-05-03 华为技术有限公司 一种语音数据传输方法、用户设备以及存储介质
KR20200094525A (ko) 2019-01-30 2020-08-07 삼성전자주식회사 서로 연관된 복수의 데이터를 포함하는 하나의 파일을 처리하는 전자 장치
CN111417029B (zh) * 2020-02-25 2022-06-24 广州广哈通信股份有限公司 视频码率的调整方法、系统、终端及存储介质
CN116797673B (zh) * 2023-08-22 2023-10-31 四川沃耐稀新材料科技有限公司 一种硝酸锆冷却结晶状态监测方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6765904B1 (en) * 1999-08-10 2004-07-20 Texas Instruments Incorporated Packet networks
US7295549B2 (en) * 2003-02-14 2007-11-13 Ntt Docomo, Inc. Source and channel rate adaptation for VoIP
US7225382B2 (en) * 2004-05-04 2007-05-29 Telefonakiebolaget Lm Ericsson (Publ) Incremental redundancy operation in a wireless communication network
JP2007142614A (ja) * 2005-11-16 2007-06-07 Ricoh Co Ltd 画像処理装置、画像処理方法、プログラム及び情報記録媒体
US20080063202A1 (en) * 2006-09-12 2008-03-13 Michael Zhu Reconfigurable handheld device to perform various tasks
CN101222296B (zh) * 2008-01-31 2010-06-09 上海交通大学 上行蜂窝视频通信中自适应的传输方法及系统
CN101777960B (zh) * 2008-11-17 2013-08-14 华为终端有限公司 音频编码方法、音频解码方法、相关装置及通信系统
JP4883076B2 (ja) * 2008-12-12 2012-02-22 ソニー株式会社 情報処理装置および方法
WO2011151647A2 (en) * 2010-06-01 2011-12-08 Gi Provision Limited Data transmission apparatus, system and method
CN102446509B (zh) * 2011-11-22 2014-04-09 中兴通讯股份有限公司 增强抗丢包的音频编解码方法及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106464952A (zh) * 2014-06-02 2017-02-22 索尼公司 用于用户设备的基于上下文的自适应流处理算法
CN104967915A (zh) * 2015-06-19 2015-10-07 美国掌赢信息科技有限公司 一种即时视频传输过程中的编码方法和电子设备
CN104967915B (zh) * 2015-06-19 2019-04-02 美国掌赢信息科技有限公司 一种即时视频传输过程中的编码方法和电子设备

Also Published As

Publication number Publication date
CN104009819A (zh) 2014-08-27
US20160006667A1 (en) 2016-01-07
EP2950473A2 (en) 2015-12-02
CN104009819B (zh) 2018-08-07
EP2950473A4 (en) 2015-12-02
WO2013189428A3 (zh) 2014-02-20
PL2950473T3 (pl) 2020-01-31
EP2950473B1 (en) 2019-07-17

Similar Documents

Publication Publication Date Title
WO2013189428A2 (zh) 基于分层编码的抗丢包实时通信方法、系统及相关设备
US10542064B2 (en) Method, server side and system for computing bandwidth of network transmission of streaming media
WO2017157303A1 (zh) 实时通信中的抗丢包方法、装置和系统
EP2312787B1 (en) Method and device of data transmission
CN104519325B (zh) 一种基于4g网络的无线视频监控系统自适应保障方法
JP5094593B2 (ja) 送信装置、受信装置、及び方法、プログラム
CN101909208B (zh) 一种适用于cdma2000的视频无线传输控制方法
US9781488B2 (en) Controlled adaptive rate switching system and method for media streaming over IP networks
US20120272124A1 (en) Method and System for Recovering Lost Media Data Packets
KR20120117907A (ko) 재전송 결정을 위한 장치 및 방법
WO2008112441A1 (en) Reducing effects of packet loss in video transmissions
CN104980819A (zh) 一种视频传输方法及装置
JP4834013B2 (ja) 送信装置、送信プログラム、受信装置及び受信プログラム
CN102348095A (zh) 一种用于移动设备视频通信中、保持图像稳定传输的方法
CN104104924A (zh) 一种基于3g网络的视频监控系统带宽自适应传输方法
Baguda et al. Adaptive FEC error control scheme for wireless video transmission
CN109274980A (zh) 一种用于快速直播的数据传输方法
KR100631516B1 (ko) 스트리밍 시스템 및 적응적 대역 할당 방법
Ma et al. Early packet loss feedback for webrtc-based mobile video telephony over Wi-Fi
JP5523163B2 (ja) 送信装置、送信方法、プログラム
Harun et al. Enhancement on adaptive FEC mechanism for video transmission over burst error wireless network
Schier et al. Content-aware selective reliability for DCCP video streaming
Kreith et al. FRACTaL: FEC-based rate control for RTP
CN105657573A (zh) 一种mpeg-4压缩视频数据网络分包方法
TWI504245B (zh) 視訊傳輸控制方法

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 14769626

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2013807346

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13807346

Country of ref document: EP

Kind code of ref document: A2