CN103179466B - 基于反向链路信息的视频差错控制 - Google Patents

基于反向链路信息的视频差错控制 Download PDF

Info

Publication number
CN103179466B
CN103179466B CN201310027387.5A CN201310027387A CN103179466B CN 103179466 B CN103179466 B CN 103179466B CN 201310027387 A CN201310027387 A CN 201310027387A CN 103179466 B CN103179466 B CN 103179466B
Authority
CN
China
Prior art keywords
bag
video data
nak
error control
encoded
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310027387.5A
Other languages
English (en)
Other versions
CN103179466A (zh
Inventor
李彦辑
克里斯托弗·杰勒德·洛特
皮拉波尔·丁那功西素帕
维克拉姆·古普塔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/315,399 external-priority patent/US8842555B2/en
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Priority claimed from CN 200680046647 external-priority patent/CN101326829A/zh
Publication of CN103179466A publication Critical patent/CN103179466A/zh
Application granted granted Critical
Publication of CN103179466B publication Critical patent/CN103179466B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6156Network physical structure; Signal processing specially adapted to the upstream path of the transmission network
    • H04N21/6181Network physical structure; Signal processing specially adapted to the upstream path of the transmission network involving transmission via a mobile phone network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • H04N19/895Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/6473Monitoring network processes errors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64746Control signals issued by the network directed to the server or the client
    • H04N21/64761Control signals issued by the network directed to the server or the client directed to the server
    • H04N21/64776Control signals issued by the network directed to the server or the client directed to the server for requesting retransmission, e.g. of data packets lost or corrupted during transmission from server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6583Acknowledgement

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Detection And Prevention Of Errors In Transmission (AREA)
  • Communication Control (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明涉及基于反向链路信息的视频差错控制。本揭示案涉及反向链路下层辅助的视频差错控制。一种方法可编码视频数据,运用所述经编码的视频数据形成包,且跨越无线信道将所述包传输到接入网络。媒体接入控制(MAC)层可从所述接入网络接收否定应答(NAK)。所述方法可确定所述接收的NAK是否与含有视频数据的包相关联。如果所述接收的NAK与含有视频数据的包相关联,那么所述方法可执行差错控制。

Description

基于反向链路信息的视频差错控制
分案申请的相关信息
本案是分案申请。该分案的母案是申请日为2006年10月20日、申请号为200680046647.1、发明名称为“基于反向链路信息的视频差错控制”的发明专利申请案。
优先权主张
本申请案是基于2005年12月21日申请的题为“METHODS AND SYSTEMS FORADAPTIVE ENCODING OF REAL-TIME INFORMATION TN PACKET-SWTTCHED WIRELESSCOMMUNICATION SYSTEMS”的第11/315,399号共同转让的美国专利申请案(代理人案号051126)的部分接续申请案并主张其优先权,所述美国专利申请案主张2005年10月21日申请的第60/729,017号美国临时申请案的优先权,这两个申请案全文以引用的方式并入本文中。
技术领域
本揭示案涉及视频编码,且更明确地说涉及反向链路下层辅助的视频差错控制。
背景技术
蜂窝式电话可包括音频俘获装置(例如麦克风或语音合成器)和音频编码器以产生音频包(或帧)。所述电话可使用通信协议层和模块,例如无线电链路协议(RLP)模块、媒体接入控制(MAC)层和物理(PHY)层。所述电话可将音频包放置于RLP队列中。MAC层模块可从RLP队列的内容产生MAC层包。MAC层包可转换为PHY层包以跨越通信道传输到另一通信装置。
发明内容
一个方面涉及一种方法,其包含:编码视频数据;运用所述经编码的视频数据形成因特网协议(IP)包;跨越无线信道将所述包传输到接入网络;在媒体接入控制(MAC)层处,从所述接入网络接收否定应答(NAK);确定所述接收的NAK是否与含有视频数据的包相关联;确定哪一IP包含有在传输中丢失的数据;和在所述接收的NAK与含有视频数据的包相关联的情况下,执行差错控制。
另一方面涉及一种方法,其包含:编码视频数据的第一帧;运用视频数据的所述经编码的第一帧形成一包;跨越无线信道将所述包传输到接入网络;在编码视频数据的第二帧之前,确定媒体接入控制(MAC)层是否从所述接入网络接收否定应答(NAK);确定所述接收的NAK是否与含有视频数据的包相关联;和在所述接收的NAK与含有视频数据的包相关联的情况下,执行差错控制。
另一方面涉及一种包含存储一组指令的机器可读存储器的设备,所述指令经配置以:编码视频数据;运用所述经编码的视频数据形成因特网协议(IP)包;跨越无线信道将所述包传输到接入网络;在媒体接入控制(MAC)层处,从所述接入网络接收否定应答(NAK);确定所述接收的NAK是否与含有视频数据的包相关联;确定哪一IP包含有在传输中丢失的数据;和在所述接收的NAK与含有视频数据的包相关联的情况下,执行差错控制。
另一方面涉及一种包含存储一组指令的机器可读存储器的设备,所述指令经配置以:编码视频数据的第一帧;运用视频数据的所述经编码的第一帧形成一包;跨越无线信道将所述包传输到接入网络;在编码视频数据的第二帧之前,确定媒体接入控制(MAC)层是否从所述接入网络接收否定应答(NAK);确定所述接收的NAK是否与含有视频数据的包相关联;和在所述接收的NAK与含有视频数据的包相关联的情况下,执行差错控制。
另一方面涉及一种设备,所述设备包含:视频编码器,其经配置以编码视频数据;模块,其经配置以运用所述经编码的视频数据形成因特网协议(IP)包;收发器,其经配置以(a)跨越无线信道将所述包传输到接入网络且(b)从所述接入网络接收媒体接入控制(MAC)层否定应答(NAK);其中所述模块经配置以确定所述接收的NAK是否与含有视频数据的包相关联,且确定哪一IP包含有在传输中丢失的数据;且在所述接收的NAK与含有视频数据的包相关联的情况下,所述视频编码器经配置以执行差错控制。
一种设备包含:视频编码器,其经配置以编码视频数据的第一帧;第一模块,其经配置以运用视频数据的所述经编码的第一帧形成一包;收发器,其经配置以(a)跨越无线信道将所述包传输到接入网络且(b)从所述接入网络接收媒体接入控制(MAC)层否定应答(NAK);第二模块,其经配置以在编码视频数据的第二帧之前确定所述MAC层是否从所述接入网络接收NAK并确定所述接收的NAK是否与含有视频数据的包相关联;和差错控制模块,其经配置以在所述接收的NAK与含有视频数据的包相关联的情况下执行差错控制。
下文的附图和描述中陈述一个或一个以上实施例的细节。
附图说明
图1说明具有跨越传输信道将数据发送到解码器装置的视频和音频编码器装置的通信系统。
图2说明用于检测和控制错误的第一方式的方法和结构,其可用于图1的系统中。
图3说明用于检测和控制错误的第二方式的方法和结构,其可用于图1的系统中。
图4进一步说明图2和图3的第一和第二方式。
图5说明检测丢失的包且强制内部更新的实例,所述内部更新使由丢失的包引起的错误传播最小化。
具体实施方式
视频和音频编码和传输
图1说明具有跨越传输信道16(包括接入网络组件15)将数据发送到解码器装置14的视频和音频编码器装置12的通信系统10。编码器装置12和解码器装置14可分散于系统10各处。编码器装置12和解码器装置14可表示各种类型的装置,例如无线电话、蜂窝式电话、膝上型计算机、无线多媒体装置、无线通信个人计算机(PC)卡、个人数字助理(PDA)、外部或内部调制解调器或经由无线信道通信的任何装置。
编码器装置12和解码器装置14每一者可具有各种名称,例如接入终端(AT)、接入单元、订户单元、移动台、移动装置、移动单元、移动电话、移动体、远程台、远程终端、远程单元、用户装置、用户设备、手持式装置等。
每一装置12、14可与接入网络(AN)组件15在前向链路(FL)和/或反向链路(RL)上通信。FL(或下行链路)是指从AN15到装置12、14的传输。反向链路(或上行链路)是指从装置12、14到AN15的传输。AN15可以指通信系统的网络部分且可包括(但不限于)或实施基站(BS)、基站收发器系统(BTS)、接入点(AP)、调制解调器集区收发器(modem pooltransceiver,MPT)、节点B(例如,在WCDMA型系统中)等的功能。
编码器装置12可在第一视频通信装置中且可包括音频源17、视频源18、视频编码器20、音频编码器22、实时传送协议(RTP)/用户数据报协议(UDP)/因特网协议(IP)转换模块26、无线电链路协议(RLP)队列28、MAC层模块30和物理(PHY)层模块32。编码器装置12的其它实施例可包括代替图1中所示的元件的其它元件或除图1中所示的元件外的其它元件。编码器装置12的其它实施例可包括比图1中所示的元件少的元件。
解码器装置14可在另一视频通信装置中且可包括PHY层模块34、MAC层模块36、RLP队列38、RTP/UDP/IP转换模块40、视频解码器42、音频解码器44、音频输出单元46和视频输出单元48。解码器装置14的其它实施例可包括代替图1中所示的元件的其它元件或除图1中所示的元件外的其它元件。解码器装置14的其它实施例可包括比图1中所示的元件少的元件。
系统10可经由信道16提供双向视频和音频传输,例如视频电话(VT)。互逆编码、解码和转换模块可提供于信道16的相对端。在一些实施例中,编码器装置12和解码器装置14可在例如经配备用于视频串流、VT或两者的无线移动终端的视频通信装置内实施。移动终端可根据例如RTP、UDP或IP的包交换标准而支持VT。
视频源18可为视频俘获装置,例如视频摄影机、一个或一个以上视频档案库(video archive)或视频摄影机与视频档案库的组合。视频编码器20根据例如MPEG-4的视频压缩方法产生经编码的视频数据包。可使用其它视频压缩方法,例如国际电信联盟(ITU)H.263、ITU H.264或MPEG-2方法。视频编码器20可提供通常依赖于CODEC的视频源速率控制方案。举例来说,视频编码器20可适于根据MPEG4、ITU H.263或ITU H.264进行视频编码。视频编码器20可通过DSP或经嵌入的逻辑核心来实施。
音频源17可为例如麦克风或语音合成器装置的音频俘获装置。音频编码器22可编码音频数据并产生音频包以伴随视频数据。音频数据可根据例如自适应多速率窄带(AMR-NB)或其它技术的音频压缩方法来编码。对于VT应用,视频将允许一方对VT会议的检视,且音频将允许听到所述方的语音。
RTP/UDP/IP转换模块26从视频编码器20和音频编码器22获得视频和音频数据包。RTP/UDP/IP转换模块26可将适当的RTP/UDP/IP标头信息添加到从音频编码器22和视频编码器20接收的音频和视频数据包,并将数据包放置于RLP队列28中。RTP可在UDP上运行。UDP可在IP上运行。在一种配置中,IP可在点对点协议(PPP)层上运行。
MAC层模块30可从RLP队列28中检索RLP包并产生MAC层包。每一MAC层包可载运RTP/UDP/IP标头信息和包含于RLP队列28内的音频或视频包数据。
音频包可独立于视频包而插入于RLP队列28中。在一些情况下,从RLP队列28的内容所产生的MAC层包将仅载运标头信息和视频包数据。在其它情况下,MAC层包将仅载运标头信息和音频包数据。在其它情况下,视RLP队列28的内容而定,MAC层包将载运标头信息、音频包数据和视频包数据。MAC层包可根据无线电链路协议(RLP)来配置,且可称为MAC RLP包。
PHY层模块32可将MAC RLP包转换为PHY层包以用于经由信道16传输。信道16将PHY层包载运到解码器装置14。
在解码装置14中,PHY层模块34与MAC层模块36可以相反方式操作。PHY层模块34可从PHY层包中识别MAC层包且将从信道16接收的PHY层包转换/重组为MACRLP包。
MAC层模块36可重组MAC RLP包的内容以提供视频和音频包,以便将MAC RLP包插入于RLP队列38中。RTP/UDP/IP转换模块40可从RLP队列38中的数据中去除/剥离伴随的标头信息,并重组视频和音频数据以分别传递到视频解码器42和音频解码器44。
视频解码器42解码视频数据帧以产生视频数据流,以用于驱动显示装置(视频输出)48。音频解码器44解码音频数据以产生音频信息,以用于(例如)经由音频扬声器(音频输出)46呈现给用户。
视频电话(VT)是指在至少两个装置(例如系统12与14)之间的音频和视频包的实时通信。在移动VT应用中,VT装置(无线终端)经由无线前向链路(FL)(即,“下行链路”)从基站接收PHY层包。VT装置经由无线反向链路(RL)(即,“上行链路”)将PHY层包传输到基站。
系统10和信道16可经设计以支持一种或一种以上无线通信技术,例如码分多址(CDMA)、频分多址(FDMA)、时分多址(TDMA)或正交频分多路复用(OFDM)或另一适合的无线技术。可根据多种无线电接入技术中的任一者来提供以上无线通信技术。举例来说,可根据cdma2000或宽带CDMA(WCDMA)标准来提供CDMA。可根据全球移动通信系统(GSM)标准来提供TDMA。通用移动电信系统(UMTS)标准允许GSM或WCDMA操作。对于VT应用,系统10可经设计以支持高数据速率(HDR)技术,例如cdma20001x EV-DO版本0修订版A或随后的EV-DO版本。
信道条件对于无线信道可能是一个关注因素,但其对于移动VT应用可能尤其有问题,在移动VT应用中,信道条件可遭受衰落或网络拥塞。
视频差错控制
下层辅助的视频差错控制方法可解决视频数据在反向链路上传输期间所出现的错误。所述方法可使得视频编码器20能够使用来自MAC层30的信道错误信息且立即应用差错控制,而无需等待来自接收装置14的反馈。所述方法可使用用于检索/接收可由视频编码器20了解的错误信息的机制。视所需的实施复杂性而定,可将来自MAC层30的错误信息转化为两种不同格式。
在从下层接收错误消息之后,视频编码器20可(a)为新的帧使用不同的参考帧,(b)增加宏区块(MB)内部更新率,或(c)插入内部帧(I帧)以阻止接收器处的错误传播。插入I帧基本上与强制内部更新相同。在I帧中,每一MB经帧内编码,即其不视先前帧而定,这可阻止错误传播。对于MB内部更新,仅有一些MB经帧内编码。选项(c)可避免使用周期性I帧(或减少内部帧更新率)以改进编码效率和视频延迟,以及在错误发生时提供较好的视频质量。视频质量可能较好是因为视频编码器20可立即清除错误,而不是逐渐更新随后帧中的每一MB。
图5说明检测包丢失和强制内部更新的实例,内部更新使由丢失的包引起的错误传播最小化。
在下文中使用CDMA20001x EV-DO修订版A反向链路作为接收/检索来自MAC层30的错误信息的一个实例。所述方法还可应用于其它通信系统,例如WCDMA高速上行链路包接入(HSUPA)系统,其使用H-ARQ、NAK或其它类似方式检测传输错误和/或丢失的信息。
下文中所描述的方法可提供对于包括视频电话和视频共享(其中传输错误可能是不可避免的)的无线网络上的多媒体中的错误性能的跨层优化。
对于前向链路(下行链路)传输错误,一些方法可使用端对端反馈来提供错误信息。然而,如果这些方法只是依赖端对端反馈,那么其可能无法足够快速地回应RL传输错误以减少由丢失的包引起的假像。本文中所描述的RL方法可补充端对端反馈方式。
使用NAK信息的MAC辅助的视频差错控制
此部分描述使用来自接入网络15的否定应答(NAK)信息的两种MAC辅助的视频差错控制方法。在两种方法中,视频编码器20或差错控制模块206可逐帧地查询MAC层30,即在编码新的帧之前,视频编码器20可接收来自一个或一个以上下层的错误信息且视需要执行差错控制。基于错误信息消息类型,视频编码器20可执行不同的差错控制方案以减轻错误传播。
第一方式:使用视频流IP包NAK的差错控制
图2说明用于第一方式的方法和结构,其中向视频编码器20或差错控制模块206通知视频帧中的哪些宏区块(MB)在传输中丢失。每一视频帧可包含多个宏区块。
当发生传输错误时,接入网络15将NAK发送到反向业务信道MAC(RTCMAC)层30。所述MAC层30向包合并协议(Packet Consolidation Protocol;PCP)模块210通知与NAK相关联的MAC包。
PCP模块210确定丢失的MAC包是否含有任何视频流数据。尽管EV-DO修订版A反向链路中支持服务质量(QoS),但音频和视频数据可放置于同一MAC包中。如果在丢失的MAC包中具有视频数据,那么PCP模块210将使用RLP包NAK向RLP模块208通知哪一RLP队列(可能存在若干RLP队列)含有在传输中经历错误的包。
RLP模块208确定哪一IP包含有丢失的数据。RLP模块208知晓IP包。对于EV-DO修订版A,视频流经配置使得链路流数据单元为IP包。接着RLP模块208使用视频流IP包NAK通知应用层中的RTP层202哪一IP包已丢失。
RTP层202维持映射图或表,所述映射图或表在一帧中将丢失的IP包转换为丢失的MB。接着丢失的MB的信息将被传递到差错控制模块206和/或视频编码器20以用于进一步差错控制。
此第一方式可涉及三个不同层处的修改:
□视频编码器20将每一包中的MB的信息传递到RTP层202。
□RTP层202维持IP包(由序列号索引)与宏区块之间的转换映射图或表。如果IP包丢失,那么RTP层202可将IP包转换为宏区块并通知视频编码器20丢失的MB。与每一IP包相关联的序列号也可被传递到RLP模块208。
□RLP模块208追踪IP包如何分段为RLP包并通过检查序列号来确定哪一IP包丢失。
对于差错控制,因为视频编码器20知道哪些MB丢失,所以视频编码器20或差错控制模块206可执行以下差错控制方法中的一者或一者以上:
□限制运动估计搜索范围以使得已损坏(丢失)的部分将不用作预测。
□对共同定位的MB及其邻近的MB进行帧内编码。
□对共同定位的MB使用不同的参考帧。
第二方式:使用视频流NAK的差错控制
上文所描述的第一方式可提供良好的差错控制能力和性能,但实施复杂性可能相对较高。第一方式可能需要修改RTP和RLP层202、208。第二方式可提供用于差错控制的简单化但有效的方式。
图3说明用于第二方式的方法和结构。与图2相比,图3可不要求对RTP层202的修改。实际上,第二方式可不需要RTP层202执行任何操作。事实上,视频编码器或差错控制模块206可在编码视频数据的每一新的帧之前查询RLP模块208,且错误信息可直接传递到视频编码器20或差错控制模块206以用于差错控制。此错误消息可仅仅是RLP模块208中设定的旗标(例如,二进制位),其向视频编码器20通知从上次查询MAC层30以来在视频流上是否有任何数据丢失。在一个实施例中,MAC层30可将NAK自动发送到PCP模块210,所述PCP模块210将NAK发送到RLP模块208,所述RLP模块208设定旗标而不对PCP或MAC层210、30进行任何查询。
在编码两个视频帧之间,视频编码器20可仅需要获知是否有任何数据在先前帧中丢失,因此视频编码器20或差错控制模块206可在当前帧上执行差错控制。因为编码器20或差错控制模块206逐帧地查询RLP模块208,即在编码新的帧之前,获知是否存在任何传输错误可能与获知哪一IP包丢失几乎一样。
如果MAC层自动重复请求(MARQ)用于视频流,那么应仅在含有视频数据的MARQ包在物理层处未获得肯定应答(ACK)时设定此旗标。
此第二方式可大大简化实施复杂性并为视频编码器20提供有用的信息以执行正确的差错控制。然而,因为旗标仅可指示是否存在错误,所以视频编码器20不能获知帧的哪部分丢失。因此,差错控制应假定从上次查询以来错误可发生于任何帧的任何部分中。
一旦设定此旗标,视频编码器20就可执行以下差错控制方法中的一者或一者以上,所述方法可不同于第一方式:
□将当前帧编码为I帧。
□增加经帧内编码的MB的百分率。
□在先前帧之前使用所述帧作为用于运动估计的参考。
图4进一步说明第一和第二方式。使用EV-DO修订版A保留链路信道作为一实例,但可使用其它类型的信道、标准和通信协议。在图4的底部附近,MAC层30在时隙n中将含有音频和视频数据的MAC包作为第一子包发送到物理层32。举例来说,假定为12时隙终止且所有这些MAC包均载运视频数据,那么在MAC层30处每秒可传输50个包。EV-DO物理层可使得接入终端能够几乎即刻在反向链路上检测丢失的包。
MAC层30经由混合ARQ(H-ARQ)信道从基站接收NAK。MAC层30尝试在时隙n+3期间发送第二子包。MAC层30再次经由H-ARQ信道从基站接收第二NAK。MAC层30尝试在时隙n+6期间发送第三子包。MAC层30再次经由H-ARQ信道从基站接收第三NAK。MAC层30尝试在时隙n+9期间发送第四子包。MAC层30经由上一ARQ(L-ARQ)信道从基站接收NAK且还经由包ARQ(P-ARQ)信道从基站接收NAK。这促使MAC层30通知PCP模块210。
第二方式可允许视频编码器20在错误之后快速恢复,且用户可能看不到质量降级的视频。第二方式可在错误后即刻插入I帧以立即阻止错误传播。当没有错误时,第二方式可因I帧而提供比其它方法更好的质量和更少的帧跳越。
视频编码器装置12可具有用于存储指令和数据的专用存储器,以及专用硬件、软件、固件或其组合。如果在软件中实施,那么所述技术可实施为在计算机可读媒体上的指令,所述计算机可读媒体例如为随机存取存储器(RAM)、只读存储器(ROM)、非易失性随机存取存储器(NVRAM)、电可擦除可编程只读存储器(EEPROM)、快闪存储器等。所述指令促使一个或一个以上处理器执行本揭示案中所描述的功能性的某些方面。
本揭示案中所描述的技术可在通用微处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或其它等效逻辑装置内实施。举例来说,视频编码器装置12、视频解码器装置14和相关联的组件及模块可实施为在数字信号处理器(DSP)或其它处理装置上运行的编码过程或编码/解码(CODEC)过程的若干部分。因此,描述为模块的组件可形成此类过程或一单独过程的可编程特征。
视频编码器装置12可具有用于存储指令和数据的专用存储器,以及专用硬件、软件、固件或其组合。如果在软件中实施,那么所述技术可实施为可由一个或一个以上处理器执行的指令。所述指令可存储于计算机可读媒体上,所述计算机可读媒体例如随机存取存储器(RAM)、只读存储器(ROM)、非易失性随机存取存储器(NVRAM)、电可擦除可编程只读存储器(EEPROM)、快闪存储器、磁性或光学数据存储装置等。所述指令促使一个或一个以上处理器执行本揭示案中所描述的功能性的某些方面。
已描述各种实施例。这些和其它实施例在所附权利要求书的范围内。

Claims (17)

1.一种差错控制方法,其包含:
编码视频数据与音频数据;
形成若干因特网协议IP包,所述若干IP包包含至少一个具有经编码的视频数据而非音频数据的包、至少一个具有经编码的音频数据而非视频数据的包,以及,至少一个具有经编码的音频数据及经编码的视频数据两者的包;
跨越无线信道将所述若干IP包传输到接入网络;
在媒体接入控制MAC层处,从所述接入网络接收否定应答NAK;
确定所述接收的NAK是否来自所述若干IP包中与含有视频数据的包相关联;
确定来自所述若干IP包中哪一包含有在传输中丢失的数据;
仅在所述接收的NAK与含有视频数据的包相关联时,执行差错控制;
维持因特网协议IP包与视频数据的宏区块之间的映射;
在确定哪一IP包含有在传输中丢失的数据之后,使用所述映射将所述IP包转换为视频帧的宏区块以确定哪些宏区块在传输中丢失;以及
对在传输中丢失的所述宏区块执行差错控制,
其中所述差错控制由编码器执行,所述编码器经配置以根据反向链路延迟和多组阈值来编码实时信息。
2.根据权利要求1所述的方法,其中所述至少一个具有经编码的视频数据的包包含视频数据的宏区块MB,所述方法进一步包含将所述宏区块的信息从视频编码器传递到实时传送协议RTP层。
3.根据权利要求1所述的方法,其进一步包含:
在编码一视频数据帧之后且在编码新的视频数据帧之前,查询所述MAC层以确定所述MAC层是否接收到NAK;以及
如果所述MAC层接收到NAK,则执行差错控制。
4.根据权利要求1所述的方法,其进一步包含向包合并协议PCP模块通知所述接收的NAK。
5.根据权利要求1所述的方法,其进一步包含:如果所述接收的NAK与含有视频数据的包相关联,那么向无线电链路协议RLP模块通知所述接收的NAK。
6.根据权利要求5所述的方法,其进一步包含确定哪一RLP队列含有在传输中经历错误的包。
7.根据权利要求1所述的方法,其进一步包含向应用层通知与所述接收的NAK相关联的所述包。
8.根据权利要求1所述的方法,其中差错控制包含以下各项中的至少一者:(a)限制运动估计搜索范围以使得已损坏的部分将不用作预测;(b)对共同定位的宏区块和邻近的宏区块进行帧内编码;和(c)对共同定位的宏区块使用不同的参考帧。
9.根据权利要求1所述的方法,其中所述无线信道包含码分多址2000 1x演进数据优化修订版A CDMA2000 1x EV-DO修订版A信道。
10.根据权利要求1所述的方法,其中所述无线信道包含宽带码分多址WCDMA高速上行链路包接入HSUPA信道。
11.一种差错控制方法,其包含:
编码第一视频数据帧与音频数据;
形成具有经编码的第一视频数据帧的第一包及具有经编码的音频数据的第二包;
跨越无线信道将所述包传输到接入网络;
在编码第二视频数据帧之前,确定媒体接入控制MAC层是否从所述接入网络接收到否定应答NAK;
确定所述接收的NAK是否与含有视频数据的所述第一包相关联;
仅在所述接收的NAK与含有视频数据的所述第一包相关联时,执行差错控制,其中确定媒体接入控制MAC层是否从所述接入网络接收到否定应答NAK包含:检查是否在无线电链路协议RLP模块中设定了旗标,
其中所述差错控制由编码器执行,所述编码器经配置以根据反向链路延迟和多组阈值来编码实时信息。
12.根据权利要求11所述的方法,其进一步包含向应用层通知所述接收的NAK。
13.根据权利要求11所述的方法,其进一步包含向视频编码器通知所述接收的NAK。
14.根据权利要求11所述的方法,其进一步包含在无线电链路协议RLP模块中设定1位旗标以指示所述MAC层接收到NAK。
15.根据权利要求11所述的方法,其中差错控制包含以下各项中的至少一者:(a)将所述第二帧编码为I帧;(b)增加经帧内编码的宏区块的百分率;和(c)将所述第一帧之前的帧用作运动估计的参考。
16.一种差错控制设备,其包含:
编码器,其经配置以编码视频数据与音频数据;
模块,其经配置以形成若干因特网协议IP包;所述若干IP包包含至少一个具有经编码的视频数据而非音频数据的包、至少一个具有经编码的音频数据而非视频数据的包,及至少一个具有经编码的音频数据和经编码的视频数据两者的包;
收发器,其经配置以(a)跨越无线信道将所述包传输到接入网络,且(b)从所述接入网络接收媒体接入控制MAC层否定应答NAK;
其中所述模块经配置以确定所述接收的NAK是否与来自所述若干IP包中含有视频数据的包相关联并确定来自所述若干IP包中的哪一包含有在传输中丢失的数据;
仅在所述接收的NAK与含有视频数据的包相关联时,所述编码器经配置以执行差错控制;
RTP层,其经配置以维持因特网协议IP包与视频数据的宏区块之间的映射;在确定哪一IP包含有在传输中丢失的数据之后,所述RTP层经配置以使用所述映射将所述IP包转换为视频帧的宏区块以确定哪些宏区块在传输中丢失;以及
所述编码器经配置以对在传输中丢失的所述宏区块执行差错控制,
其中所述差错控制由编码器执行,所述编码器经配置以根据反向链路延迟和多组阈值来编码实时信息。
17.一种差错控制设备,其包含:
编码器,其经配置以编码第一视频数据帧与音频数据;
第一模块,其经配置以形成具有经编码的第一视频数据帧的第一包及具有经编码的音频数据的第二包;
收发器,其经配置以(a)跨越无线信道将所述包传输到接入网络,且(b)从所述接入网络接收媒体接入控制MAC层否定应答NAK;
第二模块,其经配置以在编码第二视频数据帧之前,确定所述MAC层是否从所述接入网络接收NAK并确定所述接收的NAK是否与含有视频数据的所述第一包相关联;以及
差错控制模块,其经配置以:仅在所述接收的NAK与含有视频数据的所述第一包相关联时,执行差错控制,其中确定媒体接入控制MAC层是否从所述接入网络接收到否定应答NAK包含:检查是否在无线电链路协议RLP模块中设定了旗标,
其中所述差错控制模块经配置以根据反向链路延迟和多组阈值来编码实时信息。
CN201310027387.5A 2005-10-21 2006-10-20 基于反向链路信息的视频差错控制 Expired - Fee Related CN103179466B (zh)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US72901705P 2005-10-21 2005-10-21
US60/729,017 2005-10-21
US11/315,399 US8842555B2 (en) 2005-10-21 2005-12-21 Methods and systems for adaptive encoding of real-time information in packet-switched wireless communication systems
US11/315,399 2005-12-21
US11/454,475 2006-06-15
US11/454,475 US8514711B2 (en) 2005-10-21 2006-06-15 Reverse link lower layer assisted video error control
CN 200680046647 CN101326829A (zh) 2005-10-21 2006-10-20 基于反向链路信息的视频差错控制

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN 200680046647 Division CN101326829A (zh) 2005-10-21 2006-10-20 基于反向链路信息的视频差错控制

Publications (2)

Publication Number Publication Date
CN103179466A CN103179466A (zh) 2013-06-26
CN103179466B true CN103179466B (zh) 2017-09-29

Family

ID=37814397

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310027387.5A Expired - Fee Related CN103179466B (zh) 2005-10-21 2006-10-20 基于反向链路信息的视频差错控制

Country Status (12)

Country Link
US (1) US8514711B2 (zh)
EP (1) EP1938609B1 (zh)
JP (1) JP4933556B2 (zh)
KR (1) KR100957359B1 (zh)
CN (1) CN103179466B (zh)
AU (1) AU2006304947B2 (zh)
BR (1) BRPI0617711A2 (zh)
CA (1) CA2626794C (zh)
ES (1) ES2820766T3 (zh)
NO (1) NO20082301L (zh)
TW (2) TWI369867B (zh)
WO (1) WO2007048138A1 (zh)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006060813A (ja) * 2004-08-20 2006-03-02 Polycom Inc ビデオデコーダにおける誤り隠蔽
US8842555B2 (en) * 2005-10-21 2014-09-23 Qualcomm Incorporated Methods and systems for adaptive encoding of real-time information in packet-switched wireless communication systems
US8406309B2 (en) * 2005-10-21 2013-03-26 Qualcomm Incorporated Video rate adaptation to reverse link conditions
US8548048B2 (en) * 2005-10-27 2013-10-01 Qualcomm Incorporated Video source rate control for video telephony
US8953596B2 (en) * 2006-01-06 2015-02-10 Qualcomm Incorporated Conserving network capacity by releasing QoS resources
WO2008086509A2 (en) * 2007-01-10 2008-07-17 Qualcomm Incorporated Content- and link-dependent coding adaptation for multimedia telephony
US7557605B2 (en) * 2007-09-14 2009-07-07 Cswitch Corporation Heterogeneous configurable integrated circuit
US8797850B2 (en) 2008-01-10 2014-08-05 Qualcomm Incorporated System and method to adapt to network congestion
US7978626B1 (en) * 2009-01-13 2011-07-12 Sprint Spectrum L.P. Method and system for adaptive hybrid automatic repeat request protocols based on network conditions
US8369337B1 (en) 2009-11-05 2013-02-05 Sprint Spectrum L.P. Methods and devices for assigning a wireless communication device to a wireless coverage area based on early termination gain
US8228817B2 (en) * 2010-04-06 2012-07-24 Via Telecom, Inc. Quality of service control of reverse traffic channel for a mobile communication device
US20110249127A1 (en) * 2010-04-07 2011-10-13 Cisco Technology, Inc. Estimating Video Quality Corruption in Lossy Networks
US9083772B2 (en) * 2010-04-30 2015-07-14 Qualcomm Incorporated Exchanging data associated with a communication session within a communications system
KR20140126762A (ko) * 2012-02-24 2014-10-31 브이아이디 스케일, 인크. 패킷 손실 검출을 이용한 비디오 코딩
US9247448B2 (en) 2012-08-27 2016-01-26 Qualcomm Incorporated Device and method for adaptive rate multimedia communications on a wireless network
US10051519B2 (en) 2012-08-27 2018-08-14 Qualcomm Incorporated Device and method for adaptive rate multimedia communications on a wireless network
EP2979487B1 (en) * 2013-03-29 2018-11-28 VID SCALE, Inc. Early packet loss detection and feedback
US9531504B1 (en) 2014-03-27 2016-12-27 Sprint Spectrum L.P. Bundling acknowledgments based on signal quality
US9591316B2 (en) * 2014-03-27 2017-03-07 Intel IP Corporation Scalable video encoding rate adaptation based on perceived quality
US9473973B1 (en) 2014-05-19 2016-10-18 Sprint Spectrum L.P. Reducing transmission rates in data slots subject to bundled acknowledgments
US9531505B1 (en) 2014-06-20 2016-12-27 Sprint Spectrum L.P. Determining an amount of hybrid ARQ transmissions based on a series of acknowledgments
US9445344B1 (en) 2014-07-22 2016-09-13 Sprint Spectrum L.P. Preferentially assigning data slots subject to bundled acknowledgments to devices that support carrier aggregation
US10073735B1 (en) * 2014-10-28 2018-09-11 Seagate Technology Llc Seeding mechanism for error detection codes
US9609651B1 (en) 2015-01-08 2017-03-28 Sprint Spectrum L.P. Exchanging uplink and downlink carrier frequencies
US10021686B1 (en) 2015-10-19 2018-07-10 Sprint Spectrum L.P. Scheduling traffic based on acknowledgment bundling
WO2017117505A1 (en) * 2015-12-31 2017-07-06 BOT Home Automation, Inc. Streaming and storing video content captured by an audio/video recording and communication device
US20210120232A1 (en) * 2020-12-23 2021-04-22 Intel Corporation Method and system of video coding with efficient frame loss recovery

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1293871A (zh) * 1998-11-18 2001-05-02 皇家菲利浦电子有限公司 流式视频接收机的解码器缓冲器

Family Cites Families (134)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4167264A (en) * 1978-07-17 1979-09-11 Kretzmeir James P Vise caddy tool rack
US4942126A (en) * 1986-08-13 1990-07-17 Allegheny-Singer Research Institute Method of extracting antigens of bacteria
US4774587A (en) * 1987-06-02 1988-09-27 Eastman Kodak Company Still video transceiver processor
EP0461023B1 (en) * 1990-06-05 1998-09-16 Canon Kabushiki Kaisha Communication method and apparatus
US5156244A (en) * 1990-08-31 1992-10-20 The Aro Corporation Torque sensing automatic shut-off and reset clutch for screwdrivers, nutsetters and the like
US5341374A (en) 1991-03-01 1994-08-23 Trilan Systems Corporation Communication network integrating voice data and video with distributed call processing
JP2861518B2 (ja) 1991-09-03 1999-02-24 日本電気株式会社 適応多重化方式
JP3002348B2 (ja) 1992-11-30 2000-01-24 シャープ株式会社 画像通信システム
US5367523A (en) 1993-08-26 1994-11-22 International Business Machines Corporation Adaptive rate-based congestion and flow control in packet communications networks
DE69427578T2 (de) 1993-09-21 2001-10-04 Sony Corp Verfahren und anlage zum übertragen von daten, datenkodierer und datenaufnahmemedium
US5541919A (en) 1994-12-19 1996-07-30 Motorola, Inc. Multimedia multiplexing device and method using dynamic packet segmentation
US5784362A (en) 1995-04-17 1998-07-21 Telefonaktiebolaget Lm Ericsson Temporary frame identification for ARQ in a reservation-slotted-ALOHA type of protocol
US5802068A (en) 1995-06-30 1998-09-01 Nippon Steel Corporation Multiplexing apparatus of a plurality of data having different bit rates
US5768533A (en) 1995-09-01 1998-06-16 National Semiconductor Corporation Video coding using segmented frames and retransmission to overcome channel errors
JP3068002B2 (ja) * 1995-09-18 2000-07-24 沖電気工業株式会社 画像符号化装置、画像復号化装置及び画像伝送システム
TW305043B (zh) 1995-09-29 1997-05-11 Matsushita Electric Ind Co Ltd
US6002802A (en) 1995-10-27 1999-12-14 Kabushiki Kaisha Toshiba Video encoding and decoding apparatus
US5790538A (en) 1996-01-26 1998-08-04 Telogy Networks, Inc. System and method for voice Playout in an asynchronous packet network
JP3499670B2 (ja) * 1996-02-02 2004-02-23 株式会社東芝 無線通信方法、無線基地局装置及び無線端末装置
SG71709A1 (en) * 1996-05-08 2000-04-18 Matsushita Electric Ind Co Ltd Multiplex transmission method and system and audio jitter absorbing method used therein
CN1126374C (zh) * 1996-07-05 2003-10-29 日本电信电话株式会社 图象通信系统及方法
US5838678A (en) 1996-07-24 1998-11-17 Davis; Joseph W. Method and device for preprocessing streams of encoded data to facilitate decoding streams back-to back
US6366614B1 (en) 1996-10-11 2002-04-02 Qualcomm Inc. Adaptive rate control for digital video compression
DE19648077C2 (de) 1996-11-20 1998-12-03 Nokia Mobile Phones Ltd Verfahren zur Einstellung der Zugriffsbeharrlichkeit einer Mobilstation in einem zellularen Mobilfunknetz
US6633609B1 (en) 1996-12-24 2003-10-14 Intel Corporation Method and apparatus for bit rate control in a digital video environment for arbitrary bandwidth
US5969764A (en) 1997-02-14 1999-10-19 Mitsubishi Electric Information Technology Center America, Inc. Adaptive video coding method
US6404776B1 (en) 1997-03-13 2002-06-11 8 × 8, Inc. Data processor having controlled scalable input data source and method thereof
EP1492368B1 (en) 1997-04-17 2009-04-08 NTT DoCoMo, Inc. Base station apparatus and method for mobile communication system
JPH10341217A (ja) * 1997-06-09 1998-12-22 Kokusai Electric Co Ltd マルチメディア多重化通信システム
EP2239876A3 (en) 1997-06-19 2011-01-26 Kabushiki Kaisha Toshiba Information data multiplexing transmission system, multiplexer and demultiplexer used therefor, and error correcting encoder and decoder
US6377809B1 (en) 1997-09-16 2002-04-23 Qualcomm Incorporated Channel structure for communication systems
US6154489A (en) 1998-03-30 2000-11-28 Motorola, Inc. Adaptive-rate coded digital image transmission
US6396956B1 (en) 1998-03-31 2002-05-28 Sharp Laboratories Of America, Inc. Method and apparatus for selecting image data to skip when encoding digital video
US6421387B1 (en) * 1998-05-15 2002-07-16 North Carolina State University Methods and systems for forward error correction based loss recovery for interactive video transmission
TW376497B (en) 1998-05-26 1999-12-11 Koninkl Philips Electronics Nv Transmission system for transmitting a main signal and an auxiliary signal
CA2238795A1 (en) 1998-05-28 1999-11-28 Newbridge Networks Corporation Er information acceleration in abr traffic
US6584509B2 (en) 1998-06-23 2003-06-24 Intel Corporation Recognizing audio and video streams over PPP links in the absence of an announcement protocol
JP2000023240A (ja) 1998-06-30 2000-01-21 Matsushita Electric Ind Co Ltd 無線通信装置及び無線通信方法
US6389034B1 (en) 1998-09-04 2002-05-14 Nortel Networks Limited System for providing stream based and packet based services
US6108795A (en) 1998-10-30 2000-08-22 Micron Technology, Inc. Method for aligning clock and data signals received from a RAM
CA2257007A1 (en) 1998-12-24 2000-06-24 Newbridge Networks Corporation Explicit rate flow control for multicast connections
JP2000324171A (ja) 1999-05-14 2000-11-24 Namco Ltd データ転送装置及びデータ転送方法、並びにデータ配布方法
JP3841256B2 (ja) 2000-02-15 2006-11-01 三菱電機株式会社 通信システム及び通信方法及び送信端末
JP2001238256A (ja) 2000-02-21 2001-08-31 Hitachi Kokusai Electric Inc 可変速度符号化システム
EP1130921B1 (en) * 2000-03-02 2005-01-12 Matsushita Electric Industrial Co., Ltd. Data transmission in non-reliable networks
KR100833222B1 (ko) 2000-03-29 2008-05-28 삼성전자주식회사 멀티미디어 송수신 장치 및 방법
US6694469B1 (en) 2000-04-14 2004-02-17 Qualcomm Incorporated Method and an apparatus for a quick retransmission of signals in a communication system
US6747991B1 (en) 2000-04-26 2004-06-08 Carnegie Mellon University Filter and method for adaptively modifying the bit rate of synchronized video and audio streams to meet packet-switched network bandwidth constraints
JP3669281B2 (ja) 2000-04-27 2005-07-06 三菱電機株式会社 符号化装置および符号化方法
CN1322759C (zh) 2000-04-27 2007-06-20 三菱电机株式会社 编码装置和编码方法
US6999432B2 (en) 2000-07-13 2006-02-14 Microsoft Corporation Channel and quality of service adaptation for multimedia over wireless networks
US6862298B1 (en) 2000-07-28 2005-03-01 Crystalvoice Communications, Inc. Adaptive jitter buffer for internet telephony
US6891822B1 (en) 2000-09-08 2005-05-10 Sharewave, Inc. Method and apparatus for transferring isocronous data within a wireless computer network
WO2002032083A1 (fr) 2000-10-13 2002-04-18 Sony Corporation Systeme de controle de la qualite de la communication de donnees, systeme emetteur et recepteur
US7304951B2 (en) 2000-11-21 2007-12-04 North Carolina State University Methods and systems for rate-based flow control between a sender and a receiver
US7006510B2 (en) 2001-01-17 2006-02-28 Optibase Ltd. Method of clock mismatch and drift compensation for packet networks
GB2399998B (en) 2001-02-01 2005-04-13 Fujitsu Ltd Communications systems
US7058085B2 (en) * 2001-03-14 2006-06-06 Nortel Networks Limited Method and apparatus for transmitting data over a network within a specified time limit
KR100425253B1 (ko) 2001-04-18 2004-03-30 주식회사 현대시스콤 무선통신 시스템에서의 순방향 패킷 송수신 방법
US7054316B2 (en) 2001-04-25 2006-05-30 Nokia Corporation Method and system for interlayer control between re-sequencing and retransmission entities
US7342901B1 (en) 2001-05-01 2008-03-11 Nortel Networks Limited Medium access control (MAC) protocol for a wireless communication system
US6920598B2 (en) 2001-05-21 2005-07-19 Lucent Technologies Inc. System and method for error recovery using NAKs
JP2002354141A (ja) 2001-05-25 2002-12-06 Matsushita Electric Ind Co Ltd ビデオフォンおよび遠隔医療装置
US7193966B2 (en) 2001-06-25 2007-03-20 Telefonakitebolaget Lm Ericsson (Publ) Triggered packet data rate change in a communication system
US7269139B1 (en) 2001-06-27 2007-09-11 Cisco Technology, Inc. Method and apparatus for an adaptive rate control mechanism reactive to flow control messages in a packet switching system
US6741603B2 (en) 2001-07-09 2004-05-25 Overture Networks, Inc. Use of a circular buffer to assure in-order delivery of packets
WO2003010674A1 (en) 2001-07-27 2003-02-06 Advantest Corporation Phase correction circuit
US7206285B2 (en) 2001-08-06 2007-04-17 Koninklijke Philips Electronics N.V. Method for supporting non-linear, highly scalable increase-decrease congestion control scheme
US6865374B2 (en) 2001-09-18 2005-03-08 Koninklijke Philips Electronics N.V. Video recovery system and method
US7356079B2 (en) 2001-11-21 2008-04-08 Vixs Systems Inc. Method and system for rate control during video transcoding
US20050013244A1 (en) 2001-12-14 2005-01-20 Parlos Alexander G System for actively controlling distributed applications
JP3606259B2 (ja) 2002-01-16 2005-01-05 ソニー株式会社 通信装置とその方法、ならびにプログラムとその記録媒体
KR100933469B1 (ko) 2002-01-18 2009-12-23 코닌클리케 필립스 일렉트로닉스 엔.브이. 오디오 코딩
EP1335289A1 (en) 2002-02-07 2003-08-13 Siemens Aktiengesellschaft Method for software downloads in a radio communications system
JP3900413B2 (ja) 2002-02-14 2007-04-04 Kddi株式会社 映像情報伝送方式およびプログラム
JP4116470B2 (ja) 2002-03-06 2008-07-09 ヒューレット・パッカード・カンパニー メディア・ストリーミング配信システム
JP3490425B2 (ja) 2002-03-14 2004-01-26 松下電器産業株式会社 受信装置及び受信方法
JP4029670B2 (ja) 2002-06-11 2008-01-09 日本電気株式会社 無線アクセスにおける輻輳制御方法並びにシステム
KR20030095995A (ko) 2002-06-14 2003-12-24 마츠시타 덴끼 산교 가부시키가이샤 미디어 전송방법 및 그 송신장치 및 수신장치
JP3730974B2 (ja) 2002-06-14 2006-01-05 松下電器産業株式会社 メディア伝送方法及びその送信装置
GB0229396D0 (en) 2002-12-17 2003-01-22 British Telecomm Signal processing
AU2003288595A1 (en) 2002-12-18 2004-07-09 Koninklijke Philips Electronics N.V. Adaptive encoding of digital multimedia information
JP2004208001A (ja) 2002-12-25 2004-07-22 Sharp Corp 無線通信システム、無線通信方法、無線通信プログラム及びプログラム記録媒体
JP2004253883A (ja) 2003-02-18 2004-09-09 Nec Corp 音声・画像リアルタイム通信におけるビットレート制御を実行するデータ通信装置
US7551588B2 (en) 2003-03-06 2009-06-23 Nortel Networks Limited Autonomous mode transmission from a mobile station
SE0301048D0 (sv) 2003-04-07 2003-04-07 Ericsson Telefon Ab L M RLC window reconfiguration
JPWO2004093446A1 (ja) * 2003-04-17 2006-07-13 富士通株式会社 圧縮データと非圧縮データを同時転送する場合のタスクスケジューリング方法
JP3943558B2 (ja) 2003-05-14 2007-07-11 株式会社エヌ・ティ・ティ・ドコモ パケット通信方法及びパケット通信システム。
US7477604B2 (en) 2003-05-14 2009-01-13 Ntt Docomo, Inc. Packet communications system
JP2004350227A (ja) 2003-05-26 2004-12-09 Ntt Communications Kk ビデオ会議システムにおける会議クライアント装置及びそのプログラム
US20040252761A1 (en) 2003-06-16 2004-12-16 Dilithium Networks Pty Limited (An Australian Corporation) Method and apparatus for handling video communication errors
US7050397B2 (en) 2003-07-02 2006-05-23 Nokia Corporation Apparatus, and associated method, for facilitating retransmission of data packets in a packet radio communication system that utilizes a feedback acknowledgement scheme
US7263067B2 (en) 2003-07-15 2007-08-28 Nokia Siemans Networks Oy Method and apparatus for accelerating throughput in a wireless or other telecommunication system
JP4176576B2 (ja) 2003-08-01 2008-11-05 株式会社エヌ・ティ・ティ・ドコモ データ流入量制御方法、基地局及び制御局
CN101060705B (zh) 2003-09-30 2012-09-05 捷讯研究有限公司 通信模式控制方法,移动通信系统,基站控制装置,基站和移动通信终端
KR100816598B1 (ko) 2003-10-17 2008-03-24 닛본 덴끼 가부시끼가이샤 시그널링 방법, 시스템, 기지국 및 이동국
WO2005053216A2 (en) * 2003-11-25 2005-06-09 Dg2L Technologies Methods and systems for reliable distribution of media over a network
US7197026B2 (en) 2003-12-23 2007-03-27 Nokia Corporation Method and system for RLP optimization
JP2005192073A (ja) 2003-12-26 2005-07-14 Matsushita Electric Ind Co Ltd マルチメディアデータ通信方法および装置
US20050152320A1 (en) 2004-01-08 2005-07-14 Interdigital Technology Corporation Wireless communication method and apparatus for balancing the loads of access points by controlling access point transmission power levels
US7453938B2 (en) 2004-02-06 2008-11-18 Apple Inc. Target bitrate estimator, picture activity and buffer management in rate control for video coder
JP4562402B2 (ja) 2004-02-20 2010-10-13 アルパイン株式会社 音声データの非同期通信システムおよびその通信方法
WO2005094020A1 (en) 2004-03-19 2005-10-06 Telefonaktiebolaget Lm Ericsson (Publ) Higher layer packet framing using rlp
KR100550567B1 (ko) 2004-03-22 2006-02-10 엘지전자 주식회사 무선 네트워크망을 통해 통신하는 서버 시스템 및 그동작방법
JP3950865B2 (ja) 2004-03-30 2007-08-01 Necアクセステクニカ株式会社 Atm通信システム
KR101071816B1 (ko) 2004-04-02 2011-10-11 엘지전자 주식회사 무선 패킷 통신 시스템에서의 업링크 패킷 스케쥴링 방법
JP4526294B2 (ja) 2004-04-15 2010-08-18 シャープ株式会社 ストリームデータ送信装置、受信装置、プログラムを記録した記録媒体、およびシステム
US7424026B2 (en) 2004-04-28 2008-09-09 Nokia Corporation Method and apparatus providing continuous adaptive control of voice packet buffer at receiver terminal
EP1751955B1 (en) 2004-05-13 2009-03-25 Qualcomm, Incorporated Header compression of multimedia data transmitted over a wireless communication system
BRPI0511858B1 (pt) 2004-06-07 2020-12-22 Sling Media, Inc. transmissor de mídia pessoal e respectivo sistema de transmissão, métodos de provimento de acesso a fonte áudio/visual em localização remota da fonte áudio/visual e de fluxo (streaming) de sinal de mídia para local de assinante remoto
KR20050121067A (ko) 2004-06-21 2005-12-26 삼성전자주식회사 무선 채널에 의한 무선 통신 시스템 및 그의 무선 통신 방법
US7606427B2 (en) 2004-07-08 2009-10-20 Qualcomm Incorporated Efficient rate control techniques for video encoding
KR100608061B1 (ko) 2004-07-12 2006-08-02 삼성전자주식회사 전송 스트림 생성을 위한 다중화 방법 및 그 장치
US7551647B2 (en) 2004-07-19 2009-06-23 Qvidium Technologies, Inc. System and method for clock synchronization over packet-switched networks
EP1628446B1 (en) 2004-08-18 2007-11-14 Infineon Technologies AG Method for transmitting information through a communication link and respective transmitting device and communication system
CA2691959C (en) 2004-08-30 2013-07-30 Qualcomm Incorporated Method and apparatus for an adaptive de-jitter buffer
US7606303B2 (en) 2004-09-28 2009-10-20 General Instrument Corporation Method and apparatus to detect anchor frames from digital video streams
JP2006115354A (ja) 2004-10-15 2006-04-27 Ntt Docomo Inc 移動端末、制御装置及び移動通信方法
US7925271B2 (en) 2004-11-09 2011-04-12 Spyder Navigations L.L.C. Apparatus and method for arbitrary data rate ramp up after overload on wireless interface
JP2006222822A (ja) 2005-02-14 2006-08-24 Hitachi Ltd ハンドオーバシステム
US7492710B2 (en) 2005-03-31 2009-02-17 Intel Corporation Packet flow control
US20070019931A1 (en) 2005-07-19 2007-01-25 Texas Instruments Incorporated Systems and methods for re-synchronizing video and audio data
US7701851B2 (en) 2005-07-20 2010-04-20 Vidyo, Inc. System and method for the control of the transmission rate in packet-based digital communications
CA2620544C (en) * 2005-09-21 2015-04-14 Lg Electronics Inc. Method and apparatus for multiplexing multiple reverse feedback channels in multi-carrier wireless networks
US8102878B2 (en) 2005-09-29 2012-01-24 Qualcomm Incorporated Video packet shaping for video telephony
US8406309B2 (en) 2005-10-21 2013-03-26 Qualcomm Incorporated Video rate adaptation to reverse link conditions
US8842555B2 (en) 2005-10-21 2014-09-23 Qualcomm Incorporated Methods and systems for adaptive encoding of real-time information in packet-switched wireless communication systems
US8548048B2 (en) 2005-10-27 2013-10-01 Qualcomm Incorporated Video source rate control for video telephony
US8848618B2 (en) 2006-08-22 2014-09-30 Qualcomm Incorporated Semi-persistent scheduling for traffic spurts in wireless communication
US20080056125A1 (en) 2006-09-06 2008-03-06 Nokia Corporation Congestion control in a wireless network
WO2008086509A2 (en) 2007-01-10 2008-07-17 Qualcomm Incorporated Content- and link-dependent coding adaptation for multimedia telephony
KR100787314B1 (ko) 2007-02-22 2007-12-21 광주과학기술원 미디어내 동기화를 위한 적응형 미디어 재생 방법 및 장치
JP5339697B2 (ja) 2007-08-14 2013-11-13 キヤノン株式会社 送信装置、送信方法、及びコンピュータプログラム
US8797850B2 (en) 2008-01-10 2014-08-05 Qualcomm Incorporated System and method to adapt to network congestion

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1293871A (zh) * 1998-11-18 2001-05-02 皇家菲利浦电子有限公司 流式视频接收机的解码器缓冲器

Also Published As

Publication number Publication date
WO2007048138A1 (en) 2007-04-26
CN103179466A (zh) 2013-06-26
EP1938609B1 (en) 2020-07-08
CA2626794A1 (en) 2007-04-26
CA2626794C (en) 2013-04-02
AU2006304947B2 (en) 2010-08-19
BRPI0617711A2 (pt) 2011-08-02
ES2820766T3 (es) 2021-04-22
TWI370641B (en) 2012-08-11
KR20080077125A (ko) 2008-08-21
US8514711B2 (en) 2013-08-20
EP1938609A1 (en) 2008-07-02
AU2006304947A1 (en) 2007-04-26
TW200726118A (en) 2007-07-01
TWI369867B (en) 2012-08-01
JP2009513072A (ja) 2009-03-26
NO20082301L (no) 2008-07-09
KR100957359B1 (ko) 2010-05-12
JP4933556B2 (ja) 2012-05-16
TW201203929A (en) 2012-01-16
US20070091816A1 (en) 2007-04-26

Similar Documents

Publication Publication Date Title
CN103179466B (zh) 基于反向链路信息的视频差错控制
US8259565B2 (en) Call setup in a video telephony network
CA2395615C (en) Method for making data transmission more effective and a data transmission protocol
EP2061174B1 (en) Data communication system, data transmitting device and method, using probe packets and having a transmission buffer control
EP1482681B1 (en) Medium streaming distribution system
USRE46167E1 (en) Systems and methods for transmitting data over lossy networks
US8111698B2 (en) Method of performing a layer operation in a communications network
US20060256785A1 (en) Mobile terminal
KR101197887B1 (ko) 이동통신 시스템에서 자동 재전송 요구를 위한 상태 보고의송수신 방법 및 장치
CN101326829A (zh) 基于反向链路信息的视频差错控制
JP2006279436A (ja) マルチメディア通信システムおよび再送用データ削除方法
RU2364051C2 (ru) Установление вызова в видеотелефонной сети
Pal et al. Video rate adaptation and scheduling in multi-rate wireless networks

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170929

CF01 Termination of patent right due to non-payment of annual fee