CN103179466B - 基于反向链路信息的视频差错控制 - Google Patents
基于反向链路信息的视频差错控制 Download PDFInfo
- Publication number
- CN103179466B CN103179466B CN201310027387.5A CN201310027387A CN103179466B CN 103179466 B CN103179466 B CN 103179466B CN 201310027387 A CN201310027387 A CN 201310027387A CN 103179466 B CN103179466 B CN 103179466B
- Authority
- CN
- China
- Prior art keywords
- bag
- video data
- nak
- error control
- encoded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 claims abstract description 64
- 230000004044 response Effects 0.000 claims abstract description 14
- 230000005540 biological transmission Effects 0.000 claims description 27
- 238000013507 mapping Methods 0.000 claims description 6
- 230000015572 biosynthetic process Effects 0.000 abstract description 6
- 238000004891 communication Methods 0.000 description 18
- 238000005516 engineering process Methods 0.000 description 10
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 101000911390 Homo sapiens Coagulation factor VIII Proteins 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 102000057593 human F8 Human genes 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 229940047431 recombinate Drugs 0.000 description 2
- 230000032258 transport Effects 0.000 description 2
- 230000007306 turnover Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000007596 consolidation process Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000000465 moulding Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
- H04N21/6156—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network
- H04N21/6181—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network involving transmission via a mobile phone network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
- H04N19/895—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
- H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
- H04N21/6131—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
- H04N21/6473—Monitoring network processes errors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64746—Control signals issued by the network directed to the server or the client
- H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
- H04N21/64776—Control signals issued by the network directed to the server or the client directed to the server for requesting retransmission, e.g. of data packets lost or corrupted during transmission from server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6583—Acknowledgement
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Mobile Radio Communication Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Detection And Prevention Of Errors In Transmission (AREA)
- Communication Control (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明涉及基于反向链路信息的视频差错控制。本揭示案涉及反向链路下层辅助的视频差错控制。一种方法可编码视频数据,运用所述经编码的视频数据形成包,且跨越无线信道将所述包传输到接入网络。媒体接入控制(MAC)层可从所述接入网络接收否定应答(NAK)。所述方法可确定所述接收的NAK是否与含有视频数据的包相关联。如果所述接收的NAK与含有视频数据的包相关联,那么所述方法可执行差错控制。
Description
分案申请的相关信息
本案是分案申请。该分案的母案是申请日为2006年10月20日、申请号为200680046647.1、发明名称为“基于反向链路信息的视频差错控制”的发明专利申请案。
优先权主张
本申请案是基于2005年12月21日申请的题为“METHODS AND SYSTEMS FORADAPTIVE ENCODING OF REAL-TIME INFORMATION TN PACKET-SWTTCHED WIRELESSCOMMUNICATION SYSTEMS”的第11/315,399号共同转让的美国专利申请案(代理人案号051126)的部分接续申请案并主张其优先权,所述美国专利申请案主张2005年10月21日申请的第60/729,017号美国临时申请案的优先权,这两个申请案全文以引用的方式并入本文中。
技术领域
本揭示案涉及视频编码,且更明确地说涉及反向链路下层辅助的视频差错控制。
背景技术
蜂窝式电话可包括音频俘获装置(例如麦克风或语音合成器)和音频编码器以产生音频包(或帧)。所述电话可使用通信协议层和模块,例如无线电链路协议(RLP)模块、媒体接入控制(MAC)层和物理(PHY)层。所述电话可将音频包放置于RLP队列中。MAC层模块可从RLP队列的内容产生MAC层包。MAC层包可转换为PHY层包以跨越通信道传输到另一通信装置。
发明内容
一个方面涉及一种方法,其包含:编码视频数据;运用所述经编码的视频数据形成因特网协议(IP)包;跨越无线信道将所述包传输到接入网络;在媒体接入控制(MAC)层处,从所述接入网络接收否定应答(NAK);确定所述接收的NAK是否与含有视频数据的包相关联;确定哪一IP包含有在传输中丢失的数据;和在所述接收的NAK与含有视频数据的包相关联的情况下,执行差错控制。
另一方面涉及一种方法,其包含:编码视频数据的第一帧;运用视频数据的所述经编码的第一帧形成一包;跨越无线信道将所述包传输到接入网络;在编码视频数据的第二帧之前,确定媒体接入控制(MAC)层是否从所述接入网络接收否定应答(NAK);确定所述接收的NAK是否与含有视频数据的包相关联;和在所述接收的NAK与含有视频数据的包相关联的情况下,执行差错控制。
另一方面涉及一种包含存储一组指令的机器可读存储器的设备,所述指令经配置以:编码视频数据;运用所述经编码的视频数据形成因特网协议(IP)包;跨越无线信道将所述包传输到接入网络;在媒体接入控制(MAC)层处,从所述接入网络接收否定应答(NAK);确定所述接收的NAK是否与含有视频数据的包相关联;确定哪一IP包含有在传输中丢失的数据;和在所述接收的NAK与含有视频数据的包相关联的情况下,执行差错控制。
另一方面涉及一种包含存储一组指令的机器可读存储器的设备,所述指令经配置以:编码视频数据的第一帧;运用视频数据的所述经编码的第一帧形成一包;跨越无线信道将所述包传输到接入网络;在编码视频数据的第二帧之前,确定媒体接入控制(MAC)层是否从所述接入网络接收否定应答(NAK);确定所述接收的NAK是否与含有视频数据的包相关联;和在所述接收的NAK与含有视频数据的包相关联的情况下,执行差错控制。
另一方面涉及一种设备,所述设备包含:视频编码器,其经配置以编码视频数据;模块,其经配置以运用所述经编码的视频数据形成因特网协议(IP)包;收发器,其经配置以(a)跨越无线信道将所述包传输到接入网络且(b)从所述接入网络接收媒体接入控制(MAC)层否定应答(NAK);其中所述模块经配置以确定所述接收的NAK是否与含有视频数据的包相关联,且确定哪一IP包含有在传输中丢失的数据;且在所述接收的NAK与含有视频数据的包相关联的情况下,所述视频编码器经配置以执行差错控制。
一种设备包含:视频编码器,其经配置以编码视频数据的第一帧;第一模块,其经配置以运用视频数据的所述经编码的第一帧形成一包;收发器,其经配置以(a)跨越无线信道将所述包传输到接入网络且(b)从所述接入网络接收媒体接入控制(MAC)层否定应答(NAK);第二模块,其经配置以在编码视频数据的第二帧之前确定所述MAC层是否从所述接入网络接收NAK并确定所述接收的NAK是否与含有视频数据的包相关联;和差错控制模块,其经配置以在所述接收的NAK与含有视频数据的包相关联的情况下执行差错控制。
下文的附图和描述中陈述一个或一个以上实施例的细节。
附图说明
图1说明具有跨越传输信道将数据发送到解码器装置的视频和音频编码器装置的通信系统。
图2说明用于检测和控制错误的第一方式的方法和结构,其可用于图1的系统中。
图3说明用于检测和控制错误的第二方式的方法和结构,其可用于图1的系统中。
图4进一步说明图2和图3的第一和第二方式。
图5说明检测丢失的包且强制内部更新的实例,所述内部更新使由丢失的包引起的错误传播最小化。
具体实施方式
视频和音频编码和传输
图1说明具有跨越传输信道16(包括接入网络组件15)将数据发送到解码器装置14的视频和音频编码器装置12的通信系统10。编码器装置12和解码器装置14可分散于系统10各处。编码器装置12和解码器装置14可表示各种类型的装置,例如无线电话、蜂窝式电话、膝上型计算机、无线多媒体装置、无线通信个人计算机(PC)卡、个人数字助理(PDA)、外部或内部调制解调器或经由无线信道通信的任何装置。
编码器装置12和解码器装置14每一者可具有各种名称,例如接入终端(AT)、接入单元、订户单元、移动台、移动装置、移动单元、移动电话、移动体、远程台、远程终端、远程单元、用户装置、用户设备、手持式装置等。
每一装置12、14可与接入网络(AN)组件15在前向链路(FL)和/或反向链路(RL)上通信。FL(或下行链路)是指从AN15到装置12、14的传输。反向链路(或上行链路)是指从装置12、14到AN15的传输。AN15可以指通信系统的网络部分且可包括(但不限于)或实施基站(BS)、基站收发器系统(BTS)、接入点(AP)、调制解调器集区收发器(modem pooltransceiver,MPT)、节点B(例如,在WCDMA型系统中)等的功能。
编码器装置12可在第一视频通信装置中且可包括音频源17、视频源18、视频编码器20、音频编码器22、实时传送协议(RTP)/用户数据报协议(UDP)/因特网协议(IP)转换模块26、无线电链路协议(RLP)队列28、MAC层模块30和物理(PHY)层模块32。编码器装置12的其它实施例可包括代替图1中所示的元件的其它元件或除图1中所示的元件外的其它元件。编码器装置12的其它实施例可包括比图1中所示的元件少的元件。
解码器装置14可在另一视频通信装置中且可包括PHY层模块34、MAC层模块36、RLP队列38、RTP/UDP/IP转换模块40、视频解码器42、音频解码器44、音频输出单元46和视频输出单元48。解码器装置14的其它实施例可包括代替图1中所示的元件的其它元件或除图1中所示的元件外的其它元件。解码器装置14的其它实施例可包括比图1中所示的元件少的元件。
系统10可经由信道16提供双向视频和音频传输,例如视频电话(VT)。互逆编码、解码和转换模块可提供于信道16的相对端。在一些实施例中,编码器装置12和解码器装置14可在例如经配备用于视频串流、VT或两者的无线移动终端的视频通信装置内实施。移动终端可根据例如RTP、UDP或IP的包交换标准而支持VT。
视频源18可为视频俘获装置,例如视频摄影机、一个或一个以上视频档案库(video archive)或视频摄影机与视频档案库的组合。视频编码器20根据例如MPEG-4的视频压缩方法产生经编码的视频数据包。可使用其它视频压缩方法,例如国际电信联盟(ITU)H.263、ITU H.264或MPEG-2方法。视频编码器20可提供通常依赖于CODEC的视频源速率控制方案。举例来说,视频编码器20可适于根据MPEG4、ITU H.263或ITU H.264进行视频编码。视频编码器20可通过DSP或经嵌入的逻辑核心来实施。
音频源17可为例如麦克风或语音合成器装置的音频俘获装置。音频编码器22可编码音频数据并产生音频包以伴随视频数据。音频数据可根据例如自适应多速率窄带(AMR-NB)或其它技术的音频压缩方法来编码。对于VT应用,视频将允许一方对VT会议的检视,且音频将允许听到所述方的语音。
RTP/UDP/IP转换模块26从视频编码器20和音频编码器22获得视频和音频数据包。RTP/UDP/IP转换模块26可将适当的RTP/UDP/IP标头信息添加到从音频编码器22和视频编码器20接收的音频和视频数据包,并将数据包放置于RLP队列28中。RTP可在UDP上运行。UDP可在IP上运行。在一种配置中,IP可在点对点协议(PPP)层上运行。
MAC层模块30可从RLP队列28中检索RLP包并产生MAC层包。每一MAC层包可载运RTP/UDP/IP标头信息和包含于RLP队列28内的音频或视频包数据。
音频包可独立于视频包而插入于RLP队列28中。在一些情况下,从RLP队列28的内容所产生的MAC层包将仅载运标头信息和视频包数据。在其它情况下,MAC层包将仅载运标头信息和音频包数据。在其它情况下,视RLP队列28的内容而定,MAC层包将载运标头信息、音频包数据和视频包数据。MAC层包可根据无线电链路协议(RLP)来配置,且可称为MAC RLP包。
PHY层模块32可将MAC RLP包转换为PHY层包以用于经由信道16传输。信道16将PHY层包载运到解码器装置14。
在解码装置14中,PHY层模块34与MAC层模块36可以相反方式操作。PHY层模块34可从PHY层包中识别MAC层包且将从信道16接收的PHY层包转换/重组为MACRLP包。
MAC层模块36可重组MAC RLP包的内容以提供视频和音频包,以便将MAC RLP包插入于RLP队列38中。RTP/UDP/IP转换模块40可从RLP队列38中的数据中去除/剥离伴随的标头信息,并重组视频和音频数据以分别传递到视频解码器42和音频解码器44。
视频解码器42解码视频数据帧以产生视频数据流,以用于驱动显示装置(视频输出)48。音频解码器44解码音频数据以产生音频信息,以用于(例如)经由音频扬声器(音频输出)46呈现给用户。
视频电话(VT)是指在至少两个装置(例如系统12与14)之间的音频和视频包的实时通信。在移动VT应用中,VT装置(无线终端)经由无线前向链路(FL)(即,“下行链路”)从基站接收PHY层包。VT装置经由无线反向链路(RL)(即,“上行链路”)将PHY层包传输到基站。
系统10和信道16可经设计以支持一种或一种以上无线通信技术,例如码分多址(CDMA)、频分多址(FDMA)、时分多址(TDMA)或正交频分多路复用(OFDM)或另一适合的无线技术。可根据多种无线电接入技术中的任一者来提供以上无线通信技术。举例来说,可根据cdma2000或宽带CDMA(WCDMA)标准来提供CDMA。可根据全球移动通信系统(GSM)标准来提供TDMA。通用移动电信系统(UMTS)标准允许GSM或WCDMA操作。对于VT应用,系统10可经设计以支持高数据速率(HDR)技术,例如cdma20001x EV-DO版本0修订版A或随后的EV-DO版本。
信道条件对于无线信道可能是一个关注因素,但其对于移动VT应用可能尤其有问题,在移动VT应用中,信道条件可遭受衰落或网络拥塞。
视频差错控制
下层辅助的视频差错控制方法可解决视频数据在反向链路上传输期间所出现的错误。所述方法可使得视频编码器20能够使用来自MAC层30的信道错误信息且立即应用差错控制,而无需等待来自接收装置14的反馈。所述方法可使用用于检索/接收可由视频编码器20了解的错误信息的机制。视所需的实施复杂性而定,可将来自MAC层30的错误信息转化为两种不同格式。
在从下层接收错误消息之后,视频编码器20可(a)为新的帧使用不同的参考帧,(b)增加宏区块(MB)内部更新率,或(c)插入内部帧(I帧)以阻止接收器处的错误传播。插入I帧基本上与强制内部更新相同。在I帧中,每一MB经帧内编码,即其不视先前帧而定,这可阻止错误传播。对于MB内部更新,仅有一些MB经帧内编码。选项(c)可避免使用周期性I帧(或减少内部帧更新率)以改进编码效率和视频延迟,以及在错误发生时提供较好的视频质量。视频质量可能较好是因为视频编码器20可立即清除错误,而不是逐渐更新随后帧中的每一MB。
图5说明检测包丢失和强制内部更新的实例,内部更新使由丢失的包引起的错误传播最小化。
在下文中使用CDMA20001x EV-DO修订版A反向链路作为接收/检索来自MAC层30的错误信息的一个实例。所述方法还可应用于其它通信系统,例如WCDMA高速上行链路包接入(HSUPA)系统,其使用H-ARQ、NAK或其它类似方式检测传输错误和/或丢失的信息。
下文中所描述的方法可提供对于包括视频电话和视频共享(其中传输错误可能是不可避免的)的无线网络上的多媒体中的错误性能的跨层优化。
对于前向链路(下行链路)传输错误,一些方法可使用端对端反馈来提供错误信息。然而,如果这些方法只是依赖端对端反馈,那么其可能无法足够快速地回应RL传输错误以减少由丢失的包引起的假像。本文中所描述的RL方法可补充端对端反馈方式。
使用NAK信息的MAC辅助的视频差错控制
此部分描述使用来自接入网络15的否定应答(NAK)信息的两种MAC辅助的视频差错控制方法。在两种方法中,视频编码器20或差错控制模块206可逐帧地查询MAC层30,即在编码新的帧之前,视频编码器20可接收来自一个或一个以上下层的错误信息且视需要执行差错控制。基于错误信息消息类型,视频编码器20可执行不同的差错控制方案以减轻错误传播。
第一方式:使用视频流IP包NAK的差错控制
图2说明用于第一方式的方法和结构,其中向视频编码器20或差错控制模块206通知视频帧中的哪些宏区块(MB)在传输中丢失。每一视频帧可包含多个宏区块。
当发生传输错误时,接入网络15将NAK发送到反向业务信道MAC(RTCMAC)层30。所述MAC层30向包合并协议(Packet Consolidation Protocol;PCP)模块210通知与NAK相关联的MAC包。
PCP模块210确定丢失的MAC包是否含有任何视频流数据。尽管EV-DO修订版A反向链路中支持服务质量(QoS),但音频和视频数据可放置于同一MAC包中。如果在丢失的MAC包中具有视频数据,那么PCP模块210将使用RLP包NAK向RLP模块208通知哪一RLP队列(可能存在若干RLP队列)含有在传输中经历错误的包。
RLP模块208确定哪一IP包含有丢失的数据。RLP模块208知晓IP包。对于EV-DO修订版A,视频流经配置使得链路流数据单元为IP包。接着RLP模块208使用视频流IP包NAK通知应用层中的RTP层202哪一IP包已丢失。
RTP层202维持映射图或表,所述映射图或表在一帧中将丢失的IP包转换为丢失的MB。接着丢失的MB的信息将被传递到差错控制模块206和/或视频编码器20以用于进一步差错控制。
此第一方式可涉及三个不同层处的修改:
□视频编码器20将每一包中的MB的信息传递到RTP层202。
□RTP层202维持IP包(由序列号索引)与宏区块之间的转换映射图或表。如果IP包丢失,那么RTP层202可将IP包转换为宏区块并通知视频编码器20丢失的MB。与每一IP包相关联的序列号也可被传递到RLP模块208。
□RLP模块208追踪IP包如何分段为RLP包并通过检查序列号来确定哪一IP包丢失。
对于差错控制,因为视频编码器20知道哪些MB丢失,所以视频编码器20或差错控制模块206可执行以下差错控制方法中的一者或一者以上:
□限制运动估计搜索范围以使得已损坏(丢失)的部分将不用作预测。
□对共同定位的MB及其邻近的MB进行帧内编码。
□对共同定位的MB使用不同的参考帧。
第二方式:使用视频流NAK的差错控制
上文所描述的第一方式可提供良好的差错控制能力和性能,但实施复杂性可能相对较高。第一方式可能需要修改RTP和RLP层202、208。第二方式可提供用于差错控制的简单化但有效的方式。
图3说明用于第二方式的方法和结构。与图2相比,图3可不要求对RTP层202的修改。实际上,第二方式可不需要RTP层202执行任何操作。事实上,视频编码器或差错控制模块206可在编码视频数据的每一新的帧之前查询RLP模块208,且错误信息可直接传递到视频编码器20或差错控制模块206以用于差错控制。此错误消息可仅仅是RLP模块208中设定的旗标(例如,二进制位),其向视频编码器20通知从上次查询MAC层30以来在视频流上是否有任何数据丢失。在一个实施例中,MAC层30可将NAK自动发送到PCP模块210,所述PCP模块210将NAK发送到RLP模块208,所述RLP模块208设定旗标而不对PCP或MAC层210、30进行任何查询。
在编码两个视频帧之间,视频编码器20可仅需要获知是否有任何数据在先前帧中丢失,因此视频编码器20或差错控制模块206可在当前帧上执行差错控制。因为编码器20或差错控制模块206逐帧地查询RLP模块208,即在编码新的帧之前,获知是否存在任何传输错误可能与获知哪一IP包丢失几乎一样。
如果MAC层自动重复请求(MARQ)用于视频流,那么应仅在含有视频数据的MARQ包在物理层处未获得肯定应答(ACK)时设定此旗标。
此第二方式可大大简化实施复杂性并为视频编码器20提供有用的信息以执行正确的差错控制。然而,因为旗标仅可指示是否存在错误,所以视频编码器20不能获知帧的哪部分丢失。因此,差错控制应假定从上次查询以来错误可发生于任何帧的任何部分中。
一旦设定此旗标,视频编码器20就可执行以下差错控制方法中的一者或一者以上,所述方法可不同于第一方式:
□将当前帧编码为I帧。
□增加经帧内编码的MB的百分率。
□在先前帧之前使用所述帧作为用于运动估计的参考。
图4进一步说明第一和第二方式。使用EV-DO修订版A保留链路信道作为一实例,但可使用其它类型的信道、标准和通信协议。在图4的底部附近,MAC层30在时隙n中将含有音频和视频数据的MAC包作为第一子包发送到物理层32。举例来说,假定为12时隙终止且所有这些MAC包均载运视频数据,那么在MAC层30处每秒可传输50个包。EV-DO物理层可使得接入终端能够几乎即刻在反向链路上检测丢失的包。
MAC层30经由混合ARQ(H-ARQ)信道从基站接收NAK。MAC层30尝试在时隙n+3期间发送第二子包。MAC层30再次经由H-ARQ信道从基站接收第二NAK。MAC层30尝试在时隙n+6期间发送第三子包。MAC层30再次经由H-ARQ信道从基站接收第三NAK。MAC层30尝试在时隙n+9期间发送第四子包。MAC层30经由上一ARQ(L-ARQ)信道从基站接收NAK且还经由包ARQ(P-ARQ)信道从基站接收NAK。这促使MAC层30通知PCP模块210。
第二方式可允许视频编码器20在错误之后快速恢复,且用户可能看不到质量降级的视频。第二方式可在错误后即刻插入I帧以立即阻止错误传播。当没有错误时,第二方式可因I帧而提供比其它方法更好的质量和更少的帧跳越。
视频编码器装置12可具有用于存储指令和数据的专用存储器,以及专用硬件、软件、固件或其组合。如果在软件中实施,那么所述技术可实施为在计算机可读媒体上的指令,所述计算机可读媒体例如为随机存取存储器(RAM)、只读存储器(ROM)、非易失性随机存取存储器(NVRAM)、电可擦除可编程只读存储器(EEPROM)、快闪存储器等。所述指令促使一个或一个以上处理器执行本揭示案中所描述的功能性的某些方面。
本揭示案中所描述的技术可在通用微处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或其它等效逻辑装置内实施。举例来说,视频编码器装置12、视频解码器装置14和相关联的组件及模块可实施为在数字信号处理器(DSP)或其它处理装置上运行的编码过程或编码/解码(CODEC)过程的若干部分。因此,描述为模块的组件可形成此类过程或一单独过程的可编程特征。
视频编码器装置12可具有用于存储指令和数据的专用存储器,以及专用硬件、软件、固件或其组合。如果在软件中实施,那么所述技术可实施为可由一个或一个以上处理器执行的指令。所述指令可存储于计算机可读媒体上,所述计算机可读媒体例如随机存取存储器(RAM)、只读存储器(ROM)、非易失性随机存取存储器(NVRAM)、电可擦除可编程只读存储器(EEPROM)、快闪存储器、磁性或光学数据存储装置等。所述指令促使一个或一个以上处理器执行本揭示案中所描述的功能性的某些方面。
已描述各种实施例。这些和其它实施例在所附权利要求书的范围内。
Claims (17)
1.一种差错控制方法,其包含:
编码视频数据与音频数据;
形成若干因特网协议IP包,所述若干IP包包含至少一个具有经编码的视频数据而非音频数据的包、至少一个具有经编码的音频数据而非视频数据的包,以及,至少一个具有经编码的音频数据及经编码的视频数据两者的包;
跨越无线信道将所述若干IP包传输到接入网络;
在媒体接入控制MAC层处,从所述接入网络接收否定应答NAK;
确定所述接收的NAK是否来自所述若干IP包中与含有视频数据的包相关联;
确定来自所述若干IP包中哪一包含有在传输中丢失的数据;
仅在所述接收的NAK与含有视频数据的包相关联时,执行差错控制;
维持因特网协议IP包与视频数据的宏区块之间的映射;
在确定哪一IP包含有在传输中丢失的数据之后,使用所述映射将所述IP包转换为视频帧的宏区块以确定哪些宏区块在传输中丢失;以及
对在传输中丢失的所述宏区块执行差错控制,
其中所述差错控制由编码器执行,所述编码器经配置以根据反向链路延迟和多组阈值来编码实时信息。
2.根据权利要求1所述的方法,其中所述至少一个具有经编码的视频数据的包包含视频数据的宏区块MB,所述方法进一步包含将所述宏区块的信息从视频编码器传递到实时传送协议RTP层。
3.根据权利要求1所述的方法,其进一步包含:
在编码一视频数据帧之后且在编码新的视频数据帧之前,查询所述MAC层以确定所述MAC层是否接收到NAK;以及
如果所述MAC层接收到NAK,则执行差错控制。
4.根据权利要求1所述的方法,其进一步包含向包合并协议PCP模块通知所述接收的NAK。
5.根据权利要求1所述的方法,其进一步包含:如果所述接收的NAK与含有视频数据的包相关联,那么向无线电链路协议RLP模块通知所述接收的NAK。
6.根据权利要求5所述的方法,其进一步包含确定哪一RLP队列含有在传输中经历错误的包。
7.根据权利要求1所述的方法,其进一步包含向应用层通知与所述接收的NAK相关联的所述包。
8.根据权利要求1所述的方法,其中差错控制包含以下各项中的至少一者:(a)限制运动估计搜索范围以使得已损坏的部分将不用作预测;(b)对共同定位的宏区块和邻近的宏区块进行帧内编码;和(c)对共同定位的宏区块使用不同的参考帧。
9.根据权利要求1所述的方法,其中所述无线信道包含码分多址2000 1x演进数据优化修订版A CDMA2000 1x EV-DO修订版A信道。
10.根据权利要求1所述的方法,其中所述无线信道包含宽带码分多址WCDMA高速上行链路包接入HSUPA信道。
11.一种差错控制方法,其包含:
编码第一视频数据帧与音频数据;
形成具有经编码的第一视频数据帧的第一包及具有经编码的音频数据的第二包;
跨越无线信道将所述包传输到接入网络;
在编码第二视频数据帧之前,确定媒体接入控制MAC层是否从所述接入网络接收到否定应答NAK;
确定所述接收的NAK是否与含有视频数据的所述第一包相关联;
仅在所述接收的NAK与含有视频数据的所述第一包相关联时,执行差错控制,其中确定媒体接入控制MAC层是否从所述接入网络接收到否定应答NAK包含:检查是否在无线电链路协议RLP模块中设定了旗标,
其中所述差错控制由编码器执行,所述编码器经配置以根据反向链路延迟和多组阈值来编码实时信息。
12.根据权利要求11所述的方法,其进一步包含向应用层通知所述接收的NAK。
13.根据权利要求11所述的方法,其进一步包含向视频编码器通知所述接收的NAK。
14.根据权利要求11所述的方法,其进一步包含在无线电链路协议RLP模块中设定1位旗标以指示所述MAC层接收到NAK。
15.根据权利要求11所述的方法,其中差错控制包含以下各项中的至少一者:(a)将所述第二帧编码为I帧;(b)增加经帧内编码的宏区块的百分率;和(c)将所述第一帧之前的帧用作运动估计的参考。
16.一种差错控制设备,其包含:
编码器,其经配置以编码视频数据与音频数据;
模块,其经配置以形成若干因特网协议IP包;所述若干IP包包含至少一个具有经编码的视频数据而非音频数据的包、至少一个具有经编码的音频数据而非视频数据的包,及至少一个具有经编码的音频数据和经编码的视频数据两者的包;
收发器,其经配置以(a)跨越无线信道将所述包传输到接入网络,且(b)从所述接入网络接收媒体接入控制MAC层否定应答NAK;
其中所述模块经配置以确定所述接收的NAK是否与来自所述若干IP包中含有视频数据的包相关联并确定来自所述若干IP包中的哪一包含有在传输中丢失的数据;
仅在所述接收的NAK与含有视频数据的包相关联时,所述编码器经配置以执行差错控制;
RTP层,其经配置以维持因特网协议IP包与视频数据的宏区块之间的映射;在确定哪一IP包含有在传输中丢失的数据之后,所述RTP层经配置以使用所述映射将所述IP包转换为视频帧的宏区块以确定哪些宏区块在传输中丢失;以及
所述编码器经配置以对在传输中丢失的所述宏区块执行差错控制,
其中所述差错控制由编码器执行,所述编码器经配置以根据反向链路延迟和多组阈值来编码实时信息。
17.一种差错控制设备,其包含:
编码器,其经配置以编码第一视频数据帧与音频数据;
第一模块,其经配置以形成具有经编码的第一视频数据帧的第一包及具有经编码的音频数据的第二包;
收发器,其经配置以(a)跨越无线信道将所述包传输到接入网络,且(b)从所述接入网络接收媒体接入控制MAC层否定应答NAK;
第二模块,其经配置以在编码第二视频数据帧之前,确定所述MAC层是否从所述接入网络接收NAK并确定所述接收的NAK是否与含有视频数据的所述第一包相关联;以及
差错控制模块,其经配置以:仅在所述接收的NAK与含有视频数据的所述第一包相关联时,执行差错控制,其中确定媒体接入控制MAC层是否从所述接入网络接收到否定应答NAK包含:检查是否在无线电链路协议RLP模块中设定了旗标,
其中所述差错控制模块经配置以根据反向链路延迟和多组阈值来编码实时信息。
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US72901705P | 2005-10-21 | 2005-10-21 | |
US60/729,017 | 2005-10-21 | ||
US11/315,399 US8842555B2 (en) | 2005-10-21 | 2005-12-21 | Methods and systems for adaptive encoding of real-time information in packet-switched wireless communication systems |
US11/315,399 | 2005-12-21 | ||
US11/454,475 | 2006-06-15 | ||
US11/454,475 US8514711B2 (en) | 2005-10-21 | 2006-06-15 | Reverse link lower layer assisted video error control |
CN 200680046647 CN101326829A (zh) | 2005-10-21 | 2006-10-20 | 基于反向链路信息的视频差错控制 |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 200680046647 Division CN101326829A (zh) | 2005-10-21 | 2006-10-20 | 基于反向链路信息的视频差错控制 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103179466A CN103179466A (zh) | 2013-06-26 |
CN103179466B true CN103179466B (zh) | 2017-09-29 |
Family
ID=37814397
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310027387.5A Expired - Fee Related CN103179466B (zh) | 2005-10-21 | 2006-10-20 | 基于反向链路信息的视频差错控制 |
Country Status (12)
Country | Link |
---|---|
US (1) | US8514711B2 (zh) |
EP (1) | EP1938609B1 (zh) |
JP (1) | JP4933556B2 (zh) |
KR (1) | KR100957359B1 (zh) |
CN (1) | CN103179466B (zh) |
AU (1) | AU2006304947B2 (zh) |
BR (1) | BRPI0617711A2 (zh) |
CA (1) | CA2626794C (zh) |
ES (1) | ES2820766T3 (zh) |
NO (1) | NO20082301L (zh) |
TW (2) | TWI369867B (zh) |
WO (1) | WO2007048138A1 (zh) |
Families Citing this family (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006060813A (ja) * | 2004-08-20 | 2006-03-02 | Polycom Inc | ビデオデコーダにおける誤り隠蔽 |
US8842555B2 (en) * | 2005-10-21 | 2014-09-23 | Qualcomm Incorporated | Methods and systems for adaptive encoding of real-time information in packet-switched wireless communication systems |
US8406309B2 (en) * | 2005-10-21 | 2013-03-26 | Qualcomm Incorporated | Video rate adaptation to reverse link conditions |
US8548048B2 (en) * | 2005-10-27 | 2013-10-01 | Qualcomm Incorporated | Video source rate control for video telephony |
US8953596B2 (en) * | 2006-01-06 | 2015-02-10 | Qualcomm Incorporated | Conserving network capacity by releasing QoS resources |
WO2008086509A2 (en) * | 2007-01-10 | 2008-07-17 | Qualcomm Incorporated | Content- and link-dependent coding adaptation for multimedia telephony |
US7557605B2 (en) * | 2007-09-14 | 2009-07-07 | Cswitch Corporation | Heterogeneous configurable integrated circuit |
US8797850B2 (en) | 2008-01-10 | 2014-08-05 | Qualcomm Incorporated | System and method to adapt to network congestion |
US7978626B1 (en) * | 2009-01-13 | 2011-07-12 | Sprint Spectrum L.P. | Method and system for adaptive hybrid automatic repeat request protocols based on network conditions |
US8369337B1 (en) | 2009-11-05 | 2013-02-05 | Sprint Spectrum L.P. | Methods and devices for assigning a wireless communication device to a wireless coverage area based on early termination gain |
US8228817B2 (en) * | 2010-04-06 | 2012-07-24 | Via Telecom, Inc. | Quality of service control of reverse traffic channel for a mobile communication device |
US20110249127A1 (en) * | 2010-04-07 | 2011-10-13 | Cisco Technology, Inc. | Estimating Video Quality Corruption in Lossy Networks |
US9083772B2 (en) * | 2010-04-30 | 2015-07-14 | Qualcomm Incorporated | Exchanging data associated with a communication session within a communications system |
KR20140126762A (ko) * | 2012-02-24 | 2014-10-31 | 브이아이디 스케일, 인크. | 패킷 손실 검출을 이용한 비디오 코딩 |
US9247448B2 (en) | 2012-08-27 | 2016-01-26 | Qualcomm Incorporated | Device and method for adaptive rate multimedia communications on a wireless network |
US10051519B2 (en) | 2012-08-27 | 2018-08-14 | Qualcomm Incorporated | Device and method for adaptive rate multimedia communications on a wireless network |
EP2979487B1 (en) * | 2013-03-29 | 2018-11-28 | VID SCALE, Inc. | Early packet loss detection and feedback |
US9531504B1 (en) | 2014-03-27 | 2016-12-27 | Sprint Spectrum L.P. | Bundling acknowledgments based on signal quality |
US9591316B2 (en) * | 2014-03-27 | 2017-03-07 | Intel IP Corporation | Scalable video encoding rate adaptation based on perceived quality |
US9473973B1 (en) | 2014-05-19 | 2016-10-18 | Sprint Spectrum L.P. | Reducing transmission rates in data slots subject to bundled acknowledgments |
US9531505B1 (en) | 2014-06-20 | 2016-12-27 | Sprint Spectrum L.P. | Determining an amount of hybrid ARQ transmissions based on a series of acknowledgments |
US9445344B1 (en) | 2014-07-22 | 2016-09-13 | Sprint Spectrum L.P. | Preferentially assigning data slots subject to bundled acknowledgments to devices that support carrier aggregation |
US10073735B1 (en) * | 2014-10-28 | 2018-09-11 | Seagate Technology Llc | Seeding mechanism for error detection codes |
US9609651B1 (en) | 2015-01-08 | 2017-03-28 | Sprint Spectrum L.P. | Exchanging uplink and downlink carrier frequencies |
US10021686B1 (en) | 2015-10-19 | 2018-07-10 | Sprint Spectrum L.P. | Scheduling traffic based on acknowledgment bundling |
WO2017117505A1 (en) * | 2015-12-31 | 2017-07-06 | BOT Home Automation, Inc. | Streaming and storing video content captured by an audio/video recording and communication device |
US20210120232A1 (en) * | 2020-12-23 | 2021-04-22 | Intel Corporation | Method and system of video coding with efficient frame loss recovery |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1293871A (zh) * | 1998-11-18 | 2001-05-02 | 皇家菲利浦电子有限公司 | 流式视频接收机的解码器缓冲器 |
Family Cites Families (134)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4167264A (en) * | 1978-07-17 | 1979-09-11 | Kretzmeir James P | Vise caddy tool rack |
US4942126A (en) * | 1986-08-13 | 1990-07-17 | Allegheny-Singer Research Institute | Method of extracting antigens of bacteria |
US4774587A (en) * | 1987-06-02 | 1988-09-27 | Eastman Kodak Company | Still video transceiver processor |
EP0461023B1 (en) * | 1990-06-05 | 1998-09-16 | Canon Kabushiki Kaisha | Communication method and apparatus |
US5156244A (en) * | 1990-08-31 | 1992-10-20 | The Aro Corporation | Torque sensing automatic shut-off and reset clutch for screwdrivers, nutsetters and the like |
US5341374A (en) | 1991-03-01 | 1994-08-23 | Trilan Systems Corporation | Communication network integrating voice data and video with distributed call processing |
JP2861518B2 (ja) | 1991-09-03 | 1999-02-24 | 日本電気株式会社 | 適応多重化方式 |
JP3002348B2 (ja) | 1992-11-30 | 2000-01-24 | シャープ株式会社 | 画像通信システム |
US5367523A (en) | 1993-08-26 | 1994-11-22 | International Business Machines Corporation | Adaptive rate-based congestion and flow control in packet communications networks |
DE69427578T2 (de) | 1993-09-21 | 2001-10-04 | Sony Corp | Verfahren und anlage zum übertragen von daten, datenkodierer und datenaufnahmemedium |
US5541919A (en) | 1994-12-19 | 1996-07-30 | Motorola, Inc. | Multimedia multiplexing device and method using dynamic packet segmentation |
US5784362A (en) | 1995-04-17 | 1998-07-21 | Telefonaktiebolaget Lm Ericsson | Temporary frame identification for ARQ in a reservation-slotted-ALOHA type of protocol |
US5802068A (en) | 1995-06-30 | 1998-09-01 | Nippon Steel Corporation | Multiplexing apparatus of a plurality of data having different bit rates |
US5768533A (en) | 1995-09-01 | 1998-06-16 | National Semiconductor Corporation | Video coding using segmented frames and retransmission to overcome channel errors |
JP3068002B2 (ja) * | 1995-09-18 | 2000-07-24 | 沖電気工業株式会社 | 画像符号化装置、画像復号化装置及び画像伝送システム |
TW305043B (zh) | 1995-09-29 | 1997-05-11 | Matsushita Electric Ind Co Ltd | |
US6002802A (en) | 1995-10-27 | 1999-12-14 | Kabushiki Kaisha Toshiba | Video encoding and decoding apparatus |
US5790538A (en) | 1996-01-26 | 1998-08-04 | Telogy Networks, Inc. | System and method for voice Playout in an asynchronous packet network |
JP3499670B2 (ja) * | 1996-02-02 | 2004-02-23 | 株式会社東芝 | 無線通信方法、無線基地局装置及び無線端末装置 |
SG71709A1 (en) * | 1996-05-08 | 2000-04-18 | Matsushita Electric Ind Co Ltd | Multiplex transmission method and system and audio jitter absorbing method used therein |
CN1126374C (zh) * | 1996-07-05 | 2003-10-29 | 日本电信电话株式会社 | 图象通信系统及方法 |
US5838678A (en) | 1996-07-24 | 1998-11-17 | Davis; Joseph W. | Method and device for preprocessing streams of encoded data to facilitate decoding streams back-to back |
US6366614B1 (en) | 1996-10-11 | 2002-04-02 | Qualcomm Inc. | Adaptive rate control for digital video compression |
DE19648077C2 (de) | 1996-11-20 | 1998-12-03 | Nokia Mobile Phones Ltd | Verfahren zur Einstellung der Zugriffsbeharrlichkeit einer Mobilstation in einem zellularen Mobilfunknetz |
US6633609B1 (en) | 1996-12-24 | 2003-10-14 | Intel Corporation | Method and apparatus for bit rate control in a digital video environment for arbitrary bandwidth |
US5969764A (en) | 1997-02-14 | 1999-10-19 | Mitsubishi Electric Information Technology Center America, Inc. | Adaptive video coding method |
US6404776B1 (en) | 1997-03-13 | 2002-06-11 | 8 × 8, Inc. | Data processor having controlled scalable input data source and method thereof |
EP1492368B1 (en) | 1997-04-17 | 2009-04-08 | NTT DoCoMo, Inc. | Base station apparatus and method for mobile communication system |
JPH10341217A (ja) * | 1997-06-09 | 1998-12-22 | Kokusai Electric Co Ltd | マルチメディア多重化通信システム |
EP2239876A3 (en) | 1997-06-19 | 2011-01-26 | Kabushiki Kaisha Toshiba | Information data multiplexing transmission system, multiplexer and demultiplexer used therefor, and error correcting encoder and decoder |
US6377809B1 (en) | 1997-09-16 | 2002-04-23 | Qualcomm Incorporated | Channel structure for communication systems |
US6154489A (en) | 1998-03-30 | 2000-11-28 | Motorola, Inc. | Adaptive-rate coded digital image transmission |
US6396956B1 (en) | 1998-03-31 | 2002-05-28 | Sharp Laboratories Of America, Inc. | Method and apparatus for selecting image data to skip when encoding digital video |
US6421387B1 (en) * | 1998-05-15 | 2002-07-16 | North Carolina State University | Methods and systems for forward error correction based loss recovery for interactive video transmission |
TW376497B (en) | 1998-05-26 | 1999-12-11 | Koninkl Philips Electronics Nv | Transmission system for transmitting a main signal and an auxiliary signal |
CA2238795A1 (en) | 1998-05-28 | 1999-11-28 | Newbridge Networks Corporation | Er information acceleration in abr traffic |
US6584509B2 (en) | 1998-06-23 | 2003-06-24 | Intel Corporation | Recognizing audio and video streams over PPP links in the absence of an announcement protocol |
JP2000023240A (ja) | 1998-06-30 | 2000-01-21 | Matsushita Electric Ind Co Ltd | 無線通信装置及び無線通信方法 |
US6389034B1 (en) | 1998-09-04 | 2002-05-14 | Nortel Networks Limited | System for providing stream based and packet based services |
US6108795A (en) | 1998-10-30 | 2000-08-22 | Micron Technology, Inc. | Method for aligning clock and data signals received from a RAM |
CA2257007A1 (en) | 1998-12-24 | 2000-06-24 | Newbridge Networks Corporation | Explicit rate flow control for multicast connections |
JP2000324171A (ja) | 1999-05-14 | 2000-11-24 | Namco Ltd | データ転送装置及びデータ転送方法、並びにデータ配布方法 |
JP3841256B2 (ja) | 2000-02-15 | 2006-11-01 | 三菱電機株式会社 | 通信システム及び通信方法及び送信端末 |
JP2001238256A (ja) | 2000-02-21 | 2001-08-31 | Hitachi Kokusai Electric Inc | 可変速度符号化システム |
EP1130921B1 (en) * | 2000-03-02 | 2005-01-12 | Matsushita Electric Industrial Co., Ltd. | Data transmission in non-reliable networks |
KR100833222B1 (ko) | 2000-03-29 | 2008-05-28 | 삼성전자주식회사 | 멀티미디어 송수신 장치 및 방법 |
US6694469B1 (en) | 2000-04-14 | 2004-02-17 | Qualcomm Incorporated | Method and an apparatus for a quick retransmission of signals in a communication system |
US6747991B1 (en) | 2000-04-26 | 2004-06-08 | Carnegie Mellon University | Filter and method for adaptively modifying the bit rate of synchronized video and audio streams to meet packet-switched network bandwidth constraints |
JP3669281B2 (ja) | 2000-04-27 | 2005-07-06 | 三菱電機株式会社 | 符号化装置および符号化方法 |
CN1322759C (zh) | 2000-04-27 | 2007-06-20 | 三菱电机株式会社 | 编码装置和编码方法 |
US6999432B2 (en) | 2000-07-13 | 2006-02-14 | Microsoft Corporation | Channel and quality of service adaptation for multimedia over wireless networks |
US6862298B1 (en) | 2000-07-28 | 2005-03-01 | Crystalvoice Communications, Inc. | Adaptive jitter buffer for internet telephony |
US6891822B1 (en) | 2000-09-08 | 2005-05-10 | Sharewave, Inc. | Method and apparatus for transferring isocronous data within a wireless computer network |
WO2002032083A1 (fr) | 2000-10-13 | 2002-04-18 | Sony Corporation | Systeme de controle de la qualite de la communication de donnees, systeme emetteur et recepteur |
US7304951B2 (en) | 2000-11-21 | 2007-12-04 | North Carolina State University | Methods and systems for rate-based flow control between a sender and a receiver |
US7006510B2 (en) | 2001-01-17 | 2006-02-28 | Optibase Ltd. | Method of clock mismatch and drift compensation for packet networks |
GB2399998B (en) | 2001-02-01 | 2005-04-13 | Fujitsu Ltd | Communications systems |
US7058085B2 (en) * | 2001-03-14 | 2006-06-06 | Nortel Networks Limited | Method and apparatus for transmitting data over a network within a specified time limit |
KR100425253B1 (ko) | 2001-04-18 | 2004-03-30 | 주식회사 현대시스콤 | 무선통신 시스템에서의 순방향 패킷 송수신 방법 |
US7054316B2 (en) | 2001-04-25 | 2006-05-30 | Nokia Corporation | Method and system for interlayer control between re-sequencing and retransmission entities |
US7342901B1 (en) | 2001-05-01 | 2008-03-11 | Nortel Networks Limited | Medium access control (MAC) protocol for a wireless communication system |
US6920598B2 (en) | 2001-05-21 | 2005-07-19 | Lucent Technologies Inc. | System and method for error recovery using NAKs |
JP2002354141A (ja) | 2001-05-25 | 2002-12-06 | Matsushita Electric Ind Co Ltd | ビデオフォンおよび遠隔医療装置 |
US7193966B2 (en) | 2001-06-25 | 2007-03-20 | Telefonakitebolaget Lm Ericsson (Publ) | Triggered packet data rate change in a communication system |
US7269139B1 (en) | 2001-06-27 | 2007-09-11 | Cisco Technology, Inc. | Method and apparatus for an adaptive rate control mechanism reactive to flow control messages in a packet switching system |
US6741603B2 (en) | 2001-07-09 | 2004-05-25 | Overture Networks, Inc. | Use of a circular buffer to assure in-order delivery of packets |
WO2003010674A1 (en) | 2001-07-27 | 2003-02-06 | Advantest Corporation | Phase correction circuit |
US7206285B2 (en) | 2001-08-06 | 2007-04-17 | Koninklijke Philips Electronics N.V. | Method for supporting non-linear, highly scalable increase-decrease congestion control scheme |
US6865374B2 (en) | 2001-09-18 | 2005-03-08 | Koninklijke Philips Electronics N.V. | Video recovery system and method |
US7356079B2 (en) | 2001-11-21 | 2008-04-08 | Vixs Systems Inc. | Method and system for rate control during video transcoding |
US20050013244A1 (en) | 2001-12-14 | 2005-01-20 | Parlos Alexander G | System for actively controlling distributed applications |
JP3606259B2 (ja) | 2002-01-16 | 2005-01-05 | ソニー株式会社 | 通信装置とその方法、ならびにプログラムとその記録媒体 |
KR100933469B1 (ko) | 2002-01-18 | 2009-12-23 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | 오디오 코딩 |
EP1335289A1 (en) | 2002-02-07 | 2003-08-13 | Siemens Aktiengesellschaft | Method for software downloads in a radio communications system |
JP3900413B2 (ja) | 2002-02-14 | 2007-04-04 | Kddi株式会社 | 映像情報伝送方式およびプログラム |
JP4116470B2 (ja) | 2002-03-06 | 2008-07-09 | ヒューレット・パッカード・カンパニー | メディア・ストリーミング配信システム |
JP3490425B2 (ja) | 2002-03-14 | 2004-01-26 | 松下電器産業株式会社 | 受信装置及び受信方法 |
JP4029670B2 (ja) | 2002-06-11 | 2008-01-09 | 日本電気株式会社 | 無線アクセスにおける輻輳制御方法並びにシステム |
KR20030095995A (ko) | 2002-06-14 | 2003-12-24 | 마츠시타 덴끼 산교 가부시키가이샤 | 미디어 전송방법 및 그 송신장치 및 수신장치 |
JP3730974B2 (ja) | 2002-06-14 | 2006-01-05 | 松下電器産業株式会社 | メディア伝送方法及びその送信装置 |
GB0229396D0 (en) | 2002-12-17 | 2003-01-22 | British Telecomm | Signal processing |
AU2003288595A1 (en) | 2002-12-18 | 2004-07-09 | Koninklijke Philips Electronics N.V. | Adaptive encoding of digital multimedia information |
JP2004208001A (ja) | 2002-12-25 | 2004-07-22 | Sharp Corp | 無線通信システム、無線通信方法、無線通信プログラム及びプログラム記録媒体 |
JP2004253883A (ja) | 2003-02-18 | 2004-09-09 | Nec Corp | 音声・画像リアルタイム通信におけるビットレート制御を実行するデータ通信装置 |
US7551588B2 (en) | 2003-03-06 | 2009-06-23 | Nortel Networks Limited | Autonomous mode transmission from a mobile station |
SE0301048D0 (sv) | 2003-04-07 | 2003-04-07 | Ericsson Telefon Ab L M | RLC window reconfiguration |
JPWO2004093446A1 (ja) * | 2003-04-17 | 2006-07-13 | 富士通株式会社 | 圧縮データと非圧縮データを同時転送する場合のタスクスケジューリング方法 |
JP3943558B2 (ja) | 2003-05-14 | 2007-07-11 | 株式会社エヌ・ティ・ティ・ドコモ | パケット通信方法及びパケット通信システム。 |
US7477604B2 (en) | 2003-05-14 | 2009-01-13 | Ntt Docomo, Inc. | Packet communications system |
JP2004350227A (ja) | 2003-05-26 | 2004-12-09 | Ntt Communications Kk | ビデオ会議システムにおける会議クライアント装置及びそのプログラム |
US20040252761A1 (en) | 2003-06-16 | 2004-12-16 | Dilithium Networks Pty Limited (An Australian Corporation) | Method and apparatus for handling video communication errors |
US7050397B2 (en) | 2003-07-02 | 2006-05-23 | Nokia Corporation | Apparatus, and associated method, for facilitating retransmission of data packets in a packet radio communication system that utilizes a feedback acknowledgement scheme |
US7263067B2 (en) | 2003-07-15 | 2007-08-28 | Nokia Siemans Networks Oy | Method and apparatus for accelerating throughput in a wireless or other telecommunication system |
JP4176576B2 (ja) | 2003-08-01 | 2008-11-05 | 株式会社エヌ・ティ・ティ・ドコモ | データ流入量制御方法、基地局及び制御局 |
CN101060705B (zh) | 2003-09-30 | 2012-09-05 | 捷讯研究有限公司 | 通信模式控制方法,移动通信系统,基站控制装置,基站和移动通信终端 |
KR100816598B1 (ko) | 2003-10-17 | 2008-03-24 | 닛본 덴끼 가부시끼가이샤 | 시그널링 방법, 시스템, 기지국 및 이동국 |
WO2005053216A2 (en) * | 2003-11-25 | 2005-06-09 | Dg2L Technologies | Methods and systems for reliable distribution of media over a network |
US7197026B2 (en) | 2003-12-23 | 2007-03-27 | Nokia Corporation | Method and system for RLP optimization |
JP2005192073A (ja) | 2003-12-26 | 2005-07-14 | Matsushita Electric Ind Co Ltd | マルチメディアデータ通信方法および装置 |
US20050152320A1 (en) | 2004-01-08 | 2005-07-14 | Interdigital Technology Corporation | Wireless communication method and apparatus for balancing the loads of access points by controlling access point transmission power levels |
US7453938B2 (en) | 2004-02-06 | 2008-11-18 | Apple Inc. | Target bitrate estimator, picture activity and buffer management in rate control for video coder |
JP4562402B2 (ja) | 2004-02-20 | 2010-10-13 | アルパイン株式会社 | 音声データの非同期通信システムおよびその通信方法 |
WO2005094020A1 (en) | 2004-03-19 | 2005-10-06 | Telefonaktiebolaget Lm Ericsson (Publ) | Higher layer packet framing using rlp |
KR100550567B1 (ko) | 2004-03-22 | 2006-02-10 | 엘지전자 주식회사 | 무선 네트워크망을 통해 통신하는 서버 시스템 및 그동작방법 |
JP3950865B2 (ja) | 2004-03-30 | 2007-08-01 | Necアクセステクニカ株式会社 | Atm通信システム |
KR101071816B1 (ko) | 2004-04-02 | 2011-10-11 | 엘지전자 주식회사 | 무선 패킷 통신 시스템에서의 업링크 패킷 스케쥴링 방법 |
JP4526294B2 (ja) | 2004-04-15 | 2010-08-18 | シャープ株式会社 | ストリームデータ送信装置、受信装置、プログラムを記録した記録媒体、およびシステム |
US7424026B2 (en) | 2004-04-28 | 2008-09-09 | Nokia Corporation | Method and apparatus providing continuous adaptive control of voice packet buffer at receiver terminal |
EP1751955B1 (en) | 2004-05-13 | 2009-03-25 | Qualcomm, Incorporated | Header compression of multimedia data transmitted over a wireless communication system |
BRPI0511858B1 (pt) | 2004-06-07 | 2020-12-22 | Sling Media, Inc. | transmissor de mídia pessoal e respectivo sistema de transmissão, métodos de provimento de acesso a fonte áudio/visual em localização remota da fonte áudio/visual e de fluxo (streaming) de sinal de mídia para local de assinante remoto |
KR20050121067A (ko) | 2004-06-21 | 2005-12-26 | 삼성전자주식회사 | 무선 채널에 의한 무선 통신 시스템 및 그의 무선 통신 방법 |
US7606427B2 (en) | 2004-07-08 | 2009-10-20 | Qualcomm Incorporated | Efficient rate control techniques for video encoding |
KR100608061B1 (ko) | 2004-07-12 | 2006-08-02 | 삼성전자주식회사 | 전송 스트림 생성을 위한 다중화 방법 및 그 장치 |
US7551647B2 (en) | 2004-07-19 | 2009-06-23 | Qvidium Technologies, Inc. | System and method for clock synchronization over packet-switched networks |
EP1628446B1 (en) | 2004-08-18 | 2007-11-14 | Infineon Technologies AG | Method for transmitting information through a communication link and respective transmitting device and communication system |
CA2691959C (en) | 2004-08-30 | 2013-07-30 | Qualcomm Incorporated | Method and apparatus for an adaptive de-jitter buffer |
US7606303B2 (en) | 2004-09-28 | 2009-10-20 | General Instrument Corporation | Method and apparatus to detect anchor frames from digital video streams |
JP2006115354A (ja) | 2004-10-15 | 2006-04-27 | Ntt Docomo Inc | 移動端末、制御装置及び移動通信方法 |
US7925271B2 (en) | 2004-11-09 | 2011-04-12 | Spyder Navigations L.L.C. | Apparatus and method for arbitrary data rate ramp up after overload on wireless interface |
JP2006222822A (ja) | 2005-02-14 | 2006-08-24 | Hitachi Ltd | ハンドオーバシステム |
US7492710B2 (en) | 2005-03-31 | 2009-02-17 | Intel Corporation | Packet flow control |
US20070019931A1 (en) | 2005-07-19 | 2007-01-25 | Texas Instruments Incorporated | Systems and methods for re-synchronizing video and audio data |
US7701851B2 (en) | 2005-07-20 | 2010-04-20 | Vidyo, Inc. | System and method for the control of the transmission rate in packet-based digital communications |
CA2620544C (en) * | 2005-09-21 | 2015-04-14 | Lg Electronics Inc. | Method and apparatus for multiplexing multiple reverse feedback channels in multi-carrier wireless networks |
US8102878B2 (en) | 2005-09-29 | 2012-01-24 | Qualcomm Incorporated | Video packet shaping for video telephony |
US8406309B2 (en) | 2005-10-21 | 2013-03-26 | Qualcomm Incorporated | Video rate adaptation to reverse link conditions |
US8842555B2 (en) | 2005-10-21 | 2014-09-23 | Qualcomm Incorporated | Methods and systems for adaptive encoding of real-time information in packet-switched wireless communication systems |
US8548048B2 (en) | 2005-10-27 | 2013-10-01 | Qualcomm Incorporated | Video source rate control for video telephony |
US8848618B2 (en) | 2006-08-22 | 2014-09-30 | Qualcomm Incorporated | Semi-persistent scheduling for traffic spurts in wireless communication |
US20080056125A1 (en) | 2006-09-06 | 2008-03-06 | Nokia Corporation | Congestion control in a wireless network |
WO2008086509A2 (en) | 2007-01-10 | 2008-07-17 | Qualcomm Incorporated | Content- and link-dependent coding adaptation for multimedia telephony |
KR100787314B1 (ko) | 2007-02-22 | 2007-12-21 | 광주과학기술원 | 미디어내 동기화를 위한 적응형 미디어 재생 방법 및 장치 |
JP5339697B2 (ja) | 2007-08-14 | 2013-11-13 | キヤノン株式会社 | 送信装置、送信方法、及びコンピュータプログラム |
US8797850B2 (en) | 2008-01-10 | 2014-08-05 | Qualcomm Incorporated | System and method to adapt to network congestion |
-
2006
- 2006-06-15 US US11/454,475 patent/US8514711B2/en not_active Expired - Fee Related
- 2006-10-20 CA CA2626794A patent/CA2626794C/en active Active
- 2006-10-20 JP JP2008536656A patent/JP4933556B2/ja not_active Expired - Fee Related
- 2006-10-20 AU AU2006304947A patent/AU2006304947B2/en not_active Ceased
- 2006-10-20 EP EP06839497.2A patent/EP1938609B1/en active Active
- 2006-10-20 CN CN201310027387.5A patent/CN103179466B/zh not_active Expired - Fee Related
- 2006-10-20 ES ES06839497T patent/ES2820766T3/es active Active
- 2006-10-20 BR BRPI0617711-5A patent/BRPI0617711A2/pt not_active Application Discontinuation
- 2006-10-20 WO PCT/US2006/060141 patent/WO2007048138A1/en active Application Filing
- 2006-10-20 KR KR1020087012080A patent/KR100957359B1/ko active IP Right Grant
- 2006-10-23 TW TW095139067A patent/TWI369867B/zh not_active IP Right Cessation
- 2006-10-23 TW TW100126273A patent/TWI370641B/zh not_active IP Right Cessation
-
2008
- 2008-05-20 NO NO20082301A patent/NO20082301L/no not_active Application Discontinuation
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1293871A (zh) * | 1998-11-18 | 2001-05-02 | 皇家菲利浦电子有限公司 | 流式视频接收机的解码器缓冲器 |
Also Published As
Publication number | Publication date |
---|---|
WO2007048138A1 (en) | 2007-04-26 |
CN103179466A (zh) | 2013-06-26 |
EP1938609B1 (en) | 2020-07-08 |
CA2626794A1 (en) | 2007-04-26 |
CA2626794C (en) | 2013-04-02 |
AU2006304947B2 (en) | 2010-08-19 |
BRPI0617711A2 (pt) | 2011-08-02 |
ES2820766T3 (es) | 2021-04-22 |
TWI370641B (en) | 2012-08-11 |
KR20080077125A (ko) | 2008-08-21 |
US8514711B2 (en) | 2013-08-20 |
EP1938609A1 (en) | 2008-07-02 |
AU2006304947A1 (en) | 2007-04-26 |
TW200726118A (en) | 2007-07-01 |
TWI369867B (en) | 2012-08-01 |
JP2009513072A (ja) | 2009-03-26 |
NO20082301L (no) | 2008-07-09 |
KR100957359B1 (ko) | 2010-05-12 |
JP4933556B2 (ja) | 2012-05-16 |
TW201203929A (en) | 2012-01-16 |
US20070091816A1 (en) | 2007-04-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103179466B (zh) | 基于反向链路信息的视频差错控制 | |
US8259565B2 (en) | Call setup in a video telephony network | |
CA2395615C (en) | Method for making data transmission more effective and a data transmission protocol | |
EP2061174B1 (en) | Data communication system, data transmitting device and method, using probe packets and having a transmission buffer control | |
EP1482681B1 (en) | Medium streaming distribution system | |
USRE46167E1 (en) | Systems and methods for transmitting data over lossy networks | |
US8111698B2 (en) | Method of performing a layer operation in a communications network | |
US20060256785A1 (en) | Mobile terminal | |
KR101197887B1 (ko) | 이동통신 시스템에서 자동 재전송 요구를 위한 상태 보고의송수신 방법 및 장치 | |
CN101326829A (zh) | 基于反向链路信息的视频差错控制 | |
JP2006279436A (ja) | マルチメディア通信システムおよび再送用データ削除方法 | |
RU2364051C2 (ru) | Установление вызова в видеотелефонной сети | |
Pal et al. | Video rate adaptation and scheduling in multi-rate wireless networks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170929 |
|
CF01 | Termination of patent right due to non-payment of annual fee |