CN101127904B - 与不可伸缩解码器兼容的可伸缩视频编码/解码方法、系统 - Google Patents

与不可伸缩解码器兼容的可伸缩视频编码/解码方法、系统 Download PDF

Info

Publication number
CN101127904B
CN101127904B CN2007101388226A CN200710138822A CN101127904B CN 101127904 B CN101127904 B CN 101127904B CN 2007101388226 A CN2007101388226 A CN 2007101388226A CN 200710138822 A CN200710138822 A CN 200710138822A CN 101127904 B CN101127904 B CN 101127904B
Authority
CN
China
Prior art keywords
telescoping
video
encoded
data
video data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN2007101388226A
Other languages
English (en)
Other versions
CN101127904A (zh
Inventor
巴瑞恩·杰弗里·哈斯克尔
戴维·威廉·辛格
托马斯·彭
吴斯军
詹姆斯·奥利弗·诺迈尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Computer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apple Computer Inc filed Critical Apple Computer Inc
Publication of CN101127904A publication Critical patent/CN101127904A/zh
Application granted granted Critical
Publication of CN101127904B publication Critical patent/CN101127904B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network
    • H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6582—Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8451—Structuring of content, e.g. decomposing content into time segments using Advanced Video Coding [AVC]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

公开了一种与不可伸缩解码器兼容的可伸缩视频编码和多路技术。在某些实施例中，视频数据被接收并且以使至少一基层与不可伸缩的视频编码标准兼容的方式进行编码，所述方式包括为至少所述基层指定一个或多个可伸缩性参数的默认值。在某些实施例中，视频数据被接收并编码以产生一编码的视频数据，该数据包括符合不可伸缩视频编码标准的基层和一个或多个从属不可伸缩层，其中所述从属不可伸缩层自身不能符合所述不可伸缩视频编码标准，但其可以与所述基层联合以产生符合所述不可伸缩视频编码标准的结果，这样所述结果可以被不可伸缩的解码器所解码。一标识了与从属不可伸缩层相关联的那部分编码视频数据的标识数据被包括在所述编码视频数据中。

Description

与不可伸缩解码器兼容的可伸缩视频编码/解码方法、系统
对其它申请的交叉参考 
本申请要求于2006年3月16日提交的U.S.临时专利申请号为No.60/782,807(Attorney Docket No.P4226USP1)的名称为“与不可伸缩解码器兼容的可伸缩(scalable)视频编码/多路技术(multiplexing)”的申请的优先权，其被在此引用作为所有目的的参考；并且要求于2006年3月23日提交的U.S.临时专利申请号为No.60/785,796(Attorney Docket No.P4226USP2)的名称为“与不可伸缩解码器兼容的可伸缩视频编码/多路技术”的申请的优先权，其被在此引用作为所有目的的参考。 
背景技术
在可伸缩视频编码/多路技术方案中，希望所谓的基层与不可伸缩的视频编码标准，如H.264，相兼容。还希望附加的可伸缩层的任意多路技术以这样的方式被执行，即不知道可伸缩性的不可伸缩视频解码器将忽略所有可伸缩层并且仅仅解码所述基层。 
附图说明
在下面的详细描述和附图中公开了本发明的多种实施例。 
附图1是示例了用于可伸缩视频编码的编解码器实施例的模块图。 
附图2是示例了一编解码器的实施例的模块图，该编解码器包含配置成用于解码兼容的可伸缩视频流的基层的不可伸缩视频解码器。 
附图3是示例了一网络网关实施例的模块图，该网关配置成至少部分地基于目的地是否包含可伸缩或不可伸缩的解码器来路由视频数据包。 
具体实施方式
本发明可以以多种方式实现，包括例如处理方法、装置、系统、构成材料、计算机可读媒体(例如计算机可读存储媒体或者通过光纤或电子通信连接传输 程序的计算机网络)。在本说明书中，这些应用或者本发明可以呈现的任何其它形式可以是指技术。例如处理器或存储器的被描述为配置成执行任务的组件包括被临时配置为在一给定的时间执行所述任务的通用组件或者被生产用于执行所述任务的特定组件。通常，所公开的过程的步骤顺序可以在本发明的精神范围内进行改变。 
下面，伴随示例本发明规则的附图，提供了本发明的一个或多个实施例的具体实施方式。本发明联系这样实施例进行描述，并且本发明不限制于任何的实施例。本发明的范围仅仅由权利要求进行限定并且本发明包括多种变动、修改和等同物。下面的描述中阐明了多种特定细节以提供对本发明的完整理解。这些细节被提供作为示例的目的并且不需要一些或所有这些特定细节本发明就可以根据权利要求进行实现。为了清楚的目的，在与本发明相关的技术领域中已知的技术材料没有进行详细的描述，因此本发明没有不清楚。 
附图1是示例了用于可伸缩视频编码的编解码器实施例的模块图。在一些实施例中，在可伸缩视频编码/多路技术方案中，所述基层通过为所述基层指定所有必须的可伸缩性参数(例如，优先权id，依赖id、临时级别id等)的默认值，来与不可伸缩视频编码标准兼容。对于所述基层，可伸缩解码器(如，附图1中的所述基层解码器)被配置为对所述基层使用对于所述可伸缩性参数的所述默认值，来代替被传输的可伸缩性参数，使其不必为基层数据传输可伸缩性参数。通过这种方式，所述基层可以以所有的方式依附于所述不可伸缩标准，并且不必在所述基层数据中传输任何可伸缩参数。所述基层数据可以由不可伸缩解码器直接地使用而不必进行去除、过滤、丢弃、忽略或者如果不被传输的可伸缩性参数数据进行模糊化就不使用。 
附图2是示例一编解码器实施例的模块图，该编解码器包括配置为用于解码兼容的可伸缩视频流的基层的不可伸缩视频解码器。在一些实施例中，不知道可伸缩性的不可伸缩视频解码器能够忽略所有可伸缩层并且通过标识数据包仅仅解码所述基层，所述数据包被称为NAL单元或者在H.264视频编码标准中的NALUs，其不与所述基层关联，其中所述基层具有不可伸缩解码器知道去丢弃的值。在一些实施例中，不可伸缩的H.264解码器，例如附图2中的不可伸缩解码器，被配置为仅仅用于解码具有在不可伸缩的H.264标准中定义的nal_unit_type语法元素值的NALUs以及用于忽略(例如，不进行解码或尝试 进行解码的丢弃)具有在所述不可伸缩的H.264标准中没有定义的nal_unit_type语法元素值的NALUs。 
附图3是示例了一网络网关实施例的模块图，该网关配置成至少部分地基于目的地是否包含可伸缩或不可伸缩的解码器来路由视频数据包。在一些实施例中，网络网关或者其它网络节点，例如附图3中所述的网络网关，被配置为用于路由一些NALUs到一些目的地以及路由其它NALUs到其它目的地。例如，如果一些目的地仅仅包含不可伸缩解码器(例如，那些与附图3中第一边缘路由器关联的)，那么在一些实施例中所述网关或者其它节点仅仅将具有在所述不可伸缩的H.264标准中定义的nal_unit_type语法元素值的NALUs路由给它们。使用这种方法，网络资源和/或带宽不用发送不被这种解码器使用的NALUs到不可伸缩解码器。 
在一些可伸缩视频流中可能具有多于一个的层符合所述不可伸缩标准，并且在这种情况中希望为解码器和/或网关标识这种层。 
这样，在一些实施例中，根据所述不可伸缩层的特定特性对每个不可伸缩层指定不同的默认可伸缩性参数。例如，在H.264中所述默认可伸缩性参数可以依赖于所述不可伸缩层的序列参数集合或图片参数集合。这使得所述可伸缩解码器利用任意的所述不可伸缩层作为它的基层。 
在一些实施例中，在一些或所有所述不可伸缩视频NALUs之前插入特定的NALU。所述特定的NALU指示随后的NALU属于可伸缩层次中的一个层，但是它的编码与所述不可伸缩标准兼容。所述特定NALU还可以包含属于随后兼容的NALU(如，优先权id、依赖id、临时级别id等)的可伸缩性数据。 
不可伸缩视频解码器将忽略所述特定的NALU并且选择一个可用的不可伸缩层来进行解码和显示。例如，所述选择将基于所述不可伸缩层的简档(profile)和级别或图片大小。或者其也可能由包含在，例如，如mp4的文件格式中的一些其它选择机制来实现。网关可以使用在所述特定NALU中的数据来作出路由决定，或者其可以使用相似于上面描述的解码器能够使用的机制。 
在一些实施例中，所述符合不可伸缩标准的视频数据被包含在可伸缩NALUs中，但是是以一种容易被不可伸缩解码器提取使用的形式。例如，在一些实施例中所述可伸缩性数据包含在所述可伸缩NALUs的前面。网关或预处理器去除所述可伸缩性数据，把所述nal_unit_type语法元素值变成不可伸缩值， 并将所述结果发送到一个或多个不可伸缩解码器。 
在一些实施例中，符合所述不可伸缩标准的所述视频数据被包含在具有特定nal_unit_type语法元素值或者其它语法元素值的可伸缩NALUs中，所述语法元素值将所述视频数据标识为以不可伸缩的形式被编码。在不同的实施例中，可伸缩性数据包含在这些NALUs的前面或者包含在所述NALUs中的另一预定位置。网关或预处理器去除所述可伸缩性数据，将所述nal_unit_type语法元素改变为不可伸缩值，并且将所述结果发送给一个或多个不可伸缩解码器。 
在一些可伸缩视频流中可能具有一些层，它们自身不符合所述不可伸缩标准，但是当其与其它层联合时就符合所述标准。为了清楚的目的，我们称这些层为从属不可伸缩层。例如，具有临时可伸缩性的所述基层可以符合所述不可伸缩标准，但是所述从属不可伸缩层它们自身并不符合。然而，当所述从属不可伸缩层与所述基层正确联合时，所述总体结果符合所述不可伸缩标准并且能被不可伸缩解码器解码。 
在一些实施例中，所述从属不可伸缩层被标识，这样它们可以容易地被可伸缩解码器、预处理器和/或网关所识别。在一些实施例中，这通过在所述从属不可伸缩层NALUs之前插入特定的NALU来实现。这些特定的NALUs具有nal_unit_type语法元素值或者标识所述从属不可伸缩层的其它语法元素值。所述从属不可伸缩层NALUs具有符合所述不可伸缩标准的nal_unit_type语法元素值。然后网关可以使用在所述特定NALUs中的数据来作出它的路由决定。它可以仅仅将所述基层发送到一些不可伸缩解码器，所述基层将一些或所有从属不可伸缩层加到其它不可伸缩解码器上，以及将一些或所有层加到可伸缩解码器上。 
在一些实施例中，所述从属不可伸缩层的视频数据被包含在可伸缩的NALUs中，但是是以一种容易被不可伸缩解码器提取使用的形式。例如，在一些实施例中所述可伸缩性数据包含在所述可伸缩NALUs的前面。网关或预处理器去除所述可伸缩性数据，将nal_unit_type语法元素值变为不可伸缩值，并且将所述结果发送到不可伸缩解码器。 
虽然前面所述的实施例为了能清楚地理解的目的描述了一些细节，但是本发明并不限制于所提供的细节。其具有许多可变的方式来实现本发明。所述公开的实施例是示例性的而不是限制性的。 

Claims (21)

1.一种编码视频数据的方法，包括： 
接收视频数据；以及 
以使至少一基层与不可伸缩的视频编码标准兼容的方式编码所述视频数据，包括为至少所述基层指定一个或多个可伸缩性参数的默认值，其中在被编码的视频数据中包含标识数据，所述标识数据标识符合所述不可伸缩视频编码标准的那部分被编码的视频数据。 
2.如权利要求1所述的方法，其中所述一个或多个可伸缩性参数包括以下中的一个或多个：优先权id、依赖id和临时级别id。 
3.如权利要求1所述的方法，其中所述不可伸缩视频编码标准包括H.264视频编码标准。 
4.如权利要求1所述的方法，进一步包括配置可伸缩解码器，以对至少所述基层使用对于所述一个或多个可伸缩性参数的所述默认值，来代替被传输的可伸缩性参数。 
5.如权利要求1所述的方法，其中所述被编码的视频数据包括多于一个的符合所述不可伸缩视频编码标准的层，并且进一步包括至少部分地基于所述不可伸缩层的特征来为每个不可伸缩层指定一个或多个默认可伸缩性参数值的相应集合。 
6.如权利要求5所述的方法，其中所述特征包括以下中的一个或多个：序列参数集合以及图片参数集合。 
7.如权利要求5所述的方法，其中在所述被编码的视频数据中包含标识数据包括：在数据包流中的如下位置包含特定数据包，所述特定数据包将一个或多个随后的数据包标识为与具有与所述不可伸缩视频编码标准兼容的编码的可伸缩层相关联，所述特定数据包的位置在传输顺序上在与具有与所述不可伸缩视频编码标准兼容的编码的所述可伸缩层相关联的一个或多个数据包之前。 
8.如权利要求7所述的方法，其中对于与所述特定数据包相关联的所述一个或多个随后的数据包，所述特定数据包包括一个或多个可伸缩性参数的默认值。 
9.如权利要求7所述的方法，进一步包括配置不可伸缩解码器以忽略所述特定数据包以及选择不可伸缩层进行解码。 
10.如权利要求9所述的方法，其中所述选择至少部分地基于以下中的一个或多个：所述不可伸缩层的简档和级别以及图片大小。 
11.如权利要求7所述的方法，进一步包括配置转发节点以至少部分地基于所述标识数据来作出转发决定。 
12.如权利要求11所述的方法，其中所述转发决定至少部分地基于下游解码器的性能来作出，所述被编码的视频数据或其一部分被转发到所述解码器。 
13.如权利要求11所述的方法，其中所述转发决定包括确定转发所述被编码视频数据的哪些部分。 
14.一种解码视频数据的方法，包括： 
接收以使至少一基层与不可伸缩的视频编码标准兼容的方式被编码的视频数据；以及 
解码所述被编码的视频数据，包括对至少一基层使用一个或多个可伸缩性参数的默认值，其中在所述被编码的视频数据中包含标识数据，所述标识数据标识符合所述不可伸缩视频编码标准的那部分被编码的视频数据。 
15.一种视频编码系统，包括： 
配置为接收视频数据的通信接口；以及 
耦合到所述通信接口的视频编码器，所述视频编码器配置为以使至少一基层与不可伸缩的视频编码标准兼容的方式来编码所述视频数据，包括为至少所述基层指定一个或多个可伸缩性参数的默认值，其中在被编码的视频数据中包 含标识数据，所述标识数据标识符合所述不可伸缩视频编码标准的那部分被编码的视频数据。 
16.如权利要求15所述的系统，其中所述一个或多个可伸缩性参数包括如下中的一个或多个：优先权id、依赖id和临时级别id。 
17.如权利要求15所述的系统，其中所述被编码的视频数据包括多于一个的符合所述不可伸缩视频编码标准的层，并且所述视频编码器进一步配置为至少部分地基于所述不可伸缩层的特征来为每个不可伸缩层指定一个或多个默认可伸缩性参数值的相应集合。 
18.如权利要求17所述的系统，其中所述视频编码器配置为在所述被编码的视频数据中包含标识数据，这是至少部分地通过在数据包流中的如下位置包含特定数据包，所述特定数据包将一个或多个随后的数据包标识为与具有与所述不可伸缩视频编码标准兼容的编码的可伸缩层相关联，所述特定数据包的位置在传输顺序上在与具有与所述不可伸缩视频编码标准兼容的编码的可伸缩层相关联的一个或多个数据包之前。 
19.如权利要求18所述的系统，其中对于与所述特定数据包相关联的所述一个或多个随后的数据包，所述特定数据包包括一个或多个可伸缩参数的默认值。 
20.如权利要求15所述的系统，其中所述视频编码器包括配置为执行用于编码所述视频数据的计算机指令的处理器。 
21.一种视频解码系统，包括： 
配置为接收以使至少一基层与不可伸缩的视频编码标准兼容的方式被编码的视频数据的通信接口；以及 
耦合到所述通信接口的视频解码器，所述解码器配置为解码所述被编码的视频数据，包括为至少一基层使用一个或多个可伸缩性参数的默认值，其中在被编码的视频数据中包含标识数据，所述标识数据标识符合所述不可伸缩视频编码标准的那部分被编码的视频数据。 
CN2007101388226A 2006-03-16 2007-03-16 与不可伸缩解码器兼容的可伸缩视频编码/解码方法、系统 Active CN101127904B (zh)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US78280706P 2006-03-16 2006-03-16
US60/782,807 2006-03-16
US60/785,796 2006-03-23
US78579606P 2006-03-28 2006-03-28
US11/710,183 US8937997B2 (en) 2006-03-16 2007-02-23 Scalable video coding/multiplexing compatible with non-scalable decoders
US11/710,183 2007-02-23

Publications (2)

Publication Number Publication Date
CN101127904A CN101127904A (zh) 2008-02-20
CN101127904B true CN101127904B (zh) 2013-09-11

Family

ID=38110656

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2007101388226A Active CN101127904B (zh) 2006-03-16 2007-03-16 与不可伸缩解码器兼容的可伸缩视频编码/解码方法、系统

Country Status (5)

Country Link
US (2) US8937997B2 (zh)
EP (2) EP2323403A1 (zh)
KR (2) KR101131266B1 (zh)
CN (1) CN101127904B (zh)
WO (1) WO2007109186A2 (zh)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7994946B2 (en) * 2004-06-07 2011-08-09 Agency For Science, Technology And Research Systems and methods for scalably encoding and decoding data
US8937997B2 (en) 2006-03-16 2015-01-20 Apple Inc. Scalable video coding/multiplexing compatible with non-scalable decoders
US7456760B2 (en) * 2006-09-11 2008-11-25 Apple Inc. Complexity-aware encoding
SI3264780T1 (sl) * 2007-04-18 2020-08-31 Dolby International Ab Kodirni sistemi, pri katerih se uporablja dodatni niz sekvenčnih parametrov za skalabilno kodiranje videa ali večpogledno kodiranje
IT1394245B1 (it) * 2008-09-15 2012-06-01 St Microelectronics Pvt Ltd Convertitore per video da tipo non-scalabile a tipo scalabile
US9300969B2 (en) 2009-09-09 2016-03-29 Apple Inc. Video storage
US8976856B2 (en) 2010-09-30 2015-03-10 Apple Inc. Optimized deblocking filters
US20130318251A1 (en) * 2012-05-22 2013-11-28 Alimuddin Mohammad Adaptive multipath content streaming
US9762903B2 (en) * 2012-06-01 2017-09-12 Qualcomm Incorporated External pictures in video coding
JP6361866B2 (ja) * 2013-05-09 2018-07-25 サン パテント トラスト 画像処理方法および画像処理装置

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005055605A1 (en) * 2003-12-03 2005-06-16 Koninklijke Philips Electronics N.V. System and method for improved scalability support in mpeg-2 systems

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4958226A (en) * 1989-09-27 1990-09-18 At&T Bell Laboratories Conditional motion compensated interpolation of digital motion video
US5465119A (en) * 1991-02-22 1995-11-07 Demografx Pixel interlacing apparatus and method
EP1330129A3 (en) * 1991-04-10 2006-03-15 Mitsubishi Denki Kabushiki Kaisha Encoder and Decoder
US5467136A (en) * 1991-05-31 1995-11-14 Kabushiki Kaisha Toshiba Video decoder for determining a motion vector from a scaled vector and a difference vector
US5414469A (en) * 1991-10-31 1995-05-09 International Business Machines Corporation Motion video compression system with multiresolution features
US5408328A (en) * 1992-03-23 1995-04-18 Ricoh Corporation, California Research Center Compressed image virtual editing system
JPH05316360A (ja) * 1992-05-14 1993-11-26 Fuji Xerox Co Ltd 画像信号の符号化復号装置
KR970003102B1 (ko) * 1993-09-17 1997-03-14 대우전자 주식회사 영상 복호기에서의 하프 픽셀 움직임 보상 회로
JP2956464B2 (ja) * 1993-12-29 1999-10-04 日本ビクター株式会社 画像情報圧縮伸長装置
US6005623A (en) * 1994-06-08 1999-12-21 Matsushita Electric Industrial Co., Ltd. Image conversion apparatus for transforming compressed image data of different resolutions wherein side information is scaled
JP3732867B2 (ja) * 1995-03-09 2006-01-11 株式会社ルネサステクノロジ 画像伸張装置
US5619256A (en) * 1995-05-26 1997-04-08 Lucent Technologies Inc. Digital 3D/stereoscopic video compression technique utilizing disparity and motion compensated predictions
US5612735A (en) * 1995-05-26 1997-03-18 Luncent Technologies Inc. Digital 3D/stereoscopic video compression technique utilizing two disparity estimates
US5999189A (en) * 1995-08-04 1999-12-07 Microsoft Corporation Image compression to reduce pixel and texture memory requirements in a real-time image generator
US5786855A (en) * 1995-10-26 1998-07-28 Lucent Technologies Inc. Method and apparatus for coding segmented regions in video sequences for content-based scalability
US6026183A (en) * 1995-10-27 2000-02-15 Texas Instruments Incorporated Content-based video compression
JPH09182083A (ja) * 1995-12-27 1997-07-11 Matsushita Electric Ind Co Ltd ビデオ画像符号化方法及び復号化方法とその装置
US5778097A (en) * 1996-03-07 1998-07-07 Intel Corporation Table-driven bi-directional motion estimation using scratch area and offset valves
JP3263807B2 (ja) * 1996-09-09 2002-03-11 ソニー株式会社 画像符号化装置および画像符号化方法
KR100235347B1 (ko) * 1996-09-19 1999-12-15 전주범 윤곽선 영상신호 부호화 방법 및 장치
US6144701A (en) * 1996-10-11 2000-11-07 Sarnoff Corporation Stereoscopic video coding and decoding apparatus and method
US5978509A (en) * 1996-10-23 1999-11-02 Texas Instruments Incorporated Low power video decoder system with block-based motion compensation
US5886736A (en) * 1996-10-24 1999-03-23 General Instrument Corporation Synchronization of a stereoscopic video sequence
US6173013B1 (en) * 1996-11-08 2001-01-09 Sony Corporation Method and apparatus for encoding enhancement and base layer image signals using a predicted image signal
US6043846A (en) * 1996-11-15 2000-03-28 Matsushita Electric Industrial Co., Ltd. Prediction apparatus and method for improving coding efficiency in scalable video coding
US6148026A (en) * 1997-01-08 2000-11-14 At&T Corp. Mesh node coding to enable object based functionalities within a motion compensated transform video coder
US6005980A (en) * 1997-03-07 1999-12-21 General Instrument Corporation Motion estimation and compensation of video object planes for interlaced digital video
US6404813B1 (en) * 1997-03-27 2002-06-11 At&T Corp. Bidirectionally predicted pictures or video object planes for efficient and flexible video coding
US6057884A (en) * 1997-06-05 2000-05-02 General Instrument Corporation Temporal and spatial scaleable coding for video object planes
US6233356B1 (en) * 1997-07-08 2001-05-15 At&T Corp. Generalized scalability for video coder based on video objects
US6771703B1 (en) * 2000-06-30 2004-08-03 Emc Corporation Efficient scaling of nonscalable MPEG-2 Video
EP1670260A3 (en) 2002-01-23 2010-03-03 Nokia Corporation Grouping of image frames in video coding
US7656950B2 (en) * 2002-05-29 2010-02-02 Diego Garrido Video interpolation coding
CN1679340A (zh) * 2002-05-31 2005-10-05 皇家飞利浦电子股份有限公司 不可伸缩到可伸缩视频转换方法,可伸缩到不可伸缩视频转换方法
ES2672109T3 (es) * 2003-01-30 2018-06-12 Koninklijke Philips N.V. Codificación de vídeo
EP1709815A1 (en) * 2004-01-21 2006-10-11 Koninklijke Philips Electronics N.V. Method of spatial and snr fine granular scalable video encoding and transmission
EP1738588B1 (en) * 2004-04-02 2018-08-15 Thomson Licensing DTV Complexity scalable video decoding
US20050254575A1 (en) * 2004-05-12 2005-11-17 Nokia Corporation Multiple interoperability points for scalable media coding and transmission
US7994946B2 (en) * 2004-06-07 2011-08-09 Agency For Science, Technology And Research Systems and methods for scalably encoding and decoding data
KR101407748B1 (ko) * 2004-10-13 2014-06-17 톰슨 라이센싱 복잡도 스케일러블 비디오 인코딩 및 디코딩을 위한 방법 및 장치
CN101390399B (zh) * 2006-01-11 2010-12-01 诺基亚公司 可伸缩视频编码中的图片的后向兼容聚合
US8937997B2 (en) 2006-03-16 2015-01-20 Apple Inc. Scalable video coding/multiplexing compatible with non-scalable decoders

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005055605A1 (en) * 2003-12-03 2005-06-16 Koninklijke Philips Electronics N.V. System and method for improved scalability support in mpeg-2 systems

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
无.通用视听业务的先进视频编码.《国际电信联盟 H系列：视听及多媒体系统 视听业务的基础设施－活动图像编码》.2005,第56－58页.
无.通用视听业务的先进视频编码.《国际电信联盟 H系列:视听及多媒体系统 视听业务的基础设施-活动图像编码》.2005,第56-58页. *

Also Published As

Publication number Publication date
US20070217503A1 (en) 2007-09-20
KR101131374B1 (ko) 2012-04-04
US8937997B2 (en) 2015-01-20
KR101131266B1 (ko) 2012-03-30
CN101127904A (zh) 2008-02-20
EP1835764A3 (en) 2008-01-02
US10148970B2 (en) 2018-12-04
WO2007109186A2 (en) 2007-09-27
KR20100030639A (ko) 2010-03-18
EP1835764A2 (en) 2007-09-19
KR20070094560A (ko) 2007-09-20
US20150131712A1 (en) 2015-05-14
WO2007109186A3 (en) 2008-04-17
EP2323403A1 (en) 2011-05-18

Similar Documents

Publication Publication Date Title
CN101127904B (zh) 与不可伸缩解码器兼容的可伸缩视频编码/解码方法、系统
KR102127702B1 (ko) 미디어 데이터를 송수신하기 위한 인터페이스 장치 및 방법
CN101390399B (zh) 可伸缩视频编码中的图片的后向兼容聚合
KR101037338B1 (ko) 스케일러블 비디오 코딩 및 디코딩
KR101863410B1 (ko) 멀티미디어 시스템에서 복합 미디어 컨텐츠를 송수신하는 방법 및 장치
Wenger et al. Transport and signaling of SVC in IP networks
CN101518087A (zh) 用于指示媒体文件中轨道关系的系统和方法
CN106982382A (zh) 用于在可分级视频编码中信令并执行时间级切换的系统和方法
KR20080066624A (ko) 네트워크 추상 계층 유닛의 패킷 구성방법, 이를 이용한비디오 부호화 및 복호화 알고리즘 및 장치, 서비스품질제어를 위한ＩＰｖ6 라벨 스위칭 알고리즘 및 장치
CN1906947A (zh) 在网络上传输数字服务的方法和实现该方法的设备
CN104541509A (zh) 兼容三维视频通信
WO2018121584A1 (zh) 一种数据流传输方法、装置、相关设备及存储介质
CN1295689A (zh) 交互通信中客户机－服务器交互方法和系统
ES2346166T3 (es) Procedimiento de transmision de una secuencia de video a un terminal remoto.
JP2004519908A (ja) Ｍｐｅｇ４ビデオデータを符号化する方法及び装置
CA3043053A1 (en) Handling advertisement placement within a decisioned advertisement
WO2014047938A1 (zh) 数字视频码流的解码方法拼接方法和装置
De Neve et al. Using bitstream structure descriptions for the exploitation of multi-layered temporal scalability in H. 264/AVC’s base specification
EP2357820A1 (en) System and method for signaling programs from different Transport Streams
KR20090111253A (ko) 리치미디어 콘텐츠의 장면 구성을 위한 장치 및 방법
CN102594778A (zh) 一种流媒体反馈的实现方法和系统
WO2006047230A3 (en) Method for encoding a multimedia content
KR20090130609A (ko) 인터넷 프로토콜 텔레비전 수신기 및 채널 전환 방법

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant