CN100473157C - 基于运动图像专家组-4的立体视频因特网广播系统和方法 - Google Patents

基于运动图像专家组-4的立体视频因特网广播系统和方法 Download PDF

Info

Publication number
CN100473157C
CN100473157C CNB2004800158630A CN200480015863A CN100473157C CN 100473157 C CN100473157 C CN 100473157C CN B2004800158630 A CNB2004800158630 A CN B2004800158630A CN 200480015863 A CN200480015863 A CN 200480015863A CN 100473157 C CN100473157 C CN 100473157C
Authority
CN
China
Prior art keywords
display mode
right eye
field
even field
coding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2004800158630A
Other languages
English (en)
Other versions
CN1802858A (zh
Inventor
尹国镇
曹叔嬉
安忠铉
李寿寅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics and Telecommunications Research Institute ETRI filed Critical Electronics and Telecommunications Research Institute ETRI
Publication of CN1802858A publication Critical patent/CN1802858A/zh
Application granted granted Critical
Publication of CN100473157C publication Critical patent/CN100473157C/zh
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/162—User input
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/25—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding with scene description coding, e.g. binary format for scenes [BIFS] compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/31—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2181—Source of audio or video content, e.g. local disk arrays comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/23439—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6156—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network
    • H04N21/6175—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/6437—Real-time Transport Protocol [RTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6581—Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format

Abstract

提供了一种系统和方法，用于基于运动图像专家组(MPEG)-4在因特网上向用户广播的立体视频数据。该系统包括：编码服务器，用于接收立体视频数据、音频数据和对象描述符/场景二进制格式(OD/BIFS)数据，并将数据编码为具有MPEG-4结构的基本流(ES)，所述OD/BIFS是用于控制内容的信息；网络服务器，用于从客户端接收二维视频显示模式、场快门视频显示模式和帧快门视频显示模式中的任意一个；以及流服务器，用于通过根据输入网络服务器的显示模式复用ES，生成用于实时数据传输的实时传输协议(RTP)分组，并将该RTP分组传输到客户端。

Description

基于运动图像专家组-4的立体视频因特网广播系统和方法
技术领域
本发明涉及网络(Web)广播系统和方法；并特别涉及用于基于运动图像专家组(MPEG)-4在因特网上向用户广播立体视频的系统和方法。
背景技术
“立体视频”指通过交替地接收和输出左眼数据和右眼数据而产生的运动图像，以便给二维平面以三维的远距离和近距离效果。
随着因特网近来的发展，在教育、文化、现期期刊(current issue)等领域中，多种多样的多媒体数据被提供给因特网用户。只要他们具有被连接到因特网的客户端，因特网用户就可以在任意时间任意地点观看和/或收听他们想要的多媒体数据。
通常，因特网广播系统，其也被称作因特网广播系统，由编码服务器、流服务器和客户端形成，编码服务器用于根据预先确定的编码方法对多媒体数据进行编码，流服务器用于传输多媒体流，而客户端用于解码和输出被传输的多媒体流。
图1是示出典型的因特网广播系统的框图。如图所示，视频数据和音频数据被从例如摄影机的视频/音频输入设备10输入，并在其通过编码服务器20时被压缩。
MPEG是运动图像专家组，为建立对于运动图像编码方法的标准而形成的专家组。MPEG研究基于时间连续变化的运动图像压缩和编码数据的传输。MPEG建议了国际编码标准，并且，当前的因特网广播被根据这些标准执行的。具体来讲，MPEG-1和MPEG-2是用于压缩和存储大量多媒体数据的国际标准。
流服务器30把被编码服务器20编码的多媒体流通过因特网40传输到客户端50。然后，客户端50解码被传输的多媒体流。客户端50应该具有带有必须的编解码器(codec)的播放器以输出多媒体数据。
同时，当使用常规编码方法和目前的以太网广播系统来传输立体视频数据时，可能发生一些问题。因为左眼影像和右眼影像应该被分别编码，以便将立体视频数据通过因特网传输到客户端，所以数据量被增加超过了两倍，并且由于传输流量的负载，使得传输错误的概率变得更高。此外，存在客户端应该区分左眼影像和右眼影像，以便将它们解码并将它们在时间上彼此同步地输出的问题。如果左眼影像和右眼影像没有被交替地输出，则不能获得三维效果，只会导致观众的视觉疲劳。
因此，为了在因特网上广播立体视频数据，除了常规编码方法之外，还需要新的编码方法，以及和该编码方法一致的因特网广播系统和方法。
发明内容
因此，本发明的目的是提供一种系统和方法，用于通过根据运动图像专家组-4(MPEG-4)时域扩缩(temporal scalability，TS)的结构来编码和复用多媒体数据，以便在因特网上广播立体视频数据。
本发明的另一个目的是提供能够在因特网上广播常规的二维视频数据的因特网广播系统和方法。
依照本发明的一个方面，提供了一种用于在因特网上向客户端广播立体视频数据的系统，包括：编码服务器，用于对立体视频数据、音频数据和对象描述符/场景二进制格式(Object Descriptor/Binary Format for Scene，OD/BIFS)进行编码，并将所述数据编码为具有MPEG-4结构的基本流(elementary stream，ES)，OD/BIFS是用于控制内容的信息；网络(web)服务器，用于从客户端接收二维视频显示模式、场快门(field-shuttering)视频显示模式和帧快门(frame-shuttering)视频显示模式中的任意一个；以及流服务器，用于通过根据输入网络服务器的显示模式复用ES，生成用于在因特网上实时数据传输的实时传输协议(real-time transport protocol，RTP)分组，并将该RTP分组传输到客户端。
依照本发明的一个方面，提供了一种方法，用于基于MEPG-4在因特网上向客户端广播立体视频数据，包括步骤：a)接收立体视频数据、音频数据和OD/BIFS数据，并将所述数据编码为具有MPEG-4结构的ES，所述OD/BIFS数据是用于控制内容的信息；b)从客户端接收二维视频显示模式、场快门视频显示模式和帧快门视频显示模式中的任意一个；和c)通过根据输入的显示模式复用ES，生成用于在因特网上实时传输的RTP分组，并将该RTP分组传输到客户端。
附图说明
从下面结合附图给出的对优选实施例的描述，本发明的上述和其他目的以及特征将变得清晰，其中：
图1是示出典型的因特网广播系统的框图；
图2是描述依照本发明的优选实施例的因特网广播系统的框图；
图3是详细地示出图2的编码服务器的框图；
图4是详细地示出图3的编码器的框图；
图5是示出依照本发明的优选实施例的被输入运动图像专家组-4(MPEG-4)结构的每一层的视频数据的图；
图6是详细地示出图3的MPEG-4(MP4)文件生成器的框图；
图7和图8是描述MP4文件的基本流(ES)的排列的图；
图9是详细地示出图2的流服务器的框图；和
图10是描述流服务器中的分组变换处理的图。
具体实施方式
从下面参考附图对实施例的描述，本发明的其他目的和方面将变得清晰，描述在后面给出。在本说明书和权利要求中使用的术语和词汇不应该被理解为常规的含义和字典上的含义，根据发明人可以恰当地定义术语的概念以便最为适当地描述本发明的原理，它们应该被理解为符合本发明的技术概念的概念和含义。因此，本说明书的实施例和附图只不过是优选实施例之一，但是不代表本发明所有的技术概念。在这个方面，存在各种等效物和修改，可以代替在递交的本专利申请的说明书中示出的元素。
图2是绘出依照本发明的优选实施例的因特网广播系统的框图。如图所示，从立体摄像机或例如磁带录像机(VTR)的视频/音频输入设备100获取的多媒体数据(即，立体视频数据和音频数据)或内容控制对象描述符/场景二进制格式(OD/BIFS)数据被输入编码服务器200。然后，编码服务器200根据运动图像专家组-4(MPEG-4)对输入信号进行编码。通过在编码服务器200中对信号编码获得的基本流(ES)被传输到流服务器300。
为了对立体视频编码，本发明使用MPEG-4时域扩缩(TS)。MPEG-4 TS是一种输入的左眼影像数据被分配给基础层(base layer)并且右眼影像数据被分配给增强层(enhancement layer)的结构。被分配给基础层的左眼影像被根据常规的二维视频编码进行编码。被分配给增强层的右眼影像被参考基础层的影像编码，基础层的影像与环境层的影像重叠。
同时，网络服务器400通过反向通道(back channel)接收关于客户端600所请求的显示模式和内容的信息，并将其传输到流服务器300。流服务器300以客户端600所请求的显示模式复用内容的ES，以生成多媒体数据，例如实时传输协议(RTP)分组，并将多媒体数据通过因特网传输到客户端600。客户端600按传输的顺序解码并显示数据。为了输出多媒体数据，客户端600一定应该具有带有必须的编解码器(codec)的播放器。
图3是示出图2的编码服务器的框图。如图所示，编码服务器200包括编码器210、编码参数单元220、用于通过使用编码的ES生成MP4文件的MPEG层4(MP4)文件生成器230，和用于储存MP4文件的储存器240。
编码参数单元220提供用于对输入的立体视频编码的信息。它设置用于编码的参数，例如影像的大小、要被编码的帧数、帧速、运动检索(motionsearch)的大小、传输比特率，和初始量化系数，并将它们输入编码器210。
编码器210根据MPEG-4TS和音频编解码器对输入的立体视频数据和音频数据编码。图4中示出了编码器210的内部模块。
参考图4，编码器210包括视频：用于对立体视频数据编码的视频编码模块212、基本流接口(Elementary Stream Interface，ESI)信息生成模块216、用于对音频数据编码的音频编码模块218，和用于对OD/BIFS数据编码的OD/BIFS编码模块219。
OD/BIFS编码模块219对用于描述音频和场景的场景二进制格式(binaryformat for scene，BIFS)以及用于定义媒体流之间的关系的对象描述符(objectdescriptor，OD)编码。
ESI信息生成模块216生成传输和解码ES所需的额外信息，例如ES的数据长度、空闲标志、访问单元(access unit，AU)的长度，所述额外信息被包括在同步层(synchronization layer，SL)的标头信息中。SL的标头信息稍后将被描述。
视频编码模块212还包括场分离(field separating)模块213、基础层编码模块214，和增强层编码模块215。场分离模块213将立体三维视频数据分离为左眼奇数场、左眼偶数场、右眼奇数场和右眼偶数场。基础层编码模块214对左眼奇数场编码，并且增强层编码模块215对左眼偶数场、右眼奇数场和右眼偶数场编码。
图5是示出依照本发明的优选实施例，示出由场分离模块分离的场被输入MPEG-4结构的每一层的图。如图所示，左眼奇数场被输入基础层；左眼偶数场被输入第一增强层；右眼奇数场被输入第二增强层；而右眼偶数场被输入第三增强层。
图6是示出图3的MP4文件生成器的框图。如图所示，MP4文件生成器230从编码器210接收视频/音频ES、OD/BIFS ES和ESI信息，MP4文件生成器230包括媒体数据提供模块232、元数据提供模块234和MP4文件生成模块236。
媒体数据提供模块232是用于接收视频ES、音频ES和OD/BIFS ES的缓冲器，这些数据被以逐场为基础进行编码。它将ES传输到MP4文件生成模块236。
元数据提供模块234是用于接收从编码器210传输的ESI信息，并将ESI信息作为元数据传输到MP4文件生成模块236的缓冲器。
MP4文件生成模块236将输入的ES和元数据转换为MP4文件格式。这是要生成和储存如下格式的文件：它适于通过接收从编码器输出的ES以及用于该ES的额外信息，与用户所请求的显示模式一致地提取ES来传输。
MP4文件具有两个区(zone)：一个是用于储存文件信息的元数据区，另一个是用于储存ES的mdata原子区(mdata Atom zone)。储存在mdata原子区中的ES被给予适当的ED标识ES_ID，以区别被编码的ES。
图7是示出在用于储存媒体数据的mdata原子中的ES的排列的示例图，根据右和左、奇数和偶数场，ES被给予四个ES_ID。图8是示出通过复用ES的四个场，在mdata原子中的立体视频数据的ES的排列的示例图。ES被以四个场为基础(four-field basis)输入，即左眼奇数场、右眼偶数场、左眼偶数场和右眼奇数场。一个ES_ID被分配给具有相同时间信息的四个场。
通过上述处理生成的MP4文件被储存在储存器240中，并被流服务器300提取。
图9是示出图2的流服务器300的框图。如图所示，流服务器300提取储存在储存器240中的MP4文件，或者接收被编码器210编码的编码ES和ESI信息，生成符合用户的请求的实时传输协议(RTP)分组，并将其传输到客户端600。
为了生成符合用户请求的RTP分组，用户所请求的显示模式应该被输入流服务器300。因此，用户所请求的显示模式应该被从客户端600和网络服务器400输入，然后被传输到流服务器300。
在本发明的因特网广播系统中，视频数据在被划分为左眼奇数场、左眼偶数场、右眼奇数场和右眼偶数场之后被编码。因此，常规的二维视频数据、场快门三维视频数据和帧快门三维视频数据都可以被在该系统中处理。
例如，如果用户想要常规的二维视频显示，则流服务器300传输左眼奇数场和左眼偶数场的流。如果用户想要场快门三维视频显示，则提取并传输左眼奇数场和右眼偶数场的流。同样地，如果用户想要帧快门三维显示，则它传输所有四个场的流。
如果用户对显示模式的请求通过网络服务器400被输入MP4文件分析模块310，则MP4文件分析模块310从储存在储存器240的MP4文件中提取需要的AU流和ESI信息。这里，MP4文件分析模块310能够实时地从编码器210接收AU流和ESI信息。
当MP4文件分析模块310根据用户的请求提取AU流和ESI信息时，SL分组生成模块320生成具有标头和对于所提取的AU流的有效载荷(payload)的SL分组。SL分组的标头是用于每一个分组的同步信息，并且，当发生数据丢失时，它被用来检验完整性。标头包括用于控制时间同步的信息，例如时间标记(time stamp)。SL分组的有效载荷是跟在标头后面的有效信息。有效载荷包括由MP4文件分析模块310提取的AU流。
生成的SL分组被输入FlexMux分组生成模块330FlexMux，并且，FlexMux分组生成模块330通过将定义分组类型的标头添加到SL分组来生成FlexMux分组。分组类型指用于将视频数据与音频数据区分开的信息。
生成的FlexMux分组被输入RTP分组生成模块340。然后，RTP分组生成模块340生成可以被通过因特网实时地传输的RTP分组。
RTP分组是传输层的协议分组，这使得有可能在因特网上实时地传输数据。通过将包括用于实时数据传输的信息的标头添加到FlexMux分组可以生成RTP分组。
图10是描述在流服务器中的分组变换处理的图。在上面生成的RTP分组通过因特网被实时地传输到客户端600，并且，安装在客户端600上的播放器解码RTP分组并显示它。
如果分组是场快门三维视频RTP分组，则播放器可以通过以被传输的顺序输出左眼奇数场流和右眼偶数场流，而不是区别左眼奇数场流和右眼偶数场流并将它们的时间彼此同步和输出它们，产生三维距离效果。简而言之，由于被流服务器300复用的RTP分组是被根据用户所请求的显示模式按需要的场流次序进行分组的，所以客户端600能够输出立体视频数据而无需进行额外的数据处理。
本发明的因特网广播系统和方法通过对立体视频数据有效地编码，可以显著地降低数据量，从而降低了传输错误发生的概率。因此，有可能在因特网上实时地广播立体视频。
此外，根据用户所请求的显示模式，本发明的因特网广播系统不仅可以重现立体视频，也可以重现常规的二维视频。
虽然已经参考某些优选实施例描述了本发明，但是本领域熟练技术人员将清楚，在不偏离如下面的权利要求所定义的本发明的范围的情况下，可以做出各种改变和修改。

Claims (14)

1.一种用于在因特网上广播基于MPEG-4的立体视频数据的系统，包含：
编码服务器，用于将立体视频数据、音频数据和对象描述符/场景二进制格式OD/BIFS编码为具有运动图像专家组MPEG-4结构的基本流ES，所述OD/BIFS是用于控制内容的信息；
网络服务器，从客户端接收二维视频显示模式、场快门三维视频显示模式和帧快门三维视频显示模式中的任意一个；和
流服务器，用于通过根据输入网络服务器的显示模式复用ES，生成用于实时数据传输的实时传输协议RTP分组，并将该RTP分组传输到客户端。
2.如权利要求1所述的系统，其中，所述编码服务器包括：
编码单元，用于将立体视频数据、音频数据和OD/BIFS编码为具有MPEG-4时域扩缩TS结构的ES；
编码参数单元，用于给编码单元提供具有影像大小和要被编码的帧数的编码信息；
MP4文件生成单元，用于通过给ES添加元数据来生成MP4文件；和
储存器，用于储存MP4文件。
3.如权利要求2所述的系统，其中，所述编码单元包括：
OD/BIFS编码模块，用于对OD/BIFS数据编码；
音频编码模块，用于对音频数据编码；
视频编码模块，用于对立体视频数据编码；和
基本流接口ESI信息生成模块，用于生成传输和解码ES所需的额外信息。
4.如权利要求3所述的系统，其中，所述视频编码模块包括：
场分离模块，用于将立体视频数据分离为左眼奇数场、左眼偶数场、右眼奇数场和右眼偶数场；
基础层编码模块，用于对左眼奇数场编码；和
增强编码模块，用于对左眼偶数场、右眼奇数场和右眼偶数场编码。
5.如权利要求4所述的系统，其中，增强编码模块将左眼偶数场分配给第一增强层，将右眼奇数场分配给第二增强层，并且将右眼偶数场分配给第三增强层，并根据MPEG-4TS结构对左眼偶数场、右眼奇数场和右眼偶数场编码。
6.如权利要求4所述的系统，其中，MP4文件生成单元通过给予ES中的具有相同时间信息的一组左眼奇数场、左眼偶数场、右眼奇数场和右眼偶数场一个ES标识ES_ID来生成MP4文件。
7.如权利要求4所述的系统，其中，如果从网络服务器输入的显示模式是二维视频显示模式，则流服务器将左眼奇数场和左眼偶数场的ES传输到客户端；
如果从网络服务器输入的显示模式是场快门三维视频显示模式，则流服务器顺序地复用左眼奇数场和右眼偶数场的ES，并将该ES传输到客户端；并且
如果从网络服务器输入的显示模式是帧快门三维视频显示模式，则流服务器顺序地复用具有左眼奇数场、左眼偶数场、右眼奇数场和右眼偶数场的ES，并将该ES传输到客户端。
8.一种用于基于MPEG-4在因特网上向客户端广播立体视频数据的方法，包含步骤：
a)将立体视频数据、音频数据和对象描述符/场景二进制格式OD/BIFS编码为具有运动图像专家组MPEG-4结构的基本流ES，所述OD/BIFS是用于控制内容的信息；
b)从客户端接收二维视频显示模式、场快门三维视频显示模式和帧快门三维视频显示模式中的任意一个；
c)通过根据输入网络服务器的显示模式复用ES，生成用于实时数据传输的实时传输协议RTP分组，并将该RTP分组传输到客户端。
9.如权利要求8所述的方法，其中，步骤a)包括步骤：
a1)将立体视频数据、音频数据和OD/BIFS编码为具有MPEG-4TS结构的ES；
a2)通过给ES添加元数据来生成MP4文件；和
a3)将MP4文件储存在储存器中。
10.如权利要求9所述的方法，其中，步骤a1)包括步骤：
a1-1)对OD/BIFS数据编码；
a1-2)对音频数据编码；
a1-3)对立体视频数据编码；和
a1-4)生成传输和解码ES所需的额外信息。
11.如权利要求10所述的方法，其中，步骤a1-3)包括步骤：
a1-3a)将立体视频数据分离为左眼奇数场、左眼偶数场、右眼奇数场和右眼偶数场；
a1-3b)对左眼奇数场编码；
a1-3c)对左眼偶数场、右眼奇数场和右眼偶数场编码。
12.如权利要求11所述的方法，其中，在步骤a1-3c)，左眼偶数场被分配给第一增强层；右眼奇数场被分配给第二增强层；而右眼偶数场被分配给第三增强层；并且，左眼偶数场、右眼奇数场和右眼偶数场被根据MPEG-4结构编码。
13.如权利要求11所述的方法，其中，在步骤a1-3c)，通过给予ES中的具有相同时间信息的一组左眼奇数场、左眼偶数场、右眼奇数场和右眼偶数场一个ES_ID来生成MP4文件。
14.如权利要求11所述的方法，其中，在步骤c)，如果从网络服务器输入的显示模式是二维视频显示模式，则流服务器将左眼奇数场和左眼偶数场的ES传输到客户端；如果从网络服务器输入的显示模式是场快门三维视频显示模式，则流服务器顺序地复用左眼奇数场和右眼偶数场的ES，并将该ES传输到客户端；并且，如果从网络服务器输入的显示模式是帧快门三维视频显示模式，则流服务器顺序地复用具有左眼奇数场、左眼偶数场、右眼奇数场和右眼偶数场的ES，并将该ES传输到客户端。
CNB2004800158630A 2003-04-17 2004-04-14 基于运动图像专家组-4的立体视频因特网广播系统和方法 Expired - Fee Related CN100473157C (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020030024292A KR100556826B1 (ko) 2003-04-17 2003-04-17 Ｍｐｅｇ-4 기반의 양안식 3차원 동영상을 서비스하기 위한 인터넷 방송 시스템 및 그 방법
KR1020030024292 2003-04-17

Publications (2)

Publication Number Publication Date
CN1802858A CN1802858A (zh) 2006-07-12
CN100473157C true CN100473157C (zh) 2009-03-25

Family

ID=36811870

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2004800158630A Expired - Fee Related CN100473157C (zh) 2003-04-17 2004-04-14 基于运动图像专家组-4的立体视频因特网广播系统和方法

Country Status (5)

Country Link
US (1) US7782937B2 (zh)
EP (1) EP1616441A1 (zh)
KR (1) KR100556826B1 (zh)
CN (1) CN100473157C (zh)
WO (1) WO2004093459A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104486612A (zh) * 2009-04-27 2015-04-01 Lg电子株式会社 用于广播发射机的3d视频数据处理方法及广播接收机

Families Citing this family (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100739320B1 (ko) * 2000-12-15 2007-07-12 주식회사 케이티 비디오 스트림을 알티피로 전송하기 위한 알티피 송신페이로드 핸들러 장치 및 그 방법
KR100576544B1 (ko) 2003-12-09 2006-05-03 한국전자통신연구원 엠펙-4 객체기술자 정보 및 구조를 이용한 3차원 동영상처리 장치 및 그 방법
CN1331359C (zh) * 2005-06-28 2007-08-08 清华大学 交互式多视点视频系统中视频流的传输方法
KR100686521B1 (ko) * 2005-09-23 2007-02-26 한국정보통신대학교 산학협력단 비디오 및 메타데이터의 통합을 위한 비디오 멀티미디어응용 파일 형식의 인코딩/디코딩 방법 및 시스템
CN101212452B (zh) * 2006-12-31 2012-06-06 中兴通讯股份有限公司 一种基于实时传输协议的多媒体数据传输控制方法
US8274551B2 (en) * 2007-06-11 2012-09-25 Samsung Electronics Co., Ltd. Method and apparatus for generating header information of stereoscopic image data
EP2757788B1 (en) * 2007-06-19 2020-03-11 Electronics and Telecommunications Research Institute Metadata structure for storing and playing stereoscopic data, and method for storing stereoscopic content file using this metadata
KR100950082B1 (ko) * 2007-06-22 2010-03-26 주식회사 넷앤티비 Ｍｐｅｇ-4 ｂｉｆｓ 스트림을 이용한 압축 이미지 전송방법
US8471893B2 (en) * 2007-06-26 2013-06-25 Samsung Electronics Co., Ltd. Method and apparatus for generating stereoscopic image bitstream using block interleaved method
KR101382618B1 (ko) * 2007-08-21 2014-04-10 한국전자통신연구원 콘텐츠 정보 생성 방법 및 콘텐츠 정보를 이용한 콘텐츠처리 장치
US8400497B2 (en) 2007-09-07 2013-03-19 Samsung Electronics Co., Ltd Method and apparatus for generating stereoscopic file
KR101369426B1 (ko) * 2007-09-18 2014-03-04 엘지전자 주식회사 엠피쓰리 파일의 엠펙포 파일로의 변환방법 및 장치 및그를 이용한 엠펙포 멀티미디어 파일 실행방법 및 그 장치
MY162861A (en) * 2007-09-24 2017-07-31 Koninl Philips Electronics Nv Method and system for encoding a video data signal, encoded video data signal, method and system for decoding a video data signal
CN101137060B (zh) * 2007-09-30 2010-06-09 腾讯科技（深圳）有限公司 一种视频传输方法、系统及设备
EP2198625A4 (en) * 2007-10-10 2013-11-06 Korea Electronics Telecomm METADATA STRUCTURE FOR STORING AND REPRODUCING STEREOSCOPIC DATA AND METHOD FOR STORING A STEREOSCOPIC CONTENT FILE USING THESE METADATA
EP2201774A4 (en) * 2007-10-13 2012-02-29 Samsung Electronics Co Ltd APPARATUS AND METHOD FOR GENERATING THREE DIMENSIONAL STEREOSCOPIC IMAGE / VIDEO CONTENT ON TERMINAL FROM LIGHT APPLICATION SCENIC REPRESENTATION
KR100955578B1 (ko) 2007-12-18 2010-04-30 한국전자통신연구원 스테레오스코픽 콘텐츠 장면 재생 방법 및 그 장치
EP2124449A1 (en) 2008-05-19 2009-11-25 THOMSON Licensing Device and method for synchronizing an interactive mark to streaming content
JP5295236B2 (ja) * 2008-06-18 2013-09-18 三菱電機株式会社 三次元映像変換記録装置、三次元映像変換記録方法、記録媒体、三次元映像変換装置、及び三次元映像伝送装置
KR20100002032A (ko) * 2008-06-24 2010-01-06 삼성전자주식회사 영상 생성 방법, 영상 처리 방법, 및 그 장치
US8629898B2 (en) * 2008-09-03 2014-01-14 Sony Corporation Stereoscopic video delivery
CN101911713B (zh) * 2008-09-30 2014-01-08 松下电器产业株式会社 再现装置、集成电路、再现方法、记录方法、记录介质再现系统
KR100972792B1 (ko) * 2008-11-04 2010-07-29 한국전자통신연구원 스테레오스코픽 영상을 동기화하는 장치 및 방법과 이를 이용한 스테레오스코픽 영상 제공 장치 및 방법
US20120069154A1 (en) * 2009-01-20 2012-03-22 Koninklijke Philips Electronics N.V. Transferring of 3d image data
CA2749065C (en) * 2009-01-28 2017-01-17 Lg Electronics Inc. Broadcast receiver and video data processing method thereof
KR101289886B1 (ko) * 2009-02-03 2013-07-24 한국전자통신연구원 디지털 멀티미디어 방송 서비스를 위한 송신 방법, 송신 장치, 수신 방법 및수신 장치
JP5267886B2 (ja) * 2009-04-08 2013-08-21 ソニー株式会社 再生装置、記録媒体、および情報処理方法
WO2010120804A1 (en) * 2009-04-13 2010-10-21 Reald Inc. Encoding, decoding, and distributing enhanced resolution stereoscopic video
US8948247B2 (en) * 2009-04-14 2015-02-03 Futurewei Technologies, Inc. System and method for processing video files
US9036700B2 (en) * 2009-07-15 2015-05-19 Google Technology Holdings LLC Simulcast of stereoviews for 3D TV
US9432723B2 (en) * 2009-08-03 2016-08-30 Google Technology Holdings LLC Method of encoding video content
US8743178B2 (en) * 2010-01-05 2014-06-03 Dolby Laboratories Licensing Corporation Multi-view video format control
CN102118425A (zh) * 2010-01-06 2011-07-06 江国庆 以远程服务器传输三维信息之方法
CN102763421B (zh) * 2010-02-15 2015-08-26 汤姆森许可贸易公司 处理视频内容的装置和方法
US11711592B2 (en) 2010-04-06 2023-07-25 Comcast Cable Communications, Llc Distribution of multiple signals of video content independently over a network
US10448083B2 (en) 2010-04-06 2019-10-15 Comcast Cable Communications, Llc Streaming and rendering of 3-dimensional video
US9271052B2 (en) 2010-05-10 2016-02-23 Comcast Cable Communications, Llc Grid encoded media asset data
JP5527603B2 (ja) * 2010-06-24 2014-06-18 ソニー株式会社 情報処理装置および情報処理方法
WO2013090923A1 (en) 2011-12-17 2013-06-20 Dolby Laboratories Licensing Corporation Multi-layer interlace frame-compatible enhanced resolution video delivery
US20130209063A1 (en) * 2010-08-17 2013-08-15 Lg Electronics Inc. Digital receiver and content processing method in digital receiver
CN102387359A (zh) * 2010-08-31 2012-03-21 中国电信股份有限公司 三维视频传输方法、系统及编解码装置
US8878897B2 (en) * 2010-12-22 2014-11-04 Cyberlink Corp. Systems and methods for sharing conversion data
US9204123B2 (en) 2011-01-14 2015-12-01 Comcast Cable Communications, Llc Video content generation
CA2824708C (en) * 2011-01-14 2018-08-21 Comcast Cable Communications, Llc Video content generation
CN102131111A (zh) * 2011-01-25 2011-07-20 天津大学 一种立体视频传输系统
KR101814798B1 (ko) * 2011-01-26 2018-01-04 삼성전자주식회사 입체영상 처리 장치 및 방법
US9420258B1 (en) * 2011-02-07 2016-08-16 Google Inc. Streaming-time 3D metadata injection
US9462024B2 (en) * 2011-06-08 2016-10-04 Futurewei Technologies, Inc. System and method of media content streaming with a multiplexed representation
CN102227133B (zh) * 2011-06-23 2013-01-09 天津大学 一种立体视频传输方法
MX2013005444A (es) * 2011-07-22 2013-07-29 Panasonic Corp Dispositivo de regeneracion de contenido, metodo de regeneracion de contenido, programa de regeneracion de contenido y programa que proporciona contenido.
US20130050573A1 (en) * 2011-08-25 2013-02-28 Comcast Cable Communications, Llc Transmission of video content
KR101779181B1 (ko) * 2011-11-29 2017-09-18 한국전자통신연구원 3ｄ 디지털방송 수신 장치 및 방법, 그리고 영상 모드 전환 장치 및 방법
US9584793B2 (en) 2012-04-09 2017-02-28 Intel Corporation Signaling three-dimensional video information in communication networks
CN102723104A (zh) * 2012-07-04 2012-10-10 深圳锐取信息技术股份有限公司 基于mp4文件封装格式的多媒体录播系统
US8826332B2 (en) 2012-12-21 2014-09-02 Ustudio, Inc. Media distribution and management platform
WO2016144072A1 (ko) 2015-03-08 2016-09-15 엘지전자(주) 방송 신호 송수신 장치 및 방법

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5619256A (en) * 1995-05-26 1997-04-08 Lucent Technologies Inc. Digital 3D/stereoscopic video compression technique utilizing disparity and motion compensated predictions
WO1997032437A1 (en) * 1996-02-28 1997-09-04 Matsushita Electric Industrial Co., Ltd. High-resolution optical disk for recording stereoscopic video, optical disk reproducing device, and optical disk recording device
US6057884A (en) * 1997-06-05 2000-05-02 General Instrument Corporation Temporal and spatial scaleable coding for video object planes
EP1269761A1 (en) 2000-03-31 2003-01-02 Koninklijke Philips Electronics N.V. Encoding of two correlated sequences of data
KR20020088633A (ko) 2001-05-18 2002-11-29 쓰리알 주식회사 동영상 전송장치 및 부호화 방법
KR100397511B1 (ko) * 2001-11-21 2003-09-13 한국전자통신연구원 양안식/다시점 3차원 동영상 처리 시스템 및 그 방법
JP3794352B2 (ja) * 2002-07-04 2006-07-05 ソニー株式会社 データ分配装置及び方法
JP4154569B2 (ja) * 2002-07-10 2008-09-24 日本電気株式会社 画像圧縮伸長装置
KR100488804B1 (ko) * 2002-10-07 2005-05-12 한국전자통신연구원 Ｍｐｅｇ-4 기반의 양안식 3차원 동영상 데이터 처리시스템 및 그 방법
KR100576544B1 (ko) * 2003-12-09 2006-05-03 한국전자통신연구원 엠펙-4 객체기술자 정보 및 구조를 이용한 3차원 동영상처리 장치 및 그 방법
US8228994B2 (en) * 2005-05-20 2012-07-24 Microsoft Corporation Multi-view video coding based on temporal and view decomposition

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Image and video coding-emerging standards and beyond. Haskell, B.G., Howard, P.G., LeCun, Y.A., Ostermann,J.,Civan, Haffner, P.Circuits and Systems for Video Technology, IEEE Transactions,Vol.8 No.7. 1998
Image and video coding-emerging standards and beyond. Haskell, B.G., Howard, P.G., LeCun, Y.A., Ostermann,J.,Civan, Haffner, P.Circuits and Systems for Video Technology, IEEE Transactions,Vol.8 No.7. 1998 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104486612A (zh) * 2009-04-27 2015-04-01 Lg电子株式会社 用于广播发射机的3d视频数据处理方法及广播接收机

Also Published As

Publication number Publication date
US20060221178A1 (en) 2006-10-05
WO2004093459A1 (en) 2004-10-28
KR20040090523A (ko) 2004-10-26
CN1802858A (zh) 2006-07-12
KR100556826B1 (ko) 2006-03-10
US7782937B2 (en) 2010-08-24
EP1616441A1 (en) 2006-01-18

Similar Documents

Publication Publication Date Title
CN100473157C (zh) 基于运动图像专家组-4的立体视频因特网广播系统和方法
CN100428804C (zh) 3d立体/多视图视频处理系统及其方法
US8665968B2 (en) Method and system for 3D video coding using SVC spatial scalability
JP5551315B2 (ja) ビデオデータをストリーミングするためのサブトラックフラグメントの配列
KR100488804B1 (ko) Ｍｐｅｇ-4 기반의 양안식 3차원 동영상 데이터 처리시스템 및 그 방법
US9014276B2 (en) Method and system for 3D video coding using SVC temporal and spatial scalabilities
CN1204757C (zh) 一种立体视频流编码/解码器及其立体视频编解码系统
KR20190009290A (ko) 이미지에서의 가장 관심있는 영역
CN101690200B (zh) 用于在数字多媒体广播系统中提供高质量多媒体服务的方法和设备
KR20100119228A (ko) 스테레오스코픽 영상의 효율적 전송 장치 및 방법
KR100703715B1 (ko) 다시점 3차원 동영상 송수신 시스템
JP2005533433A (ja) ２次元および３次元立体ビデオ信号の適応変換装置およびその方法
CN1246997A (zh) 在恒定大小的传送分组中封装数据的方法
KR100924170B1 (ko) 전송 효율을 높이기 위한 다시점 파노라믹 콘텐츠 송/수신시스템 및 그 방법
KR20080065766A (ko) 다시점 화상 및 3차원 오디오 송수신 장치 및 이를 이용한송수신 방법
KR101233161B1 (ko) 3차원 동영상을 다중화 방송 서비스로 송수신하는 시스템및 방법
KR20050038054A (ko) 3차원 다시점 멀티미디어 처리용 적응형 다중화/역다중화장치 및 그 방법
KR100913397B1 (ko) Ｄｍｂ기반의 3차원 입체영상 서비스를 위한 객체 기술방법과, 그에 따른 3차원 입체영상 서비스 수신 및 영상포맷 변환 방법
CN108702533A (zh) 发送装置、发送方法、接收装置和接收方法
EP2158767A1 (en) Method for describing and multiplexing objects for 3d still image service based on dmb, and apparatus and decoding apparatus and method thereof
US20040223547A1 (en) System and method for MPEG-4 random access broadcast capability
KR20170093637A (ko) 이종 네트워크 환경에서 미디어 전송 스트림 버퍼링 방법 및 이를 이용한 영상 수신 장치

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090325

Termination date: 20120414