WO2006016735A1 - 3-dimensional digital multimedia broadcasting system - Google Patents

3-dimensional digital multimedia broadcasting system Download PDF

Info

Publication number
WO2006016735A1
WO2006016735A1 PCT/KR2004/003540 KR2004003540W WO2006016735A1 WO 2006016735 A1 WO2006016735 A1 WO 2006016735A1 KR 2004003540 W KR2004003540 W KR 2004003540W WO 2006016735 A1 WO2006016735 A1 WO 2006016735A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
audio
encoding
signal
decoding
Prior art date
Application number
PCT/KR2004/003540
Other languages
French (fr)
Inventor
Kug-Jin Yun
Suk-Hee Cho
Jeong-Il Seo
Gi-Yoon Park
Gi-Mun Um
Eun-Young Chang
Kyeongok Kang
Chung-Hyun Ahn
Soo-In Lee
Original Assignee
Electronics And Telecommunications Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics And Telecommunications Research Institute filed Critical Electronics And Telecommunications Research Institute
Priority to EP04808668A priority Critical patent/EP1776832A4/en
Priority to CN2004800437751A priority patent/CN1998233B/en
Publication of WO2006016735A1 publication Critical patent/WO2006016735A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8451—Structuring of content, e.g. decomposing content into time segments using Advanced Video Coding [AVC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/44—Arrangements characterised by circuits or components specially adapted for broadcast
    • H04H20/46—Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/65—Arrangements characterised by transmission systems for broadcast
    • H04H20/71—Wireless systems
    • H04H20/72—Wireless systems of terrestrial networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/86—Arrangements characterised by the broadcast information itself
    • H04H20/88—Stereophonic broadcast systems
    • H04H20/89—Stereophonic broadcast systems using three or more audio channels, e.g. triphonic or quadraphonic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H40/00—Arrangements specially adapted for receiving broadcast information
    • H04H40/18—Arrangements characterised by circuits or components specially adapted for receiving
    • H04H40/27—Arrangements characterised by circuits or components specially adapted for receiving specially adapted for broadcast systems covered by groups H04H20/53 - H04H20/95
    • H04H40/36—Arrangements characterised by circuits or components specially adapted for receiving specially adapted for broadcast systems covered by groups H04H20/53 - H04H20/95 specially adapted for stereophonic broadcast receiving
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/167—Synchronising or controlling image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/25—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding with scene description coding, e.g. binary format for scenes [BIFS] compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/28—Arrangements for simultaneous broadcast of plural pieces of information

Definitions

  • the present invention relates to a 3-dimensional Digital Multimedia Broadcasting (3D DMB) system; and more particularly, to 3D DMB transmitting and receiving systems for transmitting a 3D Audio/Video (AV) by encoding the 3D AV and providing a service to a user by decoding the received signal into the 3D AV to provide a more realistic stereophonic broadcasting to a user while maintaining compatibility with a conventional DMB system.
  • 3D DMB 3-dimensional Digital Multimedia Broadcasting
  • AV 3D Audio/Video
  • a field of communication among people has been remarkably changed due to development of a computer and a communication technology, and a two-way service, is actively used instead of a conventional one-way service by connecting diverse data of diverse multimedia to mobile technology such as a Digital Multimedia Broadcasting (DMB) .
  • DMB Digital Multimedia Broadcasting
  • the DMB system is a broadcasting system for providing diverse multimedia services such as a video, an audio and data to a mobile user anytime and anywhere, and a service of the DMB system has been prepared in Korea for the first time in the world.
  • the DMB system which is a transmission system, utilizes a Digital Audio Broadcasting (DAB) as a transmission system, uses MPEG-4 as a media process method, and uses MPEG-4 and MPEG-2 system as a specification for multiplexing, synchronizing and transmitting media data.
  • DMB Digital Audio Broadcasting
  • MPEG-4 as a media process method
  • MPEG-4 and MPEG-2 system as a specification for multiplexing, synchronizing and transmitting media data.
  • a user can be provided a high-quality audio and video service of a CD level by using the DMB system.
  • the user demand for a stereophonic sound in digital broadcasting is increasing due to rapid propagation of a multi-channel sound audio and development of a 3D audio acquisition and restoring technology.
  • the 3D AV is used in diverse application fields such as sports relay, advertisement, education, medical service and game due to increasing interest and request with respect to the 3D AV, but a DMB service has a ⁇ problem that the sense of real and 3D effect is very low since the DMB service is provided with a focus on 2D AV.
  • an object of the present invention to provide a three dimensional (3D) digital multimedia broadcasting system (DMB) for providing a 3D Audio/Video (AV) service, which maintains comparability with a conventional DMB system and provides a more realistic 3D AV service to a user, by processing a binocular 3D moving picture and 3D sound by using a conventional system structure.
  • DMB digital multimedia broadcasting system
  • AV Audio/Video
  • a 3-dimensional digital multimedia broadcasting (3D DMB) transmitting system including: a video encoder for receiving and encoding a video signal of a binocular 3D image; an audio encoder for receiving and encoding an audio signal of a 3D sound; a packetizer for packetizing the encoded video and audio signals as a sync layer (SL) packet; and a multiplexer for transforming and multiplexing the SL packet, which is packetized by the packetizer and outputting the multiplexed SL packet.
  • 3D DMB 3-dimensional digital multimedia broadcasting
  • a three dimensional digital multimedia broadcasting (3D DMB) receiving system including: a demultiplexer for outputting an SL packet by demultiplexing a stream including binocular 3D image information and 3D sound information; a depacketizer for depacketizing the SL packet and outputting an encoding streams of a binocular 3D video signal and a 3D sound audio signal; a video decoder for decoding an encoding stream with respect to the binocular 3D video signal; an audio decoder for decoding a encoding stream with respect to the 3D sound audio signal; and a scene restorer for forming and outputting a 2D audio/video (AV) or 3D AV scene by using a video/3D additional video signal and an audio/3D additional audio signal which are inputted from the video decoder and the audio decoder.
  • 3D DMB three dimensional digital multimedia broadcasting
  • Fig. 1 is a block diagram showing a three-dimensional digital multimedia broadcasting (3D DMB) transmitting system in accordance with an embodiment of the present invention
  • Fig. 2 is a block diagram illustrating a video encoding module of Fig. 1;
  • Fig. 3 is a block diagram illustrating a 3D additional video encoding module of Fig. 1;
  • Fig. 4 is a block diagram illustrating an audio encoding module of Fig. 1;
  • Fig. 5 is a 3D additional audio encoding module of Fig.
  • Fig. 6 is a block diagram illustrating an additional audio pre-processor of Fig. 5;
  • Fig. 7 is a block diagram illustrating a system encoding module of Fig. 1;
  • Fig. 8 is a block diagram showing a data structure of an object descriptor (OD) in accordance with an embodiment of the present invention
  • Fig. 9 is a block diagram illustrating an M4 over M2 module of Fig. 1;
  • Fig. 10 is a block diagram showing a 3D digital multimedia broadcasting receiving system in accordance with an embodiment of the present invention
  • Fig. 11 is a block diagram illustrating an M2 over M4 module of Fig. 10;
  • Fig. 12 is a block diagram illustrating a system analyzing module of Fig. 10;
  • Fig. 13 is a block diagram illustrating a 3D video decoding module of Fig. 10;
  • Fig. 14 is a block diagram of a 3D audio decoding module of Fig. 10;
  • Fig. 15 is a block diagram illustrating a 3D audio post-processor of Fig. 14.
  • Fig. 16 is a block diagram illustrating a scene generating module of Fig. 10.
  • Fig. 1 is a block diagram showing a three-dimensional digital multimedia broadcasting (3D DMB) transmitting system in accordance with an embodiment of the present invention.
  • the 3D digital multimedia broadcasting transmitting system of the present invention is a system for receiving an Audio/video (AV) data, i.e., a video signal and an audio signal, and 3D additional AV data, i.e., a 3D additional video signal and a 3D additional audio signal, encoding the AV data and the 3D additional AV data based on MPEG-4, and outputting multiplexed MPEG-2 Transport Stream (TS) .
  • AV Audio/video
  • 3D additional AV data i.e., a 3D additional video signal and a 3D additional audio signal
  • TS MPEG-2 Transport Stream
  • the 3D digital multimedia broadcasting transmitting system includes a video encoding module 110, a 3D additional video encoding module 130, an audio encoding module 120, a 3D additional audio encoding module 140, a system encoding module 150 and an M4 over M2 module 160.
  • the video encoding module 110 is a module for encoding one of a left image and a right image of a binocular 3D moving picture as an MPEG-4 part 10 Advanced Video Coding (AVC) baseline profile specification.
  • the audio encoding module 120 is a module for encoding an audio signal transmitted from an outside as an MPEG-4 Bit Sliced Arithmetic Coding (BSAC) specification.
  • BSAC MPEG-4 Bit Sliced Arithmetic Coding
  • the 3D additional audio encoding module 140 is a module for encoding the 3D additional audio signal inputted from the outside as the MPEG-4 Bit BSAC specification.
  • the system encoding module 150 generates, encodes MPEG-4 Initial Object Descriptor (IOD) /OD/Binary Format for Scene (BIFS) data and packetizes an object descriptor (OD) / Binary Format for scenes (BIFS) stream generated by using Elementary Stream (ES) outputted from the 4 decoding modules 110 to 140 and the data received from the outside into a sync layer (SL) packet.
  • IOD Initial Object Descriptor
  • BIFS Binary Format for scenes
  • ES Elementary Stream
  • the M4 over M2 module 160 receives SL packet data, packetizes the SL packet data into MPEG-2 TSs, multiplexes the packetized MPEG-2 TSs into one MPEG-2 TS and outputs the MPEG-2 TS.
  • Fig. 2 is a block diagram illustrating a video encoding module of Fig. 1.
  • the video encoding module 110 includes a video pre-processor 111 and a video encoder 113.
  • the video pre-processor 111 receives a left or right video signal with respect to a binocular 3D moving picture from an outside and transforms a size of the image into a size of Quater Video Graphic Array (QVGA) 320X240 or Common Intermediate Format (CIF) 352X288.
  • the video encoder 113 outputs a video Elementary Stream (ES) , which is obtained by encoding a video signal, a size of which is transformed in the additional video pre-processor 111 and the MPEG-4 part 10 Advanced Video Coding (AVC) baseline profile specification and an encoding parameter, which is a bit rate.
  • the video encoding module 110 can receive and process a general 2D moving picture video signal.
  • Fig. 3 is a block diagram illustrating a 3D additional video encoding module of Fig. 1.
  • the 3D additional video encoding module 130 includes an additional video pre-processor 131 and an additional video encoder 133.
  • the additional video pre-processor 131 receives a right or left video signal with respect to a binocular 3D moving picture from an outside and transforms a size of the image into a size of 160X240/320X120 or 176X288/352X144, which is reduced as large as a half of the QVGA/CIF size in height or width.
  • the additional video encoder 133 outputs a 3D additional video ES, which is encoding a video signal transformed in the additional video pre-processor 131 into the MPEG-4 part 10 AVC baseline profile specification and an encoding parameter, which is a bit rate.
  • Fig. 4 is a block diagram illustrating an audio encoding module of Fig. 1.
  • the audio encoding module 120 includes an audio pre-processor 121 and an audio encoder 123.
  • the audio pre-processor 121 transforms resolution and a sampling frequency of an audio signal received from the outside to meet an MPEG-4 BSAC specification.
  • the audio encoder 123 receives an audio signal transformed in the audio pre-processor 121 and a 2 channel downmix audio signal generated in the 3D additional audio encoding module 140, and also generates an audio ES, which is encoded into an MPEG-4 BSAC specification based on an encoding parameter, which is a bit rate.
  • Fig. 5 is a 3D additional audio encoding module of Fig. 1 in accordance with an embodiment of the present invention.
  • the 3D additional audio encoding module 140 includes an additional audio pre-processor 141 and an additional audio encoder 143.
  • the additional audio pre-processor 141 generates and outputs a 2 channel downmix signal and 3 channel 3D additional audio signal by using a 3D additional audio signal received from the outside, wherein the 2 channel downmix signal is outputted to the audio encoder 123 of the MPEG-4 audio encoding module 120.
  • the additional audio encoder 143 outputs a 3D additional audio ES by encoding the 3 channel 3D additional audio signal into an MPEG-4 BSAC specification.
  • the 3D additional audio signal can be diverse multi-channel stereophonic signal such as a 5 channel stereophonic signal, which includes a forward left speaker signal L, a forward right speaker signal R, a forward central speaker signal C, a backward left speaker signal LS and a backward right speaker signal RS, or 5.1 channel stereophonic signal, in which Sub-Woofer signal SW is added to the 5 signals.
  • Fig. 6 is a block diagram illustrating an additional audio pre-processor of Fig. 5.
  • the additional audio pre ⁇ processing block 141 includes a pre-processor 145 and a channel-mixer 147.
  • the pre-processor 145 receives a 3D additional audio signal, which is diverse channel stereophonic signals, from the outside, processes a signal characteristic such as a sampling frequency and a number of quantization bit, and generates 5 channel stereophonic signal in which low-pass filtering is performed.
  • the channel-mixer 147 generates a 2 channel downmix signals LO and RO, and 3 channel additional audio signals T, Ql and Q2 by using a mixing method defined by an ITU-R BS.775-1 specification from the 5 channel stereophonic signal.
  • the 2 channel downmix signals LO and RO are left/right audio signals used when a stereo is played
  • the 3 channel additional audio signal T, Ql and Q2 are signals for reorganizing an original signal.
  • the pre-processor 145 can output the inputted signal without any special process.
  • Fig. 7 is a block diagram illustrating a system encoding module of Fig. 1.
  • the system encoding module 150 includes an SL packetizer 151, an OD/BIFS generator 153 and Initial Object Descriptor (IOD) generator 155.
  • IOD Initial Object Descriptor
  • the OD/BIFS generator 153 generates and outputs an OD/BIFS ES by using an OD/BIFS text data received from the outside.
  • a 3D AV is expressed by individually using one OD with respect to a video/3D additional video and an audio/3D additional audio.
  • the SL packetizer 151 receives a video ES, an audio ES, a 3D additional video ES, a 3D additional audio ES and the OD/BIFS ES from the above-mentioned 4 encoding modules, and outputs them by packetizing each of them as an SL packet according to a Korean mobile multimedia broadcasting specification.
  • the IOD generator 155 generates and outputs an IOD ES by using the IOD text data transmitted from the outside.
  • Fig. 8 is a block diagram showing a data structure of an object descriptor (OD) in accordance with an embodiment of the present invention.
  • two ES_Descriptors for left or right video and a 3D additional video of a right or left video are subordinately included in one OD to express a 3D AV while maintaining comparability with an OD/BIFS structure of a conventional DMB system.
  • two ES_Descriptors for one OD lower audio and a 3D additional audio have a subordinate relationship.
  • the subordinate relationship can be expressed by using Stream DependenceFlag of MPEG-4 OD, and depends0n_ES_ID.
  • ObjectTypelndication of a 3D additional video ES is set as User private, and stream type is set as Visual to provide a service of a 3D AV while maintaining comparability with a conventional DMB system.
  • ObjectTypelndication of a 3D additional audio ES is set as User private and stream type is set as Audio.
  • Other video and audio ES are set according to a conventional DMB system specification.
  • Fig. 9 is a block diagram illustrating an M4 over M2 module of Fig. 1.
  • the M4 over M2 module 160 includes a Packetized Elementary Stream (PES) Packetizer 161, a PES to TS Packetizer 162, a multiplexer 163, a switch 164, a 14496 section packetizer 165, a PSI generator 166, a Program Specific Information PSI section to TS Packetizer 167 and a 14496 section to TS Packetizer 168.
  • PES Packetized Elementary Stream
  • the switch 164 receives an OD/BIFS SL packet from the system encoding module 150 and outputs the OD/BIFS SL packet as the PES Packetizer 161 or the 14496 section packetizer 165 according to encoding information of an SL packet.
  • the video SL packet, the Audio SL packet, the 3D additional video SL packet, the 3D additional audio SL packet received from the system encoding module 150, and the OD/BIFS SL packet inputted from the switch 164 are individuallly packetized as PES and outputted to the PES to TS Packetizer 162 by the PES packetizer 161.
  • the OD/BIFS SL packet inputted from the switch 164 is packetized into a 14496 section and outputted to the 14496 section to TS Packetizer 168 by the 14496 section packetizer 165.
  • the PSI generator 166 generates PSI including Program Association Table (PMT) section (PA_section) and Program Map Table (PMT) section (PM_section) by using the IOD information received from the system encoding module 150 and outputs the PSI to the PSI section to TS Packetizer 167.
  • the inputted PES packet is packetized into MPEG-2 TS and outputted to the multiplexer 163 by the PES to TS Packetizer 162.
  • the inputted 14496 seciton is packetized into MPEG-2 TS and outputted to the multiplexer 163 by the 14496 section to TS Packetizer 168.
  • the PSI information is inputted and packetized into MPEG-2 TS and outputted to the multiplexer 163 by the PSI section to TS Packetizer 167.
  • Fig. 10 is a block diagram showing a 3D digital multimedia broadcasting receiving system in accordance with an embodiment of the present invention.
  • the 3D digital multimedia broadcasting receiving system of the present invention is a system for demultiplexing and decoding the multiplexed MPEG-2 TS, which is inputted from the outside, and displaying a 2D AV or a 3D AV to a user.
  • the 3D digital multimedia broadcasting receiving system includes an M2 over M4 module 210, a system analyzing module 220, a 3D video decoding module 230, a 3D audio decoding module 240 and a scene generating module 250.
  • the M2 over M4 module 210 outputs the video SL packet, the audio SL packet, the 3D additional video SL packet, the 3D additional audio SL packet, the OD/BIFS SL packet and the IOD data by demultiplexing and depacketizing the multiplexed MPEG-2 TS, which is inputted from an outside.
  • the system analyzing module 220 depacketizes the received SL packet including the video SL packet, the Audio
  • the SL packet, the 3D additional video SL packet, the 3D additional audio SL packet and the OD/BIFS SL packet outputs the SL packet as an encoding stream including a video ES, an audio ES, a 3D additional video ES and a 3D additional audio ES and outputs the IOD data and the
  • the 3D video decoding module 230 outputs a video ES and a 3D additional video encoding ES as a 2D video scene or a 3D video scene by decoding the video ES and the 3D additional video encoding ES.
  • the 3D audio decoding module 240 outputs a 3D audio signal as a 2D or 3D audio signal by decoding an audio ES and a 3D additional audio ES.
  • the scene generating module 250 forms and outputs a scene according to a definition of the BIFS by using the
  • Fig. 11 is a block diagram illustrating an M2 over M4 module of Fig. 10.
  • the M2 over M4 module 210 includes a De_Multiplexer 211, a TS to PES de-packetizer
  • the De_Multiplexer 211 individually demultiplexes the multiplexed MPEG-2 TS, which is inputted from the outside, and outputs the demultiplexed MPEG-2 TS as a single MPEG-2 TS with respect to a video ES, an audio ES, a 3D additional video ES, a 3D additional audio ES, OD/BIFS, a 14496 section and PSI.
  • the TS to PES de-packetizer 212 receives an MPEG-2 TS of a video, an audio, a 3D additional video, a 3D additional audio and OD/BIFS from the De_Multiplexer 211, and outputs the MPEG-2 TS as a PES de-packetizer 215 by depacketizing the MPEG-2 TS into a PES packet.
  • the TS to 14496 section de-packetizer 213 receives an MPEG-2 TS of the 14496 section and outputs the MPEG-2 TS to the 14496 section analyzer 216 by depacketizing the MPEG-2 TS into the 14496 section.
  • the TS to PSI section de-packetizer 214 receives an
  • the MPEG-2 TS of the PSI and outputs the MPEG-2 TS to the PSI section analyzer 217 by depacketizing the MPEG-2 TS into the PMP-section.
  • the PES de-packetizer 215 receives each PES packet with respect to a video, an audio, a 3D additional video ES, a 3D additional audio and OD/BIFS from the TS to PES de- packetizer 212 and outputs a video SL packet, an audio SL packet, a 3D additional video SL packet, a 3D additional audio SL packet and an OD/BIFS SL packet by depacketizing the PES packets into an SL packet.
  • the 14496 section analyzer 216 receives a 14496 section from the TS to 14496 section de-packetizer 213 and outputs the OD/BIFS SL packet by extracting the OD/BIFS SL packet.
  • the PSI section analyzer 217 receives a PAT section and a PMT section and outputs IOD data by extracting the IOD data.
  • Fig. 12 is a block diagram illustrating a system analyzing module of Fig. 10.
  • the system analyzing module 220 includes a SL de-packetizer 221, an OD/BIFS decoder 222 and a IOD decoder 223.
  • the SL de-packetizer 221 receives a video SL packet, an audio SL packet, a 3D additional video SL packet, a 3D additional audio SL packet and an OD/BIFS SL packet from the M2 over M4 module 210, depacketizes each of them into Encoding Stream and outputs the video ES and outputs the 3D additional video ES to the 3D video decoding module 230, the audio ES and 3D additional audio ES to the 3D audio decoding module 240, and the OD/BIFS data to the OD/BIFS decoder 222.
  • the the OD/BIFS decoder 222 decodes the OD/BIFS encoding data transmitted from the SL de-packetizer 221 and outputs the decoded BIFS information to the scene generating module 250, wherein the decoded OD information is used to initialize each media decoder.
  • the IOD decoder 223 outputs the IOD encoding data by receiving and decoding the IOD encoding data, and the decoded IOD data is used to extract OD/BIFS data.
  • Fig. 13 is a block diagram illustrating a 3D video decoding module of Fig. 10.
  • the 3D video decoding module 230 includes a video decoder 231, an additional video decoder 233 and a 3D video post-processor 235.
  • the video decoder 231 receives a video ES of MPEG-4 part 10 AVC specification of 320X240/352X288 image size from the SL de-packetizer 221 of the system analyzing module 220 and outputs the video ES to the 3D video post- processor 235 by decoding the video ES.
  • the additional video decoder 233 receives a 3D additional video ES of MPEG-4 part 10 AVC specification of 160X240/320X120 or 176X288/352X144 image size from the SL de-packetizer 221 of the system analyzing module 220 and outputs the 3D additional video ES to the 3D video post ⁇ processor 235 by decoding the 3D additional video ES.
  • the 3D video post-processor 235 individually receives a decoded video signal and a 3D additional video signal form the video decoder 231 and the additional video decoder 233, and outputs the video signal and the 3D additional video signal as a 3D video signal of QUGA 320X240 or CIF 352X288 by synthesizing the signals according to a field when the video restoring mode information inputted from a user is a 3D video restoring mode, or outputs only a 2D video signal of 320X240 or 352X288 image size with ignoring the received 3D additional video signal when the video restoring mode information is a 2D video restoring mode.
  • a user can enjoy 3D AV by selecting a desirable displaying method through this.
  • Fig. 14 is a block diagram of a 3D audio decoding module of Fig. 10.
  • the 3D audio decoding module 240 includes an audio decoder 241, an additional audio decoder 243 and a 3D audio post-processor 245.
  • the audio decoder 241 receives an audio ES of an MPEG- 4 BSAC specification from the SL de-packetizer 221 of the system analyzing module 220 and outputs the audio ES to the 3D audio post-processor 245 by decoding the audio ES.
  • the additional audio decoder 243 receives a 3D additional audio ES of an MPEG-4 BSAC specification from the SL de-packetizer 221 of the system analyzing module 220 and outputs the 3D additional audio ES to the 3D audio post-processor 245 by decoding the 3D additional audio ES.
  • the 3D audio post-processor 245 receives a decoded audio signal and a 3D additional audio signal from the audio decoder 241 and the additional audio decoder 243, generates and outputs a 2D or 3D audio signal by using audio restoring information inputted from a user.
  • Fig. 15 is a block diagram illustrating a 3D audio post-processor of Fig. 14.
  • the 3D audio post-processor 245 includes a 2D/3D switch 246, a de-matrixer 247 and a virtual 3D combiner 248.
  • the 2D/3D switch 246 outputs 5 channel 3D audio signals LO, RO, T, Ql and Q2 by synthesizing the decoded audio signal and the 3D additional audio signal when the audio restoring mode information received from a user is a
  • the de-matrixer 247 receives an audio signal and a 3D audio signal, and outputs a 5 channel audio signals L, R, C, LS and RS by using ITU-R BS.775-1 specification.
  • the Virtual 3D Synthesizer 248 receives and outputs the 5 channel audio signals by transforming the 5 channel audio signals into a 3D audio signal, which is formed of 2 channel virtual sound signals L and R.
  • Fig. 16 is a block diagram illustrating a scene generating module of Fig. 10. As shown in Fig. 16, the scene generating module 250 includes a scene forming unit 251 and a renderer 253.
  • the scene forming unit 251 receives AV data such as a 2D/3D video signal and a 2D/3D audio signal from the 3D video decoding module 230 and the 3D audio decoding module 240, and outputs an AV scene such as a 2D/3D video scene and a 2D/3D audio composing a scene according to BIFS data, which are received from the OD/BIFS decoder 222 of the system analyzing module 220, to the renderer 253.
  • the renderer 253 receives and outputs an AV scene such as a 2D/3D video scene and a 2D/3D audio from the scene forming unit 251 be rendering the AV scene.
  • the present invention can be embodied as a program and stored in a computer-readable recording medium, such as CD-ROM, RAM, ROM, a floppy disk, a hard disk and a magneto-optical disk. Since the process can be easily implemented by those skilled in the art, further description will not be provided herein.
  • the present invention can provide a two dimensional audio/video (2D AV) or a more realistic three dimensional (3D) AV service to a user while maintaining comparability with a conventional digital multimedia broadcasting (DMB) system.
  • 2D AV two dimensional audio/video
  • 3D three dimensional
  • the present invention has an additional effect that the present invention can economically realize a system for providing a 3D AV service by using the conventional DMB system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Provide is a 3-dimensional Digital Multimedia Broadcasting (3D DMB) system. The present invention can provide a 3D DMB system providing a more realistic 3D Audio/Video (AV) service to a user, while maintaining comparability with a conventional DMB system, by processing a binocular 3D image and 3D sound based on a conventional system structure. The 3D DMB system includes: a video encoder for receiving and encoding a video signal of a binocular 3D image; an audio encoder for receiving and encoding an audio signal of a 3D sound; a packetizor for packetizing the encoded video and audio signals into an Sync Layer (SL) packet; and a multiplexer for transforming and multiplexing the SL packet packetized by the packetizer. A 3D DMB receiving system includes: a demultiplexer for demultiplexing a stream including binocular 3D image information and 3D sound information; a depacketizer for depacketizing the SL packet and outputting a decoding stream of an 3D video signal and a 3D sound audio signal; a video decoder for decoding a encoding stream for a video signal of the binocular 3D image; an audio decoder for decoding a encoding stream for the 3D sound audio signal; and a scene restorer for forming and outputting a 2D AV or 3D AV scene by using a video/3D additional video and an audio/3D additional audio signal which are received from the video decoder and the audio decoder.

Description

3-DIMENSIONAL DIGITAL MULTIMEDIA BROADCASTING SYSTEM
Description Technical Field
The present invention relates to a 3-dimensional Digital Multimedia Broadcasting (3D DMB) system; and more particularly, to 3D DMB transmitting and receiving systems for transmitting a 3D Audio/Video (AV) by encoding the 3D AV and providing a service to a user by decoding the received signal into the 3D AV to provide a more realistic stereophonic broadcasting to a user while maintaining compatibility with a conventional DMB system.
Background Art •
A field of communication among people has been remarkably changed due to development of a computer and a communication technology, and a two-way service, is actively used instead of a conventional one-way service by connecting diverse data of diverse multimedia to mobile technology such as a Digital Multimedia Broadcasting (DMB) .
The DMB system is a broadcasting system for providing diverse multimedia services such as a video, an audio and data to a mobile user anytime and anywhere, and a service of the DMB system has been prepared in Korea for the first time in the world.
The DMB system, which is a transmission system, utilizes a Digital Audio Broadcasting (DAB) as a transmission system, uses MPEG-4 as a media process method, and uses MPEG-4 and MPEG-2 system as a specification for multiplexing, synchronizing and transmitting media data. A user can be provided a high-quality audio and video service of a CD level by using the DMB system.
Meanwhile, a technology for processing a binocular 3D moving picture having left and right images has been remarkably developed, and subsequently integration of the '3D moving picture and digital broadcasting has been attempted.
There are many difficulties in processing the 3D moving picture in the respect of data quantity, synchronization and a system complexity, which is different from a conventional 2D moving picture, and furthermore, a service for processing a real picture image inputted through a camera is not provided to users in mobile systems since a focus is generally put on a Computer Graphics (CG) process.
Also, the user demand for a stereophonic sound in digital broadcasting is increasing due to rapid propagation of a multi-channel sound audio and development of a 3D audio acquisition and restoring technology.
As described above, the 3D AV is used in diverse application fields such as sports relay, advertisement, education, medical service and game due to increasing interest and request with respect to the 3D AV, but a DMB service has a■ problem that the sense of real and 3D effect is very low since the DMB service is provided with a focus on 2D AV.
It is required to realize new MPEG-4 system information and structure, a method for encoding/decoding 3D AV while maintaining comparability with a conventional DMB system, a method for displaying the 3D AV as 2D AV or 3D AV according to a user selection in a reception terminal and a system for providing a 2D or 3D AV service to express 3D AV based on a conventional DMB system.
Disclosure Technical Problem
It is, therefore, an object of the present invention to provide a three dimensional (3D) digital multimedia broadcasting system (DMB) for providing a 3D Audio/Video (AV) service, which maintains comparability with a conventional DMB system and provides a more realistic 3D AV service to a user, by processing a binocular 3D moving picture and 3D sound by using a conventional system structure.
Other objects and advantages of the invention will be understood by the following description and become more apparent from the embodiments in accordance with the present invention, which are set forth hereinafter. It will be also apparent that objects and advantages of the invention can be embodied easily by the means defined in claims and combinations thereof.
Technical Solution
In accordance with one aspect of the present invention, there is provided a 3-dimensional digital multimedia broadcasting (3D DMB) transmitting system, including: a video encoder for receiving and encoding a video signal of a binocular 3D image; an audio encoder for receiving and encoding an audio signal of a 3D sound;a packetizer for packetizing the encoded video and audio signals as a sync layer (SL) packet; and a multiplexer for transforming and multiplexing the SL packet, which is packetized by the packetizer and outputting the multiplexed SL packet.
In accordance with another aspect of the present invention, there is provided a three dimensional digital multimedia broadcasting (3D DMB) receiving system, including: a demultiplexer for outputting an SL packet by demultiplexing a stream including binocular 3D image information and 3D sound information; a depacketizer for depacketizing the SL packet and outputting an encoding streams of a binocular 3D video signal and a 3D sound audio signal; a video decoder for decoding an encoding stream with respect to the binocular 3D video signal; an audio decoder for decoding a encoding stream with respect to the 3D sound audio signal; and a scene restorer for forming and outputting a 2D audio/video (AV) or 3D AV scene by using a video/3D additional video signal and an audio/3D additional audio signal which are inputted from the video decoder and the audio decoder.
Description of Drawings
The above and other objects and features of the present invention will become apparent from the following description of the preferred embodiments given in conjunction with the accompanying drawings, in which: Fig. 1 is a block diagram showing a three-dimensional digital multimedia broadcasting (3D DMB) transmitting system in accordance with an embodiment of the present invention;
Fig. 2 is a block diagram illustrating a video encoding module of Fig. 1;
Fig. 3 is a block diagram illustrating a 3D additional video encoding module of Fig. 1;
Fig. 4 is a block diagram illustrating an audio encoding module of Fig. 1; Fig. 5 is a 3D additional audio encoding module of Fig.
1;
Fig. 6 is a block diagram illustrating an additional audio pre-processor of Fig. 5;
Fig. 7 is a block diagram illustrating a system encoding module of Fig. 1;
Fig. 8 is a block diagram showing a data structure of an object descriptor (OD) in accordance with an embodiment of the present invention;
Fig. 9 is a block diagram illustrating an M4 over M2 module of Fig. 1; Fig. 10 is a block diagram showing a 3D digital multimedia broadcasting receiving system in accordance with an embodiment of the present invention;
Fig. 11 is a block diagram illustrating an M2 over M4 module of Fig. 10;
Fig. 12 is a block diagram illustrating a system analyzing module of Fig. 10;
Fig. 13 is a block diagram illustrating a 3D video decoding module of Fig. 10; Fig. 14 is a block diagram of a 3D audio decoding module of Fig. 10;
Fig. 15 is a block diagram illustrating a 3D audio post-processor of Fig. 14; and
Fig. 16 is a block diagram illustrating a scene generating module of Fig. 10.
Best Mode for the Invention
Other objects and advantages of the present invention will become apparent from the following description of the embodiments with reference to the accompanying drawings. Therefore, those skilled in the art that the present invention is included can embody the technological concept and scope of the invention easily. In addition, if it is considered that detailed description on prior art may blur the points of the present invention, the detailed description will not be provided herein. Also, in digital multimedia transmitting and receiving systems of the present invention, an ultrashort wave digital broadcasting video transmitting/receiving matched specification document of Telecommunication Technology Association (TTA) can be included in the present specification in a range that the ultrashort wave digital broadcasting video transmitting/receiving matched specification document can be helpful for explaining a function and operation of each element. The preferred embodiments of the present invention will be described in detail hereinafter with reference to the attached drawings.
Fig. 1 is a block diagram showing a three-dimensional digital multimedia broadcasting (3D DMB) transmitting system in accordance with an embodiment of the present invention.
The 3D digital multimedia broadcasting transmitting system of the present invention is a system for receiving an Audio/video (AV) data, i.e., a video signal and an audio signal, and 3D additional AV data, i.e., a 3D additional video signal and a 3D additional audio signal, encoding the AV data and the 3D additional AV data based on MPEG-4, and outputting multiplexed MPEG-2 Transport Stream (TS) . As shown in Fig, 1, the 3D digital multimedia broadcasting transmitting system includes a video encoding module 110, a 3D additional video encoding module 130, an audio encoding module 120, a 3D additional audio encoding module 140, a system encoding module 150 and an M4 over M2 module 160.
Herein, the video encoding module 110 is a module for encoding one of a left image and a right image of a binocular 3D moving picture as an MPEG-4 part 10 Advanced Video Coding (AVC) baseline profile specification. The audio encoding module 120 is a module for encoding an audio signal transmitted from an outside as an MPEG-4 Bit Sliced Arithmetic Coding (BSAC) specification.
The 3D additional audio encoding module 140 is a module for encoding the 3D additional audio signal inputted from the outside as the MPEG-4 Bit BSAC specification.
The system encoding module 150 generates, encodes MPEG-4 Initial Object Descriptor (IOD) /OD/Binary Format for Scene (BIFS) data and packetizes an object descriptor (OD) / Binary Format for scenes (BIFS) stream generated by using Elementary Stream (ES) outputted from the 4 decoding modules 110 to 140 and the data received from the outside into a sync layer (SL) packet.
The M4 over M2 module 160 receives SL packet data, packetizes the SL packet data into MPEG-2 TSs, multiplexes the packetized MPEG-2 TSs into one MPEG-2 TS and outputs the MPEG-2 TS.
Fig. 2 is a block diagram illustrating a video encoding module of Fig. 1.
As shown in Fig. 2, the video encoding module 110 includes a video pre-processor 111 and a video encoder 113. The video pre-processor 111 receives a left or right video signal with respect to a binocular 3D moving picture from an outside and transforms a size of the image into a size of Quater Video Graphic Array (QVGA) 320X240 or Common Intermediate Format (CIF) 352X288. The video encoder 113 outputs a video Elementary Stream (ES) , which is obtained by encoding a video signal, a size of which is transformed in the additional video pre-processor 111 and the MPEG-4 part 10 Advanced Video Coding (AVC) baseline profile specification and an encoding parameter, which is a bit rate. Herein, the video encoding module 110 can receive and process a general 2D moving picture video signal.
Fig. 3 is a block diagram illustrating a 3D additional video encoding module of Fig. 1. As shown in Fig. 3, the 3D additional video encoding module 130 includes an additional video pre-processor 131 and an additional video encoder 133. The additional video pre-processor 131 receives a right or left video signal with respect to a binocular 3D moving picture from an outside and transforms a size of the image into a size of 160X240/320X120 or 176X288/352X144, which is reduced as large as a half of the QVGA/CIF size in height or width. The additional video encoder 133 outputs a 3D additional video ES, which is encoding a video signal transformed in the additional video pre-processor 131 into the MPEG-4 part 10 AVC baseline profile specification and an encoding parameter, which is a bit rate.
Fig. 4 is a block diagram illustrating an audio encoding module of Fig. 1. As shown in Fig. 4, the audio encoding module 120 includes an audio pre-processor 121 and an audio encoder 123. The audio pre-processor 121 transforms resolution and a sampling frequency of an audio signal received from the outside to meet an MPEG-4 BSAC specification. The audio encoder 123 receives an audio signal transformed in the audio pre-processor 121 and a 2 channel downmix audio signal generated in the 3D additional audio encoding module 140, and also generates an audio ES, which is encoded into an MPEG-4 BSAC specification based on an encoding parameter, which is a bit rate.
Fig. 5 is a 3D additional audio encoding module of Fig. 1 in accordance with an embodiment of the present invention. As shown in Fig. 5, the 3D additional audio encoding module 140 includes an additional audio pre-processor 141 and an additional audio encoder 143. The additional audio pre-processor 141 generates and outputs a 2 channel downmix signal and 3 channel 3D additional audio signal by using a 3D additional audio signal received from the outside, wherein the 2 channel downmix signal is outputted to the audio encoder 123 of the MPEG-4 audio encoding module 120. The additional audio encoder 143 outputs a 3D additional audio ES by encoding the 3 channel 3D additional audio signal into an MPEG-4 BSAC specification. Herein, the 3D additional audio signal can be diverse multi-channel stereophonic signal such as a 5 channel stereophonic signal, which includes a forward left speaker signal L, a forward right speaker signal R, a forward central speaker signal C, a backward left speaker signal LS and a backward right speaker signal RS, or 5.1 channel stereophonic signal, in which Sub-Woofer signal SW is added to the 5 signals. Fig. 6 is a block diagram illustrating an additional audio pre-processor of Fig. 5.
As shown in Fig. 6, the additional audio pre¬ processing block 141 includes a pre-processor 145 and a channel-mixer 147. The pre-processor 145 receives a 3D additional audio signal, which is diverse channel stereophonic signals, from the outside, processes a signal characteristic such as a sampling frequency and a number of quantization bit, and generates 5 channel stereophonic signal in which low-pass filtering is performed. The channel-mixer 147 generates a 2 channel downmix signals LO and RO, and 3 channel additional audio signals T, Ql and Q2 by using a mixing method defined by an ITU-R BS.775-1 specification from the 5 channel stereophonic signal. Herein, the 2 channel downmix signals LO and RO are left/right audio signals used when a stereo is played, and the 3 channel additional audio signal T, Ql and Q2 are signals for reorganizing an original signal. Also, when a 3D additional audio signal inputted to the pre-processor 145 is a 5 channel stereophonic signal, the pre-processor 145 can output the inputted signal without any special process.
Fig. 7 is a block diagram illustrating a system encoding module of Fig. 1. As shown in Fig. 7, the system encoding module 150 includes an SL packetizer 151, an OD/BIFS generator 153 and Initial Object Descriptor (IOD) generator 155.
Herein, the OD/BIFS generator 153 generates and outputs an OD/BIFS ES by using an OD/BIFS text data received from the outside. A 3D AV is expressed by individually using one OD with respect to a video/3D additional video and an audio/3D additional audio.
Also, the SL packetizer 151 receives a video ES, an audio ES, a 3D additional video ES, a 3D additional audio ES and the OD/BIFS ES from the above-mentioned 4 encoding modules, and outputs them by packetizing each of them as an SL packet according to a Korean mobile multimedia broadcasting specification.
The IOD generator 155 generates and outputs an IOD ES by using the IOD text data transmitted from the outside.
Fig. 8 is a block diagram showing a data structure of an object descriptor (OD) in accordance with an embodiment of the present invention.
In a video, two ES_Descriptors for left or right video and a 3D additional video of a right or left video are subordinately included in one OD to express a 3D AV while maintaining comparability with an OD/BIFS structure of a conventional DMB system. Also, in an audio, two ES_Descriptors for one OD lower audio and a 3D additional audio have a subordinate relationship.
The subordinate relationship can be expressed by using Stream DependenceFlag of MPEG-4 OD, and depends0n_ES_ID.
Also, ObjectTypelndication of a 3D additional video ES is set as User private, and stream type is set as Visual to provide a service of a 3D AV while maintaining comparability with a conventional DMB system. ObjectTypelndication of a 3D additional audio ES is set as User private and stream type is set as Audio. Other video and audio ES are set according to a conventional DMB system specification.
The conventional DMB system cannot recognize ObjectTypelndication information with respect to a 3D additional AV stream through this, and also cannot receive a related 3D additional AV encoding stream. As a result, since the conventional DMB system can recognize only a general 2D video and audio and receive only related encoding stream, backward comparability, which can be received as a 2D moving picture with respect to a 3D AV, is provided to a user. Fig. 9 is a block diagram illustrating an M4 over M2 module of Fig. 1.
As shown in Fig. 9, the M4 over M2 module 160 includes a Packetized Elementary Stream (PES) Packetizer 161, a PES to TS Packetizer 162, a multiplexer 163, a switch 164, a 14496 section packetizer 165, a PSI generator 166, a Program Specific Information PSI section to TS Packetizer 167 and a 14496 section to TS Packetizer 168.
The switch 164 receives an OD/BIFS SL packet from the system encoding module 150 and outputs the OD/BIFS SL packet as the PES Packetizer 161 or the 14496 section packetizer 165 according to encoding information of an SL packet.
The video SL packet, the Audio SL packet, the 3D additional video SL packet, the 3D additional audio SL packet received from the system encoding module 150, and the OD/BIFS SL packet inputted from the switch 164 are individuallly packetized as PES and outputted to the PES to TS Packetizer 162 by the PES packetizer 161.
The OD/BIFS SL packet inputted from the switch 164 is packetized into a 14496 section and outputted to the 14496 section to TS Packetizer 168 by the 14496 section packetizer 165.
The PSI generator 166 generates PSI including Program Association Table (PMT) section (PA_section) and Program Map Table (PMT) section (PM_section) by using the IOD information received from the system encoding module 150 and outputs the PSI to the PSI section to TS Packetizer 167. The inputted PES packet is packetized into MPEG-2 TS and outputted to the multiplexer 163 by the PES to TS Packetizer 162.
The inputted 14496 seciton is packetized into MPEG-2 TS and outputted to the multiplexer 163 by the 14496 section to TS Packetizer 168.
The PSI information is inputted and packetized into MPEG-2 TS and outputted to the multiplexer 163 by the PSI section to TS Packetizer 167.
The inputted MPEG-2 TS is multiplexed into one transmission stream and the multiplexed MPEG-2 TS is outputted by the multiplexer 163. Fig. 10 is a block diagram showing a 3D digital multimedia broadcasting receiving system in accordance with an embodiment of the present invention.
The 3D digital multimedia broadcasting receiving system of the present invention is a system for demultiplexing and decoding the multiplexed MPEG-2 TS, which is inputted from the outside, and displaying a 2D AV or a 3D AV to a user.
As shown in Fig. 10, the 3D digital multimedia broadcasting receiving system includes an M2 over M4 module 210, a system analyzing module 220, a 3D video decoding module 230, a 3D audio decoding module 240 and a scene generating module 250.
Herein, the M2 over M4 module 210 outputs the video SL packet, the audio SL packet, the 3D additional video SL packet, the 3D additional audio SL packet, the OD/BIFS SL packet and the IOD data by demultiplexing and depacketizing the multiplexed MPEG-2 TS, which is inputted from an outside.
The system analyzing module 220 depacketizes the received SL packet including the video SL packet, the Audio
SL packet, the 3D additional video SL packet, the 3D additional audio SL packet and the OD/BIFS SL packet, outputs the SL packet as an encoding stream including a video ES, an audio ES, a 3D additional video ES and a 3D additional audio ES and outputs the IOD data and the
OD/BIFS data by decoding the IOD data and the OD/BIFS data. The 3D video decoding module 230 outputs a video ES and a 3D additional video encoding ES as a 2D video scene or a 3D video scene by decoding the video ES and the 3D additional video encoding ES. The 3D audio decoding module 240 outputs a 3D audio signal as a 2D or 3D audio signal by decoding an audio ES and a 3D additional audio ES.
The scene generating module 250 forms and outputs a scene according to a definition of the BIFS by using the
2D/3D video signal and the 2D/3D audio signal received from the 3D video decoding module 230 and the 3D audio decoding module 240.
Fig. 11 is a block diagram illustrating an M2 over M4 module of Fig. 10.
As shown in Fig. 11, the M2 over M4 module 210 includes a De_Multiplexer 211, a TS to PES de-packetizer
212, a TS to 14496 section de-packetizer 213, a TS to PSI section de-packetizer 214, a PES de-packetizer 215, a 14496 section analyzer 216 and a PSI section analyzer 217.
The De_Multiplexer 211 individually demultiplexes the multiplexed MPEG-2 TS, which is inputted from the outside, and outputs the demultiplexed MPEG-2 TS as a single MPEG-2 TS with respect to a video ES, an audio ES, a 3D additional video ES, a 3D additional audio ES, OD/BIFS, a 14496 section and PSI.
The TS to PES de-packetizer 212 receives an MPEG-2 TS of a video, an audio, a 3D additional video, a 3D additional audio and OD/BIFS from the De_Multiplexer 211, and outputs the MPEG-2 TS as a PES de-packetizer 215 by depacketizing the MPEG-2 TS into a PES packet.
The TS to 14496 section de-packetizer 213 receives an MPEG-2 TS of the 14496 section and outputs the MPEG-2 TS to the 14496 section analyzer 216 by depacketizing the MPEG-2 TS into the 14496 section.
The TS to PSI section de-packetizer 214 receives an
MPEG-2 TS of the PSI and outputs the MPEG-2 TS to the PSI section analyzer 217 by depacketizing the MPEG-2 TS into the PMP-section. The PES de-packetizer 215 receives each PES packet with respect to a video, an audio, a 3D additional video ES, a 3D additional audio and OD/BIFS from the TS to PES de- packetizer 212 and outputs a video SL packet, an audio SL packet, a 3D additional video SL packet, a 3D additional audio SL packet and an OD/BIFS SL packet by depacketizing the PES packets into an SL packet.
The 14496 section analyzer 216 receives a 14496 section from the TS to 14496 section de-packetizer 213 and outputs the OD/BIFS SL packet by extracting the OD/BIFS SL packet.
The PSI section analyzer 217 receives a PAT section and a PMT section and outputs IOD data by extracting the IOD data.
Fig. 12 is a block diagram illustrating a system analyzing module of Fig. 10.
As shown in Fig. 12, the system analyzing module 220 includes a SL de-packetizer 221, an OD/BIFS decoder 222 and a IOD decoder 223.
The SL de-packetizer 221 receives a video SL packet, an audio SL packet, a 3D additional video SL packet, a 3D additional audio SL packet and an OD/BIFS SL packet from the M2 over M4 module 210, depacketizes each of them into Encoding Stream and outputs the video ES and outputs the 3D additional video ES to the 3D video decoding module 230, the audio ES and 3D additional audio ES to the 3D audio decoding module 240, and the OD/BIFS data to the OD/BIFS decoder 222.
The the OD/BIFS decoder 222 decodes the OD/BIFS encoding data transmitted from the SL de-packetizer 221 and outputs the decoded BIFS information to the scene generating module 250, wherein the decoded OD information is used to initialize each media decoder.
The IOD decoder 223 outputs the IOD encoding data by receiving and decoding the IOD encoding data, and the decoded IOD data is used to extract OD/BIFS data. Fig. 13 is a block diagram illustrating a 3D video decoding module of Fig. 10.
As shown in Fig. 13, the 3D video decoding module 230 includes a video decoder 231, an additional video decoder 233 and a 3D video post-processor 235.
The video decoder 231 receives a video ES of MPEG-4 part 10 AVC specification of 320X240/352X288 image size from the SL de-packetizer 221 of the system analyzing module 220 and outputs the video ES to the 3D video post- processor 235 by decoding the video ES.
The additional video decoder 233 receives a 3D additional video ES of MPEG-4 part 10 AVC specification of 160X240/320X120 or 176X288/352X144 image size from the SL de-packetizer 221 of the system analyzing module 220 and outputs the 3D additional video ES to the 3D video post¬ processor 235 by decoding the 3D additional video ES.
The 3D video post-processor 235 individually receives a decoded video signal and a 3D additional video signal form the video decoder 231 and the additional video decoder 233, and outputs the video signal and the 3D additional video signal as a 3D video signal of QUGA 320X240 or CIF 352X288 by synthesizing the signals according to a field when the video restoring mode information inputted from a user is a 3D video restoring mode, or outputs only a 2D video signal of 320X240 or 352X288 image size with ignoring the received 3D additional video signal when the video restoring mode information is a 2D video restoring mode. A user can enjoy 3D AV by selecting a desirable displaying method through this. Fig. 14 is a block diagram of a 3D audio decoding module of Fig. 10.
As shown in Fig. 14, the 3D audio decoding module 240 includes an audio decoder 241, an additional audio decoder 243 and a 3D audio post-processor 245. The audio decoder 241 receives an audio ES of an MPEG- 4 BSAC specification from the SL de-packetizer 221 of the system analyzing module 220 and outputs the audio ES to the 3D audio post-processor 245 by decoding the audio ES.
The additional audio decoder 243 receives a 3D additional audio ES of an MPEG-4 BSAC specification from the SL de-packetizer 221 of the system analyzing module 220 and outputs the 3D additional audio ES to the 3D audio post-processor 245 by decoding the 3D additional audio ES.
The 3D audio post-processor 245 receives a decoded audio signal and a 3D additional audio signal from the audio decoder 241 and the additional audio decoder 243, generates and outputs a 2D or 3D audio signal by using audio restoring information inputted from a user.
Fig. 15 is a block diagram illustrating a 3D audio post-processor of Fig. 14.
As shown in Fig. 15, the 3D audio post-processor 245 includes a 2D/3D switch 246, a de-matrixer 247 and a virtual 3D combiner 248.
The 2D/3D switch 246 outputs 5 channel 3D audio signals LO, RO, T, Ql and Q2 by synthesizing the decoded audio signal and the 3D additional audio signal when the audio restoring mode information received from a user is a
3D audio restoring mode, or outputs only 3D audio signals
LO and RO with ignoring the inputted 3D additional audio signal when the audio restoring mode information is a 2D audio restoring mode.
The de-matrixer 247 receives an audio signal and a 3D audio signal, and outputs a 5 channel audio signals L, R, C, LS and RS by using ITU-R BS.775-1 specification. The Virtual 3D Synthesizer 248 receives and outputs the 5 channel audio signals by transforming the 5 channel audio signals into a 3D audio signal, which is formed of 2 channel virtual sound signals L and R.
Fig. 16 is a block diagram illustrating a scene generating module of Fig. 10. As shown in Fig. 16, the scene generating module 250 includes a scene forming unit 251 and a renderer 253.
The scene forming unit 251 receives AV data such as a 2D/3D video signal and a 2D/3D audio signal from the 3D video decoding module 230 and the 3D audio decoding module 240, and outputs an AV scene such as a 2D/3D video scene and a 2D/3D audio composing a scene according to BIFS data, which are received from the OD/BIFS decoder 222 of the system analyzing module 220, to the renderer 253. The renderer 253 receives and outputs an AV scene such as a 2D/3D video scene and a 2D/3D audio from the scene forming unit 251 be rendering the AV scene.
Accordingly, it is possible to realize a system capable of providing a 3D AV contents service to a user while maintaining comparability with a conventional DMB system.
As described in detail, the present invention can be embodied as a program and stored in a computer-readable recording medium, such as CD-ROM, RAM, ROM, a floppy disk, a hard disk and a magneto-optical disk. Since the process can be easily implemented by those skilled in the art, further description will not be provided herein.
The present invention can provide a two dimensional audio/video (2D AV) or a more realistic three dimensional (3D) AV service to a user while maintaining comparability with a conventional digital multimedia broadcasting (DMB) system.
Also, the present invention has an additional effect that the present invention can economically realize a system for providing a 3D AV service by using the conventional DMB system.
While the present invention has been described with respect to certain preferred embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the scope of the invention as defined in the following claims.

Claims

What is claimed is:
1. A 3-dimensional digital multimedia broadcasting (3D DMB) transmitting system, comprising: a video encoding means for receiving and encoding a video signal of a binocular 3D image; an audio encoding means for receiving and encoding an audio signal of a 3D sound; a packetizing means for packetizing the encoded video and audio signals as a sync layer (SL) packet; and a multiplexing means for transforming and multiplexing the SL packet, which is packetized by the packetizing means and outputting the multiplexed SL packet.
2. The transmitting system as recited in claim 1, wherein the video encoding means includes: a first video encoding means for encoding a left or right video signal of the binocular 3D image; and a second video encoding means for encoding a signal, which is not encoded in the first video encoding means, among the left and right video signals.
3. The transmitting system as recited in claim 1, wherein the audio encoding means includes: a first audio encoding means for encoding a mono audio signal or a stereo audio signal; and a second audio encoding means for encoding a 3 channel additional audio signal.
4. The transmitting system as recited in claim 2, wherein the first video encoding means includes: a first video pre-processing means for transforming an image size of the inputted video signal; and a first video encoding means for encoding the signal transformed in the first video pre-processing means.
5. The transmitting system as recited in claim 4, wherein the second video encoding means includes: a second video pre-processing means for transforming a size of the inputted video signal into an image size a half as large as a size transformed in the first video pre¬ processing means in height or width; and a second video encoding means for encoding the signal transformed in the second video pre-processing means.
6. The transmitting system as recited in anyone of claims 1 to 5, wherein the packetizing means includes: an object descriptor (OD) /Binary Format for Scenes (BIFS) generating means for generating an OD and BIFS encoding stream; a SL packetizing means for packetizing the stream, which is inputted from the encoding means and the OD/BIFS generating means, into an SL packet; and an Initial Object Descriptor (IOD) generating means for generating an IOD encoding stream.
7. The transmitting system as recited in claim 6, wherein the OD includes description information with respect to a 3D additional video signal or a 3D additional audio signal.
8. The transmitting system as recited in claim 7, wherein the description information includes object type information for providing backward comparability with respect to the 3D additional video signal or the 3D additional audio signal.
9. The transmitting system as recited in claim 6, wherein each OD includes two ES_Descriptors with respect to video and audio signals, and the ES_Descriptor sets up Stream Type with respect to a 3D additional video signal as Visual, ObjectTypelndication as User private, Stream Type with respect to a 3D additional audio signal as Audio, and ObjectTypelndication as User private in order to provide backward comparability with respect to the 3D additional video or 3D additional audio signal.
10. A three dimensional digital multimedia broadcasting (3D DMB) receiving system, comprising: a demultiplexing means for outputting an SL packet by demultiplexing a stream including binocular 3D image information and 3D sound information; a depacketizing means for depacketizing the SL packet and outputting an encoding streams of a binocular 3D video signal and a 3D sound audio signal; a video decoding means for decoding an encoding stream with respect to the binocular 3D video signal; an audio decoding means for decoding a encoding stream with respect to the 3D sound audio signal; and a scene restoring means for forming and outputting a 2D audio/video (AV) or 3D AV scene by using a video/3D additional video signal and an audio/3D additional audio signal which are inputted from the video decoding means and the audio decoding means.
11. The receiving signal as recited in claim 10, wherein the video decoding means includes: a first video decoding means for decoding a video encoding stream with respect to a left or right image of the binocular 3D image by receiving the video encoding stream from the depacketizing means; a second video decoding means for decoding a video encoding stream with respect to a signal which is not inputted in the first video decoding means among the left and right video signals by receiving the video encoding stream from the depacketizing means; and a video post-processing means for outputting a video signal which is decoded by the first video decoding means and the second video decoding means as a 2D video signal or a 3D video signal according to video restoring mode information inputted from outside.
12. The receiving signal as recited in claim 11, wherein the image size of the video encoding stream inputted from the second video decoding means is a half as large as an image size of the video encoding stream received from the first video decoding means in height or width.
13. The receiving signal as recited in claim 10, wherein the audio decoding means includes: a first audio decoding means for decoding mono audio encoding stream or stereo audio encoding stream by receiving the mono audio encoding stream or a stereo audio decoding stream from the depacketizing means; a second audio decoding means for decoding a 3 channel additional audio encoding stream by receiving the 3 channel audio encoding stream from the depacketizing means; and an audio post-processing means for outputting an audio signal, which is decoded by the first audio decoding means and the second audio decoding means, as a 2D audio signal or a 3D audio signal according to audio restoring mode information inputted from outside.
PCT/KR2004/003540 2004-08-09 2004-12-30 3-dimensional digital multimedia broadcasting system WO2006016735A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP04808668A EP1776832A4 (en) 2004-08-09 2004-12-30 3-dimensional digital multimedia broadcasting system
CN2004800437751A CN1998233B (en) 2004-08-09 2004-12-30 3-dimensional digital multimedia broadcasting system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2004-0062418 2004-08-09
KR1020040062418A KR100658222B1 (en) 2004-08-09 2004-08-09 3 Dimension Digital Multimedia Broadcasting System

Publications (1)

Publication Number Publication Date
WO2006016735A1 true WO2006016735A1 (en) 2006-02-16

Family

ID=35839476

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2004/003540 WO2006016735A1 (en) 2004-08-09 2004-12-30 3-dimensional digital multimedia broadcasting system

Country Status (4)

Country Link
EP (1) EP1776832A4 (en)
KR (1) KR100658222B1 (en)
CN (1) CN1998233B (en)
WO (1) WO2006016735A1 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008039042A1 (en) * 2006-09-29 2008-04-03 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
WO2008048042A1 (en) * 2006-10-17 2008-04-24 Electronics And Telecommunications Research Institute Apparatus and method for transmitting or replaying multi-channel audio signal
US7636929B2 (en) * 2004-10-06 2009-12-22 Samsung Electronics Co., Ltd. Method and apparatus of providing and receiving video services in digital audio broadcasting (DAB) system
EP2158767A1 (en) * 2007-05-29 2010-03-03 Electronics and Telecommunications Research Institute Method for describing and multiplexing objects for 3d still image service based on dmb, and apparatus and decoding apparatus and method thereof
CN102460573A (en) * 2009-06-24 2012-05-16 弗兰霍菲尔运输应用研究公司 Audio signal decoder, method for decoding audio signal and computer program using cascaded audio object processing stages
US8204756B2 (en) 2007-02-14 2012-06-19 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
RU2536388C2 (en) * 2009-01-20 2014-12-20 Конинклейке Филипс Электроникс Н.В. 3d image transmission
EP2509322A4 (en) * 2009-12-04 2015-09-30 Korea Electronics Telecomm Apparatus and method for three-dimensional broadcasting service in broadcasting system coupled with mobile broadcasting
CN106463123A (en) * 2014-03-21 2017-02-22 杜比国际公司 Method for compressing a higher order ambisonics (hoa) signal, method for decompressing a compressed hoa signal, apparatus for compressing a hoa signal, and apparatus for decompressing a compressed hoa signal
EP2454886B1 (en) * 2009-07-15 2018-11-14 Google Technology Holdings LLC Simulcast of stereoviews for 3d tv
US10679634B2 (en) 2014-03-21 2020-06-09 Dolby Laboratories Licensing Corporation Methods and apparatus for decoding a compressed HOA signal
US20220255649A1 (en) * 2019-07-22 2022-08-11 Algorkorea Co. Ltd Mobile terminal having integrated radio function, and integrated radio system using same

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101191195B1 (en) * 2006-05-04 2012-10-15 엘지전자 주식회사 apparatus for transmitting contents, apparatus for outputting contents, method for transmitting contents and method for outputting contents
KR100910996B1 (en) * 2006-12-08 2009-08-05 한국전자통신연구원 Method of Providing Three-Dimensional Video Service in Digital Multimedia Broadcasting System
KR101319535B1 (en) 2006-12-26 2013-10-21 삼성전자주식회사 Device of processing image and method thereof
KR100842582B1 (en) * 2007-01-08 2008-07-01 삼성전자주식회사 Digital broadcasting system for transfering and receiving digital multimedia data and method therefor
KR101292893B1 (en) * 2007-05-08 2013-09-02 한국전자통신연구원 Scalable coding apparatus and method, scalable decoding apparatus and method
CN101378545B (en) * 2007-08-28 2012-07-18 中兴通讯股份有限公司 Layered transmission method for multimedia broadcast and multicast business
KR101531510B1 (en) * 2008-11-27 2015-06-26 엘지전자 주식회사 Receiving system and method of processing audio data
KR101435815B1 (en) * 2007-11-28 2014-08-29 엘지전자 주식회사 broadcasting system and method of processing audio data
KR100979445B1 (en) * 2008-10-31 2010-09-02 한국전자통신연구원 Method for providing three dimensional data service based on dmb and method for receiving it
KR20100050426A (en) 2008-11-04 2010-05-13 한국전자통신연구원 Method and system for transmitting/receiving 3-dimensional broadcasting service
US8947504B2 (en) 2009-01-28 2015-02-03 Lg Electronics Inc. Broadcast receiver and video data processing method thereof
CN102484727B (en) 2009-03-19 2015-01-21 Lg电子株式会社 Method for processing three dimensional (3d) video signal and digital broadcast receiver for performing the processing method
KR101599554B1 (en) * 2009-03-23 2016-03-03 한국전자통신연구원 3 3d binaural filtering system using spectral audio coding side information and the method thereof
KR101641684B1 (en) * 2009-08-18 2016-07-21 삼성전자주식회사 Apparatus and method for transmitting digital multimedia broadcasting, and method and apparatus for receiving digital multimedia broadcasting
KR101647408B1 (en) * 2010-02-03 2016-08-10 삼성전자주식회사 Apparatus and method for image processing
KR101277267B1 (en) * 2010-04-02 2013-06-20 전자부품연구원 Coding method and apparatus for 3D broadcasting
CN103168473B (en) * 2010-10-16 2016-09-28 Lg电子株式会社 Digital receiver and the method being used for processing the 3D content in digital receiver
KR20130011994A (en) * 2011-07-22 2013-01-30 삼성전자주식회사 Transmitter, receiver and the method thereof

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998025406A1 (en) * 1996-12-06 1998-06-11 Sanyo Electric Co., Ltd. Digital broadcasting system
US20040066846A1 (en) * 2002-10-07 2004-04-08 Kugjin Yun Data processing system for stereoscopic 3-dimensional video based on MPEG-4 and method thereof

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10150608A (en) 1996-11-19 1998-06-02 Sanyo Electric Co Ltd User-side terminal of digital broadcasting system
JPH10164448A (en) 1996-12-02 1998-06-19 Sanyo Electric Co Ltd Method and device for reproducing image for television broadcasting system
JPH10336700A (en) 1997-05-30 1998-12-18 Sanyo Electric Co Ltd Digital broadcasting system, transmitter and receiver
US6057884A (en) * 1997-06-05 2000-05-02 General Instrument Corporation Temporal and spatial scaleable coding for video object planes
US6539357B1 (en) * 1999-04-29 2003-03-25 Agere Systems Inc. Technique for parametric coding of a signal containing information
KR100392384B1 (en) * 2001-01-13 2003-07-22 한국전자통신연구원 Apparatus and Method for delivery of MPEG-4 data synchronized to MPEG-2 data
KR100397511B1 (en) * 2001-11-21 2003-09-13 한국전자통신연구원 The processing system and it's method for the stereoscopic/multiview Video
US7292690B2 (en) * 2002-01-02 2007-11-06 Sony Corporation Video scene change detection
CN1307612C (en) * 2002-04-22 2007-03-28 皇家飞利浦电子股份有限公司 Parametric representation of spatial audio
KR20040035297A (en) * 2002-10-19 2004-04-29 삼성전자주식회사 Apparatus and method for transmission of digital broadcasting system having the composition error correction coding function
KR100751422B1 (en) * 2002-12-27 2007-08-23 한국전자통신연구원 A Method of Coding and Decoding Stereoscopic Video and A Apparatus for Coding and Decoding the Same
KR100566100B1 (en) * 2003-10-21 2006-03-31 전자부품연구원 Apparatus for adaptive multiplexing/demultiplexing for 3D multiview video processing and its method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998025406A1 (en) * 1996-12-06 1998-06-11 Sanyo Electric Co., Ltd. Digital broadcasting system
US20040066846A1 (en) * 2002-10-07 2004-04-08 Kugjin Yun Data processing system for stereoscopic 3-dimensional video based on MPEG-4 and method thereof

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
DARAS P. ET AL: "MPEG-4 authoring tool for the composition of 3D audiovisual scenes", PROCEEDINGS SECOND INTERNATIONAL WORKSHOP ON DIGITAL AND COMPUTATIONAL VIDEO, 2001, 8 February 2001 (2001-02-08), pages 110 - 117, XP010547449 *
JEONG S. ET AL: "MPEG-4 extension for augmented stereoscopic video", PROCEEDINGS THIRD INTERNATIONAL WORKSHOP ON DIGITAL AND COMPUTATIONAL VIDEO, 2002. DCV 2002., 14 November 2002 (2002-11-14) - 15 November 2002 (2002-11-15), pages 176 - 183, XP010649294 *
See also references of EP1776832A4 *

Cited By (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7636929B2 (en) * 2004-10-06 2009-12-22 Samsung Electronics Co., Ltd. Method and apparatus of providing and receiving video services in digital audio broadcasting (DAB) system
US8762157B2 (en) 2006-09-29 2014-06-24 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
WO2008039043A1 (en) * 2006-09-29 2008-04-03 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
WO2008039039A1 (en) * 2006-09-29 2008-04-03 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
WO2008039041A1 (en) * 2006-09-29 2008-04-03 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US8504376B2 (en) 2006-09-29 2013-08-06 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US7979282B2 (en) 2006-09-29 2011-07-12 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US7987096B2 (en) 2006-09-29 2011-07-26 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US9792918B2 (en) 2006-09-29 2017-10-17 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
WO2008039042A1 (en) * 2006-09-29 2008-04-03 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US8625808B2 (en) 2006-09-29 2014-01-07 Lg Elecronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US9384742B2 (en) 2006-09-29 2016-07-05 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
WO2008048042A1 (en) * 2006-10-17 2008-04-24 Electronics And Telecommunications Research Institute Apparatus and method for transmitting or replaying multi-channel audio signal
US8204756B2 (en) 2007-02-14 2012-06-19 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US8296158B2 (en) 2007-02-14 2012-10-23 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US8417531B2 (en) 2007-02-14 2013-04-09 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US8271289B2 (en) 2007-02-14 2012-09-18 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US9449601B2 (en) 2007-02-14 2016-09-20 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US8234122B2 (en) 2007-02-14 2012-07-31 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
US8756066B2 (en) 2007-02-14 2014-06-17 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
EP2158767A4 (en) * 2007-05-29 2012-07-11 Korea Electronics Telecomm Method for describing and multiplexing objects for 3d still image service based on dmb, and apparatus and decoding apparatus and method thereof
EP2158767A1 (en) * 2007-05-29 2010-03-03 Electronics and Telecommunications Research Institute Method for describing and multiplexing objects for 3d still image service based on dmb, and apparatus and decoding apparatus and method thereof
RU2536388C2 (en) * 2009-01-20 2014-12-20 Конинклейке Филипс Электроникс Н.В. 3d image transmission
US10257493B2 (en) 2009-01-20 2019-04-09 Koninklijke Philips N.V. Transferring of 3D image data
CN103489449A (en) * 2009-06-24 2014-01-01 弗兰霍菲尔运输应用研究公司 Audio signal decoder, method for providing upmix signal representation state
CN103474077A (en) * 2009-06-24 2013-12-25 弗兰霍菲尔运输应用研究公司 Audio signal decoder and upmix signal representation method
US8958566B2 (en) 2009-06-24 2015-02-17 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Audio signal decoder, method for decoding an audio signal and computer program using cascaded audio object processing stages
CN103489449B (en) * 2009-06-24 2017-04-12 弗劳恩霍夫应用研究促进协会 Audio signal decoder, method for providing upmix signal representation state
CN102460573A (en) * 2009-06-24 2012-05-16 弗兰霍菲尔运输应用研究公司 Audio signal decoder, method for decoding audio signal and computer program using cascaded audio object processing stages
EP2454886B1 (en) * 2009-07-15 2018-11-14 Google Technology Holdings LLC Simulcast of stereoviews for 3d tv
EP2509322A4 (en) * 2009-12-04 2015-09-30 Korea Electronics Telecomm Apparatus and method for three-dimensional broadcasting service in broadcasting system coupled with mobile broadcasting
US9392255B2 (en) 2009-12-04 2016-07-12 Electronics And Telecommunication Research Institute Apparatus and method for 3D broadcasting service in broadcasting system combined with mobile broadcasting
US10334382B2 (en) 2014-03-21 2019-06-25 Dolby Laboratories Licensing Corporation Methods, apparatus and systems for decompressing a higher order ambisonics (HOA) signal
CN106463123A (en) * 2014-03-21 2017-02-22 杜比国际公司 Method for compressing a higher order ambisonics (hoa) signal, method for decompressing a compressed hoa signal, apparatus for compressing a hoa signal, and apparatus for decompressing a compressed hoa signal
US10542364B2 (en) 2014-03-21 2020-01-21 Dolby Laboratories Licensing Corporation Methods, apparatus and systems for decompressing a higher order ambisonics (HOA) signal
CN111145766A (en) * 2014-03-21 2020-05-12 杜比国际公司 Method and apparatus for decoding a compressed Higher Order Ambisonics (HOA) representation and medium
US10679634B2 (en) 2014-03-21 2020-06-09 Dolby Laboratories Licensing Corporation Methods and apparatus for decoding a compressed HOA signal
US10779104B2 (en) 2014-03-21 2020-09-15 Dolby Laboratories Licensing Corporation Methods, apparatus and systems for decompressing a higher order ambisonics (HOA) signal
CN111145766B (en) * 2014-03-21 2022-06-24 杜比国际公司 Method and apparatus for decoding a compressed Higher Order Ambisonics (HOA) representation and medium
US11395084B2 (en) 2014-03-21 2022-07-19 Dolby Laboratories Licensing Corporation Methods, apparatus and systems for decompressing a higher order ambisonics (HOA) signal
US11462222B2 (en) 2014-03-21 2022-10-04 Dolby Laboratories Licensing Corporation Methods and apparatus for decoding a compressed HOA signal
US11722830B2 (en) 2014-03-21 2023-08-08 Dolby Laboratories Licensing Corporation Methods, apparatus and systems for decompressing a Higher Order Ambisonics (HOA) signal
US11830504B2 (en) 2014-03-21 2023-11-28 Dolby Laboratories Licensing Corporation Methods and apparatus for decoding a compressed HOA signal
US20220255649A1 (en) * 2019-07-22 2022-08-11 Algorkorea Co. Ltd Mobile terminal having integrated radio function, and integrated radio system using same
US11870548B2 (en) * 2019-07-22 2024-01-09 Algorkorea Co. Ltd Mobile terminal having integrated radio function, and integrated radio system using same

Also Published As

Publication number Publication date
CN1998233A (en) 2007-07-11
EP1776832A4 (en) 2009-08-26
EP1776832A1 (en) 2007-04-25
CN1998233B (en) 2011-12-07
KR20060013818A (en) 2006-02-14
KR100658222B1 (en) 2006-12-15

Similar Documents

Publication Publication Date Title
KR100658222B1 (en) 3 Dimension Digital Multimedia Broadcasting System
US9380288B2 (en) System and method for transmitting/receiving three dimensional video based on digital broadcasting
JP5575949B2 (en) Broadcast data transmission method and apparatus
KR100585966B1 (en) The three dimensional video digital broadcasting transmitter- receiver and its method using Information for three dimensional video
KR100747550B1 (en) Method for providing three dimensional image service based on DMB, Apparatus and Method of Decoding for three dimensional image service based on DMB
JP5543504B2 (en) 3D still image service method and apparatus based on digital broadcasting
EP2501128B1 (en) Object-based 3-dimensional audio service system using preset audio scenes
US20100134592A1 (en) Method and apparatus for transceiving multi-view video
WO2007064159A1 (en) Method for providing 3d contents service based on digital broadcasting
KR100703715B1 (en) Multiview 3D video transmission/receiving system
JP2010512096A (en) Non-real-time digital actual broadcasting transmission / reception system and method
JP2008306750A (en) Stereoscopic/multiview 3d moving image processing system, and method thereof
WO2007067020A1 (en) System and method for transmitting/receiving three dimensional video based on digital broadcasting
EP2153645A1 (en) Method and apparatus for providing high-quality multimedia service in dmb system
EP2654305A2 (en) Signaling method for a stereoscopic video service and apparatus using the method
KR100874226B1 (en) Multi-view Image and 3D Audio Transceiver and Transmit and Receive Method Using the Same
JP5771098B2 (en) COMMUNICATION CONTENT GENERATION DEVICE AND COMMUNICATION CONTENT GENERATION PROGRAM

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2004808668

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 200480043775.1

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

WWP Wipo information: published in national office

Ref document number: 2004808668

Country of ref document: EP