EP2153645A1 - Method and apparatus for providing high-quality multimedia service in dmb system - Google Patents

Method and apparatus for providing high-quality multimedia service in dmb system

Info

Publication number
EP2153645A1
EP2153645A1 EP08753313A EP08753313A EP2153645A1 EP 2153645 A1 EP2153645 A1 EP 2153645A1 EP 08753313 A EP08753313 A EP 08753313A EP 08753313 A EP08753313 A EP 08753313A EP 2153645 A1 EP2153645 A1 EP 2153645A1
Authority
EP
European Patent Office
Prior art keywords
base layer
enhancement layer
packet
layer
pes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP08753313A
Other languages
German (de)
French (fr)
Other versions
EP2153645A4 (en
Inventor
Kwang-Yong Kim
Gwang-Soon Lee
Joungil Yun
Young-Su Kim
Kyu-Tae Yang
Jae-Hwui Bae
Seomee Choi
Ju-Yeun Kim
Jae-Hyun Seo
Jong-Soo Lim
Soo-In Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics and Telecommunications Research Institute ETRI filed Critical Electronics and Telecommunications Research Institute ETRI
Publication of EP2153645A1 publication Critical patent/EP2153645A1/en
Publication of EP2153645A4 publication Critical patent/EP2153645A4/en
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43074—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614—Multiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2362—Generation or processing of Service Information [SI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4345—Extraction or processing of SI, e.g. extracting service information from an MPEG stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/44029—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display for generating different versions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network
    • H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H2201/00—Aspects of broadcast communication
    • H04H2201/10—Aspects of broadcast communication characterised by the type of broadcast system
    • H04H2201/11—Aspects of broadcast communication characterised by the type of broadcast system digital multimedia broadcasting [DMB]

Definitions

  • the present invention relates to a media processing method and apparatus for providing high-quality multimedia services, by which a function for providing high-quality services is added to digital multimedia broadcasting and backward compatibility with existing receivers can be maintained.
  • the present invention is derived from a research project supported by the Information Technology (IT) Research & Development (R&D) program of the Ministry of Information and Communication (MIC) [2006-S-017-02, Development of High-Tech Terrestrial DMB Transmission].
  • IT Information Technology
  • R&D Research & Development
  • MIC Ministry of Information and Communication
  • DMB digital multimedia broadcasting
  • a multi-media service is multiplexed into a single transport stream and the multiplexed service is transmitted.
  • DMB broadcasting multi-media services are provided through a single stream, and thus there is a limit in providing a high-quality service.
  • FIG. 1 is a block diagram illustrating a structure of a media processor of a conventional transmission unit in digital multimedia broadcasting (DMB);
  • DMB digital multimedia broadcasting
  • FIG. 2 is a conceptual diagram illustrating a system for providing high-quality multimedia services in DMB, according to an embodiment of the present invention
  • FIG. 3 is a block diagram for illustrating an encoding and multiplexing method performed in an encoding unit, according to one embodiment of the present invention
  • FIG. 4 is a block diagram for illustrating an encoding and multiplexing method performed in an encoding unit, according to another embodiment of the present invention
  • FIG. 5 is a block diagram of a receiving device that performs a decoding and de-multiplexing method corresponding to the encoding and multiplexing method illustrated in FIG. 3.
  • FIG. 6 is a flowchart illustrating a decoding and de-multiplexing method performed in a decoding unit, according to one embodiment of the present invention
  • FIG. 7 is a block diagram for describing a decoding and de-multiplexing method performed in a decoding unit, according to another embodiment of the present invention.
  • FIG. 8 is a flowchart of the decoding and de-multiplexing method illustrated in FIG. 7;
  • FIG. 9 illustrates a decoding and de-multiplexing method according to another embodiment of the present invention
  • FIG. 10 illustrates an MPEG-4 object descriptor (OD) used in the present invention
  • FIG. 11 is a block diagram of a transmission device for providing high-quality multimedia services in a DMB transmission system, according to an exemplary embodiment of the present invention
  • FIG. 12 is a block diagram of a reception device for providing high-quality multimedia services in a DMB transmission system, according to an exemplary embodiment of the present invention.
  • the present invention provides a transceiving method and apparatus by which a function for providing high-quality services is added to digital multimedia broadcasting and backward compatibility with existing receivers can be maintained.
  • the present invention provides a structure in which a transport stream (TS) is separated into a base layer TS and an enhancement layer TS, a conventional TS is transmitted via the base layer TS and additional multimedia service information for high-quality services is multiplexed and transmitted via the enhancement layer TS, so that services transmitted through different transport channels can be incorporated with each other and provided when needed.
  • TS transport stream
  • DMB digital multimedia broadcasting
  • the present invention proposes an apparatus and method of providing high-quality multimedia services in digital multimedia broadcasting (DMB), by which a function for providing high-quality services is added to DMB and compatibility with a conventional DMB network is possible so that a predetermined quality can be maintained with the conventional DMB network even without special machine changes.
  • DMB digital multimedia broadcasting
  • a transmission device for providing high-quality multimedia services in a DMB (digital multimedia broadcasting) transmission system, the transmission device comprising: an encoding unit separating input multimedia contents into a base layer ES (elementary stream) and an enhancement layer ES and encoding the base layer ES and the enhancement layer ES, respectively; an SL (synchronization layer) packet transform unit transforming the base layer ES and the enhancement layer ES into a base layer SL packet and an enhancement layer SL packet, respectively; a PES (program specific information) packet transform unit transforming the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet, respectively; and a TS (transport stream) multiplexing unit multiplexing the base layer PES packet and the enhancement layer PES packet, respectively, according to a base layer ES and an enhancement layer ES and outputting a base layer TS packet and an enhancement layer TS packet.
  • a receiving device for providing high-quality multimedia services in a DMB transmission system, the receiving device comprising: a quality selection unit determining whether only a base layer stream is to be received or both the base layer stream and an enhancement layer stream are to be received; a decoding unit decoding the base layer stream and the enhancement layer stream, respectively, and outputting a base layer TS packet and an enhancement layer TS packet, respectively; a TS de-multiplexing unit de-multiplexing the base layer and enhancement layer TS packets, respectively, so as to obtain a base layer PES packet and an enhancement layer PES packet, respectively; a PES de-packet transform unit decoding the base layer and enhancement layer PES packets, respectively, so as to obtain a base layer SL packet and an enhancement layer SL packet, respectively; and an SL de-packet transform unit multiplexing the base layer and enhancement SL packets so as to obtain a base layer ES and an enhancement layer ES.
  • a transmission method for providing high-quality multimedia services in a DMB transmission system comprising: separating input multimedia contents into a base layer ES and an enhancement layer ES and encoding the base layer ES and the enhancement layer ES; transforming the base layer ES and the enhancement layer ES into a base layer SL packet and an enhancement layer SL packet; transforming the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet; and multiplexing the base layer PES packet and the enhancement layer PES packet according to a base layer ES and an enhancement layer ES and outputting a base layer TS packet and an enhancement layer TS packet.
  • a receiving method for providing high-quality multimedia services in a DMB transmission system comprising: a quality selection operation of determining whether only a base layer stream is to be received or both the base layer stream and an enhancement layer stream are to be received; a decoding operation of decoding the base layer stream and the enhancement layer stream and outputting a base layer TS packet and an enhancement layer TS packet; a TS de-multiplexing operation of de-multiplexing the base layer and enhancement layer TS packets so as to obtain a base layer PES packet and an enhancement layer PES packet; a PES de-packet transform operation of decoding the base layer and enhancement layer PES packets so as to obtain a base layer SL packet and an enhancement layer SL packet; and an SL de-packet transform operation of multiplexing the base layer and enhancement SL packets so as to obtain a base layer ES and an enhancement layer ES.
  • FIG. 1 is a block diagram illustrating a structure of a media processor of a conventional transmission unit in digital multimedia broadcasting (DMB).
  • DMB digital multimedia broadcasting
  • a video encoder encodes an incoming image signal in accordance with the video standard and an audio encoder encodes an incoming audio signal.
  • An initial object descriptor (IOD) generator 110 generates IOD data which is based on the ISO/IEC 14496-1 standard.
  • An object descriptor (OD)/BIFS (binary format for scenes) generator 120 generates an OD/BIFS stream which is based on the ISO/IEC 14496-1 standard.
  • An SL packetizer 130 (SL - synchronization layer) generates an SL packet, which is a packet for synchronization between incoming media streams, and follows the
  • the SL packetizer 130 receives an
  • OD/BIFS stream a video elementary stream (ES), an audio ES, and additional data and generates an OD/BIFS SL packet, a video SL packet, an audio SL packet, and additional data packet corresponding to the OD/BIFS stream, the video ES, the audio ES, and the additional data, respectively.
  • ES video elementary stream
  • audio ES audio ES
  • additional data generates an OD/BIFS SL packet, a video SL packet, an audio SL packet, and additional data packet corresponding to the OD/BIFS stream, the video ES, the audio ES, and the additional data, respectively.
  • a section generator (or a PSI generator 140) (PSI - program specific information) generates a section including received IOD/OD/BIFS, and follows the ISO/IEC 13818-1 standard.
  • the section generator 140 includes a 14496 section packetization unit for packetizing an SL packet (i.e., the OD/BIFS SL packet) into a 14496 section, and a PSI packetization unit for generating PSI information including the IOD data.
  • a PES packetizer 150 receives and PES-packetizes the SL packets, and follows the ISO/IEC 13818-1 standard.
  • a transport stream (TS) multiplexer 160 receives the section and a PES packet, which is a result of the PES packetization, from the section generator 140 and the PES packetizer 150, respectively, and multiplexes the section and the PES packet to an MPEG-2 TS.
  • FIG. 2 is a conceptual diagram illustrating a system for providing high-quality multimedia services in DMB, according to an embodiment of the present invention.
  • multimedia services are multiplexed and transmitted through a single transport stream.
  • a hierarchical modulation function is given to a DMB transmission system so as to separate a TS into a base layer TS and an enhancement layer TS, and thus a conventional TS is transmitted as the base layer TS and additional multimedia service information for high-quality services is transmitted in the enhancement layer TS.
  • basic-quality multimedia services can be provided to low-spec terminals such as cellular phones, and high-quality multimedia services can be provided to high-spec terminals.
  • An encoding unit includes a high-quality video encoder 210, a high-quality audio encoder 220, and an additional data encoder 230.
  • the high-quality video encoder 210 may be a scalable video encoder, a stereo 3D video encoder, a multi-view video encoder, a multi-channel audio encoder, or the like.
  • the high-quality video encoder 210 separates an input stream into a base layer video ES 211 and an enhancement layer video ES 212 and outputs the base layer video ES 211 and the enhancement layer video ES 212 to a media system encoding and multiplexing unit 240.
  • the media system encoding and multiplexing unit 240 multiplexes the base layer video ES 211 and the enhancement layer video ES 212.
  • the high-quality audio encoder 220 separates an input stream into a base layer audio ES and an enhancement layer audio ES and outputs the base layer audio ES and the enhancement layer audio ES to the media system encoding and multiplexing unit 240.
  • the media system encoding and multiplexing unit 240 multiplexes the base layer audio ES and the enhancement layer audio ES.
  • the additional data encoder 230 separates an input stream into a base layer data ES and an enhancement layer data ES and outputs the base layer data ES and the enhancement layer data ES to the media system encoding and multiplexing unit 240.
  • the media system encoding and multiplexing unit 240 multiplexes the base layer data ES and the enhancement layer data ES.
  • the media system encoding and multiplexing unit 240 multiplexes each of the video, audio, and data ESs respectively received from the high-quality video encoder 210, the high-quality audio encoder 220, and the additional data encoder 230 into a base layer and an enhancement layer.
  • a transmission unit 250 can transmit the multiplexed video, audio, and data ESs via either an identical channel or different channels.
  • a decoding unit includes a high-quality video decoder, a high-quality audio decoder, a reception unit, and a media system decoding and de-multiplexing unit 260.
  • FIGS. 3 and 4 illustrate embodiments of media system encoding and multiplexing methods performed in the encoding unit illustrated in FIG. 2, which are proposed in order to provide high-quality multimedia services in DMB.
  • FIG. 5 is a block diagram of a receiving device that performs a decoding and de-multiplexing method corresponding to the encoding and multiplexing method illustrated in FIG. 3.
  • FIGS. 6 and 7 illustrate decoding and de-multiplexing methods performed in a decoding unit in order to provide high-quality multimedia services in DMB, according to embodiments of the present invention.
  • FIG. 8 is a flowchart illustrating the decoding and de-multiplexing method illustrated in FIG. 7.
  • FIG. 9 illustrates a decoding and de-multiplexing method according to another embodiment of the present invention.
  • FIG. 3 is a block diagram of a media system encoding and multiplexing unit in the encoding unit illustrated in FIG. 2, according to one embodiment of the present invention.
  • an SL packetizer 310 receives a base layer ES and an enhancement layer ES from each of the high-quality video encoder 210, the high-quality audio encoder 220, and the additional data encoder 230 and transforms the received base layer ESs and the enhancement layer ESs into base layer SL packets and enhancement layer SL packets.
  • the SL packetizer 310 synchronizes streams (i.e., video, audio, and data ESs) for a base layer with the corresponding streams (i.e., video, audio, and data ESs) for an enhancement layer in a way similar to the way in which the SL packetizer 130 of FIG. 1 synchronizes video, audio, and data streams.
  • time stamp information such as a composition time stamp (CTS) is inserted into the streams based on an identical OCR (Object Clock Reference) inferred from identical system time clocks (STCs).
  • CTS composition time stamp
  • OCR Object Clock Reference
  • a PES packetizer 320 PES-packetizes the received SL packets in the same or similar way as used in the SL packetizer 130 of FIG. 1 , and inserts time stamps such as presentation time stamps (PTSs) into the base layer ESs and the enhancement layer ESs based on an identical system clock in order to perform synchronization.
  • time stamps such as presentation time stamps (PTSs)
  • Each pair of a pair of IOD generators 350 and 351 , a pair of OD/BIFS generators 360 and 361 , and a pair of section generators 370 and 371 exists for a base layer stream and an enhancement layer stream, and each pair generates a base layer stream and an enhancement layer stream.
  • the media system encoding and multiplexing unit of FIG. 3 includes two TS multiplexers, namely, a base layer TS multiplexer 330 and an enhancement layer TS multiplexer 340.
  • the media system encoding and multiplexing unit of FIG. 3 multiplexes packetized PES streams and PSI section/14496 section streams according to a base layer and an enhancement layer.
  • the two TS multiplexers 330 and 340 generate a base layer MEPG-2 TS packet and an enhancement layer MEPG-2 TS packet by using an identical STC, and also generate a program clock reference (PCR)_by using the identical STC.
  • PCR program clock reference
  • a PCR may be inserted into an audio TS packet that is generated by a relatively small amount and at relatively regular intervals. Accordingly, a PTS and an OCR may also be inserted into only an audio stream
  • the multiplexed base layer MPEG-2 TS packet and the multiplexed enhancement layer MPEG-2 TS packet are respectively encoded in channel encoders suitable for a base layer transmission channel and an enhancement transmission channel, and then respectively transmitted to the base layer transmission channel and the enhancement transmission channel.
  • a base layer stream and an enhancement layer stream may be mapped into a single symbol and transmitted to a single radio frequency (RF) channel.
  • RF radio frequency
  • the base layer PSI information 380 which corresponds to the prior art, is transmitted without changes, and only PMT/OD/BIFS information added for an enhancement layer is extracted and included in the enhancement layer PSI information 381.
  • a receiving terminal can extract corresponding packets from MPEG-2 TSs of the two layers by using the base layer PSI information 380 and the enhancement layer PSI information 381.
  • the conventional base layer PSI information 380 is transmitted without changes, and the enhancement layer PSI information 381 contains extended PMT/OD/BIFS information obtained by adding information for an enhancement layer to PMT/OD/BIFS information for a basic layer.
  • the receiving terminal can extract corresponding packets from MPEG-2 TSs of the two layers by using the base layer PSI information 380 and the enhancement layer PSI information 381 including the extended PMT/OD/BIFS information.
  • high-quality services when provision of high-quality services is selected, high-quality services can be simply provided through only an analysis of enhancement layer PSI information without need to analyze base layer PSI information.
  • the operation of extracting information required for an enhancement layer can be simplified by not performing a process of analyzing the base layer PSI information.
  • FIG. 4 is a block diagram for illustrating a media system encoding and multiplexing method performed in an encoding unit, according to another embodiment of the present invention.
  • the media system encoding and multiplexing method illustrated in FIG. 4 is the same as that illustrated in FIG. 3 in terms of synchronization, and is different therefrom in that a base layer and an enhancement layer share a single IOD generator, a single OD/BIFS generator, and a section generator.
  • IOD, OD, and BIFS which are additional data transmitted from a transmission side, are transmitted through only a base layer so that a terminal extracts ESs for two layers (i.e., a base layer and an enhancement layer) and constructs a scene by using the extracted ESs, thereby increasing transmission efficiency.
  • IOD, OD, and BIFS which are relatively small amounts of data required for the two layers, are transmitted through only a single channel (i.e., a base layer channel), overhead generated due to packetization performed in each stage can be reduced.
  • FIG. 5 is a block diagram of a receiving device that performs a decoding and de-multiplexing method corresponding to the encoding and multiplexing method illustrated in FIG. 3, according to one embodiment of the present invention.
  • a base layer stream and an enhancement layer stream received via a single transmission channel or different transmission channels due to hierarchical modulation or the like are decoded by corresponding channel decoders. Then, the decoded base layer stream is divided into section data and PES streams by a base layer TS demultiplexer 510, and the decoded enhancement layer stream is divided into section data and PES streams by an enhancement layer TS demultiplexer 511.
  • synchronization between streams inferred from an identical time clock can be achieved based on the value of a PCR inserted into an audio TS packet which is transmitted at relatively regular intervals.
  • FIG. 6 is a flowchart illustrating the decoding and de-multiplexing method performed in the receiving device of FIG. 5.
  • program map table (PMT) information included in the PAT is interpreted in order to search for a PMT from a base layer TS.
  • the found PMT is interpreted in order to extract a relation table that shows identifiers ESJD of various types of ESs and packet identifiers (PIDs).
  • TS packets of different types are separated from each other by referring to corresponding PIDs according to the extracted relation table, and then ES information is extracted from each of the separated TS packets. Then, ODs included in the ES information are interpreted so as to write a list of related information about each object and each ES.
  • an enhancement layer TS packet is extracted simultaneously with initial extraction of a base layer TS packet, and synchronization between the base layer TS packet and the enhancement layer TS packet is primarily performed.
  • operation S650 includes S651 through S654, similar to operation S640 performed when basic services are provided, a PAT and a PMT which are transmitted in the enhancement layer TS packet are interpreted, and thus each type of ES transmitted via an enhancement layer channel is extracted and a list of information about each object and each ES is written.
  • the extracted ESs (e.g., a video ES, an audio ES, and a data ES) from a base layer and an enhancement layer are combined with related information about the extracted ESs. Thereafter, in operations S670 and S680, a video and/or audio stream is decoded and constructs a scene before the data is reproduced.
  • FIG. 7 illustrates a receiving device that performs a decoding and de-multiplexing method according to another embodiment of the present invention, when information such as IOD, OD/BIFS, etc., is inserted into the bitstream and transmitted through one of a base layer and an enhancement layer.
  • the decoding and de-multiplexing method performed in the receiving device illustrated in FIG. 7 corresponds to the encoding and multiplexing method illustrated in FIG. 4.
  • the receiving device illustrated in FIG. 7 is different from the receiving device according to the first embodiment illustrated in FIG. 5 in that a section interpreter for interpreting enhancement layer IOD and OD/BIFS information is not included and information about an enhancement layer is incorporated into a PSI section for a base layer and transmitted. Accordingly, the receiving device illustrated in FIG. 7 extracts the enhancement layer IOD and OD/BIFS information from the base layer PSI section and transmits the extracted information to a scene construction unit.
  • FIG. 8 is a flowchart illustrating the decoding and de-multiplexing method performed in the receiving device of FIG. 7.
  • the decoding and de-multiplexing method illustrated in FIG. 8 is the same as that illustrated in FIG. 6.
  • the decoding and de-multiplexing method illustrated in FIG. 8 is different from that illustrated in FIG. 6 in that interpretations of a PMT and an OD are performed for only the base layer and pieces of information about the two layers are simultaneously extracted based on the interpretations and thus only incorporation of different types of ESs is performed.
  • both a mapping relationship between base layer streams and a mapping relationship between enhancement layer streams are added to a first loop and a second loop and described therein.
  • a receiving terminal extracts corresponding packets from a base layer MPEG-2 TS and an enhancement layer MPEG-2 TS by using the added mapping relationships.
  • an OD stream is also transmitted through only the basic layer, and an ES Descriptor described to construct a scene is additionally inserted into the base layer MPEG-2 TS so as to describe both a video ES, an audio ES, and a data ES for a base layer and a video ES, an audio ES, and a data ES for an enhancement layer.
  • a PCR may be inserted into an audio TS packet that is generated by a relatively small amount and at relatively regular intervals. Accordingly, even a PTS and an OCR may be inserted into only an audio stream
  • FIG. 9 illustrates a decoding and de-multiplexing method according to another embodiment of the present invention.
  • a PMT is made up of two types of loops, namely, first and second loops 910 and
  • the first loop 910 is made up of ES_Descriptors including contents about a scene description and an object description, and the second loop 920 maps PIDs,
  • both the mapping relationship between base layer streams and the mapping relationship between enhancement layer streams are added to the two loops and described therein.
  • the receiving device extracts corresponding packets from a base layer MPEG-2 TS and an enhancement layer MPEG-2 TS by using the added mapping relationships.
  • an OD stream is also transmitted through only a base layer channel, and an ES_Descriptor described to construct a scene is additionally inserted into the base layer MPEG-2 TS so as to describe both a video ES, an audio ES, and a data ES for a base layer and a video ES, an audio ES, and a data ES for an enhancement layer.
  • FIG. 10 illustrates an MPEG-4 OD according to an embodiment of the present invention.
  • a base layer stream and an enhancement layer stream may be defined as different ODs. However, in the present embodiment, two ES descriptors for a base layer and an enhancement are included in a single OD in a subordinate relationship.
  • This subordinate relationship may be expressed using "StreamDependanceFlag” and "dependsOn_ES_ID” of an MPEG-4 ES descriptor.
  • a location of an ES is designated using URL FIag in order to express that the ES itself exists in an enhancement layer.
  • a conventional terminal that recognizes only a base layer fails to recognize "ObjectTypelndication” information for an enhancement layer and thus secures compatibility.
  • a terminal for high-quality multimedia services according to the present invention recognizes the existence of a dependent stream and "ObjectTypelndication” information and thus also properly receives an enhancement layer stream.
  • FIG. 11 is a block diagram of a transmission device 1100 for providing high-quality multimedia services in a DMB transmission system, according to an exemplary embodiment of the present invention.
  • the transmission device 1100 includes an encoding unit 1110, an SL packet transform unit 1120, a PES packet transform unit 1130, and a TS multiplexing unit 1140.
  • the encoding unit 1110 separates input multimedia contents into a base layer ES and an enhancement layer ES and encodes the base layer ES and the enhancement layer ES.
  • the SL packet transform unit 1120 transforms the base layer ES and the enhancement layer ES into a base layer SL packet and an enhancement layer SL packet and performs synchronization between the base layer SL packet and the enhancement layer SL packet.
  • the PES packet transform unit 1130 transforms the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet and performs synchronization between the base layer PES packet and the enhancement layer PES packet.
  • the SL packet transform unit 1120 performs synchronization by inserting time stamp information into the base layer SL packet and the enhancement layer SL packet by using OCR which is ascertained based on an identical STC.
  • the PES packet transform unit 1130 performs synchronization by inserting time stamp information into the base layer PES packet and the enhancement layer PES packet by using the PCR which is ascertained based on an identical STC. For example, the SL packet transform unit 1120 inserts a CTS as the time stamp information, and the PES packet transform unit 1130 inserts a PTS as the time stamp information.
  • the TS multiplexing unit 1140 multiplexes the PES packets according a base layer TS and an enhancement layer TS so as to generate TS packets. At this time, the TS multiplexing unit 1140 performs synchronization by inserting PCRs into the TS packets according to the base layer ES and the enhancement layer ES or by using an identical STC in the base layer ES and the enhancement layer ES.
  • FIG. 12 is a block diagram of a reception device for providing high-quality multimedia services in a DMB transmission system, according to an exemplary embodiment of the present invention.
  • the receiving device includes a quality selection unit 1210, a decoding unit 1220, a TS de-multiplexing unit 1230, a PES de-packet transform unit 1240, and an SL de-packet transform unit 1250.
  • the quality selection unit 1210 determines, based on a selection of a user, whether only a base layer stream is to be received or both the base layer stream and an enhancement layer stream are to be received.
  • the decoding unit 1220 decodes the base layer stream and the enhancement layer stream so as to obtain TS packets.
  • the TS de-multiplexing unit 1230 demultiplexes the TS packets so as to obtain PES packets, and performs synchronization between the PES packets.
  • the F 1 ES de-packet transform unit 1240 decodes the PES packets obtained by the TS de-multiplexing unit 1230 so as to obtain SL packets, and performs synchronization between the SL packets.
  • the SL de-packet transform unit 1250 multiplexes the SL packets according to the base layer ES and the enhancement layer
  • the invention can also be embodied as computer readable codes on a computer readable recording medium.
  • the computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet).
  • the computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
  • the computer-readable media can distribute, sore and execute computer-readable codes in embedded-systems connected via a wireless network such as a sensor node.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Systems (AREA)

Abstract

A transmission device and receiving device for providing high-quality multimedia services in a digital multimedia broadcasting (DMB) transmission system is provided. The transmission device separates input multimedia contents into a base layer elementary stream and an enhancement layer elementary stream, encodes the base layer elementary stream and the enhancement layer elementary stream, transforms the base layer elementary stream and the enhancement layer elementary stream into a base layer SL packet and an enhancement layer SL packet, transforms the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet, and multiplexes the base layer PES packet and the enhancement layer PES packet according to a base layer elementary stream and an enhancement layer elementary stream and outputs a base layer TS packet and an enhancement layer TS packet.

Description

METHOD AND APPARATUS FOR PROVIDING HIGH-QUALITY MULTIMEDIA
SERVICE IN DMB SYSTEM
TECHNICAL FIELD The present invention relates to a media processing method and apparatus for providing high-quality multimedia services, by which a function for providing high-quality services is added to digital multimedia broadcasting and backward compatibility with existing receivers can be maintained.
The present invention is derived from a research project supported by the Information Technology (IT) Research & Development (R&D) program of the Ministry of Information and Communication (MIC) [2006-S-017-02, Development of High-Tech Terrestrial DMB Transmission].
BACKGROUND ART In conventional digital multimedia broadcasting (DMB), a multi-media service is multiplexed into a single transport stream and the multiplexed service is transmitted. In DMB broadcasting, multi-media services are provided through a single stream, and thus there is a limit in providing a high-quality service.
DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram illustrating a structure of a media processor of a conventional transmission unit in digital multimedia broadcasting (DMB);
FIG. 2 is a conceptual diagram illustrating a system for providing high-quality multimedia services in DMB, according to an embodiment of the present invention; FIG. 3 is a block diagram for illustrating an encoding and multiplexing method performed in an encoding unit, according to one embodiment of the present invention;
FIG. 4 is a block diagram for illustrating an encoding and multiplexing method performed in an encoding unit, according to another embodiment of the present invention; FIG. 5 is a block diagram of a receiving device that performs a decoding and de-multiplexing method corresponding to the encoding and multiplexing method illustrated in FIG. 3. FIG. 6 is a flowchart illustrating a decoding and de-multiplexing method performed in a decoding unit, according to one embodiment of the present invention;
FIG. 7 is a block diagram for describing a decoding and de-multiplexing method performed in a decoding unit, according to another embodiment of the present invention;
FIG. 8 is a flowchart of the decoding and de-multiplexing method illustrated in FIG. 7;
FIG. 9 illustrates a decoding and de-multiplexing method according to another embodiment of the present invention; FIG. 10 illustrates an MPEG-4 object descriptor (OD) used in the present invention;
FIG. 11 is a block diagram of a transmission device for providing high-quality multimedia services in a DMB transmission system, according to an exemplary embodiment of the present invention; and FIG. 12 is a block diagram of a reception device for providing high-quality multimedia services in a DMB transmission system, according to an exemplary embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION TECHNICAL PROBLEM
The present invention provides a transceiving method and apparatus by which a function for providing high-quality services is added to digital multimedia broadcasting and backward compatibility with existing receivers can be maintained.
TECHNICAL SOLUTION
The present invention provides a structure in which a transport stream (TS) is separated into a base layer TS and an enhancement layer TS, a conventional TS is transmitted via the base layer TS and additional multimedia service information for high-quality services is multiplexed and transmitted via the enhancement layer TS, so that services transmitted through different transport channels can be incorporated with each other and provided when needed.
In particular, when a hierarchical modulation function is given to a digital multimedia broadcasting (DMB) transmission system in order to divide a transmission mechanism into a base layer and an enhancement layer, basic-quality multimedia services can be provided to low-spec terminals such as cellular phones and high-quality multimedia services can provided to high-spec terminals.
ADVANTAGEOUS EFFECTS
The present invention proposes an apparatus and method of providing high-quality multimedia services in digital multimedia broadcasting (DMB), by which a function for providing high-quality services is added to DMB and compatibility with a conventional DMB network is possible so that a predetermined quality can be maintained with the conventional DMB network even without special machine changes.
BEST MODE
According to an aspect of the present invention, there is provided a transmission device for providing high-quality multimedia services in a DMB (digital multimedia broadcasting) transmission system, the transmission device comprising: an encoding unit separating input multimedia contents into a base layer ES (elementary stream) and an enhancement layer ES and encoding the base layer ES and the enhancement layer ES, respectively; an SL (synchronization layer) packet transform unit transforming the base layer ES and the enhancement layer ES into a base layer SL packet and an enhancement layer SL packet, respectively; a PES (program specific information) packet transform unit transforming the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet, respectively; and a TS (transport stream) multiplexing unit multiplexing the base layer PES packet and the enhancement layer PES packet, respectively, according to a base layer ES and an enhancement layer ES and outputting a base layer TS packet and an enhancement layer TS packet.
According to another aspect of the present invention, there is provided a receiving device for providing high-quality multimedia services in a DMB transmission system, the receiving device comprising: a quality selection unit determining whether only a base layer stream is to be received or both the base layer stream and an enhancement layer stream are to be received; a decoding unit decoding the base layer stream and the enhancement layer stream, respectively, and outputting a base layer TS packet and an enhancement layer TS packet, respectively; a TS de-multiplexing unit de-multiplexing the base layer and enhancement layer TS packets, respectively, so as to obtain a base layer PES packet and an enhancement layer PES packet, respectively; a PES de-packet transform unit decoding the base layer and enhancement layer PES packets, respectively, so as to obtain a base layer SL packet and an enhancement layer SL packet, respectively; and an SL de-packet transform unit multiplexing the base layer and enhancement SL packets so as to obtain a base layer ES and an enhancement layer ES.
According to another aspect of the present invention, there is provided a transmission method for providing high-quality multimedia services in a DMB transmission system, the transmission method comprising: separating input multimedia contents into a base layer ES and an enhancement layer ES and encoding the base layer ES and the enhancement layer ES; transforming the base layer ES and the enhancement layer ES into a base layer SL packet and an enhancement layer SL packet; transforming the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet; and multiplexing the base layer PES packet and the enhancement layer PES packet according to a base layer ES and an enhancement layer ES and outputting a base layer TS packet and an enhancement layer TS packet.
According to another aspect of the present invention, there is provided a receiving method for providing high-quality multimedia services in a DMB transmission system, the receiving method comprising: a quality selection operation of determining whether only a base layer stream is to be received or both the base layer stream and an enhancement layer stream are to be received; a decoding operation of decoding the base layer stream and the enhancement layer stream and outputting a base layer TS packet and an enhancement layer TS packet; a TS de-multiplexing operation of de-multiplexing the base layer and enhancement layer TS packets so as to obtain a base layer PES packet and an enhancement layer PES packet; a PES de-packet transform operation of decoding the base layer and enhancement layer PES packets so as to obtain a base layer SL packet and an enhancement layer SL packet; and an SL de-packet transform operation of multiplexing the base layer and enhancement SL packets so as to obtain a base layer ES and an enhancement layer ES. MODE OF THE INVENTION
The preferred embodiments of the present invention will now be explained with reference to the accompanying drawings. Like reference numerals or symbols in the drawings denote like elements. In order to clarify the sprit of the invention, descriptions of well known functions or constructions may be omitted.
FIG. 1 is a block diagram illustrating a structure of a media processor of a conventional transmission unit in digital multimedia broadcasting (DMB).
A video encoder encodes an incoming image signal in accordance with the video standard and an audio encoder encodes an incoming audio signal. An initial object descriptor (IOD) generator 110 generates IOD data which is based on the ISO/IEC 14496-1 standard. An object descriptor (OD)/BIFS (binary format for scenes) generator 120 generates an OD/BIFS stream which is based on the ISO/IEC 14496-1 standard.
An SL packetizer 130 (SL - synchronization layer) generates an SL packet, which is a packet for synchronization between incoming media streams, and follows the
ISO/IEC 14496-1 system standard. In other words, the SL packetizer 130 receives an
OD/BIFS stream, a video elementary stream (ES), an audio ES, and additional data and generates an OD/BIFS SL packet, a video SL packet, an audio SL packet, and additional data packet corresponding to the OD/BIFS stream, the video ES, the audio ES, and the additional data, respectively.
A section generator (or a PSI generator 140) (PSI - program specific information) generates a section including received IOD/OD/BIFS, and follows the ISO/IEC 13818-1 standard. The section generator 140 includes a 14496 section packetization unit for packetizing an SL packet (i.e., the OD/BIFS SL packet) into a 14496 section, and a PSI packetization unit for generating PSI information including the IOD data.
A PES packetizer 150 (PES - program elementary stream ) receives and PES-packetizes the SL packets, and follows the ISO/IEC 13818-1 standard. A transport stream (TS) multiplexer 160 receives the section and a PES packet, which is a result of the PES packetization, from the section generator 140 and the PES packetizer 150, respectively, and multiplexes the section and the PES packet to an MPEG-2 TS. FIG. 2 is a conceptual diagram illustrating a system for providing high-quality multimedia services in DMB, according to an embodiment of the present invention.
In conventional multimedia broadcasting, multimedia services are multiplexed and transmitted through a single transport stream. However, in the present invention, a hierarchical modulation function is given to a DMB transmission system so as to separate a TS into a base layer TS and an enhancement layer TS, and thus a conventional TS is transmitted as the base layer TS and additional multimedia service information for high-quality services is transmitted in the enhancement layer TS.
Therefore, basic-quality multimedia services can be provided to low-spec terminals such as cellular phones, and high-quality multimedia services can be provided to high-spec terminals.
An encoding unit includes a high-quality video encoder 210, a high-quality audio encoder 220, and an additional data encoder 230.
The high-quality video encoder 210 may be a scalable video encoder, a stereo 3D video encoder, a multi-view video encoder, a multi-channel audio encoder, or the like. The high-quality video encoder 210 separates an input stream into a base layer video ES 211 and an enhancement layer video ES 212 and outputs the base layer video ES 211 and the enhancement layer video ES 212 to a media system encoding and multiplexing unit 240. The media system encoding and multiplexing unit 240 multiplexes the base layer video ES 211 and the enhancement layer video ES 212.
Similarly, the high-quality audio encoder 220 separates an input stream into a base layer audio ES and an enhancement layer audio ES and outputs the base layer audio ES and the enhancement layer audio ES to the media system encoding and multiplexing unit 240. The media system encoding and multiplexing unit 240 multiplexes the base layer audio ES and the enhancement layer audio ES. Similarly, the additional data encoder 230 separates an input stream into a base layer data ES and an enhancement layer data ES and outputs the base layer data ES and the enhancement layer data ES to the media system encoding and multiplexing unit 240.
The media system encoding and multiplexing unit 240 multiplexes the base layer data ES and the enhancement layer data ES.
The media system encoding and multiplexing unit 240 multiplexes each of the video, audio, and data ESs respectively received from the high-quality video encoder 210, the high-quality audio encoder 220, and the additional data encoder 230 into a base layer and an enhancement layer. Thus, a transmission unit 250 can transmit the multiplexed video, audio, and data ESs via either an identical channel or different channels.
A decoding unit includes a high-quality video decoder, a high-quality audio decoder, a reception unit, and a media system decoding and de-multiplexing unit 260.
FIGS. 3 and 4 illustrate embodiments of media system encoding and multiplexing methods performed in the encoding unit illustrated in FIG. 2, which are proposed in order to provide high-quality multimedia services in DMB. FIG. 5 is a block diagram of a receiving device that performs a decoding and de-multiplexing method corresponding to the encoding and multiplexing method illustrated in FIG. 3. FIGS. 6 and 7 illustrate decoding and de-multiplexing methods performed in a decoding unit in order to provide high-quality multimedia services in DMB, according to embodiments of the present invention. FIG. 8 is a flowchart illustrating the decoding and de-multiplexing method illustrated in FIG. 7. FIG. 9 illustrates a decoding and de-multiplexing method according to another embodiment of the present invention.
FIG. 3 is a block diagram of a media system encoding and multiplexing unit in the encoding unit illustrated in FIG. 2, according to one embodiment of the present invention.
In the media system encoding and multiplexing unit 240 of FIG. 2, an SL packetizer 310 receives a base layer ES and an enhancement layer ES from each of the high-quality video encoder 210, the high-quality audio encoder 220, and the additional data encoder 230 and transforms the received base layer ESs and the enhancement layer ESs into base layer SL packets and enhancement layer SL packets. The SL packetizer 310 synchronizes streams (i.e., video, audio, and data ESs) for a base layer with the corresponding streams (i.e., video, audio, and data ESs) for an enhancement layer in a way similar to the way in which the SL packetizer 130 of FIG. 1 synchronizes video, audio, and data streams. For example, in order to perform this synchronization in the SL packetizer 310, time stamp information such as a composition time stamp (CTS) is inserted into the streams based on an identical OCR (Object Clock Reference) inferred from identical system time clocks (STCs).
A PES packetizer 320 PES-packetizes the received SL packets in the same or similar way as used in the SL packetizer 130 of FIG. 1 , and inserts time stamps such as presentation time stamps (PTSs) into the base layer ESs and the enhancement layer ESs based on an identical system clock in order to perform synchronization.
Each pair of a pair of IOD generators 350 and 351 , a pair of OD/BIFS generators 360 and 361 , and a pair of section generators 370 and 371 exists for a base layer stream and an enhancement layer stream, and each pair generates a base layer stream and an enhancement layer stream.
In contrast with the conventional media system encoding and multiplexing unit illustrated in FIG. 1 including the single TS multiplexer 160, the media system encoding and multiplexing unit of FIG. 3 includes two TS multiplexers, namely, a base layer TS multiplexer 330 and an enhancement layer TS multiplexer 340. The media system encoding and multiplexing unit of FIG. 3 multiplexes packetized PES streams and PSI section/14496 section streams according to a base layer and an enhancement layer.
The two TS multiplexers 330 and 340 generate a base layer MEPG-2 TS packet and an enhancement layer MEPG-2 TS packet by using an identical STC, and also generate a program clock reference (PCR)_by using the identical STC. The use of the identical STC enables the two TSs to be synchronized over the entire transceiving system.
In this case, in order to minimize an increase in surplus TS packets that may be generated by inserting a PCR into an MPEG-2 TS packet, a PCR may be inserted into an audio TS packet that is generated by a relatively small amount and at relatively regular intervals. Accordingly, a PTS and an OCR may also be inserted into only an audio stream
Finally, the multiplexed base layer MPEG-2 TS packet and the multiplexed enhancement layer MPEG-2 TS packet are respectively encoded in channel encoders suitable for a base layer transmission channel and an enhancement transmission channel, and then respectively transmitted to the base layer transmission channel and the enhancement transmission channel. When a hierarchical modulation method for use in DMB is used, a base layer stream and an enhancement layer stream may be mapped into a single symbol and transmitted to a single radio frequency (RF) channel. In the embodiment illustrated in FIG. 3, the number of unnecessary transmission packets generated due to duplicate transmission can be minimized by transmitting a PSI which is constructed with only information required for an enhancement layer. More specifically, in a method of constructing base layer PSI information 380 and enhancement layer PSI information 381 according to an embodiment of the present invention, the base layer PSI information 380, which corresponds to the prior art, is transmitted without changes, and only PMT/OD/BIFS information added for an enhancement layer is extracted and included in the enhancement layer PSI information 381. A receiving terminal can extract corresponding packets from MPEG-2 TSs of the two layers by using the base layer PSI information 380 and the enhancement layer PSI information 381.
In another embodiment, the conventional base layer PSI information 380 is transmitted without changes, and the enhancement layer PSI information 381 contains extended PMT/OD/BIFS information obtained by adding information for an enhancement layer to PMT/OD/BIFS information for a basic layer. Thus, the receiving terminal can extract corresponding packets from MPEG-2 TSs of the two layers by using the base layer PSI information 380 and the enhancement layer PSI information 381 including the extended PMT/OD/BIFS information.
According to the present invention, when provision of high-quality services is selected, high-quality services can be simply provided through only an analysis of enhancement layer PSI information without need to analyze base layer PSI information. In addition, the operation of extracting information required for an enhancement layer can be simplified by not performing a process of analyzing the base layer PSI information.
FIG. 4 is a block diagram for illustrating a media system encoding and multiplexing method performed in an encoding unit, according to another embodiment of the present invention. The media system encoding and multiplexing method illustrated in FIG. 4 is the same as that illustrated in FIG. 3 in terms of synchronization, and is different therefrom in that a base layer and an enhancement layer share a single IOD generator, a single OD/BIFS generator, and a section generator.
According to the current embodiment, IOD, OD, and BIFS, which are additional data transmitted from a transmission side, are transmitted through only a base layer so that a terminal extracts ESs for two layers (i.e., a base layer and an enhancement layer) and constructs a scene by using the extracted ESs, thereby increasing transmission efficiency. In other words, since IOD, OD, and BIFS, which are relatively small amounts of data required for the two layers, are transmitted through only a single channel (i.e., a base layer channel), overhead generated due to packetization performed in each stage can be reduced. FIG. 5 is a block diagram of a receiving device that performs a decoding and de-multiplexing method corresponding to the encoding and multiplexing method illustrated in FIG. 3, according to one embodiment of the present invention.
First, a base layer stream and an enhancement layer stream received via a single transmission channel or different transmission channels due to hierarchical modulation or the like are decoded by corresponding channel decoders. Then, the decoded base layer stream is divided into section data and PES streams by a base layer TS demultiplexer 510, and the decoded enhancement layer stream is divided into section data and PES streams by an enhancement layer TS demultiplexer 511.
Since a transmission side has already inserted PCRs into MPEG-2 TSs of the two layers by using an identical STC so that the PCRs are consecutive to one another in each of the MPEG-2 TSs, only one of the base layer TS demultiplexer 510 and the enhancement layer TS demultiplexer 511 extracts the PCRs, and the extracted PCRs are used when the STC is reproduced. In this case, in order to synchronize media reproduction between two layers, the MPEG-2 TSs for the two layers should be synchronized with each other before passing through the base layer TS demultiplexer
510 and the enhancement layer TS demultiplexer 511 , by buffering stream buffers based on the PCR.
In order to achieve this, synchronization between streams inferred from an identical time clock can be achieved based on the value of a PCR inserted into an audio TS packet which is transmitted at relatively regular intervals.
FIG. 6 is a flowchart illustrating the decoding and de-multiplexing method performed in the receiving device of FIG. 5.
[Case where provision of basic services is selected] A flowchart of signals when a user selects provision of only basic services will now be described.
In operations S610 and S611 , when a packet stream encoded using an existing MPEG-4 system is inserted into an MPEG-2 TS and transmitted, a PAT (Program Association Table) in which a PID is 0x0000 is obtained from the MPEG-2 TS in order to access media data which is multiplexed and transmitted.
In operation S630, program map table (PMT) information included in the PAT is interpreted in order to search for a PMT from a base layer TS. The found PMT is interpreted in order to extract a relation table that shows identifiers ESJD of various types of ESs and packet identifiers (PIDs).
In operation S640 and S641 through S644, TS packets of different types are separated from each other by referring to corresponding PIDs according to the extracted relation table, and then ES information is extracted from each of the separated TS packets. Then, ODs included in the ES information are interpreted so as to write a list of related information about each object and each ES.
Thereafter, in operations S670 and S680, a video or audio stream is decoded, a scene is constructed with related information extracted due to the decoding, and data is reproduced.
[Case where provision of high-quality services is selected]
A flowchart of signals when a user selects provision of high-quality services will now be described.
In operations S611 and S621 , when a user selects provision of high-quality services, an enhancement layer TS packet is extracted simultaneously with initial extraction of a base layer TS packet, and synchronization between the base layer TS packet and the enhancement layer TS packet is primarily performed.
In operations S631 and S650, wherein operation S650 includes S651 through S654, similar to operation S640 performed when basic services are provided, a PAT and a PMT which are transmitted in the enhancement layer TS packet are interpreted, and thus each type of ES transmitted via an enhancement layer channel is extracted and a list of information about each object and each ES is written.
In operation S661 , the extracted ESs (e.g., a video ES, an audio ES, and a data ES) from a base layer and an enhancement layer are combined with related information about the extracted ESs. Thereafter, in operations S670 and S680, a video and/or audio stream is decoded and constructs a scene before the data is reproduced.
FIG. 7 illustrates a receiving device that performs a decoding and de-multiplexing method according to another embodiment of the present invention, when information such as IOD, OD/BIFS, etc., is inserted into the bitstream and transmitted through one of a base layer and an enhancement layer.
The decoding and de-multiplexing method performed in the receiving device illustrated in FIG. 7 corresponds to the encoding and multiplexing method illustrated in FIG. 4.
The receiving device illustrated in FIG. 7 is different from the receiving device according to the first embodiment illustrated in FIG. 5 in that a section interpreter for interpreting enhancement layer IOD and OD/BIFS information is not included and information about an enhancement layer is incorporated into a PSI section for a base layer and transmitted. Accordingly, the receiving device illustrated in FIG. 7 extracts the enhancement layer IOD and OD/BIFS information from the base layer PSI section and transmits the extracted information to a scene construction unit.
FIG. 8 is a flowchart illustrating the decoding and de-multiplexing method performed in the receiving device of FIG. 7. When a user selects provision of only basic services, the decoding and de-multiplexing method illustrated in FIG. 8 is the same as that illustrated in FIG. 6. However, when the user selects provision of high-quality services, the decoding and de-multiplexing method illustrated in FIG. 8 is different from that illustrated in FIG. 6 in that interpretations of a PMT and an OD are performed for only the base layer and pieces of information about the two layers are simultaneously extracted based on the interpretations and thus only incorporation of different types of ESs is performed.
In the decoding and de-multiplexing method according to another embodiment of FIG. 8, both a mapping relationship between base layer streams and a mapping relationship between enhancement layer streams are added to a first loop and a second loop and described therein. A receiving terminal extracts corresponding packets from a base layer MPEG-2 TS and an enhancement layer MPEG-2 TS by using the added mapping relationships.
In addition, in the decoding and de-multiplexing method according to another embodiment of FIG. 8, an OD stream is also transmitted through only the basic layer, and an ES Descriptor described to construct a scene is additionally inserted into the base layer MPEG-2 TS so as to describe both a video ES, an audio ES, and a data ES for a base layer and a video ES, an audio ES, and a data ES for an enhancement layer. As illustrated in FIG. 6, in order to minimize an increase in surplus TS packets that may be generated by inserting PCRs into the MPEG-2 TS packets, a PCR may be inserted into an audio TS packet that is generated by a relatively small amount and at relatively regular intervals. Accordingly, even a PTS and an OCR may be inserted into only an audio stream
FIG. 9 illustrates a decoding and de-multiplexing method according to another embodiment of the present invention.
A PMT is made up of two types of loops, namely, first and second loops 910 and
920. The first loop 910 is made up of ES_Descriptors including contents about a scene description and an object description, and the second loop 920 maps PIDs,
Stream_type, etc. of the MPEG-2 TS packets for transmitting ESs which have been described in the ES_Descriptors.
In the decoding and de-multiplexing method according to another embodiment described above in conjunction with FIGS. 7 and 8, both the mapping relationship between base layer streams and the mapping relationship between enhancement layer streams are added to the two loops and described therein. The receiving device extracts corresponding packets from a base layer MPEG-2 TS and an enhancement layer MPEG-2 TS by using the added mapping relationships.
In addition, in the decoding and de-multiplexing method according to the second embodiment, an OD stream is also transmitted through only a base layer channel, and an ES_Descriptor described to construct a scene is additionally inserted into the base layer MPEG-2 TS so as to describe both a video ES, an audio ES, and a data ES for a base layer and a video ES, an audio ES, and a data ES for an enhancement layer.
FIG. 10 illustrates an MPEG-4 OD according to an embodiment of the present invention.
A base layer stream and an enhancement layer stream may be defined as different ODs. However, in the present embodiment, two ES descriptors for a base layer and an enhancement are included in a single OD in a subordinate relationship.
This subordinate relationship may be expressed using "StreamDependanceFlag" and "dependsOn_ES_ID" of an MPEG-4 ES descriptor. A location of an ES is designated using URL FIag in order to express that the ES itself exists in an enhancement layer. The base layer stream, which is an independent stream, is set as "ObjectTypelndication=0x21 (AVC), StreamType=0x04(visual stream)" according to an AVC codec which is a conventional standard. The enhancement layer stream, which is a dependent stream, is encoded according to an SVC codec or any of a plurality of other codecs and is thus set as "ObjectTypelndication=0xC0(user private), StreamType=0x04(visual stream), StreamDependanceFlag=1 , dependsOn_ES_ID=101 (base layer IESJD)".
Existence of the dependent base layer stream in an enhancement layer instead of in a base layer is expressed as "URL_Flag=1 , URLstring[URLIength]= xx (location of enhancement layer)".
Accordingly, a conventional terminal that recognizes only a base layer fails to recognize "ObjectTypelndication" information for an enhancement layer and thus secures compatibility. A terminal for high-quality multimedia services according to the present invention recognizes the existence of a dependent stream and "ObjectTypelndication" information and thus also properly receives an enhancement layer stream.
FIG. 11 is a block diagram of a transmission device 1100 for providing high-quality multimedia services in a DMB transmission system, according to an exemplary embodiment of the present invention. The transmission device 1100 includes an encoding unit 1110, an SL packet transform unit 1120, a PES packet transform unit 1130, and a TS multiplexing unit 1140.
The encoding unit 1110 separates input multimedia contents into a base layer ES and an enhancement layer ES and encodes the base layer ES and the enhancement layer ES.
The SL packet transform unit 1120 transforms the base layer ES and the enhancement layer ES into a base layer SL packet and an enhancement layer SL packet and performs synchronization between the base layer SL packet and the enhancement layer SL packet. The PES packet transform unit 1130 transforms the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet and performs synchronization between the base layer PES packet and the enhancement layer PES packet. The SL packet transform unit 1120 performs synchronization by inserting time stamp information into the base layer SL packet and the enhancement layer SL packet by using OCR which is ascertained based on an identical STC. The PES packet transform unit 1130 performs synchronization by inserting time stamp information into the base layer PES packet and the enhancement layer PES packet by using the PCR which is ascertained based on an identical STC. For example, the SL packet transform unit 1120 inserts a CTS as the time stamp information, and the PES packet transform unit 1130 inserts a PTS as the time stamp information.
The TS multiplexing unit 1140 multiplexes the PES packets according a base layer TS and an enhancement layer TS so as to generate TS packets. At this time, the TS multiplexing unit 1140 performs synchronization by inserting PCRs into the TS packets according to the base layer ES and the enhancement layer ES or by using an identical STC in the base layer ES and the enhancement layer ES.
FIG. 12 is a block diagram of a reception device for providing high-quality multimedia services in a DMB transmission system, according to an exemplary embodiment of the present invention.
The receiving device includes a quality selection unit 1210, a decoding unit 1220, a TS de-multiplexing unit 1230, a PES de-packet transform unit 1240, and an SL de-packet transform unit 1250. The quality selection unit 1210 determines, based on a selection of a user, whether only a base layer stream is to be received or both the base layer stream and an enhancement layer stream are to be received.
The decoding unit 1220 decodes the base layer stream and the enhancement layer stream so as to obtain TS packets. The TS de-multiplexing unit 1230 demultiplexes the TS packets so as to obtain PES packets, and performs synchronization between the PES packets.
The F1ES de-packet transform unit 1240 decodes the PES packets obtained by the TS de-multiplexing unit 1230 so as to obtain SL packets, and performs synchronization between the SL packets. The SL de-packet transform unit 1250 multiplexes the SL packets according to the base layer ES and the enhancement layer
ES.
The invention can also be embodied as computer readable codes on a computer readable recording medium. The computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet). The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. Also, the computer-readable media can distribute, sore and execute computer-readable codes in embedded-systems connected via a wireless network such as a sensor node. While this invention has been particularly shown and described with reference to preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. The preferred embodiments should be considered in descriptive sense only and not for purposes of limitation. Therefore, the scope of the invention is defined not by the detailed description of the invention but by the appended claims, and all differences within the scope will be construed as being included in the present invention.

Claims

1. A transmission device for providing high-quality multimedia services in a DMB (digital multimedia broadcasting) transmission system, the transmission device comprising: an encoding unit separating input multimedia contents into a base layer ES (elementary stream) and an enhancement layer ES and encoding the base layer ES and the enhancement layer ES, respectively; an SL (synchronization layer) packet transform unit transforming the base layer ES and the enhancement layer ES into a base layer SL packet and an enhancement layer SL packet, respectively; a PES (program specific information) packet transform unit transforming the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet, respectively; and a TS (transport stream) multiplexing unit multiplexing the base layer PES packet and the enhancement layer PES packet, respectively, according to a base layer ES and an enhancement layer ES and outputting a base layer TS packet and an enhancement layer TS packet.
2. The transmission device of claim 1 , wherein the SL packet transform unit and the PES packet transform unit respectively perform synchronization between the SL packets and synchronization between the PES packets by, respectively, inserting time stamp information into the SL packets and the PES packets by using OCR (Object Clock Reference) which is ascertained based on an identical STC (system time clock).
3. The transmission device of claim 2, wherein the SL packet transform unit inserts a CTS (composition time stamp) as the time stamp information.
4. The transmission device of claim 2, wherein the PES packet transform unit inserts a PTS (Presentation Time Stamp) as the time stamp information.
5. The transmission device of claim 1 , wherein the TS multiplexing unit uses an identical STC in the base layer ES and the enhancement layer ES when generating the TS packets.
6. The transmission device of claim 1 , wherein the TS multiplexing unit inserts PCRs (Program reference clocks) in the base layer ES and the enhancement layer ES, respectively.
7. The transmission device of claim 1 , further comprising an additional data generation unit for generating additional data for use in scene construction, respectively, on the basis of the base layer ES and the enhancement layer ES separated in the encoding unit.
8. The transmission device of claim 7, further comprising a section generation unit for generating a PSI (PSI - program specific information) section for the base layer ES and a PSI section for the enhancement layer ES, wherein each of the PSI sections comprises the additional data.
9. The transmission device of claim 7, wherein each of the additional data are respectively transmitted to the base layer ES and the enhancement layer ES, wherein, additional data information appended only for an enhancement layer is transmitted to the enhancement layer ES.
10. The transmission device of claim 7, wherein both the additional data for the base layer and for the enhancement layer are transmitted only through the base layer ES, and when the additional data for the enhancement layer is lacking, only the additional data for the base layer is transmitted to the base layer ES.
11. A receiving device for providing high-quality multimedia services in a DMB transmission system, the receiving device comprising: a quality selection unit determining whether only a base layer stream is to be received or both the base layer stream and an enhancement layer stream are to be received; a decoding unit decoding the base layer stream and the enhancement layer stream, respectively, and outputting a base layer TS packet and an enhancement layer TS packet, respectively; a TS de-multiplexing unit de-multiplexing the base layer and enhancement layer TS packets, respectively, so as to obtain a base layer PES packet and an enhancement layer PES packet, respectively; a PES de-packet transform unit decoding the base layer and enhancement layer PES packets, respectively, so as to obtain a base layer SL packet and an enhancement layer SL packet, respectively; and an SL de-packet transform unit multiplexing the base layer and enhancement SL packets so as to obtain a base layer ES and an enhancement layer ES.
12. The receiving device of claim 11 , wherein the PES de-packet transform unit and the SL de-packet transform unit perform synchronization between the PES packets and synchronization between the SL packets, respectively, on the basis of inserted time stamp information that uses OCR which is ascertained based on an identical STC.
13. The receiving device of claim 12, wherein the PES de-packet transform unit performs synchronization by using a PTS inserted as the time stamp information
14. The receiving device of claim 12, wherein the SL de-packet transform unit performs synchronization by using a CTS inserted as the time stamp information.
15. The receiving device of claim 12, wherein the TS de-multiplexing unit performs synchronization by using a PCR included in one of the base layer ES and the enhancement layer ES.
16. The receiving device of claim 11 , wherein additional data for use in scene construction, which has been inserted in a stream transmitted by a transmission unit of the DMB transmission system, is received through each of the base layer ES and the enhancement layer ES, and additional data information added for only the enhancement layer is extracted from the enhancement layer ES.
17. The receiving device of claim 11 , wherein additional data for use in scene construction, which has been inserted in a stream transmitted by a transmission unit of the DMB transmission system, is received through the base layer ES, wherein the additional data information comprises additional data for the base layer and additional data for the enhancement layer.
18. The receiving device of claim 11 , wherein additional data information for use in scene construction, which has been inserted in a stream transmitted by a transmission unit of the DMB transmission system, is received through only the base layer ES.
19. The receiving device of any one of claims 16 through 18, wherein the additional data information comprises PSI, IOD (initial object descriptor), OD, and BIFS (binary format for scenes) information.
20. A transmission method for providing high-quality multimedia services in a DMB transmission system, the transmission method comprising: separating input multimedia contents into a base layer ES and an enhancement layer ES and encoding the base layer ES and the enhancement layer ES; transforming the base layer ES and the enhancement layer ES into a base layer SL packet and an enhancement layer SL packet; transforming the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet; and multiplexing the base layer PES packet and the enhancement layer PES packet according to a base layer ES and an enhancement layer ES and outputting a base layer TS packet and an enhancement layer TS packet.
21. The transmission method of claim 20, wherein the transforming into the SL packets and the transforming into the PES packets comprise performing synchronization between the SL packets and synchronization between the PES packets, respectively, by inserting time stamp information into the SL packets and time stamp information into the PES packets by using OCR which is ascertained based on an identical STC.
22. The transmission method of claim 21 , wherein in the transforming into the SL packets, a CTS is inserted as the time stamp information.
23. The transmission method of claim 21 , wherein in the transforming into the PES packets, a PTS is inserted as the time stamp information.
24. The transmission method of claim 20, wherein in the TS multiplexing, an identical STC in the base layer ES and the enhancement layer ES is used when generating the TS packets.
25. The transmission method of claim 20, wherein in the TS multiplexing, PCRs are inserted into the base layer ES and the enhancement layer ES.
26. The transmission method of claim 20, further comprising generating additional data for use in scene construction on the basis of the base layer ES and the enhancement layer ES obtained in the encoding of the base layer ES and the enhancement layer ES.
27. The transmission method of claim 26, further comprising generating a PSI section for the base layer ES and a PSI section for the enhancement layer ES, wherein each of the PSI sections comprises the additional data.
28. The transmission method of claim 26, wherein the additional data for the base layer and the additional data for the enhancement layer are transmitted to the base layer ES and the enhancement layer ES, respectively.
29. The transmission method of claim 26, wherein both the additional data for the base layer and the additional data for the enhancement layer are transmitted in the base layer ES.
30. A receiving method for providing high-quality multimedia services in a DMB transmission system, the receiving method comprising: a quality selection operation of determining whether only a base layer stream is to be received or both the base layer stream and an enhancement layer stream are to be received; a decoding operation of decoding the base layer stream and the enhancement layer stream and outputting a base layer TS packet and an enhancement layer TS packet; a TS de-multiplexing operation of de-multiplexing the base layer and enhancement layer TS packets so as to obtain a base layer PES packet and an enhancement layer PES packet; a PES de-packet transform operation of decoding the base layer and enhancement layer PES packets so as to obtain a base layer SL packet and an enhancement layer SL packet; and an SL de-packet transform operation of multiplexing the base layer and enhancement SL packets so as to obtain a base layer ES and an enhancement layer ES.
31. The receiving method of claim 30, wherein in the PES de-packet transform operation and the SL de-packet transform operation, synchronization between the PES packets and synchronization between the SL packets are performed, respectively, on the basis of inserted time stamp information that uses OCR which is ascertained based on an identical STC.
32. The receiving method of claim 31 , wherein in the PES de-packet transform operation, synchronization is performed by using a PTS inserted as the time stamp information
33. The receiving method of claim 31 , wherein in the SL de-packet transform operation, synchronization is performed by using a CTS inserted as the time stamp information.
34. The receiving method of claim 31 , wherein in the TS de-multiplexing operation, synchronization is performed by using a PCR included in one of the base layer ES and the enhancement layer ES.
35. The receiving method of claim 30, wherein additional data information for use in scene construction, which has been inserted in a stream transmitted by a transmission unit of the DMB transmission system, is received through each of the base layer ES and the enhancement layer ES, and additional data added for only the enhancement layer is extracted from the enhancement layer ES.
36. The receiving method of claim 30, wherein additional data information for use in scene construction, which has been inserted in a stream transmitted by a transmission unit of the DMB transmission system, is received through the base layer ES, wherein the additional data information comprises additional data for the base layer and additional data for the enhancement layer.
37. The receiving method of claim 30, wherein additional data information for use in scene construction, which has been inserted in a stream transmitted by a transmission unit of the DMB transmission system, is received through only the base layer ES.
38. The receiving method of any one of claims 35 through 37, wherein the additional data information comprises PSI, IOD, OD, and BIFS information.
EP08753313A 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system Ceased EP2153645A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR20070043734 2007-05-04
KR1020080041434A KR20080098328A (en) 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system
PCT/KR2008/002516 WO2008136623A1 (en) 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system

Publications (2)

Publication Number Publication Date
EP2153645A1 true EP2153645A1 (en) 2010-02-17
EP2153645A4 EP2153645A4 (en) 2011-07-27

Family

ID=40285873

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08753313A Ceased EP2153645A4 (en) 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system

Country Status (4)

Country Link
EP (1) EP2153645A4 (en)
KR (1) KR20080098328A (en)
CN (1) CN101690200B (en)
WO (1) WO2008136623A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10931980B2 (en) 2016-07-19 2021-02-23 Electronics And Telecommunications Research Institute Method and apparatus for providing 360 degree virtual reality broadcasting service

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101201206B1 (en) * 2008-12-22 2012-11-15 한국전자통신연구원 Apparatus and method for multiplexing and demultiplexing based on digital multimedia broadcasting
KR101289886B1 (en) * 2009-02-03 2013-07-24 한국전자통신연구원 Methode of transmitting signal, device of transmitting signal, method of receiving signal and device of receiving signal for digital multimedia broadcasting serivce
KR101683119B1 (en) * 2009-06-16 2016-12-06 엘지전자 주식회사 Broadcast transmitter, Broadcast receiver and 3D video processing method thereof
KR101368468B1 (en) * 2010-02-10 2014-03-03 한국전자통신연구원 Apparatus and method for transmitting and receiving broadcasting signal
WO2011097754A1 (en) * 2010-02-11 2011-08-18 上海贝尔股份有限公司 Transmission method and device for scalable coding stream in relay network
KR101977689B1 (en) * 2010-08-19 2019-05-14 삼성전자주식회사 Apparatus and method for encoding/decoding multi-layer videos
CN102480634B (en) * 2010-11-24 2015-12-16 中兴通讯股份有限公司 The method, apparatus and system that in Mobile Multimedia Broadcasting, classified service is synchronous
WO2013108954A1 (en) * 2012-01-20 2013-07-25 전자부품연구원 Method for transmitting and receiving program configuration information for scalable ultra high definition video service in hybrid transmission environment, and method and apparatus for effectively transmitting scalar layer information
US9088813B2 (en) * 2013-10-07 2015-07-21 Ericsson Television Inc. Network personal video recorder savings with scalable video coding
JP6505413B2 (en) * 2013-11-08 2019-04-24 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Transmission method, reception method, transmission apparatus, and reception apparatus
KR101656193B1 (en) * 2015-08-11 2016-09-22 서울여자대학교 산학협력단 MMT-based Broadcasting System and Method for UHD Video Streaming over Heterogeneous Networks
WO2018016879A1 (en) * 2016-07-19 2018-01-25 한국전자통신연구원 Method and device for providing 360-degree virtual reality broadcasting service
WO2018186525A1 (en) * 2017-04-07 2018-10-11 주식회사 아이리버 Modular signal conversion apparatus having synchronized clock, and data processing apparatus
CN107197390B (en) * 2017-05-27 2019-11-12 上海东方明珠广播电视研究发展有限公司 Wireless signal emission system, method, method for receiving and processing signal and terminal

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6590902B1 (en) * 1998-09-03 2003-07-08 Hitachi, Ltd. Layer-coded data transmitting apparatus
WO2004051959A1 (en) * 2002-12-04 2004-06-17 Koninklijke Philips Electronics N.V. Packetization of layered media bitstreams
US6785330B1 (en) * 1999-08-19 2004-08-31 Ghildra Holdings, Inc. Flexible video encoding/decoding method
US7133449B2 (en) * 2000-09-18 2006-11-07 Broadcom Corporation Apparatus and method for conserving memory in a fine granularity scalability coding system
EP1742476A1 (en) * 2005-07-06 2007-01-10 Thomson Licensing Scalable video coding streaming system and transmission mechanism of the same system
US20070081586A1 (en) * 2005-09-27 2007-04-12 Raveendran Vijayalakshmi R Scalability techniques based on content information

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7116717B1 (en) * 1999-12-15 2006-10-03 Bigband Networks, Inc. Method and system for scalable representation, storage, transmission and reconstruction of media streams
KR100587324B1 (en) * 2003-06-14 2006-06-08 엘지전자 주식회사 Method for servicing digital multimedia broadcasting, transmitter/receiver, and data structure
KR100585933B1 (en) * 2003-08-20 2006-06-01 한국전자통신연구원 System ? Method for Digital Multimedia Broadcasting
KR101407748B1 (en) * 2004-10-13 2014-06-17 톰슨 라이센싱 Method and apparatus for complexity scalable video encoding and decoding
KR100760260B1 (en) * 2005-02-04 2007-09-19 한국전자통신연구원 Apparatus and Method for creating transport stream for efficient transmission of timing information, and DMB transmission system using it

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6590902B1 (en) * 1998-09-03 2003-07-08 Hitachi, Ltd. Layer-coded data transmitting apparatus
US6785330B1 (en) * 1999-08-19 2004-08-31 Ghildra Holdings, Inc. Flexible video encoding/decoding method
US7133449B2 (en) * 2000-09-18 2006-11-07 Broadcom Corporation Apparatus and method for conserving memory in a fine granularity scalability coding system
WO2004051959A1 (en) * 2002-12-04 2004-06-17 Koninklijke Philips Electronics N.V. Packetization of layered media bitstreams
EP1742476A1 (en) * 2005-07-06 2007-01-10 Thomson Licensing Scalable video coding streaming system and transmission mechanism of the same system
US20070081586A1 (en) * 2005-09-27 2007-04-12 Raveendran Vijayalakshmi R Scalability techniques based on content information

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
"Digital Audio Broadcasting (DAB); DMB video service; User Application Specification European Broadcasting Union Union Européenne de Radio-Télévision EBUÜER; ETSI TS 102 428", IEEE, LIS, SOPHIA ANTIPOLIS CEDEX, FRANCE, vol. BC, no. V1.1.1, 1 January 2005 (2005-01-01), XP014030465, ISSN: 0000-0001 *
International Organisation for Standardisation: "MPEG-4 Overview (V.21 - Jeju Version)", ISO/IEC JTC1/SC29/WG11 , March 2002 (2002-03), pages 1-44, XP002637618, Retrieved from the Internet: URL:http://mpeg.chiariglione.org/standards/mpeg-4/mpeg-4.htm [retrieved on 2011-05-18] *
Pourmohammadi, Y. et al.: "Streaming MPEG-4 over IP and Broadcast Networks: DMIF Based Architectures", Proceedings of the 11th International Packet Video Workshop 30 April - 1 May 2001 , 1 May 2001 (2001-05-01), pages 218-227, XP002637617, Kyungju, Korea Retrieved from the Internet: URL:http://lan.ece.ubc.ca/DMIF-PV2001.pdf [retrieved on 2011-05-18] *
See also references of WO2008136623A1 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10931980B2 (en) 2016-07-19 2021-02-23 Electronics And Telecommunications Research Institute Method and apparatus for providing 360 degree virtual reality broadcasting service

Also Published As

Publication number Publication date
WO2008136623A1 (en) 2008-11-13
KR20080098328A (en) 2008-11-07
CN101690200A (en) 2010-03-31
EP2153645A4 (en) 2011-07-27
CN101690200B (en) 2012-06-20

Similar Documents

Publication Publication Date Title
EP2153645A1 (en) Method and apparatus for providing high-quality multimedia service in dmb system
KR101639358B1 (en) Transmission apparatus and method, and reception apparatus and method for providing 3d service using the content and additional image seperately transmitted with the reference image transmitted in real time
US8422564B2 (en) Method and apparatus for transmitting/receiving enhanced media data in digital multimedia broadcasting system
JP5575949B2 (en) Broadcast data transmission method and apparatus
KR100552678B1 (en) Apparauts and method for transmitting and receiving with reducing the setup time of data packet
US9210354B2 (en) Method and apparatus for reception and transmission
RU2674890C2 (en) Transmission apparatus, transmission method, reception apparatus, reception method, encoding apparatus, and encoding method
WO2015029754A1 (en) Transmission device, transmission method, receiving device, and receiving method
MX2012008816A (en) Method and apparatus for generating data stream for providing 3-dimensional multimedia service, and method and apparatus for receiving the data stream.
EP3179730B1 (en) Transmission method, reception method, transmission device, and reception device
KR20170087868A (en) Transmission device, transmission method, reception device, and reception method
EP2685729A2 (en) Transmission device and method for providing program-linked stereoscopic broadcasting service, and reception device and method for same
CN112954435B (en) Receiving apparatus and receiving method
US20230188767A1 (en) Transmission device, transmission method, reception device, and reception method
US20100315486A1 (en) Stereoscopic video service providing/receiving method and apparatus in digital broadcasting system
KR100799592B1 (en) Apparatus and method of hierarachical modulation for scalable video bit stream
KR101201206B1 (en) Apparatus and method for multiplexing and demultiplexing based on digital multimedia broadcasting
EP2084704A1 (en) Apparatus and method for transmitting or replaying multi-channel audio signal
KR20130056829A (en) Transmitter/receiver for 3dtv broadcasting, and method for controlling the same
KR20110068821A (en) Method and apparatus for receiving and transmitting
KR101204112B1 (en) Method for transmitting/receiving in digital multimedia broadcasting system and apparatus thereof
KR101808672B1 (en) Transmission apparatus and method, and reception apparatus and method for providing 3d service using the content and additional image seperately transmitted with the reference image transmitted in real time

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20091126

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

RIN1 Information on inventor provided before grant (corrected)

Inventor name: LEE, SOO-IN

Inventor name: LIM, JONG-SOO

Inventor name: SEO, JAE-HYUN

Inventor name: KIM, JU-YEUN

Inventor name: CHOI, SEOMEE

Inventor name: BAE, JAE-HWUI

Inventor name: YANG, KYU-TAE

Inventor name: KIM, YOUNG-SU

Inventor name: YUN, JOUNGIL

Inventor name: LEE, GWANG-SOON

Inventor name: KIM, KWANG-YONG

RIN1 Information on inventor provided before grant (corrected)

Inventor name: LEE, SOO-IN

Inventor name: LIM, JONG-SOO

Inventor name: SEO, JAE-HYUN

Inventor name: KIM, JU-YEUN

Inventor name: CHOI, SEOMEE

Inventor name: BAE, JAE-HWUI

Inventor name: YANG, KYU-TAE

Inventor name: KIM, YOUNG-SU

Inventor name: YUN, JOUNGIL

Inventor name: LEE, GWANG-SOON

Inventor name: KIM, KWANG-YONG

DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: H04N0007015000

Ipc: H04N0007520000

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 7/015 20060101ALI20110524BHEP

Ipc: H04N 7/24 20110101ALI20110524BHEP

Ipc: H04N 7/52 20110101AFI20110524BHEP

A4 Supplementary search report drawn up and despatched

Effective date: 20110624

17Q First examination report despatched

Effective date: 20131007

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20150618