CN101690200B - Method and apparatus for providing high-quality multimedia service in dmb system - Google Patents

Method and apparatus for providing high-quality multimedia service in dmb system Download PDF

Info

Publication number
CN101690200B
CN101690200B CN2008800231475A CN200880023147A CN101690200B CN 101690200 B CN101690200 B CN 101690200B CN 2008800231475 A CN2008800231475 A CN 2008800231475A CN 200880023147 A CN200880023147 A CN 200880023147A CN 101690200 B CN101690200 B CN 101690200B
Authority
CN
China
Prior art keywords
layer
enhancement layer
groups
basal layer
pes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2008800231475A
Other languages
Chinese (zh)
Other versions
CN101690200A (en
Inventor
金光勇
李光淳
尹正日
金永受
杨圭台
裵在辉
崔序米
金柱延
徐在贤
林钟秀
李寿寅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics and Telecommunications Research Institute ETRI filed Critical Electronics and Telecommunications Research Institute ETRI
Publication of CN101690200A publication Critical patent/CN101690200A/en
Application granted granted Critical
Publication of CN101690200B publication Critical patent/CN101690200B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43074—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614—Multiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2362—Generation or processing of Service Information [SI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4345—Extraction or processing of SI, e.g. extracting service information from an MPEG stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/44029—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display for generating different versions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network
    • H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H2201/00—Aspects of broadcast communication
    • H04H2201/10—Aspects of broadcast communication characterised by the type of broadcast system
    • H04H2201/11—Aspects of broadcast communication characterised by the type of broadcast system digital multimedia broadcasting [DMB]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A transmission device and receiving device for providing high-quality multimedia services in a digital multimedia broadcasting (DMB) transmission system is provided. The transmission device separates input multimedia contents into a base layer elementary stream and an enhancement layer elementary stream, encodes the base layer elementary stream and the enhancement layer elementary stream, transforms the base layer elementary stream and the enhancement layer elementary stream into a base layer SL packet and an enhancement layer SL packet, transforms the base layer SL packet and the enhancement layer SL packet into a base layer PES packet and an enhancement layer PES packet, and multiplexes the base layer PES packet and the enhancement layer PES packet according to a base layer elementary stream and an enhancement layer elementary stream and outputs a base layer TS packet and an enhancement layer TS packet.

Description

Be used for providing the method and apparatus of high-quality multimedia service at digital multimedia broadcasting system
Technical field
The present invention relates to be used to provide the media processing method and the equipment of high-quality multimedia service, utilize said method and apparatus, add to DMB and be used to provide the function of high-quality service, and can keep the backwards compatibility with existing receiver.
The present invention stems from the research project of being supported by the information technology of information communication portion (MIC) (IT) research and development (R&D) plan [2006-S-017-02, Development of High-Tech TerrestrialDMB Transmission].
Background technology
In conventional digital multimedia broadcasting (DMB), multimedia service is multiplexed as single transport stream and transmits the service after multiplexed.In DMB broadcasting, through single stream multimedia service is provided, and in high-quality service is provided, has restriction thus.
Description of drawings
Fig. 1 is the block diagram of structure that illustrates the Media Processor of the traditional delivery unit in the DMB (DMB);
Fig. 2 is the concept map that is used for providing at DMB the system of high-quality multimedia service that illustrates according to the embodiment of the invention;
Fig. 3 is used for illustrating according to an embodiment of the invention the coding carried out at coding unit and the block diagram of multichannel multiplexing method;
Fig. 4 is used for illustrating according to another embodiment of the present invention the coding carried out at coding unit and the block diagram of multichannel multiplexing method;
Fig. 5 be carry out with Fig. 3 in the block diagram of receiving system of the corresponding decoding reconciliation multichannel multiplexing method of illustrated coding and multichannel multiplexing method;
Fig. 6 illustrates the flow chart that multichannel multiplexing method is conciliate in the decoding of in decoding unit, carrying out according to an embodiment of the invention;
Fig. 7 is used for describing the block diagram that multichannel multiplexing method is conciliate in the decoding of carrying out at decoding unit according to another embodiment of the present invention;
Fig. 8 is the flow chart that multichannel multiplexing method is conciliate in illustrated decoding among Fig. 7;
Fig. 9 illustrates decoding according to another embodiment of the present invention and conciliates multichannel multiplexing method;
Figure 10 illustrates the MPEG-4 Object Descriptor (OD) that uses among the present invention;
Figure 11 is the block diagram that is used for providing at the DMB transfer system conveyer of high-quality multimedia service of the example embodiment according to the present invention; With
Figure 12 is the block diagram that is used for providing at the DMB transfer system receiving system of high-quality multimedia service of the example embodiment according to the present invention.
Summary of the invention
Technical problem
The invention provides a kind of receiving/transmission method and equipment, utilize said method and apparatus, add to DMB and be used to provide the function of high-quality service, and can keep the backwards compatibility with existing receiver.
Technical scheme
The invention provides a kind of structure; Wherein MPTS (TS) is separated into basal layer TS and enhancement layer TS; Transmit traditional TS via basal layer TS; And the additional multimedia service information that is used for high-quality service is made the service that transmits through different transmission channels to merge each other, and provides when needed by multiplexed and transmit via enhancement layer TS.
Specifically; When being divided into basal layer and enhancement layer when giving DMB (DMB) transfer system so that with transfer mechanism with the hierarchical modulation function; Can the gross multimedia service be provided to for example low specification (low-spec) terminal of mobile phone, and can the high-quality multimedia service be provided to high standard (high-spec) terminal.
Advantageous effects
The present invention proposes the equipment and the method that are used for providing the high-quality multimedia service at DMB (DMB); Utilize said equipment and method; Add the function that is used to provide high-quality service to DMB; And with the compatibility of traditional DMB network be possible, make can in addition do not have under the situation that particular machine changes, utilize traditional DMB network to keep predetermined quality.
Optimal mode
According to an aspect of the present invention; A kind of conveyer that is used for providing at DMB (DMB) transfer system the high-quality multimedia service is provided; This conveyer comprises: coding unit; Be used for to import content of multimedia and be separated into basal layer ES (basic stream) and enhancement layer ES, and said basal layer ES and enhancement layer ES are encoded respectively; SL (layer, sync) converter unit of packing is used for that said basal layer ES and enhancement layer ES are transformed to basal layer SL respectively and divides into groups and enhancement layer SL grouping; PES (Program Specific Information) converter unit of packing is used for said basal layer SL divided into groups to divide into groups to be transformed to respectively with enhancement layer SL that basal layer PES divides into groups and enhancement layer PES grouping; And the multiplexed unit of TS (MPTS), be used for said basal layer PES being divided into groups and enhancement layer PES divides into groups to carry out respectively multiplexed according to basal layer ES and enhancement layer ES, and output basal layer TS divides into groups and enhancement layer TS grouping.
According to a further aspect in the invention; A kind of receiving system that is used for providing at the DMB transfer system high-quality multimedia service is provided; This receiving system comprises: the quality selected cell, and base layer stream still will receive base layer stream and enhancement layer stream to be used for confirming only to receive; Decoding unit is used for base layer stream and enhancement layer stream are decoded respectively, and exports basal layer TS grouping and enhancement layer TS grouping respectively; TS separates multiplexed unit, is used for said basal layer and enhancement layer TS are divided into groups to separate respectively multiplexed, divides into groups and enhancement layer PES grouping so that obtain basal layer PES respectively; PES unpacks converter unit, is used for said basal layer and enhancement layer PES are divided into groups to decode respectively, and basal layer SL divides into groups and enhancement layer SL divides into groups so that obtain respectively; Unpack converter unit with SL, be used for to said basal layer with strengthen SL divide into groups to carry out respectively multiplexed so that obtain basal layer ES and enhancement layer ES.
According to a further aspect in the invention; A kind of transfer approach that is used for providing at the DMB transfer system high-quality multimedia service is provided; This transfer approach comprises: will import content of multimedia and be separated into basal layer ES and enhancement layer ES, and said basal layer ES and enhancement layer ES are encoded; Said basal layer ES and enhancement layer ES are transformed to basal layer SL grouping and enhancement layer SL grouping; Said basal layer SL grouping and enhancement layer SL are divided into groups to be transformed to basal layer PES grouping and enhancement layer PES grouping; With according to basal layer ES and enhancement layer ES said basal layer PES is divided into groups and enhancement layer PES divides into groups to carry out multiplexed, and output basal layer TS divides into groups and enhancement layer TS grouping.
According to a further aspect in the invention; A kind of method of reseptance that is used for providing at the DMB transfer system high-quality multimedia service is provided; This method of reseptance comprises: the quality selection operation, and base layer stream still will receive base layer stream and enhancement layer stream to be used for confirming only to receive; Decode operation is used for base layer stream and enhancement layer stream are decoded, and output basal layer TS divides into groups and enhancement layer TS divides into groups; TS separates multiplex operation, is used for said basal layer and enhancement layer TS are divided into groups to separate multiplexed, divides into groups and enhancement layer PES grouping so that obtain basal layer PES; PES unpacks map function, is used for said basal layer and enhancement layer PES are divided into groups to decode, and basal layer SL divides into groups and enhancement layer SL divides into groups so that obtain; Unpack map function with SL, be used for to said basal layer with strengthen SL divide into groups to carry out multiplexed so that obtain basal layer ES and enhancement layer ES.
Embodiment
Explain the preferred embodiments of the present invention referring now to accompanying drawing.Same reference numerals among the figure or symbolic representation similar elements.In order to illustrate spirit of the present invention, the description that can omit known function or structure.
Fig. 1 is the block diagram of structure that illustrates the Media Processor of the traditional delivery unit in the DMB (DMB).
Video encoder is encoded to getting into picture signal according to video standard, and audio coder is to getting into coding audio signal.
The IOD data that initial object descriptor (IOD) generator 110 generates based on ISO/IEC 14496-1 standard.Object Descriptor (OD)/BIFS (binary format that is used for scene) generator 120 generates the OD/BIFS stream based on ISO/IEC 14496-1 standard.
SL packing device 130 (SL-layer, sync) generates as the SL that is used to get into the synchronous grouping between the Media Stream and divides into groups, and follows ISO/IEC 14496-1 system standard.In other words; SL packing device 130 receives OD/BIFS stream, video-frequency basic flow (ES), audio ES and additional data, and generates corresponding with OD/BIFS stream, video ES, audio ES and additional data respectively OD/BIFS SL grouping, video SL grouping, audio frequency SL grouping and additional data packet.
Partly (section) generator (or PSI generator 140) (PSI-Program Specific Information) generates the part of the IOD/OD/BIFS that comprises reception, and follows ISO/IEC 13818-1 standard.Part generator 140 comprises 14496 parts packing unit, and be used for SL is divided into groups (that is, OD/BIFS SL divides into groups) is packaged as 14496 parts, and comprises PSI packing unit, is used to generate the PSI information that comprises the IOD data.
PES packing device 150 (the PES-program flows basically) receives the SL grouping and it is carried out the PES packing, and follows ISO/IEC 13818-1 standard.MPTS (TS) multiplexer 160 receives this part respectively and divides into groups as the result's of PES packing PES from part generator 140 and PES packing device 150, and grouping is multiplexed as MPEG-2TS with PES with said part.
Fig. 2 is the concept map that is used for providing at DMB the system of high-quality multimedia service that illustrates according to the embodiment of the invention.
In traditional multimedia broadcasting, multimedia service is by multiplexed and transmit through single transport stream.Yet; In the present invention, give DMB transfer system, make TS is separated into basal layer TS and enhancement layer TS the hierarchical modulation function; And thus traditional TS is transmitted as basal layer TS, and in enhancement layer TS, transmit the additional multimedia service information that is used for high-quality service.
So, can the gross multimedia service be provided to the for example low specification terminal of mobile phone, and can the high-quality multimedia service be provided to the high standard terminal.
Coding unit comprises high-quality video encoder 210, high quality audio encoder 220 and additional data encoder 230.
High-quality video encoder 210 can be scalable video decoder, three-dimensional 3D video encoder, multiple view video coding device, multi-channel audio coding device etc.High-quality video encoder 210 is separated into base layer videos ES 211 and enhancement-layer video ES 212 with inlet flow, and base layer videos ES 211 and enhancement-layer video ES 212 are outputed to media system coding and multiplexed unit 240.Media system coding and 240 couples of base layer videos ES in multiplexed unit 211 carry out multiplexed with enhancement-layer video ES 212.
Similarly, high quality audio encoder 220 is separated into basal layer audio ES and enhancement layer audio ES with inlet flow, and basal layer audio ES and enhancement layer audio ES are outputed to media system coding and multiplexed unit 240.Media system coding and the 240 pairs of basal layer audio ES in multiplexed unit and enhancement layer audio ES are carried out multiplexed.Similarly, additional data encoder 230 is separated into base layer data ES and enhancement data ES with inlet flow, and base layer data ES and enhancement data ES are outputed to media system coding and multiplexed unit 240.Media system coding and the 240 couples of base layer data ES in multiplexed unit and enhancement data ES carry out multiplexed.
Media system coding and multiplexed unit 240 will be from video, audio frequency and data ES that high-quality video encoder 210, high quality audio encoder 220 and additional data encoder 230 receive respectively each be multiplexed as basal layer and enhancement layer.Thus, delivery unit 250 can transmit video, audio frequency and data ES after multiplexed via same channel or different channels.
Decoding unit comprises high-quality video decoder, high quality audio decoder, receiving element and the multiplexed unit 260 of media system decoding reconciliation.
Fig. 3 and 4 illustrates for the media system coding that the high-quality multimedia service proposes, in Fig. 2, carries out in the illustrated coding unit and the embodiment of multichannel multiplexing method are provided in DMB.Fig. 5 be carry out with Fig. 3 in the block diagram of receiving system of the corresponding decoding reconciliation multichannel multiplexing method of illustrated coding and multichannel multiplexing method.Fig. 6 and 7 illustrates according to the decoding of in decoding unit, carrying out for the high-quality multimedia service is provided in DMB of the embodiment of the invention and conciliates multichannel multiplexing method.Fig. 8 is the flow chart that illustrates illustrated decoding reconciliation multichannel multiplexing method among Fig. 7.Fig. 9 illustrates decoding according to another embodiment of the present invention and conciliates multichannel multiplexing method.
Fig. 3 is the block diagram of the media system in illustrated coding unit coding and multiplexed unit in Fig. 2 according to an embodiment of the invention.
In the media system coding and multiplexed unit 240 of Fig. 2; SL packing device 310 each from high-quality video encoder 210, high quality audio encoder 220 and additional data encoder 230 receives basal layer ES and enhancement layer ES, and basal layer ES that receives and enhancement layer ES are transformed to basal layer SL grouping and enhancement layer SL grouping.
SL packing device 310 is according to carrying out the similar mode of synchronous mode with SL packing device 130 pairs of videos, audio frequency and data flow of Fig. 1; Come to make be used for basal layer stream (promptly; Video, audio frequency and data ES) and to be used for the correspondence stream (that is, video, audio frequency and data ES) of enhancement layer synchronous.For example, should be synchronous in order in SL packing device 310, to carry out, based on the identical of (infer) of deriving from identical systems time clock (STC) OCR (object clock reference), and in stream, insert the timestamp information that for example stabs (CTS) recombination time.
PES packing device 320 according to the SL packing device 130 of Fig. 1 in the identical or similar mode of mode used; Come the SL that receives is divided into groups to carry out the PES packing; And in basal layer ES and enhancement layer ES, insert the timestamp that presentative time for example stabs (PTS) based on the same system clock, so that carry out synchronously.
For base layer stream and enhancement layer stream exist a pair of IOD generator 350 and 351, pair of O D/BIFS generator 360 and 361 and a pair of part generator 370 and 371 in each is right, and each is to formation base laminar flow and enhancement layer stream.
With illustrated traditional media system coding that comprises single TS multiplexer 160 and multiplexed unit among Fig. 1 form contrast be; Media system coding and the multiplexed unit of Fig. 3 comprise two TS multiplexers; That is, basal layer TS multiplexer 330 and enhancement layer TS multiplexer 340.The media system coding of Fig. 3 and multiplexed unit carry out multiplexed according to the PES stream and the PSI part/14496 parts stream of basal layer and enhancement layer packetized.
These two TS multiplexers 330 and 340 divide into groups and enhancement layer MPEG-2TS grouping through using same STC to generate basal layer MPEG-2TS, and also through using same STC to generate timer reference of programs (PCR).The use of same STC makes that these two TS can be on whole receive-transmit system synchronously.
In this case, in order to make the increase that to divide into groups through surplus (surplus) TS that insertion PCR in MPEG-2TS divides into groups generates minimize, can insert PCR according to relative a small amount of with in the audio TS packet that rule generates at interval relatively.Therefore, also can PTS and OCR only be inserted in the audio stream.
At last; In being suitable for basal layer transfer channel and the channel encoder that strengthens transfer channel, the basal layer MPEG-2 TS after multiplexed divided into groups with multiplexed after enhancement layer MPEG-2 TS divide into groups to encode respectively, and then they are sent to basal layer transfer channel and enhancing transfer channel respectively.During the hierarchical modulation method in using DMB, used, can base layer stream and enhancement layer stream be mapped in the single code element and be sent to single radio frequency (RF) channel.
In Fig. 3 in the illustrated embodiment,, can make owing to repeat to transmit the number that the unnecessary transmission of generation divides into groups and minimize through transmitting only by the PSI of the required information structuring of enhancement layer.
More specifically; In method according to structure foundation layer PSI information of the embodiment of the invention 380 and enhancement layer PSI information 381; Do not change ground and transmit basal layer PSI information 380, and the PMT/OD/BIFS information of only adding for enhancement layer is extracted and is included in the enhancement layer PSI information 381 corresponding to prior art.Receiving terminal can from this two-layer MPEG-2TS, extract corresponding the grouping through using basal layer PSI information 380 and enhancement layer PSI information 381.
In another embodiment, change ground and transmit traditional basal layer PSI information 380, and enhancement layer PSI information 381 comprises the expansion PMT/OD/BIFS information that obtains through the information that is used for enhancement layer to the PMT/OD/BIFS information interpolation that is used for basal layer.Thus, receiving terminal can from this two-layer MPEG-2TS, extract corresponding the grouping through using basal layer PSI information 380 and the enhancement layer PSI information 381 that comprises expansion PMT/OD/BIFS information.
According to the present invention, when selecting the providing of high-quality service, can come simply to provide high-quality service, and need not analysis foundation layer PSI information only through the analysis of enhancement layer PSI information.In addition, through not execution analysis basal layer PSI information processing, can simplify the operation of extracting the required information of enhancement layer.
Fig. 4 is used for illustrating according to another embodiment of the present invention the media system coding carried out at coding unit and the block diagram of multichannel multiplexing method.
Illustrated identical among illustrated media system coding and multichannel multiplexing method and Fig. 3 among Fig. 4 at synchronization aspects, but difference is that basal layer and enhancement layer are shared single IOD generator, single OD/BIFS generator and part generator.
According to current embodiment; IOD, OD and BIFS as the additional data that transmits from the sender only transmit through basal layer, make the terminal extract the ES that is used for two-layer (that is, basal layer and enhancement layer); And, increase transmission efficiency thus through using the ES that extracts to construct scene.
In other words, owing to only transmit, can reduce because the expense that the packing of carrying out in each stage generates through single channel (that is, the basal layer channel) as IOD, OD and the BIFS of the relative small amount of data of these two-layer needs.
Fig. 5 be carry out according to an embodiment of the invention with Fig. 3 in the corresponding decoding of illustrated coding and multichannel multiplexing method conciliate the block diagram of the receiving system of multichannel multiplexing method.
At first, since base layer stream that hierarchical modulation etc. receives via single transfer channel or different transfer channel and enhancement layer stream by the respective channels decoder decode.Then, basal layer TS demultiplexer 510 is divided into partial data and PES stream with the base layer stream of decoding, and enhancement layer TS demultiplexer 511 is divided into partial data and PES stream with the enhancement layer stream of decoding.
Because the sender inserts PCR through using same STC, makes PCR continuous each other in each MPEG-2TS in this two-layer MPEG-2TS; So only extraction PCR in basal layer TS demultiplexer 510 and the enhancement layer TS demultiplexer 511; And when reproducing STC, use the PCR that extracts.In this case, in order to make the media representation between two-layer synchronous, through PCR-based cache flow buffering area, this two-layer MPEG-2TS should be through synchronized with each other before basal layer TS demultiplexer 510 and the enhancement layer TS demultiplexer 511.
In order to realize this, can be based on value according to the PCR that inserts in the audio TS packet that rule transmits at interval relatively, between the stream of realizing deriving from same time clock synchronously.
Fig. 6 illustrates the flow chart that multichannel multiplexing method is conciliate in the decoding of in the receiving system of Fig. 5, carrying out.
[selection provides the situation of basic service]
The flow chart of the signal when the user selects only basic service to be provided will be described now.
In operation S610 and S611; When the stream of packets of using existing MPEG-4 system coding is inserted among the MPEG-2TS and transmits; Obtain wherein from MPEG-2TS that PID is the PAT (Program Association Table) of 0x0000, so that access is by multiplexed and the media data that transmits.
In operation S630, explain Program Map Table (PMT) information that comprises among the PAT, so that from basal layer TS search PMT.The PMT that explanation obtains shows the identifier ES ID of all kinds ES and the relation table of packet identifier (PID) so that extract.
At operation S640 and S641 in S644, through according to the relation table that extracts with reference to corresponding PID, and it is separated from one another that dissimilar TS are divided into groups, and extraction ES information from the TS of each separation divides into groups then.Then, explain the OD that comprises in the ES information, make to write tabulation about the relevant information of each object and each ES.
Thereafter, in operation S670 and S680, decoded video or audio stream utilize because the relevant information that decoding is extracted is constructed scene, and reproduce data.
[selection provides the situation of high-quality service]
The flow chart of the signal when the user selects high-quality service is provided will be described now.
In operation S611 and S621, when the user selected high-quality service is provided, the initial extraction of dividing into groups with basal layer TS was side by side extracted enhancement layer TS and is divided into groups, and preliminary (primarily) carries out synchronous between basal layer TS divides into groups and enhancement layer TS divides into groups.
In operation S631 and S650; Wherein operate S650 and comprise that S651 is to S654; Similar with the operation S640 that when basic service is provided, carries out; PAT and PMT that explanation transmits in enhancement layer TS divides into groups, and extract each the type ES that transmits via the enhancement layer channel thus, and write information list about each object and each ES.
In operation S661, will combine with the relevant information of the ES of relevant extraction from the ES (for example, video ES, audio ES and data ES) of the extraction of basal layer and enhancement layer.Thereafter, in operation S670 and S680, video and/or audio stream is decoded, and before reproducing data, constructs scene.
Fig. 7 illustrates information as for example IOD, OD/BIFS etc. and is inserted in the bit stream and when transmitting through one of basal layer and enhancement layer, carry out the receiving system that multichannel multiplexing method is conciliate in decoding according to another embodiment of the present invention.
The decoding of carrying out in the illustrated receiving system among Fig. 7 is conciliate multichannel multiplexing method corresponding to illustrated coding and multichannel multiplexing method among Fig. 4.
Among Fig. 7 among illustrated receiving system and Fig. 5 the difference of illustrated receiving system according to first embodiment be; Do not comprise the partial interpretation device that is used to explain enhancement layer IOD and OD/BIFS information, and the information of relevant enhancement layer is incorporated in PSI part and the transmission that is used for basal layer.Therefore, illustrated receiving system and is sent to the scene structural unit with the information of extracting from basal layer PSI extracting section enhancement layer IOD and OD/BIFS information among Fig. 7.
Fig. 8 illustrates the flow chart that multichannel multiplexing method is conciliate in the decoding of in the receiving system of Fig. 7, carrying out.
When the user selected only basic service to be provided, illustrated decoding was conciliate among multichannel multiplexing method and Fig. 6 illustrated identical among Fig. 8.Yet; When the user selects high-quality service is provided; Illustrated decoding conciliates that illustrated difference is among multichannel multiplexing method and Fig. 6 among Fig. 8; Only carry out the explanation of PMT and OD, and come to extract simultaneously relevant these many two-layer information, and only carry out the merging of dissimilar ES thus based on said explanation for basal layer.
Conciliating in the multichannel multiplexing method according to the decoding of another embodiment of Fig. 8, mapping relations between the base layer stream and the mapping relations between the enhancement layer stream are added to first circulation and second circulation, and description here.Receiving terminal extracts corresponding the grouping from basal layer MPEG-2 TS and enhancement layer MPEG-2 TS through using the mapping relations of adding.
In addition; The decoding according to another embodiment at Fig. 8 is conciliate in the multichannel multiplexing method; Also only transmit OD stream through basic layer; And the ES_Descriptor (ES_ descriptor) that will be described as constructing scene is additional is inserted among the basal layer MPEG-2TS, so that describe video ES, audio ES and the data ES that is used for video ES, audio ES and the data ES of basal layer and is used for enhancement layer.
As illustrated among Fig. 6,, can insert PCR according to relative a small amount of with in the audio TS packet that rule generates at interval relatively in order to make the increase that to divide into groups through the superfluous TS that insertion PCR in MPEG-2TS divides into groups generates minimize.Even can PTS and OCR only be inserted in the audio stream therefore.
Fig. 9 illustrates decoding according to another embodiment of the present invention and conciliates multichannel multiplexing method.
PMT is made up of two types of circulations, i.e. first and second circulations 910 and 920.First circulation 910 is by comprising that the ES_Descriptor that describes with the content of object factory about scene constitutes, and second circulation, 920 mappings are used for transmitting the PID, Stream_type (stream _ type) of the MPEG-2TS grouping of the ES that describes at ES_Descriptor etc.
The decoding according to another embodiment that combines Fig. 7 and 8 to describe is in the above conciliate in the multichannel multiplexing method, and mapping relations between the base layer stream and the mapping relations between the enhancement layer stream are added to these two circulations and here describe.Receiving system extracts corresponding the grouping from basal layer MPEG-2TS and enhancement layer MPEG-2TS through using the mapping relations of adding.
In addition; Conciliating in the multichannel multiplexing method according to the decoding of second embodiment; OD stream also only transmits through the basal layer channel; And be described as constructing additional being inserted among the basal layer MPEG-2 TS of ES_Descriptor quilt of scene, so that describe video ES, audio ES and the data ES that is used for video ES, audio ES and the data ES of basal layer and is used for enhancement layer.
Figure 10 illustrates the MPEG-4OD according to the embodiment of the invention.
Base layer stream can be defined as different OD with enhancement layer stream.Yet, in the present embodiment, close to tie up to and comprise two ES descriptors that are used for basal layer and enhancing among the single OD according to being subordinate to (subordinate).
This membership can use MPEG-4ES descriptor " StreamDependanceFlag (stream dependency sign) " and " dependsOn_ES_ID " to express.The position of using URL_Flag (URL_ sign) to specify ES is present in the enhancement layer so that express ES oneself.
Base layer stream as independent stream is set to " ObjectTypeIndication (object type indication)=0x21 (AVC), StreamType (stream type)=0x04 (visual stream) " according to the AVC codec as traditional standard.Be encoded according in SVC codec or a plurality of other codecs any as the enhancement layer stream of subordinate stream; And be set to " ObjectTypeIndication=0xC0 (user is privately owned); StreamType=0x04 (visual stream); StreamDependanceFlag=1, dependsOn_ES_ID=101 (basal layer ES_ID) " thus.
The base layer stream of subordinate is at enhancement layer but not the existence in the basal layer is expressed as " URL_Flag=1, URLstring [URLlength]=xx (position of enhancement layer) ".
Therefore, only discern the conventional terminal of basal layer and fail to discern " ObjectTypeIndication " information that is used for enhancement layer, and guarantee compatibility thus.According to the existence and " ObjectTypeIndication " information that is used for the terminal recognition subordinate stream of high-quality multimedia service of the present invention, and also correctly receive enhancement layer stream thus.
Figure 11 is the block diagram that is used for providing at the DMB transfer system conveyer 1100 of high-quality multimedia service of the example embodiment according to the present invention.
Conveyer 1100 comprises coding unit 1110, SL packing converter unit 1120, PES packing converter unit 1130 and the multiplexed unit 1140 of TS.
Coding unit 1110 will be imported content of multimedia and be separated into basal layer ES and enhancement layer ES, and basal layer ES and enhancement layer ES are encoded.
SL packing converter unit 1120 is transformed to basal layer ES and enhancement layer ES that basal layer SL divides into groups and enhancement layer SL divides into groups, and carry out that basal layer SL divides into groups and enhancement layer SL grouping between synchronous.
PES packing converter unit 1130 divides into groups basal layer SL to divide into groups to be transformed to enhancement layer SL that basal layer PES divides into groups and enhancement layer PES divides into groups, and carry out that basal layer PES divides into groups and enhancement layer PES grouping between synchronous.
SL packing converter unit 1120 concludes that through using based on same STC the OCR of (ascertain) inserts timestamp information in basal layer SL grouping and enhancement layer SL grouping, and carries out synchronously.PES packing converter unit 1130 inserts timestamp information through using the PCR that concludes based on same STC in basal layer PES grouping and enhancement layer PES grouping, and carries out synchronously.For example, SL packing converter unit 1120 inserts CTS as timestamp information, and PES packing converter unit 1130 inserts PTS as timestamp information.
The multiplexed unit 1140 of TS comes PES is divided into groups to carry out multiplexed according to basal layer TS and enhancement layer TS, divide into groups so that generate TS.At this moment, the multiplexed unit of TS 1140 is through inserting PCR or through using the identical STC among basal layer ES and the enhancement layer ES, carrying out synchronous in TS divides into groups according to basal layer ES and enhancement layer ES.
Figure 12 is the block diagram that is used for providing at the DMB transfer system receiving system of high-quality multimedia service of the example embodiment according to the present invention.
This receiving system comprises that quality selected cell 1210, decoding unit 1220, TS separate multiplexed unit 1230, PES unpacks converter unit 1240 and SL unpacks converter unit 1250.
Quality selected cell 1210 confirms only to receive based on user's selection, and base layer stream still will receive base layer stream and enhancement layer stream.
1220 pairs of base layer stream of decoding unit and enhancement layer stream are decoded, and divide into groups so that obtain TS.TS separates the 1230 couples of TS in multiplexed unit and divides into groups to separate multiplexed divide into groups so that obtain PES, and carry out PES between dividing into groups synchronously.
PES unpacks 1240 couples of these TS of converter unit and separates the PES that multiplexed unit 1230 obtained and divide into groups to decode so that obtaining SL divides into groups, and carries out SL synchronous between dividing into groups.SL unpacks converter unit 1250 and divides into groups to carry out multiplexed according to basal layer ES and enhancement layer ES to SL.
The present invention also can be embodied as the computer-readable code on the computer readable recording medium storing program for performing.Computer readable recording medium storing program for performing is that can store thereafter can be by any data storage device of the data of computer system reads.The example of computer readable recording medium storing program for performing comprises read-only memory (ROM), random-access memory (ram), CD-ROM, tape, floppy disk, optical data storage device and carrier wave (for example the data through the internet transmit).Computer readable recording medium storing program for performing also can make and store and move computer-readable code according to distribution mode through distributing with the computer system of network-coupled.And computer-readable medium can be distributed, store and the operation computer-readable code in the embedded system that connects via wireless network of for example sensor node.
Although specifically illustrate and described the present invention with reference to its preferred embodiment, it will be appreciated by those skilled in the art that and to carry out the various changes of form and details here, and do not break away from the spirit and scope of the present invention that accompanying claims limits.Preferred embodiment should be only considered according to the implication of describing rather than for the purpose that limits.So scope of the present invention can't help detailed description of the present invention and limited, and is defined by the following claims, and all difference in this scope will be interpreted as and comprise in the present invention.

Claims (38)

1. conveyer that is used for providing the high-quality multimedia service at DMB (DMB) transfer system, this conveyer comprises:
Coding unit is used for the input content of multimedia is separated into basal layer ES (basic stream) and enhancement layer ES;
SL (layer, sync) converter unit of packing is used for that this basal layer ES and this enhancement layer ES are transformed to basal layer SL respectively and divides into groups and enhancement layer SL grouping;
PES (Program Specific Information) converter unit of packing is used for said basal layer SL divided into groups to divide into groups to be transformed to respectively with enhancement layer SL that basal layer PES divides into groups and enhancement layer PES grouping; With
The multiplexed unit of TS (MPTS) is used for said basal layer PES being divided into groups and enhancement layer PES divides into groups to carry out respectively multiplexed according to basal layer ES and enhancement layer ES, and output basal layer TS divides into groups and enhancement layer TS grouping.
2. according to the conveyer of claim 1; Wherein this SL packing converter unit and this PES packing converter unit divide into groups to divide into groups with enhancement layer SL and said basal layer PES inserts timestamp information respectively in dividing into groups to divide into groups with enhancement layer PES at said basal layer SL through using the OCR (object clock reference) that concludes based on same STC (system time clock), and carry out synchronous between synchronous and said basal layer PES grouping and the enhancement layer PES grouping between said basal layer SL divides into groups and enhancement layer SL divides into groups respectively.
3. according to the conveyer of claim 2, wherein this SL packing converter unit inserts CTS (stamp recombination time) as this timestamp information.
4. according to the conveyer of claim 2, wherein this PES packing converter unit inserts PTS (presentative time stamp) as this timestamp information.
5. according to the conveyer of claim 1, wherein when formation base layer TS grouping and enhancement layer TS grouping, this TS uses the same STC in basal layer ES and enhancement layer ES in multiplexed unit.
6. according to the conveyer of claim 1, wherein the multiplexed unit of this TS inserts PCR (program reference clock) respectively in basal layer ES and enhancement layer ES.
7. according to the conveyer of claim 1, also comprise the additional data generation unit, be used for being based on basal layer ES and the enhancement layer ES that this coding unit separates, and generate the additional data information that is used for a surface construction respectively.
8. according to the conveyer of claim 7; Also comprise part generating unit; Be used to generate PSI (PSI-Program Specific Information) part that is used for basal layer ES and the PSI part that is used for enhancement layer ES, the wherein said PSI part that is used for basal layer ES comprises additional data with partly each of the PSI that is used for enhancement layer ES.
9. according to the conveyer of claim 7, each in the wherein said additional data information is sent to basal layer ES and enhancement layer ES respectively, wherein has been merely enhancement layer and the additional data information of adding is sent to enhancement layer ES.
10. according to the conveyer of claim 7, wherein be used for basal layer and only transmit, and when lacking the additional data that is used for enhancement layer, the additional data that only will be used for basal layer is sent to basal layer ES through basal layer ES with the additional data that is used for enhancement layer.
11. a receiving system that is used for providing at the DMB transfer system high-quality multimedia service, this receiving system comprises:
The quality selected cell, base layer stream still will receive base layer stream and enhancement layer stream to be used for confirming only to receive;
Decoding unit is used for base layer stream and enhancement layer stream are decoded respectively, and exports basal layer TS grouping and enhancement layer TS grouping respectively;
TS separates multiplexed unit, is used for said basal layer TS is divided into groups and enhancement layer TS divides into groups to separate respectively multiplexed, and basal layer PES divides into groups and enhancement layer PES grouping so that obtain respectively;
PES unpacks converter unit, is used for said basal layer PES grouping and enhancement layer PES are divided into groups to decode respectively, and basal layer SL divides into groups and enhancement layer SL divides into groups so that obtain respectively; With
SL unpacks converter unit, be used for to said basal layer SL divide into groups and strengthen SL divide into groups to carry out multiplexed so that obtain basal layer ES and enhancement layer ES.
12. receiving system according to claim 11; Wherein this PES unpacks converter unit and this SL and unpacks converter unit and be basis with the timestamp information that uses the OCR that concludes based on same STC to insert, and carries out synchronous synchronously and between basal layer SL divides into groups and enhancement layer SL divides into groups between basal layer PES divides into groups and enhancement layer PES divides into groups respectively.
13. according to the receiving system of claim 12, wherein this PES unpacks converter unit through using the PTS that inserts as this timestamp information, carries out synchronously.
14. according to the receiving system of claim 12, wherein this SL unpacks converter unit through using the CTS that inserts as this timestamp information, carries out synchronously.
15. according to the receiving system of claim 12, wherein this TS separates multiplexed unit through using the PCR that in one of basal layer ES and enhancement layer ES, comprises, carries out synchronously.
16. receiving system according to claim 11; Wherein be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for a surface construction, and from enhancement layer ES, extract and be merely the additional data information that enhancement layer adds through among said basal layer ES and the enhancement layer ES each.
17. receiving system according to claim 11; Wherein be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for a surface construction through said basal layer ES, wherein this additional data information comprises additional data that is used for basal layer and the additional data that is used for enhancement layer.
18., wherein only be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for a surface construction through said basal layer ES according to the receiving system of claim 11.
19. according to any the receiving system in the claim 16 to 18, wherein this additional data information comprises PSI, IOD (initial object descriptor), OD and BIFS (binary format of scene) information.
20. a transfer approach that is used for providing at the DMB transfer system high-quality multimedia service, this transfer approach comprises:
Content of multimedia be will import and basal layer ES and enhancement layer ES will be separated into;
This basal layer ES and this enhancement layer ES are transformed to basal layer SL grouping and enhancement layer SL grouping;
This basal layer SL grouping and this enhancement layer SL are divided into groups to be transformed to basal layer PES grouping and enhancement layer PES grouping; With
This basal layer PES is divided into groups and this enhancement layer PES divides into groups to carry out multiplexed according to basal layer ES and enhancement layer ES, and output basal layer TS divides into groups and enhancement layer TS grouping.
21. transfer approach according to claim 20; Wherein being transformed to basal layer SL divides into groups to divide into groups with enhancement layer SL and is transformed to the step that basal layer PES divides into groups to divide into groups with enhancement layer PES to comprise: divide into groups and this enhancement layer SL inserts timestamp information in dividing into groups and divides into groups and this enhancement layer PES inserts timestamp information in dividing into groups at this basal layer PES at this basal layer SL through using the OCR that concludes based on same STC, and carry out respectively between basal layer SL divides into groups and enhancement layer SL divides into groups synchronously and basal layer PES divides into groups and enhancement layer PES grouping between synchronous.
22., wherein in being transformed to the step that basal layer SL divides into groups and enhancement layer SL divides into groups, insert CTS as this timestamp information according to the transfer approach of claim 21.
23., wherein in being transformed to the step that basal layer PES divides into groups and enhancement layer PES divides into groups, insert PTS as this timestamp information according to the transfer approach of claim 21.
24., wherein in the multiplexed step of this TS, when formation base layer TS grouping and enhancement layer TS grouping, use the same STC among basal layer ES and the enhancement layer ES according to the transfer approach of claim 20.
25., wherein in the multiplexed step of this TS, in basal layer ES and enhancement layer ES, insert PCR according to the transfer approach of claim 20.
26. the transfer approach according to claim 20 also comprises: basal layer ES that obtains when being based on basis of coding layer ES and enhancement layer ES and enhancement layer ES, and generate the additional data that is used for a surface construction.
27. according to the transfer approach of claim 26, comprise that also generation is used for the PSI part and the PSI part that is used for enhancement layer ES of basal layer ES, the wherein said PSI part that is used for basal layer ES comprises additional data with partly each of the PSI that is used for enhancement layer ES.
28. according to the transfer approach of claim 26, the additional data that wherein will be used for basal layer is sent to basal layer ES and enhancement layer ES respectively with the additional data that is used for enhancement layer.
29. according to the transfer approach of claim 26, the additional data that wherein is used for basal layer transmits at basal layer ES with the additional data that is used for enhancement layer.
30. a method of reseptance that is used for providing at the DMB transfer system high-quality multimedia service, this method of reseptance comprises:
The quality selection operation, base layer stream still will receive base layer stream and enhancement layer stream to be used for confirming only to receive;
Decode operation is used for base layer stream and enhancement layer stream are decoded, and output basal layer TS divides into groups and enhancement layer TS divides into groups;
TS separates multiplex operation, is used for said basal layer TS is divided into groups and enhancement layer TS divides into groups to separate multiplexed, and basal layer PES divides into groups and enhancement layer PES grouping so that obtain;
PES unpacks map function, is used for said basal layer PES grouping and enhancement layer PES are divided into groups to decode, and basal layer SL divides into groups and enhancement layer SL divides into groups so that obtain; With
SL unpacks map function, be used for to said basal layer SL divide into groups and strengthen SL divide into groups to carry out multiplexed so that obtain basal layer ES and enhancement layer ES.
31. method of reseptance according to claim 30; Wherein unpacking map function at this PES unpacks in the map function with this SL; Timestamp information to use the OCR that concludes based on same STC to insert is basis, carries out synchronous synchronously and between basal layer SL divides into groups and enhancement layer SL divides into groups between basal layer PES divides into groups and enhancement layer PES divides into groups respectively.
32. according to the method for reseptance of claim 31, wherein unpack in the map function,, carry out synchronously through using the PTS that inserts as this timestamp information at this PES.
33. according to the method for reseptance of claim 31, wherein unpack in the map function,, carry out synchronously through using the CTS that inserts as this timestamp information at this SL.
34. according to the method for reseptance of claim 31, wherein separate in the multiplex operation,, carry out synchronously through using the PCR that in one of basal layer ES and enhancement layer ES, comprises at this TS.
35. method of reseptance according to claim 30; Wherein be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for a surface construction, and from enhancement layer ES, extract the additional data that has been merely enhancement layer and has added through among this basal layer ES and this enhancement layer ES each.
36. method of reseptance according to claim 30; Wherein be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for a surface construction through said basal layer ES, wherein this additional data information comprises additional data that is used for basal layer and the additional data that is used for enhancement layer.
37., wherein only be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for a surface construction through said basal layer ES according to the method for reseptance of claim 30.
38. according to any the method for reseptance in the claim 35 to 37, wherein this additional data information comprises PSI, IOD, OD and BIFS information.
CN2008800231475A 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system Expired - Fee Related CN101690200B (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
KR10-2007-0043734 2007-05-04
KR20070043734 2007-05-04
KR1020070043734 2007-05-04
KR1020080041434 2008-05-02
PCT/KR2008/002516 WO2008136623A1 (en) 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system
KR1020080041434A KR20080098328A (en) 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system
KR10-2008-0041434 2008-05-02

Publications (2)

Publication Number Publication Date
CN101690200A CN101690200A (en) 2010-03-31
CN101690200B true CN101690200B (en) 2012-06-20

Family

ID=40285873

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008800231475A Expired - Fee Related CN101690200B (en) 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system

Country Status (4)

Country Link
EP (1) EP2153645A4 (en)
KR (1) KR20080098328A (en)
CN (1) CN101690200B (en)
WO (1) WO2008136623A1 (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101201206B1 (en) * 2008-12-22 2012-11-15 한국전자통신연구원 Apparatus and method for multiplexing and demultiplexing based on digital multimedia broadcasting
EP3073746A1 (en) * 2009-02-03 2016-09-28 Electronics and Telecommunications Research Institute Transmission method, transmission apparatus, reception method, and reception apparatus for a digital multimedia broadcasting service
CN105025309A (en) * 2009-06-16 2015-11-04 Lg电子株式会社 Broadcast transmitter and 3D video data processing method thereof
KR101368468B1 (en) * 2010-02-10 2014-03-03 한국전자통신연구원 Apparatus and method for transmitting and receiving broadcasting signal
WO2011097754A1 (en) * 2010-02-11 2011-08-18 上海贝尔股份有限公司 Transmission method and device for scalable coding stream in relay network
EP2606649A4 (en) * 2010-08-19 2016-05-04 Samsung Electronics Co Ltd Method and apparatus for encoding and decoding multilayer videos
CN102480634B (en) * 2010-11-24 2015-12-16 中兴通讯股份有限公司 The method, apparatus and system that in Mobile Multimedia Broadcasting, classified service is synchronous
US9848217B2 (en) 2012-01-20 2017-12-19 Korea Electronics Technology Institute Method for transmitting and receiving program configuration information for scalable ultra high definition video service in hybrid transmission environment, and method and apparatus for effectively transmitting scalar layer information
US9088813B2 (en) * 2013-10-07 2015-07-21 Ericsson Television Inc. Network personal video recorder savings with scalable video coding
JP6505413B2 (en) * 2013-11-08 2019-04-24 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Transmission method, reception method, transmission apparatus, and reception apparatus
KR101656193B1 (en) * 2015-08-11 2016-09-22 서울여자대학교 산학협력단 MMT-based Broadcasting System and Method for UHD Video Streaming over Heterogeneous Networks
US10931980B2 (en) 2016-07-19 2021-02-23 Electronics And Telecommunications Research Institute Method and apparatus for providing 360 degree virtual reality broadcasting service
WO2018016879A1 (en) * 2016-07-19 2018-01-25 한국전자통신연구원 Method and device for providing 360-degree virtual reality broadcasting service
WO2018186525A1 (en) * 2017-04-07 2018-10-11 주식회사 아이리버 Modular signal conversion apparatus having synchronized clock, and data processing apparatus
CN107197390B (en) * 2017-05-27 2019-11-12 上海东方明珠广播电视研究发展有限公司 Wireless signal emission system, method, method for receiving and processing signal and terminal

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1574962A (en) * 2003-06-14 2005-02-02 Lg电子有限公司 Device and method for receiving and transmitting digital multimedia broadcasting
CN1820507A (en) * 2003-08-20 2006-08-16 韩国电子通信研究院 System and method for digital multimedia broadcasting

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000078573A (en) * 1998-09-03 2000-03-14 Hitachi Ltd Hierarchical encoded data distribution device
US6785330B1 (en) * 1999-08-19 2004-08-31 Ghildra Holdings, Inc. Flexible video encoding/decoding method
US7116717B1 (en) * 1999-12-15 2006-10-03 Bigband Networks, Inc. Method and system for scalable representation, storage, transmission and reconstruction of media streams
US7133449B2 (en) * 2000-09-18 2006-11-07 Broadcom Corporation Apparatus and method for conserving memory in a fine granularity scalability coding system
KR100992002B1 (en) * 2002-12-04 2010-11-04 코닌클리케 필립스 일렉트로닉스 엔.브이. Packetization of layered media bitstreams
KR101407748B1 (en) * 2004-10-13 2014-06-17 톰슨 라이센싱 Method and apparatus for complexity scalable video encoding and decoding
KR100760260B1 (en) * 2005-02-04 2007-09-19 한국전자통신연구원 Apparatus and Method for creating transport stream for efficient transmission of timing information, and DMB transmission system using it
EP1742476A1 (en) * 2005-07-06 2007-01-10 Thomson Licensing Scalable video coding streaming system and transmission mechanism of the same system
US8879856B2 (en) * 2005-09-27 2014-11-04 Qualcomm Incorporated Content driven transcoder that orchestrates multimedia transcoding using content information

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1574962A (en) * 2003-06-14 2005-02-02 Lg电子有限公司 Device and method for receiving and transmitting digital multimedia broadcasting
CN1820507A (en) * 2003-08-20 2006-08-16 韩国电子通信研究院 System and method for digital multimedia broadcasting

Also Published As

Publication number Publication date
CN101690200A (en) 2010-03-31
KR20080098328A (en) 2008-11-07
EP2153645A4 (en) 2011-07-27
WO2008136623A1 (en) 2008-11-13
EP2153645A1 (en) 2010-02-17

Similar Documents

Publication Publication Date Title
CN101690200B (en) Method and apparatus for providing high-quality multimedia service in dmb system
KR101639358B1 (en) Transmission apparatus and method, and reception apparatus and method for providing 3d service using the content and additional image seperately transmitted with the reference image transmitted in real time
CN102484731B (en) Method and apparatus for generating 3-dimensional image datastream, and method and apparatus for receiving the 3-dimensional image datastream
US8422564B2 (en) Method and apparatus for transmitting/receiving enhanced media data in digital multimedia broadcasting system
US9380288B2 (en) System and method for transmitting/receiving three dimensional video based on digital broadcasting
US8520057B2 (en) Method and system for transmitting/receiving 3-dimensional broadcasting service
CN102835047B (en) The link information about multiple vision point video stream is used to send the method and apparatus of digital broadcasting stream and the method and apparatus of receiving digital broadcast stream
RU2674890C2 (en) Transmission apparatus, transmission method, reception apparatus, reception method, encoding apparatus, and encoding method
US9210354B2 (en) Method and apparatus for reception and transmission
KR101856093B1 (en) Content providing apparatus and method, and content reproduction apparatus and method for synchronization between left and right stream in the stationary-mobile hybrid 3dtv broadcast
US20110010739A1 (en) Method and apparatus for transmitting/receiving stereoscopic video in digital broadcasting system
US20120320168A1 (en) Method and apparatus for transmission and reception in the provision of a plurality of transport interactive 3dtv broadcasting services
TW201127062A (en) Multiview video coding over MPEG-2 systems
MX2012008816A (en) Method and apparatus for generating data stream for providing 3-dimensional multimedia service, and method and apparatus for receiving the data stream.
US20130342648A1 (en) Transmisson apparatus and method and reception apparatus and method for providing program associated stereoscopic broadcasting service
US20140125762A1 (en) Transmission device, transmission method, reception apparatus, and reception method
CN104247413A (en) Signal processing device and method for 3D service
US20100315486A1 (en) Stereoscopic video service providing/receiving method and apparatus in digital broadcasting system
CN102326387B (en) Apparatus and method for multiplexig and demultiplxeing based on digitgal multimedia broadcasting
KR20130056829A (en) Transmitter/receiver for 3dtv broadcasting, and method for controlling the same
KR101204112B1 (en) Method for transmitting/receiving in digital multimedia broadcasting system and apparatus thereof
KR20110068821A (en) Method and apparatus for receiving and transmitting
EP2648407A2 (en) Method and apparatus for transmitting stereoscopic video information
KR101808672B1 (en) Transmission apparatus and method, and reception apparatus and method for providing 3d service using the content and additional image seperately transmitted with the reference image transmitted in real time
KR20090059910A (en) Method for transmitting and receiving broadcasting signal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120620

Termination date: 20210502