CN101690200A - Method and apparatus for providing high-quality multimedia service in dmb system - Google Patents

Method and apparatus for providing high-quality multimedia service in dmb system Download PDF

Info

Publication number
CN101690200A
CN101690200A CN200880023147A CN200880023147A CN101690200A CN 101690200 A CN101690200 A CN 101690200A CN 200880023147 A CN200880023147 A CN 200880023147A CN 200880023147 A CN200880023147 A CN 200880023147A CN 101690200 A CN101690200 A CN 101690200A
Authority
CN
China
Prior art keywords
layer
enhancement layer
grouping
basal layer
pes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN200880023147A
Other languages
Chinese (zh)
Other versions
CN101690200B (en
Inventor
金光勇
李光淳
尹正日
金永受
杨圭台
裵在辉
崔序米
金柱延
徐在贤
林钟秀
李寿寅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics and Telecommunications Research Institute ETRI filed Critical Electronics and Telecommunications Research Institute ETRI
Publication of CN101690200A publication Critical patent/CN101690200A/en
Application granted granted Critical
Publication of CN101690200B publication Critical patent/CN101690200B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614—Multiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43074—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2362—Generation or processing of Service Information [SI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4345—Extraction or processing of SI, e.g. extracting service information from an MPEG stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/44029—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display for generating different versions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network
    • H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H2201/00—Aspects of broadcast communication
    • H04H2201/10—Aspects of broadcast communication characterised by the type of broadcast system
    • H04H2201/11—Aspects of broadcast communication characterised by the type of broadcast system digital multimedia broadcasting [DMB]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Systems (AREA)

Abstract

A transmission device and receiving device for providing high-quality multimedia services in a digital multimedia broadcasting (DMB) transmission system is provided. The transmission device separatesinput multimedia contents into a base layer elementary stream and an enhancement layer elementary stream, encodes the base layer elementary stream and the enhancement layer elementary stream, transforms the base layer elementary stream and the enhancement layer elementary stream into a base layer SL packet and an enhancement layer SL packet, transforms the base layer SL packet and the enhancementlayer SL packet into a base layer PES packet and an enhancement layer PES packet, and multiplexes the base layer PES packet and the enhancement layer PES packet according to a base layer elementary stream and an enhancement layer elementary stream and outputs a base layer TS packet and an enhancement layer TS packet.

Description

Be used for providing the method and apparatus of high-quality multimedia service at digital multimedia broadcasting system
Technical field
The present invention relates to be used to provide the media processing method and the equipment of high-quality multimedia service, utilize described method and apparatus, add to DMB and be used to provide the function of high-quality service, and can keep the backwards compatibility with existing receiver.
The present invention stems from by the information technology of information communication portion (MIC) (IT) research and development (R﹠amp; D) research project [2006-S-017-02, Development of High-Tech TerrestrialDMB Transmission] of plan support.
Background technology
In conventional digital multimedia broadcasting (DMB), multimedia service is multiplexed as single transport stream and transmits service after multiplexed.In DMB broadcasting, provide multimedia service by single stream, and in high-quality service is provided, have restriction thus.
Description of drawings
Fig. 1 is the block diagram of structure that illustrates the Media Processor of the traditional delivery unit in the DMB (DMB);
Fig. 2 is the concept map that is used for providing at DMB the system of high-quality multimedia service that illustrates according to the embodiment of the invention;
Fig. 3 is used for illustrating according to an embodiment of the invention the coding carried out at coding unit and the block diagram of multichannel multiplexing method;
Fig. 4 is used for illustrating according to another embodiment of the present invention the coding carried out at coding unit and the block diagram of multichannel multiplexing method;
Fig. 5 is a block diagram of carrying out the receiving system of the decoding reconciliation multichannel multiplexing method corresponding with illustrated coding and multichannel multiplexing method among Fig. 3;
Fig. 6 illustrates the flow chart that multichannel multiplexing method is conciliate in the decoding of carrying out according to an embodiment of the invention in decoding unit;
Fig. 7 is used for describing the block diagram that multichannel multiplexing method is conciliate in the decoding of carrying out at decoding unit according to another embodiment of the present invention;
Fig. 8 is the flow chart that multichannel multiplexing method is conciliate in illustrated decoding among Fig. 7;
Fig. 9 illustrates decoding according to another embodiment of the present invention and conciliates multichannel multiplexing method;
Figure 10 illustrates the MPEG-4 Object Descriptor (OD) that uses among the present invention;
Figure 11 is the block diagram that is used for providing at the DMB transfer system conveyer of high-quality multimedia service of the example embodiment according to the present invention; With
Figure 12 is the block diagram that is used for providing at the DMB transfer system receiving system of high-quality multimedia service of the example embodiment according to the present invention.
Summary of the invention
Technical problem
The invention provides a kind of receiving/transmission method and equipment, utilize described method and apparatus, add to DMB and be used to provide the function of high-quality service, and can keep the backwards compatibility with existing receiver.
Technical scheme
The invention provides a kind of structure, wherein transport stream (TS) is separated into basal layer TS and enhancement layer TS, transmit traditional TS via basal layer TS, and the additional multimedia service information that is used for high-quality service is by multiplexed and transmit via enhancement layer TS, make the service that transmits by different transmission channels to merge each other, and provide when needed.
Specifically, when being divided into basal layer and enhancement layer when giving DMB (DMB) transfer system so that with transfer mechanism with the hierarchical modulation function, the gross multimedia service can be provided to for example low specification (low-spec) terminal of mobile phone, and the high-quality multimedia service can be provided to high standard (high-spec) terminal.
Advantageous effects
The present invention proposes the equipment and the method that are used for providing the high-quality multimedia service at DMB (DMB), utilize described equipment and method, add the function that is used to provide high-quality service to DMB, and with the compatibility of traditional DMB network be possible, make can in addition do not have under the situation that particular machine changes, utilize traditional DMB network to keep predetermined quality.
Optimal mode
According to an aspect of the present invention, a kind of conveyer that is used for providing at DMB (DMB) transfer system the high-quality multimedia service is provided, this conveyer comprises: coding unit, be used for the input content of multimedia is separated into basal layer ES (basic stream) and enhancement layer ES, and described basal layer ES and enhancement layer ES are encoded respectively; SL (layer, sync) converter unit of packing is used for described basal layer ES and enhancement layer ES is transformed to basal layer SL grouping respectively and enhancement layer SL divides into groups; PES (Program Specific Information) converter unit of packing is used for described basal layer SL grouping and enhancement layer SL grouping is transformed to basal layer PES grouping respectively and enhancement layer PES divides into groups; And the multiplexed unit of TS (transport stream), be used for described basal layer PES grouping and enhancement layer PES grouping being carried out respectively multiplexed according to basal layer ES and enhancement layer ES, and the TS grouping of output basal layer and enhancement layer TS divide into groups.
According to a further aspect in the invention, a kind of receiving system that is used for providing at the DMB transfer system high-quality multimedia service is provided, this receiving system comprises: the quality selected cell, and base layer stream still will receive base layer stream and enhancement layer stream to be used for determining only to receive; Decoding unit is used for base layer stream and enhancement layer stream are decoded respectively, and exports basal layer TS grouping and enhancement layer TS grouping respectively; TS separates multiplexed unit, be used for described basal layer and enhancement layer TS grouping separate respectively multiplexed so that obtain basal layer PES grouping respectively and enhancement layer PES divides into groups; PES unpacks converter unit, is used for described basal layer and enhancement layer PES grouping are decoded respectively, so that obtain basal layer SL grouping and enhancement layer SL grouping respectively; Unpack converter unit with SL, be used for to described basal layer and strengthen the SL grouping carry out respectively multiplexed so that obtain basal layer ES and enhancement layer ES.
According to a further aspect in the invention, a kind of transfer approach that is used for providing at the DMB transfer system high-quality multimedia service is provided, this transfer approach comprises: will import content of multimedia and be separated into basal layer ES and enhancement layer ES, and described basal layer ES and enhancement layer ES are encoded; Described basal layer ES and enhancement layer ES are transformed to basal layer SL grouping and enhancement layer SL grouping; Described basal layer SL grouping and enhancement layer SL grouping are transformed to basal layer PES grouping and enhancement layer PES grouping; With according to basal layer ES and enhancement layer ES described basal layer PES grouping and enhancement layer PES grouping are carried out multiplexedly, and the TS grouping of output basal layer and enhancement layer TS divide into groups.
According to a further aspect in the invention, a kind of method of reseptance that is used for providing at the DMB transfer system high-quality multimedia service is provided, this method of reseptance comprises: the quality selection operation, and base layer stream still will receive base layer stream and enhancement layer stream to be used for determining only to receive; Decode operation is used for base layer stream and enhancement layer stream are decoded, and TS grouping of output basal layer and enhancement layer TS grouping; TS separates multiplex operation, be used for described basal layer and enhancement layer TS grouping separate multiplexed so that obtain basal layer PES grouping and enhancement layer PES divides into groups; PES unpacks map function, is used for described basal layer and enhancement layer PES grouping are decoded, so that obtain basal layer SL grouping and enhancement layer SL grouping; Unpack map function with SL, be used for to described basal layer and strengthen the SL grouping carry out multiplexed so that obtain basal layer ES and enhancement layer ES.
Embodiment
Explain the preferred embodiments of the present invention referring now to accompanying drawing.Same reference numerals among the figure or symbolic representation similar elements.In order to illustrate spirit of the present invention, the description that can omit known function or structure.
Fig. 1 is the block diagram of structure that illustrates the Media Processor of the traditional delivery unit in the DMB (DMB).
Video encoder is encoded to entering picture signal according to video standard, and audio coder is to entering coding audio signal.
The IOD data that initial object descriptor (IOD) generator 110 generates based on ISO/IEC 14496-1 standard.Object Descriptor (OD)/BIFS (binary format that is used for scene) generator 120 generates the OD/BIFS stream based on ISO/IEC 14496-1 standard.
SL packing device 130 (SL-layer, sync) generates as the SL grouping that is used to enter the synchronous grouping between the Media Stream, and follows ISO/IEC 14496-1 system standard.In other words, SL packing device 130 receives OD/BIFS stream, video-frequency basic flow (ES), audio ES and additional data, and generates corresponding with OD/BIFS stream, video ES, audio ES and additional data respectively OD/BIFS SL grouping, video SL grouping, audio frequency SL grouping and additional data packet.
Partly (section) generator (or PSI generator 140) (PSI-Program Specific Information) generates the part of the IOD/OD/BIFS that comprises reception, and follows ISO/IEC 13818-1 standard.Part generator 140 comprises 14496 part packaged units, is used for SL grouping (that is, OD/BIFS SL grouping) is packaged as 14496 parts, and comprises the PSI packaged unit, is used to generate the PSI information that comprises the IOD data.
PES packing device 150 (the PES-program flows substantially) receives the SL grouping and it is carried out the PES packing, and follows ISO/IEC 13818-1 standard.Transport stream (TS) multiplexer 160 receives this part respectively and as the result's of PES packing PES grouping from part generator 140 and PES packing device 150, and described part and PES grouping are multiplexed as MPEG-2TS.
Fig. 2 is the concept map that is used for providing at DMB the system of high-quality multimedia service that illustrates according to the embodiment of the invention.
In traditional multimedia broadcasting, multimedia service is by multiplexed and transmit by single transport stream.Yet, in the present invention, give DMB transfer system, make TS is separated into basal layer TS and enhancement layer TS the hierarchical modulation function, and thus traditional TS is transmitted as basal layer TS, and in enhancement layer TS, transmit the additional multimedia service information that is used for high-quality service.
So, the gross multimedia service can be provided to for example low specification terminal of mobile phone, and the high-quality multimedia service can be provided to the high standard terminal.
Coding unit comprises high-quality video encoder 210, high quality audio encoder 220 and additional data encoder 230.
High-quality video encoder 210 can be scalable video decoder, three-dimensional 3D video encoder, multiple view video coding device, multi-channel audio coding device etc.High-quality video encoder 210 is separated into base layer videos ES 211 and enhancement-layer video ES 212 with inlet flow, and base layer videos ES 211 and enhancement-layer video ES 212 are outputed to media system coding and multiplexed unit 240.Media system coding and the 240 couples of base layer videos ES 211 in multiplexed unit and enhancement-layer video ES 212 carry out multiplexed.
Similarly, high quality audio encoder 220 is separated into basal layer audio ES and enhancement layer audio ES with inlet flow, and basal layer audio ES and enhancement layer audio ES are outputed to media system coding and multiplexed unit 240.Media system coding and the 240 pairs of basal layer audio ES in multiplexed unit and enhancement layer audio ES are carried out multiplexed.Similarly, additional data encoder 230 is separated into base layer data ES and enhancement data ES with inlet flow, and base layer data ES and enhancement data ES are outputed to media system coding and multiplexed unit 240.Media system coding and the 240 couples of base layer data ES in multiplexed unit and enhancement data ES carry out multiplexed.
Media system coding and multiplexed unit 240 will be from video, audio frequency and data ES that high-quality video encoder 210, high quality audio encoder 220 and additional data encoder 230 receive respectively each be multiplexed as basal layer and enhancement layer.Thus, delivery unit 250 can transmit video, audio frequency and data ES after multiplexed via same channel or different channels.
Decoding unit comprises high-quality video decoder, high quality audio decoder, receiving element and the multiplexed unit 260 of media system decoding reconciliation.
Fig. 3 and 4 illustrates for the media system coding that the high-quality multimedia service proposes, carries out in the illustrated coding unit in Fig. 2 and the embodiment of multichannel multiplexing method are provided in DMB.Fig. 5 is a block diagram of carrying out the receiving system of the decoding reconciliation multichannel multiplexing method corresponding with illustrated coding and multichannel multiplexing method among Fig. 3.Fig. 6 and 7 illustrates according to the decoding of carrying out in decoding unit for the high-quality multimedia service is provided in DMB of the embodiment of the invention and conciliates multichannel multiplexing method.Fig. 8 is the flow chart that illustrates illustrated decoding reconciliation multichannel multiplexing method among Fig. 7.Fig. 9 illustrates decoding according to another embodiment of the present invention and conciliates multichannel multiplexing method.
Fig. 3 is the block diagram of the media system in illustrated coding unit coding and multiplexed unit in Fig. 2 according to an embodiment of the invention.
In the media system coding and multiplexed unit 240 of Fig. 2, SL packing device 310 each from high-quality video encoder 210, high quality audio encoder 220 and additional data encoder 230 receives basal layer ES and enhancement layer ES, and basal layer ES and the enhancement layer ES that receives is transformed to basal layer SL grouping and enhancement layer SL grouping.
SL packing device 310 is according to carrying out the similar mode of synchronous mode with SL packing device 130 pairs of videos, audio frequency and data flow of Fig. 1, come to make be used for basal layer stream (promptly, video, audio frequency and data ES) and to be used for the correspondence stream (that is, video, audio frequency and data ES) of enhancement layer synchronous.For example, should be synchronous in order in SL packing device 310, to carry out, based on the identical of (infer) of deriving from identical systems time clock (STC) OCR (object clock reference), and in stream, insert the timestamp information that for example stabs (CTS) recombination time.
PES packing device 320 according to the SL packing device 130 of Fig. 1 in the identical or similar mode of mode used, come SL grouping carrying out PES packing to receiving, and in basal layer ES and enhancement layer ES, insert the timestamp that presentative time for example stabs (PTS) based on the same system clock, so that carry out synchronously.
For base layer stream and enhancement layer stream exist a pair of IOD generator 350 and 351, pair of O D/ BIFS generator 360 and 361 and a pair of part generator 370 and 371 in each is right, and each is to formation base laminar flow and enhancement layer stream.
With illustrated traditional media system coding that comprises single TS multiplexer 160 and multiplexed unit among Fig. 1 form contrast be, media system coding and the multiplexed unit of Fig. 3 comprise two TS multiplexers, that is, basal layer TS multiplexer 330 and enhancement layer TS multiplexer 340.The media system of Fig. 3 coding and multiplexed unit according to basal layer and enhancement layer to the PES stream of packing and PSI partly/14496 part streams carry out multiplexed.
These two TS multiplexers 330 and 340 are by using same STC to generate basal layer MPEG-2TS grouping and enhancement layer MPEG-2TS divides into groups, and also by using same STC to generate timer reference of programs (PCR).The use of same STC makes that these two TS can be on whole receive-transmit system synchronously.
In this case, in order to make the increase that to divide into groups by surplus (surplus) TS that insertion PCR in MPEG-2TS divides into groups generates minimize, can in audio TS packet, insert PCR according to relative a small amount of and relative regular generation at interval.Therefore, only also PTS and OCR can be inserted in the audio stream.
At last, be suitable for the basal layer transfer channel and strengthen in the channel encoder of transfer channel to the grouping of the basal layer MPEG-2 TS after multiplexed and multiplexed after enhancement layer MPEG-2 TS grouping encode respectively, and then they are sent to basal layer transfer channel and enhancing transfer channel respectively.During the hierarchical modulation method in using DMB, used, can be mapped to base layer stream and enhancement layer stream in the single code element and be sent to single radio frequency (RF) channel.
In Fig. 3 in the illustrated embodiment,, can make owing to repeat to transmit the number of the unnecessary transmission grouping of generation and minimize by transmitting only by the PSI of the required information structuring of enhancement layer.
More specifically, in method according to the structure foundation layer PSI information 380 of the embodiment of the invention and enhancement layer PSI information 381, change the basal layer PSI information 380 of ground transmission, and the PMT/OD/BIFS information of only adding for enhancement layer is extracted and is included in the enhancement layer PSI information 381 corresponding to prior art.Receiving terminal can extract corresponding grouping by using basal layer PSI information 380 and enhancement layer PSI information 381 from this two-layer MPEG-2TS.
In another embodiment, change ground and transmit traditional basal layer PSI information 380, and enhancement layer PSI information 381 comprises the expansion PMT/OD/BIFS information that obtains by the information that is used for enhancement layer to the PMT/OD/BIFS information interpolation that is used for basal layer.Thus, receiving terminal can extract corresponding grouping by using basal layer PSI information 380 and comprising the enhancement layer PSI information 381 of expanding PMT/OD/BIFS information from this two-layer MPEG-2TS.
According to the present invention, when the providing of high-quality service is provided, can high-quality service simply be provided, and need not analysis foundation layer PSI information only by the analysis of enhancement layer PSI information.In addition, by not execution analysis basal layer PSI information processing, can simplify the operation of extracting the required information of enhancement layer.
Fig. 4 is used for illustrating according to another embodiment of the present invention the media system coding carried out at coding unit and the block diagram of multichannel multiplexing method.
Illustrated identical among illustrated media system coding and multichannel multiplexing method and Fig. 3 among Fig. 4 at synchronization aspects, but difference is that basal layer and enhancement layer are shared single IOD generator, single OD/BIFS generator and part generator.
According to current embodiment, IOD, OD and BIFS as the additional data that transmits from the sender only transmit by basal layer, make terminal extract the ES that is used for two-layer (that is, basal layer and enhancement layer), and, increase transmission efficiency thus by using the ES that extracts to construct scene.
In other words, owing to only transmit, can reduce because the expense that the packing of carrying out in each stage generates by single channel (that is, the basal layer channel) as IOD, OD and the BIFS of the relative small amount of data of these two-layer needs.
Fig. 5 carries out the block diagram that the receiving system of multichannel multiplexing method is conciliate in the decoding corresponding with illustrated coding and multichannel multiplexing method among Fig. 3 according to an embodiment of the invention.
At first, since base layer stream that hierarchical modulation etc. receives via single transfer channel or different transfer channel and enhancement layer stream by the respective channels decoder decode.Then, basal layer TS demultiplexer 510 is divided into partial data and PES stream with the base layer stream of decoding, and enhancement layer TS demultiplexer 511 is divided into partial data and PES stream with the enhancement layer stream of decoding.
Because the sender inserts PCR by using same STC, makes PCR continuous each other in each MPEG-2TS in this two-layer MPEG-2TS, so only extraction PCR in basal layer TS demultiplexer 510 and the enhancement layer TS demultiplexer 511, and when reproducing STC, use the PCR that extracts.In this case, in order to make the media representation between two-layer synchronous, by PCR-based cache flow buffering area, this two-layer MPEG-2TS should be synchronized with each other before through basal layer TS demultiplexer 510 and enhancement layer TS demultiplexer 511.
In order to realize this, can be based on the value of the PCR that in according to the audio TS packet that rule transmits at interval relatively, inserts, between the stream of realizing deriving from same time clock synchronously.
Fig. 6 illustrates the flow chart that multichannel multiplexing method is conciliate in the decoding of carrying out in the receiving system of Fig. 5.
[selection provides the situation of basic service]
The flow chart of the signal when the user selects only to provide basic service will be described now.
In operation S610 and S611, when the stream of packets of using existing MPEG-4 system coding is inserted among the MPEG-2TS and transmits, obtain wherein from MPEG-2TS that PID is the PAT (Program Association Table) of 0x0000, so that access is by media data multiplexed and that transmit.
In operation S630, explain Program Map Table (PMT) information that comprises among the PAT, so that from basal layer TS search PMT.The PMT that explanation obtains shows the identifier ES ID of all kinds ES and the relation table of packet identifier (PID) so that extract.
At operation S640 and S641 in S644, by according to the relation table that extracts with reference to corresponding PID, and dissimilar TS groupings are separated from one another, and from the TS grouping of each separation, extract ES information then.Then, explain the OD that comprises in the ES information, the feasible tabulation that writes about the relevant information of each object and each ES.
Thereafter, in operation S670 and S680, decoded video or audio stream utilize because the relevant information that decoding is extracted is constructed scene, and reproduce data.
[selection provides the situation of high-quality service]
The flow chart of the signal when the user selects high-quality service is provided will be described now.
In operation S611 and S621, when the user selects high-quality service is provided, side by side extract enhancement layer TS grouping with the initial extraction of basal layer TS grouping, and preliminary (primarily) carry out between basal layer TS grouping and the enhancement layer TS grouping synchronously.
In operation S631 and S650, wherein operate S650 and comprise that S651 is to S654, similar with the operation S640 that when basic service is provided, carries out, PAT and PMT that explanation transmits in enhancement layer TS grouping, and extract each the type ES that transmits via the enhancement layer channel thus, and write information list about each object and each ES.
In operation S661, will combine with the relevant information of the ES of relevant extraction from the ES (for example, video ES, audio ES and data ES) of the extraction of basal layer and enhancement layer.Thereafter, in operation S670 and S680, video and/or audio stream is decoded, and constructs scene before reproducing data.
Fig. 7 illustrates information as for example IOD, OD/BIFS etc. and is inserted in the bit stream and when transmitting by one of basal layer and enhancement layer, carry out the receiving system that multichannel multiplexing method is conciliate in decoding according to another embodiment of the present invention.
The decoding of carrying out in the illustrated receiving system among Fig. 7 is conciliate multichannel multiplexing method corresponding to illustrated coding and multichannel multiplexing method among Fig. 4.
Among Fig. 7 among illustrated receiving system and Fig. 5 the difference of illustrated receiving system according to first embodiment be, do not comprise the partial interpretation device that is used to explain enhancement layer IOD and OD/BIFS information, and the information of relevant enhancement layer is incorporated in PSI part and the transmission that is used for basal layer.Therefore, illustrated receiving system and is sent to the scene structural unit with the information of extracting from basal layer PSI extracting section enhancement layer IOD and OD/BIFS information among Fig. 7.
Fig. 8 illustrates the flow chart that multichannel multiplexing method is conciliate in the decoding of carrying out in the receiving system of Fig. 7.
When the user selected only to provide basic service, illustrated decoding was conciliate among multichannel multiplexing method and Fig. 6 illustrated identical among Fig. 8.Yet, when the user selects high-quality service is provided, illustrated decoding conciliates that illustrated difference is among multichannel multiplexing method and Fig. 6 among Fig. 8, only carry out the explanation of PMT and OD for basal layer, and extract relevant these many two-layer information simultaneously, and only carry out the merging of dissimilar ES thus based on described explanation.
Conciliating in the multichannel multiplexing method according to the decoding of another embodiment of Fig. 8, mapping relations between the base layer stream and the mapping relations between the enhancement layer stream are added to first circulation and second circulation, and description here.Receiving terminal extracts corresponding grouping from basal layer MPEG-2 TS and enhancement layer MPEG-2 TS by using the mapping relations of adding.
In addition, the decoding according to another embodiment at Fig. 8 is conciliate in the multichannel multiplexing method, also only transmit OD stream by basic layer, and the ES_Descriptor (ES_ descriptor) that will be described as constructing scene is additional is inserted among the basal layer MPEG-2TS, so that describe video ES, audio ES and the data ES that is used for video ES, audio ES and the data ES of basal layer and is used for enhancement layer.
As illustrated in Figure 6, in order to make the increase that to divide into groups by the superfluous TS that insertion PCR in MPEG-2TS divides into groups generates minimize, can in audio TS packet, insert PCR according to relative a small amount of and relative regular generation at interval.Even only PTS and OCR can be inserted in the audio stream therefore.
Fig. 9 illustrates decoding according to another embodiment of the present invention and conciliates multichannel multiplexing method.
PMT is made of the circulation of two classes, i.e. first and second circulations 910 and 920.First circulation 910 is described and the ES_Descriptor of the content of object factory constitutes by comprising about scene, and second circulation, 920 mappings are used for transmitting PID, Stream_type (stream _ type) etc. that the MPEG-2TS of the ES that describes at ES_Descriptor divides into groups.
The decoding of describing in conjunction with Fig. 7 and 8 according to another embodiment is in the above conciliate in the multichannel multiplexing method, and mapping relations between the base layer stream and the mapping relations between the enhancement layer stream are added to these two circulations and here describe.Receiving system extracts corresponding grouping from basal layer MPEG-2TS and enhancement layer MPEG-2TS by using the mapping relations of adding.
In addition, conciliating in the multichannel multiplexing method according to the decoding of second embodiment, OD stream also only transmits by the basal layer channel, and be described as constructing additional being inserted among the basal layer MPEG-2 TS of ES_Descriptor quilt of scene, so that describe video ES, audio ES and the data ES that is used for video ES, audio ES and the data ES of basal layer and is used for enhancement layer.
Figure 10 illustrates the MPEG-4OD according to the embodiment of the invention.
Base layer stream can be defined as different OD with enhancement layer stream.Yet, in the present embodiment, close to tie up to and comprise two ES descriptors that are used for basal layer and enhancing among the single OD according to being subordinate to (subordinate).
This membership can use MPEG-4ES descriptor " StreamDependanceFlag (stream dependency sign) " and " dependsOn_ES_ID " to express.The position of using URL_Flag (URL_ sign) to specify ES is present in the enhancement layer so that express ES oneself.
Base layer stream as independent stream is set to " ObjectTypeIndication (object type indication)=0x21 (AVC), StreamType (stream type)=0x04 (visual stream) " according to the AVC codec as traditional standard.Be encoded according in SVC codec or a plurality of other codecs any as the enhancement layer stream of subordinate stream, and be set to " ObjectTypeIndication=0xC0 (user is privately owned); StreamType=0x04 (visual stream); StreamDependanceFlag=1, dependsOn_ES_ID=101 (basal layer ES_ID) " thus.
The base layer stream of subordinate is at enhancement layer but not the existence in the basal layer is expressed as " URL_Flag=1, URLstring[URLlength]=xx (position of enhancement layer) ".
Therefore, only discern the conventional terminal of basal layer and fail to discern " ObjectTypeIndication " information that is used for enhancement layer, and guarantee compatibility thus.According to existence and " ObjectTypeIndication " information that is used for the terminal recognition subordinate stream of high-quality multimedia service of the present invention, and also correctly receive enhancement layer stream thus.
Figure 11 is the block diagram that is used for providing at the DMB transfer system conveyer 1100 of high-quality multimedia service of the example embodiment according to the present invention.
Conveyer 1100 comprises coding unit 1110, SL packing converter unit 1120, PES packing converter unit 1130 and the multiplexed unit 1140 of TS.
Coding unit 1110 will be imported content of multimedia and be separated into basal layer ES and enhancement layer ES, and basal layer ES and enhancement layer ES are encoded.
SL packing converter unit 1120 is transformed to basal layer SL grouping and enhancement layer SL grouping with basal layer ES and enhancement layer ES, and carries out synchronous between basal layer SL grouping and the enhancement layer SL grouping.
PES packing converter unit 1130 is transformed to basal layer PES grouping and enhancement layer PES grouping with basal layer SL grouping and enhancement layer SL grouping, and carries out synchronous between dividing into groups of basal layer PES grouping and enhancement layer PES.
SL packing converter unit 1120 concludes that by using based on same STC the OCR of (ascertain) inserts timestamp information in basal layer SL grouping and enhancement layer SL grouping, and carries out synchronously.PES packing converter unit 1130 inserts timestamp information by using the PCR that concludes based on same STC in basal layer PES grouping and enhancement layer PES grouping, and carries out synchronously.For example, SL packing converter unit 1120 inserts CTS as timestamp information, and PES packing converter unit 1130 inserts PTS as timestamp information.
It is multiplexed that the multiplexed unit 1140 of TS comes PES grouping to carry out according to basal layer TS and enhancement layer TS, so that generate the TS grouping.At this moment, the multiplexed unit of TS 1140 is by inserting PCR or by using the identical STC among basal layer ES and the enhancement layer ES, carrying out synchronously in the TS grouping according to basal layer ES and enhancement layer ES.
Figure 12 is the block diagram that is used for providing at the DMB transfer system receiving system of high-quality multimedia service of the example embodiment according to the present invention.
This receiving system comprises that quality selected cell 1210, decoding unit 1220, TS separate multiplexed unit 1230, PES unpacks converter unit 1240 and SL unpacks converter unit 1250.
Quality selected cell 1210 determines only to receive based on user's selection, and base layer stream still will receive base layer stream and enhancement layer stream.
1220 pairs of base layer stream of decoding unit and enhancement layer stream are decoded, so that obtain the TS grouping.TS separate the 1230 couples of TS in multiplexed unit grouping separate multiplexed so that obtain the PES grouping, and carry out between the PES grouping synchronously.
PES unpacks 1240 couples of these TS of converter unit and separates the PES grouping that multiplexed unit 1230 obtained and decode so that obtains the SL grouping, and carries out synchronous between the SL grouping.SL unpacks converter unit 1250 and divides into groups to carry out multiplexed according to basal layer ES and enhancement layer ES to SL.
The present invention also can be embodied as the computer-readable code on the computer readable recording medium storing program for performing.Computer readable recording medium storing program for performing is that can store thereafter can be by any data storage device of the data of computer system reads.The example of computer readable recording medium storing program for performing comprises read-only memory (ROM), random-access memory (ram), CD-ROM, tape, floppy disk, optical data storage device and carrier wave (for example the data by the internet transmit).Computer readable recording medium storing program for performing also can make and store and move computer-readable code according to distribution mode by distributing with the computer system of network-coupled.And computer-readable medium can be distributed, store and the operation computer-readable code in the embedded system that connects via wireless network of for example sensor node.
Although specifically illustrate and described the present invention with reference to its preferred embodiment, it will be appreciated by those skilled in the art that and to carry out the various changes of form and details here, and do not break away from the spirit and scope of the present invention that claims limit.Preferred embodiment should be only considered according to the implication of describing rather than for the purpose that limits.So scope of the present invention be can't help detailed description of the present invention and is limited, and is defined by the following claims, and all difference in this scope will be interpreted as comprising in the present invention.

Claims (38)

1. conveyer that is used for providing the high-quality multimedia service at DMB (DMB) transfer system, this conveyer comprises:
Coding unit is used for the input content of multimedia is separated into basal layer ES (basic stream) and enhancement layer ES, and this basal layer ES and this enhancement layer ES is encoded respectively;
SL (layer, sync) converter unit of packing is used for this basal layer ES and this enhancement layer ES is transformed to basal layer SL grouping respectively and enhancement layer SL divides into groups;
PES (Program Specific Information) converter unit of packing is used for described basal layer SL grouping and enhancement layer SL grouping is transformed to basal layer PES grouping respectively and enhancement layer PES divides into groups; With
The multiplexed unit of TS (transport stream) is used for according to basal layer ES and enhancement layer ES described basal layer PES grouping and enhancement layer PES grouping being carried out respectively multiplexed, and the TS grouping of output basal layer and enhancement layer TS divide into groups.
2. according to the conveyer of claim 1, wherein this SL packing converter unit and this PES packing converter unit insert timestamp information by using the OCR (object clock reference) that concludes based on same STC (system time clock) respectively in described SL grouping and PES grouping, and carry out respectively between the SL grouping synchronously and PES synchronous between dividing into groups.
3. according to the conveyer of claim 2, wherein this SL packing converter unit inserts CTS (stamp recombination time) as this timestamp information.
4. according to the conveyer of claim 2, wherein this PES packing converter unit inserts PTS (presentative time stamp) as this timestamp information.
5. according to the conveyer of claim 1, wherein when generating the TS grouping, this TS uses multiplexed unit the same STC in basal layer ES and enhancement layer ES.
6. according to the conveyer of claim 1, wherein the multiplexed unit of this TS inserts PCR (program reference clock) respectively in basal layer ES and enhancement layer ES.
7. according to the conveyer of claim 1, also comprise the additional data generation unit, be used for, and generate the additional data that is used for the scene structure respectively based on basal layer ES that separates at this coding unit and enhancement layer ES.
8. according to the conveyer of claim 7, also comprise part generating unit, be used to generate PSI (PSI-Program Specific Information) part that is used for basal layer ES and the PSI part that is used for enhancement layer ES, each in the wherein said PSI part comprises additional data.
9. according to the conveyer of claim 7, each in the wherein said additional data is sent to basal layer ES and enhancement layer ES respectively, and the additional data information of wherein only adding for enhancement layer is sent to enhancement layer ES.
10. according to the conveyer of claim 7, the additional data that wherein is used for basal layer and is used for enhancement layer is only by basal layer ES transmission, and when lacking the additional data that is used for enhancement layer, the additional data that only will be used for basal layer is sent to basal layer ES.
11. a receiving system that is used for providing at the DMB transfer system high-quality multimedia service, this receiving system comprises:
The quality selected cell, base layer stream still will receive base layer stream and enhancement layer stream to be used for determining only to receive;
Decoding unit is used for base layer stream and enhancement layer stream are decoded respectively, and exports basal layer TS grouping and enhancement layer TS grouping respectively;
TS separates multiplexed unit, be used for described basal layer and enhancement layer TS grouping separate respectively multiplexed so that obtain basal layer PES grouping respectively and enhancement layer PES divides into groups;
PES unpacks converter unit, is used for described basal layer and enhancement layer PES grouping are decoded respectively, so that obtain basal layer SL grouping and enhancement layer SL grouping respectively; With
SL unpacks converter unit, be used for to described basal layer and strengthen the SL grouping carry out multiplexed so that obtain basal layer ES and enhancement layer ES.
12. receiving system according to claim 11, wherein this PES unpacks converter unit and this SL and unpacks the timestamp information of converter unit to use the OCR that concludes based on same STC to insert, and carries out synchronous synchronously and between the SL grouping between the PES grouping respectively.
13. according to the receiving system of claim 12, wherein this PES unpacks converter unit by using the PTS that inserts as this timestamp information, carries out synchronously.
14. according to the receiving system of claim 12, wherein this SL unpacks converter unit by using the CTS that inserts as this timestamp information, carries out synchronously.
15. according to the receiving system of claim 12, wherein this TS separates multiplexed unit by use the PCR that comprises in one of basal layer ES and enhancement layer ES, carries out synchronously.
16. receiving system according to claim 11, wherein be received in the additional data that is used for the scene structure that has inserted in the stream that delivery unit transmitted of this DMB transfer system, and from enhancement layer ES, extract the additional data information of only adding for enhancement layer by among described basal layer ES and the enhancement layer ES each.
17. receiving system according to claim 11, wherein be received in the additional data that is used for the scene structure that has inserted in the stream that delivery unit transmitted of this DMB transfer system by described basal layer ES, wherein this additional data information comprises additional data that is used for basal layer and the additional data that is used for enhancement layer.
18., wherein only be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for the scene structure by described basal layer ES according to the receiving system of claim 11.
19. according to any the receiving system in the claim 16 to 18, wherein this additional data information comprises PSI, IOD (initial object descriptor), OD and BIFS (binary format of scene) information.
20. a transfer approach that is used for providing at the DMB transfer system high-quality multimedia service, this transfer approach comprises:
To import content of multimedia and be separated into basal layer ES and enhancement layer ES, and this basal layer ES and this enhancement layer ES will be encoded;
This basal layer ES and this enhancement layer ES are transformed to basal layer SL grouping and enhancement layer SL grouping;
This basal layer SL grouping and this enhancement layer SL grouping are transformed to basal layer PES grouping and enhancement layer PES grouping; With
According to basal layer ES and enhancement layer ES this basal layer PES grouping and this enhancement layer PES grouping are carried out multiplexedly, and the TS grouping of output basal layer and enhancement layer TS divide into groups.
21. transfer approach according to claim 20, the step that wherein is transformed to SL grouping and is transformed to the PES grouping comprises: by using the OCR that concludes based on same STC in this SL grouping, to insert timestamp information and in this PES grouping, insert timestamp information, and carry out respectively between the SL grouping synchronously and between the PES grouping synchronously.
22., wherein in the step that is transformed to the SL grouping, insert CTS as this timestamp information according to the transfer approach of claim 21.
23., wherein in the step that is transformed to the PES grouping, insert PTS as this timestamp information according to the transfer approach of claim 21.
24., wherein in the multiplexed step of this TS, when generating the TS grouping, use the same STC among basal layer ES and the enhancement layer ES according to the transfer approach of claim 20.
25., wherein in the multiplexed step of this TS, in basal layer ES and enhancement layer ES, insert PCR according to the transfer approach of claim 20.
26. the transfer approach according to claim 20 also comprises:, and generate the additional data that is used for the scene structure based on the basal layer ES and the enhancement layer ES that obtain when basis of coding layer ES and the enhancement layer ES.
27. according to the transfer approach of claim 26, comprise also generating PSI part that is used for basal layer ES and the PSI part that is used for enhancement layer ES that each in the wherein said PSI part comprises additional data.
28. according to the transfer approach of claim 26, the additional data that wherein will be used for basal layer is sent to basal layer ES and enhancement layer ES respectively with the additional data that is used for enhancement layer.
29. according to the transfer approach of claim 26, the additional data that wherein is used for basal layer transmits at basal layer ES with the additional data that is used for enhancement layer.
30. a method of reseptance that is used for providing at the DMB transfer system high-quality multimedia service, this method of reseptance comprises:
The quality selection operation, base layer stream still will receive base layer stream and enhancement layer stream to be used for determining only to receive;
Decode operation is used for base layer stream and enhancement layer stream are decoded, and TS grouping of output basal layer and enhancement layer TS grouping;
TS separates multiplex operation, be used for described basal layer and enhancement layer TS grouping separate multiplexed so that obtain basal layer PES grouping and enhancement layer PES divides into groups;
PES unpacks map function, is used for described basal layer and enhancement layer PES grouping are decoded, so that obtain basal layer SL grouping and enhancement layer SL grouping; With
SL unpacks map function, be used for to described basal layer and strengthen the SL grouping carry out multiplexed so that obtain basal layer ES and enhancement layer ES.
31. method of reseptance according to claim 30, wherein unpacking map function at this PES unpacks in the map function with this SL, based on the timestamp information that uses the OCR that concludes based on same STC to insert, carry out synchronous synchronously and between the SL grouping between the PES grouping respectively.
32. according to the method for reseptance of claim 31, wherein unpack in the map function,, carry out synchronously by using the PTS that inserts as this timestamp information at this PES.
33. according to the method for reseptance of claim 31, wherein unpack in the map function,, carry out synchronously by using the CTS that inserts as this timestamp information at this SL.
34. according to the method for reseptance of claim 31, wherein separate in the multiplex operation,, carry out synchronously by using the PCR that in one of basal layer ES and enhancement layer ES, comprises at this TS.
35. method of reseptance according to claim 30, wherein be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for the scene structure, and from enhancement layer ES, extract the additional data that only adds for enhancement layer by among this basal layer ES and this enhancement layer ES each.
36. method of reseptance according to claim 30, wherein be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for the scene structure by described basal layer ES, wherein this additional data information comprises additional data that is used for basal layer and the additional data that is used for enhancement layer.
37., wherein only be received in the additional data information of having inserted in the stream that delivery unit transmitted of this DMB transfer system that is used for the scene structure by described basal layer ES according to the method for reseptance of claim 30.
38. according to any the method for reseptance in the claim 35 to 37, wherein this additional data information comprises PSI, IOD, OD and BIFS information.
CN2008800231475A 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system Expired - Fee Related CN101690200B (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
KR10-2007-0043734 2007-05-04
KR20070043734 2007-05-04
KR1020070043734 2007-05-04
PCT/KR2008/002516 WO2008136623A1 (en) 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system
KR10-2008-0041434 2008-05-02
KR1020080041434 2008-05-02
KR1020080041434A KR20080098328A (en) 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system

Publications (2)

Publication Number Publication Date
CN101690200A true CN101690200A (en) 2010-03-31
CN101690200B CN101690200B (en) 2012-06-20

Family

ID=40285873

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008800231475A Expired - Fee Related CN101690200B (en) 2007-05-04 2008-05-02 Method and apparatus for providing high-quality multimedia service in dmb system

Country Status (4)

Country Link
EP (1) EP2153645A4 (en)
KR (1) KR20080098328A (en)
CN (1) CN101690200B (en)
WO (1) WO2008136623A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102480634A (en) * 2010-11-24 2012-05-30 中兴通讯股份有限公司 Method, equipment and system for synchronizing tiered business in China mobile multimedia broadcasting
CN105612755A (en) * 2013-11-08 2016-05-25 松下电器（美国）知识产权公司 Transmission method, receiving method, transmission device and receiving device
CN105794214A (en) * 2013-10-07 2016-07-20 爱立信股份有限公司 Network personal video recorder savings with scalable video coding

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101201206B1 (en) * 2008-12-22 2012-11-15 한국전자통신연구원 Apparatus and method for multiplexing and demultiplexing based on digital multimedia broadcasting
KR101289886B1 (en) * 2009-02-03 2013-07-24 한국전자통신연구원 Methode of transmitting signal, device of transmitting signal, method of receiving signal and device of receiving signal for digital multimedia broadcasting serivce
WO2010147289A1 (en) * 2009-06-16 2010-12-23 Lg Electronics Inc. Broadcast transmitter, broadcast receiver and 3d video processing method thereof
KR101368468B1 (en) * 2010-02-10 2014-03-03 한국전자통신연구원 Apparatus and method for transmitting and receiving broadcasting signal
WO2011097754A1 (en) * 2010-02-11 2011-08-18 上海贝尔股份有限公司 Transmission method and device for scalable coding stream in relay network
EP2606649A4 (en) * 2010-08-19 2016-05-04 Samsung Electronics Co Ltd Method and apparatus for encoding and decoding multilayer videos
US9848217B2 (en) 2012-01-20 2017-12-19 Korea Electronics Technology Institute Method for transmitting and receiving program configuration information for scalable ultra high definition video service in hybrid transmission environment, and method and apparatus for effectively transmitting scalar layer information
KR101656193B1 (en) * 2015-08-11 2016-09-22 서울여자대학교 산학협력단 MMT-based Broadcasting System and Method for UHD Video Streaming over Heterogeneous Networks
WO2018016879A1 (en) * 2016-07-19 2018-01-25 한국전자통신연구원 Method and device for providing 360-degree virtual reality broadcasting service
US10931980B2 (en) 2016-07-19 2021-02-23 Electronics And Telecommunications Research Institute Method and apparatus for providing 360 degree virtual reality broadcasting service
WO2018186525A1 (en) * 2017-04-07 2018-10-11 주식회사 아이리버 Modular signal conversion apparatus having synchronized clock, and data processing apparatus
CN107197390B (en) * 2017-05-27 2019-11-12 上海东方明珠广播电视研究发展有限公司 Wireless signal emission system, method, method for receiving and processing signal and terminal

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000078573A (en) * 1998-09-03 2000-03-14 Hitachi Ltd Hierarchical encoded data distribution device
US6785330B1 (en) * 1999-08-19 2004-08-31 Ghildra Holdings, Inc. Flexible video encoding/decoding method
US7116717B1 (en) * 1999-12-15 2006-10-03 Bigband Networks, Inc. Method and system for scalable representation, storage, transmission and reconstruction of media streams
US7133449B2 (en) * 2000-09-18 2006-11-07 Broadcom Corporation Apparatus and method for conserving memory in a fine granularity scalability coding system
US7450612B2 (en) * 2002-12-04 2008-11-11 Koninklijke Electronics N.V. Packetization of layered media bitstreams
KR100587324B1 (en) * 2003-06-14 2006-06-08 엘지전자 주식회사 Method for servicing digital multimedia broadcasting, transmitter/receiver, and data structure
KR100585933B1 (en) * 2003-08-20 2006-06-01 한국전자통신연구원 System ? Method for Digital Multimedia Broadcasting
JP2008516556A (en) * 2004-10-13 2008-05-15 トムソン ライセンシング Complexity scalable video coding / decoding method and apparatus
KR100760260B1 (en) * 2005-02-04 2007-09-19 한국전자통신연구원 Apparatus and Method for creating transport stream for efficient transmission of timing information, and DMB transmission system using it
EP1742476A1 (en) * 2005-07-06 2007-01-10 Thomson Licensing Scalable video coding streaming system and transmission mechanism of the same system
US8879635B2 (en) * 2005-09-27 2014-11-04 Qualcomm Incorporated Methods and device for data alignment with time domain boundary

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102480634A (en) * 2010-11-24 2012-05-30 中兴通讯股份有限公司 Method, equipment and system for synchronizing tiered business in China mobile multimedia broadcasting
WO2012068898A1 (en) * 2010-11-24 2012-05-31 中兴通讯股份有限公司 Method, apparatus and system for synchronizing tiered service in mobile multimedia broadcasting
CN102480634B (en) * 2010-11-24 2015-12-16 中兴通讯股份有限公司 The method, apparatus and system that in Mobile Multimedia Broadcasting, classified service is synchronous
CN105794214A (en) * 2013-10-07 2016-07-20 爱立信股份有限公司 Network personal video recorder savings with scalable video coding
CN105794214B (en) * 2013-10-07 2019-09-20 爱立信股份有限公司 Pass through the network individual video logger saving of scalable video
CN105612755A (en) * 2013-11-08 2016-05-25 松下电器（美国）知识产权公司 Transmission method, receiving method, transmission device and receiving device
CN105612755B (en) * 2013-11-08 2019-08-23 松下电器（美国）知识产权公司 Sending method, method of reseptance, sending device and reception device

Also Published As

Publication number Publication date
EP2153645A1 (en) 2010-02-17
KR20080098328A (en) 2008-11-07
WO2008136623A1 (en) 2008-11-13
CN101690200B (en) 2012-06-20
EP2153645A4 (en) 2011-07-27

Similar Documents

Publication Publication Date Title
CN101690200B (en) Method and apparatus for providing high-quality multimedia service in dmb system
KR101639358B1 (en) Transmission apparatus and method, and reception apparatus and method for providing 3d service using the content and additional image seperately transmitted with the reference image transmitted in real time
CN102484731B (en) Method and apparatus for generating 3-dimensional image datastream, and method and apparatus for receiving the 3-dimensional image datastream
US8422564B2 (en) Method and apparatus for transmitting/receiving enhanced media data in digital multimedia broadcasting system
US9380288B2 (en) System and method for transmitting/receiving three dimensional video based on digital broadcasting
RU2674890C2 (en) Transmission apparatus, transmission method, reception apparatus, reception method, encoding apparatus, and encoding method
KR100397511B1 (en) The processing system and it's method for the stereoscopic/multiview Video
US8917314B2 (en) Apparatus and method for synchronizing stereoscopic image, and apparatus and method for providing stereoscopic image based on the same
CN102835047B (en) The link information about multiple vision point video stream is used to send the method and apparatus of digital broadcasting stream and the method and apparatus of receiving digital broadcast stream
US9210354B2 (en) Method and apparatus for reception and transmission
KR101856093B1 (en) Content providing apparatus and method, and content reproduction apparatus and method for synchronization between left and right stream in the stationary-mobile hybrid 3dtv broadcast
US20110010739A1 (en) Method and apparatus for transmitting/receiving stereoscopic video in digital broadcasting system
US20120320168A1 (en) Method and apparatus for transmission and reception in the provision of a plurality of transport interactive 3dtv broadcasting services
MX2012008816A (en) Method and apparatus for generating data stream for providing 3-dimensional multimedia service, and method and apparatus for receiving the data stream.
TW201127062A (en) Multiview video coding over MPEG-2 systems
EP2685729A2 (en) Transmission device and method for providing program-linked stereoscopic broadcasting service, and reception device and method for same
CN105453574A (en) Transmission device, transmission method, receiving device, and receiving method
KR20090014875A (en) Digital broadcasting transmission/receiving apparatus and method
US20140125762A1 (en) Transmission device, transmission method, reception apparatus, and reception method
US20110090314A1 (en) Method and apparatus for generating stream and method and apparatus for processing stream
CN114449292A (en) Encoding device, encoding method, transmission device, and reception device
CN102104795A (en) Method for multiplexing program stream (PS) paths into transport stream (TS) path based on moving picture experts group (MPEG)-2
US20100315486A1 (en) Stereoscopic video service providing/receiving method and apparatus in digital broadcasting system
CN102326387B (en) Apparatus and method for multiplexig and demultiplxeing based on digitgal multimedia broadcasting
KR20130056829A (en) Transmitter/receiver for 3dtv broadcasting, and method for controlling the same

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120620

Termination date: 20210502