CN102480634A - Method, equipment and system for synchronizing tiered business in China mobile multimedia broadcasting - Google Patents

Method, equipment and system for synchronizing tiered business in China mobile multimedia broadcasting Download PDF

Info

Publication number
CN102480634A
CN102480634A CN2010105577587A CN201010557758A CN102480634A CN 102480634 A CN102480634 A CN 102480634A CN 2010105577587 A CN2010105577587 A CN 2010105577587A CN 201010557758 A CN201010557758 A CN 201010557758A CN 102480634 A CN102480634 A CN 102480634A
Authority
CN
China
Prior art keywords
bit stream
layer bit
cmmb
stream
timestamp
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2010105577587A
Other languages
Chinese (zh)
Other versions
CN102480634B (en
Inventor
陈光亮
戴志军
张建强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201010557758.7A priority Critical patent/CN102480634B/en
Priority to PCT/CN2011/077591 priority patent/WO2012068898A1/en
Publication of CN102480634A publication Critical patent/CN102480634A/en
Application granted granted Critical
Publication of CN102480634B publication Critical patent/CN102480634B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network

Abstract

The invention relates to a method, equipment and a system for synchronizing tiered business in China mobile multimedia broadcasting. When each tier of data rates of the tiered business in an MPEG (moving picture experts group)-2TS (transport stream) data rate is transmitted by CMMB (China mobile multimedia broadcasting), and synchronization of all tiers of data rates (namely: all tiered data) of the tiered business is guaranteed by means of timestamps, so that normal implementation of the tiered business in the CMMB is ensured.

Description

Synchronous method, equipment and the system of classified service in the CMMB
Technical field
The present invention relates to the mobile communication technology field; Specifically be a kind of mobile multimedia broadcast system (CMMB; When transmitting MPEG-2TS flow point level business China Mobile Multimedia Broadcasting), realize the method and system of a plurality of hierarchical synchronization of classified service.
Background technology
Along with development of Communication Technique, the application of China mobile multi-media broadcasting technology is more and more wider.At present, the China Mobile multimedia broadcasting system (be called for short: CMMB) standard code in the broadcasting service frequency range, frame structure, chnnel coding and the modulation etc. of mobile multimedia broadcast system broadcast channel transmission signals.Stipulate in the CMMB standard, adopt multiplexed sub frame to come stream medium datas such as encapsulate video, audio frequency, transmit.
Classified service is meant that encoder encodes to content source; Produce the code stream of many levels; Basic layer bit stream can be decoded separately, and enhancement layer bitstream comprises the additional information that is used to improve the low-lever code current mass, need and comprise that the low layer code stream of basic layer is decoded together.Classified service can be realized other differentiated service in poor service, realize that the ability at various terminals is adaptive that have plurality of advantages, therefore, it is necessary in the CMMB system, transmitting classified service.
In the classified service, the terminal receives the moment that finishes at frame data, and code stream can be encoded in a plurality of layerings.In end side, need and will merge through the code stream of different layerings, merge like a plurality of layerings same frame of video, carry out video decode then and represent.When merging, must be synchronously between each layer bit stream, could guarantee to participate in merging be same access unit code stream, the success of assurance merging merges and could guarantee that successfully subsequent decoding represents success.
In the prior art, do not provide each layer bit stream to transmit, and guarantee the synchronous technology between each layer bit streams of above-mentioned a plurality of classified services through CMMB with the classified service in the MPEG-2TS stream.
Summary of the invention
Main purpose of the present invention provides synchronous method, equipment and the system of classified service in a kind of CMMB; Each layer bit stream of classified service in the MPEG-2TS stream is transmitted through CMMB, and guarantee between each layer bit streams of above-mentioned a plurality of classified services synchronously.
The technical solution adopted for the present invention to solve the technical problems is:
Classified service sends synchronous method in a kind of CMMB, and it comprises:
The MPEG-2TS code stream that front end transmitting apparatus received code equipment sends;
From said MPEG-2TS code stream, extract packaged media data, obtain each layer bit stream: basic layer bit stream and enhancement layer bitstream;
Said each layer bit stream is packaged in respectively in the different multiplexed sub frames in the broadcast channel frame by the layer under it and the multiplexed sub frame positional information that will said each layer bit stream belongs to is packaged in the said broadcast channel frame;
The CMMB airtime that the PTS timestamp of said each layer bit stream of said media data converts under benchmark unified time is stabbed, control that said each layer bit stream stabs in the CMMB airtime synchronously;
The media data that needs are sent stabs the broadcasting transmission together with the CMMB airtime of said each layer bit stream of this media data.
Preferably, the CMMB airtime that the PTS timestamp of said said each layer bit stream with said media data converts under benchmark unified time stabs, control that said each layer bit stream stabs in the CMMB airtime synchronously; Specifically comprise:
According to the PCR time of said each layer bit stream of PCR temporal information calculating of PTS information in the PES bag at said each layer bit stream place and PES bag;
PCR time of this layer bit stream multiply by the CMMB time scale then divided by the clock scale of PCR, obtain the CMMB timestamp of this layer bit stream.
The present invention also provides the synchronous method of classified service reception in a kind of CMMB, and it comprises:
The terminal receiving equipment is monitored the multiplexed sub frame positional information at each layer bit stream place described in the broadcast channel frame;
Receive the basic layer bit stream in said each layer bit stream according to said positional information and the disposal ability of self, or receive said basic layer bit stream and corresponding enhancement layer bitstream;
Said each layer bit stream was stabbed alignment, merges after synchronously by the CMMB airtime;
Said each layer bit stream decoded represent.
Preferably, saidly said each layer bit stream pressed the CMMB airtime stab alignment, synchronously, specifically comprise:
Said terminal receiving equipment is put into buffering area with received said each layer bit stream together with its corresponding CMMB timestamp;
Receive the moment finish at frame data, get the code stream to be combined merging of aliging from said buffering area.
Preferably, saidly receive the moment finish, get the code stream to be combined merging of aliging, specifically comprise from said buffering area at frame data:
Said terminal receiving equipment is got the basic layer bit stream that belongs to an access unit, is benchmark with the timestamp of basic layer bit stream, takes out and the corresponding enhancement layer bitstream of layer bit stream timestamp basically, and its code stream as same access unit is merged.
The present invention also provides a kind of front end transmitting apparatus, and it comprises:
The code stream receiving element is used for the MPEG-2TS code stream that received code equipment sends;
Data extracting unit is used for extracting packaged media data from said MPEG-2TS code stream, obtains each layer bit stream: basic layer bit stream and enhancement layer bitstream;
The code stream encapsulation unit is used for said each layer bit stream is packaged in respectively in the different multiplexed sub frames of broadcast channel frame by the layer under it and the multiplexed sub frame positional information that will said each layer bit stream belongs to is packaged in the said broadcast channel frame;
The code stream lock unit is used for the CMMB airtime that the PTS timestamp with said each layer bit stream of said media data converts under benchmark unified time to stab, control that said each layer bit stream stabs in the CMMB airtime synchronously;
The code stream transmitting element, the media data that is used for that needs are sent stabs broadcasting together with the CMMB airtime of said each layer bit stream of this media data and sends.
Preferably, said code stream lock unit comprises:
The Time Calculation subelement is used for the PCR time according to said each layer bit stream of PCR temporal information calculating of the PTS information of the PES bag at said each layer bit stream place and PES bag;
The timestamp computation subunit is used for PCR time of this layer bit stream multiply by the CMMB time scale then divided by the clock scale of PCR, obtains the CMMB timestamp of this layer bit stream.
The present invention also provides a kind of terminal receiving equipment, and it comprises:
The position monitoring unit is used to monitor the multiplexed sub frame positional information at each layer bit stream place described in the broadcast channel frame;
The code stream receiving element is used for receiving the basic layer bit stream of said each layer bit stream according to said positional information and the disposal ability of self, or receives said basic layer bit stream and corresponding enhancement layer bitstream;
The code stream merge cells is used for said each layer bit stream was stabbed alignment, merges after synchronously by the CMMB airtime;
Code stream represents the unit, is used for said each layer bit stream decoded representing.
Preferably, said code stream merge cells comprises:
The buffer sublayer unit is used for received said each layer bit stream is put into buffering area together with its corresponding CMMB timestamp;
Code stream alignment subelement is used for receiving the moment that finishes at frame data, gets the code stream to be combined merging of aliging from said buffering area.
Preferably; Said code stream alignment subelement is used to get the basic layer bit stream that belongs to an access unit, is benchmark with the timestamp of basic layer bit stream; Take out and the basic corresponding enhancement layer bitstream of layer bit stream timestamp, its code stream as same access unit is merged.
The present invention also provides the synchronous system of classified service in a kind of CMMB, and it comprises:
Encoding device sends after the code stream of a plurality of layerings that are used for coding is generated is encapsulated as the MPEG-2TS code stream;
The front end transmitting apparatus; Be used to receive the MPEG-2TS code stream that said encoding device sends; From said MPEG-2TS code stream, extract packaged media data; Obtain each layer bit stream: basic layer bit stream and enhancement layer bitstream; Said each layer bit stream is packaged in respectively in the different multiplexed sub frames in the broadcast channel frame by the layer under it and the multiplexed sub frame positional information that will said each layer bit stream belongs to is packaged in the said broadcast channel frame; The CMMB airtime that the PTS timestamp of said each layer bit stream of said media data converts under benchmark unified time is stabbed, control that said each layer bit stream stabs in the CMMB airtime synchronously, the media data that needs are sent stabs the broadcasting transmission together with the CMMB airtime of said each layer bit stream of this media data;
The terminal receiving equipment; Be used to monitor the multiplexed sub frame positional information at each layer bit stream place described in the broadcast channel frame; Receive the basic layer bit stream in said each layer bit stream according to said positional information and the disposal ability of self; Or receive said basic layer bit stream and corresponding enhancement layer bitstream, and will said each layer bit stream stabbing alignment, merge after synchronous by the CMMB airtime, said each layer bit stream is decoded to be represented.
Preferably; Said front end transmitting apparatus; Be used for the PCR time according to said each layer bit stream of PCR temporal information calculating of the PTS information of the PES bag at said each layer bit stream place and PES bag; PCR time of this layer bit stream multiply by the CMMB time scale then divided by the clock scale of PCR, obtain the CMMB timestamp of this layer bit stream.
Preferably, said terminal receiving equipment also is used for received said each layer bit stream is put into buffering area together with its corresponding CMMB timestamp, receives the moment finish at frame data, gets the code stream to be combined merging of aliging from said buffering area.
Preferably; Said terminal receiving equipment also is used to get the basic layer bit stream that belongs to an access unit, is benchmark with the timestamp of basic layer bit stream; Take out and the basic corresponding enhancement layer bitstream of layer bit stream timestamp, its code stream as same access unit is merged.
The technical scheme of embodiment of the present invention; Has following beneficial effect: synchronous method, equipment and the system of classified service in the CMMB provided by the invention; When each layer bit stream of the classified service in the MPEG-2TS code stream is transmitted through CMMB; Stab through unified time, guarantee between each layer bit stream (that is: each individual-layer data) of classified service synchronously, thereby guarantee the normal enforcement of classified service among the CMMB.
Description of drawings
Classified service sends the flow chart of synchronous method in the CMMB that Fig. 1 provides for the embodiment of the invention;
Fig. 2 is the particular flow sheet of the step S140 of Fig. 1;
Classified service receives the flow chart of synchronous method in the CMMB that Fig. 3 provides for the embodiment of the invention;
Fig. 4 is the particular flow sheet of the step S230 of Fig. 3;
The structural representation of the front end transmitting apparatus that Fig. 5 provides for the embodiment of the invention;
Fig. 6 is the concrete structure sketch map of code stream lock unit among Fig. 5;
The structural representation of the terminal receiving equipment that Fig. 7 provides for the embodiment of the invention;
Fig. 8 is the structural representation of the code stream merge cells among Fig. 7;
The structural representation of the system that Fig. 9 provides for the embodiment of the invention;
The composition structural representation of the broadcast channel frame that Figure 10 provides for application examples of the present invention.
The realization of the object of the invention, functional characteristics and advantage will combine embodiment, further specify with reference to accompanying drawing.
Embodiment
In order to make the object of the invention, technical scheme and advantage clearer,, the present invention is further elaborated below in conjunction with accompanying drawing and embodiment.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
The embodiment of the invention provides the synchronous method of classified service transmission in a kind of CMMB, and as shown in Figure 1, the method comprising the steps of:
The MPEG that S110, front end transmitting apparatus received code equipment send (Moving Pictures Experts Group/Motin Pictures Experts Group, dynamic image expert group)-2TS (Transport Stream, MPTS) code stream; Each layer bit stream has the PCR time, and the said PCR time guarantees that base layer data, the enhancement data in the same sampling instant is temporal synchronously at PCR
S120, front end transmitting apparatus extract packaged media data from said MPEG-2TS code stream, obtain each layer bit stream: basic layer bit stream and enhancement layer bitstream;
S130, front end transmitting apparatus are packaged in said each layer bit stream respectively in the different multiplexed sub frames in the broadcast channel frame by the layer under it and the multiplexed sub frame positional information that will said each layer bit stream belongs to is packaged in the said broadcast channel frame;
S140, front end transmitting apparatus are with PTS (the Presentation timestamp of said each layer bit stream of said media data; Represent time stamp) CMMB airtime of converting under benchmark unified time of timestamp stabs, control that said each layer bit stream stabs in the CMMB airtime synchronously; In the present embodiment, as shown in Figure 2, this step S140 specifically comprises step:
S141, front end transmitting apparatus are according to PTS information and PES (Packetized Elementary Stream in the PES bag at said each layer bit stream place; The basic stream of grouping) the PCR temporal information of bag is calculated PCR (Program Clock Reference, the program clock reference) time of said each layer bit stream;
S142, front end transmitting apparatus multiply by the CMMB time scale with PCR time of this layer bit stream divided by the clock scale of PCR then, obtain the CMMB timestamp of this layer bit stream.
The media data that S150, front end transmitting apparatus will send stabs broadcasting together with the CMMB airtime of said each layer bit stream of this media data and sends.
The method that this embodiment provides is multiplied by the CMMB time scale through the PCR time with each layer bit stream and converses the corresponding CMMB timestamp of layered code stream; The PCR time with the ground floor code stream in handled first multiplexed sub frame has been confirmed professional CMMB timestamp initial value, and has confirmed the CMMB timestamp of follow-up each layer bit stream through this conversion method.Guarantee each layer bit stream on the same PCR time point in the unification of CMMB timestamp, thus guarantee between different each layer bit stream that divides layer services synchronously.
The embodiment of the invention also provides the synchronous method of classified service reception in a kind of CMMB, and the method that this embodiment provides matches with the method that the foregoing description provides, and as shown in Figure 3, the method comprising the steps of:
S210, terminal receiving equipment are monitored the multiplexed sub frame positional information at each layer bit stream place described in the broadcast channel frame;
S220, said terminal receiving equipment receive the basic layer bit stream in said each layer bit stream according to said positional information and the disposal ability of self, or receive said basic layer bit stream and corresponding enhancement layer bitstream;
S230, said terminal receiving equipment stab said each layer bit stream alignment, merge after synchronously by the CMMB airtime; In the present embodiment, as shown in Figure 4, this step S230 more specifically comprises:
S231, said terminal receiving equipment are put into buffering area with received said each layer bit stream together with its corresponding CMMB timestamp;
S232, said terminal receiving equipment frame data receive moment of finishing (, get the code stream to be combined merging of aliging from said buffering area.In the present embodiment; This step S232 specifically comprises: said terminal receiving equipment is got the basic layer bit stream that belongs to an access unit; Timestamp with basic layer bit stream is a benchmark; Take out and the basic corresponding enhancement layer bitstream of layer bit stream timestamp, its code stream as same access unit is merged.
S240, said terminal receiving equipment are decoded said each layer bit stream and are represented.
Classified service sends the method synchronous with reception in the CMMB that the foregoing description provides; When each layer bit stream of the classified service in the MPEG-2TS code stream is transmitted through CMMB; Stab through unified time; Guarantee between each layer bit stream (that is: each individual-layer data) of classified service synchronously, thereby guarantee the normal enforcement of classified service among the CMMB.
The embodiment of the invention provides a kind of front end transmitting apparatus, and is as shown in Figure 5, and this front end transmitting apparatus comprises:
Code stream receiving element 510 is used for the MPEG-2TS code stream that received code equipment sends;
Data extracting unit 520 is used for extracting packaged media data from said MPEG-2TS code stream, obtains each layer bit stream: basic layer bit stream and enhancement layer bitstream;
Code stream encapsulation unit 530 is used for said each layer bit stream is packaged in respectively in the different multiplexed sub frames of broadcast channel frame by the layer under it and the multiplexed sub frame positional information that will said each layer bit stream belongs to is packaged in the said broadcast channel frame;
Code stream lock unit 540 is used for the CMMB airtime that the PTS timestamp with said each layer bit stream of said media data converts under benchmark unified time to stab, control that said each layer bit stream stabs in the CMMB airtime synchronously;
Code stream transmitting element 550, the media data that is used for that needs are sent stabs broadcasting together with the CMMB airtime of said each layer bit stream of this media data and sends.
In more concrete embodiment, as shown in Figure 6, said code stream lock unit 540 comprises:
Time Calculation subelement 541 is used for the PCR time according to said each layer bit stream of PCR temporal information calculating of the PTS information of the PES bag at said each layer bit stream place and PES bag;
Timestamp computation subunit 542 is used for PCR time of this layer bit stream multiply by the CMMB time scale then divided by the clock scale of PCR, obtains the CMMB timestamp of this layer bit stream.
The embodiment of the invention also provides a kind of terminal receiving equipment, and is as shown in Figure 7, and this terminal receiving equipment comprises:
Position monitoring unit 710 is used to monitor the multiplexed sub frame positional information at each layer bit stream place described in the broadcast channel frame;
Code stream receiving element 720 is used for receiving the basic layer bit stream of said each layer bit stream according to said positional information and the disposal ability of self, or receives said basic layer bit stream and corresponding enhancement layer bitstream;
Code stream merge cells 730 is used for said each layer bit stream was stabbed alignment, merges after synchronously by the CMMB airtime;
Code stream represents unit 740, is used for said each layer bit stream decoded representing.
In more concrete embodiment, as shown in Figure 8, said code stream merge cells 730 comprises:
Buffer sublayer unit 731 is used for received said each layer bit stream is put into buffering area together with its corresponding CMMB timestamp;
Code stream alignment subelement 732 is used for receiving the moment that finishes at frame data, gets the code stream to be combined merging of aliging from said buffering area.In other embodiment; More concrete; Said code stream alignment subelement 732 is used to get the basic layer bit stream that belongs to an access unit, is benchmark with the timestamp of basic layer bit stream; Take out and the basic corresponding enhancement layer bitstream of layer bit stream timestamp, its code stream as same access unit is merged.
The embodiment of the invention also provides the synchronous system of classified service in a kind of CMMB, and as shown in Figure 9, this system comprises:
Encoding device 810 sends after the code stream of a plurality of layerings that are used for coding is generated is encapsulated as the MPEG-2TS code stream;
In the present embodiment; Encoding device 810 is encoded to basic layer bit stream and at least one enhancement layer bitstream with source of media; Basic layer bit stream can be decoded separately, and enhancement layer bitstream comprises the additional information that is used to improve the low-lever code current mass, needs and comprises that the low layer of basic layer bit stream decodes together.On timeline, layered code stream is base unit with the access unit, and typical access unit is like a frame frame of video.Under the mode of hierarchical coding, an access unit on the particular point in time can be encoded as the data of a plurality of layer bit streams, and the data of these a plurality of layer bit streams can be divided into multichannel and transmit; Terminal receiving equipment (as: portable terminal such as mobile phone) as required, can receive multiplex a plurality of layers data simultaneously, and it is merged by affiliated access unit, and decoding represents.
Front end transmitting apparatus 820; Be used to receive the MPEG-2TS code stream that said encoding device sends; From said MPEG-2TS code stream, extract packaged media data; Obtain each layer bit stream: basic layer bit stream and enhancement layer bitstream; Said each layer bit stream is packaged in respectively in the different multiplexed sub frames in the broadcast channel frame by the layer under it and the multiplexed sub frame positional information that will said each layer bit stream belongs to is packaged in the said broadcast channel frame; The CMMB airtime that the PTS timestamp of said each layer bit stream of said media data converts under benchmark unified time is stabbed, control that said each layer bit stream stabs in the CMMB airtime synchronously, the media data that needs are sent stabs the broadcasting transmission together with the CMMB airtime of said each layer bit stream of this media data;
Terminal receiving equipment 830; Be used to monitor the multiplexed sub frame positional information at each layer bit stream place described in the broadcast channel frame; Receive the basic layer bit stream in said each layer bit stream according to said positional information and the disposal ability of self; Or receive said basic layer bit stream and corresponding enhancement layer bitstream, and will said each layer bit stream stabbing alignment, merge after synchronous by the CMMB airtime, said each layer bit stream is decoded to be represented.
The system that the foregoing description provides; When each layer bit stream of the classified service in the MPEG-2TS code stream is transmitted through CMMB; Stab through unified time, guarantee between each layer bit stream (that is: each individual-layer data) of classified service synchronously, thereby guarantee the normal enforcement of classified service among the CMMB.
In more concrete embodiment; Said front end transmitting apparatus 820; Also be used for the PCR time according to said each layer bit stream of PCR temporal information calculating of the PTS information of the PES bag at said each layer bit stream place and PES bag; PCR time of this layer bit stream multiply by the CMMB time scale then divided by the clock scale of PCR, obtain the CMMB timestamp of this layer bit stream.The PCR time with each layer bit stream is multiplied by the CMMB timestamp that the CMMB time scale converses the layered code stream correspondence; The PCR time with the ground floor code stream in handled first multiplexed sub frame has been confirmed professional CMMB timestamp initial value, and has confirmed the CMMB timestamp of follow-up each layer bit stream through this conversion method.Guarantee each layer bit stream on the same PCR time point in the unification of CMMB timestamp, thus guarantee between different each layer bit stream that divides layer services synchronously.
In more concrete embodiment; Said terminal receiving equipment; Be used for received said each layer bit stream is put into buffering area together with its corresponding CMMB timestamp, receive the moment finish, get the code stream to be combined merging of aliging from said buffering area at frame data.Among the more concrete embodiment; Said terminal receiving equipment 830 also is used to get the basic layer bit stream that belongs to an access unit, is benchmark with the timestamp of basic layer bit stream; Take out and the basic corresponding enhancement layer bitstream of layer bit stream timestamp, its code stream as same access unit is merged.
The application examples of the foregoing description is provided below:
Be that H264SVC (extendible video coding) encoder is an example with the encoding device in should use-case; Its coding output video data elementary cell is NALU (Network Abstraction Layer; Network abstraction layer unit), the some NALU on the same time point form an access unit.
In this application examples; Comprised the SVC video and one road audio frequency is an example with broadcasting service, the SVC video adopts the space delamination pattern, is encoded as one road QVGA (Quarter VGA; 320 * 240 pixel images) elementary stream and one road VGA (Video Graphic Array; A kind of video transmission standard, video image 640X480 pixel image) strengthen video code flow, audio frequency is encoded as one road voice data code stream.Need to prove that method equipment that the foregoing description provides and system are equally applicable to the situation of multichannel enhanced flow and other hierarchical coding pattern.
To the encode SVC elementary stream, the SVC that generate of encoding device strengthens code stream and voice data code stream and is divided into and sends after a plurality of program multiplexings are encapsulated as one road MPEG-2TS code stream.For the PTS timestamp in the PES code stream of each road program not mandatory requirement interdepend, guarantee that through PCR SVC elementary stream, SVC in the same sampling instant strengthens code stream and the voice data code stream is temporal synchronously at PCR.
The MPEG-2TS code stream that front end transmitting apparatus received code equipment sends; From the MPEG-2TS code stream, extract packaged SVC media data; The basic layer bit stream of SVC is packaged in respectively in the different multiplexed sub frames in the broadcast channel frame by the layer under it with the SVC enhancement layer bitstream, and the multiplexed sub frame positional information with each layer bit stream place of said video flowing is packaged in the said broadcast channel frame simultaneously.
The composition structural representation of the broadcast channel frame that Figure 10 provides for application examples of the present invention.Shown in figure 10,40 time slots are arranged on certain frequency F, wherein time slot 0 (multiplexed frame 0) is used for communicating control information, and time slot 1 to time slot 39 is used for transport service information.The front end transmitting apparatus is configured to the basic layer bit stream of the video among the video traffic S, audio frequency and data message to take time slot 1 to time slot 4 in the multiplexed frame 1, and the multiplex sub frame number is 1.The video enhancement layer bitstream is configured to multiplexed frame 2, takies time slot 5 to time slot 6, and the multiplex sub frame number is 1.No longer transmit other business in multiplexed frame 1 and the multiplexed frame 2.Control information and electron service instruction (Electronic Service Guide in business; ESG) add the multiplexed frame positional information of carrying each layer (basic layer bit stream and each corresponding enhancement layer bitstream thereof) code stream in the information; This descriptor indicates that video traffic S comprises two multiplexed sub frames: the multiplexed sub frame 1 of multiplexed frame 1 is professional basic layer bit stream data, and the multiplexed sub frame 1 of multiplexed frame 2 is the enhancement layer bitstream data.
The front end transmitting apparatus obtains the basic layer bit stream V1 of video traffic S, is encapsulated in the multiplexed sub frame 1 of multiplexed frame 1, obtains the enhancement layer bitstream V2 of video traffic S, is encapsulated in the multiplexed sub frame 1 of multiplexed frame 2.The front end transmitting apparatus obtains voice data code stream and the data segment information of video traffic S, adds in the multiplexed sub frame 1 of multiplexed frame 1, promptly is carried in the same multiplexed sub frame with basic layer bit stream.Carry the multiplexed frame positional information of each layer bit stream, be carried in the multiplexed frame 0 in the broadcast channel frame, with the multiplexed frame positional information of each layer bit stream of indication receiving terminal, to make things convenient for its receiving video service S.
Voice data code stream, stream of video data are encapsulated into when going in the multiplexed sub frame, are that unit encapsulates with audio or video unit one by one.For each audio unit or video unit, the CMMB timestamp of a correspondence is all arranged, according to the CMMB standard, this timestamp is that the initial reproduction time in the multiplexed sub frame combines with the corresponding relative reproduction time in each unit.Initial reproduction time also is encapsulated in the multiplexed sub frame with the corresponding relative reproduction time in each unit, together sends with media data.
On the front end transmitting apparatus, need the PCR timestamp of the media data that is received be converted to the CMMB airtime to stab, what control SVC each minute layer service stabbed in the CMMB airtime in this process is synchronous.
On the front end transmitting apparatus, it is synchronous that SVC each minute layer service stabbed in the CMMB airtime, undertaken by following method:
For pairing each multiplexed sub frame of each layering of SVC,
The MPEG-2TS code stream of A, reception input for each video unit, takes out the PTS timestamp of its place PES bag, in conjunction with the relevant temporal information of the pairing PCR of code stream of its place program, the PCR time of calculating this video unit;
B, directly the PCR time with video unit is multiplied by the CMMB time scale, obtains the CMMB timestamp of this SVC video unit.To multiplexed sub frame; Get an initial reproduction time; The CMMB timestamp of video unit is decomposed into initial reproduction time relative reproduction time two parts corresponding with each unit, is encapsulated into initial reproduction time in the multiplexed sub frame with the corresponding relative reproduction time in each unit and goes.
The calculating of the PCR time of video unit can be adopted following method in the steps A:
(1) resolves TS bag in the MPEG-2TS code stream, up to being resolved to the TS bag that has PCR,, resolve PES bag in this TS bag, the PTS timestamp as a reference of the PTS in the PES bag with this PCR PCR timestamp as a reference.
(2) for follow-up each video unit, take out the PTS timestamp of its place PES bag, if having PCR in this TS bag, then upgrade timestamp with reference to PCR, upgrade timestamp simultaneously with reference to PTS.If do not have PCR in this TS bag, then calculate the PCR of this video unit;
(3) go with the PTS timestamp in the PES bag and do difference, add timestamp with this difference again, just obtain the corresponding PCR time of PES bag with reference to PCR with reference to the PTS timestamp, that is the PCR time of video unit correspondence.
PCR time=| the PTS timestamp-with reference to the PTS timestamp |+with reference to PCR timestamp formula (1)
The time scale of CMMB described in the step B, the CMMB chronomere number that the expression per second takes place is 22500 according to CMMB standard " CMMB part 2: multiplexing ".
Terminal receiving equipment (as: mobile phone, net book etc.) is gone up receiving terminal and is monitored the multiplexed frame 0 in the broadcast channel frame; Receiving control information and ESG information; Professional with correct receiving multimedia broadcast; Listen to simultaneously, also comprise the multiplexed sub frame positional information at each layer bit stream place in the scalable video business.Terminal receiving equipment and according to self needs, like its video flow processing ability or Network Transmission situation, decision receives basic layer bit stream, or receives basic layer bit stream and corresponding enhancement layer bitstream.This terminal receiving equipment is an example with the net book that can handle the VGA video in this application examples, need receive the elementary stream of QVGA and the enhancing code stream of VGA simultaneously and process, and decoding represents the VGA video.After receiving the elementary stream that transmits from different multiplexed sub frames and strengthening code stream; Net book extracts video unit from multiplexed sub frame; Parse H264 basic coding unit NALU; To belong to the different NALU of layer service that divide and stab alignment, synchronous by the CMMB airtime, the NALU that will belong to same access unit afterwards merges, and carries out video decode then and represents.
On the terminal receiving equipment (as: net book), being undertaken by following method synchronously of SVC each minute layer service:
A, each video unit all have corresponding CMMB timestamp, and this timestamp is that the initial reproduction time in the multiplexed sub frame combines with the corresponding relative reproduction time in each unit.NALU data that video unit comprised are stabbed together with its time corresponding put into buffering area, buffering area can be basic layer or enhancement layer, and this basic layer, enhancement layer all are separately independently.
B, every at a distance from a Fixed Time Interval, net book is just got a video access unit from aforementioned buffering area, after the NALU alignment of data merging with the layerings of video access unit difference, sends into decoder.Get the NALU data of the basic layer bit stream of SVC that belongs to a video access unit earlier; Timestamp with the basic layer bit stream of SVC is a benchmark; Take out the NALU data of the enhancement layer bitstream corresponding, it is merged as the data of same video access unit and the NALU data of basic layer bit stream with basic layer bit stream timestamp; NALU data after merging as a complete access unit, are sent into decoder decode.
More than be merely preferred embodiment of the present invention,, all any modifications of within spirit of the present invention and principle, being done, be equal to and replace and improvement etc., all should be included within protection scope of the present invention not in order to restriction the present invention.

Claims (14)

1. classified service sends synchronous method in the CMMB, it is characterized in that, comprising:
The MPEG-2TS code stream that front end transmitting apparatus received code equipment sends;
From said MPEG-2TS code stream, extract packaged media data, obtain each layer bit stream: basic layer bit stream and enhancement layer bitstream;
Said each layer bit stream is packaged in respectively in the different multiplexed sub frames in the broadcast channel frame by the layer under it and the multiplexed sub frame positional information that will said each layer bit stream belongs to is packaged in the said broadcast channel frame;
The CMMB airtime that the PTS timestamp of said each layer bit stream of said media data converts under benchmark unified time is stabbed, control that said each layer bit stream stabs in the CMMB airtime synchronously;
The media data that needs are sent stabs the broadcasting transmission together with the CMMB airtime of said each layer bit stream of this media data.
2. method according to claim 1 is characterized in that, the CMMB airtime that the PTS timestamp of said said each layer bit stream with said media data converts under benchmark unified time stabs, control that said each layer bit stream stabs in the CMMB airtime synchronously; Specifically comprise:
According to the PCR time of said each layer bit stream of PCR temporal information calculating of PTS information in the PES bag at said each layer bit stream place and PES bag;
PCR time of this layer bit stream multiply by the CMMB time scale then divided by the clock scale of PCR, obtain the CMMB timestamp of this layer bit stream.
3. classified service receives synchronous method in the CMMB, it is characterized in that, comprising:
The terminal receiving equipment is monitored the multiplexed sub frame positional information at each layer bit stream place described in the broadcast channel frame;
Receive the basic layer bit stream in said each layer bit stream according to said positional information and the disposal ability of self, or receive said basic layer bit stream and corresponding enhancement layer bitstream;
Said each layer bit stream was stabbed alignment, merges after synchronously by the CMMB airtime;
Said each layer bit stream decoded represent.
4. like the said method of claim 3, it is characterized in that, saidly said each layer bit stream is pressed the CMMB airtime stab alignment, synchronously, specifically comprise:
Said terminal receiving equipment is put into buffering area with received said each layer bit stream together with its corresponding CMMB timestamp;
Receive the moment finish at frame data, get the code stream to be combined merging of aliging from said buffering area.
5. like the said method of claim 4, it is characterized in that, saidly receive the moment finish, get the code stream to be combined merging of aliging, specifically comprise from said buffering area at frame data:
Said terminal receiving equipment is got the basic layer bit stream that belongs to an access unit, is benchmark with the timestamp of basic layer bit stream, takes out and the corresponding enhancement layer bitstream of layer bit stream timestamp basically, and its code stream as same access unit is merged.
6. a front end transmitting apparatus is characterized in that, comprising:
The code stream receiving element is used for the MPEG-2TS code stream that received code equipment sends;
Data extracting unit is used for extracting packaged media data from said MPEG-2TS code stream, obtains each layer bit stream: basic layer bit stream and enhancement layer bitstream;
The code stream encapsulation unit is used for said each layer bit stream is packaged in respectively in the different multiplexed sub frames of broadcast channel frame by the layer under it and the multiplexed sub frame positional information that will said each layer bit stream belongs to is packaged in the said broadcast channel frame;
The code stream lock unit is used for the CMMB airtime that the PTS timestamp with said each layer bit stream of said media data converts under benchmark unified time to stab, control that said each layer bit stream stabs in the CMMB airtime synchronously;
The code stream transmitting element, the media data that is used for that needs are sent stabs broadcasting together with the CMMB airtime of said each layer bit stream of this media data and sends.
7. front end transmitting apparatus according to claim 1 is characterized in that said code stream lock unit comprises:
The Time Calculation subelement is used for the PCR time according to said each layer bit stream of PCR temporal information calculating of the PTS information of the PES bag at said each layer bit stream place and PES bag;
The timestamp computation subunit is used for PCR time of this layer bit stream multiply by the CMMB time scale then divided by the clock scale of PCR, obtains the CMMB timestamp of this layer bit stream.
8. a terminal receiving equipment is characterized in that, comprising:
The position monitoring unit is used to monitor the multiplexed sub frame positional information at each layer bit stream place described in the broadcast channel frame;
The code stream receiving element is used for receiving the basic layer bit stream of said each layer bit stream according to said positional information and the disposal ability of self, or receives said basic layer bit stream and corresponding enhancement layer bitstream;
The code stream merge cells is used for said each layer bit stream was stabbed alignment, merges after synchronously by the CMMB airtime;
Code stream represents the unit, is used for said each layer bit stream decoded representing.
9. like the said terminal of claim 8 receiving equipment, it is characterized in that said code stream merge cells comprises:
The buffer sublayer unit is used for received said each layer bit stream is put into buffering area together with its corresponding CMMB timestamp;
Code stream alignment subelement is used for receiving the moment that finishes at frame data, gets the code stream to be combined merging of aliging from said buffering area.
10. like the said terminal of claim 9 receiving equipment; It is characterized in that; Said code stream alignment subelement is used to get the basic layer bit stream that belongs to an access unit, is benchmark with the timestamp of basic layer bit stream; Take out and the basic corresponding enhancement layer bitstream of layer bit stream timestamp, its code stream as same access unit is merged.
11. the synchronous system of classified service is characterized in that in the CMMB, comprising:
Encoding device sends after the code stream of a plurality of layerings that are used for coding is generated is encapsulated as the MPEG-2TS code stream;
The front end transmitting apparatus; Be used to receive the MPEG-2TS code stream that said encoding device sends; From said MPEG-2TS code stream, extract packaged media data; Obtain each layer bit stream: basic layer bit stream and enhancement layer bitstream; Said each layer bit stream is packaged in respectively in the different multiplexed sub frames in the broadcast channel frame by the layer under it and the multiplexed sub frame positional information that will said each layer bit stream belongs to is packaged in the said broadcast channel frame; The CMMB airtime that the PTS timestamp of said each layer bit stream of said media data converts under benchmark unified time is stabbed, control that said each layer bit stream stabs in the CMMB airtime synchronously, the media data that needs are sent stabs the broadcasting transmission together with the CMMB airtime of said each layer bit stream of this media data;
The terminal receiving equipment; Be used to monitor the multiplexed sub frame positional information at each layer bit stream place described in the broadcast channel frame; Receive the basic layer bit stream in said each layer bit stream according to said positional information and the disposal ability of self; Or receive said basic layer bit stream and corresponding enhancement layer bitstream, and will said each layer bit stream stabbing alignment, merge after synchronous by the CMMB airtime, said each layer bit stream is decoded to be represented.
12. like the said system of claim 11; It is characterized in that; Said front end transmitting apparatus; Be used for the PCR time, PCR time of this layer bit stream multiply by the CMMB time scale then divided by the clock scale of PCR, obtain the CMMB timestamp of this layer bit stream according to said each layer bit stream of PCR temporal information calculating of the PTS information of the PES bag at said each layer bit stream place and PES bag.
13. like the said system of claim 11; It is characterized in that; Said terminal receiving equipment; Also be used for received said each layer bit stream is put into buffering area together with its corresponding CMMB timestamp, receive the moment finish, get the code stream to be combined merging of aliging from said buffering area at frame data.
14. like the said system of claim 13; It is characterized in that; Said terminal receiving equipment also is used to get the basic layer bit stream that belongs to an access unit, is benchmark with the timestamp of basic layer bit stream; Take out and the basic corresponding enhancement layer bitstream of layer bit stream timestamp, its code stream as same access unit is merged.
CN201010557758.7A 2010-11-24 2010-11-24 The method, apparatus and system that in Mobile Multimedia Broadcasting, classified service is synchronous Active CN102480634B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201010557758.7A CN102480634B (en) 2010-11-24 2010-11-24 The method, apparatus and system that in Mobile Multimedia Broadcasting, classified service is synchronous
PCT/CN2011/077591 WO2012068898A1 (en) 2010-11-24 2011-07-25 Method, apparatus and system for synchronizing tiered service in mobile multimedia broadcasting

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010557758.7A CN102480634B (en) 2010-11-24 2010-11-24 The method, apparatus and system that in Mobile Multimedia Broadcasting, classified service is synchronous

Publications (2)

Publication Number Publication Date
CN102480634A true CN102480634A (en) 2012-05-30
CN102480634B CN102480634B (en) 2015-12-16

Family

ID=46093091

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010557758.7A Active CN102480634B (en) 2010-11-24 2010-11-24 The method, apparatus and system that in Mobile Multimedia Broadcasting, classified service is synchronous

Country Status (2)

Country Link
CN (1) CN102480634B (en)
WO (1) WO2012068898A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016192413A1 (en) * 2015-06-04 2016-12-08 中兴通讯股份有限公司 Bitstream alignment and synchronous processing method and system, receiving terminal and communication system

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3378235A4 (en) 2015-11-20 2019-05-01 Genetec Inc. Media streaming
US11716520B2 (en) * 2021-06-25 2023-08-01 Netflix, Inc. Systems and methods for providing optimized time scales and accurate presentation time stamps

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101273627A (en) * 2005-09-27 2008-09-24 韩国电子通信研究院 Apparatus for transmitting and receiving digital multimedia broadcasting for high-quality video service
CN101282482A (en) * 2008-05-04 2008-10-08 中兴通讯股份有限公司 Apparatus, system and method for synchronously playing video data and audio data
CN101690200A (en) * 2007-05-04 2010-03-31 韩国电子通信研究院 Method and apparatus for providing high-quality multimedia service in dmb system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050088448A (en) * 2002-12-20 2005-09-06 코닌클리케 필립스 일렉트로닉스 엔.브이. Method and apparatus for handling layered media data
JP2009267573A (en) * 2008-04-23 2009-11-12 Victor Co Of Japan Ltd Moving picture hierarchical encoder, moving picture hierarchical decoder, moving picture hierarchical encoding method, moving picture hierarchical decoding method, moving picture hierarchical encoding program, and hierarchical decoding program
CN101951506B (en) * 2010-09-17 2014-03-12 中兴通讯股份有限公司 System and method for realizing synchronous transmitting and receiving of scalable video coding service

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101273627A (en) * 2005-09-27 2008-09-24 韩国电子通信研究院 Apparatus for transmitting and receiving digital multimedia broadcasting for high-quality video service
CN101690200A (en) * 2007-05-04 2010-03-31 韩国电子通信研究院 Method and apparatus for providing high-quality multimedia service in dmb system
CN101282482A (en) * 2008-05-04 2008-10-08 中兴通讯股份有限公司 Apparatus, system and method for synchronously playing video data and audio data

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016192413A1 (en) * 2015-06-04 2016-12-08 中兴通讯股份有限公司 Bitstream alignment and synchronous processing method and system, receiving terminal and communication system
CN106303673A (en) * 2015-06-04 2017-01-04 中兴通讯股份有限公司 Code stream alignment, synchronization processing method and transmission, reception terminal and communication system
US10582234B2 (en) 2015-06-04 2020-03-03 Zte Corporation Bitstream alignment and synchronous processing method transmitting terminal, receiving terminal and communication system

Also Published As

Publication number Publication date
WO2012068898A1 (en) 2012-05-31
CN102480634B (en) 2015-12-16

Similar Documents

Publication Publication Date Title
CN101951506B (en) System and method for realizing synchronous transmitting and receiving of scalable video coding service
KR101639358B1 (en) Transmission apparatus and method, and reception apparatus and method for providing 3d service using the content and additional image seperately transmitted with the reference image transmitted in real time
CN101453639B (en) Encoding, decoding method and system for supporting multi-path video stream of ROI region
CN101690200B (en) Method and apparatus for providing high-quality multimedia service in dmb system
US8009742B2 (en) Method and system for retransmitting internet protocol packet for terrestrial digital multimedia broadcasting service
CN102342127A (en) Method and apparatus for video coding and decoding
CN105723718A (en) Apparatus for transmitting broadcast signals, apparatus for receiving broadcast signals, method for transmitting broadcast signals and method for receiving broadcast signals
CN101321280A (en) Real-time video transcoding stream medium server
CN107113462A (en) Sending method, method of reseptance, dispensing device and reception device
CN105745899A (en) Apparatus for transmitting broadcast signals, apparatus for receiving broadcast signals, method for transmitting broadcast signals and method for receiving broadcast signals
CN106134203A (en) Broadcast singal dispensing device, broadcast receiver, broadcast singal sending method and broadcast signal received method
CN106416268A (en) Method and apparatus for multiplexing layered coded contents
CN101729887B (en) Data transmission method and data transmission device of digital broadcasting system
CN102098542A (en) Multi-media data transmission method, system and device
CN102480634B (en) The method, apparatus and system that in Mobile Multimedia Broadcasting, classified service is synchronous
CN103475900A (en) Method and device for packaging mobile phone television service video frame and front-end system
JP2013513280A (en) Apparatus and method for 3D broadcasting service in broadcasting system combined with mobile broadcasting
CN101218819A (en) Method and apparatus for synchronizing data service with video service in digital multimedia broadcasting
KR101311982B1 (en) Method and apparatus for providing/receiving stereoscopic video service in digital broadcasting system
US20100315486A1 (en) Stereoscopic video service providing/receiving method and apparatus in digital broadcasting system
CN102404560B (en) Method and system for implementing collaborative transmission of SVC (Scalable Video Coding) service
KR20080053194A (en) Method of providing three-dimensional video service in digital multimedia broadcasting system
US9131281B2 (en) Method for embedding and multiplexing audio metadata in a broadcasted analog video stream
KR20160062716A (en) Apparatus and method for transmitting and receiving 3dtv broadcasting
KR101745652B1 (en) Broadcasting transmitter and receiver for rapid receiving of decoding information, and method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant