WO2012068898A1 - 移动多媒体广播中分级业务同步的方法、设备和系统 - Google Patents

移动多媒体广播中分级业务同步的方法、设备和系统 Download PDF

Info

Publication number
WO2012068898A1
WO2012068898A1 PCT/CN2011/077591 CN2011077591W WO2012068898A1 WO 2012068898 A1 WO2012068898 A1 WO 2012068898A1 CN 2011077591 W CN2011077591 W CN 2011077591W WO 2012068898 A1 WO2012068898 A1 WO 2012068898A1
Authority
WO
WIPO (PCT)
Prior art keywords
code stream
layer code
mobile multimedia
timestamp
layer
Prior art date
Application number
PCT/CN2011/077591
Other languages
English (en)
French (fr)
Inventor
陈光亮
戴志军
张建强
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2012068898A1 publication Critical patent/WO2012068898A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network

Definitions

  • the present invention relates to the field of mobile communication technologies, and in particular to a mobile multimedia broadcast transmission
  • CMMB China Mobile Multimedia Broadcasting
  • the CMMB standard stipulates that multiplexed sub-frames are used to encapsulate streaming media data such as video and audio for transmission.
  • the hierarchical service means that the encoder encodes the content source to generate a plurality of layers of code streams, and the base layer code stream can be separately decoded.
  • the enhancement layer code stream includes additional information for improving the quality of the lower layer code stream, and the basic layer is needed and included.
  • the lower layer code streams are decoded together.
  • Hierarchical services can realize differentiated services with different service quality and ability to adapt to various terminals. It has many advantages. Therefore, it is necessary to transmit hierarchical services in the CMMB system.
  • the code stream can be encoded into multiple layers at the moment when the terminal receives the data in one frame.
  • the code streams of each layer must be synchronized to ensure that the code streams of the same access unit are involved in the merge, and the success of the merge is ensured.
  • each layer code stream of the hierarchical service in the MPEG-2 TS code stream is not provided to be transmitted through the mobile multimedia broadcast, and between the layers of the plurality of hierarchical services is ensured. Synchronous technology. Summary of the invention
  • the main object of the present invention is to provide a method, device and system for hierarchical service synchronization in mobile multimedia broadcasting, which transmit each layer code stream of a hierarchical service in an MPEG-2 TS code stream through a mobile multimedia broadcast, and Synchronization between layers of code streams of the above plurality of hierarchical services is ensured.
  • a method for synchronizing hierarchical service transmission in mobile multimedia broadcasting comprising:
  • the front-end transmitting device receives the MPEG-2 TS code stream sent by the encoding device;
  • each layer code stream a base layer code stream and an enhancement layer code stream;
  • the media data to be transmitted is broadcasted along with the mobile multimedia broadcast timestamp of the layer streams of the media data.
  • the PTS timestamp of the layer code streams of the media data is converted into a mobile multimedia broadcast timestamp under a unified time reference, and synchronization of the layer code streams on a mobile multimedia broadcast timestamp is controlled.
  • a mobile multimedia broadcast timestamp under a unified time reference, and synchronization of the layer code streams on a mobile multimedia broadcast timestamp is controlled.
  • the mobile multimedia broadcast timestamp of the layer code stream is obtained.
  • the present invention also provides a method for grading service reception synchronization in mobile multimedia broadcasting, which includes:
  • the terminal receiving device monitors the multiplex subframe position information of the layer code streams in the broadcast channel frame
  • the base layer code stream in the layer code stream Receiving, according to the location information and the processing capability of the layer, the base layer code stream in the layer code stream, or receiving the base layer code stream and the corresponding enhancement layer code stream;
  • the aligning and synchronizing the layer code streams according to the mobile multimedia broadcast timestamp includes:
  • the terminal receiving device puts the received layer code streams together with their corresponding mobile multimedia broadcast time stamps into a buffer
  • the code streams to be merged are taken from the buffer for alignment and merging.
  • the aligning and merging the code streams to be merged from the buffer at a time when the data is received at the time of receiving the frame includes:
  • the terminal receiving device takes the base layer code stream belonging to an access unit, and takes the enhancement layer code stream corresponding to the base layer code stream timestamp as the reference, and uses the same as the same access unit.
  • the streams are merged.
  • the present invention also provides a front-end transmitting device, including:
  • a code stream receiving unit configured to receive an MPEG-2 TS code stream sent by the encoding device, and a data extracting unit, configured to extract the encapsulated media data from the MPEG-2 TS code stream, to obtain each layer code stream: a basic layer Code stream and enhancement layer code stream;
  • a code stream encapsulating unit configured to respectively encapsulate the layer code streams into a broadcast letter according to a layer to which they belong Encapsulating, in the different multiplex subframes in the track frame, the multiplex subframe position information in which the layer code streams are located in the broadcast channel frame;
  • a code stream synchronization unit configured to convert a PTS timestamp of the layer code streams of the media data into a mobile multimedia broadcast timestamp under a unified time reference, and control the layer code streams on a mobile multimedia broadcast timestamp Synchronization
  • a code stream sending unit configured to broadcast the media data that needs to be sent together with the mobile multimedia broadcast timestamp of the layer code streams of the media data.
  • the code stream synchronization unit includes:
  • a time calculation subunit configured to calculate a PCR time of each layer code stream according to a PTS time stamp in the PES packet where the layer code stream is located and a PCR time information of the PES packet;
  • the timestamp calculation subunit is configured to divide the PCR time of the layer code stream by the clock scale of the PCR and multiply by the mobile multimedia broadcast time scale to obtain a mobile multimedia broadcast time stamp of the layer code stream.
  • the present invention also provides a terminal receiving device, including:
  • a location monitoring unit configured to listen to multiplex subframe location information of each layer of the code stream in the broadcast channel frame
  • a code stream receiving unit configured to receive a base layer code stream in each layer code stream according to the location information and its own processing capability, or receive the base layer code stream and a corresponding enhancement layer code stream; a unit, configured to align the layer code streams according to a mobile multimedia broadcast timestamp, and then perform synchronization after being synchronized;
  • a code stream presentation unit configured to decode and display the layer code streams.
  • the code stream merging unit comprises:
  • a buffer subunit configured to put the received layer code streams into a buffer together with their corresponding mobile multimedia broadcast time stamps
  • a stream alignment sub-unit for taking a time from the buffer at the time when the reception of the data is completed.
  • the code stream alignment sub-unit is configured to take a base layer code stream belonging to an access unit, and take out an enhancement layer code stream corresponding to a base layer code stream timestamp based on a timestamp of the base layer code stream. , merge them as streams of the same access unit.
  • the present invention also provides a system for grading service synchronization in a mobile multimedia broadcast, comprising: an encoding device, configured to encapsulate a plurality of layered code streams generated by the encoding into an MPEG-2 TS code stream;
  • a front-end transmitting device configured to receive an MPEG-2 TS code stream sent by the encoding device, extract the encapsulated media data from the MPEG-2 TS code stream, and obtain each layer code stream: a base layer code stream and an enhancement layer a code stream, the layer code streams are respectively encapsulated in different multiplex subframes in a broadcast channel frame according to layers to which they belong, and the multiplex subframe position information in which the layer code streams are located is encapsulated in the broadcast Transmitting, in a channel frame, a PTS timestamp of the layer code stream of the media data into a mobile multimedia broadcast timestamp under a unified time reference, and controlling synchronization of the layer code streams on a mobile multimedia broadcast timestamp, And transmitting the media data that needs to be sent together with the mobile multimedia broadcast timestamp of the layer code streams of the media data;
  • a terminal receiving device configured to monitor multiplex subframe position information of each layer code stream in a broadcast channel frame, and receive a base layer code stream in each layer code stream according to the location information and a processing capability of the layer, Or receiving the base layer code stream and the corresponding enhancement layer code stream, aligning the layer code streams according to the mobile multimedia broadcast timestamp, synchronizing and combining, and decoding and displaying the layer code streams.
  • the front-end transmitting device is configured to calculate, according to the PTS timestamp in the PES packet in which the layer code stream is located, and the PCR time information of the PES packet, the PCR time of the layer code stream, and the layer code stream is used.
  • the PCR time is divided by the clock scale of the PCR and then multiplied by the mobile multimedia broadcast time scale to obtain the mobile multimedia broadcast time stamp of the layer stream.
  • the terminal receiving device is further configured to use the received layer code streams together
  • the corresponding mobile multimedia broadcast timestamp is put into the buffer, and the code stream to be merged from the buffer is aligned and merged at the time when the reception of one frame of data is completed.
  • the terminal receiving device is further configured to take a base layer code stream belonging to an access unit, and extract an enhancement layer code stream corresponding to a base layer code stream timestamp based on a timestamp of the base layer code stream.
  • the code streams are merged as the same access unit.
  • the technical solution of the present invention has the following beneficial effects:
  • the method, device and system for grading service synchronization in mobile multimedia broadcasting provided by the present invention, passing each layer code stream of the hierarchical service in the MPEG-2 TS code stream through mobile multimedia broadcasting During transmission, a unified timestamp is used to ensure synchronization between layers of the hierarchical service (ie, each hierarchical data), thereby ensuring normal implementation of the hierarchical service in the mobile multimedia broadcast.
  • FIG. 1 is a schematic flowchart of a method for synchronizing hierarchical service transmission in a mobile multimedia broadcast according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a specific process of S140 in FIG. 1;
  • FIG. 3 is a schematic flowchart of a method for receiving and receiving a hierarchical service in a mobile multimedia broadcast according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of a specific process of S230 in FIG. 3;
  • FIG. 5 is a schematic structural diagram of a front end sending device according to an embodiment of the present disclosure.
  • FIG. 6 is a schematic structural diagram of a code stream synchronization unit in FIG. 5;
  • FIG. 7 is a schematic structural diagram of a terminal receiving device according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of a code stream merging unit in FIG. 7;
  • FIG. 9 is a schematic structural diagram of a system according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic structural diagram of a structure of a broadcast channel frame provided by an application example of the present invention.
  • the embodiment of the invention provides a method for synchronizing the hierarchical service transmission in the mobile multimedia broadcast. As shown in FIG. 1 , the method includes the following steps:
  • the front-end transmitting device receives an MPEG (Moving Pictures Experts Group/Motion Pictures Experts Group) -2 TS (Transport Stream) code stream sent by the encoding device; each layer code stream has a PCR (Program Clock Reference) , program clock reference) time, the PCR time ensures synchronization of the base layer data and the enhancement layer data at the same sampling time in the PCR time
  • the front-end transmitting device extracts the encapsulated media data from the MPEG-2 TS code stream, to obtain each layer code stream: a base layer code stream and an enhancement layer code stream;
  • the front-end transmitting device encapsulates the layer code streams in different multiplex subframes in the broadcast channel frame according to the layer to which they belong, and encapsulates the multiplex subframe position information in which the layer code streams are located.
  • the broadcast channel frame In the broadcast channel frame;
  • the front-end transmitting device converts a PTS (Presentation Time Stamp) timestamp of the layer code streams of the media data into a mobile multimedia broadcast timestamp under a unified time reference, and controls the layer code streams in the
  • PTS Presentation Time Stamp
  • the S140 specifically includes the following steps:
  • the front-end transmitting device calculates, according to the PTS timestamp in the PES (Packetized Elementary Stream) packet and the PCR time information of the PES packet, the PCR time of each layer of the code stream.
  • PES Packetized Elementary Stream
  • the front-end transmitting device divides the PCR time of the layer code stream by the clock scale of the PCR and multiplies the mobile multimedia broadcast time scale to obtain a mobile multimedia broadcast time stamp of the layer code stream. S150.
  • the front-end transmitting device broadcasts the media data that needs to be sent together with the mobile multimedia broadcast timestamp of the layer code streams of the media data.
  • the method provided in this embodiment converts the mobile multimedia broadcast timestamp corresponding to the layered code stream by multiplying the PCR time of each layer code stream by the mobile multimedia broadcast time scale, and uses the first in the processed first multiplex subframe.
  • the PCR time of the layer code stream determines the mobile multimedia broadcast timestamp start value of the service, and determines the mobile multimedia broadcast timestamp of the subsequent layer code streams by the conversion method to ensure the layer code streams at the same PCR time point.
  • the uniformity of time stamps in mobile multimedia broadcasts ensures synchronization between streams of different layered services.
  • the embodiment of the invention further provides a method for receiving the synchronization of the hierarchical service in the mobile multimedia broadcast.
  • the method comprises the following steps:
  • the terminal receiving device monitors, in the broadcast channel frame, the multiplex subframe location information of each layer of the code stream.
  • the terminal receiving device receives, according to the location information and its own processing capability, a base layer code stream in each layer code stream, or receives the base layer code stream and a corresponding enhancement layer code stream;
  • the terminal receiving device combines the layer code streams according to the mobile multimedia broadcast timestamps, and then merges them.
  • the S230 further includes:
  • the terminal receiving device puts the received layer code stream into a buffer together with its corresponding mobile multimedia broadcast time stamp.
  • the terminal receiving device performs alignment and combining the code streams to be merged from the buffer at a time when the data reception is completed.
  • the S232 specifically includes: the terminal receiving device takes a base layer code stream belonging to an access unit, and extracts, according to a timestamp of the base layer code stream, an enhancement corresponding to the base layer code stream timestamp.
  • the layer code stream is merged as the code stream of the same access unit.
  • the terminal receiving device decodes and displays the layer code streams.
  • the method for synchronizing the transmission and reception of the hierarchical service in the mobile multimedia broadcast provided by the above embodiment, when the code streams of the hierarchical services in the MPEG-2 TS code stream are transmitted through the mobile multimedia broadcast, the unified time stamp is used to ensure the hierarchical service. Synchronization between layers of code streams (ie, individual layered data) to ensure the normal implementation of hierarchical services in mobile multimedia broadcasts.
  • the embodiment of the present invention provides a front-end transmitting device. As shown in FIG. 5, the front-end transmitting device includes:
  • the code stream receiving unit 510 is configured to receive the MPEG-2 TS code stream sent by the encoding device, and the data extracting unit 520 is configured to extract the encapsulated media data from the MPEG-2 TS code stream to obtain each layer code stream: Base layer code stream and enhancement layer code stream;
  • the code stream encapsulating unit 530 is configured to encapsulate the layer code streams into different multiplex subframes in the broadcast channel frame and the multiplex subframe position information in which the layer code streams are located, respectively. Encapsulated in the broadcast channel frame;
  • the code stream synchronization unit 540 is configured to convert a PTS timestamp of the layer code streams of the media data into a mobile multimedia broadcast timestamp under a unified time reference, and control the layer code stream in a mobile multimedia broadcast timestamp. Synchronization
  • the code stream sending unit 550 is configured to broadcast the media data that needs to be sent together with the mobile multimedia broadcast timestamp of the layer code streams of the media data.
  • the code stream synchronization unit 540 includes: a time calculation sub-unit 541, configured to: according to the PTS timestamp and PES in the PES packet where the layer code streams are located. Calculating PCR time of each layer code stream by using PCR time information of the packet;
  • the timestamp calculation sub-unit 542 is configured to divide the PCR time of the layer code stream by the clock scale of the PCR and multiply by the mobile multimedia broadcast time scale to obtain a mobile multimedia broadcast time stamp of the layer code stream.
  • the embodiment of the present invention further provides a terminal receiving device.
  • the terminal receiving device includes:
  • the location monitoring unit 710 is configured to listen to the multiplex subframe position information of the layer code streams in the broadcast channel frame.
  • a code stream receiving unit 720 configured to receive a base layer code stream in each layer code stream according to the location information and its own processing capability, or receive the base layer code stream and a corresponding enhancement layer code stream;
  • a merging unit 730 configured to align the layer code streams according to a mobile multimedia broadcast timestamp, and then perform merging after being synchronized;
  • the code stream presentation unit 740 is configured to decode and display the layer code streams.
  • the code stream merging unit 730 includes: a buffer subunit 731, configured to receive the received layer code streams together with their corresponding mobile multimedia broadcasts. The timestamp is placed in the buffer;
  • the code stream alignment sub-unit 732 is configured to perform alignment alignment on the code stream to be merged from the buffer at a time when the data reception is completed.
  • the code stream alignment sub-unit 732 is configured to take a base layer code stream belonging to an access unit, and take out a base layer based on a timestamp of the base layer code stream.
  • the enhancement layer code stream corresponding to the code stream timestamp is merged as the code stream of the same access unit.
  • the embodiment of the invention further provides a system for grading service synchronization in mobile multimedia broadcasting. As shown in FIG. 9, the system includes:
  • An encoding device 810 configured to encapsulate a plurality of layered code streams generated by the encoding into an MPEG-2 TS code stream;
  • the encoding device 810 encodes the media source into a base layer code stream and at least one enhancement layer code stream, and the base layer code stream can be separately decoded, and the enhancement layer code stream includes additional information for improving the quality of the low layer code stream. It needs to be decoded together with the lower layer including the base layer code stream.
  • the layered code stream is based on the access unit.
  • a typical access unit is: a frame of video frames.
  • an access unit at a specific time point can be encoded into data of a multi-layer code stream, and the data of the multi-layer code stream can be divided into multiple channels for transmission;
  • the terminal receiving device eg: A mobile terminal such as a mobile phone can receive the multiplexed multi-layer code stream at the same time as needed, and combine it according to the access unit to which it is decoded.
  • the front-end transmitting device 820 is configured to receive the MPEG-2 TS code stream sent by the encoding device 810, extract the encapsulated media data from the MPEG-2 TS code stream, and obtain each layer code stream: a basic layer code stream and
  • the enhancement layer code stream is encapsulated in different multiplex subframes in the broadcast channel frame according to the layer to which the layer belongs, and the multiplex subframe position information in which the layer code streams are located is encapsulated in the Transmitting, in the broadcast channel frame, a PTS timestamp of the layer code streams of the media data into a mobile multimedia broadcast timestamp under a unified time reference, and controlling the layer code streams on a mobile multimedia broadcast timestamp. Synchronizing, transmitting the media data that needs to be sent together with the mobile multimedia broadcast timestamp of the layer code streams of the media data;
  • the terminal receiving device 830 is configured to listen to the multiplex subframe position information of the layer code streams in the broadcast channel frame, and receive the base layer code stream in the layer code streams according to the location information and the processing capability of the layer. Or receiving the base layer code stream and the corresponding enhancement layer code stream, aligning the layer code streams according to the mobile multimedia broadcast timestamp, synchronizing and combining, and decoding and displaying the layer code streams.
  • the system provided by the foregoing embodiment ensures that each layer of the code stream of the hierarchical service in the MPEG-2 TS code stream is transmitted through the mobile multimedia broadcast, and the code stream of each layer of the hierarchical service is ensured by a unified time stamp (ie: each layer) Synchronization between data) to ensure the normal implementation of hierarchical services in mobile multimedia broadcasting.
  • the front-end sending device 820 is further configured to calculate, according to the PTS timestamp in the PES packet in which the layer code stream is located, and the PCR time information of the PES packet.
  • the PCR time is obtained by dividing the PCR time of the layer code stream by the clock scale of the PCR and multiplying by the mobile multimedia broadcast time scale to obtain a mobile multimedia broadcast time stamp of the layer code stream.
  • the PCR time determines the mobile multimedia broadcast timestamp start value of the service, and determines the mobile multimedia broadcast timestamp of the subsequent layer code streams by the conversion method, and ensures that each layer of the code stream at the same PCR time point is in the mobile multimedia broadcast time.
  • the unification of the stamps ensures synchronization between the layers of code streams of different layered services.
  • the terminal receiving device 830 is configured to put the received layer code streams together with their corresponding mobile multimedia broadcast time stamps into a buffer, and receive the data in one frame. At the moment, the code stream to be merged is taken from the buffer for alignment and merging. In a more specific embodiment, the terminal receiving device 830 is further configured to take a base layer code stream belonging to an access unit, and take a timestamp corresponding to the base layer code stream according to a timestamp of the base layer code stream. The enhancement layer code stream is merged as the code stream of the same access unit.
  • the encoding device is an H264 SVC (Scalable Video Coding) encoder.
  • the basic unit of the encoded output video data is NALU (Network Abstraction Layer Unit), and several NALUs at the same time point. Form an access unit.
  • the SVC video uses a spatial layering mode in which the broadcast service includes SVC video and one channel audio, and is encoded as a QVGA (Quad VGA, 320x240 pixel image) base layer stream and a VGA (Video) Graphic Array, a video transmission standard, video image 640X480 pixel image) enhances the video stream, and the audio is encoded as an audio data stream.
  • QVGA Quad VGA, 320x240 pixel image
  • VGA Video Graphic Array
  • the encoding device sends the encoded SVC base layer code stream, the SVC enhancement layer code stream, and the audio data code stream into a plurality of programs and multiplexes them into one MPEG-2 TS code stream.
  • the PTS timestamp in the PES code stream of each program is not mandatory to depend on each other, and the SVC base layer code stream, the SVC enhancement layer code stream, and the audio data stream on the PCR time are guaranteed by PCR. Synchronization.
  • the front-end transmitting device receives the MPEG-2 TS code stream sent by the encoding device, extracts the encapsulated SVC media data from the MPEG-2 TS code stream, and separately encapsulates the SVC base layer code stream and the SVC enhancement layer code stream according to the layer to which they belong.
  • the multiplex subframe position information in which the layer streams of the video stream are located are simultaneously encapsulated in the broadcast channel frame.
  • FIG. 10 is a schematic structural diagram of a broadcast channel frame provided by an application example of the present invention. As shown in FIG. 10, there are 40 time slots on a certain frequency point F, wherein time slot 0 (multiplexed frame 0) is used to transmit control information. Slot 1 to slot 39 are used to transmit service information.
  • the front-end transmitting device configures the video base layer code stream, audio, and data information in the video service S into the multiplex frame 1, occupying slot 1 to time slot 4, and multiplexing the subframe number to 1.
  • the video enhancement layer code stream is configured to multiplex frame 2, occupying slot 5 to slot 6, and the multiplex subframe number is 1. No other services are transmitted in the multiplex frame 1 and the multiplex frame 2.
  • the video service S includes two multiplex subframes: the multiplex subframe 1 of the multiplex frame 1 is the service base layer code stream data, and the multiplex subframe 1 of the multiplex frame 2 is the enhancement layer code stream data.
  • the front-end transmitting device obtains the basic layer code stream VI of the video service S, encapsulates it into the multiplex subframe 1 of the multiplex frame 1, acquires the enhancement layer code stream V2 of the video service S, and encapsulates the multiplex subframe of the multiplex frame 2. 1 in.
  • the front-end transmitting device acquires the audio data stream and the data segment information of the video service S, and adds it to the multiplex subframe 1 of the multiplex frame 1, that is, is carried in the same multiplex subframe together with the base layer code stream.
  • the multiplex frame position information of each layer of the code stream is carried in the multiplex frame 0 of the broadcast channel frame to indicate that the terminal receives the multiplexed frame position information of each layer of the device stream to facilitate receiving the video service S.
  • the audio data stream and the video data stream are encapsulated into the multiplexed sub-frame, they are encapsulated in units of audio or video units.
  • the time stamp is the initial play time in the multiplex subframe and the relative play time combination corresponding to each unit. And to make.
  • the initial play time and the relative play time corresponding to each unit are also encapsulated in the multiplex subframe and transmitted together with the media data.
  • the PCR timestamp of the received media data needs to be converted into a mobile multimedia broadcast timestamp, and the synchronization of the SVC hierarchical services on the mobile multimedia broadcast timestamp is controlled in this process.
  • the synchronization of the SVC layered services on the mobile multimedia broadcast timestamp is performed as follows:
  • A. Receive the input MPEG-2 TS code stream, for each video unit, take the PTS timestamp of the PES packet in which it is located, and calculate the PCR time of the video unit according to the PCR time information corresponding to the code stream of the program in which it is located. ;
  • For the multiplex subframe take a starting play time, and decompose the mobile multimedia broadcast time stamp of the video unit into two parts: the initial play time and the relative play time corresponding to each unit, and the start play time and each unit are corresponding.
  • the relative play time is encapsulated into the multiplexed sub-frame.
  • the PCR time of the video unit in step A can be calculated by the following methods:
  • the PTS timestamp of the PES packet in which it is located is taken out. If the TS packet carries a PCR, the reference PCR timestamp is updated, and the reference PTS timestamp is updated. If there is no PCR in the TS packet, calculate the PCR of the video unit;
  • the PCR time corresponding to the PES packet is obtained, that is, the video The PCR time corresponding to the unit.
  • PCR time
  • the mobile multimedia broadcast time scale in step B indicating the number of mobile multimedia broadcast time units per second, according to the mobile multimedia broadcast standard Mobile Multimedia Broadcasting Part 2: Reuse is 22,500.
  • the terminal receiving device receives and listens to the multiplex frame 0 in the broadcast channel frame, receives the control information and the ESG information, and correctly receives the multimedia broadcast service, and simultaneously monitors, and also includes the hierarchical video service.
  • the multiplex subframe position information where each layer of the code stream is located.
  • the terminal receives the device and determines to receive the base layer code stream or receive the base layer code stream and the corresponding enhancement layer code stream according to its own needs, such as its video stream processing capability or network transmission status.
  • the terminal receiving device takes a netbook that can process VGA video as an example, and needs to receive the QVGA base layer code stream and the VGA enhancement layer code stream for processing, and decode and display VGA video.
  • the netbook After receiving the base layer code stream and the enhancement layer code stream transmitted from different multiplex subframes, the netbook extracts the video unit from the multiplex subframe, and parses out the H264 basic coding unit NALU, which belongs to different layered services.
  • the NALU is time-aligned and synchronized according to the mobile multimedia broadcast time, and then the NALUs belonging to the same access unit are merged, and then the video decoding is performed.
  • the synchronization of the SVC layered services is performed as follows:
  • Each video unit has a corresponding mobile multimedia broadcast timestamp, which is a combination of the initial play time in the multiplex subframe and the relative play time corresponding to each unit.
  • the NALU data contained in the video unit is placed in a buffer along with its corresponding time stamp.
  • the buffer may be a base layer or an enhancement layer, and the base layer and the enhancement layer are independent.
  • the netbook takes a video access unit from the foregoing buffer, aligns and merges the NALU data of different layers of the video access unit, and sends them to the decoder.
  • the NALU data of the SVC base layer code stream belonging to one video access unit with SVC basic
  • the timestamp of the layer code stream is used as a reference, and the enhancement layer code stream corresponding to the base layer code stream timestamp is taken out.
  • the NALU data is combined with the data of the same video access unit and the NALU data of the base layer stream, and the combined NALU data is used as a complete access unit and sent to the decoder for decoding.
  • the front-end transmitting device side receives the MPEG-2 TS code stream sent by the encoding device, and extracts the encapsulated media data from the MPEG-2 TS code stream to obtain each layer code stream: the basic layer a code stream and an enhancement layer code stream; respectively, the layer code streams are respectively encapsulated in different multiplex subframes in a broadcast channel frame according to layers to which they belong, and multiplex subframe position information in which the layer code streams are located Encapsulating in the broadcast channel frame; converting a PTS timestamp of the layer code streams of the media data into a mobile multimedia broadcast timestamp under a unified time reference, and controlling the layer code streams in a mobile multimedia broadcast time Synchronization on the stamp; the media data to be transmitted is broadcasted along with the mobile multimedia broadcast timestamp of the layer streams of the media data.
  • each layer of the code stream of the hierarchical service in the MPEG-2 TS code stream is transmitted through the mobile multimedia broadcast, each layer of the code stream of the hierarchical service is guaranteed by a uniform time stamp (ie: each hierarchical data) Synchronization between them to ensure the normal implementation of the hierarchical service in mobile multimedia broadcasting.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明涉及一种移动多媒体广播中分级业务同步的方法、设备和系统，将MPEG-2TS码流中的分级业务的各层码流通过移动多媒体广播传送时，通过统一的时间戳，保证分级业务的各层码流（即：各个分层数据）之间的同步，从而保证移动多媒体广播中分级业务的正常实施。

Description

移动多媒体广播中分级业务同步的方法、 设备和系统 技术领域
本发明涉及移动通信技术领域， 具体是一种移动多媒体广播中传送
MPEG-2 TS ( MPEG-2传输流 )码流分级业务时 , 实现分级业务多个分层同 步的方法、 设备和系统。 背景技术
随着通信技术的发展， 移动多媒体广播技术的应用越来越广。 目前， CMMB ( China Mobile Multimedia Broadcasting, 中国移动多媒体广播 )标 准规定了在广播业务频率范围内， CMMB系统广播信道传输信号的帧结构、 信道编码和调制等。 CMMB标准中规定， 釆用复用子帧来封装视频、 音频 等流媒体数据， 进行传送。
分级业务是指编码器对内容源进行编码， 产生多个层次的码流， 基本 层码流可以单独解码， 增强层码流包含用于提高低层码流质量的附加信息， 需要和包括基本层在内的低层码流一起解码。 分级业务能够实现有服务质 量差别的区分业务、 实现各种终端的能力适配， 具有诸多优点， 因此， 在 CMMB系统中传送分级业务是很有必要的。
分级业务中， 终端在一帧数据接收完毕的时刻， 码流可被编码到多个 分层中。 在终端侧， 需要将通过不同分层的码流合并， 如将同一视频帧的 多个分层合并起来， 然后进行视频解码展现。 在合并时， 各层码流之间必 须同步， 才能保证参与合并的是同一接入单元的的码流， 保证合并的成功， 合并成功才能保证后续解码展现成功。
现有技术中， 并没有提供将 MPEG-2 TS码流中的分级业务的各层码流 通过移动多媒体广播传送， 并且保证上述多个分级业务的各层码流之间的 同步的技术。 发明内容
有鉴于此， 本发明的主要目的是提供一种移动多媒体广播中分级业务 同步的方法、 设备和系统， 将 MPEG-2 TS码流中的分级业务的各层码流通 过移动多媒体广播传送， 并且保证上述多个分级业务的各层码流之间的同 步。
本发明解决其技术问题所釆用的技术方案是：
一种移动多媒体广播中分级业务发送同步的方法， 其包括：
前端发送设备接收编码设备发出的 MPEG-2 TS码流；
从所述 MPEG-2 TS码流中提取出所封装的媒体数据， 得到各层码流： 基本层码流和增强层码流；
将所述各层码流按其所属的层分别封装于广播信道帧中的不同复用子 帧中以及将所述各层码流所在的复用子帧位置信息封装于所述广播信道帧 中；
将所述媒体数据的所述各层码流的 PTS时间戳转换成统一时间基准下 的移动多媒体广播时间戳， 控制所述各层码流在移动多媒体广播时间戳上 的同步；
将需要发送的媒体数据连同该媒体数据的所述各层码流的移动多媒体 广播时间戳一起广播发送。
优选地， 所述将所述媒体数据的所述各层码流的 PTS时间戳转换成统 一时间基准下的移动多媒体广播时间戳， 控制所述各层码流在移动多媒体 广播时间戳上的同步， 具体包括：
根据所述各层码流所在的 PES包中的 PTS时间戳和 PES包的 PCR时 间信息计算所述各层码流的 PCR时间；
将该层码流的 PCR时间除以 PCR的时钟刻度然后乘以移动多媒体广播 时间刻度， 得到该层码流的移动多媒体广播时间戳。
本发明还提供一种移动多媒体广播中分级业务接收同步的方法， 其包 括：
终端接收设备监听广播信道帧中所述各层码流所在的复用子帧位置信 息；
根据所述位置信息和自身的处理能力接收所述各层码流中的基本层码 流， 或接收所述基本层码流及对应的增强层码流；
将所述各层码流按移动多媒体广播时间戳对齐、 同步后进行合并； 将所述各层码流进行解码展现。
优选地， 所述将所述各层码流按移动多媒体广播时间戳对齐、 同步， 具体包括：
所述终端接收设备将所接收到的所述各层码流连同其对应的移动多媒 体广播时间戳放入緩冲区；
在一帧数据接收完毕的时刻， 从所述緩冲区取待合并的码流进行对齐 合并。
优选地， 所述在一帧数据接收完毕的时刻， 从所述緩冲区取待合并的 码流进行对齐合并， 具体包括：
所述终端接收设备取属于一个接入单元的基本层码流， 以基本层码流 的时间戳为基准， 取出与基本层码流时间戳对应的增强层码流， 将其作为 同一接入单元的码流进行合并。
本发明还提供一种前端发送设备， 其包括：
码流接收单元， 用于接收编码设备发出的 MPEG-2 TS码流； 数据提取单元， 用于从所述 MPEG-2 TS码流中提取出所封装的媒体数 据， 得到各层码流： 基本层码流和增强层码流；
码流封装单元， 用于将所述各层码流按其所属的层分别封装于广播信 道帧中的不同复用子帧中以及将所述各层码流所在的复用子帧位置信息封 装于所述广播信道帧中；
码流同步单元， 用于将所述媒体数据的所述各层码流的 PTS时间戳转 换成统一时间基准下的移动多媒体广播时间戳， 控制所述各层码流在移动 多媒体广播时间戳上的同步；
码流发送单元， 用于将需要发送的媒体数据连同该媒体数据的所述各 层码流的移动多媒体广播时间戳一起广播发送。
优选地， 所述码流同步单元， 包括：
时间计算子单元， 用于根据所述各层码流所在的 PES包中的 PTS时间 戳和 PES包的 PCR时间信息计算所述各层码流的 PCR时间；
时间戳计算子单元，用于将该层码流的 PCR时间除以 PCR的时钟刻度 然后乘以移动多媒体广播时间刻度， 得到该层码流的移动多媒体广播时间 戳。
本发明还提供一种终端接收设备， 其包括：
位置监听单元， 用于监听广播信道帧中所述各层码流所在的复用子帧 位置信息；
码流接收单元， 用于根据所述位置信息和自身的处理能力接收所述各 层码流中的基本层码流， 或接收所述基本层码流及对应的增强层码流； 码流合并单元， 用于将所述各层码流按移动多媒体广播时间戳对齐、 同步后进行合并；
码流展现单元， 用于将所述各层码流进行解码展现。
优选地， 所述码流合并单元包括：
緩冲子单元， 用于将所接收到的所述各层码流连同其对应的移动多媒 体广播时间戳放入緩冲区；
码流对齐子单元， 用于在一帧数据接收完毕的时刻， 从所述緩冲区取 待合并的码流进行对齐合并。
优选地， 所述码流对齐子单元， 用于取属于一个接入单元的基本层码 流， 以基本层码流的时间戳为基准， 取出与基本层码流时间戳对应的增强 层码流， 将其作为同一接入单元的码流进行合并。
本发明还提供一种移动多媒体广播中分级业务同步的系统， 其包括： 编码设备， 用于将编码生成的多个分层的码流封装为 MPEG-2 TS码流 后发出；
前端发送设备， 用于收所述编码设备发出的 MPEG-2 TS码流， 从所述 MPEG-2 TS码流中提取出所封装的媒体数据， 得到各层码流： 基本层码流 和增强层码流， 将所述各层码流按其所属的层分别封装于广播信道帧中的 不同复用子帧中以及将所述各层码流所在的复用子帧位置信息封装于所述 广播信道帧中， 将所述媒体数据的所述各层码流的 PTS时间戳转换成统一 时间基准下的移动多媒体广播时间戳， 控制所述各层码流在移动多媒体广 播时间戳上的同步， 将需要发送的媒体数据连同该媒体数据的所述各层码 流的移动多媒体广播时间戳一起广播发送；
终端接收设备， 用于监听广播信道帧中所述各层码流所在的复用子帧 位置信息， 根据所述位置信息和自身的处理能力接收所述各层码流中的基 本层码流， 或接收所述基本层码流及对应的增强层码流， 将所述各层码流 按移动多媒体广播时间戳对齐、 同步后进行合并， 将所述各层码流进行解 码展现。
优选地， 所述前端发送设备， 用于根据所述各层码流所在的 PES包中 的 PTS时间戳和 PES包的 PCR时间信息计算所述各层码流的 PCR时间， 将该层码流的 PCR时间除以 PCR的时钟刻度然后乘以移动多媒体广播时间 刻度， 得到该层码流的移动多媒体广播时间戳。
优选地， 所述终端接收设备， 还用于将所接收到的所述各层码流连同 其对应的移动多媒体广播时间戳放入緩冲区， 在一帧数据接收完毕的时刻， 从所述緩冲区取待合并的码流进行对齐合并。
优选地， 所述终端接收设备， 还用于取属于一个接入单元的基本层码 流， 以基本层码流的时间戳为基准， 取出与基本层码流时间戳对应的增强 层码流， 将其作为同一接入单元的码流进行合并。
实施本发明的技术方案， 具有以下有益效果： 本发明提供的移动多媒 体广播中分级业务同步的方法、 设备和系统， 将 MPEG-2 TS码流中的分级 业务的各层码流通过移动多媒体广播传送时， 通过统一的时间戳， 保证分 级业务的各层码流（即： 各个分层数据）之间的同步， 从而保证移动多媒 体广播中分级业务的正常实施。 附图说明
图 1 为本发明实施例提供的移动多媒体广播中分级业务发送同步的方 法的流程示意图；
图 2为图 1中的 S140的具体流程示意图；
图 3 为本发明实施例提供的移动多媒体广播中分级业务接收同步的方 法的流程示意图；
图 4为图 3中的 S230的具体流程示意图；
图 5为本发明实施例提供的前端发送设备的结构示意图；
图 6为图 5中码流同步单元的具体结构示意图；
图 7为本发明实施例提供的终端接收设备的结构示意图；
图 8为图 7中的码流合并单元的结构示意图；
图 9为本发明实施例提供的系统的结构示意图；
图 10为本发明应用实例提供的广播信道帧的组成结构示意图。
本发明目的的实现、 功能特点及优点将结合实施例， 参照附图做进一 步说明。 具体实施方式
为了使本发明的目的、 技术方案及优点更加清楚明白， 以下结合附图 及实施例， 对本发明进行进一步详细说明。 应当理解， 此处所描述的具体 实施例仅仅用以解释本发明， 并不用于限定本发明。
本发明实施例提供一种移动多媒体广播中分级业务发送同步的方法， 如图 1所示， 该方法包括步骤：
S110、 前端发送设备接收编码设备发出的 MPEG ( Moving Pictures Experts Group/Motion Pictures Experts Group , 动态图像专家组) -2 TS ( Transport Stream, 传输流）码流； 各层码流具有 PCR ( Program Clock Reference , 节目时钟参考 ) 时间， 所述 PCR时间保证同一釆样时刻上的基 本层数据、 增强层数据在 PCR时间上的同步
S120、前端发送设备从所述 MPEG-2 TS码流中提取出所封装的媒体数 据， 得到各层码流： 基本层码流和增强层码流；
S130、 前端发送设备将所述各层码流按其所属的层分别封装于广播信 道帧中的不同复用子帧中以及将所述各层码流所在的复用子帧位置信息封 装于所述广播信道帧中；
5140、 前端发送设备将所述媒体数据的所述各层码流的 PTS ( Presentation TimeStamp ,展现时戳）时间戳转换成统一时间基准下的移动 多媒体广播时间戳， 控制所述各层码流在移动多媒体广播时间戳上的同步； 在本实施例中， 如图 2所示， 该 S140具体包括步骤：
5141、 前端发送设备根据所述各层码流所在的 PES ( Packetized Elementary Stream, 分组基本流） 包中的 PTS时间戳和 PES包的 PCR时间 信息计算所述各层码流的 PCR时间；
5142、前端发送设备将该层码流的 PCR时间除以 PCR的时钟刻度然后 乘以移动多媒体广播时间刻度， 得到该层码流的移动多媒体广播时间戳。 S150、 前端发送设备将需要发送的媒体数据连同该媒体数据的所述各 层码流的移动多媒体广播时间戳一起广播发送。
该实施例提供的方法通过用各层码流的 PCR时间乘上移动多媒体广播 时间刻度换算出分层码流对应的移动多媒体广播时间戳， 用所处理的第一 个复用子帧内的第一层码流的 PCR时间确定了业务的移动多媒体广播时间 戳起始值， 并通过该转换方法确定了后续各层码流的移动多媒体广播时间 戳， 保证同一 PCR时间点上的各层码流在移动多媒体广播时间戳的统一， 从而保证不同分层业务的各层码流之间的同步。
本发明实施例还提供一种移动多媒体广播中分级业务接收同步的方 该方法包括步骤：
S210、 终端接收设备监听广播信道帧中所述各层码流所在的复用子帧 位置信息；
S220、 所述终端接收设备根据所述位置信息和自身的处理能力接收所 述各层码流中的基本层码流， 或接收所述基本层码流及对应的增强层码流；
S230、 所述终端接收设备将所述各层码流按移动多媒体广播时间戳对 齐、 同步后进行合并； 在本实施例中， 如图 4所示， 该 S230更具体包括：
S231、 所述终端接收设备将所接收到的所述各层码流连同其对应的移 动多媒体广播时间戳放入緩冲区；
S232、 所述终端接收设备在一帧数据接收完毕的时刻， 从所述緩冲区 取待合并的码流进行对齐合并。 在本实施例中， 该 S232具体包括： 所述终 端接收设备取属于一个接入单元的基本层码流， 以基本层码流的时间戳为 基准， 取出与基本层码流时间戳对应的增强层码流， 将其作为同一接入单 元的码流进行合并。
S240、 所述终端接收设备将所述各层码流进行解码展现。 上述实施例提供的移动多媒体广播中分级业务发送与接收同步的方 法， 将 MPEG-2 TS码流中的分级业务的各层码流通过移动多媒体广播传送 时， 通过统一的时间戳， 保证分级业务的各层码流（即： 各个分层数据） 之间的同步， 从而保证移动多媒体广播中分级业务的正常实施。
本发明实施例提供一种前端发送设备， 如图 5 所示， 该前端发送设备 包括：
码流接收单元 510, 用于接收编码设备发出的 MPEG-2 TS码流； 数据提取单元 520, 用于从所述 MPEG-2 TS码流中提取出所封装的媒 体数据， 得到各层码流： 基本层码流和增强层码流；
码流封装单元 530,用于将所述各层码流按其所属的层分别封装于广播 信道帧中的不同复用子帧中以及将所述各层码流所在的复用子帧位置信息 封装于所述广播信道帧中；
码流同步单元 540, 用于将所述媒体数据的所述各层码流的 PTS时间 戳转换成统一时间基准下的移动多媒体广播时间戳， 控制所述各层码流在 移动多媒体广播时间戳上的同步；
码流发送单元 550,用于将需要发送的媒体数据连同该媒体数据的所述 各层码流的移动多媒体广播时间戳一起广播发送。
在更为具体的实施例中， 如图 6所示， 所述码流同步单元 540包括： 时间计算子单元 541 , 用于根据所述各层码流所在的 PES包中的 PTS 时间戳和 PES包的 PCR时间信息计算所述各层码流的 PCR时间；
时间戳计算子单元 542, 用于将该层码流的 PCR时间除以 PCR的时钟 刻度然后乘以移动多媒体广播时间刻度， 得到该层码流的移动多媒体广播 时间戳。
本发明实施例还提供一种终端接收设备， 如图 7 所示， 该终端接收设 备包括： 位置监听单元 710,用于监听广播信道帧中所述各层码流所在的复用子 帧位置信息；
码流接收单元 720,用于根据所述位置信息和自身的处理能力接收所述 各层码流中的基本层码流， 或接收所述基本层码流及对应的增强层码流； 码流合并单元 730 , 用于将所述各层码流按移动多媒体广播时间戳对 齐、 同步后进行合并；
码流展现单元 740, 用于将所述各层码流进行解码展现。
在更为具体的实施例中， 如图 8所示， 所述码流合并单元 730包括： 緩冲子单元 731 ,用于将所接收到的所述各层码流连同其对应的移动多 媒体广播时间戳放入緩冲区；
码流对齐子单元 732, 用于在一帧数据接收完毕的时刻， 从所述緩冲区 取待合并的码流进行对齐合并。 在其他的实施例中， 更为具体的， 所述码 流对齐子单元 732, 用于取属于一个接入单元的基本层码流， 以基本层码流 的时间戳为基准， 取出与基本层码流时间戳对应的增强层码流， 将其作为 同一接入单元的码流进行合并。
本发明实施例还提供一种移动多媒体广播中分级业务同步的系统， 如 图 9所示， 该系统包括：
编码设备 810, 用于将编码生成的多个分层的码流封装为 MPEG-2 TS 码流后发出；
在本实施例中， 编码设备 810将媒体源编码为基本层码流和至少一个 增强层码流， 基本层码流可以单独解码， 增强层码流包含用于提高低层码 流质量的附加信息， 需要和包括基本层码流在内的低层一起解码。 在时间 线上， 分层码流以接入单元为基本单位， 典型的接入单元如： 一帧视频帧。 在分层编码的方式下， 特定时间点上的一个接入单元可被编码为多层码流 的数据， 这多层码流的数据可以被分为多路进行传输； 终端接收设备（如： 手机等移动终端）根据需要， 可同时接收多路传输的多层码流， 将其按所 属的接入单元进行合并， 解码展现。
前端发送设备 820, 用于接收所述编码设备 810发出的 MPEG-2 TS码 流， 从所述 MPEG-2 TS码流中提取出所封装的媒体数据， 得到各层码流： 基本层码流和增强层码流， 将所述各层码流按其所属的层分别封装于广播 信道帧中的不同复用子帧中以及将所述各层码流所在的复用子帧位置信息 封装于所述广播信道帧中， 将所述媒体数据的所述各层码流的 PTS时间戳 转换成统一时间基准下的移动多媒体广播时间戳， 控制所述各层码流在移 动多媒体广播时间戳上的同步， 将需要发送的媒体数据连同该媒体数据的 所述各层码流的移动多媒体广播时间戳一起广播发送；
终端接收设备 830,用于监听广播信道帧中所述各层码流所在的复用子 帧位置信息， 根据所述位置信息和自身的处理能力接收所述各层码流中的 基本层码流， 或接收所述基本层码流及对应的增强层码流， 将所述各层码 流按移动多媒体广播时间戳对齐、 同步后进行合并， 将所述各层码流进行 解码展现。
上述实施例提供的系统， 将 MPEG-2 TS码流中的分级业务的各层码流 通过移动多媒体广播传送时， 通过统一的时间戳， 保证分级业务的各层码 流（即： 各个分层数据）之间的同步， 从而保证移动多媒体广播中分级业 务的正常实施。
在更为具体的实施例中， 所述前端发送设备 820,还用于根据所述各层 码流所在的 PES包中的 PTS时间戳和 PES包的 PCR时间信息计算所述各 层码流的 PCR时间 , 将该层码流的 PCR时间除以 PCR的时钟刻度然后乘 以移动多媒体广播时间刻度， 得到该层码流的移动多媒体广播时间戳。 用 各层码流的 PCR时间乘上移动多媒体广播时间刻度换算出分层码流对应的 移动多媒体广播时间戳， 用所处理的第一个复用子帧内的第一层码流的 PCR 时间确定了业务的移动多媒体广播时间戳起始值， 并通过该转换方法 确定了后续各层码流的移动多媒体广播时间戳， 保证同一 PCR时间点上的 各层码流在移动多媒体广播时间戳的统一， 从而保证不同分层业务的各层 码流之间的同步。
在更为具体的实施例中， 所述终端接收设备 830, 用于将所接收到的所 述各层码流连同其对应的移动多媒体广播时间戳放入緩冲区， 在一帧数据 接收完毕的时刻， 从所述緩冲区取待合并的码流进行对齐合并。 更为具体 的实施例中， 所述终端接收设备 830, 还用于取属于一个接入单元的基本层 码流， 以基本层码流的时间戳为基准， 取出与基本层码流时间戳对应的增 强层码流， 将其作为同一接入单元的码流进行合并。
下面提供上述实施例的应用实例：
本应用实例中以编码设备为 H264 SVC (可扩展的视频编码 )编码器为 例， 其编码输出视频数据基本单元为 NALU ( Network Abstraction Layer Unit, 网络抽象层单元） ， 同一时间点上的若干 NALU组成一个接入单元。
在该应用实例中， 以广播业务包含了 SVC视频和一路音频为例， SVC 视频釆用空间分层模式， 被编码为一路 QVGA ( Quarter VGA, 320x240像 素图像）基本层码流和一路 VGA ( Video Graphic Array, 一种视频传输标 准， 视频图像 640X480像素图像）增强视频码流， 音频被编码为一路音频 数据码流。 需要说明的是， 上述实施例提供的方法设备和系统同样适用于 多路增强层码流及其它分级编码模式的情况。
编码设备将编码生成的 SVC基本层码流、 SVC增强层码流以及音频数 据码流分为多个节目复用封装为一路 MPEG-2 TS码流后发出。 对于每一路 节目的 PES码流中的 PTS时间戳并不强制要求相互依赖，通过 PCR来保证 同一釆样时刻上的 SVC基本层码流、 SVC增强层码流以及音频数据码流在 PCR时间上的同步。 前端发送设备接收编码设备发出的 MPEG-2 TS码流， 从 MPEG-2 TS 码流中提取出所封装的 SVC媒体数据， 将 SVC基本层码流和 SVC增强层 码流按其所属的层分别封装于广播信道帧中的不同复用子帧中， 同时将所 述视频流各层码流所在的复用子帧位置信息封装于所述广播信道帧中。
图 10为本发明应用实例提供的广播信道帧的组成结构示意图，如图 10 所示， 某频点 F上有 40个时隙， 其中时隙 0 (复用帧 0 )用于传送控制信 息， 时隙 1至时隙 39用于传送业务信息。 前端发送设备将视频业务 S中的 视频基本层码流、 音频以及数据信息配置为复用帧 1 中， 占用时隙 1至时 隙 4, 复用子帧号为 1。 视频增强层码流配置为复用帧 2, 占用时隙 5至时 隙 6, 复用子帧号为 1。 复用帧 1和复用帧 2中不再传输其他业务。 在业务 的控制信息和 ESG ( Electronic Service Guide, 电子业务指南 )信息中添加 承载各层码流（基本层码流及其对应的各增强层码流）的复用帧位置信息， 该描述信息标明视频业务 S包含两个复用子帧： 复用帧 1的复用子帧 1为 业务基本层码流数据， 复用帧 2的复用子帧 1为增强层码流数据。
前端发送设备获取视频业务 S的基本层码流 VI , 封装到复用帧 1的复 用子帧 1中， 获取视频业务 S的增强层码流 V2, 封装到复用帧 2的复用子 帧 1 中。 前端发送设备获取视频业务 S的音频数据码流及数据段信息， 添 加到复用帧 1的复用子帧 1 中， 即与基本层码流一起承载于同一个复用子 帧中。 承载各层码流的复用帧位置信息， 承载于广播信道帧中的复用帧 0 中， 以指示终端接收设备各层码流的复用帧位置信息， 以方便其接收视频 业务 S。
音频数据码流、 视频数据码流封装到复用子帧中去的时候， 是以一个 个音频或视频单元为单位进行封装的。 对于每个音频单元或视频单元， 都 有一个对应的移动多媒体广播时间戳， 根据移动多媒体广播标准， 该时间 戳为复用子帧内的起始播放时间和每个单元对应的相对播放时间组合而 成。 起始播放时间和每个单元对应的相对播放时间也封装在复用子帧内 , 与媒体数据一同发送。
在前端发送设备上， 需要将所接收的媒体数据的 PCR时间戳转换成移 动多媒体广播时间戳， 在此过程中控制 SVC各分层业务在移动多媒体广播 时间戳上的同步。
前端发送设备上， SVC各分层业务在移动多媒体广播时间戳上的同步， 按以下方法进行：
对于 SVC各分层所对应的每一复用子帧，
A、接收输入的 MPEG-2 TS码流，对于每一视频单元，取出其所在 PES 包的 PTS时间戳， 结合其所在节目的码流所对应的有关 PCR时间信息， 计 算该视频单元的 PCR时间；
B、 直接用视频单元的 PCR时间乘上移动多媒体广播时间刻度， 得到 该 SVC视频单元的移动多媒体广播时间戳。 对复用子帧， 取一个起始播放 时间， 将视频单元的移动多媒体广播时间戳分解为起始播放时间和每个单 元对应的相对播放时间两部分， 把起始播放时间和每个单元对应的相对播 放时间封装到复用子帧里去。
步骤 A中视频单元的 PCR时间的计算可以釆用以下方法：
( 1 )解析 MPEG-2 TS码流中的 TS包， 直到解析到带有 PCR时间信 息的 TS包，将该 PCR时间信息作为参考 PCR时间戳，解析该 TS包中 PES 包， 将 PES包中的 PTS作为参考 PTS时间戳。
( 2 )对于后续每一视频单元， 取出其所在 PES包的 PTS时间戳， 如 果该 TS包中带有 PCR, 则更新参考 PCR时间戳， 同时更新参考 PTS时间 戳。 如果该 TS包中没有 PCR, 则计算该视频单元的 PCR;
( 3 )用 PES包里的 PTS时间戳去和参考 PTS时间戳做差值， 再用这 个差值加上参考 PCR时间戳， 就得到 PES包对应的 PCR时间， 亦即视频 单元对应的 PCR时间。
PCR时间 =|PTS时间戳 -参考 PTS时间戳 |+参考 PCR时间戳 公式（ 1 ) 步骤 B中所述移动多媒体广播时间刻度， 表示每秒发生的移动多媒体 广播时间单位数， 根据移动多媒体广播标准《移动多媒体广播 第 2部分： 复用》为 22500。
终端接收设备（如： 手机、 上网本等） 上接收并监听广播信道帧中的 复用帧 0, 接收控制信息及 ESG信息， 以正确接收多媒体广播业务， 同时 监听到的， 还包括分级视频业务中各层码流所在的复用子帧位置信息。 终 端接收设备并根据自身需要， 如其视频流处理能力或网络传输状况， 决定 接收基本层码流， 或接收基本层码流及对应的增强层码流。 该应用实例中 该终端接收设备以一个可以处理 VGA视频的上网本为例， 需要同时接收 QVGA的基本层码流和 VGA的增强层码流来做处理，解码展现 VGA视频。 接收到从不同复用子帧传来的基本层码流和增强层码流后， 上网本将视频 单元从复用子帧中提取出来， 解析出 H264基本编码单元 NALU, 将属于不 同分层业务的 NALU按移动多媒体广播时间戳对齐、 同步， 之后将属于同 一个接入单元的 NALU进行合并， 然后进行视频解码展现。
终端接收设备（如： 上网本）上， SVC各分层业务的同步按以下方法 进行：
a、 每一个视频单元， 都有对应的移动多媒体广播时间戳， 该时间戳为 复用子帧内的起始播放时间和每个单元对应的相对播放时间组合而成。 将 视频单元所包含的 NALU数据连同其对应的时间戳放入緩冲区， 緩冲区可 以是基本层或者增强层， 该基本层、 增强层都是各自独立的。
b、 每隔一个固定时间间隔， 上网本就从前述緩冲区取一个视频接入单 元， 将视频接入单元不同分层的 NALU数据对齐合并后， 送入解码器。 先 取属于一个视频接入单元的 SVC基本层码流的 NALU数据， 以 SVC基本 层码流的时间戳为基准， 取出与基本层码流时间戳对应的增强层码流的
NALU数据， 将其作为同一视频接入单元的数据， 和基本层码流的 NALU 数据合并， 将合并后的 NALU数据作为一个完整的接入单元， 送入解码器 解码。
以上仅为本发明的较佳实施例而已， 并不用以限制本发明， 凡在本发 明的精神和原则之内所作的任何修改、 等同替换和改进等， 均应包含在本 发明的保护范围之内。 工业实用性
本发明实施例方案中， 前端发送设备一侧， 接收编码设备发出的 MPEG-2 TS码流； 从所述 MPEG-2 TS码流中提取出所封装的媒体数据，得 到各层码流： 基本层码流和增强层码流； 将所述各层码流按其所属的层分 别封装于广播信道帧中的不同复用子帧中以及将所述各层码流所在的复用 子帧位置信息封装于所述广播信道帧中； 将所述媒体数据的所述各层码流 的 PTS时间戳转换成统一时间基准下的移动多媒体广播时间戳， 控制所述 各层码流在移动多媒体广播时间戳上的同步； 将需要发送的媒体数据连同 该媒体数据的所述各层码流的移动多媒体广播时间戳一起广播发送。 终端 接收设备一侧， 监听广播信道帧中所述各层码流所在的复用子帧位置信息； 根据所述位置信息和自身的处理能力接收所述各层码流中的基本层码流， 或接收所述基本层码流及对应的增强层码流； 将所述各层码流按移动多媒 体广播时间戳对齐、 同步后进行合并； 将所述各层码流进行解码展现。
根据以上描述可见， 在将 MPEG-2 TS码流中的分级业务的各层码流通 过移动多媒体广播传送时， 通过统一的时间戳， 保证分级业务的各层码流 (即： 各个分层数据）之间的同步， 从而保证移动多媒体广播中分级业务 的正常实施。

Claims

权利要求书
1、 一种移动多媒体广播中分级业务发送同步的方法， 其特征在于， 包 括：
前端发送设备接收编码设备发出的动态图像专家组 -2传输流 MPEG-2 TS码流；
从所述 MPEG-2 TS码流中提取出所封装的媒体数据， 得到各层码流： 基本层码流和增强层码流；
将所述各层码流按其所属的层分别封装于广播信道帧中的不同复用子 帧中以及将所述各层码流所在的复用子帧位置信息封装于所述广播信道帧 中；
将所述媒体数据的所述各层码流的展现时戳 PTS时间戳转换成统一时 间基准下的移动多媒体广播时间戳， 控制所述各层码流在移动多媒体广播 时间戳上的同步；
将需要发送的媒体数据连同该媒体数据的所述各层码流的移动多媒体 广播时间戳一起广播发送。
2、 如权利要求 1所述方法， 其特征在于， 所述将所述媒体数据的所述 各层码流的 PTS时间戳转换成统一时间基准下的移动多媒体广播时间戳， 控制所述各层码流在移动多媒体广播时间戳上的同步， 具体包括：
根据所述各层码流所在的分组基本流 PES包中的 PTS时间戳和 PES包 的节目时钟参考 PCR时间信息计算所述各层码流的 PCR时间；
将该层码流的 PCR时间除以 PCR的时钟刻度然后乘以移动多媒体广播 时间刻度， 得到该层码流的移动多媒体广播时间戳。
3、 一种移动多媒体广播中分级业务接收同步的方法， 其特征在于， 包 括：
终端接收设备监听广播信道帧中所述各层码流所在的复用子帧位置信 息；
根据所述位置信息和自身的处理能力接收所述各层码流中的基本层码 流， 或接收所述基本层码流及对应的增强层码流；
将所述各层码流按移动多媒体广播时间戳对齐、 同步后进行合并； 将所述各层码流进行解码展现。
4、 如权利要求 3所述方法， 其特征在于， 所述将所述各层码流按移动 多媒体广播时间戳对齐、 同步， 具体包括：
所述终端接收设备将所接收到的所述各层码流连同其对应的移动多媒 体广播时间戳放入緩冲区；
在一帧数据接收完毕的时刻， 从所述緩冲区取待合并的码流进行对齐 合并。
5、 如权利要求 4所述方法， 其特征在于， 所述在一帧数据接收完毕的 时刻， 从所述緩冲区取待合并的码流进行对齐合并， 具体包括：
所述终端接收设备取属于一个接入单元的基本层码流， 以基本层码流 的时间戳为基准， 取出与基本层码流时间戳对应的增强层码流， 将其作为 同一接入单元的码流进行合并。
6、 一种前端发送设备， 其特征在于， 包括：
码流接收单元， 用于接收编码设备发出的 MPEG-2 TS码流； 数据提取单元， 用于从所述 MPEG-2 TS码流中提取出所封装的媒体数 据， 得到各层码流： 基本层码流和增强层码流；
码流封装单元， 用于将所述各层码流按其所属的层分别封装于广播信 道帧中的不同复用子帧中以及将所述各层码流所在的复用子帧位置信息封 装于所述广播信道帧中；
码流同步单元， 用于将所述媒体数据的所述各层码流的 PTS时间戳转 换成统一时间基准下的移动多媒体广播时间戳， 控制所述各层码流在移动 多媒体广播时间戳上的同步；
码流发送单元， 用于将需要发送的媒体数据连同该媒体数据的所述各 层码流的移动多媒体广播时间戳一起广播发送。
7、如权利要求 1所述前端发送设备，其特征在于， 所述码流同步单元， 包括：
时间计算子单元， 用于根据所述各层码流所在的 PES包中的 PTS时间 戳和 PES包的 PCR时间信息计算所述各层码流的 PCR时间；
时间戳计算子单元，用于将该层码流的 PCR时间除以 PCR的时钟刻度 然后乘以移动多媒体广播时间刻度， 得到该层码流的移动多媒体广播时间 戳。
8、 一种终端接收设备， 其特征在于， 包括：
位置监听单元， 用于监听广播信道帧中所述各层码流所在的复用子帧 位置信息；
码流接收单元， 用于根据所述位置信息和自身的处理能力接收所述各 层码流中的基本层码流， 或接收所述基本层码流及对应的增强层码流； 码流合并单元， 用于将所述各层码流按移动多媒体广播时间戳对齐、 同步后进行合并；
码流展现单元， 用于将所述各层码流进行解码展现。
9、 如权利要求 8所述终端接收设备， 其特征在于， 所述码流合并单元 包括：
緩冲子单元， 用于将所接收到的所述各层码流连同其对应的移动多媒 体广播时间戳放入緩冲区；
码流对齐子单元， 用于在一帧数据接收完毕的时刻， 从所述緩冲区取 待合并的码流进行对齐合并。
10、 如权利要求 9所述终端接收设备， 其特征在于， 所述码流对齐子 单元， 用于取属于一个接入单元的基本层码流， 以基本层码流的时间戳为 基准， 取出与基本层码流时间戳对应的增强层码流， 将其作为同一接入单 元的码流进行合并。
11、 一种移动多媒体广播中分级业务同步的系统， 其特征在于， 包括： 编码设备， 用于将编码生成的多个分层的码流封装为 MPEG-2 TS码流 后发出；
前端发送设备， 用于收所述编码设备发出的 MPEG-2 TS码流， 从所述 MPEG-2 TS码流中提取出所封装的媒体数据， 得到各层码流： 基本层码流 和增强层码流， 将所述各层码流按其所属的层分别封装于广播信道帧中的 不同复用子帧中以及将所述各层码流所在的复用子帧位置信息封装于所述 广播信道帧中， 将所述媒体数据的所述各层码流的 PTS时间戳转换成统一 时间基准下的移动多媒体广播时间戳， 控制所述各层码流在移动多媒体广 播时间戳上的同步， 将需要发送的媒体数据连同该媒体数据的所述各层码 流的移动多媒体广播时间戳一起广播发送；
终端接收设备， 用于监听广播信道帧中所述各层码流所在的复用子帧 位置信息， 根据所述位置信息和自身的处理能力接收所述各层码流中的基 本层码流， 或接收所述基本层码流及对应的增强层码流， 将所述各层码流 按移动多媒体广播时间戳对齐、 同步后进行合并， 将所述各层码流进行解 码展现。
12、 如权利要求 11所述系统， 其特征在于， 所述前端发送设备， 用于 根据所述各层码流所在的 PES包中的 PTS时间戳和 PES包的 PCR时间信 息计算所述各层码流的 PCR时间， 将该层码流的 PCR时间除以 PCR的时 钟刻度然后乘以移动多媒体广播时间刻度， 得到该层码流的移动多媒体广 播时间戳。
13、 如权利要求 11或 12所述系统， 其特征在于， 所述终端接收设备， 还用于： 将所接收到的所述各层码流连同其对应的移动多媒体广播时间戳 放入緩冲区， 在一帧数据接收完毕的时刻， 从所述緩冲区取待合并的码流 进行对齐合并。
14、 如权利要求 13所述系统， 其特征在于， 所述终端接收设备， 还用 于： 取属于一个接入单元的基本层码流， 以基本层码流的时间戳为基准， 取出与基本层码流时间戳对应的增强层码流， 将其作为同一接入单元的码 流进行合并。
PCT/CN2011/077591 2010-11-24 2011-07-25 移动多媒体广播中分级业务同步的方法、设备和系统 WO2012068898A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010557758.7 2010-11-24
CN201010557758.7A CN102480634B (zh) 2010-11-24 2010-11-24 移动多媒体广播中分级业务同步的方法、设备和系统

Publications (1)

Publication Number Publication Date
WO2012068898A1 true WO2012068898A1 (zh) 2012-05-31

Family

ID=46093091

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/077591 WO2012068898A1 (zh) 2010-11-24 2011-07-25 移动多媒体广播中分级业务同步的方法、设备和系统

Country Status (2)

Country Link
CN (1) CN102480634B (zh)
WO (1) WO2012068898A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10915647B2 (en) 2015-11-20 2021-02-09 Genetec Inc. Media streaming
US20220417620A1 (en) * 2021-06-25 2022-12-29 Netflix, Inc. Systems and methods for providing optimized time scales and accurate presentation time stamps

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106303673B (zh) 2015-06-04 2021-01-22 中兴通讯股份有限公司 码流对齐、同步处理方法及发送、接收终端和通信系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1726719A (zh) * 2002-12-20 2006-01-25 皇家飞利浦电子股份有限公司 处理分层媒体数据的方法和设备
CN101273627A (zh) * 2005-09-27 2008-09-24 韩国电子通信研究院 用于高质量视频服务的传送和接收数字多媒体广播的设备
CN101282482A (zh) * 2008-05-04 2008-10-08 中兴通讯股份有限公司 视频数据与音频数据同步播放的装置、系统和方法
JP2009267573A (ja) * 2008-04-23 2009-11-12 Victor Co Of Japan Ltd 動画像階層符号化装置、動画像階層復号化装置、動画像階層符号化方法、動画像階層復号方法、動画像階層符号化プログラム及び階層復号プログラム
CN101690200A (zh) * 2007-05-04 2010-03-31 韩国电子通信研究院 用于在数字多媒体广播系统中提供高质量多媒体服务的方法和设备
CN101951506A (zh) * 2010-09-17 2011-01-19 中兴通讯股份有限公司 实现可伸缩视频编码业务同步发送、接收的系统和方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1726719A (zh) * 2002-12-20 2006-01-25 皇家飞利浦电子股份有限公司 处理分层媒体数据的方法和设备
CN101273627A (zh) * 2005-09-27 2008-09-24 韩国电子通信研究院 用于高质量视频服务的传送和接收数字多媒体广播的设备
CN101690200A (zh) * 2007-05-04 2010-03-31 韩国电子通信研究院 用于在数字多媒体广播系统中提供高质量多媒体服务的方法和设备
JP2009267573A (ja) * 2008-04-23 2009-11-12 Victor Co Of Japan Ltd 動画像階層符号化装置、動画像階層復号化装置、動画像階層符号化方法、動画像階層復号方法、動画像階層符号化プログラム及び階層復号プログラム
CN101282482A (zh) * 2008-05-04 2008-10-08 中兴通讯股份有限公司 视频数据与音频数据同步播放的装置、系统和方法
CN101951506A (zh) * 2010-09-17 2011-01-19 中兴通讯股份有限公司 实现可伸缩视频编码业务同步发送、接收的系统和方法

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10915647B2 (en) 2015-11-20 2021-02-09 Genetec Inc. Media streaming
US11397824B2 (en) 2015-11-20 2022-07-26 Genetec Inc. Media streaming
US11853447B2 (en) 2015-11-20 2023-12-26 Genetec Inc. Media streaming
US20220417620A1 (en) * 2021-06-25 2022-12-29 Netflix, Inc. Systems and methods for providing optimized time scales and accurate presentation time stamps
US20230199278A1 (en) * 2021-06-25 2023-06-22 Netflix, Inc. Systems and methods for providing optimized time scales and accurate presentation time stamps
US11716520B2 (en) * 2021-06-25 2023-08-01 Netflix, Inc. Systems and methods for providing optimized time scales and accurate presentation time stamps

Also Published As

Publication number Publication date
CN102480634A (zh) 2012-05-30
CN102480634B (zh) 2015-12-16

Similar Documents

Publication Publication Date Title
EP2498495B1 (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks
WO2012034442A1 (zh) 实现可伸缩视频编码业务同步发送、接收的系统和方法
US8009742B2 (en) Method and system for retransmitting internet protocol packet for terrestrial digital multimedia broadcasting service
US10397633B2 (en) Receiver apparatus and synchronization processing method thereof
KR20130014428A (ko) 실시간으로 전송되는 기준 영상과 별도로 전송되는 부가 영상 및 콘텐츠를 연동하여 3ｄ 서비스를 제공하기 위한 전송 장치 및 방법, 및 수신 장치 및 방법
CN101710997A (zh) 基于mpeg-2系统实现视、音频同步的方法及系统
US20090241163A1 (en) Broadcast picture display method and a digital broadcast receiver using the same
CN101272200B (zh) 一种多媒体流同步缓存的方法及系统
Concolato et al. Synchronized delivery of multimedia content over uncoordinated broadcast broadband networks
WO2012079402A1 (zh) 一种多媒体数据传输的方法、系统和装置
JP5313399B2 (ja) ハードウェア・タイムスタンプなしでビデオ・フレームを同期すること
WO2012068898A1 (zh) 移动多媒体广播中分级业务同步的方法、设备和系统
US20100205317A1 (en) Transmission, reception and synchronisation of two data streams
WO2012034441A1 (zh) 实现可伸缩视频编码业务协同传输的方法及系统
EP1839440A2 (en) Visual radio broadcasting method, encoder and decoder for the method, and receiver using the decoder
AU2015204359B2 (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks
WO2005020580A1 (en) Apparatus and method for converting media stream for multimedia service in dab system
KR100950771B1 (ko) 방송 신호의 송신 및 수신 방법
TWI673999B (zh) 供視聽內容及／或資料傳輸的方法
WO2017110854A1 (ja) 送信装置、受信装置、送信方法及び受信方法
Takada et al. An overview of the ISDB-T one-seg broadcasting ISDB-TSB and ISDB-Tmm
WO2014045614A1 (en) Video signal transmitting method, video signal receiving apparatus, and video signal receiving method
JP2002016915A (ja) 同期信号発生器
JP2013207650A (ja) エンコーダおよび制御方法
Jang et al. Multiplexing of UHDTV Based on MPEG-2 TS

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11842596

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11842596

Country of ref document: EP

Kind code of ref document: A1