WO2013042998A1 - Appareil et procédé pour transmettre des données multimédia pour système mmt, et appareil et procédé pour recevoir des données multimédia - Google Patents

Appareil et procédé pour transmettre des données multimédia pour système mmt, et appareil et procédé pour recevoir des données multimédia Download PDF

Info

Publication number
WO2013042998A1
WO2013042998A1 PCT/KR2012/007617 KR2012007617W WO2013042998A1 WO 2013042998 A1 WO2013042998 A1 WO 2013042998A1 KR 2012007617 W KR2012007617 W KR 2012007617W WO 2013042998 A1 WO2013042998 A1 WO 2013042998A1
Authority
WO
WIPO (PCT)
Prior art keywords
sampling time
time information
information
layer
sampling
Prior art date
Application number
PCT/KR2012/007617
Other languages
English (en)
Korean (ko)
Inventor
유정주
김창기
김태정
정영호
홍진우
서광덕
이홍래
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority claimed from KR1020120105350A external-priority patent/KR20130032843A/ko
Publication of WO2013042998A1 publication Critical patent/WO2013042998A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2362—Generation or processing of Service Information [SI]

Definitions

  • the present invention relates to an apparatus and method for transmitting and receiving media data, and more particularly, to an encapsulation layer (E) required for transmission and reception of media data for an MMT (MPEG Media Transport) system. -layer) timing information.
  • E encapsulation layer
  • MMT MPEG Media Transport
  • MPEG Media Transport is a new standard technology that has begun development in the MPEG systems sub-working group.
  • the existing MPEG-2 system has been widely used since MPEG-2 transport stream (TS) technology has been standardized as a standard for packetization, synchronization, and multiplexing for transmitting A / V content in a broadcasting network.
  • MPEG-2 TS is inefficient in a packet transmission environment in which a network is based on IP (Internet Protocol). Therefore, ISO MPEG recognized the necessity of a new media transmission standard in consideration of the new media transmission environment and the expected media transmission environment, and started to standardize MMT.
  • DTS decoding time stamp
  • PTS presentation time stamp
  • RTP real-time transport protocol
  • NTP network time protocol
  • timing models for media transmission there are two conventionally developed timing models for media transmission, firstly, MPEG-2 system technology, and secondly, a method of combining RTP and RTCP (RTP control protocol).
  • RTP control protocol a method of combining RTP and RTCP (RTP control protocol).
  • PTS and DTS timing information are used as timing information for constructing a timing model for determining a media playback time.
  • RTP timestamp information recorded in the RTP and the NTP time stamp recorded in the RTCP sender report are simultaneously used.
  • MPEG-2 system technology proposes a timing model for delivering compressed media through a stable transmission network such as a broadcasting network. Since MPEG-2 system is a standard developed for digital broadcasting service, MPEG-2 TS (transport stream) packets transmitted to the receiver are transmitted to the receiver through a broadcasting network which is a circuit switched network with relatively stable channel quality. do. Accordingly, MPEG-2 TS packets have a relatively short and constant packet delay time experienced in a transport channel, and a timing model for sequentially processing TS packets arriving at a receiver also operates relatively stably. However, in the case of IP networks other than broadcasting networks, the arrival delay time intervals experienced by TS packets transmitted are very irregular, and therefore, the timing model adopted by MPEG-2 system technology is difficult to maintain stably.
  • the RTP timestamp recorded in the header of the RTP packet indicates the internal temporal ordering relationship of a specific media stream. Accordingly, in order to provide synchronization between different media streams, timing information corresponding to an absolute time (wall-clock) must be delivered.
  • the timing information transmitted to the terminal for this purpose is an NTP timestamp.
  • the NTP timestamp is transmitted in an RTCP sender report (SRTCP) packet.
  • SRTCP RTCP sender report
  • the NTP timestamp is repeatedly transmitted at regular intervals. Since RTCP SR packets are transmitted separately from the RTP stream for transmitting media, the operation of the transmitting and receiving system is complicated by increasing the traffic burden on the network and increasing the number of UDP ports and streams to be managed by the server / terminal. Lose.
  • an object of the present invention for solving the above problems is to provide the basic timing information necessary for the timing of the playback of the media and the time synchronization between the media transmitted in the media transmission service based on the MMT system, MPEG- which is a conventional timing model
  • the present invention provides an apparatus and method for transmitting media data that can provide timing information compatible with the timing system of the 2 system and the RTP / RTCP-based timing model.
  • another object of the present invention is to provide the basic timing information necessary for the timing of the playback of the media and the time synchronization between the media transmitted in the MMT system-based media transmission service, and the timing model of the conventional MPEG-2 system
  • the present invention provides an apparatus and method for receiving media data that can provide timing information compatible with an RTP / RTCP-based timing model.
  • An apparatus for transmitting media data according to an embodiment of the present invention for encapsulating an encoded media stream generates an encapsulation layer data (E-layer data) including timing information.
  • the media data transmission device includes an encoder for generating media streams by encoding media data; A buffer that stores the encoded media stream; A packetizer for packetizing the E-layer data to generate a delivery layer packet (D-layer packet); And a transmitter configured to transmit the packetized D-layer packet.
  • the first sampling time information may be 1 bit
  • the second sampling time information may be 32 bits.
  • the first sampling time information is a value of the 33rd bit of the sampling time based on a sampling clock frequency
  • the second sampling time information is a lower 32 bit value of the sampling time. It may be characterized by.
  • an apparatus for receiving media data generates an encoded media stream by decapsulating encapsulation layer data (E-layer data), and extracts timing information.
  • a decapsulator may be included.
  • the timing information may include first sampling time information, second sampling time information, and rendering time information.
  • the media data receiving apparatus includes a receiving unit for receiving a delivery layer packet (D-layer packet); A depacketizer configured to depacketize the D-layer packet to generate the E-layer data; A buffer for storing the encoded media stream; A decoder for decoding the encoded media stream; And a rendering buffer for rearranging the decoded media data for display.
  • D-layer packet delivery layer packet
  • a depacketizer configured to depacketize the D-layer packet to generate the E-layer data
  • a buffer for storing the encoded media stream
  • a decoder for decoding the encoded media stream
  • And a rendering buffer for rearranging the decoded media data for display.
  • the rendering time information may represent a time required until the playback time after the media stream is decoded.
  • the method may further include a controller configured to determine a sampling time based on the first sampling time information and the second sampling time information, and to determine a rendering time indicating an accurate playback time of media based on the sampling time. It can be characterized.
  • the controller may generate a decoding time stamp (DTS) and a presentation time stamp (PTS) of the MPEG-2 system based on the first sampling time information, the second sampling time information, and the rendering time information.
  • the controller may generate an RTP time stamp of a real time protocol (RTP) based on the second sampling time information and the rendering time information.
  • DTS decoding time stamp
  • PTS presentation time stamp
  • RTP real time protocol
  • a media data transmission method for generating encapsulation layer data including timing information by encapsulating an encoded media stream.
  • the timing information may include first sampling time information, second sampling time information, and rendering time information.
  • the media data transmission method may include generating a media stream by encoding media data; Storing the encoded media stream; Packetizing the E-layer data to generate a delivery layer packet (D-layer packet); And transmitting the packetized D-layer packet.
  • the first sampling time information may be 1 bit
  • the second sampling time information may be 32 bits.
  • the first sampling time information is a value of the 33rd bit of the sampling time based on a sampling clock frequency
  • the second sampling time information is a lower 32 bit value of the sampling time. It may be characterized by.
  • a method for receiving media data includes decapsulating encapsulation layer data (E-layer data) to generate an encoded media stream and extract timing information.
  • the timing information may include first sampling time information, second sampling time information, and rendering time information.
  • the method for receiving media data may include receiving a delivery layer packet (D-layer packet); Depacketizing the D-layer packet to generate the E-layer data; Storing the encoded media stream; Decoding the encoded media stream; And rearranging the decoded media data for display.
  • the rendering time information may represent a time required until a playback time after the media stream is decoded.
  • the method may further include determining a sampling time based on the first sampling time information and the second sampling time information, and determining a rendering time indicating a correct playback time of the media based on the sampling time. It can be characterized.
  • the method may further include generating a decoding time stamp (DTS) and a presentation time stamp (PTS) of the MPEG-2 system based on the first sampling time information, the second sampling time information, and the rendering time information.
  • the method may further include generating an RTP time stamp of a real time protocol (RTP) based on the second sampling time information and the rendering time information.
  • DTS decoding time stamp
  • PTS presentation time stamp
  • RTP real time protocol
  • the MMT transmission system provides timing information such as Sampling_Time_Ext, Sampling_Time_Base, Rendering_Time_Offset, etc. to the receiving terminal to derive a playback time for media
  • Basic timing information is provided to maintain lip-synchronization between different media such as audio.
  • the Sampling Time information is divided into a 1-bit Sampling_Time_Ext field and a 32-bit Sampling_Time_Base field to express the 33-bit DTS / PTS timing information used in the existing MPEG-2 system and the 32-bit RTP used in the RTP. Maintain compatibility with time stamp information.
  • FIG. 1 is a conceptual diagram illustrating an MMT hierarchical structure.
  • 3 shows a temporal correlation between timing information recorded in an E-layer header.
  • FIG. 4 is a block diagram illustrating a configuration of an apparatus for transmitting media data according to an embodiment of the present invention.
  • FIG. 5 is a block diagram illustrating a configuration of an apparatus for receiving media data according to an embodiment of the present invention.
  • FIG. 6 illustrates an operation procedure performed by the media data receiving apparatus of FIG. 5 at a receiving terminal of an MMT system for timing synchronization using the timing information shown in FIG. 3.
  • FIG. 7 illustrates a case where timing information recorded in a header of MMT E-layer data is mapped to DTS and PTS information of an MPEG-2 system.
  • FIG. 9 is a flowchart illustrating a method of transmitting media data according to an embodiment of the present invention.
  • FIG. 10 is a flowchart illustrating a method of receiving media data according to an embodiment of the present invention.
  • FIG. 11 is a detailed flowchart of a step of determining the sampling time and rendering time of FIG. 10.
  • first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.
  • the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.
  • FIG. 1 is a conceptual diagram illustrating an MMT hierarchical structure.
  • the MMT layer includes an encapsulation layer, a delivery layer, and a functional area of a signaling layer.
  • the MMT layer operates on a transport layer.
  • the encapsulation layer may be responsible for, for example, packetization, fragmentation, synchronization, multiplexing, and the like of transmitted media.
  • Encapsulation layer (E-layer), as shown in Figure 1, MMT E.1 Layer (MMT E.1 Layer), MMT E.2 Layer (MMT E.2 Layer) and MMT E.3 Layer (MMT) E.3 Layer).
  • MMT E.1 Layer MMT E.1 Layer
  • MMT E.2 Layer MMT E.2 Layer
  • MMT E.3 Layer MMT E.3 Layer
  • the E.3 layer encapsulates a Media Fragment Unit (MFU) provided from the Media Codec (A) layer to create an M-Unit.
  • MFU Media Fragment Unit
  • the MFU may have a format, independent of any particular codec, that can carry data units that can be consumed independently in the media decoder.
  • the MFU can be, for example, a picture or slice of the video.
  • the M-unit may consist of one or a plurality of MFUs and may have a format, independent of a particular codec, that may carry one or a plurality of access units.
  • the E.2 layer encapsulates the M-units created in the E.3 layer to create an MMT asset.
  • An MMT asset is a data entity composed of one or a plurality of M-units from a single data source and is a data unit in which composition information and transport characteristics are defined.
  • MMT assets can correspond to packetized elementary streams (PES), for example video, audio, program information, MPEG-U widgets, JPEG images, MPEG 4 file format, M2TS (MPEG transport stream) and the like.
  • PES packetized elementary streams
  • the E.1 layer creates an MMT package by encapsulating the MMT asset generated in the E.2 layer.
  • the MMT package may be composed of one or more MMT assets together with additional information such as composition information and transport characteristics.
  • Composition information includes information about a relationship between MMT assets, and when one content consists of a plurality of MMT packages, it indicates a relationship between a plurality of MMT packages. It may further include information.
  • the transport characteristics may include transmission characteristic information necessary for determining a delivery condition of an MMT asset or an MMT packet, and may include, for example, a traffic description parameter and a QoS descriptor. ) May be included.
  • the MMT package may correspond to a program of MPEG-2 TS.
  • the delivery layer may perform, for example, network flow multiplexing, network packetization, and QoS control of media transmitted through a network.
  • the transport layer (D-layer), as shown in Figure 1, MMT D.1 Layer (MMT D.1 Layer), MMT D.2 Layer (MMT D.2 Layer) and MMT D.3 Layer (MMT) D.3 Layer).
  • the D.1 layer receives the MMT package generated in the E.1 layer and generates an MMT payload format.
  • the MMT payload format is a payload format for carrying MMT assets and for transmitting information for consumption by the MMT application protocol or other existing application transport protocol such as RTP.
  • the MMT payload may include a fragment of the MFU along with information such as AL-FEC.
  • the D.2 layer receives the MMT payload format generated in the D.1 layer and generates an MMT transport packet or an MMT packet.
  • the MMT transport packet or MMT packet is a data format used in an application transport protocol for MMT.
  • D.3 layer supports QoS by providing the ability to exchange information between layers by cross-layer design.
  • the D.3 layer may perform QoS control using QoS parameters of the MAC / PHY layer.
  • the signaling layer performs a signaling function. For example, signaling functions for session initialization / control / management of transmitted media, server-based and / or client-based trick modes, service discovery, synchronization, etc. Can be done.
  • Signaling layer may be composed of MMT S.1 layer (MMT S.1 Layer) and MMT S.2 layer (MMT S.2 Layer).
  • S.1 layer includes service discovery, media session initialization / termination of media, media session presentation / control of media, delivery (D) layer and encapsulation (E).
  • the interface function with the layer can be performed.
  • the S.1 layer may define the format of control messages between applications for media presentation session management.
  • the S.2 layer is responsible for flow control, delivery session management, delivery session monitoring, error control, and hybrid network synchronization control. It is possible to define the format of the control message exchanged between delivery end-points of the D-layer.
  • the S.2 layer supports delivery session establishment and release, delivery session monitoring, flow control, error control, resource scheduling for established delivery sessions, and synchronization in a complex delivery environment to support the behavior of the delivery layer.
  • Signaling for adaptive delivery, and signaling for adaptive delivery. Required signaling may be provided between a sender and a receiver. That is, the S.2 layer may provide signaling required between the sender and the receiver in order to support the operation of the transport layer as described above.
  • the S.2 layer may be responsible for interfacing with the transport layer and the encapsulation layer.
  • the present invention relates to an apparatus and method for transmitting media data, including basic E-layer timing information for acquiring playback time information on media and playing media while maintaining time synchronization between media in an MMT system. It is about.
  • the proposed timing information can be utilized while maintaining compatibility with the existing MPEG-2 system and RTP timing model, so that the data generated in the MMT E-layer is not only D-layer (Delivery layer) of MMT. In addition, it can be smoothly transmitted by the existing RTP.
  • the timing information can be easily converted while maintaining compatibility with the representation method of the timing information adopted by the MPEG-2 system.
  • the timing of the media transmission and the time synchronization between the media in the MMT system-based media transmission service aiming at efficient media transmission over the IP network are determined.
  • the timing information is used to provide accurate playback time information of frames in the media stream to enable media playback at a predetermined time, and further, to provide basic time information required for synchronization between different media.
  • the media data transmission apparatus 400 includes an encoder 410 for generating a media stream by encoding media data, and a buffer that stores the encoded media stream. 420, an encapsulator 430 that encapsulates the encoded media stream to generate encapsulation layer data (E-layer data) including timing information, and transmits the packetized E-layer data. It may include a packetizer 440 for generating a delivery layer packet (D-layer packet) and a transmission unit 450 for transmitting the packetized D-layer packet.
  • the timing information included in the E-layer data may be compatible with the MPEG-2 system and the Real Time Protocol (RTP). More specifically, the timing information may include first sampling time information, second sampling time information, and rendering time information.
  • FIG. 2 shows timing information recorded in a header of E-layer data of an MMT. Referring to FIG. 2, first sampling time information, second sampling time information, and rendering time information included in the timing information will be described in detail.
  • the timing information may be allocated to a sample of media data, such as a picture of a video or a frame of audio, or to E-layer data in units of one or more of the samples of the media data.
  • the E-layer timing information includes first sampling time information (hereinafter, 'Sampling_Time_Ext', 210), second sampling time information (hereinafter, 'Sampling_Time_Base', 220), and rendering time information (hereinafter, 'Rendering_Time_Offset' ', 230) may be included.
  • the Sampling_Time_Ext 210 may be 1 bit
  • the Sampling_Time_Base 220 is 32 bits
  • the Rendering_Time_Offset 230 may be 20 bits.
  • Sampling Time can be obtained from a sampling clock frequency operating at 90 KHz precision commonly used in MPEG-2 systems and RTP transmission systems. If a sampling clock frequency other than 90 KHz precision is adopted, the same principle can be applied.
  • Sampling time is the result of obtaining the sampling time for the pictures inputted in the order of compression to the media encoder of the MMT transmission system from the 90 KHz sampling clock frequency.
  • Sampling time can be a total of 33 bits.
  • the Sampling_Time_Ext 210 may mean the value of the 33rd bit of the Sampling Time
  • the Sampling_Time_Base 220 may represent the lower 32 bits of the Sampling Time.
  • the Rendering_Time_Offset 230 represents a time required until decoding, which is a playback time, after decoding.
  • the decompressed media data may be reproduced by an output device at a rendering time.
  • the rendering buffer is also used for picture reordering of I-pictures, P-pictures, and B-pictures that occur when a B-picture is present in the video sequence structure. . Normally, B-pictures are reproduced immediately after decoding, so they are immediately output without undergoing a rendering buffer process. However, I-pictures or P-pictures must wait for Rendering_Time_Offset until they are decoded and played.
  • FIG. 3 shows a temporal correlation between timing information recorded in an E-layer header. As shown in FIG. 3, delivery time and decoding time are obtained through timing information delivered in a header of a D-layer, which is responsible for generating an MMT packet of a transport format.
  • FIG. 5 is a block diagram illustrating a configuration of an apparatus for receiving media data according to an embodiment of the present invention.
  • the apparatus 500 for receiving media data includes a receiver 510 for receiving a delivery layer packet (D-layer packet) and the D-layer packet.
  • Rendering buffer 560 the timing information may be compatible with the MPEG-2 system and the Real Time Protocol (RTP).
  • the timing information may include first sampling time information, second sampling time information, and rendering time information.
  • the timing information is the same as the timing information of the aforementioned media data transmission device. That is, the E-layer timing information may include three fields such as first sampling time information (hereinafter referred to as 'Sampling_Time_Ext'), second sampling time information (hereinafter referred to as 'Sampling_Time_Base'), and rendering time information (hereinafter referred to as 'Rendering_Time_Offset'). Can be.
  • the media data receiving apparatus 500 determines a sampling time based on the first sampling time information and the second sampling time information, and renders time indicating an accurate playback time point of the media based on the sampling time. It may further include a control unit 570 for determining. Equation for the control unit 570 to obtain the Sampling Time and Rendering Time values by the time relationship of FIG. 3 is as follows. First, the sampling time may be calculated by Equation 1 below.
  • Decoding Time can be calculated by Equation 2 below using Sampling Time information of the E-layer and Sender_Processing_Delay and Receiver_Processing_Delay provided from the D-layer.
  • the rendering time representing the exact playback time of the media can be calculated by Equation 3 below.
  • Decoding Time and Rendering Time required for locally reproducing MMT data stored in a local storage device in the terminal may be calculated by Equations 4 and 5, respectively.
  • the Sampling_Time value itself is used as the Decoding_Time value.
  • FIG. 6 illustrates an operation procedure performed by the media data receiving apparatus of FIG. 5 at a receiving terminal of an MMT system for timing synchronization using the timing information shown in FIG. 3.
  • An operation procedure performed at the media data receiving apparatus side of the MMT system using the timing information of the MMT E-layer shown in FIG. 3 is shown in FIG. 6.
  • the reason why the Sampling Time is divided into Sampling_Time_Ext and Sampling_Time_Base fields is displayed so that the timing information of the MMT E-layer can be directly converted into the timing information and the RTP timestamp value of the conventional MPEG-2 system.
  • Data generated by MMT should be easily convertible to a storage format such as the MPEG-2 system and a transport format such as an RTP packet.
  • the DTS and PTS timing information included in the MPEG-2 packetized elementary system (PES) packet header is converted to the E-layer timing information of the MMT. Efficiently derived from
  • the RTP timestamp value included in the RTP protocol header should be efficiently derived from the MMT E-layer timing information.
  • a value corresponding to the 33rd bit of the Sampling Time value having a total size of 33 bits is represented by a Sampling_Time_Ext field having a size of 1 bit, and the value corresponding to the remaining 32 bits is represented by a Sampling_Time_Base field.
  • a Sampling_Time_Base field having a size of 1 bit
  • a Sampling_Time_Base field can be displayed as As described above, when the Sampling Time information is divided into a 1-bit Sampling_Time_Ext field and a 32-bit Sampling_Time_Base field, both 33-bit DTS / PTS values and 32-bit RTP timestamp values of the MPEG-2 system can be directly obtained. .
  • FIG. 7 illustrates a case where timing information recorded in a header of MMT E-layer data is mapped to DTS and PTS information of an MPEG-2 system.
  • the control unit 570 of the apparatus for receiving media data according to an embodiment of the present invention uses the DTS (MPS) of the MPEG-2 system based on the first sampling time information (Sampling_Time_Ext), the second sampling time information (Sampling_Time_Base), and the rendering time information. Decoding Time Stamp) and PTS (Presentation Time Stamp) can be generated.
  • DTS DTS
  • PTS Presentation Time Stamp
  • the timing information recorded in the header of the MMT E-layer data may be mapped to the DTS value of the MPEG-2 system based on Equation 6 below.
  • Sender_Processing_to_Decoding_Delay represents an expected value for the sum of all of the Sender Processing Delay, Transmission Delay, and Receiver Processing Delay shown in FIG. 3.
  • timing information recorded in the header of the MMT E-layer data may be mapped to the PTS value of the MPEG-2 system based on Equation 7 below using the result of Equation 6.
  • the time information of the media data transmitted by the MMT system can be interpreted as a format of the time information used by the MPEG-2 system.
  • Time synchronization can also be achieved with media data transmitted via the -2 system. That is, when one stream is transmitted through the MMT system and another stream is transmitted through the MPEG system, temporal synchronization between the two streams can be achieved.
  • the controller 570 of the apparatus for receiving media data may generate an RTP time stamp of a real time protocol (RTP) based on the second sampling time information and the rendering time information. . Since the RTP timestamp has a total length of 32 bits, direct mapping to the RTP timestamp value is possible based on Equation 8 below.
  • RTP real time protocol
  • the timing information of the MMT E-layer can be directly converted into the timing information and the RTP timestamp value of the conventional MPEG-2 system. That is, the data generated by the MMT can be easily converted into a storage format such as the MPEG-2 system and a transmission format such as an RTP packet.
  • FIG. 9 is a flowchart illustrating a method of transmitting media data according to an embodiment of the present invention.
  • the media data transmission method includes generating a media stream by encoding media data (S910), storing the encoded media stream (S920), and Generating encapsulation layer data (E-layer data) including the timing information by encapsulating the encoded media stream (S930); packetizing the E-layer data to deliver a delivery layer packet; Generating a D-layer packet (S940) and transmitting the packetized D-layer packet (S950).
  • the timing information may include first sampling time information, second sampling time information, and rendering time information.
  • the first sampling time information may be 1 bit
  • the second sampling time information may be 32 bits.
  • the first sampling time information may be a sampling time based on a sampling clock frequency. It is the value of the 33rd bit of the second sampling time information may be characterized in that the value of the lower 32 bits of the sampling time (Sampling Time).
  • FIG. 10 is a flowchart of a method of receiving media data according to an embodiment of the present invention
  • FIG. 11 is a detailed flowchart of steps of determining a sampling time and a rendering time of FIG. 10.
  • the method for receiving media data first receives a delivery layer packet (D-layer packet) (S1010).
  • the E-layer data is generated by depacketizing the D-layer packet (S1020).
  • the encapsulation layer data (Encapsulation layer data, E-layer data) may be decapsulated to generate an encoded media stream and to extract timing information (S1030).
  • the timing information may be compatible with the MPEG-2 system and the Real Time Protocol (RTP).
  • the timing information may include first sampling time information, second sampling time information, and rendering time information.
  • the rendering time information may represent a time required until the playback time after the media stream is decoded.
  • a sampling time may be determined based on the first sampling time information and the second sampling time information, and a rendering time indicating an accurate playback time of the media may be determined based on the sampling time (S1040).
  • sampling time and rendering time determination step (S1040) will be described in more detail.
  • the first sampling time information (Sampling_Time_Ext) is extracted (S1042).
  • the second sampling time information Sampling_Time_Base may be extracted.
  • the sampling time may be calculated based on the first sampling time information and the second sampling time information (S1044), and may be used to calculate a decoding time (S1046).
  • rendering time information (Rendering_Time_Offset) is extracted from the data header of the MMT E-layer (S1047), and a rendering time (Rendering Time) may be calculated based on the calculated decoding time and the rendering time information (S1047). .
  • the encoded media stream may be stored (S1050), the encoded media stream is decoded (S1060), and the decoded media data may be rearranged (S1070) for display.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Synchronisation In Digital Transmission Systems (AREA)

Abstract

La présente invention se rapporte à des informations de synchronisation de la couche E pour système de transport de données multimédia MPEG (MMT). Un modèle de synchronisation de la couche E du système MMT doit pouvoir fournir efficacement des informations de synchronisation de base requises pour synchroniser le temps d'affichage de données multimédia et les supports. De même, les données générées par la couche E du système MMT doivent pouvoir être transmises par un RTP, qui est un protocole de transport de couche-application existant. Le procédé de l'invention permet ainsi d'élaborer les informations de synchronisation applicables au modèle de synchronisation de la couche E du MMT, et de préserver en même temps la compatibilité avec une technologie de transport de données multimédia MPEG existante.
PCT/KR2012/007617 2011-09-23 2012-09-21 Appareil et procédé pour transmettre des données multimédia pour système mmt, et appareil et procédé pour recevoir des données multimédia WO2013042998A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR20110096492 2011-09-23
KR10-2011-0096492 2011-09-23
KR1020120105350A KR20130032843A (ko) 2011-09-23 2012-09-21 Ｍｍｔ 시스템을 위한 미디어 데이터 전송 장치 및 방법, 그리고 미디어 데이터 수신 장치 및 방법
KR10-2012-0105350 2012-09-21

Publications (1)

Publication Number Publication Date
WO2013042998A1 true WO2013042998A1 (fr) 2013-03-28

Family

ID=47914637

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2012/007617 WO2013042998A1 (fr) 2011-09-23 2012-09-21 Appareil et procédé pour transmettre des données multimédia pour système mmt, et appareil et procédé pour recevoir des données multimédia

Country Status (1)

Country Link
WO (1) WO2013042998A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016148547A1 (fr) * 2015-03-19 2016-09-22 엘지전자 주식회사 Dispositif d'émission de signal de diffusion, dispositif de réception de signal de diffusion, procédé d'émission de signal de diffusion et procédé de réception de signal de diffusion

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001320413A (ja) * 2000-05-02 2001-11-16 Sony Corp データ送信装置及び方法
JP2003037623A (ja) * 2001-07-23 2003-02-07 Philips Japan Ltd Ｍｐｅｇネットワーク上におけるダイレクトｒｔｐ伝送方法及びシステム
KR100762718B1 (ko) * 1999-04-20 2007-10-09 코닌클리케 필립스 일렉트로닉스 엔.브이. Ｍｐｅｇ-4 데이터 스트림들을 인터넷 네트워크에 적합시키는 전처리 방법
KR20100027136A (ko) * 2007-06-13 2010-03-10 톰슨 라이센싱 일정한 비트 속도를 지닌 스트림의 전송 시스템 및 방법

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100762718B1 (ko) * 1999-04-20 2007-10-09 코닌클리케 필립스 일렉트로닉스 엔.브이. Ｍｐｅｇ-4 데이터 스트림들을 인터넷 네트워크에 적합시키는 전처리 방법
JP2001320413A (ja) * 2000-05-02 2001-11-16 Sony Corp データ送信装置及び方法
JP2003037623A (ja) * 2001-07-23 2003-02-07 Philips Japan Ltd Ｍｐｅｇネットワーク上におけるダイレクトｒｔｐ伝送方法及びシステム
KR20100027136A (ko) * 2007-06-13 2010-03-10 톰슨 라이센싱 일정한 비트 속도를 지닌 스트림의 전송 시스템 및 방법

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016148547A1 (fr) * 2015-03-19 2016-09-22 엘지전자 주식회사 Dispositif d'émission de signal de diffusion, dispositif de réception de signal de diffusion, procédé d'émission de signal de diffusion et procédé de réception de signal de diffusion
US10009639B2 (en) 2015-03-19 2018-06-26 Lg Electronics Inc. Apparatus for transmitting broadcast signal, apparatus for receiving broadcast signal, method for transmitting broadcast signal and method for receiving broadcast signal
US10362345B2 (en) 2015-03-19 2019-07-23 Lg Electronics Inc. Apparatus for transmitting broadcast signal, apparatus for receiving broadcast signal, method for transmitting broadcast signal and method for receiving broadcast signal

Similar Documents

Publication Publication Date Title
KR102049907B1 (ko) Ｍｍｔ 시스템을 위한 미디어 데이터 전송 장치 및 방법, 그리고 미디어 데이터 수신 장치 및 방법
WO2013019042A1 (fr) Appareil et procédé d'émission et appareil et procédé de réception permettant de fournir un service 3d par le biais d'une liaison avec une image de référence émise en temps réel ainsi qu'avec une image et un contenu supplémentaires émis séparément
WO2012128563A2 (fr) Dispositif et procédé d'émission/réception de contenu radiodiffusé lié grâce à un réseau hétérogène
WO2014171806A1 (fr) Procédé et appareil pour transmettre des données multimédias dans un système de transport multimédia
WO2012173389A2 (fr) Procédé et appareil pour transmettre et recevoir un contenu multimédia dans un système multimédia
US20150181003A1 (en) Method and apparatus for transmitting and receiving packets in hybrid transmission service of mmt
WO2012125001A2 (fr) Procédé et appareil de configuration de contenu dans un système de radiodiffusion
KR20130078643A (ko) Ｍｍｔ 복합 전달 서비스에서 ｍｍｔ 패킷 스트림 동기화를 위한 ｍｍｔ 제어 계층 시그널링을 이용한 타이밍 정보 제공 방법 및 ｍｍｔ 패킷 스트림 동기화 방법
WO2012121572A2 (fr) Procédé et dispositif d'émission pour transmettre un service de radiodiffusion stéréoscopique lié à un programme, et procédé et dispositif de réception pour celui-ci
WO2013112027A1 (fr) Procédé d'estimation de gigue de réseau dans un appareil de transmission de données multimédia codées
WO2014058276A1 (fr) Appareil et procédé de transmission et de réception de données multimédias dans un réseau hybride
WO2012121571A2 (fr) Procédé et dispositif d'émission / réception d'un service de radiodiffusion stéréoscopique en temps différé
KR20130009670A (ko) 엠엠티 시스템에서의 패킷 전송 장치 및 방법, 및 패킷 수신 장치 및 방법
WO2012081902A2 (fr) Procédé et système de transmission de données asynchrones et isochrones sur un réseau vidéo à grande vitesse
US20100172374A1 (en) System and method for transport of a constant bit rate stream
WO2015105375A1 (fr) Procédé et appareil d'émission et de réception de données multimédias dans un système multimédia
WO2014010830A1 (fr) Procédé et appareil de transmission et de réception de paquets dans un service de transmission hybride de mmt
WO2013042998A1 (fr) Appareil et procédé pour transmettre des données multimédia pour système mmt, et appareil et procédé pour recevoir des données multimédia
WO2013042999A1 (fr) Procédé et appareil pour transmettre des données multimédia pour système mmt, et appareil et procédé pour recevoir des données multimédia
WO2016043432A1 (fr) Procédé et appareil permettant de transmettre ou de recevoir un contenu multimédia
WO2013009131A2 (fr) Dispositif et procédé d'émission de paquets et dispositif et procédé de réception de paquets dans un système mmt
WO2013055168A1 (fr) Procédé de transmission de données multimédias reliées à des informations de composition et des informations de caractéristiques de transmission par un réseau ip hétérogène
WO2014014305A1 (fr) Procédé et appareil pour réaliser sélectivement un classement d'erreurs de paquet de flux de paquets multiples multiplexés sur le même port
WO2013109094A1 (fr) Procédé de transmission de données multimédia ayant une unité d'accès divisée en unités de fragments multimédia dans un réseau hétérogène
WO2011132973A2 (fr) Procédé et appareil de transmission et de réception d'informations de découverte de service dans un système de transmission multimédia et structure de fichier pour ceux-ci

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12834262

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12834262

Country of ref document: EP

Kind code of ref document: A1