KR102098723B1 - Method configuring and transmitting mmt transport packet - Google Patents

Abstract

Disclosed herein is a structure and method of setting an MMT transport packet that transmits an MMT payload format. This specification includes the at least one MMT payload format unit and sets the MMT transport packet to include a sequence number field for a packet stream, wherein the sequence number field is consistent with the sequence number field included in the MMT payload format. (consistency) is maintained. According to the present invention, the packet sequence number is provided in the MMT transmission, and when the MMT payload format is used over the RTP and the MMT payload format is used over the MMT transport packet, it can simultaneously support the general sequence numbering scheme for the packet stream. have.

Description

METHOD CONFIGURING AND TRANSMITTING MMT TRANSPORT PACKET}

The present invention relates to an MMT (MPEG Media Transport) transport packet, and more particularly, to a method and apparatus for setting or transmitting an MMT transport packet.

The conventional media fragment header is a part that the media encoder accesses and processes (access / processing) rather than a part that is processed by the system, so it is difficult to implement when there is a complicated structure, and there is a problem of deteriorating availability.

Korean Registered Patent "Video Data Encoding System and Decoding System" (Registration No. 0965881, Cited Invention 1) discloses a video data encoding system and a decoding system. A video data encoding apparatus according to Cited Invention 1 includes: a first encoding unit that encodes input video data according to a predetermined syntax to generate a first bitstream; A second encoding unit encoding a second video stream by encoding input video data according to a syntax different from the predetermined syntax; And receiving the first bitstream or the second bitstream, and including header information including syntax type information indicating which syntax is encoded according to which syntax, in the first bitstream or the second bitstream. It includes a header information generating unit. According to Cited Invention 1, image data may be independently encoded / decoded according to different encoding methods, and scalable encoding / scalable decoding may be performed using different encoding methods together. Cited invention 1 has a problem that includes type information of a data stream, layer type information, and scalability type information, but does not include information about random access and AU.

In addition, the US registered patent "MOVING PICTURE DECODING DEVICE, SEMICONDUCTOR DEVICE, VIDEO DEVICE, AND MOVING PICTURE DECODING METHOD" (Pub. Published U.S. Patent "Advance macro-block entropy coding for advanced video standard" (Publication No. 2008-0260041, Cited Invention 3) for a device that encodes a device, but has random access-related information and AU without being dependent on a specific media or codec. There is still a need for a method of transmitting and receiving relevant information.

An object of the present invention is to provide an MMT transport packet structure of a new structure and a method and apparatus for setting the structure.

According to an aspect of the present invention, the process of setting an MMT transport packet that transmits an MMT payload format includes at least one MMT payload format unit, and includes the MMT transport packet to include a sequence number field for a packet stream. Set, the sequence number field is characterized in that consistency is maintained with the sequence number field included in the MMT payload format.

The MMT payload format may include fields related to sequence numbers supported in RTP packets.

A PTS-equivalent (Presentation Time stamp-equivalent) function may be provided through an E-layer function.

It may be an M-unit that is provided with the E-layer function.

The MMT payload format may aggregate or fragment units in units of MTU.

According to another aspect of the present invention, a method of transmitting an MMT transport packet that transmits an MMT payload format includes at least one MMT payload format unit and sets the MMT transport packet to include a sequence number field for a packet stream. To do; And transmitting the set MMT transport packet, wherein the sequence number field may maintain consistency with the sequence number field included in the MMT payload format.

The MMT payload format may include fields related to sequence numbers supported in RTP packets.

A PTS-equivalent (Presentation Time stamp-equivalent) function may be provided through an E-layer function.

It may be an M-unit that is provided with the E-layer function.

The MMT payload format may aggregate or fragment units in units of MTU.

According to another aspect of the present invention, the MMT transport packet includes a header unit and at least one media fragment unit (MFU), the MFU includes at least one MMT payload format unit, and the header unit is configured for a packet stream. It includes a sequence number field, and the sequence number field may be maintained in consistency with the sequence number field included in the MMT payload format.

The MMT payload format may include fields related to sequence numbers supported in RTP packets.

A PTS-equivalent (Presentation Time stamp-equivalent) function may be provided through an E-layer function.

It may be an M-unit that is provided with the E-layer function.

The MMT payload format may aggregate or fragment units in units of MTU.

According to the present invention, the packet sequence number is provided in the MMT transmission, and when the MMT payload format is used over the RTP and the MMT payload format is used over the MMT transport packet, it can simultaneously support the general sequence numbering scheme for the packet stream. have.

1 is a conceptual diagram showing an MMT hierarchy.
2 is a conceptual diagram illustrating a format of unit information (or data or packets) used for each layer of the MMT layer structure.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains may easily practice. However, the present invention can be implemented in many different forms and is not limited to the embodiments disclosed below. In addition, in order to clearly disclose the present invention in the drawings, parts not related to the present invention are omitted, and the same or similar reference numerals in the drawings indicate the same or similar components.

Hereinafter, the meaning of the term is defined as follows.

A content component or a media component is defined as a media of a single type or a subset of the media of a single type, for example , Video tracks, movie subtitles, or video enhancement layers of video.

Content is defined as a set of content components, and may be, for example, a movie or a song.

Presentation is defined as an operation performed by one or more devices to allow a user to experience (for example, watch a movie) a content component or a service.

A service is defined as one or more content components transmitted for presentation or storage.

Service information is defined as metadata describing one service, characteristics and components of the service.

The access unit (AU) is the smallest data entity and may have time information as an attribute.

If encoded media data for which time information for decoding and presentation is not specified is related, AU is not defined.

An MMT asset is a logical data entity composed of at least one MPU with the same MMT asset ID or a specific data chunk with a format defined in another standard. The MMT asset is the largest data unit to which the same composition information and transmission characteristics are applied.

MMT Asset Delivery Characteristics (MMT-ADC) is a description related to QoS requirements for transmitting MMT assets. MMT-ADC is expressed in a way that a specific transmission environment is unknown.

MMT Composition Information (MMT CI) describes spatial and temporal relationships between MMT assets.

The Media Fragment Unit (MFU) is a general container, which is independent of any specific codec and accommodates encoded media data that can be consumed independently by a media decoder. It accommodates information that can be used in the transport layer with a size equal to or smaller than the access unit (AU).

MMT Package (MMT Package) is a collection of logically structured data, and is composed of at least one MMT asset, MMT-composition information, MMT-asset transmission characteristics, and descriptive information.

MMT packet is a format of data generated or consumed by the MMT protocol.

The MMT payload format is a format for payload of an MMT package or an MMT signaling message to be delivered by an MMT protocol or an Internet application layer protocol (eg, RTP).

The MMT Processing Unit (MMT Processing Unit) is a general container independent of any specific media codec and accommodates information related to at least one AU and additional transmission and consumption. For non-temporal data, the MPU accepts portions of data that are not in the AU range. MPU is coded media data that can be processed completely and independently. Processing in this context means encapsulation or packetization into MMT packages for transmission.

Non-timed data defines all data elements consumed without specifying time. Non-timed data can have a time range over which the data can be executed or started.

Timed data defines data elements associated with a particular time to be decoded and presented.

1 is a conceptual diagram showing an MMT hierarchy.

Referring to FIG. 1, the MMT layer includes an encapsulation layer, a delivery layer, and an S layer. The MMT layer operates on a transport layer.

The encapsulation layer (E-layer) may be responsible for functions such as packetization, fragmentation, synchronization, and multiplexing of transmitted media, for example.

The encapsulation functional area defines the logical structure of the media content, the MMT package, and the format of the data units to be processed by the MMT compliant entity. In order to provide essential information for adaptive transmission, the MMT package specifies components including media content and relationships between them. The format of the data units is defined to encapsulate the encoded media to be stored or transmitted as a payload of the transport protocol, and to be easily converted between them.

The encapsulation layer (E-layer), as shown in Figure 1, MMT E.1 layer (MMT E.1 Layer), MMT E.2 layer (MMT E.2 Layer) and MMT E.3 layer (MMT E.3 Layer).

The E.3 layer encapsulates a Media Fragment Unit (MFU) provided from the Media Codec (A) layer to generate a Media Processing Unit (MPU).

The encoded media data from the upper layer is encapsulated in MFU. The type and value of the encoded media can be abstracted so that the MFU can be generally used for a specific codec technology. This allows the lower layer to process the MFU without accessing the encapsulated coded media. The lower layer fetches the required encoded media data from a network or storage buffer and sends it to the media decoder. The MFU has sufficient information media part units to perform the above operation.

The MFU can have a format, independent of any particular codec, that can carry data units that can be consumed independently at the media decoder. The MFU can be, for example, a picture or slice of a video.

One or a group of multiple MFUs that can be independently transmitted and decoded generate MPUs. Independently transportable and executable non-temporal media also creates an MPU. The MPU describes the internal structure, such as the arrangement and pattern of the MFU, which enables fast access to the MFU and partial consumption.

The E.2 layer encapsulates the MPU generated in the E.3 layer to generate an MMT asset.

The MMT asset is a data entity composed of one or more MPUs from a single data source, and is a data unit in which composition information (CI) and transport characteristics (TC) are defined, and the MMT pay Multiplexed by load format and transmitted by MMT protocol. The MMT asset can correspond to packetized elementary streams (PES), for example, video, audio, program information, MPEG-U widget, JPEG image, MPEG 4 file format, M2TS (MPEG transport stream).

The E.1 layer creates an MMT package by encapsulating the MMT asset generated in the E.2 layer.

The MMT asset is packaged with MMT composition information (MMT-composition information) for future response of the same user experience together with or separately from other functional areas-the transmission area and the signal area. The MMT package is also packaged with a transmission characteristic that selects an appropriate transmission method for each MMT asset to meet the tangible quality of the MMT asset.

The MMT package may be composed of one or more MMT assets together with additional information such as composition information and transport characteristics. Composition information includes information on relations between MMT assets, and when one content consists of a plurality of MMT packages, to indicate relations between a plurality of MMT packages It may further include information. Transport characteristics may include transport characteristic information required to determine a delivery condition of an MMT asset or an MMT packet, for example, a traffic description parameter and a QoS descriptor ). The MMT package may correspond to a program of MPEG-2 TS.

The delivery layer may perform, for example, network flow multiplexing, network packetization, and QoS control of media transmitted through a network.

The delivery functional area defines the application layer protocol and format of the payload. In the present invention, the application layer protocol provides enhanced features for the delivery of the MMT package compared to the conventional application layer protocol for transmission of multimedia including multiplexing. The payload format is defined to carry encoded media data regardless of media type or encoding method.

The delivery layer (D-layer), as shown in Figure 1, MMT D.1 layer (MMT D.1 Layer), MMT D.2 layer (MMT D.2 Layer) and MMT D.3 layer (MMT D.3 Layer).

The D.1 layer (D.1-layer) receives the MMT package generated in the E.1 layer and generates an MMT Payload format. The MMT payload format is a payload format for transmitting MMT assets and transmitting information for consumption by other existing application transport protocols such as MMT application protocol or RTP. The MMT payload may include fragments of MFU along with information such as AL-FEC.

The D.2 layer (D.2-layer) receives the MMT payload format generated in the D.1 layer and generates an MMT Transport Packet (MMT Transport Packet) or an MMT Packet (MMT Packet). The MMT transport packet or MMT packet is a data format used in an application transport protocol for MMT.

The D.3 layer supports QoS by providing a function to exchange information between layers by a cross-layer design. For example, the D.3 layer may perform QoS control using QoS parameters of the MAC / PHY layer.

The S layer (S layer) performs a signaling function (signaling function). For example, signaling functions for session initialization / control / management of transmitted media, server-based and / or client-based trick modes, service discovery, synchronization, etc. Can be done.

The signaling functional area defines the format of messages that manage the delivery and consumption of MMT packages. The message for consumption management is used to transmit the structure of the MMT package, and the message for delivery management is used to transmit the structure of the payload format and the structure of the protocol.

S layer (S layer), as shown in Figure 1, MMT S.1 layer (MMT S.1 Layer) and may be composed of MMT S.2 layer (MMT S.2 Layer).

The S.1 layer is service discovery, media session initialization / termination of media, media session presentation / control, delivery (D) layer and encapsulation (E) Interface functions with layers can be performed. The S.1 layer may define the format of control messages between applications for media presentation session management.

The S.2 layer is flow control, delivery session management, delivery session monitoring, error control, and hybrid network synchronization control. A format of a control message exchanged between delivery end-points of a D-layer may be defined.

In order to support the operation of the delivery layer, the S.2 layer provides delivery session establishment and release, delivery session monitoring, flow control, error control, resource reservation for the set delivery session, and synchronization in a complex delivery environment. Signaling, and signaling for adaptive delivery. Signaling required between a sender and a receiver may be provided. That is, the S.2 layer may provide necessary signaling between a sender and a receiver to support the operation of the transport layer as described above. In addition, the S.2 layer may be responsible for the interface function with the delivery layer and the encapsulation layer.

FIG. 2 shows the format of unit information (or data or packet) used for each layer of the MMT layer structure of FIG. 1.

The Media Fragment Unit (MFU) 130 may be composed of coded media fragment data (132) and a Media Fragment Unit Header (MFUH) 134. The media fragment unit 130 has a general container format independently of a specific codec and may load the smallest data unit that can be consumed independently by the media decoder. The MFUH 134 may include additional information such as media characteristics-for example, loss-tolerance. The MFU 130 may be, for example, a picture or slice of a video.

The Media Fragment Unit (MFU) may define a format that encapsulates a portion of an AU in a transport layer in order to perform adaptive transmission in the range of MFU. The MFU can be used to transmit a certain format of encoded media so that parts of the AU can be independently decoded or discarded.

The MFU has an identifier for distinguishing one MFU from other MFUs, and may have general relationship information between MFUs within a single AU. The dependency relationship between MFUs in a single AU is described, and the relative priority of the MFUs can be described as part of such information. The above information can be used to handle transmission in the lower transport layer. For example, the transport layer may omit the transmission of MFUs that may be discarded, to support QoS transmission in insufficient bandwidth. Detailed description of the MFU structure will be described later.

The MPU is a set of media fragment units including a plurality of media fragment units 130. The MPU may have a general container format independently of a specific codec and may include media data equivalent to an access unit. The MPU may have a timed data unit or a non-timed data unit.

The MPU is data that has been independently and completely processed by an individual following the MMT, and the processing can include encapsulation and packetization. The MPU may have a portion of data composed of at least one MFU or having a format defined by other standards.

A single MPU can accommodate at least one AU's integral number or non-time data. For time data, an AU may be delivered from at least one MFU, but one AU cannot be divided into multiple MPUs. In non-time data, one MPU accommodates a portion of non-time data that has been independently and completely processed by an MMT compliant entity.

The MPU can be uniquely identified in the MMT package with a sequence number and an associated asset ID that distinguishes it from other MPUs.

The MPU may have at least one random access point. The first byte of the MPU payload can always start with a random access point. In time data, this fact means that the decoding order of the first MFU in the MPU payload is always zero. In the time data, the presentation period and decoding order of each AU can be sent to inform the presentation time. The MPU does not have its own initial presentation time, and the presentation time of the first AU of one MPU may be described in composition information. The composition information may specify the first presentation time of the MPU. Details will be described later.

The MMT asset 150 is a set of MPUs composed of a plurality of MPUs. The MMT asset 150 is a data entity composed of a plurality of MPUs (timed or non-timed data) from a single data source, and the MMT asset information 152 is asset packaging metadata (Asset packaging metadata) and data types. The MMT asset 150 includes, for example, video, audio, program information, MPEG-U widget, JPEG image, MPEG 4 file format (FF), packetized elementary streams (PES), and MPEG transport (M2TS). stream).

The MMT asset is a logical data entity that accommodates encoded media data. The MMT asset may consist of an MMT asset header and encoded media data. The encoded media data may be a collective reference group of MPUs with the same MMT asset ID. Data of a type that can be individually consumed by an entity directly connected to the MMT client may be considered as a separate MMT asset. Examples of data types that can be considered as individual MMT assets include MPEG-2 TS, PES, MP4 file, MPEG-U Widget Package, and JPEG file.

The encoded media of the MMT asset can be time data or non-time data. Time data is audio-visual media data that requires synchronized decoding and presentation of specific data at a specified time. Non-time data is data of a data type that can be decoded and provided at any time according to service provision or user interaction.

A service provider may integrate MMT assets and place MMT assets on a space-time axis to generate multimedia services.

The MMT package 160 is a set of MMT assets including one or more MMT assets 150. MMT assets in an MMT package can be multiplexed or concatenated like a chain.

The MMT package is a container format for MMT asset and configuration information. The MMT package provides a storage of MMT asset and configuration information for the MMT program.

The MMT program provider generates configuration information by encapsulating coded data into MMT assets and describing the temporal and spatial layout of the MMT assets and their transmission characteristics. MU and MMT assets can be transmitted directly in D.1 payload format. Configuration information may be transmitted by a C.1 presentation session management message. However, MMT program providers and clients that allow relay of the MMT program or later reuse, store it in the MMT package format.

In parsing the MMT package, the MMT program provider determines which transmission path (eg, broadcast or broadband) the MMT asset will provide to the client. The configuration information in the MMT package is transmitted as a C.1 presentation session management message along with transmission related information.

By receiving the C.1 presentation session management message, the client knows which MMT program is possible and how to receive the MMT asset for the corresponding MMT program.

The MMT package can also be transmitted by the D.1 payload format. The MMT package is packetized and delivered in the D.1 payload format. The client receives the packetized MMT package and configures all or part of it, where it consumes the MMT program.

The package information 165 of the MMT package 160 may include configuration information. Configuration information may include additional information such as a list of MMT assets, package identification information, composition information 162, and transport characteristics 164. The composition information (composition information) 162 includes information on the relationship between the MMT assets 150 (relationship).

In addition, the composition information (composition information) 162 may further include information for indicating a relationship (relationship) between a plurality of MMT packages when one content is composed of a plurality of MMT packages. The composition information 162 may include information about temporal, spatial, and adaptive relationships in the MMT package.

Composition information in MMT provides information on spatial and temporal relationships between MMT assets in the MMT package, such as information to help the transmission and presentation of the MMT package.

MMT-CI is a descriptive language that extends HTML5 to provide such information. If HTML5 was designed to describe page-based presentation of text-based content, MMT-CI mainly expresses the spatial relationship between sources. In order to support the expression indicating the temporal relationship between MMT assets, information related to MMT assets in the MMT package, such as presentation resources, time information to determine the order of transmission and consumption of MMT assets, and HTML5 consumes various MMT assets Can be extended to have additional attributes of media elements. Details will be described later.

The transport characteristics information 164 includes information on transport characteristics, and may provide information necessary to determine a delivery condition of each MMT asset (or MMT packet). The transmission characteristic information may include a traffic description parameter and a QoS descriptor.

The traffic description parameter may include bit rate information, priority information, etc. for the media fragment unit (MFU) 130 or MPU. Bit rate information includes, for example, information on whether an MMT asset is a variable bit rate (VBR) or a constant bit rate (CBR), a guaranteed bit rate for a media fragment unit (MFU) (or MPU) (guaranteed bit rate) ), The maximum bit rate for a media fragment unit (MFU) (or MPU). The traffic description parameter may be used for resource reservation between servers, clients, and other components on a delivery path, for example, maximum size information of a media fragment unit (MFU) (or MPU) in an MMT asset. It may include. The traffic description parameter may be updated periodically or aperiodically.

The QoS descriptor includes information for QoS control, and may include, for example, delay information and loss information. The loss information may include, for example, a loss indicator as to whether delivery loss of the MMT asset is allowed or not. For example, if the loss indicator is '1', it may indicate 'lossless', and if it is '0', it may indicate 'lossy'. Delay (delay) information may include a delay indicator (delay indicator) used to distinguish the sensitivity of the transmission delay of the MMT asset. The delay indicator may indicate whether the type of the MMT asset is conversation, interactive, real time, and non-realtime.

One content may consist of one MMT package. Alternatively, one content may consist of a plurality of MMT packages.

When one content is composed of a plurality of MMT packages, composition information or composition information indicating temporal, spatial, and adaptive relationship between the plurality of MMT packages ( configuration information) may exist inside one of the MMT packages or outside the MMT package.

For example, in the case of hybrid delivery, some of the content components are transmitted through a broadcast network and the rest of the content components are transmitted through a broadband network. Can be. For example, in the case of a plurality of AV streams (audiovisual streams) constituting one multi-view service, one stream may be transmitted to a broadcasting network and the other stream may be transmitted to a broadband network, and each AV stream is multiplexed and transmitted to a client terminal. It can be received and stored individually. Or, for example, an application software such as a widget may be transmitted over a broadband network, and an AV stream (AV program) may be delivered to an existing broadcasting network.

In the case of the multi-view service scenario and / or widget scenario described above, the entire plurality of AV streams may be in one MMT package, and in this case, one of the plurality of streams may be stored in only one client terminal. Storage content becomes a part of the MMT package, and the client terminal needs to re-record composition information or configuration information, and the re-recorded content becomes a new MMT package independent of the server. .

In the multi-view service scenario and / or widget scenario as described above, each AV stream may be a single MMT package, and in this case, a plurality of MMT packages constitute one content, and storage (storage) is recorded in units of MMT packages, and composition information or configuration information indicating relationships between MMT packages is required.

Composition information or configuration information included in one MMT package may refer to an MMT asset in another MMT package, and may also refer to the outside of an MMT package that refers to an MMT package in an out-band situation. I can express it.

Meanwhile, in order to inform the client terminal of a list of MMT assets 160 provided by a service provider and a possible path for delivery of the MMT package 160, the MMT package 160 is controlled through a control (C) layer. Translated into service discovery information, the MMT control message may include an information table for service discovery.

The server that divides the multimedia content into a plurality of segments allocates URL information to a plurality of segments divided into a predetermined number, and stores the URL information for each segment in a media information file and transmits it to the client.

The media information file may be referred to by various names such as 'Media Presentation Technology (MPD)' or 'Manifest file' according to a standardization organization that standardizes HTTP streaming. Hereinafter, the media information file is referred to and described as a media expression technology (MPD).

Hereinafter, a cross-layer interface will be described.

The Cross Layer Interface (CLI) exchanges QoS-related information between the application layer and lower layers including the MAC / PHY layer, providing a means for supporting QoS in a single entity. The lower layer provides bottom-up QoS information such as network channel status, while the application layer provides information related to media characteristics as top-down QoS information.

The cross-layer interface provides an integrated interface between the application layer and various network layers including IEE802.11 WiFi, IEEE 802.16 WiMAX, 3G, 4G LTE, and the like. Common network parameters of popular network standards are excerpted as NAM parameters for static and dynamic QoS control of real-time media applications across various networks. The NAM parameter may include a bit error rate BER value. BER can be measured at the PHY or MAC layer. NAM also provides identification of the underlying network, possible bit rates, buffer status, peak bit rates, service unit size and service data unit loss rates.

Two different methods can be used to provide NAM. The first method is to provide absolute values. And the second way is to provide relative values. The second method can be used to update the NAM while connecting.

The application layer provides top-down QoS information related to media characteristics for the lower layer. There are two types of top-down information, such as MMT asset level information and packet level information. MMT asset information is used for capacity exchange and / or resource (re) allocation at a lower layer. The packet level top down information is recorded in the appropriate field of all packets for the lower layer to identify the supported QoS level.

The lower layer provides bottom-up QoS information to the application layer. The lower layer provides information related to network conditions that change over time, enabling faster and more accurate QoS control at the application layer. Bottom-up information is expressed in abstract form to support heterogeneous network environments. These parameters are measured at the lower layer, and are read at the application layer periodically or at the request of the MMT application.

The MMT Transport Packet (MMT Transport Packet) is responsible for an application layer for transmitting an MMT Payload Format (MMT Payload Format) through a transport protocol of an Internet Protocol (IP) network. Hereinafter, the structure of the MMT transport packet according to the present invention will be described.

For example, according to the present invention, one MMT transport packet may include one MMT payload format (or MMT payload format unit). Aggregation or fragmentation of units according to MTU (MMT Transport Unit) units may be performed in the MMT payload format layer.

As another example, according to the present invention, the MMT transport packet may accept an operation that is commonly applicable to an existing Realtime Transport Protocol (RTP) payload format.

The MMT payload format can be used as an RTP payload format over RTP, and at the same time, can be used over MMT transport packets. In the IP packet stream, a sequence number for a packet sequence such as error checking or recovery is required. The RTP packet may support a sequence number field for the sequence number. In addition, when the MMT payload format is used on the RTP, the sequence number of the RTP may be utilized. In addition, even if the MMT payload format is used over the MMT transport packet, in order to maintain consistency with the MMT payload format used over the RTP, the MMT transport packet is a general sequence number for a packet stream. It may have a field (general sequence number field).

Table 1 below shows an example of an MMT transport packet. The components of the following Table 1 are not limited to the order, and the components are not exclusive, and further include other components, or one or more components may be deleted.

Here, sequence_no represents the sequence number of the packet stream, and increases by 1 per packet.

As RTP is used on the User Datagram Protocol (UDP) layer, the two largest functions provided for media streaming are packet sequence number and timestamp. Here, the time stamp provides a PTS-equivalent (Presentation Time Stamp-equivalent) function, and in the MMT, the PTS can be provided in an E-layer function, specifically an M-unit. have.

Therefore, according to the present invention, the packet sequence number is provided in the MMT transmission, and when the MMT payload format is used over the RTP and the MMT payload format is used over the MMT transport packet, it can simultaneously support the general sequence numbering scheme for the packet stream. You can.

In the exemplary system described above, the methods are described based on a flow chart as a series of steps or blocks, but the present invention is not limited to the order of steps, and some steps may occur in a different order than the steps described above or simultaneously. You can. In addition, those skilled in the art will understand that the steps shown in the flowcharts are not exclusive, other steps may be included, or one or more steps in the flowchart may be deleted without affecting the scope of the present invention.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and variations without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the claims below, and all technical spirits within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

Claims (20)

A packet generating apparatus for packetizing and transmitting media data,
An encapsulation unit that encapsulates a media fragment unit to generate a media processing unit, and generates an asset based on the media processing unit; And
A packetization unit for generating a packet by packetizing the media processing unit included in the asset,
The asset is a group of media processing units including an asset header and encoded media data, and having the same asset ID (Identification) for the encoded media data. Packet generation device to say. According to claim 1,
The packetization unit generates a packet by including a sequence number field for counting a transmitted packet. According to claim 2,
The sequence number field is a packet generating device included in the header of the packet. According to claim 2,
The value of the sequence number field is a packet generating apparatus characterized in that it is increased by 1 for each transmitted packet. According to claim 1,
A packet generating apparatus characterized in that the predetermined data unit in the packet is packetized in a predetermined transmission unit size. The method of claim 5,
The predetermined data unit includes a media processing unit. According to claim 2,
The sequence number field is a packet generation apparatus characterized in that the consistency (consistency) is maintained with the sequence number field included in the payload format (payload format) in the packet. According to claim 1,
A packet generation device characterized in that a PTS-equivalent (Presentation Time stamp-equivalent) function is provided through an E-layer function. The method of claim 8,
The E-layer function is provided, a packet generating apparatus, characterized in that the media processing unit. According to claim 1,
The media processing unit is a packet generating apparatus in a container format independent of a specific codec. In the packet generation method for packetizing and transmitting media data,
Generating a media processing unit by encapsulating a media fragment unit, and generating an asset based on the media processing unit; And
Packetizing the media processing unit included in the asset to generate a packet,
The asset is a group of media processing units including an asset header and encoded media data, and having the same asset ID (Identification) for the encoded media data. Packet generation method to say. The method of claim 11,
Generating the packet,
And generating the packet by including a sequence number field for counting transmitted packets. The method of claim 12,
The sequence number field is a packet generation method, characterized in that included in the header of the packet. The method of claim 12,
The value of the sequence number field is a packet generation method characterized in that it is increased by 1 per transmitted packet. The method of claim 11,
The packet generation method, characterized in that the predetermined data unit in the packet is packetized in a predetermined transmission unit (MTU) size. The method of claim 15,
The predetermined data unit includes a media processing unit. The method of claim 12,
The sequence number field is a packet generation method characterized in that consistency is maintained with a sequence number field included in a payload format in a packet. The method of claim 11,
A packet generation method characterized in that a PTS-equivalent (Presentation Time stamp-equivalent) function is provided through an E-layer function. The method of claim 18,
The E-layer function is provided is a packet processing method, characterized in that the media processing unit. The method of claim 11,
Wherein the media processing unit is a container format independent of a particular codec.

Images