KR100976729B1 - Combined file format for digital multimedia broadcasting dmb content, method and apparatus for handling dmb content of this format - Google Patents

Abstract

The present invention allows the user to automatically filter and store desired content and to watch the content when desired, and to integrate files of digital multimedia broadcasting (DMB) content to increase the usability of the content through content sharing and exchange. Formats and methods and apparatus for handling DMB content in such integrated file formats. The file format of the DMB broadcast content of the present invention includes DMB AV content including video data and audio data, metadata about the content of the DMB AV content, metadata about the protection and management of the DMB AV content, Include additional data that can be represented with the DMB AV content in one unified file.

Description

DMB CONTENT, METHOD AND APPARATUS FOR HANDLING DMB CONTENT OF THIS FORMAT}

The present invention relates to an integrated file format of digital multimedia broadcasting (DMB) content, and to a method and apparatus for handling DMB content in such an integrated file format. In particular, the user can automatically filter and store desired content. The integrated file format of Digital Multimedia Broadcasting (DMB) content, which enables content to be viewed at any time and increases the usability of the content through content sharing and exchange, and how to handle the DMB content in such integrated file format. Relates to a device.

The present invention is derived from research conducted as part of the IT Strategic Technology Development Project of the Ministry of Information and Communication and the Ministry of Information and Telecommunications Research and Development. Digital Multimedia Broadcasting Technology for Personalized Broadcasting).

Recently, as the Digital Multimedia Broadcasting (DMB) service is started, viewing DMB broadcasting through a mobile terminal (mobile phone, PDA, PMP, etc.) is becoming more common. DMB is the first mobile TV service based on a digital radio transmission system.It provides high quality video, high quality audio, and additional data to enable content consumption anytime and anywhere in user terminals such as mobile terminals and mobile phones that support mobility. to provide.

Since DMB is a broadcast service considering mobility, the content scheduling time is relatively shorter than that of the fixed broadcast service. Therefore, it is difficult to memorize DMB program programming information one by one and it is not easy to find through the terminal, so it is very difficult to watch the desired broadcasting content in accordance with the airing time.

In addition, the current DMB content is a volatile content and is provided in the form of a one-time service that is viewed once in real time on a mobile terminal. Due to the characteristics of the mobile terminal device, it is very difficult to store DMB contents and watch them at a desired time due to battery problems and limited data storage space. In addition, the type of DMB content currently provided is based on video and audio, and recently, additional data services (securities, weather information, etc.) using BIFS are being prepared for DMB data broadcasting.

Recently, however, user terminals have started to mount a memory having a mass storage capability (for example, 4 gigabytes of flash memory), and can also use a mass storage device connected to a network while connected to an HSDPA network or a Wibro network. The environment became. The development of DMB video compression technology in the future is expected to enable a technology capable of encoding at a lower bit rate while maintaining a similar image quality level compared to the current DMB video quality. It is expected that additional services that can be provided will emerge.

The MPEG Standards Group, meanwhile, is aiming to provide a standard-oriented, multimedia application standardization (MPEG-Applications: ISO / IEC 23000, MPEG-A) activity to provide standards in a form that is optimized for general and standardization. Actively in progress Existing general-purpose standardization took a long time to be completed as a complete standard, and some of the technologies were profiled and used within the standard. In addition, general-purpose standardization is not flexible to produce timely standards to meet market demands, and the amount of standards is too complicated or limited to provide various application services. The Multimedia Application Standardization (MPEG-A) deviates from this conventional method and combines only the standard standards necessary for a specific service purpose among the existing standards and standardizes them into one standard. The format standard for this is called a multimedia application format (MAF), and multimedia application format technologies applied to various application fields have been proposed. Here, we propose a Digital Multimedia Broadcasting (MAP) technology to support various consumption forms and to increase their utilization.

Therefore, the present invention, beyond the one-time consumption concept of watching the broadcast content on the DMB portable terminal, automatically filters the desired broadcast contents and stores them in the mobile terminal or automatically (reserved) in the remote storage device through a communication network to which the mobile terminal is connected. One purpose is to allow a user to watch DMB content when desired.

In addition, another object of the present invention is to make it possible to increase the utilization of broadcast content through content sharing and exchange between different terminal devices.

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention which are not mentioned above can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. It will also be readily apparent that the objects and advantages of the invention may be realized and attained by means of the instrumentalities and combinations particularly pointed out in the appended claims.

In order to achieve the above object, the present invention provides a file format for DMB content, comprising: DMB content including at least one of DMB video, DMB audio, and data, and detailed information metadata describing detailed information of the DMB content. And protection management metadata describing information on the protection and management of the DMB content in one file.

In addition, the present invention provides a file format for broadcast content, comprising: broadcast content including at least one of video, audio, and data, detailed information metadata describing detailed information of the broadcast content, and protection and management of the broadcast content. Another feature is that the protection management metadata, which describes the information about, can be integrated into a single file.

The present invention also provides a method for generating a DMB content file, comprising: generating metadata describing license information of a specific user for DMB content including at least one of DMB video, DMB audio, and data; Encrypting the DMB content, generating metadata describing the encryption related information, and integrating the DMB content, the license related metadata, and the encryption related metadata into a single file format. It is another feature to include a.

The present invention also provides DMB content including at least one of DMB video, DMB audio, and data, detailed information metadata describing detailed information of the DMB content, and protection describing information on protection and management of the DMB content. A method for reproducing DMB content in a file format that can integrate management metadata into a single file in a user terminal, the method comprising: searching or filtering desired DMB content through the detailed information metadata; Parsing content and parsing the protection management metadata to authenticate a user or a user terminal, extracting information necessary to decode the DMB content using the parsed protection management metadata; The detailed information metadata is parsed and transmitted through an interface of the user terminal. And presenting the contents of the existing DMB content, and extracting and decoding the corresponding content according to a content execution command from the user to perform playback.

The present invention also provides a method for remotely consuming DMB content used in conjunction with a DMB user terminal and a DMB content providing apparatus, the method comprising: receiving a DMB content file from the DMB content providing apparatus at the request of the user terminal; And storing the received DMB content file at the request of the user terminal and providing the stored DMB content file to the DMB user terminal at the request of the user terminal.

According to the present invention as described above, unlike the existing DMB broadcast content, by adding metadata to the DMB AV broadcast content, the desired broadcast content is automatically filtered and stored in the mobile terminal or stored remotely through a communication network to which the mobile terminal is connected. You can automatically (reserved) your device and watch the content when you want. In addition, according to the present invention it is possible to share and exchange the content between the terminals can increase the usability of the broadcast content.

The above objects, features, and advantages will be described in detail with reference to the accompanying drawings, whereby those skilled in the art to which the present invention pertains may easily implement the technical idea of the present invention. In describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 illustrates a relationship between a DMB MAF proposed in the present invention and another MPEG file format. Another MPEG file format is based on the ISO Base Media File Format. DMB MAF is derived from MPEG-4 AVC, 3GPP synchronous text format, MPEG-4 file format.

Table 1 describes the DMB service types according to the present invention, and Table 2 describes the content types for each service.

Figure 2 illustrates the components of a DMB MAF consisting of MPEG and non-MPEG standards. The DMB MAF includes the AV content of the current DMB service, a data service such as a broadcast website (BWS), and additional information shown in Table 3 as components.

As described in Table 1, the DMB MAF supports various service types such as terrestrial DMB (T-DMB) and satellite DMB (S-DMB). Individual DMB services support their main AV content and additional data. The specification of main AV content for terrestrial DMB services is described in ETSI TS 102 428. The satellite DMB service uses ISO / IEC 14496-10 AVC for video content and ISO / IEC 14496-3 MPEG-4 part 3 Audio: HE-AAC v2 for audio content. Content types supported for additional data such as BWS are described in ETSI TS 102 428, an extended version of ETSI TS 101 498-1 and 2.

The term “DMB content” herein refers to content consisting of at least one of DMB video, DMB audio, and data. "Detail metadata" is metadata describing detailed information of the DMB content, and is mainly represented by TV-Anytime metadata shown in Table 3. "Protection management metadata" is metadata describing information on protection and management of DMB contents, and is mainly represented by MPEG-21 IPMP and REL shown in Table 3. Among the auxiliary data shown in Table 2 and Table 3, except TV-Anytime metadata, MPEG-21 IPMP and REL are included in the data content. And "Content of the integrated file format" includes DMB content including at least one of DMB video, DMB audio, and data, detailed information metadata describing detailed information of the DMB content, and protection and management of the DMB content. DMB content having a file format capable of integrating protection management metadata describing information into one file according to the present invention.

Components of DMB MAF

The structure of the content according to the present invention follows the MPEG-21 DID. MPEG-21 DID (ISO / IEC 21000-2) describes a set of abstract terms and concepts to form a useful model for defining digital items (DI). In the MPEG-21 multimedia framework, digital items are the basic units with a standard representation, identification and metadata for distribution, and transactions. To declare digital items in a flexible and generic manner, MPEG-21 DID aims to standardize the technology for defining digital items and provides a basic structure of content representation for DMB storage and distribution scenarios.

The technique for generating and consuming content according to the present invention is made by TV-Anytime metadata. The metadata used to describe the content is obtained as a subset of the TV-Anytime metadata details available as ETSI TS 102 822-3. With these metadata details and some minor modifications, the content creation and consumption information is described in XML form.

TV-Anytime metadata is divided into two categories: face 1 metadata schema (ETSI TS 102 822-3-1) and face 2 metadata schema (ETSI TS 102 822-3-3). The Phase 1 metadata schema has a root element of TVAMainType and defines mainly program and user descriptions. The Face 2 metadata schema has a root element of ExtendedTVAMainType and extends the Face 1 schema to include various content types. An overview of the structure of the TV-Anytime schema is shown in FIG. An example of the use of TV-Anytime metadata will be described next.

The protection and management of the contents according to the present invention is achieved by MPEG-21 IPMP and REL. MPEG-21 Intellectual Property Management and Protection (IPMP) is a digital right management (DRM) structure developed by MPEG for secure and easy distribution between different user terminals and different content providers. The MPEG-21 IPMP component standard specifies which IPMP tools are required to protect specific portions of protected digital items, and that peers are required to manage each IPMP tool and to operate on the protected content. It provides a means to inform additional information. To support the use of protected and managed DMB content, the DMB MAF adopts some of the MPEG-21 IPMP elements.

ISO / IEC 21000-5 defines the right expression language (REL). The license governing the use of content in the DMB MAF is expressed according to the DAC profile of the MPEG-21 REL. Table 4 lists the profile elements defined in the REL DAC profile.

The 3GPP Timed Text format describes the standard behavior of text data for rendering. Synchronous text supports character and glyphs rendering, font support such as name / size / style, color support for text and background, text rendering location and composition, and more. These features can be used in a variety of applications on the user terminal, such as captions, karaoke, dynamic highlighting, and other visual annotations.

File structure

The file format of the DMB MAF can be expressed in two types of structures: single movie content and multiple movie content. The file format of this specification is derived from the ISO Base Media File Format Standard. The boxes used in this specification are based on a limited set of boxes selected from the ISO Base Media File Format and the MP4 File Format. Table 5 shows the structure of the adopted boxes and a description thereof. Required boxes are marked by an asterisk (*).

4 shows a single type file structure containing one movie representation. This type of file structure consists mainly of ftyp, moov and mdat boxes. A moov box describes a scene representation that contains one or more track boxes. The trak box contains the description for one media. The media in each track box can be interleaved AV, separate audio and video, BIFS, Table 2, and other data service content as shown in FIG. The trak box supports time information such as edtl and stbl boxes for synchronization with other media in other trak boxes. The mdat box may contain the actual content described in the trak box, or the content may be imported by the URL without placing the content in the mdat box. In FIG. 4, an asterisk (*) means a box essential in the file structure.

5 illustrates the primitive file structure of a single type file. As shown in Fig. 5, BIFS and IOD / OD information are not included in the file format if only the main audio and video are stored in the file.

6 shows another file structure of a single type file. As shown, BIFS, IOD and OD information is included along with the main AV data.

7 shows the file structure for a single type file using a meta box. This file contains additional data related to BIFS, such as captions, images, scripts, sync metadata, program code, and personal data, as shown in Tables 2 and 3. The meta box consists mainly of the iloc, iinf, ipro, and xml boxes. The iloc and iinf boxes contain item_ID, length and offset for searching for the item, and information such as item_ID, item_protection, item_name, content_type and content_encoding. The xml box can support asynchronous text or binary data such as MPEG-21 DID, IPMP and TV Anytime. MPEG-21 DID can support item description.

The iloc and iinf boxes describe the location and information of each item in the mdat box. However, the structure of an item in the iloc and iinf boxes has limitations in describing the item in detail. To support the flexibility of the file format, MPEG-21 DID may be used to describe the location and information of the items shown in FIG. MPEG-21 DID metadata may be stored in an xml box and may contain metadata, scripts and source code, such as IPMP, MPEG-21, and TV anytime metadata in a hierarchical structure. An example of the use of MPEG-21 DID will be described below.

Using the file structure shown in FIG. 7, important scenes can be expressed in a single unified file format structure by collecting portions of various contents through segment search. As shown in FIG. 7, one or more video or audio tracks may exist in each MPEG-4 file format in a “mdat” box. In this case, the same integrated file format structure represented by a “moov” box may be used in FIG. 4. It can have one separate file structure, such as Each item information indicating each "trak" box of the MPEG-21 DID in the "meta" box may be mapped to "iinfo" and "iloc" information in the "meta" box.

8 illustrates a multi-type file structure holding a plurality of movie presentations. As shown, this multi-type file structure consists of two types: an external file format consisting of "ftyp", "meta" and "mdat" boxes and an internal file format consisting of "moov", "meta" and "mdat" boxes. Has a layer. The directory and information of items in the external and internal file formats may be described by "iloc", "iinf" boxes in the "meta" box and / or MPEG-21 DID metadata. In multiple DMB MAF content, item_IDS in the outer "iloc" box is called the global item ID, and item_IDS in the inner "iloc" box is called the local item ID. The global item ID points to the hidden "moov" box, and the local item ID points to the items in each hidden "moov" box. The MPEG-21 DID in the outer "xml" box contains all hidden "moov" boxes of the hierarchical item structure. The use of MPEG-21 DID metadata for multiple DMB content will be described below.

Hereinafter, a protected file structure will be described with reference to FIGS. 9 and 10.

To signal content protection, a sample technique of a "trak" box or an IPMP DIDL of a "meta" box can be used. ISO / IEC 21000-5 defines the right expression language (REL). REL is comprehensive and designed to flexibly adapt to specific ranges and application requirements within specific areas. The language provides an extension and profile mechanism for this purpose.

Signal transfer using the sample technique of the "trak" box is described. Through the sample technique of the "trak" box, the DMB player finds that a particular resource is protected. The four character code in the sample technique is replaced with a four character code indicating protection encapsulation. These four character codes only vary by media type. For example, mp4v is replaced by encv and mp4a is replaced by enca. The entry codes for the protected streams are shown in Table 6.

The following describes signal transmission using MPEG-21 IPMP information. Protection of resources can be known from the IPMP information delivered to the “meta” box. Table 7 describes examples of protected DID representations that can be represented in the “xml” box of the “meta” box. The digital item associated with the resource track using the MPEG-21 IPMP DIDL representation can be known as a protected digital item in the DMB MAF player.

9 shows a short type file structure with IPMP metadata. The sample technique in the “trak” box can be used to signal the protection of the video item. IPMP information is contained in an "xml" box using the MPEG-21 IPMP Information Scheme. An example of the use of MPEG-21 IPMP will be described below.

10 illustrates a multi-type file structure with IPMP metadata. Based on the file structure for the multi-type file structure described with reference to FIG. 8, the signaling and management information is included in the “xml” box in the “meta” box.

Example of Using MPEG-21 DID and TV-Anytime

Hereinafter, an example of using MPEG-21 DID and TV-Anytime according to the present invention will be described. As described with reference to FIG. 9, this is an example of an MPEG-21 DID description that includes element information and location of resources in a DMB MAF file, IPMP information of each or all resources, and their metadata.

Table 8 is an example of a DIDL representation for transparent DMB MAF content with video and audio streams. Video and audio resources refer to the location of the file structure, and content descriptions can be inserted into digital item descriptors.

Table 9 describes an example of a modified DIDL representation that is protected for the example of Table 8. In this example the video stream is protected using the IPMP tool specified by the IPMPInfoDescriptor, which rules of use can be expressed in a license in the RightsDescriptor. It shows how resources are managed and which IPMP tools are required for access. It also shows how to express the IPMP tool information and its update information.

Table 10 describes examples of other DIDL representations for which protection is set in the example of Table 8. It contains a protected video and audio stream and its governance information. It shows how to signal using IPMPGeneralInfoDescriptor and its citations.

Hereinafter, examples of TV-Anytime metadata, such as EPG metadata, package metadata, usage history metadata, segment metadata, coupon metadata, will be described.

The main field of application of DMB MAF is the storage of mobile broadcast content. Mobile broadcast content and EPG metadata that allows a user to search for and select mobile broadcast content may be stored in a DMB MAF file for next use. The types and definitions of these EPG metadata are shown in Table 11.

The XML document in Table 12 illustrates examples of ProgramInformation and PurchaseInformation. In this example, the 849th Englishcafe program is included in the genre of “edudation / language study” and can be viewed for free when the user sees an ad embedded in the program.

Fig. 11 shows an example of package consumption according to the present invention, and Fig. 12 shows package playback on a TV.

In addition to audio-visual content, various DMB content such as images, texts, applications, slide shows, web pages, weather information, traffic and travel information can be obtained from the DMB service via the IP network. Each content may be consumed alone or together to provide a more effective consumer experience. TV-Anytime defines package metadata that describes the characteristics and organization of such a collection of content. Examples of package content include language education content services such as multi-angle services of broadcast content, photo album services, today's expressions, scripts in native and foreign languages, text data on structures and grammar, dictionaries, and the like.

Package metadata also provides a mechanism for expressing consumption options based on usage environment (device) and user preference (user). A targeting service is then available that automatically matches relevant content and delivers it to pre-collected consumers. The package metadata also describes the synchronization (time) information and spatial information between the original content as the intended service provider and the content allowing the original content consumption. Synchronization information can provide multi-stream experience (eg, multiple camera sports or optional audio and video documentaries) in content packaging. The xml example in Table 13 describes an example of package metadata. In this example, the world famous movie "Ray Charles" about Jazz California and its script are used as a resource for studying English.

As DMB content that a user creates, the user can add his usage history for next use. That is, if information describing which content has already been watched is stored with the content, he can start consuming the content at any time from the point of last consumption. For this purpose, usage history metadata of TV-Anytime is used. The usage history metadata describes the user's audiovisual content consumption history as a list of actions performed during the observation period. The xml document in Table 14 describes an example of usage history metadata. In this example, “User 1” consumed the content specified by ID, “crid: //www.ebs.co.kr/englishcafe_849” for 15 minutes from the start of the content.

As the user creates DMB content, the user can also add his bookmarks for next use. In other words, if bookmark information is stored with the content, he can selectively consume the content simply by walking around his favorite bookmarked items or segments. (Segments are a contiguous part of a piece of content.) For this purpose, segmentation metadata of TV-Anytime is used. Segmentation metadata describes one segment or groups of segments. Segment metadata makes it possible to repurpose the program, for example with video highlights, bookmarks and virtual programs. FIG. 13 shows an example of a virtual program reconstructed by a user having a preference for tennis. The xml document in Table 15 illustrates a segment group of bookmarks type.

Coupon metadata provides a method for announcing the existence of a coupon, describing the coupon, and informing how to retrieve the coupon. DMB MAF users can store coupons with related content and retrieve and use them at any time. 14 illustrates an example of using coupon metadata.

Example of using user-creative data

To provide personalized DMB content consumption, the DMB MAF can package user-generated data such as graphics, text, images, audio and video along with the spatiotemporal representation of the main DMB AV content in a “trak” box. The representation is performed in part of the Core2D profile of BIFS. As can be seen from Table 16, user-generated data is classified into five types and requires presentation information by BIFS. Table 16 shows BIFS information of user-generated data in the form of XMT.

In Table 16, each type of user-generated data has space-time information. Time information is described through the “par” node in XMT. "LineProperties" represents the color of "Graphic" data (eg RGB), and "geometry" creates the appearance of visual data. (In this case, lines, rectangles, and ellipses are used for the user-generated data.) "Translation" describes the location of visual data on the screen. That is, it makes it possible to display user generated data for the main DMB AV content. "ES_ID" refers to the index of "trak" quoted by user-generated data except "Graphic" data.

User-generated DMB MAF content is encapsulated by two types of file formats. As shown in Fig. 22, user-generated data is contained in boxes of "trak" and "mdat" which each have a media stream and an actual stream of data. However, "Graphic" can be directly expressed only by information of space-time of BIFS stream. On the other hand, BIFS of the remaining data types (eg, text, image, audio and video) uses "trak" to query the actual stream of embedded resources in the file format. As a result, user-generated data (except "Graphic") in the "mdat" box can be retrieved via the "trak" box of the DMB MAF file format.

The "bifs" track describes the spatiotemporal information of user-generated data. As described above, since "Graphic" data does not have a referencing resource, it can be described as a "bifs" track only. Since other types of user-generated data refer to embedded resources, the “trak” box wraps media information on the actual stream of user-generated data.

Fig. 15 is a view for explaining the file structure of user-generated data using the " trak " box according to the present invention.

Specific player behavior

For easy and convenient consumption of multiple DMB MAF content, the DMB MAF content provider or author can define the player's behavior. Examples of player actions specified by the DMB MAF content provider or author are as follows.
1. A DMB MAF content provider may include a single DMB MAF content for an advertisement and wants the advertisement to be played periodically or forcibly.

delete

2. When the user plays multiple DMB MAF content, the player can either initially show a single DMB MAF content list or automatically play the first DMB MAF content.

3. For better communication or understanding, authors can control a single DMB MAF content within multiple DMB MAF content files.

Use of MPEG-21 IPMP Components

The following describes a set of IPMP elements required for DMB MAF. The IPMP tool set for DMB MAF is a subset of MPEG-21 IPMP elements. Selection criteria for this tool set are based on the specific application area of the DMB.

1. Most of the target terminals are handheld DMB devices.

2. Selected IPMP tools should be applicable and available for DMB MAF services on these devices.

3. In order to be clear and easy to implement, obscure tool components having some type should be more specifically specified.

To retain all of the ability to represent protected digital items, the IPMP tool set for DMB MAF must include all elements contained in the IPMP DIDL schema of MPEG-21 IPMP elements. IPMP information descriptors in the DMB MAF consist of a subset of the IPMP information descriptor schema in the MPEG-21 IPMP Component Standard. The elements selected with restrictions are listed in Table 17.

In Table 17, the “ipmpinfo: RightsDescriptor” element is used to contain rights information that manages IPMP information. The "ipmpinfo: RightsDescriptor" element in "ipmpinfo: Tool" is used for each IPMP tool. Common rights information for all tools in "ipmpinfo: IPMPInfoDescriptor" may be represented by "ipmpinfo: RightsDescriptor" in "ipmpinfo: IPMPInfoDescriptor".

The IPMP general information descriptor in the DMB MAF consists of a subset of the MPEG-21 IPMP information descriptor schema in the MPEG-21 IPMP component and the MPEG-A media streaming player application format. The elements selected with restrictions are listed in Table 18.

Table 19 is an IPMP information schema.

DMB broadcasting content service system, user terminal, remote consumption device

16 is a block diagram of a DMB broadcasting system according to the present invention. As shown, the DMB broadcasting system includes a DMB content service system 100, a delivery medium (broadcasting network) 200, and a DMB user for requesting and using an integrated multimedia service according to a user's authority to use multimedia content. The terminal 300 includes a delivery medium (communication network / internet network) 400 for receiving the remotely stored DMB content.

The DMB content service system 100 includes a DMB content authoring unit 101, a DMB file storage unit 102, a control unit 103, a DMB content protection unit 104, a DMB file format unit 105, and an integrated content transmission unit ( 106, license metadata generator 107, protected metadata generator 108, and detailed information metadata generator 109.

The DMB content service system 100 may author video, audio, image, or text data as one content through the DMB authoring unit 101, and the authored DMB content may be stored in the DMB file storage 102. The control unit 103 causes the detailed information metadata generating unit 109 to generate metadata describing the detailed information on the authored DMB content. In addition, the control unit 103 may allow the authored DMB content to be encrypted (or protected) by the DMB content protection unit 104, and the protection metadata describing encryption-related information at the same time that the DMB content is encrypted is protected metadata generation unit. To be generated at 108. In addition, the control unit 103 causes the license metadata generating unit 107 to generate license metadata in order to generate license information for use of the DMB content. The authored DMB content, its detailed information metadata, protection metadata, and license metadata are delivered to the DMB file format unit 105 so as to be included in one file, thereby becoming one DMB content file, and delivered to the MPEG-2 TS. It is formatted in a form suitable for delivery through the broadcasting network 200, such as packetizing. The DMB content formatted for transmission is delivered from the integrated content transmitter 106 to the DMB user terminal 300 through the broadcasting network 200.

The DMB content file generated by the DMB file format unit 105 includes DMB content including at least one of DMB video, DMB audio, and data, detailed information metadata describing detailed information of the DMB content, and the DMB content. It consists of a file format that can incorporate protection management metadata that describes information about protection and management into a single file. In this case, the detailed information metadata and the protection management metadata are selectively included according to the application.

DMB video is encoded in MPEG-4 AVC, DMB audio is MPEG Layer II Audio according to ISO / IEC 11172-3 and ISO / IEC 13818-3, MPEG-4 ER-BSAC Audio according to ISO / IEC 14496-3, It is encoded with at least one of MPEG-4 HE-AAC version 2 Audio according to ISO / IEC 14496-3, MPEG AAC + SBR Audio according to ISO / IEC 13818-7 and ISO / IEC 14496-3 AMD1.

The data content may be represented by at least one of metadata, images, video, audio, and programming code, or may be represented by at least one of JPEG, PNG, MNG, HTML, CSS, ECMAscript, Java midlet, and TPEG. The data content is delivered through at least one protocol of Dynamic Label Segment (DLS), Multimedia Object Transfer (MOT), and Transparent Data Channel (TDC).

The data content may convey additional information about the DMB video content or the DMB audio content, or information required for searching or filtering the DMB video content or the DMB audio content desired by the user. In addition, the data content may be text data requiring synchronization over time for DMB video content or DMB audio content, or text data requiring no synchronization. Here, the timed text is represented by 3GPP TS 26.245. The data content may also be user data.

The detailed information metadata is expressed in MPEG-21 DID or TV Anytime Part 3, and the protection management metadata is expressed in MPEG-21 IPMP or MPEG-21 REL.

The integrated file format can be expressed using the ISO-based file format (ISO / IEC 14496-12), MPEG-4 file format (ISO / IEC 14496-14), or MPEG-21 file format (ISO / IEC 21000-9) structure. Can be.

The integrated file format having the above-described structure may be integrated into a single file, and may be applied to broadcast contents other than DMB.

The DMB user terminal 300 includes an integrated content receiving unit 301, an integrated content decoding unit 302, a DMB content rendering unit 303, a terminal control unit 304, and an integrated content storage unit 305.

The integrated content receiving unit 301 receives a DMB content file delivered through the delivery mediums 200 and 400. The DMB content file includes DMB content including video, audio, data, and the like, metadata about detailed information of the DMB content, and protection management metadata describing information on protection and management of the DMB content. A file formed in a format that can be integrated into a file. The integrated content storage unit 305 stores the content of the integrated file format received through the integrated content receiving unit 301. The integrated content decoding unit 302 receives the content of the integrated file format from the integrated content receiving unit 301 or the integrated content storage unit 305, and decodes the DMB content according to the protection management metadata. The DMB content rendering unit 303 renders the DMB content decoded by the DMB content decoding unit 302. The terminal controller 304 allows the integrated file format content received by the integrated content receiving unit 301 according to the detailed information metadata to be stored in the integrated content storage unit 305 or decoded by the integrated content decoding unit 302.

In the DMB user terminal 300, a user receives a DMB content file directly through the DMB content service system 100 or remotely through a delivery medium (communication network / internet network) 400 (PDR (Personal Data Recorder) or NDR (Networked) It can also be stored on a storage medium such as a data recorder. The requested DMB content file may be delivered through the integrated content receiving unit 301, and the delivered DMB content file may be decrypted using a user license through the integrated content decoding unit 302 or integrated content in the DMB user terminal 300. It may be stored in the storage unit 305. The decoded DMB content is rendered to the DMB user terminal 300 through the DMB content rendering unit 303. When the user wants to store the DMB content in an external storage medium to consume external DMB content or to store in an external storage medium instead of the internal storage medium of the DMB user terminal 300, a transmission medium (communication network / Internet network) The terminal control unit 304 of the DMB user terminal 300 may remotely control the storage and consumption of the DMB content of the external storage medium through the 400.

17 is a flowchart for explaining an example of the method for generating DMB content according to the present invention. First, DMB content including at least one of DMB video, DMB audio, and data is authored (S1702). Next, detailed information metadata describing detailed information of the DMB content is authored (S1704). Next, the DMB content is encrypted, and protection management metadata describing encryption related information and license information of a specific user for the DMB content is generated (S1706). Here, the encryption information is encryption tool information, key information for decryption, encryption parameter information, and the like. The license information is the number of times of reproduction, license purchaser or terminal, reproduction validity period, and the like. Next, the previously generated DMB content, detailed information metadata, and protection management metadata are integrated into one file format (S1708).

18 is a flowchart for explaining another example of the method for generating DMB content according to the present invention. This embodiment is different from the embodiment of FIG. 17 in that DMB content including at least one of DMB video, DMB audio, and data is externally authored and input, and does not generate metadata describing detailed information about the DMB content. There is.

First, metadata that describes license information of a specific user for DMB content is generated (S1802). Next, the DMB content is encrypted according to the license information (S1804). Next, metadata describing the encryption related information is generated (S1806). Next, the DMB content, license-related metadata, and encryption-related metadata generated above are integrated into one file format (S1808).

19 is a flowchart for explaining an example of the method for reproducing DMB content according to the present invention. First, DMB content including at least one of DMB video, DMB audio, and data, detailed information metadata describing detailed information of the DMB content, and protection management metadata describing information on protection and management of the DMB content. Receives DMB content (or one DMB content file) in a file format that can be combined into one file (S1902). Next, the content of the received integrated file format is stored according to the detailed information metadata (S1904). Next, the DMB content is decoded according to the protection management metadata (S1906), and the decoded DMB content is rendered (S1908).

20 is a flowchart for explaining another example of the DMB content reproduction method according to the present invention. First, DMB content including at least one of DMB video, DMB audio, and data, detailed metadata describing detailed information of the DMB content, and protection management metadata describing information on the protection and management of the DMB content. The DMB content of the file format that can be integrated into the file of the user is searched or filtered through the detailed information metadata (S2002). Next, the content of the integrated file format is parsed, and the protection management metadata is parsed to authenticate the user or the user terminal (S2004). Next, information necessary for decoding the DMB content is extracted using the parsed protection management metadata (S2006). Next, the detailed information metadata is parsed and the contents of the DMB content are presented through the interface of the user terminal (S2008). Next, the content is extracted, decoded and reproduced according to the content execution command from the user (S2010).

21 is a diagram showing the configuration and network connection relationship of the DMB remote consumption apparatus according to the present invention. As shown, the DMB remote consumption apparatus 500 includes a controller 501, an integrated content receiving unit 502, an integrated content storage unit 503, and an integrated content streaming unit 504.

The integrated content receiving unit 502 receives the DMB content from the DMB content service system 100 via the broadcasting network 200. The integrated content storage unit 503 stores the DMB content file received by the integrated content receiving unit 502. The integrated content streaming unit 504 provides a DMB content file stored in the integrated content storage unit 503 in a streaming form to the DMB user terminal 300. The control unit 501 receives a request for storing or consuming a DMB content file from the DMB user terminal 300, and causes the integrated content receiving unit 502 to receive a DMB content file from the DMB content service system 100 when the storage request is received. When the consumption request is received, the DMB content file stored in the integrated content storage unit 503 is called and provided to the DMB user terminal 300 through the integrated content streaming unit 504. The controller 501 may remotely access the user terminal 300 through the delivery medium 400.

In controlling to store or consume the DMB content file to an external storage medium remotely through the DMB user terminal 300, the remote consumption system 500 transmits a medium (communication network / Internet network) 400 from the DMB user terminal 300. DMB content storage and consumption request can be received, and is delivered to the control unit 501 of the remote consumption system 500. In response to a request of the DMB user terminal 300, the controller 501 receives the DMB content in the integrated file format from the DMB content service system 100 as the integrated content receiving unit 502, and stores the DMB content in the integrated content storage unit 503. The DMB content of the integrated file format already stored in the integrated content storage unit 503 may be called and provided to the DMB user terminal 300 in a streaming form through the integrated content streaming unit 504.

22 is an example of a method of remotely consuming DMB content in an integrated file format used in conjunction with a DMB user terminal 300 and a DMB content providing apparatus (or DMB content service system 100) according to the present invention. It is a flow chart explaining. First, a DMB content file is received from the DMB content service system 100 according to a request of the user terminal 300 (S2202). Next, the received DMB content file is stored at the request of the user terminal 300 (S2204). Next, the stored DMB content file is provided to the DMB user terminal 300 according to a request of the user terminal 300 (S2206).

On the other hand, the method of the present invention as described above can be written in a computer program. And the code and code segments constituting the program can be easily inferred by a computer programmer in the art. In addition, the written program is stored in a computer-readable recording medium (information storage medium), and read and executed by a computer to implement the method of the present invention. And the recording medium includes all types of recording media (intangible medium such as a carrier wave as well as tangible media such as CD and DVD) readable by a computer.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by.

BRIEF DESCRIPTION OF DRAWINGS Fig. 1 is a diagram for explaining a relationship between DMB MAF and another MPEG file format according to the present invention.

Fig. 2 shows the components of the DMB MAF according to the present invention.

3 is a view for explaining an outline of a schema structure of TV-Anytime metadata, which is a component of DMB MAF according to the present invention;

4 illustrates a single type file structure according to the present invention.

5 is a view for explaining an example of using a single type file structure according to the present invention;

Fig. 6 illustrates another example of the use of the single type file structure according to the present invention.

7 is a view for explaining the case of using the "meta" box in the single type file structure according to the present invention;

8 illustrates a multi-type file structure according to the present invention.

9 illustrates a single type file structure with IPMP metadata in accordance with the present invention.

10 illustrates a multi-type file structure with IPMP metadata in accordance with the present invention.

11 is a diagram illustrating an example of package consumption according to the present invention.

Fig. 12 is a diagram showing package reproduction in a TV according to the present invention.

FIG. 13 shows an example of a virtual program reconstructed by a user having a preference for tennis.

14 is a view for explaining an example of the use of coupon metadata according to the present invention.

Fig. 15 is a view for explaining the file structure of user-generated data using the " trak " box according to the present invention.

16 is a block diagram of a DMB broadcasting system according to the present invention.

17 is a flowchart for explaining an example of a method for generating DMB broadcast content according to the present invention;

18 is a flowchart for explaining another example of the method for generating DMB broadcast content according to the present invention;

19 is a flowchart for explaining an example of a method for reproducing DMB broadcast content according to the present invention.

20 is a flowchart for explaining another example of the DMB broadcast content reproduction method according to the present invention;

Fig. 21 is a diagram showing a configuration and a network connection relationship of a DMB remote consuming device according to the present invention.

22 is a flowchart illustrating an example of a method for remotely consuming DMB broadcast content used in conjunction with a DMB user terminal and a DMB broadcast content providing apparatus according to the present invention.

Claims (25)

Encrypting the input DMB content based on protection management metadata describing information on protection and management of the DMB content; And Generating a file including the encrypted DMB content and the protection management metadata; The DMB content includes additional data, The additional data is And usage history information describing the user's audiovisual content consumption history and bookmark information for the item or segment bookmarked by the user. The method of claim 1, The file is Detailed information metadata describing detailed information of the DMB content; And A content structure metadata describing the structure of the DMB content; The protection management metadata DMB content file, including information about Intellectual Property Management and Protection (IPMP), including encryption information or license information of the DMB content, and information about Rights Expression Language (REL) How to create a format. The method of claim 2, The DMB content is At least one of video and audio, The file is Is expressed using the structure of an ISO-based file format (ISO / IEC 14496-12), the MPEG-4 file format (ISO / IEC 14496-14) or the MPEG-21 file format (ISO / IEC 21000-9), The detailed information metadata Expressed as TV Anytime, The content structure metadata is Represented by MPEG-21 DID, The protection management metadata A method of generating a DMB content file format, expressed in MPEG-21 IPMP or MPEG-21 REL. The method of claim 3, The additional data is Includes timed text data requiring synchronization over time for the video or the audio; And the synchronous text data is represented by 3GPP TS 26.245. The method of claim 4, wherein The additional data is Further information about the video or the audio or information needed to search or filter the video or the audio desired by the user. Encrypting the input DMB content based on protection management metadata describing information on protection and management of the DMB content; Generating a file including the encrypted DMB content and the protection management metadata; And Transmitting the file to a user terminal, The transmitting step Formatting the file into a format for the transmission; And Transmitting the formatted file to the user terminal, The DMB content includes additional data, The additional data is A method for creating and transmitting a DMB content file, comprising usage history information describing a user's audiovisual content consumption history and bookmark information for an item or segment bookmarked by the user. Receiving a file including protection management metadata describing information on protection and management of DMB content and encrypted DMB content based on the protection management metadata; Decrypting the encrypted DMB content using the protection management metadata; And Outputting the decrypted DMB content; The DMB content includes additional data, The additional data is A usage history information describing a user's audiovisual content consumption history and bookmark information for an item or segment bookmarked by the user. The method of claim 7, wherein The file is Detailed information metadata describing detailed information of the DMB content; And A content structure metadata describing the structure of the DMB content; The protection management metadata DMB content file, including information about Intellectual Property Management and Protection (IPMP), including encryption information or license information of the DMB content, and information about Rights Expression Language (REL) Format consumption method. The method of claim 8, The DMB content is At least one of video and audio, The file is Is expressed using the structure of an ISO-based file format (ISO / IEC 14496-12), the MPEG-4 file format (ISO / IEC 14496-14) or the MPEG-21 file format (ISO / IEC 21000-9), The detailed information metadata Expressed as TV Anytime, The content structure metadata is Represented by MPEG-21 DID, The protection management metadata A method for consuming a DMB content file format, expressed in MPEG-21 IPMP or MPEG-21 REL. 10. The method of claim 9, The additional data is Includes timed text data requiring synchronization over time for the video or the audio; And the synchronous text data is represented by 3GPP TS 26.245. The method of claim 10, The receiving step Parsing the file into the encrypted DMB content, the protection management metadata, and the detailed information metadata; The decoding step Performing authentication of a user terminal using the protection management metadata; The outputting step And outputting detailed information of the DMB content using the detailed information metadata. The method of claim 11, The additional data is Further information about the video or the audio or information necessary to search or filter the video or the audio desired by the user. A content protection unit for encrypting the input DMB content based on protection management metadata describing information on protection and management of the DMB content; And A file format unit for generating a file including the encrypted DMB content and the protection management metadata; The DMB content includes additional data, The additional data is And usage history information describing a user's audiovisual content consumption history and bookmark information for an item or segment bookmarked by the user. A receiving unit which receives protection management metadata describing information on protection and management of DMB content and a file including encrypted DMB content based on the protection management metadata; A decrypting unit for decrypting the encrypted DMB content using the protection management metadata; And It includes a renderer for outputting the decoded DMB content, The DMB content includes additional data, The additional data is A usage history information describing the user's audiovisual content consumption history and bookmark information for the item or segment bookmarked by the user. A method for remotely consuming DMB content used in conjunction with a DMB user terminal and a device providing a DMB content file format, Receiving a file including protection management metadata describing information on protection and management of DMB content and encrypted DMB content according to the protection management metadata from the DMB content providing device according to a request of the DMB user terminal. And storing; Providing the stored DMB content file to the DMB user terminal at the request of the DMB user terminal; The DMB content includes additional data, The additional data is A usage history information describing a user's audiovisual content consumption history and bookmark information for an item or segment bookmarked by the user. delete delete delete delete delete delete delete delete delete delete

Images