Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04H—BROADCAST COMMUNICATION
  • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
  • H04H20/86—Arrangements characterised by the broadcast information itself
  • H04H20/95—Arrangements characterised by the broadcast information itself characterised by a specific format, e.g. an encoded audio stream
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04H—BROADCAST COMMUNICATION
  • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
  • H04H60/09—Arrangements for device control with a direct linkage to broadcast information or to broadcast space-time; Arrangements for control of broadcast-related services
  • H04H60/14—Arrangements for conditional access to broadcast information or to broadcast-related services
  • H04H60/15—Arrangements for conditional access to broadcast information or to broadcast-related services on receiving information
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04H—BROADCAST COMMUNICATION
  • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
  • H04H60/09—Arrangements for device control with a direct linkage to broadcast information or to broadcast space-time; Arrangements for control of broadcast-related services
  • H04H60/14—Arrangements for conditional access to broadcast information or to broadcast-related services
  • H04H60/23—Arrangements for conditional access to broadcast information or to broadcast-related services using cryptography, e.g. encryption, authentication, key distribution
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04H—BROADCAST COMMUNICATION
  • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
  • H04H60/27—Arrangements for recording or accumulating broadcast information or broadcast-related information
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04H—BROADCAST COMMUNICATION
  • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
  • H04H60/68—Systems specially adapted for using specific information, e.g. geographical or meteorological information
  • H04H60/73—Systems specially adapted for using specific information, e.g. geographical or meteorological information using meta-information
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
  • H04N19/25—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding with scene description coding, e.g. binary format for scenes [BIFS] compression
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
  • H04N21/23614—Multiplexing of additional data and video streams
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
  • H04N21/2368—Multiplexing of audio and video streams
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/27—Server based end-user applications
  • H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
  • H04N21/2747—Remote storage of video programmes received via the downstream path, e.g. from the server
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/41—Structure of client; Structure of client peripherals
  • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
  • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
  • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
  • H04N21/4341—Demultiplexing of audio and video streams
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
  • H04N21/4348—Demultiplexing of additional data and video streams
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
  • H04N21/454—Content or additional data filtering, e.g. blocking advertisements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/845—Structuring of content, e.g. decomposing content into time segments
  • H04N21/8451—Structuring of content, e.g. decomposing content into time segments using Advanced Video Coding [AVC]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/854—Content authoring
  • H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/16—Analogue secrecy systems; Analogue subscription systems
  • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
  • H04N7/17309—Transmission or handling of upstream communications
  • H04N7/17318—Direct or substantially direct transmission and handling of requests
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/41—Structure of client; Structure of client peripherals
  • H04N21/426—Internal components of the client ; Characteristics thereof
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
  • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
  • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications

Definitions

• the present invention relates to a combined file format for Digital Multimedia Broadcasting (DMB) contents, and an apparatus and method for processing DMB contents of the combined file format. More particularly, the present invention relates to a combined file format for DMB contents which allows a user to automatically filter desired contents, store the desired contents and watch the contents when the user want, and enhances applicability of contents through sharing and exchanging the contents; and an apparatus and method for processing the DMB contents of the combined file format.
• DMB Digital Multimedia Broadcasting
• DMB Digital Multimedia Broadcasting
• DMB services through portable terminals such as mobile phones, Personal Digital Assistants (PDAs), Portable
• DMB Media Players and so forth.
• DMB is a first mobile television (TV) service based on a digital radio transmission system, and it provides high-quality video, audio and auxiliary data to mobile user equipments such as in-vehicle terminals and mobile phones so that contents can be consumed in any where at any time.
• DMB is a broadcasting service developed in consideration of mobility
• contents show time is relatively shorter than the show time of typical broadcasting service provided to fixed equipments.
• DMB provides more contents. This makes it hard to remember program schedules and search DMB programs with the user equipments. Therefore, it is difficult to watch desired broadcasting contents at their scheduled show time.
• DMB contents are volatile contents. They are shown on mobile user equipments in real-time once and go away. Since the mobile user equipments have limited battery power and data storage, it is hard to store DMB contents and watch them later at desired time.
• DMB contents currently on service basically include video and audio, and an auxiliary data service using Binary Format for Scenes (BIFS) such as securities information and whether information is under preparation to be serviced as a DMB data service.
• BIFS Binary Format for Scenes
• MPEG-A Moving Picture Experts Group
• ISO/IEC 23000 MPEG-A
• MPEG-A ISO/IEC 23000
• MAF Multimedia Application Format
• An embodiment of the present invention is directed to providing users with DMB contents by automatically filtering desired broadcasting contents, and storing them in portable DMB user equipments or prearranging to automatically store them in a remote storage through a communication network connected to the portable user equipments, getting over an idea that broadcasting contents are of one-time consumption which are shown once on the portable user equipment and then vanish. The user can watch the DMB contents at any time they wish.
• Another embodiment of the present invention is directed to enhancing applicability of broadcasting contents by sharing or exchanging contents with other user equipments.
• Other objects and advantages of the present invention can be understood by the following description, and become apparent with reference to the embodiments of the present invention. Also, it is obvious to those skilled in the art of the present invention that the objects and advantages of the present invention can be realized by the means as claimed and combinations thereof,
• a file format for DMB contents capable of combining into one file: a Digital Multimedia Broadcasting (DMB) content including at least one of DMB video, DMB audio, data and a combination thereof; detailed information metadata for describing detailed information of the DMB content; and protection and governance metadata for describing information on protection and governance of the DMB content.
• DMB Digital Multimedia Broadcasting
• a file format for broadcasting contents capable of combining a broadcasting content including at least one among a video content, an audio content, and a data content, detailed information metadata describing detailed information of the broadcasting content, and protection and governance metadata describing information on protection and governance of the broadcasting content into one file.
• a method for generating DMB content files which includes the steps of: generating license metadata describing license information of a specific user for a DMB content including at least one among DMB video, DMB audio and data; encrypting the DMB content based on the license information; generating encryption metadata describing information on the encryption; and combining the DMB content, the license metadata, and the encryption metadata into one file format .
• a method for restoring a DMB content of a combined file format capable of combining a DMB content including at least one among DMB video, DMB audio, and data, detailed information metadata describing detailed information of the DMB content, and protection and governance metadata describing information on protection and governance of the DMB content into one file
• the method including the steps of: searching for or filtering a desired DMB content based on the detailed information metadata; authenticating a user or a user equipment by parsing the DMB content of the combined file format and parsing the protection and governance metadata; extracting information needed for decrypting the DMB content based on the parsed protection and governance metadata; presenting the content of the DMB content through an interface of the user terminal by parsing the detailed information metadata; and extracting, decoding, and restoring the DMB content according to a content execution command inputted from the user.
• a method for remotely consuming a DMB content in connection with a DMB user equipment and a DMB content providing apparatus which includes the steps of: receiving a DMB content from the DMB content providing apparatus according to a request of the user equipment; storing the received DMB content according to a request of the user equipment; and providing the stored DMB content to the DMB user equipment according to a request of the user equipment.
• the present invention makes users watch DMB contents by additionally providing metadata to DMB AV contents, automatically filtering desired broadcasting contents, and storing them in portable DMB user equipments or prearranging to automatically store them in a remote storage through a communication network connected to the portable user equipments. Also, since it is possible to share or exchange the contents among user equipments, the applicability of broadcasting contents increases.
• Fig. 1 shows the relations between MAF for DMB and other MPEG File Formats.
• Fig. 2 shows components of MAF for DMB in accordance with an embodiment of the present invention.
• Fig. 3 shows a schema structure of TV-Anytime metadata which is a constituent element of MAF for DMB.
• Fig. 4 shows the single-type file structure in accordance with an embodiment of the present invention.
• Fig. 5 shows a file structure for a single-type file in accordance with an embodiment of the present invention.
• Fig. 6 shows a file structure for a single-type file in accordance with another embodiment of the present invention.
• Fig. 7 shows a file structure for a single-type file using the meta box in accordance with an embodiment of the present invention.
• Fig. 8 shows a multiple type file structure in accordance with an embodiment of the present invention.
• Fig. 9 shows a single-type file structure with the IPMP metadata in accordance with an embodiment of the present invention.
• Fig. 10 shows a multiple type file structure with the IPMP metadata in accordance with an embodiment of the present invention.
• Fig. 11 illustrates an example of package consumption in accordance with an embodiment of the present invention.
• Fig. 12 shows package restoration on TV in accordance with an embodiment of the present invention.
• Fig. 13 shows an example for virtual program which is reconstructed by a user with preference for tennis.
• Fig. 14 shows a usage example of coupons metadata.
• Fig. 15 shows a file architecture of user-creative data using a "trak" box in accordance with an embodiment of the present invention.
• Fig. 16 shows an architecture of a DMB system in accordance with an embodiment of the present invention.
• Fig. 17 is a flowchart describing a DMB content generating method in accordance with an embodiment of the present invention.
• Fig. 18 is a flowchart describing a DMB content generating method in accordance with another embodiment of the present invention.
• Fig. 19 is a flowchart describing a DMB content restoring method in accordance with an embodiment of the present invention.
• Fig. 20 is a flowchart describing a DMB content restoring method in accordance with another embodiment of the present invention.
• Fig. 21 illustrates a structure of a DMB remote consuming apparatus and how it is connected to a network in accordance with an embodiment of the present invention.
• Fig. 22 is a flowchart describing a method of remotely consuming DMB contents between a DMB user equipment and a DMB content providing apparatus .
• Fig. 1 shows the relations between MAF for DMB and other MPEG File Formats.
• Other MPEG File Formats are based on the ISO Base Media File Formats.
• MAF for DMB is derived from the MPEG-4 AVC, 3GPP Timed Text Format [27], and MPEG-4 File Format.
• Table 1 describes DMB service types and Table 2 shows contents types of each service.
• Fig. 2 shows components of MAF for DMB which consists of the MPEG Standards and non-MPEG Standards.
• MAF for DMB includes AV contents m a current DMB service, a data service such as Broadcast Website (BWS) , and auxiliary data shown in Fig. 3 as components.
• BWS Broadcast Website
• MAF for DMB supports the various service types such as terrestrial DMB (T-DMB) and satellite DMB (S-DMB) .
• the individual DMB services support their main AV contents and auxiliary data.
• T-DMB service the specification of the main AV contents is described in ETSI TS 102 428.
• S-DMB service uses the ISO/IEC 14496-10 AVC for the video content and ISO/IEC 14496-3 MPEG-4 part 3 Audio: HE-AAC v2 for the audio content.
• auxiliary data such as BWS
• the supported content types are described in ETSI TS 102 428 which is the extended version of ETSI TS 101 498- 1 and 2
• DMB contents denote contents including at least one among DMB video, DMB audio, and data.
• a term “detailed information metadata” denotes metadata describing detailed information of DMB contents, and they are mainly represented as TV-Anytime metadata shown in Table 3.
• a term “protection and governance metadata” denotes metadata describing information on protection and governance of DMB contents.
• auxiliary data shown in Tables 2 and 3 those except TV- Anytime metadata, MPEG-21 IPMP, and MPEG-21 REL are data contents.
• Contents of a combined file format denotes DMB contents having a file format that can combine DMB contents including at least one among DMB video, DMB audio and data, detailed information metadata describing detailed information of the DMB contents, and protection and governance metadata describing information on protection and governance of the DMB contents into one file.
• MPEG-21 DID (ISO/IEC 21000-2) describes a set of abstract terms and concepts to form a useful model for defining Digital Items.
• the digital item (DI) is a fundamental unit with a standard representation, identification and metadata for the distribution, and transaction.
• MPEG-21 DID aims to standardize the description for the definition of the digital item and provides the basic structure for content representation for the DMB storage and distribution scenario .
• contents are created and consumed based on TV-Anytime metadata.
• the metadata used to describe the content is taken as a subset of the TV-Anytime metadata specification, published by ETSI and available as ETSI TS 102 822-3. Using this metadata specification and some slight modifications, the content creation and consumption information is described in XML form.
• the TV-Anytime metadata are sub-divided into two categories: phase 1 metadata schemas (ETSI TS 102 822-3- 1) and phase 2 metadata schemas (ETSI TS 102 822-3-3) .
• the phase 1 metadata schema has the root element of TVAMainType and defines mainly about program and user descriptions.
• the phase 2 metadata schema has the root element of ExtendedTVAMainType and extends the phase 1 schema for including various content types and consumption conditions.
• the structure of the TV-Anytime schemas is briefly summarized in Fig. 3. The example usage of the TV-Anytime metadata will be described below.
• MPEG-21 IPMP Protection and governance of contents is carried out based on MPEG-21 IPMP and REL.
• MPEG-21 IPMP MPEG-21 IPMP
• DRM Digital Right Management
• the MPEG-21 IPMP Components standard provides the means to signal which IPMP Tools are required to protect specific parts of a protected Digital Item, and further information required by the Peer to manage each IPMP Tool and by the IPMP Tool to operate on protected content.
• MAF for DMB adopts a restricted subset of MPEG-21 IPMP Components.
• ISO/IEC 21000-5 defines a right expression language (REL) .
• REL right expression language
• MAF for DMB licenses governing the use of content are expressed according to the DAC profile of the MPEG-21 Rights Expression Language.
• Table 4 presents profile elements defined in the REL DAC profile .
• Timed Text format describes the normative behavior of text data for rendering.
• Timed text supports the characters and glyphs rendering, font support such as name, size and style, color support of text and background, text rendering position and composition, etc.
• font support such as name, size and style, color support of text and background, text rendering position and composition, etc.
• various applications such as closed captioning, karaoke, dynamic highlighting and other visual annotation can be deployed in the user' s terminal .
• the file format of MAF for DMB can be represented in two kinds of structures for single movie contents and multiple movie contents.
• the file format structure of this specification is derived from the ISO base media file format standard.
• the boxes used in this specification is based on a restricted set of boxes from the ISO base media file format and the MP4 File Format.
• Table 5 shows the structure of the employed boxes with their description. The mandatory boxes are marked with an
• Fig. 4 shows the single-type file structure containing single movie presentation.
• This type of file structure mainly consists of ftyp, moov and mdat boxes.
• the moov box describes the presentation of the scene in which more than one trak box are contained.
• the trak box contains the description for one media.
• a media in each trak box can be interleaved AV, individual audio and video, BIFS, and other data service contents as shown in 0 Table 2 and Figure 3.
• the trak box supports time information (such as edtl, stbl box) for the synchronization with other media of other trak box.
• the mdat box contains the real contents which are described in the trak box or the trak box may import the content by 5 URL without deposing the content in the mdat box.
• ⁇ *' marks mean the mandatory boxes in the file structure .
• Fig. 5 shows the primitive file structure for a single-type file. As shown in Fig. 5, BIFS and IOD/OD 0 information is not included in the file format if only the main audio and video are stored in the file.
• Fig. 6 shows another file structure for a single- type file.
• BIFS, IOD and OD information is included with the main AV data.
• 5 Fig. 7 shows a file structure for a single-type file using the meta box.
• This file contains the BIFS associated non-main data such as caption, images, script, timed metadata, program code and private data as shown in Tables 2 and 3.
• the meta box mainly consists of the iloc, iinf, ipro, xml boxes and etc.
• the iloc and iinf boxes contain the item_ID, length and offset for locating to an item and information such as item ID, item protection, item_name, content_type and content_encoding.
• the xml box can support the untimed text or binary data such as MPEG- 21 DID, IPMP, and TV Anytime.
• MPEG-21 DID can support the description for items.
• the iloc and iinf boxes describe the location and information of each item in the mdat box.
• the structure for items in the iloc and iinf boxes is flat and has limitation to describe the items in detail.
• MPEG-21 DID can be used to describe the location and information of the items as shown in Fig. 7.
• the MPEG-21 DID metadata can be contained in the xml box and can contain the metadata such as IPMP, MPEG-21, and TV anytime metadata, the script and the source code in the hierarchical structure.
• the example of MPEG-21 DID usages can be shown below. It is possible to collect parts of diverse contents and represent them in a combined file format through segment search for important scenes using the file structure of Fig. 7.
• one or more video or audio track may exist in an MPEG-4 file format in each "mdat” box.
• it can have another additional file structure shown in Fig. 4 that is represented as a "moov” box.
• Each item information representing each "trak" box of MPEG-21 DID in the "meta” box may be mapped to "iinfo" and "iloc" information in the "meta” box.
• Fig. 8 shows the multiple type file structure containing multiple movie presentations.
• outer file format which consists of the ftyp, meta and mdat boxes and inner one which consists of moov, meta and mdat boxes.
• the directory and information of the items in the outer and inner file format can be described by the iloc and iinf boxes and/or MPEG-21 DID metadata in the meta box.
• item_IDs in the outer and inner iloc box are called the global item id and local item id, respectively.
• the global item id shall indicate the hidden moov box and the local item id shall indicate the items in each hidden moov box.
• MPEG-21 DID in the outer xml box contains hierarchical item structures of all hidden moov boxes.
• the MPEG-21 DID metadata usages for the multiple DMB contents are described below.
• Fig. 9 shows the single-type file structure with the IPMP metadata.
• the sample description in the trak box can be used.
• the IPMP information is included in the xml box using MPEG-21 IPMP information scheme. The example of MPEG-21 IPMP usage will be shown below.
• Fig. 10 shows the multiple type file structure with the IPMP metadata. Based on file structure for multiple type file structure in Fig. 8, the signalling and governance information is contained in xml box within meta box.
• Table 8 is a DIDL expression for a clear MAF for DMB content with a video and audio stream.
• the video and audio resources refer to the position of the file structure, and the content description can be inserted into Descriptor in Digital item.
• Table 9 is a modified DIDL expression with protection for the Table 8 example.
• the video stream is protected using IPMP Tool specified by IPMPInfoDescriptor, and its usage rule can be expressed 5 in license within RightsDescriptor . It shows how to signal that a resource is governed and which IPMP Tool is required in order to access. It also shows how to express IPMP Tool information and its update information
• ⁇ /ipmpinfo ScheduledUpdateTime>
• ⁇ /ipmpinfo Update>
• ⁇ /ipmpinfo ConfigurationSettings>
• ⁇ /ipmpinfo ToolBaseDescription>
• ⁇ ipmpinfo InitializationSettings> ⁇ ipmpinfo: InitializatioriData>... ⁇ /ipmpinfo : InitializationData> ⁇ /ipmpinfo : InitializdtionSettings> ⁇ /ipmpinfo : Tool> ⁇ ipmpinfo : RightsDesc ⁇ ptor> ⁇ ipmpinfo : License> ⁇ r:license> ... ⁇ /r:license> ⁇ /ipmpinfo : License> ⁇ /ipmpmfo : RightsDescriptor> ⁇ /ipmpinfo: IPMPInfoDescriptor> ⁇ /ipmpdidl : Info>
• Table 10 shows another DIDL expression with protection for the Table 8 example. It contains protected video and audio stream and its governance information. It
• ⁇ /ipmpinfo Update> ⁇ /ipmpinfo : ConfigurationSettings> ⁇ /ipmpinfo : ToolDesciiption> ⁇ /ipmpinfo : ToolList> ⁇ ipmpinfo : LicenseCollectior ⁇
• ⁇ ipmpinfo License>... ⁇ /ipmpinfo: License> ⁇ /ipmpinfo : RightsDescriptor> ⁇ /ipmpinfo : LicenseCollection> ⁇ /ipmpinfo : IPMPGenerallnfoDescriptor> ⁇ /Statement> ⁇ /Descriptor>
• ⁇ ipmpdidl Identifier>urn:mpegRA:mpeg21 : dii : isan: 006A-15FA-002B- C95F-B ⁇ /ipmpdidl : Identifier>
• ⁇ ipmpdidl Identifier>urn:mpegRA:mpeg21 : dii : isan: 006A-15FA-002B- C95F-B ⁇ /ipmpdidl: Identifiers
• ⁇ /ipmpinfo License> ⁇ /ipmpinfo : RightsDescriptor> ⁇ /ipmpinfo : IPMPInfoDescriptor> ⁇ /ipmpdidl : Info>
• TV-Anytime metadata such as EPG metadata, package metadata, usage history metadata, segment metadata, and coupons meatadata.
• MAF for DMB Major application area of MAF for DMB is for storage of mobile broadcasting contents.
• Mobile broadcasting contents and EPG metadata for a user to search and select them could be stored in a MAF for DMB file for a next-time usage.
• the xml instance of Table 12 shows an example of Programlnformation and Purchaselnformation.
• 849th Englishcafe program is included in the genre of "edudation/language study" and can be watched free when a user watch advertisements inserted at the program.
• Fig. 11 illustrates an example of package consumption according to an embodiment of the present invention
• Fig. 12 shows package restoration on TV.
• DMB contents such as image, text, applications, slide show, web page, weather information, traffic and travel information can be acquired through IP network at DMB service.
• Each content can be consumed by itself or can be consumed together to provide more effective consumer experiences.
• TV-Anytime defines Package metadata to describe characteristics and composition of such contents collections.
• packaged contents include: multi-angle service of a broadcasting content, photo album service, linguistic educational content service which may consist of main video and additional contents such as today' s expression, scripts of one' s native and foreign language, textual data for structure and vocabulary, and dictionary, etc.
• Package metadata also provide a mechanism expressing options for consumption depending on usage environment (device) and user preference (user) . Then the targeting service, which is defined as automatic matching and delivering relevant content to profiled consumers, could be possible. Additionally, package metadata describes synchronization (temporal) and spatial information between content to allow content to be consumed as the service provider intended. Owing to synchronization information, multi-stream experience (e.g., multi-camera sports, or alternate audio and video documentaries) can be provided with content packaging.
• the xml instance of the following Table 13 shows an example of Package metadata. In this example, a movie about the world best jazz signer, "Ray Charles" and its scripts are used as materials for English Study.
• usage history metadata describes audio-visual content consumption history of a user as a list of actions performed over an observation period.
• the xml instance of the following Table 14 shows an example of usage history metadata. In this example, "Userl" consumed the content identified by the ID, "crid: //www. ebs . co . kr/englishcafe_849" for 15 minutes from the start of the contents.
• a user can also add his bookmark for next-time usage. That is, if bookmark information is stored with the contents, he can selectively consume the contents by just navigating his favourite bookmarked items or segments.
• a segment is a continuous portion of a piece of content.
• segmentation metadata of TV-Anytime is used. Segmentation metadata describe a segment or groups of segments. Segment metadata make it possible to repurpose programs, for example, video highlight, bookmark, and virtual program.
• Fig. 13 shows an example for virtual program which is reconstructed by a user with preference for tennis.
• the xml instance of the following Table 15 shows an example of segment metadata which describes a segment group of bookmarks type.
• Coupons metadata provides the way to signal the existence of coupon, to explain the coupon, and to signal the method to retrieve the coupon.
• MAF for DMB users may store the coupons with the associated contents and may retrieve and use them at any time.
• Fig. 14 presents a usage example of coupons metadata.
• MAF for DMB can wrap user-creative data such as graphics, texts, images, audio, and video in the trak box with the spatio-temporal representation of main DMB A/V contents.
• the representation is performed by a part of Core2D profile of BIFS.
• the user-creative data is classified into the five types and should need the representation information by BIFS.
• the Table 16 shows the BIFS information of the user-creative data as a form of XMT.
• each type of user-creative data has spatial and temporal information.
• the temporal information is described via "par” node in XMT.
• LineProperties denotes color (e.g., RGB) of "Graphic” data, and “geometry” makes the shape of visual data (In this case, line, rectangle, and ellipse are used for user-creative data.)
• transformation describes the location of visual data on the screen, in other words, it enables to display the user-creative data relative to main DMB A/V content.
• ES_ID represents the index of trak referred by the user-creative data except "Graphic” data .
• the user-creative MAF for DMB content is encapsulated by two types of the file format.
• the user-creative data is included in the trak and the mdat box which have media information and real stream of the data, respectively.
• "Graphic" can be directly expressed by only spatial and temporal information of BIFS stream.
• BIFS of remaining data types e.g., text, image, audio, and video
• the user-creative data (except "Graphic") in mdat box can be referred via trak box of MAF for DMB file format.
• Bifs track describes spatio-temporal information of user-creative data.
• "Graphic" data has no referencing resource, so that it can be described via bifs track only.
• the other types of user-creative data refer the embedded resources, trak boxes wrap media information on real streams of user- creative data.
• Fig. 15 shows a file architecture of user-creative data using a "trak" box in accordance with an embodiment of the present invention.
• the MAF for DMB content provider or author can define the player's behavior.
• the examples of the player' s behavior by the MAF for DMB content provider or the author as follows:
• the MAF for DMB content provider can include the single MAF for DMB contents for the advertisement and they want to play it periodically or mandatory. 2. When a user plays the multiple MAF for DMB contents, the player can show the single MAF for DMB content list at first or play the first MAF for DMB content automatically
• the following sub-clauses specify the normative set of the required IPMP Components elements for MAF for DMB.
• the IPMP tool set for MAF for DMB is a subset of MPEG-21 IPMP Components.
• the selection criterion on this tool set is based on the specific application domain of Digital Multimedia Broadcasting.
• Most of the target terminals are to be the hand-held devices of Digital Multimedia Broadcasting.
• IPMP tools should be useful and applicable for MAF for DMB services on such devices.
• the IPMP tool set for MAF for DMB shall include all the elements in the IPMP DIDL schema of
• IPMP Components MPEG-21 IPMP Components. IPMP Information Descriptors in
• MAF for DMB includes the subset of IPMP Information Descriptor schema in MPEG-21 IPMP Components standard. The selected elements with restrictions are as shown in Table 17.
• the ipmpinfo RightsDescriptor element is used for containing rights information that governs the IPMP information.
• the ipmpinfo : RightsDescriptor element under the ipmpinfo: Tool element is for each IPMP Tool.
• the common rights information about all tools in ipmpinfo : IPMPInfoDescriptor can be expressed by the ipmpinfo : RightsDescriptor under the ipmpinfo : IPMPInfoDescriptor .
• IPMP General Information Descriptors in MAF for DMB are composed of a subset of MPEG-21 IPMP Information Descriptor schema m MPEG-21 IPMP Components and MPEG-A Media Streaming Player application format. The selected elements with restrictions are tabulated as shown in Table 18.
• Table 19 presents IPMP information schema.
• IPMP ipmpinfo IPMPGenerallnf oDescriptor
• DMB contents service system user equipment, and remote consumption device
• Fig. 16 shows an architecture of DMB system in accordance with an embodiment of the present invention.
• the DMB system includes a DMB content service system 100 for providing DMB contents according to a multimedia contents access authority of a user, a transmission medium such as a broadcasting network 200, a DMB user equipment 300 for requesting for and using a combined multimedia service, and a transmission medium 400 such as a communication network or the Internet for receiving stored DMB contents through remote control.
• the DMB content service system 100 includes a DMB content authoring unit 101, a DMB file storing unit 102, a control unit 103, a DMB content protecting unit 104, a DMB file formatting unit 105, a combined content transmitting unit 106, a license metadata generating unit 107, a protection metadata generating unit 108, and a detailed information metadata generating unit 109.
• the DMB content service system 100 authors video, audio, image and/or text data into one content through the DMB content authoring unit 101, and the authored DMB content may be stored in a DMB file storing unit 102.
• the control unit 103 controls the detailed information metadata generating unit 109 to generate metadata describing detailed information on the authored DMB contents.
• control unit 103 controls the DMB content protecting unit 104 to encrypt, or protect, the authored DMB content and controls the protection metadata generating unit 108 to generate protection metadata describing information related to the encryption while the DMB content is encrypted. Also, the control unit 103 controls the license metadata generating unit 107 to generate license metadata to be used for generation of license information allowing the DMB content to be used.
• the authored DMB content, detailed information metadata therefor, protection metadata, and license metadata are transmitted to the DMB file formatting unit 105 to be included in one DMB content file, and they are formatted into a form appropriate for transmission through the broadcasting network 200, such as packetization for being transmitted in the form of MPEG-2 transport stream (TS) .
• the DMB content formatted for transmission is delivered from the combined content transmitting unit 106 to the DMB user equipment 300 through the broadcasting network 200.
• the DMB content file generated in the DMB file formatting unit 105 has a file format capable of combining the DMB content including at least one of DMB video, DMB audio, data and combinations thereof, the detailed information metadata describing detailed information on the DMB content, and the protection and governance metadata describing information on protection and governance of the DMB content.
• the detailed information metadata and the protection and governance metadata are selectively included according to an application .
• the DMB video is coded into an MPEG-4 AVC
• the DMB audio is coded into at least one among MPEG layer II audio according to ISO/IEC 11172-3 and ISO/IEC 13818-3, MPEG-4 ER-BSAC audio according to ISO/IEC 14496-3, MPEG-4 HE-AAC version 2 audio according to ISO/IEC 14496-3, and MPEG AAC+SBR audio according to ISO/IEC 13818-7 and ISO/IEC 14496-3 AMDl.
• the data content may be represented in at least one among metadata, image, video, audio, and programming code, or it may be represented in at least one among Joint Photographic Coding Experts Group (JPEG) , Portable Network Graphic (PNG), Multiple-Image Network Graphic (MNG) , Hyertext Markup Language (HTML) , Cascading Style Sheets (CSS), ECMAscript, Java midlet, and Transport Protocol Experts Group (TPEG) .
• JPEG Joint Photographic Coding Experts Group
• PNG Portable Network Graphic
• MNG Multiple-Image Network Graphic
• HTTP Hyertext Markup Language
• CSS Cascading Style Sheets
• ECMAscript Java midlet
• TPEG Transport Protocol Experts Group
• the data content is transmitted through at least one protocol among Dynamic Label Segment (DLS), Multimedia Object Transfer (MOT), and Transparent Data Channel (TDC) .
• DLS Dynamic Label Segment
• MOT Multimedia Object Transfer
• TDC Transparent Data Channel
• the data content may transmit information needed for searching or filtering additional information on DMB video contents or DMB audio contents, DMB video contents or DMB audio contents desired by a user.
• the data content maybe text data for the DMB video content or DMB audio content which are required to be synchronized or not according to time.
• timed text is represented as 3GPP TS 26.245.
• the data content may be user data .
• the detailed information metadata are represented as MPEG-21 DID or TV-Anytime Part 3
• the protection and governance metadata are represented as MPEG-21 IPMP or MPEG-21 REL.
• the combined file format may be represented using an ISO-based file format (ISO/IEC 14496-12), an MPEG-4 file format (ISO/IEC 14496-14), or an MPEG-21 file format (ISO/IEC 21000-9) .
• the combined file format having the aforementioned structure may be one combining a plurality of files into one file, and it may be applied to broadcasting contents other than DMB.
• the DMB user equipment 300 includes a combined content receiving unit 301, a combined content decoding unit 302, a DMB content rendering unit 303, a user equipment control unit 304, and a combined content storing unit 305.
• the combined content receiving unit 301 receives a DMB content transmitted through the transmission media 200 and 400.
• the DMB content file has a format capable of combining the DMB content including video, audio and data, detailed information metadata on the DMB content, and protection and governance metadata describing information on protection and governance of the DMB content into one file.
• the combined content storing unit 305 stores the content of the combined file format received in the combined content receiving unit 301.
• the combined content decoding unit 302 receives the content of the combined file format from the combined content receiving unit 301 or the combined content storing unit 305, and decodes the DMB content based on the protection and governance metadata.
• the DMB content rendering unit 303 renders the DMB content decoded in the DMB content decoding unit 302.
• the user equipment control unit 304 controls the combined content storing unit 305 to store the content of the combined file format received through the combined content receiving unit 301, or controls the combined content decoding unit 302 to decode the content of the combined file format received through the combined content receiving unit 301.
• the user of the DMB user equipment 300 may directly receive the DMB content file through the DMB content service system 100, or the user may store the DMB content file in a storage such as Personal Data Recorder (PDR) and Networked Data Recorder (NDR) via the transmission medium 400, such as a communication network or the Internet, in a remote place.
• the requested DMB content file can be received through the combined content receiving unit 301, and the received DMB content file may be decoded using a user license in the combined content decoding unit 302 or stored in the combined content storing unit 305 in the DMB user equipment 300.
• the DMB content rendering unit 303 of the DMB user equipment 300 renders the decoded DMB content.
• the user equipment control unit 304 When a DMB content the user wants to consume is stored in an external storage or when a DMB content is to be stored not in a built-in storage of the DMB user equipment 300 but in an external storage, the user equipment control unit 304 performs remote control to consume or store the DMB content in the external storage through the transmission medium 400 such as a communication network or the Internet.
• Fig. 17 is a flowchart describing a DMB content generating method in accordance with an embodiment of the present invention.
• a DMB content including at least one among DMB video, DMB audio and data is authored.
• detailed information metadata are authored to describe detailed information of the DMB content.
• the DMB content is encrypted, and encryption information and protection and governance metadata describing license information of a specific user are generated.
• the encryption information includes encryption tool information, decryption key information, and encryption parameter information
• the license information includes the number of restoration, license purchaser or user equipment, and restoration valid time.
• Fig. 18 is a flowchart describing a DMB content generating method in accordance with another embodiment of the present invention.
• a DMB content including at least one among DMB video, DMB audio and data is authored outside and inputted from the outside and detailed information metadata describing detailed information on the DMB content are not generated in the present embodiment .
• step S1802 license metadata describing license information of a specific user for the DMB content are generated.
• step S1804 the DMB content is encrypted according to the license information.
• step S1806 encryption metadata describing encryption information are generated.
• step S1808 the above- authored DMB content, the license metadata, and the encryption metadata are combined into one file format.
• Fig. 19 is a flowchart describing a DMB content restoring method in accordance with an embodiment of the present invention.
• a content of a combined file format (which is a DMB content file) capable of combining a DMB content including at least one among DMB video, DMB audio and data, detailed information metadata describing detailed information of the DMB content, and protection and governance metadata describing protection and governance of the DMB content.
• the content of the combined file format which has received according to the detailed information metadata is stored.
• the DMB content is decrypted according to the protection and governance metadata, and the decrypted DMB content is rendered in step S1908.
• Fig. 20 is a flowchart describing a DMB content restoring method in accordance with another embodiment of the present invention.
• a DMB content of a combined file format capable of combining a DMB content including at least one among DMB video, DMB audio and data, detailed information metadata describing detailed information of the DMB content, and protection and governance metadata describing protection and governance of the DMB content is searched and filtered based on the detailed information metadata.
• step S2004 the content of the combined file format is parsed, and a user or a user equipment is authenticated by parsing the protection and governance metadata.
• information needed to decrypt the DMB content is extracted using the parsed protection and governance metadata.
• the content of the DMB content is presented through an interface of the user equipment by parsing the detailed information metadata.
• a corresponding content is extracted, decoded, and restored according to a content execution command from the user.
• a DMB remote consuming apparatus 500 includes a control unit 501, a combined content receiving unit 502, a combined content storing unit 503, and a combined content streaming unit 504.
• the combined content receiving unit 502 receives a DMB content from a DMB content service system 100 through a broadcasting network 200.
• the combined content storing unit 503 stores the DMB content file received in the combined content receiving unit 502.
• the combined content streaming unit 504 provides the DMB content file stored in the combined content storing unit 503 to a DMB user equipment 300 in the form of streaming.
• the control unit 501 receives a request for storing or consuming a DMB content file from the DMB user equipment 300. When it receives a request for storing a DMB content file, it controls the combined content receiving unit 502 to receive the DMB content file from the DMB content service system 100. When it receives a request for consuming a DMB content file, it calls a DMB content file stored in the combined content storing unit 503 and provides it to the DMB user equipment 300 through the combined content streaming unit 504.
• the DMB user equipment can remotely access to the control unit 501 through a transmission medium 400.
• the DMB remote consuming apparatus 500 can receive the request for storing or consuming the DMB content from the DMB user equipment 300 through the transmission medium 400 such as a communication network and the Internet, and it transmits the request to the control unit 501 of the DMB remote consuming apparatus 500.
• the control unit 501 can receive the DMB content of the combined file format in the combined content receiving unit 502, or it can call a DMB content of the combined file format stored in the combined content storing unit 503 and provides it to the DMB user equipment 300 through the combined content streaming unit 504 in the form of streaming.
• the transmission medium 400 such as a communication network and the Internet
• step S2202 a DMB content file is received from the DMB content service system 100 upon a request from a user equipment 300.
• step S2204 the received DMB content file is stored upon a request from the DMB user equipment 300.
• step S2206 the stored DMB content file is provided to the DMB user equipment 300 upon a request from the DMB user equipment 300.
• the method of the present invention may be authored as a computer program. Codes and code segments constituting the program may be easily induced by a computer program of ordinary skill in the art to which the present invention pertains. Also, the authored program may be stored in a computer-readable recording medium, which is a data storage, and read and executed on a computer to thereby realize the method of the present invention.
• the recording-medium includes all kinds of recording media that can be read by a computer, including not only tangible media such as CD and DVD but also immaterial media such as sub-carrier.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Multimedia (AREA)
• Theoretical Computer Science (AREA)
• Computer Security & Cryptography (AREA)
• Databases & Information Systems (AREA)
• General Engineering & Computer Science (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Applications Claiming Priority (3)

Publications (2)

Family

ID=39314224

Family Applications (1)

Country Status (3)

Cited By (1)

Families Citing this family (4)

Family Cites Families (5)

• 2007
  • 2007-10-17 WO PCT/KR2007/005085 patent/WO2008048046A1/en not_active Ceased
  • 2007-10-17 EP EP07833394A patent/EP2084902A4/de not_active Withdrawn
  • 2007-10-17 KR KR1020070104556A patent/KR100976729B1/ko active Active

Also Published As

Similar Documents

Legal Events