KR20100136605A - Method and system of providing enhanced tv program service - Google Patents

Abstract

PURPOSE: A general A/V contents and a linkage type data broadcasting contents service providing method and a system thereof by synchronizing offered data contents are provided to supply data broadcast for a contents developer by efficiently synchronizing broadcasting data. CONSTITUTION: An MPEG(Music Player Expert Group)-7 file generating unit(12) analyzes the scene of broadcast data and generates the MPEG-7 file recording a scene keyword. An expansion BIFS(Binary Format for Scene Description) file generating unit(14) generates the expansion BIFS file inserting the scene keyword into the BIFS code. The BIFS code describes a condition indicating the advertisement contents in the user terminal.

Description

Method and system for providing linked data broadcasting contents service {METHOD AND SYSTEM OF PROVIDING ENHANCED TV PROGRAM SERVICE}

The present invention relates to a method and system for providing data broadcasting, and more particularly, to providing data contents in combination with audio / video (A / V) provided by general TV broadcasting. A method and system for providing data broadcasting in synchronization with contents are provided.

Data broadcasting refers to broadcasting that provides various additional services by transmitting multimedia data to the user along with existing audio / video data. Here, data is a generic term for data such as executable application programs and text, images, graphics, and the like used in the application.

Data broadcasting is a standalone data broadcasting service (or standalone service, virtual channel service) and linked data broadcasting service (or interlocking service, enhanced) depending on whether it is combined with A / V (Audio / Video) data provided by general TV broadcasting. TV Program Service). Stand-alone data content is content written only with text, graphics, images, etc., without A / V signals. It is a service that provides users with programs similar to existing Internet pages. Since this standalone data content is not related to the A / V program, it is serviced in a channel allocated separately for the data content (eg, news, weather information, stock information, etc.). The linked service is a type of service that sends and displays additional data when transmitting A / V signal, which is a main service of broadcasting (for example, checking news and stock quotes while watching a drama or movie, or watching sports relaying. Services that simultaneously provide data such as records).

Meanwhile, the linked service may be classified into time-independent data content and time-dependent data content according to whether time affects the change of data content.

The time independent data content is a type in which a change in a video image, that is, a change in a scene, does not affect data content conversion, and refers to a type in which the content of the content is changed by a user input event such as a mouse event. This type of content has a problem in that the change of data content contents is entirely dependent on the user, and the producer cannot forcibly change the data content.

The time-dependent data content refers to a form in which the content of the data content changes according to the change of the scene, and corresponds to a case where the content correlation of the data content to be shown and the image currently being broadcast is high. For example, providing an interface for solving problems together while watching a quiz show, or providing additional information for each scene while watching a drama, and changing the information according to the scene are typical examples of time-dependent data contents.

DMB's TV content is expected to be more actively used time-dependent data content for future advertisement and additional information representation due to the broadcast feature that always has a background video layer. Unlike time-independent content, such time-dependent data content can naturally expose data suitable for a scene at the intention of a producer without user input. Therefore, such linked content may be a means of generating new revenue in DMB broadcasting, which has a 'B2B' revenue model that depends on companies' advertisements. However, time-dependent data content is a service that is not easy to implement even in a DTV environment, and it is difficult to find a type currently being serviced because it is not easy to produce in DMB.

MPEG-4 expresses objects that are components of a scene in a scene graph as in VRML (Virtual Reality Modeling Language). MPEG-4 is based on VRML, but is described using a binary format for scene description (BIFS) for file compression. BIFS refers to the MPEG-4 scene description standard for spatial location, temporal relationship representation, and user interaction with multimedia objects. Here, the scene refers to a screen constituting the content, and includes a plurality of media objects such as still images, text, video, and audio in one scene.

On the other hand, MPEG-4 uses BT, XMT-α, and XMT-Ω as data description methods, and provides different time representation methods according to these code description methods. In other words

(1) How to enter absolute time

BIFS and XMT-α can describe the time when the change of the graphics object should take place by inputting an absolute time value in milliseconds using the <AT> node (see the left figure of FIG. 1).

(2) how to use SMIL 2.0 elements

The XMT-Ω accommodates SMIL 2.0 elements, such as <seq>, <par>, and <excl>, for the time synchronization one step further than BIFS and XMT-α (the right side of FIG. 1). See illustration).

Since time ultimately means the flow of video images in time-dependent content, it is essential to implement synchronization between other multimedia objects including video images and graphics objects in order to implement time-dependent content. However, the present time method of MPEG-4 provides a method of time synchronization between graphics objects, which is not a method for synchronizing video objects with graphics objects required for constructing time-dependent data content. Therefore, the current MPEG-4 does not provide any link between the video content and the graphics object, and therefore, the following problems occur when producing time-dependent data content.

(1) It is not easy to insert the data content into the appropriate scene

In order to synchronize video and graphics objects according to scenes during content creation, developers must first carefully examine the length of video content and check the appropriate time value for each data content to appear. And, based on this time value, you have to take the inconvenience of having to rewrite the data contents once again created as a whole.

(2) Difficult to modify / edit the overall content

Even in broadcast contents that have been created once, editing and correction of video data occurs frequently according to the production purpose. However, since the code is described so that the content appears on the basis of an absolute time value, the appearance time of the data content does not change automatically even if the video data is modified and edited. Therefore, in this case, in order to synchronize the data content and the video object, it is necessary to modify the time value previously created as a whole.

(3) A problem arises in the repetition technique of graphic data.

Currently there is no concept of data modularity in BIFS. This is also a problem caused by the absence of a link between the scene and the data content. Thus, even if the same graphics data is repeated many times and they only differ in the time value they appear, the same code should be described repeatedly with only the number of appearances per appearance time. Therefore, the size of the data is unnecessarily large due to the redundant code.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems in the prior art, and one object thereof is to provide a method and system capable of providing data broadcasting by efficiently synchronizing content data with general broadcasting data.

It is another object of the present invention to provide a data broadcaster by efficiently synchronizing content data with general broadcast data without the content developer arbitrarily dividing the content data based on time information and matching the general broadcast data. And to provide a system.

It is still another object of the present invention to examine data contents of general broadcasting data and to easily insert data contents according to the change of scene of general broadcasting data without complicated operation such as checking the time value at which data contents appear. It is to provide a method and system that can provide.

Another object of the present invention is a method and system that can provide data contents in synchronization with the edited / modified general broadcast data without the complicated work of manually changing the appearance time of the data content even if the general broadcast data is edited / modified. To provide.

In order to achieve the above object, according to the present invention there is provided a data broadcasting service method for synchronizing the advertising data content with the broadcast data to provide to the user terminal, the method (A) by analyzing the scene of the broadcast data prepared in advance, Generating an MPEG-7 file in which the scene keyword associated with the scene is recorded in the broadcast scene in which the advertisement data content is to be displayed; (B) generating an extended BIFS file in which the same scene keyword as the scene keyword is inserted into a BIFS code describing a condition for displaying the advertisement data content on the user's terminal; (C) analyzing / analyzing the MPEG-7 file and the extended BIFS file, and converting the MPEG-7 file into a code that can be recognized by a general terminal; (D) muxing the code converted in the step (C) and the broadcast data and the advertisement data content, and integrating it into one broadcast, and transmitting the same to a user's terminal.

In one embodiment, in the step (A), the scene keyword is recorded in a node newly defined so that information about the scene can be described in MPEG-7 of Video Segment Description Scheme format, so that the MPEG-7 file is stored. The MPEG-7 of the Video Segment Description Scheme format may include a node for indicating a start time and a progress time of a scene associated with the scene keyword.

In one embodiment, in step (B), the extended BIFS file may include a BIFS code in which a node capable of describing the scene keyword is further defined, and the node further defined in the BIFS code may include multiple attributes. It can be defined to have.

In one embodiment, extracting and interpreting values of a node newly defined in the MPEG-7 file and a node further defined in the extended BIFS file in step (C), so that any scene of the broadcast data is displayed in the advertisement data. Determine if it is related to the content.

According to another aspect of the present invention, there is provided a data broadcasting service system for synchronizing advertisement data contents with broadcast data and providing the same to a terminal of a user, wherein the system is a data input module that analyzes a scene of broadcast data prepared in advance, An MPEG-7 file generation unit that generates an MPEG-7 file that records a scene keyword associated with the scene in a broadcast scene where the data content is to be displayed, and a BIFS code that describes a condition for displaying the advertisement data content on a user's terminal. A data input module including an extended BIFS file generation unit for generating an extended BIFS file into which the same scene keyword as the scene keyword is inserted; An interpreter module which processes a file input from the data input module and generates a file transmitted to a user terminal. The terminal interprets / analyzes an MPEG-7 file and an extended BIFS file input from the data input server. An interpretation / conversion unit for converting the code into a recognizable code, and a file converted by the interpretation / conversion unit with the previously prepared broadcast data file and the advertisement content data file, and integrated into a single broadcast to generate an MP4 file. It characterized in that it comprises the interpreter module that includes an integrated unit.

According to the present invention, content data can be efficiently synchronized with general broadcast data. That is, the content developer can provide data broadcasting by efficiently synchronizing the content data with the general broadcast data without arbitrarily dividing the content data based on the time information and matching the general broadcast data. In addition, according to the present invention, it is possible to provide data broadcasting by easily inserting the data contents according to the change of the scene of the general broadcasting data without the complicated work such as checking the time value at which the data contents will appear. Even if it is edited / modified, the data content can be provided by synchronizing with the edited / modified general broadcast data without the complicated work of manually changing the appearance time of the data content.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings. In the following description, descriptions of configurations and operations of which are well known in the art will be omitted. Even if this description is omitted, those skilled in the art will be able to easily understand the configuration and operating principle of the present invention through the following description.

1. Concept of content-based synchronization of the present invention

The present inventors conducted a study on the time representation of the data content in order to solve the above problems of the conventional data broadcasting. In particular, the research focused on the time synchronization of video objects and graphics objects that can improve the efficiency of linked data content production. As a result, the content-based contents can be changed according to the content of video content. The synchronization technique was completed.

2 schematically illustrates the concept of content-based synchronization proposed in accordance with the present invention. Content-based synchronization proposed in the present invention is a concept that the data content is changed according to the content of the video, that is, the video scene. The fact that the data content can be changed according to the scene of the video means that the video scene itself and the data content itself are organically connected instead of being synchronized through the absolute time values of the video scene and the data content. Therefore, since the data content changes according to the video scene, the content developer does not have to perform the cumbersome procedure of checking the appearance time of the content and mapping the data content once again to the absolute value of time.

The present invention proposes a method of expressing the appearance time of data content based on the content of a video scene, rather than describing the time representation of the data content in an absolute time value or SMIL language for such content-based synchronization. In this regard, the present invention uses a scene keyword that can represent a video scene to express the time of appearance of the data content based on the content of the video scene. Instead of describing the absolute time value at which each data appears, we describe the graphics object based on scene keywords.

Describing data content in this way allows the data content to depend on the video scene itself rather than on an absolute time value. Therefore, even if the video data is re-edited, the video data and the data content are connected based on the scene keyword, thereby solving various inconveniences caused by the production of the linked content.

2. Content-based Synchronization Technique for Time Representation of Data Contents

According to the present invention, there can be two methods as follows to implement content-based synchronization.

(1) how to define new languages with content-based synchronized representation

If you define a new language and implement it to represent all of the concepts of content synchronization, this would be the simplest form of development. However, since BIFS and MPEG-4 are already used as standards in various broadcast fields, developing new languages to replace them is not practical and, if any, will remain at a very low level. In addition, it is also necessary to develop a browser that can compose a scene by interpreting a new language, which also has a difficulty in overcoming implementation and effectiveness.

(2) extension of BIFS

If BIFS is extended to define content-based synchronization and use a module that can interpret it, the above problems (1) can be solved.

This method is a concept of developing a content using the concept of content synchronization in the development stage, and using the preprocessor to change the existing code before transmitting the newly defined nodes to the user terminal for this purpose, It is the first concept and constitutes one important feature of the invention. Therefore, this method is not burdened with the development of new browsers, and the disadvantages of the BIFS standard in the development stage (e.g. BIFS is a language based on VRML for expressing PC-based 3D virtual environment. Therefore, the standard is too complex to be applied to the mobile broadcasting environment as it is, and the current BIFS standard does not consider the broadcasting environment, so the technology for linking video and data objects is weak. can do. In addition, the data content is not always developed in real time according to the broadcast transmission time, but is always prepared in advance before the broadcast, so the use of the preprocessor does not affect system performance and broadcast transmission. Therefore, the present invention implements content-based synchronization through extension of BIFS nodes and modules (tentatively referred to as "interpreters") that can interpret them.

3. Content-based synchronization system diagram

3 schematically illustrates the overall configuration of a content-based synchronization system according to the present invention.

As shown, the content-based synchronization system of the present invention can be divided into three parts.

(1) video scene analysis

In this step, the video image data of the broadcast content is analyzed, the semantic annotation of the video scene is recorded, and the output is generated as an MPEG-7 file.

(2) create advertising data content

This part connects the data contents constituting the advertisement with the keywords used for video scene analysis. In this step, the content is described using the node defined for the keyword expression proposed in the present invention so that the keyword can be described in the BIFS data code. After this is done, an output file in XMT format with scene keyword information added to the BIFS code is created.

(3) interpreter for time synchronization

This step connects video images and advertisement data contents based on keywords. The video scene analysis result file and the result file of the advertisement data content generation step are used as input data of the interpreter. The interpreter adds a node defined for the keyword expression to change the produced content into existing BIFS code provided to the user. Therefore, through the interpreter, the scene graph created by the time expression method of the existing BIFS is generated, and the final file MP4 file which is integrated with the video image, the advertisement content data, and optionally other multimedia data is transmitted to the user terminal.

4. Work Scenario

4 schematically illustrates the concept of a content development scenario in accordance with the present invention.

In the content-based synchronization system proposed by the present invention, data contents may be created in the following order. First, an advertisement company prepares advertisement data content that they want to appear on the broadcast. On the broadcasting station side, for example, a supervisor creates a document (storyboard) describing data content that should appear in accordance with the video content. This storyboard describes which scenes are associated with which advertising content, and specifies the video scene keywords to use. For example, "'Song Hye Kyo wearing a dress' shows 'Ad Content # 1' and the scene keyword to be used at this time may be 'Song Hye Kyo Dress'.

When this is done, the video analysis team at the broadcasting station analyzes the video data based on the written storyboard, and inserts keywords for each major scene to connect the scenes and keywords. At the same time, the content developer of the broadcasting station rewrites the advertising data content received from the advertising company based on the storyboard, and simply inserts the advertising content and the scene keyword corresponding thereto.

When all of the above work is completed, an interpreting process is performed to produce the created files as a final broadcastable broadcast. At this time, MPEG-7 file and XMT file which are the result of video analysis and content generation are used as input files, and the BT file modified by the existing code, which is the output file of the interpreter, is muxed with other multimedia files.

5. Implementation of Content-Based Synchronization System

(1) Defining Node Extensions in BIFS

In the present invention, a scene keyword is defined through a node called <SCENE>. For the convenience of developers, nodes are defined and extended based on XMT to enable content development without prior knowledge of BIFS.

In the present invention, the <SCENE> node may describe a keyword used in a feature-length expression as an attribute value and is defined to have multiple attributes. Having multiple attributes in this way can reduce the number of lines of code in the content that need to be described during production when writing the content. In other words, an attribute value of an element is an attribute, and by defining a <SCENE> node to have multiple attributes, for example, BIFS code for 'one piece' that appears in multiple scenes can be written at once. It is possible to reduce the repetition. In addition, <SCENE> node is defined as a child node of <BODY> node, which is a child node of <XMT-A> which is a root node, and defined to have <Transform2D> node and <Children> node as child nodes. The <Transform2D> node and the <Children> node are nodes that appear in BIFS code, and are defined in the standard. Therefore, descriptions thereof are omitted. 5 shows an example of content described using the scene expression node defined as above.

(2) video keyword information representation

In developing the content in the manner proposed by the present invention, a task of generating video scene keyword information should be performed first. Through the video keyword information representation, scene information can be described at a desired position of an image. Therefore, it should be possible to record annotations for video scenes at the beginning of the critical scenes of video data. In MPEG-4, the following two methods are largely used.

① How to use MPEG-4 OSCI Descriptor

First, it uses the OCI (Object Content Information) Descriptor defined in the MPEG-4 standard. The OCI Descriptor is included in an MPEG-4 file to provide additional information of an audio / video object. The MPEG-4 system provides OCI to provide a coded representation of the description content of A / V information. The OCI Descriptor may describe information describing an A / V object, a content classification descriptor, a keyword descriptor, a rating descriptor, a language descriptor, a textual descriptor, a creator name, a creation date, and the like.

In BIFS, metadata can be written through segment descriptor in OCI Descriptor of video object. The Segment Descriptor can describe each part of the video so that it can describe the name, startTime, and duration. This allows control to move to specific parts of the video when using OCI. However, the present invention is not intended to control reproduction to a specific portion, and scene start and end time extraction according to scene keywords is required. Therefore, it can be said that the method of using OCI is not suitable for the present invention.

② How to use MPEG-7 metadata as one ES

Another method is to transfer a metadata file of MPEG-7 format together as one of MPEG-4 ES (Elementary Stream) when transmitting MPEG-4 file. MPEG-7 is the standard for video technology. Accordingly, MPEG-7 has a Video Segment Description Scheme, which is a description scheme for video data. The Video Segment Description Scheme is an extended form to apply the Segment Description Scheme to not only video but also to groups of frames that are not connected in time or space. An example of the MPEG-7 Video Segment Description Scheme is shown in FIG.

In addition, MPEG-7 metadata may be muxed into one MP4 file along with other media files constituting the content. Additional information that may be searched by the characteristics of the A / V may be provided, or additional information for text search may be provided as well as plot information of MPEG-4 content.

③ Utilizing MPEG-7 Metadata in Content Development

However, when MPEG-7 is transmitted to one ES, a problem arises in that a user terminal needs to have a separate function for processing the MPEG-7. Accordingly, the present inventor has conducted a study to generate metadata using a Video Segment Description Scheme, which is a description scheme for video data of MPEG-7, but to use it in a development stage without transmitting it to a user terminal.

In fact, in order to realize a true video semantic, it may be the best approach to use Nodes such as Person and Event to understand what the current shot is. However, in reality, it is not unreasonable and time-consuming / labor-consuming for a developer to write all the characters and events correctly for every scene. In addition, it is necessary to reanalyze all contents of person and evenet that appear in the interpreter to extract time information of data content insertion.

Therefore, in the present invention, information about a scene is described quickly and easily by using a <FreeTextAnnotation> node. In the present invention, words that can be used as keywords in the BIFS file extended in <FreeTextAnnotation> are enumerated. When using <FreeTextAnnotation>, the interpreter searches for the shot's <FreeTextAnnotation> portion of the shot used in the input BIFS file, and the <MediaTimePoint> and <MediaDuration> of the Shot with the matching keyword in <FreeTextAnnotation>. It is configured to read the value of.

The <MediaTime> node is an element that can record time information of each scene, and has <MediaTimePoint> indicating the start time of the shot and <MediaDuration> indicating the progress time as sub nodes (see FIGS. 6 and 7). .

(3) interpreter module

① Analysis module

The parsing module analyzes the metadata of video written in MPEG-7 and extracts the value of the <FreeTextAnnotation> node, which is the necessary information, and the attribute value of the <SCENE> node in the extended-defined BIFS file. This module checks whether they are related to each other.

② Code conversion module

This module converts the data contents created based on the nodes defined in the present invention into existing codes. This module consists of a time conversion module that creates an AT node by converting it to absolute time based on the scene keyword, and a scene-specific event addition module that adds a node and a ROUTE node for a scene update.

The interpreter adds an <AT MediaTimePoint value> to ensure that the ad content appears exactly at the start of the shot through time conversion. Add an <insert> node to change the scene, add <AT MediaTimePoint + MediaDuration>, and delete node to make the ad content disappear at the end of the shot.

③ integrated module

The integration module is responsible for creating a single MP4 file by muxing each data content written in multiple BIFS into a single broadcast.

6. Example

Hereinafter, the present invention will be described in more detail with reference to embodiments in which the above-described concepts of the present invention are more specific.

9 illustrates an exemplary system embodying the present invention described above, and in FIG. 10 is a flowchart illustrating a method of effectively linking advertisement data contents to general broadcast data using such a system. Meanwhile, in the embodiment shown in FIG. 9, the file generation module and the interpreter module are provided separately, but it should be understood that this is only one embodiment. That is, the present invention is not particularly limited with respect to the implementation form such that they can be made as one module and can be implemented in the form of a server.

First, prepare general broadcast data (A / V File) 16 to be transmitted to a user's terminal (eg, a mobile communication terminal) through a conventional broadcasting communication network such as DMB, IPTV, DTV, Internet broadcasting (S10). The advertisement data content 17 to be transmitted together with the prepared broadcast data is prepared (S12). The broadcast data is prepared by the entity that broadcasts the broadcast, for example, by the broadcasting station, and the advertisement data is prepared by the advertising company that wants to broadcast the advertisement along with the specific broadcast.

The broadcaster side, for example, the supervisor of the broadcaster, who has been commissioned by the advertising company, writes a document (storyboard) describing the advertising data contents that should appear according to the broadcast contents. It is described. For example, as described above, "'Song Hye Kyo wearing a dress' 'Ad content # 1' appears and the scene keyword to be used at this time 'Song Hye Kyo One Piece' can be carried out in a manner such as" S14).

Subsequently, the video analysis team analyzes scenes of the video based on the created storyboard using a scene analyzer as shown in FIG. 8 (S16), and in some cases, extracts main scenes. Such scene analysis may be performed using a conventional scene analyzer which is well known, and the present invention is not particularly limited in relation to the scene analysis method.

Subsequently, the MPEG-7 file generation unit 12 inserts keywords for each major scene of the video in a format such as the MPEG-7 Video Segment Description Scheme shown in FIG. A metadata file of MPEG-7 format to be connected is generated (S18). One example of MPEG-7 metadata in which such scene keyword annotation is inserted is shown in FIG. 7. As shown, in the present invention, a <FreeTextAnnotation> node is newly defined so that information about a scene can be described quickly and easily. As such, because it defines a new node that is out of standard, an interpreter, such as the interpreter described below, is provided to analyze and interpret it, and this module includes a shot keyword used in an extension-defined BIFS file. It searches for a match and reads the values of <MediaTimePoint> and <MediaDuration> of the Shot that has the matching keyword in <FreeTextAnnotation>. Repeat this for the scenes where you want to insert keywords.

At the same time as generating the MPEG-7 file, the content developer of the broadcasting station rewrites the advertisement data content received from the advertising company based on the storyboard. That is, the time value is assigned to the scene to appear. The advertisement data contents are created in the form of the extended BIFS proposed by the present invention, and then changed into existing BIFS codes that can be interpreted by the interpreter by the interpreter, and are transmitted to the terminal of the user together with other multimedia files constituting the broadcast. According to the contents defined in the code, the advertisement data contents are output together with the broadcast data at a specific time (scene), and the present invention is effective in the development stage for outputting such advertisement data contents to the user's terminal in a specific scene of the broadcast data. It is for inserting advertisement data into a specific scene. To this end, similar to the MPEG-7 file generation, the present invention extends the node of BIFS to add a new node to an existing BIFS code to represent a scene keyword. That is, as shown in Fig. 5, the present invention further defines a node called <SCENE> in the BIFS code. This newly defined node is extended and defined based on XMT to enable the development of contents without prior knowledge of BIFS for the convenience of developers. In this way, the extended BIFS file is generated through the extended BIFS generation unit.

The <SCENE> node can describe the keyword used in the feature-length representation as an attribute value, and defines that it can have multiple attributes. Having multiple attributes reduces the number of lines of code of content that must be described in the production stage when creating the content. You can. In addition, the <SCENE> node is defined as a child node of a <BODY> node (a child node of <XMT-A> which is a root node) and defined to have a <Transform2D> node and a <Children> node as child nodes. 5 shows an example of content described using the scene representation node defined as above.

By inserting the scene keyword into the extended-defined <SCENE> node as described above, the specific scene and the keyword are associated with each other, and finally with the scene keyword of the MPEG-7 file, so that the interpreter later interprets it to produce a specific scene of the video. The predetermined advertisement data content matching the keyword can be output to the user's terminal.

As in the MPEG-7 file generation, the above process is repeated for each desired scene, thereby completing the extension-defined BIFS file generation operation.

Referring back to FIG. 9, the MPEG-7 file 12 and the extended BIFS file 14 created according to the above process are sent to the interpreter 20. That is, since the MPEG-7 file 12 and the extended BIFS file 14 extend their attributes differently from the standard, the general terminal or the browser cannot read the code, so the general terminal can recognize and analyze the code. There is a task to convert to a code that is present, the interpreter 20 performs this role.

The interpreter 20 first interprets the MPEG-7 file 12 and the extended BIFS file 14 to extract necessary information and convert the necessary information into an existing code that can be recognized by a general terminal. Specifically, the interpretation module 22 of the interpreter 20 analyzes metadata of video written in MPEG-7, extracts the value of the <FreeTextAnnotation> node which is necessary information, and extracts the value of the <SCENE> node of the extended-defined BIFS file. By extracting and interpreting attribute values, it is possible to determine which scenes are related to each other (S22).

As described above, since the MPEG-7 file 12 and the extended BIFS file 14 are out of the standard, the MPEG-7 file 12 and the extended BIFS file 14 need to be converted into existing codes, and the conversion module 24 performs this role. That is, the conversion module 24 is composed of a time conversion module for creating an AT node by converting it to absolute time based on the scene keyword and an event addition module for each scene adding a node and a ROUTE node for a scene update. To make the ad content appear exactly at the start of the shot, the interpreter adds an <AT MediaTimePoint value>, adds an <insert> node to change the scene, and makes the ad content disappear at the end of the shot. MediaTimePoint + MediaDuration> is added and a delete node is added to generate a BT code (S24). The first interpreting process of such an interpreter is exemplarily illustrated in FIG. 11.

After performing the first interpreting process, the integration module 26 of the interpreter 20 generates a file to be transmitted to the user's terminal. In detail, the integration module 26 may convert the BT code generated through the first interprinting process into the BT data generated from the broadcast data, that is, the A / V file 16 and the advertisement content data 17 (for example, refer to FIG. 4). ), MP4 files 30 are combined to fit one broadcast, and in some cases, other multimedia files 18 may be integrated to generate MP4 files. Is transmitted to the user's terminal and output on the terminal, and the advertisement content data is output in a specific scene. This is not a content constituting the present invention, and the process of performing shopping and the like by combining the BIFS code and the broadcast is already well known, and therefore, subsequent sections The description of the car is omitted.

According to the present invention described above, it provides various advantages over the conventional method for providing data contents. In other words, it is possible to differentiate work during content development, such as advertising content development part, video analysis part, and final interlocking broadcast development part, and to work on advertising data content in advance, and it is work of video analyst and content developer. This can be done at the same time.

In particular, inserting / removing the advertising data contents in time can be replaced by a module called an interpreter, which reduces the work of the pre-transmission step, and even if the broadcast data is re-edited, it is necessary to modify the advertising data contents in time. (I.e., in the present invention, since the advertisement data is output to a specific scene of the video data, even if the editing is performed such that the time of the specific scene of the video data is modified, there is no need to modify the advertisement data to that time). Can solve labor consuming work

Further, according to the present invention, although the advertisement content is subordinate to one broadcast program, the advertisement content can be made in advance, and can be reused in various programs. For example, if a dress made by a company called Loem advertises concurrently in dramas A and B, it does not separate files according to the conventional method. Since the content must be described in a way, it cannot be directly applied to drama B. However, according to the present invention, the advertisement content for the LoM One Piece is created by a data content advertising company, for example, and the broadcasting station only matches the time when the contents appear. Therefore, if you want to use the once-created one piece ad content for both dramas A and B, it is a simple task to describe the scene of drama only once in the scene description of Drama A (that is, using BIFS defined) and once in the drama B scene description. You only need to do it.

Although the present invention has been described with reference to preferred embodiments, the present invention is not limited to these embodiments. That is, the embodiments may be variously modified and modified within the scope of the following claims, and all of them fall within the scope of the present invention. Accordingly, the invention is limited only by the following claims and equivalents thereof.

1 is a diagram illustrating a method of representing time according to the data description method of MPEG-4.

2A and 2B schematically illustrate the concept of the present invention.

3 is a diagram conceptually showing the overall configuration of a content-based synchronization system according to the present invention.

4 is a diagram schematically illustrating a concept of a content development scenario according to the present invention.

5 illustrates an example of a BIFS code in which a node is newly added to insert a scene keyword according to the present invention.

6 is a diagram illustrating an example of an MPEG-7 Video Segment Description Scheme.

7 is a diagram illustrating an example of MPEG-7 metadata with a scene keyword annotation inserted.

8 is a diagram illustrating an example of analyzing a scene by using a scene analyzer and an example of extracting a representative scene.

9 is a block diagram showing main components of a data broadcasting system according to an embodiment of the present invention.

10 is a flowchart illustrating a process of providing a data broadcasting service according to an embodiment of the present invention.

11 is a diagram illustrating an example of a code of a file input to an interpreter and a BT code converted through the interpreter.

Claims (13)

A data broadcasting service method for synchronizing advertisement data contents with broadcast data and providing the same to a user terminal. (A) analyzing a scene of the broadcast data prepared in advance, and generating an MPEG-7 file in which the scene keyword associated with the scene is recorded in the broadcast scene where the advertisement data content is to be displayed; (B) generating an extended BIFS file in which the same scene keyword as the scene keyword is inserted into a BIFS code describing a condition for displaying the advertisement data content on the user's terminal; (C) analyzing / analyzing the MPEG-7 file and the extended BIFS file, and converting the MPEG-7 file into a code that can be recognized by a general terminal; (D) muxing the code converted in the step (C) and the broadcast data and the advertisement data content, and integrating them into a single broadcast and transmitting them to a user's terminal. Data broadcasting service method comprising a. The method according to claim 1, wherein in the step (A), the scene keyword is recorded in a node newly defined so that information about a scene can be described in MPEG-7 of a Video Segment Description Scheme format, so that the MPEG-7 file is generated. Data broadcasting service method, characterized in that. The method according to claim 2, wherein the MPEG-7 of the Video Segment Description Scheme format includes a node for indicating a start time and a progress time of a scene associated with the scene keyword. The method according to claim 2 or 3, wherein in step (B), the extended BIFS file includes a BIFS code in which a node capable of describing the scene keyword is further defined. The method according to claim 4, wherein the node further defined in the BIFS code is defined to have multiple attributes. The method according to claim 4, wherein in step (C), values of nodes newly defined in the MPEG-7 file and nodes further defined in the extended BIFS file are extracted and interpreted, so that any scene of the broadcast data is associated with advertisement data contents. A data broadcasting service method, characterized in that it is determined whether or not it is related. A data broadcasting service system for synchronizing advertisement data contents with broadcast data and providing the same to a user terminal. A data input module comprising: an MPEG-7 file generating unit for analyzing a scene of broadcast data prepared in advance and generating an MPEG-7 file recording a scene keyword associated with the scene in a broadcast scene in which advertisement data content is to be displayed; A data input module including an extended BIFS file generation unit for generating an extended BIFS file in which the same scene keyword as the scene keyword is inserted into a BIFS code describing a condition of displaying content on a user terminal; An interpreter module which processes a file input from the data input module and generates a file transmitted to a user terminal. The terminal interprets / analyzes an MPEG-7 file and an extended BIFS file input from the data input server. An interpretation / conversion unit for converting the code into a recognizable code, and a file converted by the interpretation / conversion unit with the previously prepared broadcast data file and the advertisement content data file, and integrated into a single broadcast to generate an MP4 file. Said interpreter module comprising an integration unit Data broadcasting service system comprising a. 8. The MPEG-7 file generating unit according to claim 7, wherein the MPEG-7 file generating unit records the scene keyword in a newly defined node so that information about a scene can be described in MPEG-7 in a Video Segment Description Scheme format. And generate the data broadcast service system. The data broadcasting service system of claim 8, wherein the MPEG-7 of the Video Segment Description Scheme format includes a node for indicating a start time and a progress time of a scene associated with the scene keyword. 10. The system of claim 8 or 9, wherein the extended BIFS file includes a BIFS code in which a node capable of describing the scene keyword is further defined. 11. The system of claim 10, wherein the nodes further defined in the BIFS code are defined to have multiple attributes. The apparatus according to claim 10, wherein the interpretation / conversion unit extracts and interprets values of nodes newly defined in the MPEG-7 file and nodes further defined in the extended BIFS file so that any scene of the broadcast data is associated with advertisement data content. Data broadcast service system characterized in that it is determined whether or not the association. The scene-specific event of claim 12, wherein the interpretation / conversion unit converts the absolute time based on the scene keyword to create an AT node and a scene-specific event for adding a node and a ROUTE node for a scene update. A data broadcast service system comprising an additional module.

Images