KR20090110570A - Mobile telecommunication ystem, and method for transforming data-information for Synchronization between broadcasting contents and data-information - Google Patents

Abstract

PURPOSE: A mobile communication broadcasting system and a method for converting additional information for synchronization are provided to connect standardized contents transmitted through a broadcasting communication network with a DMB terminal in real time. CONSTITUTION: A mobile communication broadcasting system(100) includes a digital broadcasting receiving terminal, and a service providing server(120). The digital broadcasting receiving terminal receives and displays broadcasting contents. Additional information about broadcasting contents of the digital broadcasting receiving terminal is requested and received as BIFS information.

Description

Mobile telecommunication broadcasting system and additional information transformation method for synchronization {Mobile telecommunication ystem, and method for transforming data-information for Synchronization between broadcasting contents and data-information}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile communication broadcasting system and a method for converting additional information for synchronizing content of digital multimedia broadcasting and product placement (PPL) information. Service provider server converts PPL information into Binary Format For Scenes (BIFS) data based on MPEG-4 standard and transmits it to DMB terminal, so that the DMB terminal is able to A mobile communication broadcast system and a method of converting additional information for synchronizing BIFS information.

Recently, Digital Multimedia Broadcasting (DMB) service combines broadcast contents of satellite DMB and terrestrial DMB with PPL (Product Placement) information to provide a broadcasting convergence PPL information service that can activate mobile e-commerce. have.

Here, the broadcasting convergence PPL information service is one of marketing strategies. As the size of the video industry grows and becomes more sophisticated, the company introduces and promotes specific products such as movies, dramas, etc., and uses PPL information included in satellite DMB and terrestrial DMB contents. When the user selects the data, it is transmitted to the PPL server through the bidirectional channel, and the detailed information is transmitted to the user, which is a service that is displayed in the mobile communication terminal by properly interworking with the satellite DMB and terrestrial DMB contents.

At this time, PPL information is a document describing the information of the product appearing in the AV (Audio Visual) content. The additional information of the dynamic product existing in is described based on XML (eXtensible Markup Language).

However, PPL information does not apply to the DMB system because the PPL information operates only in the DMB dedicated terminal, not the technology according to the information communication standard.

Therefore, in order to provide such PPL information service, a technology for interworking satellite DMB and terrestrial DMB services, which are unidirectional services, with the wireless Internet in a bidirectional channel is required, and a technology for providing PPL information based on the MPEG-4 standard is required. have.

In order to solve the above problems and requirements, the present invention provides a service conversion server converts PPL information into Binary Format For Scenes (BIFS) data based on MPEG-4 standard when a broadcast center provides broadcast content to a DMB terminal. It is an object of the present invention to provide a mobile communication broadcasting system and a method of converting additional information for synchronizing the DMB terminal so that the DMB terminal synchronizes the broadcast content and the BIFS information based on program information.

A mobile communication broadcasting system according to the present invention for achieving the above object, receives and displays broadcast content, requests additional information on the broadcast content to receive as BIFS information, and receives the non- A digital broadcast receiving terminal configured to display BIFS information in synchronization with the broadcast content; And searching for the additional information according to the request of the additional information requested from the digital broadcast receiving terminal, converting the searched additional information into the BIFS information, and transmitting the converted additional information to the digital broadcast receiving terminal. It includes.

In addition, the digital broadcast receiving terminal transmits a GUIP start request message to the service providing server according to the selection of the GUIP start key, requests the PPL information from the service providing server after receiving the GUIP start response from the service providing server. do.

In addition, the GUIP start request message includes a channel, a program, and a PTS.

In addition, the BIFS information is interactive content that can be linked with a user and is stored in the form of an mp4 file.

In addition, the digital broadcast reception terminal, RA (t) = abs (PTS (start)-PTS (from the PTS (start) which is the video start time of the received BIFS information) a)) + PTS (n) = abs (PTS (start) -PTS (n)).

In addition, the digital broadcast receiving terminal sets a reference clock after the random access offset (RA), and decodes and renders the BIFS information and the image stream with respect to the reset and adjusted reference clock.

In addition, the BIFS information, the unit classes are organized in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on individual streams of video / audio / BIFS and The actual data about them consists of 'mdat' which is stored as sample of stream fragment of minimum unit having time information.

On the other hand, the additional information conversion method of the system comprising a service providing server for providing additional information according to the present invention for achieving the above object, and a digital broadcast receiving terminal for displaying the additional information in synchronization with the broadcast content, (a) receiving and displaying the broadcast content by the digital broadcast receiving terminal; (b) the digital broadcasting receiving terminal requesting additional information on the broadcast content from the service providing server; (c) the service providing server converting the additional information into BIFS information; (d) the service providing server transmitting the BIFS information to the digital broadcast receiving terminal; And (e) displaying the BIFS information in synchronization with the broadcast content at the digital broadcast receiving terminal.

In addition, the step (b), the digital broadcast receiving terminal transmits a GUIP start request message to the service providing server according to the GUIP start key selection, and receives the GUIP start response from the service providing server and then the service providing server. You will be asked for PPL information.

In addition, the GUIP start request message includes a channel, a program, and a PTS.

In addition, the BIFS information is interactive content that can be linked with a user and is stored in the form of an mp4 file.

In addition, the BIFS information, the unit classes are organized in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on the individual stream of video / audio / BIFS and The actual data about them consists of 'mdat' which is stored as sample of stream fragment of minimum unit having time information.

Also, in the step (e), RA (t) = abs (PTS) is set by the digital broadcasting receiver terminal from a PTS (start) which is a video start time of the BIFS information received. (start)-PTS (a)) + PTS (n) = abs (PTS (start)-PTS (n)).

In the step (e), the digital broadcasting reception terminal sets a reference clock after the random access offset (RA), and resets the BIFS information and the image stream with respect to the adjusted reference clock. Decode and render.

On the other hand, the service providing server according to the present invention for achieving the above object, the PPL information request message including the channel information, program information of the broadcast program from the digital broadcast receiving terminal for receiving and displaying the broadcast content A service control unit for retrieving PPL information, converting the BPL information into BIFS information, and controlling the BFS information to be transmitted to the digital broadcast receiving terminal; A guide information for selecting an object displayed on a screen of the digital broadcasting receiver terminal, a type of additional information that can be provided for each object, and a content URL including information for downloading each additional information content; A PPL information database for storing PPL information for each broadcast program; A PPL information retrieval unit for retrieving the PPL information for the corresponding broadcast program from the PPL information database based on the PPL information request message; A BIFS conversion unit for converting the PPL information retrieved by the PPL information retrieval unit into BIFS information; And a communication unit configured to receive the PPL information request message from the DMB terminal and to transmit the BIFS information to the DMB terminal.

The service control unit may receive a GUIP start request message including channel information and program information of the broadcast content being viewed from the DMB terminal in a GUIP service mode. A GUIP start response message including information included in the GUIP start request message is transmitted to the digital broadcast receiving terminal.

The GUIP start request message includes a MIN number, PTS information, GUIP service type information, terminal type information, broadcast channel information, and broadcast program information of the digital broadcast receiving terminal.

Meanwhile, a method of converting additional information of a service providing server according to the present invention for achieving the above object is a method of converting additional information of a service providing server that provides additional information to a digital broadcast receiving terminal that receives and displays broadcast content. (a) receiving an additional information request message for the broadcast content from the digital broadcast receiving terminal; (b) retrieving the additional information and converting the retrieved additional information into BIFS information; And (c) transmitting the BIFS information to the digital broadcast receiving terminal.

In the step (a), the GUIP start request message is received from the digital broadcast receiving terminal according to the GUIP start key selection of the digital broadcast receiving terminal, and the response message to the GUIP start request message is received from the digital broadcast receiving terminal. After receiving the PPL information request message from the digital broadcast receiving terminal.

In addition, the GUIP start request message includes a channel, a program, and a PTS.

In addition, the BIFS information is interactive content that can be linked with a user and is stored in the form of an mp4 file.

In addition, the BIFS information, the unit classes are organized in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on individual streams of video / audio / BIFS and The actual data about them consists of 'mdat' which is stored as sample of stream fragment of minimum unit having time information.

On the other hand, the digital broadcast receiving terminal according to the present invention for achieving the above object, the BIFS playback unit for reproducing the BIFS information that is additional information about the broadcast content; An AV playback unit for analyzing an audio / video stream of the broadcast content and outputting an image to a display device or outputting an audio signal to an audio output device; Controlling the BIFS information to be reproduced in synchronization with the broadcast content through the BIFS playback unit, and controlling the broadcast content to be reproduced in synchronization with the BIFS information. Control unit; A PPL processing unit for receiving and processing the BIFS information from a mobile communication network in the form of a packet; And a broadcast processor for extracting the audio / video stream by receiving and interpreting the broadcast content from a broadcast network.

The BFS playback unit may also set a random access offset RA from PTS (start), which is a video start time of the BFS information, to RA (t) = abs (PTS (start)-PTS). (a)) + PTS (n) = abs (PTS (start) -PTS (n)).

The controller may set a reference clock after the random access offset RA, and decode and render the BIFS information and the image stream with respect to the reset and adjusted reference clock.

In addition, the BIFS information, the unit classes are organized in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on the individual stream of video / audio / BIFS and The actual data about them consists of 'mdat' which is stored as sample of stream fragment of minimum unit having time information.

In addition, the BIFS information is interactive content that can be linked with a user and is stored in the form of an mp4 file.

The controller transmits a GUIP start request message to a service providing server providing the BIFS information according to a GUIP start key selection, and receives the GUIP start response from the service providing server and then provides the service. After requesting PPL information from the server, the BFS information is received from the service providing server.

Meanwhile, a method of converting additional information of a digital broadcast receiving terminal according to the present invention for achieving the above object includes a service providing server for providing additional information and a digital broadcast receiving terminal displaying the additional information in synchronization with broadcast content. A method of converting additional information, comprising: (a) receiving and displaying the broadcast content; (b) requesting the service providing server for additional information about the broadcast content; (c) receiving the additional information as BIFS information from the service providing server; And (d) displaying the BIFS information in synchronization with the broadcast content.

Also, in the step (b), the GUIP start request message is transmitted to the service providing server according to the selection of the GUIP start key, and after receiving the GUIP start response from the service providing server, the service providing server requests PPL information. do.

In addition, the GUIP start request message includes a channel, a program, and a PTS.

In addition, the BIFS information is interactive content that can be linked with a user and is stored in the form of an mp4 file.

In addition, the BIFS information, the unit classes are organized in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on the individual stream of video / audio / BIFS And 'mdat' stored in the form of a sample of stream fragments of the minimum unit having time information.

Further, the step (d) may be performed by setting a random access offset RA from PTS (start), which is a video start time of the received BIFS information, to RA (t) = abs (PTS (start) −PTS ( a)) + PTS (n) = abs (PTS (start) -PTS (n)).

In the step (d), the reference clock is set after the random access offset (RA), and the BFS information and the image stream are decoded and rendered with respect to the reset and adjusted reference clock.

On the other hand, the recording medium according to the present invention for achieving the above object comprises the steps of: (a) receiving an additional information request message for the broadcast content from the digital broadcast receiving terminal; (b) retrieving the additional information and converting the retrieved additional information into BIFS information; And (c) a program for processing the step of transmitting the BIFS information to the digital broadcast receiving terminal.

In the step (a), the GUIP start request message is received from the digital broadcast receiving terminal according to the GUIP start key selection of the digital broadcast receiving terminal, and the response message to the GUIP start request message is received from the digital broadcast receiving terminal. After receiving the PPL information request message from the digital broadcast receiving terminal.

In addition, the GUIP start request message includes a channel, a program, and a PTS.

In addition, the BIFS information is interactive content that can be linked with a user and is stored in the form of an mp4 file.

In addition, the BIFS information, the unit classes are organized in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on individual streams of video / audio / BIFS and The actual data about them consists of 'mdat' which is stored as sample of stream fragment of minimum unit having time information.

According to the present invention, it is possible to provide a content interworking technology that is synchronized with the content of the standard standard transmitted through the broadcast communication network in real time in the DMB terminal.

In addition, it is possible to provide additional information on the satellite DMB broadcasting service and the terrestrial DMB broadcasting service without changing the structure of the existing broadcasting system.

In addition, the present invention can be applied to a DMB broadcasting system providing broadcast content and additional information to a DMB terminal.

Details of the object and technical configuration of the present invention and the resulting effects thereof will be more clearly understood by the following detailed description based on the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram schematically illustrating a configuration of a mobile communication broadcasting system to which a method for converting additional information for synchronization according to an embodiment of the present invention is applied.

Referring to FIG. 1, the mobile communication broadcast system 100 to which the present invention is applied includes a broadcast center 110, a service providing server 120, a synchronization server 130, a content server 140, a PDSN 150, and a mobile terminal. Communication network 160 and DMB terminal 170;

The broadcast center 110 provides satellite DMB content to the DMB terminal 170 through satellite or transmits terrestrial DMB content to the DMB terminal 170 through a terrestrial transmission station.

The service providing server 120 holds additional information about broadcast content including satellite DMB content and terrestrial DMB content, and converts additional information about broadcast content, for example, PPL information into BIFS information, to the DMB terminal 170. To provide.

In addition, the service providing server 120 transmits a synchronization information request message for requesting synchronization information between the broadcast content and the additional information to the synchronization server 130, and receives the synchronization information from the synchronization server 130. (170).

In addition, the service providing server 120 is a GUIP (Graphic User Interface in Picture) server that provides information on the type of additional information that can be provided for each object displayed on the digital multimedia broadcasting screen. Hereinafter, the additional information provided by the service providing server 120 will be described as PPL information.

That is, the service providing server 120 enables the user to select a specific object on the broadcast screen through interworking with the DMB terminal 170 receiving the PPL information as the BIFS information, and provides the user with additional information content on the selected object. Server that supports receiving. For example, if a user presses any GUIP start key while watching a broadcast, the outline of objects (eg, singer, singer's costume, etc.) appearing on the broadcast screen after that point in time and the kind of information that can be provided for each object ( For example, a profile of a singer, a record of a singer, lyrics of a song a singer sings, information of a costume worn by a singer, and the like, that is, information about a download address (URL) of the content is transmitted.

In this case, the contour information is information for allowing the user to select an object. When the contour information is synchronized with the broadcast screen, the DMB terminal 170 may display the contour of the object selected according to the user's key input. Is provided as guide information that allows a particular object to be selected.

If the DMB terminal 170 has a touch screen, it is not necessary to provide guide information separately for object selection. In this case, the DMB terminal 170 transmits coordinate information of the point selected by the user to the service providing server 120. Information can be directly provided on the object at the selected point.

Therefore, in such a case, the service providing server 120 does not have to provide all PPL information for subsequent broadcasting in advance, and information and content URL of the type of additional information that can be provided for the object of the corresponding point when a specific point is selected. Only information (hereinafter referred to as GUIP information) needs to be provided.

As such, when the DMB terminal 170 selects an object (a person, a product, etc.) appearing on the broadcast screen while watching the broadcast, the service providing server 120 according to the present invention enables to check the information that can be provided for the selected object. A URL is provided so that content about the information can be downloaded from the content server 140.

The sync server 130 receives the sync information request message from the service providing server 120, generates sync information based on the sync information request message received from the service providing server 120, and transmits the sync information to the service providing server 120. Will be done.

The content server 140 holds the content matched with the PPL information, and when the PPL information is selected by the DMB terminal 170 from the service providing server 120, the content server 140 displays the content matched with the selected PPL information. Will be downloaded.

The DMB terminal 170 receives and displays broadcast content related to digital multimedia and PPL information as BIFS information, and synchronizes and displays the broadcast content and BIFS information based on the synchronization information. Here, the DMB terminal 170 is a broadcasting terminal including a mobile communication terminal and a PDA that can receive and display DMB broadcasting.

In addition, the DMB terminal 170 is a terminal that receives satellite DMB broadcasting contents from the broadcasting center 110 through satellite or receives terrestrial DMB broadcasting contents through a terrestrial transmission station. A terminal accessible to the service providing server 120 and the content server 140 via the communication network 160.

Herein, the mobile communication network 160 includes a base station transmitter (BTS), a base station controller (BSC), and a mobile switching center (MSC), and thus a detailed description thereof will be omitted.

2 is a configuration diagram schematically showing an internal configuration of a service providing server according to an embodiment of the present invention.

2, the service providing server 120 according to the present invention includes a service control unit 211, an information database 212, a PPL information retrieval unit 213, a BIFS conversion unit 215, and a GUIP information providing unit ( 216 and the communication unit 217 is configured.

The service providing server 120 according to the present invention not only provides a synchronization service for transmitting synchronization information regarding synchronization between broadcast content and additional information to the DMB terminal 170, but also broadcast content displayed on the DMB terminal 170. When an arbitrary object is selected by the user, the GUIP service converts PPL information of the selected object into BIFS information and transmits the information to the DMB terminal 170.

Therefore, in the synchronous service mode, the service control unit 211 transmits a synchronization information request message for a specific broadcast program to the synchronization server 130, receives the synchronization information from the synchronization server 130, and receives the DMB terminal 170. Will be sent to.

In the GUIP service mode, the service control unit 211 receives a GUIP start request message including channel information and program information of a broadcast currently being viewed from the DMB terminal 170 and includes the received GUIP start request message in the received GUIP start request message. The GUIP start response message including the received information is transmitted to the DMB terminal 170 so that the information can be confirmed by the user or the terminal.

The GUIP start request message is a service request message that is automatically generated and transmitted from the DMB terminal 170 as the user selects the GUIP start key from the DMB terminal 170. The GUIP start request message includes: MTS number, PTS information provided to know the current broadcast time; GUIP service type information, terminal type information (laptop, mobile phone, etc.), broadcast channel information, broadcast program information may be included.

PTS (Presentation Time Stamp) is a time stamp included in a DMB broadcast data packet. When PTS of the packet header is used, the PTS can find a screen when a user requests a service from a corresponding broadcast program. 120 provides BIFS information or GUIP information for the time or after the time.

Such a GUIP service type may be preset in the DMB terminal 170, may be selected when the GUIP start key is pressed, or may be stored in the information database 212 of the service providing server 120.

The information database 212 also stores subscriber information.

On the other hand, if the GUIP service is provided only to the service subscriber, the service control unit 211 checks whether the information of the subscriber in the information database 212 when the GUIP start request message is received, performs the subscriber authentication and then includes the authentication result Will reply to the GUIP start response message.

Next, when the PPL information retrieval unit 213 receives the PPL information request message including the channel information and the program information of the broadcast from the DMB terminal 170, the PPL information retrieval unit 213 based on the information included in the PPL information request message. PPL information about the broadcast program is retrieved.

At this time, since the PPL information search unit 213 should search for PPL information on the corresponding broadcast after the DMB terminal 170 requests PPL information, the PPL information search unit 213 is included in the PPL information request message received from the DMB terminal 170. The PPL information for the part to be watched later is searched using the PTS information indicating the reproduction time of the broadcast program.

The additional information database 214 includes guide information for selecting objects displayed on the broadcast screen, PPL information including types of additional information that can be provided for each object, and content URL information for downloading each additional information content. Is stored for each broadcast program.

For example, in the case of a music broadcast program, an object of the PPL information may be a singer displayed on the screen. Examples of additional information that may be provided for the singer include profile information of the singer, record information of the singer, and the current information. There may be a song being played. In addition, if the user selects a song, the corresponding sound source content may be provided as additional information content. In this case, the download URL information of the sound source content is included in the PPL information.

In addition, the guide information is information for allowing a user to select one of the objects displayed on the broadcast screen. As described above, the guide information may be outline information for displaying the outline of the object, and may be variously designed in addition to the outline. . In addition, the guide information is synchronized with the broadcast data in the DMB terminal 170 to display the guide information such as the outline of the corresponding object according to the key input so that the user can select the desired object through the key input while watching the broadcast.

The BIFS conversion unit 215 converts PPL information about the corresponding broadcast content searched by the PPL information retrieval unit 213 into BIFS information.

Next, the GUIP information providing unit 216 is a configuration for a service to the DMB terminal 170 having a touch screen, and the channel information of the broadcast currently being viewed from the DMB terminal 170 as the user selects a specific point of the broadcast screen. When a GUIP information request message including program information, coordinate information of a selected point, and PTS information is received, referring to the additional information database 214 based on the information included in the GUIP information request message, The GUIP information response message including the type of additional information that can be provided for the object and the content URL information for downloading each additional information content is transmitted to the DMB terminal 170.

In this case, the additional information database 214 should further store the coordinate information of the object displayed through the broadcast screen, and exactly the information on the range of coordinates for the screen area occupied by the object.

Meanwhile, in the case of the BIFS conversion unit 215, the PPL information for the broadcast after the time of the user's request for service is converted into BIFS information, and the BIFS information includes DMB because the guide information for selecting an object is included. After downloading the BIFS information, the terminal 170 can identify the object selected by the user and receive the corresponding additional information content.

On the other hand, the GUIP information providing unit 216 receives the coordinate information selected by the user in real time, identifies the object corresponding to the coordinates and gives only relevant information.

The communication unit 217 receives a GUIP start request message from the DBM terminal 170 and transmits synchronization information and BIFS information to the DMB terminal 170.

Meanwhile, in FIG. 2, when the BIMB information is downloaded and the object is identified by the DMB terminal 170, when the coordinates are transmitted by the DMB terminal 170, the service providing server 120 identifies the object and provides only GUIP information. Although the service providing server 120 is configured to perform both cases, the GUIP information providing unit 216 may be omitted if only the former service is provided, and the PPL information retrieval unit may be omitted if only the latter service is provided. 213 and the BIFS conversion unit 215 may be omitted.

3 is a configuration diagram schematically showing an internal configuration of a synchronization server according to an embodiment of the present invention.

Referring to FIG. 3, the synchronization server 120 according to the present invention includes a communication unit 310, a synchronization information detector 320, a controller 330, and a synchronization information storage unit 340.

The communication unit 310 transmits or receives information or data, receives a synchronization information request message from the service providing server 120 providing additional information to the DMB terminal 170, and provides the synchronization information for the synchronization information request message. Send to server 120.

The synchronization information detector 320 detects synchronization information from broadcast content received from the content provider CP. That is, the synchronization information detector 320 detects a program start PTS from the broadcast content.

The controller 330 controls the detected synchronization information to be transmitted to the service providing server 120 through the communication unit 310.

The synchronization information storage unit 340 stores and stores the detected synchronization information.

4 is a configuration diagram schematically showing an internal configuration of a DMB terminal according to an embodiment of the present invention.

Referring to FIG. 4, the DMB terminal 170 according to the present invention includes a user interface (UI) unit 410, a BIFS playback unit 420, an audio visual (AV) playback unit 430, a controller 440, and a PPL. (Packet Protocol Link) processing unit 450 and DAB (Digital Audio Broadcasting) processing unit 460.

The UI unit 410 performs a touch input function for receiving touch information from a user and a display function for displaying broadcast content. Therefore, the UI unit 410 may have a touch screen form. Here, the UI unit 410 may be separately provided as an input unit for receiving data from a user and a display unit for displaying data processing results.

In addition, the UI unit 410 performs a renderer function for synthesizing and outputting an interactive content image provided by the BIFS playback unit 420 and a video image provided by the AV playback unit 430. At this time, the BIFS information is processed to be projected onto the video image.

The BIFS playback unit 420 is a player that plays interactive contents produced in the form of an mp4 file, and arranges graphic objects such as images and figures on the screen according to the position and size from a screen tree defined by BIFS. When the user clicks on an object, it moves to the next menu or loads a web page.

The AV playback unit 430 analyzes an audio / video stream of broadcast content and outputs an image to the UI unit 410 or a display device, or outputs an audio signal to an audio output device.

The controller 440 controls the received BIFS information to be reproduced through the BIFS playback unit 420 in synchronization with the broadcast content, and controls the broadcast content to be reproduced through the UI unit 410 while synchronizing with the BIFS information.

The PPL processing unit 450 is a module for receiving and processing BIFS information received in a packet form from the mobile communication network. The PPL processing unit 450 receives BIFS information in the form of an mp4 file at a time synchronized with video from the service providing server 120, and from the BIFS information. It performs the function of receiving and processing the additional mp4 file requested by the user's click.

The DAB processor 460 is a broadcast processor that performs a function of extracting an audio / video stream by receiving and analyzing a DAB signal, which is a satellite DMB broadcast signal.

5 is a flowchart illustrating a method of converting additional information for synchronization according to an embodiment of the present invention.

The broadcast content includes various media objects such as still images, texts, videos, and audio. The scene descriptor BIFS information expresses the spatial position and temporal relationship between these media objects.

The present invention provides a fusion type bidirectional service of DMB broadcasting and a communication network, not a bidirectional service using a broadcasting network, and interoperates with DMB broadcasting and content synchronization through a communication network.

In the case of data broadcasting provided by the satellite DMB, the present invention is not difficult to synchronize time by transmitting the additional information through the broadcasting network, and the present invention cannot provide various additional information due to the limitation of the bandwidth of the broadcasting channel. Differentiate from broadcast.

Referring to FIG. 5, the DMB terminal 170 according to the present invention receives the broadcast content of the DMB broadcast from the broadcasting center 110 through the DAB processing unit 460 and displays it on the UI unit 410 (502). .

Accordingly, the user can watch broadcast content through the DMB terminal 170.

Subsequently, when the user selects the GUIP start key while viewing the broadcast content (S504), the controller 440 transmits the GUIP start request message to the service providing server 120 through the PPL processor 450 (S506).

In this case, the GUIP start request message must include channel information, broadcast program information, PTS information, and the like, and basically includes the MIN number of the terminal and the type of the terminal.

The service providing server 120 includes the information included in the GUIP start request message received for the terminal or subscriber confirmation and transmits the GUIP start response message to the DMB terminal 170 (S508).

In this case, the function of the GUIP start request message and the function of the GUIP start response message may be included in a subsequent PPL information request message and a PPL information response message.

The DMB terminal 170 again transmits a PPL information request message including a channel, a program, PTS information, etc. to the service providing server 120 through the PPL processing unit 450 (S510).

Accordingly, the service providing server 120 searches for PPL information on broadcast content that the corresponding user is watching through the PPL information search unit 213 based on the corresponding channel, program, and PTS information (S512).

When the PPL information is retrieved, the service providing server 120 converts the PPL information into BIFS information through the BIFS conversion unit 215 (S514). The service providing server 120 stores the BIFS information in the additional information database 214.

In the present invention, BIFS information, which is a scene descriptor, is stored as an mp4 file as interactive content that can be linked with a user. The mp4 file is a standard defined in the ISO / IEC document, an international standard file format for storing BIFS content. The unit class called Atom is organized into a tree-like collection of 'moov' and video for media information technology. 'Trak' which contains information about individual streams of / audio / BIFS, and the actual data about them are stored in the form of 'sample' which is the smallest stream fragment (in case of video, information about one scene) with time information. mdat '.

Here, the functions and features of the main Atoms in BIFS information are as follows.

① 'moov' is the highest Atom of all Atoms containing all the information (sample size, time, sample location, sample type) needed to describe multimedia data such as audio / video.

② 'iods' is an Atom that contains information about an elementary stream technology such as audio / video (ObjectDesciprtor). The ObjectDescriptor contains decoder initialization information and channel information necessary for audio / video decoding.

③ 'trak' is the best Atom of a track when multimedia data such as audio / video are stored separately in track units. In the track, the actual storage location of each ES (Element Stream), the size of samples, and time information are organized.

'Stbl' contains the storage location, size and time information of each media sample in the file.

⑤ 'mdat' is a space where media data is stored, and each media elementary stream is divided and stored in units of chuck, which is a collection of samples having continuity.

On the other hand, the service providing server 120 transmits the BIFS information to the DMB terminal 170 via the communication unit 217 (S516).

Accordingly, the DBM terminal 170 receives the BIFS information, synchronizes the BIFS information with the broadcast content through the PPL processor 450, and reproduces the BIFS information through the BIFS playback unit 420 as shown in FIG. In addition, the broadcast content is displayed on the UI unit 410 through the AV playback unit 430 (S518).

Here, the BIFS reproducing unit 420 extracts and decodes the BIFS stream and the image stream from the received BIFS mp4 file, synthesizes an image from a scene configured according to the BIFS scene tree, and outputs the image to the screen of the UI unit 410. It accepts input from the user to update or modify the scene or trigger an event to download web pages and other mp4 files. Also, to maintain synchronization with the video, the AV playback unit 430 receives the audio PTS to match the PTS of the currently output video using an internal clock to synchronize with BIFS information. 6 is a diagram for describing a process of synchronizing and playing back BIFS information and broadcast content according to an embodiment of the present invention.

When the DMB terminal 170 is driven using a crystal oscillator, the DMB terminal 170 repeatedly cycles from 0 to a maximum value unique to each terminal and provides a system clock.

In addition, the DMB terminal 170 provides a reference (reference) time for DTS and PTS necessary for synchronizing each audio / video stream based on the system clock, and the reference time is set to 0 when the system is driven. The time is played at the same speed as the time.

The DMB terminal 170 also decodes the audio / video stream during decoder time DTS. Individual streams must be decoded at a time when the corresponding DTS matches the reference time.

In this regard, the presentation time PTS means a time at which an audio / video stream should be output to a screen or an audio device. Decoded video and audio data must be represented at a time when the PTS matches the reference time.

As shown in FIG. 6, the DMB terminal 170 receives the BIFS information from the designated service providing server 120 through the BIFS information transmitted together in the PTS (a), which is the video time currently being represented on the terminal at any point in time. Download is started and the reception of BIFS information is completed at any time point PTS (b).

Subsequently, the DMB terminal 170 calculates the network delay time as shown in Equation 1 below.

The DMB terminal 170 calculates an offset to randomly access (jump) from PTS (start), which is a video start time of the received BIFS information, as shown in Equation 2 below.

The BIFS reproducing unit 420 sets a reference clock for the BIFS CTS starting from 0 based on the calculated RA (t) after RA (t).

Subsequently, the BIFS reproducing unit 420 decodes and renders the BIFS stream and the image stream with respect to the reset and adjusted reference clock.

Accordingly, the DMB terminal 170 synchronizes the broadcast content with the BIFS information to support the user's object selection and additional information selection. When the user selects an outline or a point of a specific object while watching a broadcast, the additional information on the object is displayed. If one of the selected is selected, the user accesses the content URL matched with the additional information and downloads the content desired by the user.

As described above, according to the present invention, when the broadcast center provides the broadcast content to the DMB terminal, the service providing server converts the PPL information into the BIFS data based on the MPEG-4 standard and transmits it to the DMB terminal. A mobile communication broadcast system and a method of converting additional information for synchronization can be realized to synchronize broadcast content and BIFS information based on program information.

As those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features, the embodiments described above should be understood as illustrative and not restrictive in all aspects. Should be. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

The present invention can be applied to a DMB terminal that receives and displays terrestrial or satellite DMB broadcasts, and can be applied to a mobile communication terminal that receives and displays broadcast content provided from the Internet through a mobile communication network. In addition, the present invention can also be applied to an additional information providing system that provides additional information on broadcast content to a DMB terminal receiving a DMB broadcast.

1 is a configuration diagram schematically showing a configuration of a mobile communication broadcasting system to which a method of converting additional information for synchronization according to an embodiment of the present invention is applied;

2 is a configuration diagram schematically showing an internal configuration of a service providing server according to an embodiment of the present invention;

3 is a configuration diagram schematically showing an internal configuration of a synchronous server according to an embodiment of the present invention;

4 is a configuration diagram schematically showing an internal configuration of a DMB terminal according to an embodiment of the present invention;

5 is an operation flowchart for explaining a method of converting additional information for synchronization according to an embodiment of the present invention; and

6 is a diagram for describing a process of synchronizing and playing back BIFS information and broadcast content according to an embodiment of the present invention.

<Description of Symbols for Main Parts of Drawings>

100: mobile communication broadcasting system 110: broadcasting center

120: service providing server 130: synchronous server

140: content server 150: PDSN

160: mobile communication network 170: DMB terminal

211: service control unit 212: information DB

213: PPL information search unit 214: additional information DB

215: BIFS conversion unit 216: GUIP information provider

217: communication unit 310: communication unit

320: synchronization information detection unit 330: control unit

340: synchronization information storage unit

Claims (40)

Digital broadcasting for receiving and displaying broadcast content, requesting additional information on the broadcast content, receiving it as BIFS information, and synchronizing and displaying the received BIFS information in synchronization with the broadcast content. A receiving terminal; And A service providing server for retrieving the additional information according to a request of the additional information requested from the digital broadcast receiving terminal, converting the retrieved additional information into the BIFS information, and transmitting the converted additional information to the digital broadcast receiving terminal; Mobile communication broadcast system comprising a. The method of claim 1, The digital broadcast receiving terminal transmits a GUIP start request message to the service providing server according to the selection of the GUIP start key, and requests PPL information from the service providing server after receiving a GUIP start response from the service providing server. Mobile communication broadcasting system. The method according to claim 1 or 2, The GUIP start request message includes a channel, a program, and a PTS (Presentation Time Stamp). The method of claim 1, The BIFS information is interactive content capable of interworking with a user and is stored in the form of an mp4 file. The method of claim 1, The digital broadcast reception terminal is configured to set a random access offset RA from PTS (start), which is a video start time of the received BIFS information, to RA (t) = abs (PTS (start)-PTS (a). ) + PTS (n) = abs (PTS (start)-PTS (n)). The method of claim 5, wherein The digital broadcast receiving terminal sets a reference clock after the random access offset (RA), and decodes and renders the BIFS information and the image stream with respect to the reset and adjusted reference clock. Mobile communication system. The method of claim 1, The BIFS information is composed of unit classes in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on individual streams of video / audio / BIFS, and these. A mobile communication broadcasting system comprising 'mdat' stored in a sample form of a stream fragment of a minimum unit having time information. A method of converting additional information in a system comprising a service providing server providing additional information and a digital broadcast receiving terminal configured to display the additional information in synchronization with broadcast content. (a) receiving and displaying the broadcast content by the digital broadcast receiving terminal; (b) the digital broadcasting receiving terminal requesting additional information on the broadcast content from the service providing server; (c) the service providing server converting the additional information into BIFS information; (d) the service providing server transmitting the BIFS information to the digital broadcast receiving terminal; And (e) displaying the BIFS information in synchronization with the broadcast content at the digital broadcast receiving terminal; Additional information conversion method comprising a. The method of claim 8, In the step (b), the digital broadcast receiving terminal transmits a GUIP start request message to the service providing server according to the GUIP start key selection, receives a GUIP start response from the service providing server, and then sends the PPL to the service providing server. And requesting information. The method of claim 9, The GUIP start request message includes a channel, a program, and a presentation time stamp (PTS). The method of claim 8, The BIFS information is interactive content capable of interworking with a user and is stored in the form of an mp4 file. The method of claim 8, The BIFS information is composed of unit classes in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on individual streams of video / audio / BIFS, and these. And 'mdat' stored in the form of a sample of a stream fragment of a minimum unit having time information. The method of claim 8, In step (e), the digital broadcast receiving terminal receives a random access offset RA from PTS (start), which is a video start time of the received BIFS information, RA (t) = abs (PTS (start). )-PTS (a)) + PTS (n) = abs (PTS (start)-PTS (n)). The method of claim 13, In the step (e), the digital broadcasting receiver sets a reference clock after the random access offset (RA), and decodes the BIFS information and the image stream with respect to the reset and adjusted reference clock. A method of converting additional information, characterized in that for rendering.  When a PPL information request message including channel information and program information of a broadcast program is received from a digital broadcast receiving terminal for receiving and displaying broadcast content, the BPL information is retrieved and the BIFS is retrieved. A service control unit which converts the information into information and controls the BFS information to be transmitted to the digital broadcast receiving terminal; A guide information for selecting an object displayed on a screen of the digital broadcasting receiver terminal, a type of additional information that can be provided for each object, and a content URL including information for downloading each additional information content; A PPL information database for storing PPL information for each broadcast program; A PPL information retrieval unit for retrieving the PPL information for the corresponding broadcast program from the PPL information database based on the PPL information request message; A BIFS conversion unit for converting the PPL information retrieved by the PPL information retrieval unit into BIFS information; And A communication unit configured to receive the PPL information request message from the digital broadcast reception terminal and to transmit the BIFS information to the digital broadcast reception terminal; Service providing server comprising a. The method of claim 15, The service control unit receives a GUIP start request message including channel information and program information of the broadcast content being viewed from the digital broadcasting reception terminal in a GUIP service mode, and receives the received GUIP. And a GUIP start response message including information included in a GUIP start request message to the digital broadcast receiving terminal. The method of claim 16, The GUIP start request message includes a MIN number, PTS information, GUIP service type information, terminal type information, broadcast channel information, and broadcast program information of the digital broadcast receiving terminal. Provision Server. A method of converting additional information of a service providing server that provides additional information to a digital broadcast receiving terminal for receiving and displaying broadcast content, the method comprising: (a) receiving an additional information request message for the broadcast content from the digital broadcast receiving terminal; (b) retrieving the additional information and converting the retrieved additional information into BIFS information; And (c) transmitting the BIFS information to the digital broadcast receiving terminal; Method of converting additional information of the service providing server comprising a. The method of claim 18, In step (a), the GUIP start request message is received from the digital broadcast receiving terminal according to the GUIP start key selection of the digital broadcast receiving terminal, and the response message to the GUIP start request message is transmitted to the digital broadcasting receiving terminal. And then receiving a PPL information request message from the digital broadcast receiving terminal. The method of claim 19, The GUIP start request message includes a channel, a program, and a presentation time stamp (PTS). The method of claim 18, The BIFS information is interactive content capable of interworking with a user and is stored in the form of an mp4 file. The method of claim 18, The BIFS information is composed of unit classes in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on individual streams of video / audio / BIFS, and these. Method for converting additional information of a service providing server, characterized in that the actual data is configured as 'mdat' stored in the form of a sample of the stream unit of the minimum unit having time information. A BIFS playback unit which reproduces BIFS information which is additional information on broadcast content; An AV playback unit for analyzing an audio / video stream of the broadcast content and outputting an image to a display device or outputting an audio signal to an audio output device; A control unit for controlling the BIFS information to be reproduced in synchronization with the broadcast content through the BIFS playback unit, and controlling the broadcast content to be reproduced in synchronization with the BIFS information ; A PPL processing unit for receiving and processing the BIFS information from a mobile communication network in the form of a packet; And A broadcast processor for extracting an audio / video stream by receiving and interpreting the broadcast content from a broadcast network; Digital broadcast receiving terminal comprising a. The method of claim 23, The BIFS playback unit may generate a random access offset RA from PTS (start), which is a video start time of the BIFS information, RA (t) = abs (PTS (start)-PTS (a). )) + PTS (n) = abs (PTS (start) -PTS (n)). The method of claim 24, The controller sets a reference clock after the random access offset (RA), and decodes and renders the BIFS information and the image stream with respect to the reset and adjusted reference clock. terminal. The method of claim 23, The BIFS information is composed of unit classes in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on individual streams of video / audio / BIFS, and these. And 'mdat' stored in the form of a sample of a stream fragment of a minimum unit having time information. The method of claim 23, The BIFS information is interactive content capable of interworking with a user and is stored in the form of an mp4 file. The method of claim 23, The control unit transmits a GUIP start request message to a service providing server providing the BIFS information according to a GUIP start key selection, receives a GUIP start response from the service providing server, and then sends the GUIP start request message to the service providing server. And requesting PPL information, and receiving the BIFS information from the service providing server. An additional information converting method of a service providing server for providing additional information and a digital broadcast receiving terminal for displaying the additional information in synchronization with broadcast content, (a) receiving and displaying the broadcast content; (b) requesting the service providing server for additional information about the broadcast content; (c) receiving the additional information as BIFS information from the service providing server; And (d) displaying the BIFS information in synchronization with the broadcast content; The additional information conversion method of the digital broadcast receiving terminal comprising a. The method of claim 29, In step (b), the GUIP start request message is transmitted to the service providing server according to the selection of the GUIP start key, and after receiving a GUIP start response from the service providing server, the service providing server requests PPL information. An additional information converting method of a digital broadcast receiving terminal. The method of claim 30, The GUIP start request message includes a channel, a program, and a presentation time stamp (PTS). The method of claim 29, The BIFS information is interactive content capable of interworking with a user and is stored in the form of an mp4 file. The method of claim 29, The BIFS information is composed of unit classes in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on individual streams of video / audio / BIFS, and these. And 'mdat' stored in the form of a sample of a stream fragment of a minimum unit having time information. The method of claim 29, In step (d), a random access offset (RA) is obtained from PTS (start), which is a video start time of the received BIFS information, RA (t) = abs (PTS (start)-PTS (a) ) + PTS (n) = abs (PTS (start)-PTS (n)), wherein the additional information converting method of the digital broadcasting receiver terminal is calculated. The method of claim 29, In the step (d), the reference clock is set after the random access offset (RA), and the BFS information and image stream are decoded and rendered with respect to the reset and adjusted reference clock. The additional information conversion method of the digital broadcast receiving terminal. (a) receiving an additional information request message for broadcast content from a digital broadcast receiving terminal; (b) retrieving the additional information and converting the retrieved additional information into BIFS information; And (c) transmitting the BIFS information to the digital broadcast receiving terminal; The recording medium on which the program for processing the recorded data. The method of claim 36, In step (a), the GUIP start request message is received from the digital broadcast receiving terminal according to the GUIP start key selection of the digital broadcast receiving terminal, and the response message to the GUIP start request message is transmitted to the digital broadcasting receiving terminal. And a PPL information request message is received from the digital broadcast receiving terminal. The method of claim 37, wherein The GUIP start request message includes a channel, a program, and a PTS (Presentation Time Stamp). The method of claim 36, The BIFS information is an interactive content that can be linked with a user and is stored in the form of an mp4 file. The method of claim 36, The BIFS information is composed of unit classes in a tree-shaped collection, 'moov' for media information technology, 'trak' having information on individual streams of video / audio / BIFS, and these. A recording medium having a program recorded thereon, wherein the actual data of the program comprises 'mdat' stored in the form of a sample of a stream fragment of a minimum unit having time information.

Images