KR100755838B1 - Apparatus, method, and data structure for supplementary data service in mobile-type broadcast - Google Patents

Abstract

The present invention relates to a mobile broadcast receiver and an additional data service method. In particular, the present invention includes the DLS linked to the video service in the user area of the video service and transmits the same, so that the user can use the DLS service synchronized with the video.

DLS, PAD, Video

Description

Mobile broadcast receiver and additional data service method {Apparatus, method, and data structure for supplementary data service in mobile-type broadcast}

1 is a diagram showing an embodiment of a general DMB service structure

2 illustrates an example of a general DMB video service protocol stack.

3 shows an example of a PAD position in a general audio frame.

4 is a diagram illustrating an example of data types according to an application type of a general X-PAD.

5 illustrates an example of contents included in a NAL unit according to a general NAL unit type.

FIG. 6 is a diagram illustrating a syntax structure of contents included in a NAL unit when the NAL unit type of FIG. 5 is 6. FIG.

7 shows an example of the sei_message () syntax structure of FIG. 6.

FIG. 8 is a diagram illustrating a syntax structure of a payload type according to the payload type of FIG. 7; FIG.

FIG. 9 illustrates a syntax structure of a user data area when the payload type of FIG. 7 is 5; FIG.

10 is a diagram illustrating a structure of an X-PAD data group for DLS according to the present invention.

11 illustrates a syntax structure of a DLS for a video service according to the present invention.

12 illustrates a syntax structure of an example in which DLS is included in a user data area according to the present invention.

13 is a block diagram showing an embodiment of a mobile broadcast receiver according to the present invention;

Explanation of symbols for main parts of the drawings

101: Tuner 102: FIC Demux

103: MCI parser 104: FIDC parser

105: SI parser 106: MSC parser

107: TP Demux 108: PSI Parser

109: video decoder 111114: PAD decoder

111113: Audio decoder 112: Data decoder

The present invention relates to a mobile broadcast system, and more particularly, to an apparatus, a method, and a data structure for servicing additional data synchronized to video.

Digital Audio Broadcasting (DAB), adopted for digital audio broadcasting in Europe, provides clear sound quality and a variety of additional services. The DAB supports MPEG-2 audio as well as MPEG-1 audio to provide clear sound quality, and has a foundation for providing traffic information and web data.

In Korea, Digital Multimedia Broadcasting (DMB) has been defined by extending the DAB to provide video as well as audio. The DMB adopts MPEG-4 / Advanced Video Coding (H.264) for video to provide a video service based on DAB, and audio for MPEG-4 / Bit Sliced Arithmetic Coding (BSAC). Was adopted. The video and audio are multiplexed in the form of MPEG-2 TS (Transport Stream) through the MPEG-2 system. That is, the DMB enables video services using MPEG-4 and MPEG-2 standards.

1 illustrates an example of the DAB / DMB service structure, in which at least one service component constitutes one service and at least one service constitutes one ensemble. That is, the top of the DAB / DMB service is an ensemble.

The ensemble corresponds to a broadcasting station, the service corresponds to one channel of a TV or radio, and is composed of one or more service components. In other words, a series of broadcast programs is sent to the above service according to broadcast schedule information.

The service component means video, audio, traffic information, or broadcast service information constituting a broadcast program. The service component corresponds 1: 1 to a sub channel.

In FIG. 1, an 'Audio' service component, which is a primary service component of an 'Alpha 1 Radio' service, is transmitted to a sub channel a of a main service channel (MSC). The 'Audio' service component is serviced in chronological order according to the program guide plan of the broadcasting station. The SI transmitted on the fast information channel (FIC) of the DAB / DMB provides additional information about a service.

In addition, multiplex configuration information (MCI) is transmitted to the FIC as information indicating what services are multiplexed in the ensemble, service components constituting each service, and where service components are located.

That is, the DAB / DMB transmission frame is composed of a synchronization channel (Fynchronization Channel), a fast information channel (FIC), and a main service channel (MSC).

The MSC is a channel for multiplexing and transmitting media data, and the FIC is a channel for transmitting important data to be transmitted to the receiver before media data such as MSC multiplexing arrangement information (MCI) and system information (SI).

Meanwhile, the video service of the DMB is defined by extending the stream data mode of the DAB.

FIG. 2 shows a protocol stack of the DMB video service, which is a hierarchical structure of the DMB service viewed from a receiving side. At this time, 'BETA VIDEO' of FIG. 1 is a video service, and has a primary service component called DMB and is transmitted to subchannel b. That is, as shown in FIG. 2, the media data compressed and encoded in the MPEG-4 scheme is SL packetized in the MPEG-4 Sync Layer, multiplexed in the MPEG-2 TS format in the Delivery Layer, and then transmitted in the stream mode.

Meanwhile, some areas of an audio frame are defined as a program associate data (PAD) area in the DAB to transmit additional data for various data applications. An example is DLS (Dynamic Label Segment), which is a subtitle service of audio broadcasting. The DLS is a service for transmitting a series of sentences that can send text synchronized with audio and can send text that is not synchronized. For example, you can send song lyrics to DLS when a song is output as audio, or news articles to DLS. The DLS may be transmitted to a program associated data (PAD) region of an audio frame transmitted in DAB stream audio mode.

At this time, the PAD region of the DAB audio frame is divided into a fixed size F-PAD field and a variable size X-PAD field as shown in FIG. 3. For example, the DLS is transmitted as an X-PAD field.

The F-PAD region is divided into bytes L-1 and bytes L. If the CI (Content Indicator) flag assigned to byte L in the F-PAD region is '1', it indicates that X-PAD is included in the audio frame.

The X-PAD field includes a data field and a content indicator (CI) field. The X-PAD field stores an application type of data transmitted through the data field in the CI. Referring to FIG. 4, the data group is transmitted to application types 1, 12, 13, 14, and 15, and the DLS is transmitted to application types 2 and 3.

Since the DAB is a digital radio broadcasting standard, various application applications can be supported by sending additional data synchronized with an audio stream.

An object of the present invention is to provide an apparatus, a method, and a data structure for serving a DLS synchronized to a video service by using a user data area of H.264.

In order to achieve the above object, a data service method for mobile broadcasting according to the present invention comprises the steps of: synchronizing and transmitting a dynamic label segment (DLS) to a video service; And parsing the transmitted dynamic label segment and displaying the same in association with a corresponding video service.
The transmitting step is characterized by transmitting the DLS through the user area of the video service.
The DLS is transmitted through a user area in the SEI of the video service.
The SEI may be additional information included in the NAL unit when the NAL unit type is 6.
The transmitting step further includes transmitting a unique identification number for identifying a DLS and flag information for confirming whether the DLS is included,
The displaying may include indicating that the unique identification number is DLS and parsing the transmitted DLS only when the flag information indicates that the DLS is included.

delete

In another aspect, a data service method for mobile broadcasting according to the present invention includes: receiving a dynamic label segment (DLS) transmitted in synchronization with a video service of mobile broadcasting; Detecting a unique identification number for identifying the DLS; Checking whether the DLS is included through flag information; And parsing at least one or more data transmitting the actual DLS according to the flag value.
The at least one data includes a T field, a C field, a First field, and a Last field, each of which is allocated one bit and indicates one of length information and command information according to the C field value and the first field value. And a second field indicating one of Charset information and segment order information.

In accordance with another aspect of the present invention, a mobile broadcast receiver includes: a received signal processor for tuning and demodulating a frequency of a specific channel; A demultiplexer which demultiplexes the multiplexed video service in the form of a transport stream packet in a transport frame demodulated by the genital reception signal processor; A video decoding unit for decoding the demultiplexed video service in the demultiplexer; And a PAD decoder for parsing a dynamic label segment (DLS) from a user area in a video service decoded by the video decoding unit and displaying the same in association with the video decoded video service.
The PAD decoder may parse the DLS from the user area in the SEI of the video service.
The SEI may be additional information included in the NAL unit when the NAL unit type is 6.
The PAD decoder may indicate that the unique identification number in the user area is DLS, and parse the DLS from the video service only when the flag information indicates that the DLS is included.

Other objects, features and advantages of the present invention will become apparent from the following detailed description of embodiments taken in conjunction with the accompanying drawings.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention that can specifically realize the above object will be described. At this time, the configuration and operation of the present invention shown in the drawings and described by it will be described as at least one embodiment, by which the technical spirit of the present invention and its core configuration and operation is not limited.

The present invention is to provide text information, for example, DLS in synchronization with a video service.

In particular, the present invention is to transmit the DLS through the SEI region included in the NAL unit when the NAL (Network Abstraction Layer) unit type is 6.

In general, H.264, a video service standard of DMB, uses NAL to improve network portability. The NAL adoption allows the H.264 bitstream to be easily transmitted over many different networks.

In other words, H.264 can be freely used in various networks, and in particular, a layer responsible for compressing a video signal in order to facilitate data movement between different heterogeneous networks, and this information can be transmitted over a network. It is divided into hierarchies that are responsible for converting data into specific forms. Among these, the layer responsible for the compression function is called a video coding layer (VCL), and the layer responsible for the network adaptation function is called a NAL.

In this case, the mobile broadcast receiver can receive compressed data in the form of a bitstream or a packet through various types of networks, and this data is reconstructed into NAL units having the same data format over all networks.

FIG. 5 shows NAL unit type (nal_unit_type) codes included in NAL unit syntax and contents of the codes.

Referring to FIG. 5, when the NAL unit type is 6, the content of the NAL unit indicates SEI (Supplemental Enhancement Information). That is, when the NAL unit type is 6, data of the sei_rbsp type is included in the NAL unit.

The SEI includes time information and additional information related to the screen representation of the decoded data.

The SEI has a sei_rbsp () syntax structure as shown in FIG. 6 and transmits corresponding information to sei_message ().

7 illustrates the syntax structure of the sei_message (), and transmits user data through the sei_payload field. The sei_payload field includes a payload type and a payload size.

8 shows types of user data according to the payload type. For example, if the payload type (payloadType) is 1, the payload data of sei_message () indicates picture timing information pic_timing.

According to the present invention, when the payload type (payloadType) is 5, the PAD is transmitted as data user_data_unregistered (payloadSize) that can be carried in the payload.

That is, in H.264, when the payload type (payloadType) is 5, the data structure of user_data_unregistered is shown in FIG. 9, a unique identifier (uuid_iso_iec_11578) field and a user data payload byte (user_data_payload_byte) field are included.

According to an embodiment of the present invention, a universally unique identifier (uuid) is allocated to transmit a DLS in synchronization with a video service of a DMB broadcast, and the DLS is serviced using the user_data_payload_byte region of FIG.

FIG. 10 shows the structure of an X-PAD data group for one DLS, and is divided into a 16-bit prefix region, an n * 8-bit character field region, and a 16-bit CRC region. do. N of the character field may have a value of 1 to 16. That is, the DLS is composed of up to eight segments, and the character field of each segment is composed of up to 16 bytes. Since the characters of the DLS are defined by an ASCII code, the number of characters of the DLS is at most 128.

The prefix area includes one bit T (toggle) flag, one bit First flag, one bit Last flag, one bit C (Command) flag, a first field assigned with four bits, a second field, and four. It consists of an Rfa field of bits.

The first field indicates length when the C flag is '0' and indicates a command when '1'. When the First flag is '1', the second field indicates a charset. When the first flag is '0', the second field indicates a sequence of segments constituting a dynamic label in the segment number field (SegNum) of the lower 3 bits.

Referring to FIG. 4, application type 2 means the start of a segment of a DLS, and application type 3 means the continuation of a segment. The end of the segment is determined according to a length field allocated to the prefix area of the segment.

11 shows a structure of a DLS synchronized to a video service according to the present invention. In FIG. 11, the segmentFlag field indicates whether DLS is included in a DMB video service. For example, if the segmentFlag field value is 1, it means that the DLS is included in the video service, and if it is 0, it means that the DLS is not included.

When the segmentFlag field value is 1, the TF field from the T field to the CRC field of FIG. 11 has the same structure as the DLS transmitted to the X-PAD of FIG. 10.

For example, assuming '3639bca4-93ab-4a90-b129-5ba2bb9891f0' is allocated as a unique identifier (uuid) of the DLS service for video service, FIG. 12 shows an example of DLS included in the user_data_payload_byte field of the user_data_unregistered area. have.

Referring to FIG. 12, since the segmentFlag field value is '1', a valid DLS is included in the video service, and since the First and Last fields are 1 and 1, respectively, this means that a single dynamic label is configured. In addition, since the C flag is 0, this means that it is a label, not a command. In this case, since the length field value is 9, the length of the actual character field is 10 bytes. And the text stored in the character field is "This Label". In addition, since the Charset field value is b0011, it means that the character set of ISO Latin Alphabet No 2 is used. CRC values for data from the T flag to the character field are stored in the CRC field.

This allows the user to use DLS services synchronized to video, as well as DLS services provided only through audio frames.

FIG. 13 is a block diagram of a decoding related mobile broadcast receiver according to the present invention. The tuner 101, the FIC demux 102, the MCI parser 103, the FIDC parser 104, the SI parser 105, and the MSC decode Mux 106, transport (TP) demux 107, PSI decoder 108, video decoder 109, PAD decoder 110, audio decoder 111, data decoder 112, audio decoder 113 ), And a PAD decoder 114.

The tuner 101 of the mobile broadcast receiver configured as described above receives and demodulates a DMB service of a specific channel, and then outputs FIC channel information to the FIC demux 102 and MSC channel information to the MSC demux 106.

The FIC demux 102 separates MCI, SI, and FIDC from the FIC channel and provides the MCI parser 103, the FIDC parser 104, and the SI parser 105 to parse the corresponding information.

The MSC demux 106 separates the DMB broadcasting service from the signal received through the MSC channel and outputs it to the TP demux 107, and separates a data service such as EPG and outputs it to the data decoder 112, and dedicated audio. (I.e., the DAB) service is separated and output to the audio decoder 113.

The TP demux 107 separates the PSI, video, and audio from the DMB broadcasting service, and then outputs the PSI to the PSI decoder 108, outputs the video to the video decoder 109, and outputs audio to the audio decoder 111. Will output Each decoder described above applies a corresponding algorithm to perform decoding on the input data.

In this case, PAD decoders 111 and 114 are provided at the output terminal of the video decoder 109 and the output terminal of the audio decoder 113, respectively.

The audio decoders 111 and 113 are provided because the audio decoding algorithm used in the DMB service and the audio decoding algorithm used in the existing DAB service are different. For example, the audio decoding algorithm used in the DMB service is BSAC, and the audio decoding algorithm used in the DAB service is MUSICAM.

The PAD decoder 110 provided at the output of the video decoder 109 parses the DLS from the user data area of the DMB video service video decoded by the H.264 decoding algorithm. The DLS decoded by the PAD decoder 110 is displayed on the display device in conjunction with a video service. For example, if a person is currently singing a song, the subtitle may show the lyrics of the song.

The PAD decoder 114 provided at the output of the audio decoder 113 parses the PAD from the audio frame of the DAB audio service that is audio decoded by the MUSICAM decoding algorithm. The PAD decoded by the PAD decoder 114 is displayed on the display device in conjunction with an audio service.

On the other hand, the terms used in the present invention (terminology) are terms defined in consideration of the functions in the present invention may vary according to the intention or practice of those skilled in the art, the definitions are the overall contents of the present invention It should be based on.

The present invention is not limited to the above-described embodiments, and as can be seen in the appended claims, modifications can be made by those skilled in the art to which the invention pertains, and such modifications are within the scope of the present invention.

The data structure, method, and mobile broadcast receiver applying the same for additional data service synchronized to video according to the present invention described above are as follows.

First, DLS video services can be synchronized to or without video / audio. For example, subtitle broadcasting using DLS is possible in a video service.

Second, DLS services synchronized to video are possible without using large DMB middleware or BIFS by using existing DAB technology.

Those skilled in the art will appreciate that various changes and modifications can be made without departing from the spirit of the present invention.

Therefore, the technical scope of the present invention should not be limited to the contents described in the embodiments, but should be defined by the claims.

Claims (11)

Synchronizing and transmitting a dynamic label segment (DLS) to a video service; And Parsing the transmitted dynamic label segment and displaying the dynamic label segment in association with the corresponding video service. The method of claim 1, wherein the transmitting step A data service method for mobile broadcasting, characterized in that DLS is transmitted through a user area of a video service. The method of claim 1, wherein the transmitting step And transmitting the DLS through a user region in the SEI of the video service. The method of claim 3, wherein the SEI is additional information included in the NAL unit when the NAL unit type is 6. The method of claim 1, The transmitting step further includes transmitting a unique identification number for identifying a DLS and flag information for confirming whether the DLS is included, The displaying may indicate that the unique identification number is DLS, and parses the DLS transmitted only when the flag information indicates that the DLS is included. Receiving a dynamic label segment (DLS) transmitted in synchronization with a video service of a mobile broadcast; Detecting a unique identification number for identifying the DLS; Checking whether the DLS is included through flag information; And Parsing at least one or more data that transmits actual DLS according to the flag value. 7. The method of claim 6, wherein the one or more data is Includes a T field, a C field, a First field, and a Last field, each of which is allocated one bit. A first field indicating one of length information and command information according to the C field value; And a second field for displaying one of Charset information and segment order information according to the value of the First field. A reception signal processor configured to tune and demodulate a frequency of a specific channel; A demultiplexer for demultiplexing a video service multiplexed in the form of a transport stream packet in a transport frame demodulated by the received signal processor; A video decoding unit for decoding the demultiplexed video service in the demultiplexer; And And a PAD decoder for parsing a dynamic label segment (DLS) from a user area in a video service decoded by the video decoding unit and displaying the same in association with the video decoded video service. The method of claim 8, wherein the PAD decoder And parsing the DLS from the user area in the SEI of the video service. 10. The mobile broadcast receiver of claim 9, wherein the SEI is additional information included in the NAL unit when the NAL unit type is 6. The method of claim 8, wherein the PAD decoder And a DLS is parsed from the video service only when the unique identification number in the user area is DLS and the flag information indicates that the DLS is included.

Images