KR20040084508A - Apparatus and Its Method of Multiplexing Multimedia Data to DAB Data - Google Patents

Abstract

PURPOSE: A device and a method for multiplexing multimedia data in DAB(Digital Audio Broadcasting) data, and a demultiplexing method therefor are provided to directly multiplex MPEG-4 data in DAB data. CONSTITUTION: An MPEG-4 streaming portion(11) generates multimedia data packets, and separates the data into meta data, asynchronous object data, and synchronous object data for streaming. A meta data converter(12) converts the meta data, and generates a link information table for supplying link information between a main service channel and multimedia object data. A multiplexed information generator(14) generates multiplexed information. A logic frame generator(13) inputs the synchronous object data, and converts into a stream multiplexing logic frame. A stream mode processor(16) inputs the logic frame to multiplex into a sub channel. A packet mode processor(15) converts the meta data into a DAB packet. A multiplexing controller(17) controls input/output processes of each unit. A DAB multiplexer(18) multiplexes inputted data in DAB data.

Description

Apparatus and Its Method of Multiplexing Multimedia Data to DAB Data for Multiplexing Multimedia Data into Digital Audio Broadcasting Data

The present invention relates to an apparatus for multiplexing multimedia data into digital audio broadcast data, a method thereof, a demultiplexing method thereof, and a computer-readable recording medium having recorded thereon a program for realizing the above methods.

In the present invention, the multimedia data refers to data having a manner of expressing multimedia information, such as MPEG-4 data, MPEG-7 data, MPEG-21 data, and the like.

MPEG-4 is an international standard for encoding and compressing digital video and audio at a transmission rate of 64 kbps or less, and is ultra-low speed and high compression rate compared to MPEG-1 or MPEG-2, which has already been determined as an international standard. And a compression and encoding standard for video, mainly for application in mobile communication.

Digital Audio Broadcasting (DAB) is a new media that provides high quality broadcasting of compact disc (CD) sound quality using digital communication technology. The next generation that not only enables professional broadcasting to meet the diverse needs of listeners, but also supports the functions of various data services such as teletext, fax, electronic newspaper, wide area pager, and traffic information system. Broadcasting technology.

Such digital audio broadcasting was developed in 1987 as Eureka's 147 project in Europe. Conventional digital sound broadcast (Digital Sound Broadcast) had to be fixed by a special antenna using a satellite of the 12GHz band, digital audio broadcast is fixed by both terrestrial or satellite stations of the Ultra High Frequency (UHF) band or satellite Can be received by using. Therefore, the use of digital audio broadcasting can digitally relay high-quality sound such as compact disc (CD) sound quality level or performance status relay, and can receive high-quality sound even in a vehicle such as a vehicle. In particular, the monitor can receive still images, and by using the latest voice encoding method, a single broadcast wave can transmit a plurality of high-quality voices of the compact disc (CD) level.

In general, digital audio broadcasting provides two channels, a fast information channel (FIDC) for providing multiplexing information and service information, and a main service channel (MSC) for multiplexing actual service component data. )to be. The Fast Information Data Channel (FIDC) includes Multiplex Configuration Information (MCI) and Service Information (SI), and includes an Emergency Warning System (EWS) or traffic. And a channel capable of quickly transmitting a relatively small amount of data such as traffic and travel information (TTI).

The main service channel (MSC) is a main service channel for multiplexing each service component according to the multiplex configuration information (MCI), and MPEG audio data and various additional data are multiplexed. At this time, there are two transmission modes of the main service channel (MSC): packet mode and stream mode.

First, the packet mode is a mode in which multiple service components can be multiplexed and transmitted in one subchannel, and the data to be multiplexed is first configured as the main service channel data group packet 31 as shown in FIG. The digital audio broadcast data packets 32 to 34 of size are divided again and multiplexed. In this case, multiple service components multiplexed into one subchannel in the packet mode are divided into 10-bit digital audio broadcast packet addresses, and up to 1023 service components can be multiplexed into one subchannel.

In contrast, the stream mode is a mode for transparent transmission of data requiring constant streaming, such as MPEG-4 video data, and requires a constant data configuration in multiples of 8 kbps per 24 ms. To this end, a logical frame that can be multiplexed into a main service channel (MSC) in 24 ms units is required. Accordingly, data to be transmitted must be configured or divided according to a logical frame structure.

On the other hand, the following are some of the advantages of digital audio broadcasting over conventional analog broadcasting. First, digital audio broadcasts offer the same sound quality as compact discs (CDs) of 18KHz. An even more important advantage is the robustness to multipath. In the case of analogue broadcasts currently in use, medium frequency broadcasts (AMs) are disturbed by impulse noise or static electricity, while FM broadcasts are highly affected by multipath by buildings, mountains or other obstacles, but digital audio broadcasts This effect can be significantly reduced.

However, in the conventional digital audio broadcasting system, if you want to multiplex multimedia data (MPEG-4 data) for transmitting multimedia information such as text and video as well as high-quality music at the level of a compact disc (CD), First, multiplexing may be performed using an MPEG-2 transport stream, and the like may be multiplexed once again with digital audio broadcasting (DAB) data. For this reason, the multiplexing of multimedia data (MPEG-4 data) to digital audio broadcasting data requires overhead, and the configuration of the receiver is complicated.

The present invention has been proposed to solve the above problems, and an apparatus and method for multiplexing multimedia data directly into digital audio broadcasting data, and a computer-readable recording medium having recorded thereon a program for realizing the method. The purpose is to provide.

Another object of the present invention is to provide a method for demultiplexing digital audio broadcast data multiplexed with multimedia data and a computer-readable recording medium having recorded thereon a program for realizing the method.

1 is a block diagram of an embodiment of an apparatus for multiplexing MPEG-4 data into digital audio broadcasting data according to the present invention.

2 is a diagram illustrating an embodiment of a subchannel used in the present invention.

Fig. 3 is a structural diagram of an embodiment of a packet multiplexed with MPEG-4 data to digital audio broadcasting data used in the present invention.

4 is a structural diagram of an embodiment of an M4SMux logical frame used in the present invention.

FIG. 5 illustrates one embodiment of byte alignment of sync layer (SL) packets in an M4SMux logical frame used in the present invention. FIG.

FIG. 6 is a diagram illustrating an embodiment of application of outer coding and interleaving in an M4SMux logical frame used in the present invention. FIG.

7 is a flowchart illustrating a method of multiplexing MPEG-4 data into digital audio broadcast data according to the present invention.

8 is a flowchart illustrating a method for demultiplexing digital audio broadcast data multiplexed with MPEG-4 data according to the present invention.

* Explanation of symbols on the main parts of the drawing

11: MPEG-4 streaming unit 12: metadata conversion unit

13: logical frame generating unit 14: multiplexing information generating unit

15: packet mode processing unit 16: stream mode processing unit

17: multiplexing control unit 18: DAB multiplexing unit

According to an aspect of the present invention, there is provided an apparatus for multiplexing multimedia data into digital audio broadcasting data, the apparatus comprising: streaming means for generating multimedia data packets and streaming them separately into metadata, asynchronous object data, and synchronous object data; Metadata conversion means for receiving the metadata separated by the streaming means and converting the metadata into a form suitable for packetization and generating a link information table for providing link information between the main service channel and the multimedia object data; Multiplexing information generating means for receiving the link information from the metadata converting means and generating the multiplexing information; Logical frame generation means for receiving the synchronization object data separated by the streaming means and converting the stream into a stream multiplexed logical frame; Stream mode processing means for receiving a stream multiplexing logical frame from the logical frame generating means and multiplexing the sub-channels according to the digital audio broadcasting stream mode standard; Packet mode processing means for receiving the asynchronous object data separated by the streaming means and the metadata processed by the metadata converting means, converting them into digital audio broadcast packets and multiplexing them into subchannels; Multiplexing control means for controlling input and output and operation of the metadata converting means, the multiplexing information generating means, the logical frame generating means, the packet mode processing means, and the stream mode processing means; And digital audio broadcasting (DAB) multiplexing means for multiplexing and outputting data from the multiplexing information generating means, the packet mode processing means, and the digital audio broadcasting data received from the outside.

According to another aspect of the present invention, there is provided a method of multiplexing multimedia data into digital audio broadcasting data, the method comprising: a streaming unit generating multimedia data packets and streaming the multimedia data into metadata, asynchronous object data, and synchronous object data; A second step in which a metadata conversion unit receives metadata separated from the streaming unit, converts the metadata into a form suitable for packetization, and generates a link information table for providing link information between a main service channel and multimedia object data; A third step of multiplexing information generating unit receiving link information from the metadata converting unit to generate multiplexing information; A fourth step in which a logical frame generation unit receives the synchronization object data separated by the streaming unit and converts the synchronization object data into a stream multiplexing logical frame; A fifth step of receiving, by the stream mode processing unit, the stream multiplexing logical frame from the logical frame generation unit and multiplexing into subchannels according to the digital audio broadcasting stream mode specification; A sixth step of receiving, by the packet mode processing unit, the asynchronous object data separated by the streaming unit, and the metadata processed by the metadata conversion unit, converting the received audio data into a digital audio broadcasting packet, and multiplexing them into subchannels; And a seventh step of the digital audio broadcasting multiplexer receiving the data from the multiplexed information generator, the packet mode processor, and the stream mode processor and multiplexing the digital audio broadcast data from the outside.

On the other hand, the present invention for achieving the above object, in a method for demultiplexing digital audio broadcast data multiplexed with multimedia data, multiplex configuration information (MCI: Multiplex Configuration Information) and service information in the multiplexed digital audio broadcast data A first step of analyzing service information (SI) to obtain subchannel and service component information provided with Initial Object Descriptor (IOD) data; A second step of extracting an initial object descriptor (IOD) by demultiplexing a main service channel (MSC) using the subchannel and service component information; A binary format screen information (BIFS: BInary Format for Scene) and an object descriptor (OD: Object Descriptor) stream by using an elementary stream identifier (ES_ID) and a link information table (M4SLinkTable) of the initial object descriptor (IOD). Extracting a third step; The object descriptor identifier (OD_ID: Object Descriptor ID), which is connection information about an object descriptor (OD) stream, is extracted from the binary format screen information (BIFS) and linked to an elementary stream identifier (ES_ID). A fourth step of constructing; And a fifth step of configuring and demultiplexing a link between the elementary stream identifier (ES_ID) and a digital audio broadcasting subchannel or a service component by using a link information table (M4SLinkTable) of the object descriptor stream (OD). Include.

Meanwhile, the present invention provides a first function of a streaming unit generating multimedia data packets by multiplexing the multimedia data into the metadata, the asynchronous object data, and the synchronous object data in a multiplexing apparatus having a processor, the multimedia data and the digital audio broadcasting data. ; A second function of receiving, by the metadata conversion unit, metadata separated from the streaming unit, converting the metadata into a form suitable for packetization, and generating a link information table for providing link information between a main service channel and multimedia object data; A third function of multiplexing information generating unit receiving link information from the metadata converting unit to generate multiplexing information; A fourth function of receiving, by the logical frame generation unit, the synchronous object data separated by the streaming unit and converting the synchronization object data into a stream multiplexing logical frame; A fifth function of receiving, by the stream mode processing unit, the stream multiplexing logical frame from the logical frame generation unit and multiplexing into subchannels according to the digital audio broadcasting stream mode specification; A sixth function of receiving, by the packet mode processing unit, the asynchronous object data separated by the streaming unit, and the metadata processed by the metadata conversion unit, converting the received audio data into digital audio broadcast packets and multiplexing them into subchannels; And a digital audio broadcasting multiplexing unit for reading a program for realizing a seventh function of receiving data from the multiplexing information generating unit, the packet mode processing unit, and the stream mode processing unit and multiplexing the digital audio broadcasting data from the outside. Provides a record medium that can be.

In addition, the present invention provides a demultiplexing apparatus for multimedia data and digital audio broadcasting data having a processor, wherein the multiplexing configuration information (MCI: Multiplex Configuration Information) and service information (SI) are used in the multiplexed digital audio broadcasting data. A first function of acquiring subchannel and service component information provided with Initial Object Descriptor (IOD) data; A second function of extracting an Initial Object Descriptor (IOD) by demultiplexing a Main Service Channel (MSC) using the subchannel and service component information; A binary format screen information (BIFS: BInary Format for Scene) and an object descriptor (OD: Object Descriptor) stream by using an elementary stream identifier (ES_ID) and a link information table (M4SLinkTable) of the initial object descriptor (IOD). A third function of extracting; The object descriptor identifier (OD_ID: Object Descriptor ID), which is connection information about an object descriptor (OD) stream, is extracted from the binary format screen information (BIFS) and linked to an elementary stream identifier (ES_ID). A fourth function of constructing; And a fifth function of configuring and demultiplexing a link between the elementary stream identifier (ES_ID) and a digital audio broadcasting subchannel or a service component by using a link information table (M4SLinkTable) of the object descriptor stream (OD). A computer readable recording medium having recorded thereon a program for realization is provided.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of an apparatus for multiplexing MPEG-4 data into digital audio broadcasting data according to the present invention.

As shown in FIG. 1, the apparatus for multiplexing MPEG-4 data into digital audio broadcasting data according to the present invention includes an MPEG-4 streaming unit 11, a metadata conversion unit 12, and a logical frame generation unit 13. ), A multiplexing information generating unit 14, a packet mode processing unit 15, a stream mode processing unit 16, a multiplexing control unit 17, and a DAB multiplexing unit 18.

First, the MPEG-4 streaming unit 11 performs a function of generating MPEG-4 data in real time or non-real time. At this time, the real-time MPEG-4 data generation function receives a signal from an external source (source), compresses it, and then synchronizes synchronized sync layer (SL) packets in real time. In addition, the non-real time MPEG-4 data generation function reads MPEG-4 data stored in a storage device (not shown) and then streams synchronized Sync Layer (SL) packets. The MPEG-4 streaming unit 11 separates MPEG-4 synchronous object data, such as audio-visual data, asynchronous object data, and metadata related thereto, in addition to a function of generating MPEG-4 data. ) And streams to the packet mode processor 15 and the metadata converter 12, respectively.

The metadata converter 12 receives the metadata from the MPEG-4 streaming unit 11 and converts the metadata into a format capable of digital audio broadcasting (DAB) packetization. That is, the metadata conversion unit 12 receives metadata input from the MPEG-4 streaming unit 11, that is, an Initial Object Descriptor (IOD), an Object Descriptor (OD), and a binary form. Convert screen information (BIFS-Command: BInary Format for Scene description) into data fields including version information and section information as shown in Tables 1, 2, and 3, respectively. The main service channel (MSC) and MPEG- 4 Link information tables as shown in Table 4 below are included to provide link information between object data. The link information table is a table for providing substantial link information between an MPEG-4 elementary stream identifier (ES_ID) and a service component identifier corresponding to an identifier of a main service channel (MSC) and a sub component identifier.

Next, the packet mode processing unit 15 performs digital audio broadcasting on the metadata received from the metadata conversion unit 12 and the asynchronous object data received from the MPEG-4 streaming unit 11. Broadcasting) packetizes the packet and multiplexes it on one subchannel. That is, the packet mode processing unit 15 converts the received data into the main service channel (MSC) data group 31 as shown in FIG. Packetization is performed using (DAB: Digital Audio Broadcasting) packets 32-34. At this time, if the asynchronous object data is composed of various object data having a variable length, packetization may be performed after first multiplexing into an MPEG-4 stream multiplexing (M4SMux) logical frame (bold line). In addition, each data included in the metadata is packetized by individually applying a protection level and a repetition rate according to its characteristics.

The logical frame generation unit 13 is first, the object data (eg, reference clock, BIFS-Command data) that needs to be synchronized with the MPEG-4 audio-visual object data received from the MPEG-4 streaming unit 11 Etc.) as a logical frame, and second, it performs outcoding and interleaving for error tolerance. In this case, a process of generating object data requiring synchronization with MPEG-4 audio-visual object data into a logical frame will be described later with reference to FIGS. 2 and 4.

FIG. 2 is a diagram illustrating an embodiment of a subchannel used in the present invention, in which object data requiring continuous streaming and synchronization, such as MPEG-4 audio-visual object data, is provided as a separate subchannel as shown in FIG. Multiplex to (222,223). At this time, MPEG-4 Stream Multiplexing (hereinafter, referred to as "M4SMux") logical frame as shown in FIG. 4 is used to multiplex the data into a logical frame of a constant size required for stream mode transmission. do. Referring to Figure 4 will be described in more detail with respect to the M4SMux logical frame.

4 is a structural diagram of an embodiment of an M4SMux logical frame used in the present invention.

As shown in FIG. 4, the M4SMux logical frame used in the present invention is largely divided into a header 41 and a payload 42.

First, an extension field flag (EF) 411 for indicating whether an extension field 416 is present, a random access flag (RA Flag) 412 for indicating whether a random access packet exists, A frame length (M4S_length) field 413 for indicating the total length information of the M4SMux logical frame, and a sync layer packet number for indicating the total number of Sync Layer (SL) packets multiplexed on the payload ( SLps_Num) field 414, a multiplexed configuration field for indicating each packet type (audio, video, reference clock, other data, etc.) and length information in the order of multiplexing of Sync Layer (SL) packets 415 and an extension field 416 for indicating limited reception information. At this time, the receiving end efficiently separates the sync layer (SL) packets by using the type and length information of the sync layer (SL) packet included in the multiplex configuration field 415. Multiplexing)

Meanwhile, in the payload 42, a sync layer (SL) packet is sequentially multiplexed according to the information of the multiplex configuration field 415 of the header 41.

As such, the M4SMux logical frame may multiplex multiple Sync Layer (SL) packets generated by the MPEG-4 streaming unit 11 and accommodate Sync Layer (SL) packets of 255 bytes or more. In addition, the M4SMux logical frame can express multiplexing information in a header, which is efficient, and can apply bit stuffing to configure an accurate logical frame required for stream mode processing.

In addition, for flexible synchronization of the M4SMux logical frame, each Sync Layer (SL) packet should be byte aligned at the beginning of the payload 52 as shown in FIG. 5. For this purpose, if the length of the last Sync Layer (SL) packet constituting the payload 52 of the M4SMux logical frame exceeds the determined logical frame length, the M4SMux logical frame is contiguous with the M4SMux logical frame transmitted after 24 ms. For this purpose, the data is divided according to the fragmentation standard defined by the ISO / IEC 14496-1 system, and then byte-aligned at the beginning of the payload 54 of the next M4SMux logical frame. At this time, it should be partitioned considering the code added when applying outer FEC (Forward Error Correction).

Next, with respect to the generated M4SMux logical frame, as shown in FIG. 6, an external encoding and an interleaver are applied to the M4SMux logical frame to enhance error tolerance.

First, an external encoding is an external encoding of data in a predetermined block unit. In the present invention, a Reed-Solomon (hereinafter, referred to as "RS") code is used. The RS code is usually expressed in the form of (n, k) in dividing the bitstream into blocks, which means that once the block is blocked in units of k symbols, the overhead is added to make a total of n symbols into one block. In other words, it is like adding nk overheads. If you make this overhead as a promise (Reed-Solomon's appointment) and send it together, the receiving side (playback side) detects a certain number of error symbols or lowers the number of errors. The symbol can be corrected, so that the transmission quality can be maintained above a certain level.

On the other hand, the interleaver means dispersing the data streams on the time axis so as to disturb the order of the data streams so that the transmission signal is resistant to interference. That is, even if noise occurs in any part of the signal band, signals in other bands are preserved (Time Diversity), and are reversely processed by the receiver to restore the correct value.

The multiplexing information generating unit 14 generates multiplexing information so that the multiplexed MPEG-4 data can be demultiplexed effectively at the receiving end. In general, the multiplexing information is provided in the multiplex configuration information (MCI) and service information (SI) of the fast information channel (FIDC), but an MPEG including multiple objects is provided. There is a limitation in providing link information of MPEG) -4 data. Therefore, an initial object required to be transmitted out of band in multiplex configuration information (MCI) and service information (SI) of the fast information channel (FIDC). Only the Initial Object Descriptor (IOD) data is defined as the main component, and other MPEG-4 data is defined as the subcomponent. Therefore, the receiving end can access other MPEG-4 data only with the access of an Initial Object Descriptor (IOD) at the start of the MPEG-4 service.

First, the multiplexing configuration information for MPEG-4 data includes FIG. Fast provided in the multiplex configuration information (MCI) and service information (SI) of the fast information channel (FIDC). Additional information is provided using the Information Group field. That is, in the subchannel structure represented by FIG type 0/1, an identifier and related information about a subchannel through which MPEG-4 data is transmitted are represented. In the service structure consisting of FIG 0/2, a service identifier and service components (MPEG-4 object data) constituting the service are shown. Next, the service type, subchannel identifier, and packet address information of the packet mode MPEG-4 data are shown using a packet mode service component structure composed of FIG 0/3. Finally, the MPEG-4 data of an undefined data service type is defined as a general entry of an extended data service component type ExtDCST using an extended data service component type structure composed of FIG 0/7.

Using this information, the receiver can easily access the MPEG-4 object data. The process will be described with reference to FIG. 8.

8 is a flowchart illustrating a method of demultiplexing digital audio broadcast data multiplexed with MPEG-4 data according to an embodiment of the present invention.

First, a digital audio broadcasting receiver analyzes multiplex configuration information (MCI) and service information (SI) to provide subchannels and service components for which initial object descriptor (IOD) data is provided. Obtain information (801). In operation 802, an initial object descriptor (IOD) is extracted by demultiplexing a main service channel (MSC) using the subchannel and service component information. Subsequently, a binary format screen information (BIFS) and an object descriptor (OD: Object Descriptor) are obtained by using an elementary stream identifier (ES_ID) and a link information table (M4SLinkTable) of the initial object descriptor (IOD). The stream is parsed and extracted (803). Then, the object descriptor identifier (OD_ID: Object Descriptor ID), which is the connection information for the object descriptor (OD) stream, is extracted from the binary format screen information (BIFS: BInary Format for Scene Descriptor) and the base stream identifier (ES_ID) is extracted. A link is formed (804), and a link between the elementary stream identifier (ES_ID) and the digital audio broadcasting subchannel and a service component is formed using the link information table (M4SLinkTable) of the object descriptor (OD) stream. Demultiplex (805).

On the other hand, the stream mode processing unit 16 performs a function of configuring the M4SMux logical frame generated from the logical frame generation unit 13 as a subchannel. At this time, the stream mode processing unit 16 complies with the digital audio broadcast stream mode specification and receives a logical frame in units of multiples of 24 ms and 8 kbps to configure a subchannel.

The multiplexing control unit 17 controls input / output and operation of each component in order to perform multiplexing in the apparatus for multiplexing MPEG-4 data to digital audio broadcasting data according to the present invention.

Finally, the DAB multiplexer 18 inputs MPEG-4 data processed by the multiplexed information generator 14, the packet mode processor 15, and the stream mode processor 16 from the outside. Multiplexing is performed on digital audio broadcast data.

7 is a flowchart illustrating a method of multiplexing MPEG-4 data into digital audio broadcasting data according to an embodiment of the present invention.

First, the MPEG-4 streaming unit 11 generates MPEG-4 data packets in real time or non-real time (701), and streams them separately into metadata, asynchronous object data, and synchronous object data. In this case, the metadata, asynchronous object data, and synchronous object data separated by the MPEG-4 streaming unit 11 may include the metadata conversion unit 12, the packet mode processing unit 15, and the logical frame generation unit. Inputted by (13), respectively.

The metadata conversion unit 12 converts the metadata received from the MPEG-4 streaming unit 11 into a form suitable for packetization and provides link information between the main service channel and MPEG-4 object data. Create a table (703). The multiplexing information generating unit 14 receives link information from the metadata converting unit 12 and generates multiplexing information necessary for demultiplexing (704).

The packet mode processing unit 15 converts the metadata received from the metadata conversion unit 12 and the asynchronous object data received from the MPEG-4 streaming unit 11 into digital audio broadcast packets, respectively, into one subchannel. Multiplex to (21, 23) (705).

The logical frame generation unit 13 converts the synchronization object data received from the MPEG-4 streaming unit 11 into an M4SMux logical frame, performs external encoding and interleaving for error tolerance, and outputs the received data (706). Then, the stream mode processor 16 receives the external frames and the interleaved logical frames and multiplexes them into the subchannel 222 according to the digital audio broadcast stream mode specification (707).

Thereafter, the DAB multiplexer 18 multiplexes the data received from the multiplexed information generator 14, the packet mode processor 15, and the stream mode processor 16 to digital audio broadcast data input from the outside. Output 708.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

As described above, the present invention provides a method of directly multiplexing MPEG-4 data to digital audio broadcasting data, thereby performing multiplexing using the MPEG-2 Transport Stream. Compared with the conventional method of multiplexing again to digital audio broadcasting data later, the overhead can be reduced, and the configuration of the receiver can be simply implemented.

Claims (13)

An apparatus for multiplexing multimedia data to digital audio broadcasting data, Streaming means for generating multimedia data packets and streaming them separately into metadata, asynchronous object data and synchronous object data; Metadata conversion means for receiving the metadata separated by the streaming means and converting the metadata into a form suitable for packetization and generating a link information table for providing link information between the main service channel and the multimedia object data; Multiplexing information generating means for receiving the link information from the metadata converting means and generating the multiplexing information; Logical frame generation means for receiving the synchronization object data separated by the streaming means and converting the stream into a stream multiplexed logical frame; Stream mode processing means for receiving a stream multiplexing logical frame from the logical frame generating means and multiplexing the sub-channels according to the digital audio broadcasting stream mode standard; Packet mode processing means for receiving the asynchronous object data separated by the streaming means and the metadata processed by the metadata converting means, converting them into digital audio broadcast packets and multiplexing them into subchannels; Multiplexing control means for controlling input and output and operation of the metadata converting means, the multiplexing information generating means, the logical frame generating means, the packet mode processing means, and the stream mode processing means; And Digital audio broadcasting (DAB) multiplexing means for receiving data from the multiplexing information generating means, the packet mode processing means, and the stream mode processing means and multiplexing and outputting the digital audio broadcast data received from the outside; Multiplexing the multimedia data to the digital audio broadcast data comprising a. The method of claim 1, The logical frame generating means receives asynchronous object data composed of several object data having variable length separated from the streaming means, and synchronous object data, and converts the stream into a multiplexed logical frame. The packet mode processing unit receives digital audio processed by the metadata conversion unit, asynchronous object data directly input from the streaming unit, and asynchronous object data converted into a stream multiplexed logical frame by the logical frame generating unit. Multiplexing the multimedia data to the digital audio broadcast data, characterized in that the conversion to a broadcast packet and multiplexed to a sub-channel. The method according to claim 1 or 2, The link information table, Service component identifiers and subs which provide link information between a main service channel (MSC) and multimedia object data, and correspond to an elementary stream identifier (ES_ID) and an identifier of a main service channel (MSC). An apparatus for multiplexing multimedia data into digital audio broadcast data, characterized in that it provides substantial link information with the component identifier. The method according to claim 1 or 2, The multiplexing information generating means, Initial object descriptor (IOD) required to transmit out of bands to multiplex configuration information (MCI) and service information (SI) of Fast Information Data Channel (FIDC) : Initial Object Descriptor) A device for multiplexing multimedia data to digital audio broadcast data, characterized in that data is set as a main component and other multimedia data is set as a subcomponent. The method according to claim 1 or 2, The packet mode processing means, And multiplexing the multimedia data into the digital audio broadcasting data, wherein the packet data is packetized by individually applying a protection level and a repetition rate according to the characteristics of each data included in the metadata. The method according to claim 1 or 2, The logical frame generating means, And multiplexing and interleaving functions for error tolerance to the converted stream multiplexing logical frame. The method of claim 6, The logical frame generating means, For flexible synchronization of stream multiplexing logical frames, each Sync Layer (SL) packet is byte aligned at the beginning of the payload, and the last Sync Layer (SL) length of the logical frame is defined. The apparatus for multiplexing the multimedia data to the digital audio broadcasting data, characterized in that the byte is aligned at the beginning of the next stream multiplexing logical frame payload after dividing when the length is exceeded. A method of multiplexing multimedia data into digital audio broadcasting data, A first step of generating, by the streaming unit, multimedia data packets and separately dividing the multimedia data packets into metadata, asynchronous object data, and synchronous object data; A second step in which a metadata conversion unit receives metadata separated from the streaming unit, converts the metadata into a form suitable for packetization, and generates a link information table for providing link information between a main service channel and multimedia object data; A third step of multiplexing information generating unit receiving link information from the metadata converting unit to generate multiplexing information; A fourth step in which a logical frame generation unit receives the synchronization object data separated by the streaming unit and converts the synchronization object data into a stream multiplexing logical frame; A fifth step of receiving, by the stream mode processing unit, the stream multiplexing logical frame from the logical frame generation unit and multiplexing into subchannels according to the digital audio broadcasting stream mode specification; A sixth step of receiving, by the packet mode processing unit, the asynchronous object data separated by the streaming unit and the metadata processed by the metadata converting unit and converting the received data into digital audio broadcast packets and multiplexing them into subchannels; And A seventh step in which the digital audio broadcasting multiplexer receives data from the multiplex information generating unit, the packet mode processing unit, and the stream mode processing unit and multiplexes the digital audio broadcasting data from the outside; Multiplexing the multimedia data to the digital audio broadcast data comprising a. The method of claim 8, The fourth step, The logical frame generation unit receives asynchronous object data composed of several object data having a variable length separated from the streaming unit, and synchronous object data and converts the stream into a multiplexed logical frame; The sixth step, The packet mode processor receives the metadata processed by the metadata converter and the asynchronous object data converted into a stream multiplexed logical frame by the logical frame generator, converts the packet into a digital audio broadcast packet, and multiplexes them into subchannels. And multiplexing the multimedia data into digital audio broadcasting data. The method according to claim 8 or 9, The fourth step, An eighth step of receiving, by the logical frame generation unit, object data separated by the streaming unit and converting the object data into a stream multiplexing logical frame; And A ninth step of the logical frame generation unit performing outcoding and interleaving for error tolerance on the converted stream multiplexed logical frame Multiplexing the multimedia data to the digital audio broadcast data comprising a. In the method for demultiplexing digital audio broadcast data multiplexed with multimedia data, Subchannel and service component information provided with Initial Object Descriptor (IOD) data by analyzing multiplex configuration information (MCI) and service information (SI) from the multiplexed digital audio broadcasting data A first step of obtaining; A second step of extracting an initial object descriptor (IOD) by demultiplexing a main service channel (MSC) using the subchannel and service component information; A binary format screen information (BIFS: BInary Format for Scene) and an object descriptor (OD: Object Descriptor) stream by using an elementary stream identifier (ES_ID) and a link information table (M4SLinkTable) of the initial object descriptor (IOD). Extracting a third step; The object descriptor identifier (OD_ID: Object Descriptor ID), which is connection information about an object descriptor (OD) stream, is extracted from the binary format screen information (BIFS) and linked to an elementary stream identifier (ES_ID). A fourth step of constructing; And A fifth step of configuring and demultiplexing a link between the elementary stream identifier (ES_ID) and a digital audio broadcasting subchannel or a service component by using a link information table (M4SLinkTable) of the object descriptor stream (OD). And demultiplexing the digital audio broadcast data multiplexed with the multimedia data. In the multiplexing device of the multimedia data and the digital audio broadcasting data having a processor, A first function of generating, by the streaming unit, multimedia data packets and streaming them into metadata, asynchronous object data, and synchronous object data; A second function of receiving, by the metadata conversion unit, metadata separated from the streaming unit, converting the metadata into a form suitable for packetization, and generating a link information table for providing link information between a main service channel and multimedia object data; A third function of multiplexing information generating unit receiving link information from the metadata converting unit to generate multiplexing information; A fourth function of receiving, by the logical frame generation unit, the synchronous object data separated by the streaming unit and converting the synchronization object data into a stream multiplexing logical frame; A fifth function of receiving, by the stream mode processing unit, the stream multiplexing logical frame from the logical frame generation unit and multiplexing into subchannels according to the digital audio broadcasting stream mode specification; A sixth function of receiving, by the packet mode processing unit, the asynchronous object data separated by the streaming unit, and the metadata processed by the metadata conversion unit, converting the received audio data into digital audio broadcast packets and multiplexing them into subchannels; And A seventh function in which the digital audio broadcasting multiplexer receives data from the multiplexing information generating unit, the packet mode processing unit, and the stream mode processing unit and multiplexes the digital audio broadcasting data from the outside; A computer-readable recording medium having recorded thereon a program for realizing this. In the demultiplexing device of the multimedia data and the digital audio broadcasting data having a processor, Subchannel and service component information provided with Initial Object Descriptor (IOD) data by analyzing multiplex configuration information (MCI) and service information (SI) from the multiplexed digital audio broadcasting data A first function of obtaining; A second function of extracting an Initial Object Descriptor (IOD) by demultiplexing a Main Service Channel (MSC) using the subchannel and service component information; A binary format screen information (BIFS: BInary Format for Scene) and an object descriptor (OD: Object Descriptor) stream by using an elementary stream identifier (ES_ID) and a link information table (M4SLinkTable) of the initial object descriptor (IOD). A third function of extracting; The object descriptor identifier (OD_ID: Object Descriptor ID), which is connection information about an object descriptor (OD) stream, is extracted from the binary format screen information (BIFS) and linked to an elementary stream identifier (ES_ID). A fourth function of constructing; And A fifth function of configuring and demultiplexing a link between the elementary stream identifier (ES_ID) and a digital audio broadcasting subchannel or a service component by using a link information table (M4SLinkTable) of the object descriptor stream (OD). A computer-readable recording medium having recorded thereon a program for realizing this.