KR100813269B1 - Method and apparatus for processing/transmitting bit stream, and method and apparatus for receiving/processing bit stream - Google Patents

Abstract

The present invention relates to a method and apparatus for hierarchically encoding / decoding audio data, such as bit sliced arithmetic coding (BSAC), wherein the payloads of audio data and extension data are grouped according to their importance, and some of them are rearranged. By discarding the group and transmitting the remaining group, it is possible to preferentially transmit the extended data which plays a more important role than the upper layer of the audio data in the original sound reproduction.

Description

Method and apparatus for bit stream processing / transmission, method and apparatus for receiving / processing bit stream {Method and apparatus for processing / transmitting bit stream, and method and apparatus for receiving / processing bit stream}

Figure 1 shows a block diagram of an embodiment of a bit stream processing / transmission apparatus according to the present invention.

2 is a conceptual diagram illustrating an example of elementary stream discard in the bit stream processing / transmission apparatus according to the present invention.

3 is a conceptual diagram illustrating another example of elementary stream discard in the bit stream processing / transmission apparatus according to the present invention.

4 is a conceptual diagram illustrating another example of elementary stream discard in the bit stream processing / transmission apparatus according to the present invention.

5 is a block diagram illustrating another embodiment of a bitstream processing / transmission apparatus according to the present invention.

6 is a conceptual diagram illustrating an example of payload truncation in the bitstream processing / transmission apparatus according to the present invention.

7 is a block diagram illustrating an embodiment of a bit stream receiving / processing apparatus according to the present invention.

8 is a block diagram illustrating another embodiment of a bitstream receiving / processing apparatus according to the present invention.

9 is a flowchart illustrating an embodiment of a method for processing / transmitting a bit stream according to the present invention.

10 is a flowchart illustrating another embodiment of a method for processing / transmitting a bit stream according to the present invention.

11 is a flowchart illustrating another embodiment of a method for receiving / processing a bit stream according to the present invention.

12 is a flowchart illustrating another embodiment of a method for receiving / processing a bit stream according to the present invention.

The present invention relates to a method and apparatus for encoding / decoding audio data, and more particularly, to a method and apparatus for encoding / decoding audio data hierarchically such as a bit sliced arithmetic coding (BSAC) scheme.

There are two transmission methods of BSAC payload supporting FGS function as follows. First, drop the elementary stream for the BSAC access unit. Here, the access unit refers to an independently accessible portion of the elementary stream and is the smallest data unit that may include timing information. Second, truncate the BSAC payload at the server side providing audio data, that is, at the encoding device side. The former occurs on the sync layer and the delivery layer, while the latter occurs on the compression layer. In particular, the two methods described above may be used simultaneously.

In the case where the bit stream is transmitted to the decoding apparatus by hierarchically encoding the audio data by the encoding method using the above-described transmission scheme, conventionally, data for extending a channel of audio data into a multi-channel, data for extending the bandwidth of audio data, Does not provide a solution to efficiently transmit extended data that can be implemented by extending audio data such as data for generating a CRC code for checking transmission error of audio data simultaneously with hierarchically encoded audio data. Has

An object of the present invention is to provide an apparatus and method for enhancing backwards audio data and providing backward compatibility capable of supporting a conventional hierarchical encoding method. Another object of the present invention is to provide an apparatus and method for providing a solution that can be transmitted in a scalable manner considering the importance of extended data in addition to the importance of each band of audio data. Further, the present invention provides a computer-readable recording medium having recorded thereon a program for executing the above-described methods on a computer.

The technical problem to be achieved by the present invention is not limited to the above technical problems, and other technical problems may exist. This can be clearly understood from the following description by those skilled in the art to which the present invention pertains.

A bit stream processing / transmission method according to the present invention for solving the technical problem comprises the steps of: encoding audio data and at least one extension data of the audio data; Grouping and releaving the payloads that are the result of the encoding; And discarding some of the grouped and relocated payloads, and transmitting the remaining group.

In order to solve the above other technical problem, the present invention provides a computer readable recording medium having recorded thereon a program for executing the above-described bit stream processing / transmission method on a computer.

In accordance with another aspect of the present invention, there is provided a bit stream processing / transmission apparatus comprising: an encoding unit encoding audio data and at least one extension data of the audio data; A processing unit for grouping and rearranging payloads that are a result encoded by the encoding unit; And a transmitter for discarding some groups of the grouped and relocated payloads and transmitting the remaining groups.

According to another aspect of the present invention, there is provided a method for processing / transmitting a bit stream, comprising: encoding audio data and at least one extension data of the audio data; Truncating a portion of the payloads that are a result of the encoding in the encoding step; And transmitting the truncated payloads.

In order to solve the above another technical problem, the present invention provides a computer readable recording medium having recorded thereon a program for executing the above-described bit stream processing / transmission method on a computer.

In accordance with another aspect of the present invention, there is provided a bit stream processing / transmission apparatus comprising: an encoding unit encoding audio data and at least one extension data of the audio data; Truncating a portion of payloads that are a result encoded by the encoder; And a transmitter for transmitting the truncated payloads.

According to another aspect of the present invention, there is provided a method for receiving / processing a bit stream, including: receiving some of grouped and relocated payloads; Restoring payloads of the original form from the grouped and relocated payloads; And decode audio data included in the reconstructed payloads and at least one extension data of the audio data.

In order to solve the above another technical problem, the present invention provides a computer-readable recording medium having recorded thereon a program for executing the above-described method of receiving / processing a bit stream on a computer.

According to another aspect of the present invention, there is provided a bit stream receiving / processing apparatus including: a receiving unit configured to receive some of grouped and rearranged payloads; A reconstruction unit for reconstructing payloads of an original form from the grouped and relocated payloads; And a decoder configured to decode audio data included in the reconstructed payloads and at least one extension data of the audio data.

According to another aspect of the present invention, there is provided a method of receiving / processing a bit stream, the method comprising: receiving payloads partially cut off; Restoring payloads in their original form from the partially cut payloads; And decoding audio data included in the reconstructed payloads and at least one extension data of the audio data.

In order to solve the above another technical problem, the present invention provides a computer-readable recording medium having recorded thereon a program for executing the above-described method of receiving / processing a bit stream on a computer.

Another bit stream receiving / processing apparatus according to the present invention for solving the another technical problem is a receiving unit for receiving a portion of the payload cut off; A restoration unit for restoring payloads of the original shape from the payloads in which the portion is cut off; And a decoder configured to decode audio data included in the reconstructed payloads and at least one extension data of the audio data.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating an embodiment of a bitstream processing / transmission apparatus according to the present invention, wherein the bitstream processing / transmission apparatus includes an encoder 100, a payload processor 110, and an ES generator 120. ), An ES priority allocator 130, an SL packet generator 140, an SL priority allocator 150, and a transmitter 160.

The encoder 100 hierarchically encodes audio data and extended data of the audio data. Here, the audio data may be encoded by the BSAC method. The extended data of the audio data includes data for extending a channel of the audio data into multiple channels, data for extending the bandwidth of the audio data, data for generating a CRC code for checking a transmission error of the audio data, and the like. Here, the extended data of the audio data may include metadata of the audio data, a fill element of the audio data, and the like, in addition to the above-described extended data. In encoding the extended data of the audio data, the encoder 100 may encode at least one or more of the above-described examples of the extended data of the audio data.

In the case of dropping an elementary stream for an access unit among payload transmission methods, the payload processing unit 110 may determine any one of encoding results of the encoding unit 100. The payloads are interleaved by grouping such that some of the payloads belonging to the subframe and some of the payloads belonging to the other subframe become one group. In the MPEG standard, an access unit refers to an independently accessible portion of an elementary stream and is the smallest data unit that may include timing information.

The ES generator 120 generates elementary streams corresponding to groups of payloads on the compression layer from payloads grouped and rearranged by the payload processor 110. The compression layer refers to a layer that receives the result encoded by the encoder 100 and generates elementary streams therefrom.

The ES priority assignment unit 130 assigns priority to the elementary streams generated by the ES generation unit 120. In more detail, the ES priority assigning unit 130 assigns priority to each of the elementary streams based on the order to be preferentially transmitted to the decoding end. Accordingly, each of the elementary streams generated by the ES generator 120 has a priority specified in the ES descriptor.

The SL packet generator 140 generates SL packets corresponding to groups of payloads on a sync layer (SL) from the elementary streams generated by the ES generator 120. The synchronization layer refers to a layer that generates SL packets that provide synchronization information between the audio data encoding apparatus and the audio data decoding apparatus by adapting the elementary streams.

The SL priority assigning unit 150 allocates priority to each of the SL packets generated by the SL packet generating unit 140. In more detail, the SL priority allocator 150 allocates priority to each of the SL packets based on the order of priority transmission to the decoder. The priority allocated to each of the elementary streams in the ES priority allocator 130 and the priority allocated to each of the SL packets in the SL priority allocator 150 are a plurality of element streams. Enables discarding for scalable transmission at.

The transmission unit 160 is based on the priority of each of the elementary streams assigned by the ES priority assignment unit 130 and the priority of each of the SL packets assigned by the SL priority assignment unit 150. Discard some of the SL packets and transmit the remaining SL packets. In more detail, the transmitter 160 determines the overall bit rate for the transmission of the SL packets in consideration of the transmission environment between the encoder and the decoder, and prioritizes each of the elementary streams according to the overall bit rate. Subtracting the priority of each of the SL packets from each other, and discards the SL packets in the smallest order, and transmits the remaining SL packets.

2 is a conceptual diagram illustrating an example of elementary stream discard in the bit stream processing / transmission apparatus according to the present invention.

2 is an example for scalable transmission of BSAC audio data and extension data when the extension data of the audio data is data for extending the channel of the audio data into multichannels. That is, this is an example for scalable transmission of BSAC payloads corresponding to BSAC channel extention '.

In the example shown in FIG. 2, the number of subframes is set to two, and four SL packets having a lower priority are discarded. However, according to the present invention, the number of subframes is not limited to two but may be implemented using at least one or more subframes, and the number of discarded SL packets may also change in some cases. The discarded packets correspond to a higher layer among BSAC payloads of audio data of a C (Center) channel and a Surround Left (Surround Right) channel corresponding to the extended data of the audio data. This is to allow the lower layer corresponding to the low frequency band to be preferentially transmitted to each of the channels of the multichannel audio data so that the audio data of each channel can be reproduced evenly.

In the case of FIG. 2, the payload processing unit 110 may be configured by the encoder 100 so that some of the BSAC payloads of the audio data and some of the payloads of the data for extending the channel of the audio data are one group. Payloads resulting from the coding are grouped and interleaved.

For example, if the audio data in the present embodiment is 5.1 channel audio data, the payload processing unit 110 is encoded by the encoder 100 with respect to the FL (Front Left) channel and the FR (Front Right) channel. The audio data of the SL channel and the SR channel, which is the result of being encoded by the encoder 100 for the lower layer side LL0_0 and the SL channel and the SR channel, among the payloads of the audio data of the FL and FR channels. The lower layer side LL1_0 of the BSAC payloads of each layer is grouped to be one group and rearranged.

In addition, the payload processing unit 110 and the upper layer side LL0_1 of the BSAC payload of each layer of the audio data of the FL channel and the FR channel, which are the result of the encoding of the FL channel and the FR channel, by the encoder 100. The SL channel and the SR channel are grouped and rearranged so that the upper layer LL1_1 of the BSAC payloads of the respective layers of the audio data of the SL channel and the SR channel, which are the result of being encoded by the encoder 100, becomes a group. .

The ES generator 120 generates a zeroth elementary stream from the payloads LL0_0 and the payloads LL1_0 that have become a group due to grouping and relocation in the payload processing unit 110. Subsequently, the ES priority assigning unit 130 assigns a priority of 9 to the 0th elementary stream generated by the ES generating unit 120. The SL packet generator 140 generates two SL packets from the 0 th elementary stream generated by the ES generator 120. Next, the SL priority allocator 150 allocates a priority 0 to each of the SL packets generated by the SL packet generator 140. The other payloads shown in FIG. 2 are processed as described above.

The transmitter 160 discards the four SL packets in the order of subtracting the priority of each of the SL packets from the priority of each of the elementary streams according to the overall bit rate for transmitting the SL packets, and discards the remaining SL packets. Send packets.

3 is a conceptual diagram illustrating another example of elementary stream discard in the bit stream processing / transmission apparatus according to the present invention.

3 is an example for scalable transmission of audio data and extension data when the extension data of the stereo audio data is data for extending the bandwidth of the audio data. That is, this is an example for scalable transmission of BSAC payloads that are encoded according to BSAC SBR enhancement '.

In the example shown in FIG. 3, the number of subframes is set to two, and two SL packets having a lower priority are discarded. However, according to the present invention, the number of subframes is not limited to two but may be implemented using at least one or more subframes, and the number of discarded SL packets may also change in some cases. The discarded packets correspond to an upper layer of BSAC payloads of each layer of stereo audio data belonging to the first subframe and an upper layer of BSAC payloads of each layer of stereo audio data belonging to the second subframe. This is to increase the discarded SL packets so that the overall bit rate to be transmitted can be reduced. Since the high frequency band corresponding to the upper layer can be restored by the SBR tool, the quality of the restored sound quality is negligible compared to the reduction of the overall bit rate.

In the case of FIG. 3, the payload processing unit 110 includes some of the BSAC payloads of the audio data belonging to the first subframe and some of the BSAC payloads of the audio data belonging to the second subframe. By the encoder 100, the payload of the data for extending the bandwidth of the audio data belonging to the first subframe and the payload of the data for extending the bandwidth of the audio data belonging to the second subframe are included in one group. The BSAC payloads, which are encoding results, are grouped and rearranged.

For example, if the audio data in the present embodiment is stereo audio data, the payload processing unit 110 belongs to the first subframe that is a result of being encoded by the encoding unit 100 for the FL channel and the FR channel. Lower layer side (LL0_0) of the BSAC payloads of each layer of audio data of the FL channel and FR channel and lower layer side of the BSAC payloads of each layer of audio data of the FL channel and FR channel belonging to the second subframe (LL1_0) Regroup by grouping them into a group. The remaining layers of audio data of the FL channel and the FR channel are similarly processed.

In addition, the payload processing unit 110 BSBS of data for extending the bandwidth of the audio data of the FL channel and the FR channel belonging to the first subframe that is the result of being encoded by the encoder 100 for the FL channel and the FR channel The payload LL0_3 and the BSAC payload LL1_3 of the data for expanding the bandwidth of the audio data of the FL channel and the FR channel belonging to the second subframe are grouped and rearranged.

The ES generator 120 generates a zeroth elementary stream from the BSAC payloads LL0_0 and BSAC payloads LL1_0 that have become a group due to grouping and relocation in the payload processing unit 110. . The remaining layers of audio data of the FL channel and the FR channel are similarly processed.

In addition, the ES generator 120 generates a third elementary stream from the payloads LL0_3 and the payloads LL1_3 that have become a group due to the grouping and relocation of the payload processing unit 110. .

Subsequently, the ES priority assigning unit 130 assigns a priority of 9 to the 0th elementary stream generated by the ES generating unit 120. The remaining layers of audio data of the FL channel and the FR channel are similarly processed. In addition, the ES priority assigning unit 130 assigns priority 3 to the third elementary stream generated by the ES generating unit 120.

Subsequently, the SL packet generator 140 generates two SL packets from each of the elementary streams generated by the ES generator 120. Subsequently, the SL priority assigning unit 150 assigns priority to each of the SL packets generated by the SL packet generating unit 140. The transmitter 160 discards the two SL packets in order of subtracting the priority of each of the SL packets from the priority of each of the elementary streams according to the overall bit rate for transmitting the SL packets. Send the remaining SL packets.

4 is a conceptual diagram illustrating another example of elementary stream discard in the bit stream processing / transmission apparatus according to the present invention.

The example shown in FIG. 4 is an example for scalable transmission of BSAC audio data and extension data when the extension data of the audio data is data for extending the channel of the audio data. That is, this is an example for scalable transmission of 'BSAC channel extention with SBR'.

In the example shown in FIG. 4, four low priority SL packets are discarded. However, according to the present invention, the number of subframes is not limited to one but may be implemented using at least one subframe, and the number of discarded SL packets may also change in some cases.

In the case of FIG. 4, the payload processing unit 110 may include some of BSAC payloads of audio data, some of payloads of data for multichannel extension of a channel of audio data, and data for extending bandwidth of audio data. The payloads, which are the result of encoding by the encoder 100, are grouped and rearranged so that the payloads are a group.

The ES generator 120 generates a zeroth elementary stream from the payloads LL0_0 that have become a group due to the grouping and relocation in the payload processing unit 110. Subsequently, the ES priority assigning unit 130 assigns a priority of 9 to the 0th elementary stream generated by the ES generating unit 120. The SL packet generator 140 generates two SL packets from the zeroth elementary stream generated by the ES generator 120. Next, the SL priority allocator 150 allocates priorities 0 and 1 to each of the SL packets generated by the SL packet generator 140. The other payloads shown in FIG. 4 are processed in the same manner as described above.

The transmitter 160 discards the four SL packets in the order of subtracting the priority of each of the SL packets from the priority of each of the elementary streams according to the overall bit rate for transmission of the SL packets, and discards the remaining SL packets. Send packets.

FIG. 5 is a block diagram illustrating another embodiment of a bit stream processing / transmission apparatus according to the present invention. The bit stream processing / transmission apparatus includes an encoder 500, a payload processor 510, and an ES generator ( 520, the ES priority assigning unit 530, the SL packet generating unit 540, the SL priority assigning unit 550, and the transmitting unit 560.

The encoder 500 hierarchically encodes audio data and extended data of the audio data. Here, the audio data may be encoded by the BSAC method. The extended data of the audio data includes data for extending a channel of the audio data into multiple channels, data for extending the bandwidth of the audio data, data for generating a CRC code for checking a transmission error of the audio data, and the like. Here, the extended data of the audio data may include metadata of the audio data, a fill element of the audio data, and the like, in addition to the above-described extended data. In encoding the extended data of the audio data, the encoder 500 may include at least one or more examples of the above-described extended data of the audio data and encode the encoded data.

The payload processing unit 510 considers the transmission environment between the encoding end and the decoding end and, for example, considers the number of layers that may be determined by the payload from the back-channel. Some of the payloads belonging to one subframe and some of the payloads belonging to another subframe are truncated.

In particular, the payload processing unit 510 cuts some of the payloads as "light-weight server processes". In the present embodiment, the lightweight server processing refers to additional processing such as parsing of a bit stream required for truncating some of the payloads, and discards an elementary stream for an access unit among transmission methods of the BSAC payload. The term lightweight is used because of the simplicity of processing and transmission of payload when compared to the scheme.

In addition, the payload processing unit 510 cuts only a part of payloads of the audio data and does not cut the payloads of the extension data of the audio data. Accordingly, the payload processing unit 510 distinguishes payloads of the audio data and payloads of the extended data by parsing the bit stream, and cuts only some of the payloads that are not the payloads of the extended data based on the discrimination. .

BSAC uses zero_code and sync_word to make this distinction. That is, the payload processing unit 510 identifies payloads of the extended data using zero_code and sync_word, and cuts only some of the payloads that are not the payloads of the extended data. Also, the payload processing unit 510 connects the zero_code and sync_word to the end of the truncated payload so that the audio data decoding apparatus can extract the access unit from the transmitted ES by checking zero_code and sync_word. In the absence of payloads of extension data, the distinction as described above is not necessary and is simpler.

In addition, the payload processing unit 510 determines the target bit rate in consideration of the transmission environment between the encoding end and the decoding end, calculates the number of target layers based on the target bit rate, and payloads according to the number of the target layers. Cut some of them.

The ES generator 520 generates one elementary stream corresponding to the groups of payloads on the compression layer from the payloads cut by the payload processing unit 510, and from the payloads of the extended data. Create another elementary stream. The ES priority allocator 530 assigns priority to elementary streams generated by the ES generator 520. Subsequently, the SL packet generator 540 generates SL packets corresponding to groups of payloads on the SL layer from the elementary streams generated by the ES generator 520. The SL priority assignment unit 540 assigns priority to each of the SL packets generated by the SL packet generation unit 540. The transmitter 560 transmits the SL packets generated by the SL packet generator 540. As described above, the ES generator 520, the SL packet generator 540, and the transmitter 560 do not perform special processing for scalable transmission according to the present embodiment.

6 is a conceptual diagram illustrating an example of payload truncation in the bitstream processing / transmission apparatus according to the present invention.

The example shown in FIG. 6 is an example for scalable transmission of audio data and extension data when the extension data of the stereo audio data is data for extending the bandwidth of the audio data. That is, this is an example for scalable transmission of payloads as a result of encoding according to BSAC SBR enhancement '.

Referring to FIG. 6, the number of subframes is set to two. In this case, the payload processing unit 510 cuts a part of the payload LL0_0 of each layer of the stereo audio data belonging to the first subframe, and pays the payload of each layer of the stereo audio data belonging to the second subframe. Some of LL1_0) are cut. In addition, the ES generator 162 generates a zeroth elementary stream from the payloads LL0_0 and LL1_0 cut by the payload processor 510, and expands the data LL0_1, LL1_1) to generate the first elementary stream.

7 is a block diagram illustrating an embodiment of a bit stream receiving / processing apparatus according to the present invention. The bit stream receiving / processing apparatus includes a receiver 700, an ES decompression unit 710, and a payload decompression unit 720. And the decoding unit 730. By such a configuration illustrated in FIG. 7, a method of discarding the elementary stream may be implemented.

The receiver 700 receives the SL packets including some of the payloads grouped and rearranged by the bit stream processing / transmission apparatus shown in FIG. 1 by receiving the bit stream in the form of a predetermined packet through the input terminal IN. do. In particular, according to the present embodiment, the receiver 700 receives some of payloads belonging to one subframe and some of payloads belonging to another subframe as one group.

In the example shown in FIG. 2, the receiver 700 is configured to select one lower layer of BSAC payloads of each layer of audio data and one lower layer of payloads of each layer of data for extending a channel of the audio data. A group is received, and a higher layer of payloads of each layer of audio data and a higher layer of payloads of each layer of data for extending a channel of the audio data are received as a group.

In addition, in the case of the example shown in FIG. 3, the receiving unit 700 may include some of the BSAC payloads of the audio data belonging to one subframe and some of the BSAC payloads of the audio data belonging to another subframe. And a payload of data for extending the bandwidth of audio data belonging to one subframe and a payload of the data for extending the bandwidth of audio data belonging to another subframe as one group.

The ES reconstructor 710 includes some of the payloads grouped and rearranged by the bit stream processing / transmission apparatus shown in FIG. 1 by parsing the SL packets received by the receiver 700 on the SL layer. Restore the secondary streams. Here, the SL layer refers to a layer that performs operations required for synchronization between the audio data encoding apparatus and the audio data decoding apparatus, such as extracting synchronization information between the audio data encoding apparatus and the audio data decoding apparatus from the SL packets.

The payload reconstruction unit 720 reconstructs the payloads of the original form by parsing the elementary streams reconstructed by the ES reconstruction unit 710 on the compression layer. That is, the payload reconstructor 720 recovers payloads of the original form from elementary streams including some of payloads grouped and rearranged by the bit stream processing / transmission apparatus illustrated in FIG. 1. The compression layer refers to a layer that executes operations required for decryption of payloads from elementary streams.

In particular, the payload reconstructor 720 is included by the bit stream processing / transmission apparatus shown in FIG. 1 included in header information of payloads included in elementary streams reconstructed by the ES reconstructor 710. The payloads are grouped to obtain the number, length, order, etc. of each layer of payloads with reference to the relocated information, and using this to de-interleave the payloads received in one group as described above. One subframe is restored and the other subframe is restored.

In the example shown in FIG. 2, the payload reconstruction unit 720 reconstructs the BSAC payload of each layer of audio data by de-relocating the payloads received in one group as described above, and the channel of the audio data. Restore the BSAC payload of each layer of data to extend.

In addition, in the example shown in FIG. 3, the payload reconstruction unit 720 reconstructs the BSAC payload of each layer of the audio data by de-relocating the payloads received in one group as described above, and the audio data Restore the payload of the data to expand the bandwidth of.

The decoder 730 hierarchically decodes the audio data included in the payload of each layer reconstructed by the payload reconstructor 720. In addition, the decoder 730 may be configured to check data for extending the channel of the audio data restored by the payload reconstructor 720 to the multi channel, data for extending the bandwidth of the audio data, and transmission error of the audio data. The extended data of the audio data including at least one of data for generating a CRC code is decoded. Here, the extended data of the audio data may include metadata of the audio data, a fill element of the audio data, and the like, in addition to the above-described extended data.

8 is a block diagram illustrating another embodiment of a bit stream receiving / processing apparatus according to the present invention, wherein the bit stream receiving / processing apparatus includes a receiving unit 800, an ES decompressing unit 810, and a payload decompressing unit ( 820 and the decoder 830. By such a configuration shown in Figure 8 can be implemented to cut the payload.

The receiving unit 800 receives the bit stream in the form of a predetermined packet through the input terminal IN, thereby including payloads partially cut by the encoding apparatus shown in FIG. 1 and payloads of extended data of audio data. Receive packets. In particular, according to the present embodiment, the receiver 700 receives some of payloads belonging to one subframe and some of payloads belonging to another subframe as one group.

The ES reconstructor 810 reconstructs an elementary stream including payloads partially cut by the encoding apparatus shown in FIG. 1 by parsing the SL packets received by the receiver 800 on the SL layer, and audio Restore the elementary stream containing the payload of the extended data of the data.

The payload reconstruction unit 820 reconstructs the original payloads by parsing the elementary streams reconstructed by the ES reconstruction unit 810 on the compression layer. That is, the payload reconstructor 820 cuts a part of payloads of the audio data by the bit stream processing / transmission apparatus shown in FIG. 1, and payloads of the extended data of the audio data are not cut. Restore the original payloads from

In particular, the payload reconstructor 820 may include payloads of which some of the audio data belonging to the elementary stream restored by the ES reconstructor 810 are truncated and extended data belonging to the other elementary stream. Reconstruct any one subframe including the payload, partly truncated from the payload, and the payload of extension data.

The decoder 830 hierarchically decodes the audio data included in the payload of each layer reconstructed by the payload reconstructor 820. In addition, the decoder 830 may be configured to check data for extending the channel of the audio data restored by the payload reconstructor 820 to multi-channel, data for extending the bandwidth of the audio data, and transmission error of the audio data. The extended data of the audio data including at least one of data for generating a CRC code is decoded. Here, the extended data of the audio data may include metadata of the audio data, a fill element of the audio data, and the like, in addition to the above-described extended data.

In the example shown in FIG. 3, the payload reconstructor 820 may cut some of the payloads of the audio data, and the payload of the data for extending the bandwidth of the audio data may be in its original form from the uncut payloads. Restore the payloads of In more detail, the payload reconstructor 820 may include data for extending the bandwidth of payloads from which some audio data belonging to one elementary stream is cut and audio data belonging to another elementary stream. Reconstruct any one subframe containing the payloads of which part is truncated from the payload of and the payload of the data for extending the bandwidth of the audio data.

9 is a flowchart illustrating an embodiment of a method for processing / transmitting a bit stream according to the present invention.

Referring to FIG. 9, the bit stream processing / transmission method according to the present embodiment includes steps processed in time series in the bit stream processing / transmission apparatus illustrated in FIG. 1. Therefore, even if omitted below, the above description of the bit stream processing / transmission apparatus shown in FIG. 1 also applies to the bit stream processing / transmission method according to the present embodiment.

First, audio data and extension data of the audio data are hierarchically encoded (operation 900). Here, the audio data may be encoded by the BSAC method. The extended data of the audio data includes data for extending a channel of the audio data into multiple channels, data for extending the bandwidth of the audio data, data for generating a CRC code for checking a transmission error of the audio data, and the like. Here, the extended data of the audio data may include metadata of the audio data, a fill element of the audio data, and the like, in addition to the above-described extended data. In encoding the extended data of the audio data, in operation 900, at least one or more examples of the extended data of the audio data may be included and encoded.

In operation 900, the payloads are grouped and rearranged so that some of the payloads belonging to one subframe and some of the payloads belonging to another subframe become one group (operation 910).

In operation 920, elementary streams corresponding to groups of payloads on the compression layer are generated from the payloads grouped and rearranged in operation 910.

Priority is assigned to the elementary streams generated in step 920 (step 930).

SL packets corresponding to groups of payloads on a sync layer are generated from the elementary streams generated in step 930 (step 940).

Priority is assigned to each of the SL packets generated in operation 940 (operation 950).

On the basis of the priorities assigned in steps 930 and 950, some of the SL packets are discarded and the remaining SL packets are transmitted (step 960).

10 is a flowchart illustrating another embodiment of a method for processing / transmitting a bit stream according to the present invention.

Referring to FIG. 10, the bit stream processing / transmission method according to the present embodiment includes steps processed in time series in the bit stream processing / transmission apparatus illustrated in FIG. 5. Therefore, even if omitted below, the above description of the bit stream processing / transmission apparatus shown in FIG. 5 is also applied to the bit stream processing / transmission method according to the present embodiment.

First, audio data and extension data of the audio data are hierarchically encoded (step 1000). Here, the audio data may be encoded by the BSAC method. The extended data of the audio data includes data for extending a channel of the audio data into multiple channels, data for extending the bandwidth of the audio data, data for generating a CRC code for checking a transmission error of the audio data, and the like. Here, the extended data of the audio data may include metadata of the audio data, a fill element of the audio data, and the like, in addition to the above-described extended data. In encoding the extended data of the audio data, in operation 1000, at least one of examples of the extended data of the audio data may be included and encoded.

After operation 1000, any subframe that is a result of encoding in operation 1000 considering the transmission environment between the encoder and the decoder, for example, considering the number of layers that may be determined by the payload from the inverse channel. Some of the payloads belonging to the subframe different from some of the payloads belonging to the other party are cut (operation 1010).

In operation 1010, one elementary stream corresponding to the groups of payloads on the compression layer is generated from the truncated payloads, and another elementary stream is generated from the payloads of the extended data. step).

SL packets corresponding to groups of payloads on the SL layer are generated from the elementary streams generated in step 1020 (step 1030).

The SL packets generated in step 1030 are transmitted (step 1040).

11 is a flowchart illustrating another embodiment of a method for receiving / processing a bit stream according to the present invention.

Referring to FIG. 11, the bit stream receiving / processing method according to the present embodiment includes steps processed in time series in the bit stream receiving / processing apparatus shown in FIG. 7. Therefore, even if omitted below, the above description of the bit stream receiving / processing apparatus shown in FIG. 7 is also applied to the bit stream receiving / processing method according to the present embodiment.

First, SL packets including some of payloads grouped and rearranged by the bit stream processing / transmission apparatus illustrated in FIGS. 1 and 5 are received (step 1100).

By parsing the SL packets received in operation 1100, the elementary streams including some of payloads grouped and rearranged by the bit stream processing / transmission apparatus illustrated in FIG. 1 are recovered (operation 1110).

The payloads are grouped by the bit stream processing / transmission apparatus illustrated in FIGS. 1 and 5 and included in the header information of payloads included in the elementary streams restored in operation 1110, and the payloads are referred to. The number, length, order, etc. of each layer of the loads are obtained (step 1120).

By re-relocating payloads included in the elementary streams using the information obtained in step 1130, the original-type payloads are restored (step 1130).

In operation 1140, the audio data and the extension data of the audio data included in the payload of each layer restored in operation 1130 are hierarchically decoded. The extended data of the audio data may include at least one of data for extending a channel of the audio data into multiple channels, data for extending the bandwidth of the audio data, data for generating a CRC code for checking a transmission error of the audio data, and the like. Decode the extended data of the included audio data. Here, the extended data of the audio data may include metadata of the audio data, a fill element of the audio data, and the like, in addition to the above-described extended data.

12 is a flowchart illustrating another embodiment of a method for receiving / processing a bit stream according to the present invention.

Referring to FIG. 12, the bit stream receiving / processing method according to the present embodiment includes steps processed in time series in the bit stream receiving / processing apparatus shown in FIG. 8. Therefore, even if omitted below, the above description of the bit stream receiving / processing apparatus shown in FIG. 8 is also applied to the bit stream receiving / processing method according to the present embodiment.

First, SL packets including payloads partially cut by the bit stream processing / transmission apparatus illustrated in FIGS. 1 and 5 and payloads of extended data of audio data are received (step 1200).

Parsing the SL packets received in operation 1200 restores an elementary stream including payloads partially cut by the bit stream processing / transmission apparatus shown in FIGS. 1 and 5, and pays the extended data of audio data. The elementary stream including the load is restored (step 1210).

The original payloads are restored by parsing the elementary streams restored in step 1210 (step 1220). In particular, the method for receiving / processing a bit stream according to the present embodiment includes data for extending bandwidths of payloads in which a part of audio data belonging to one elementary stream is cut and audio data belonging to another elementary stream. Reconstruct any one subframe containing the payloads of which part is truncated from the payload of and the payload of the data for extending the bandwidth of the audio data.

In operation 1230, the audio data and the extension data of the audio data included in the payload of each layer reconstructed are hierarchically decoded (step 1230). The extended data of the audio data may include at least one of data for extending a channel of the audio data into multiple channels, data for extending the bandwidth of the audio data, data for generating a CRC code for checking transmission error of the audio data, and the like. Decode the extended data of the included audio data. Here, the extended data of the audio data may include metadata of the audio data, a fill element of the audio data, and the like, in addition to the above-described extended data.

Meanwhile, the above-described embodiments of the present invention can be written as a program that can be executed in a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable recording medium. In addition, the structure of the data used in the above-described embodiment of the present invention can be recorded on the computer-readable recording medium through various means.

The computer-readable recording medium may be a magnetic storage medium (for example, a ROM, a floppy disk, a hard disk, etc.), an optical reading medium (for example, a CD-ROM, DVD, etc.) and a carrier wave (for example, the Internet). Storage medium).

So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

According to the present invention, the payloads of the audio data and the extended data are grouped according to their importance, rearranged, some of these groups are discarded, and the remaining groups are transmitted, thereby extending the more important role than the upper layer of the audio data in the original sound reproduction. It has the effect of transmitting data preferentially.

Further, according to the present invention, audio data is encoded by encoding audio data and extension data of the audio data, cutting a part of payloads of the audio data, and transmitting all of the truncated payloads of the audio data and the payload of the extension data. While significantly reducing the overall bit rate, the quality of the restored sound quality can be minimized. In conclusion, the present invention provides a solution that can be transmitted in a scalable manner considering the importance of extended data in addition to the importance of each band of audio data.

Claims (48)

Encoding audio data and at least one extension data of the audio data; Grouping and interleaving payloads that are a result of the encoding in the encoding step; And Discarding a group of the grouped and relocated payloads, and transmitting the remaining group. The method of claim 1, The relocating may include relocating and grouping the payloads such that some of payloads belonging to one subframe and some of payloads belonging to another subframe become one group. Transmission method. The method of claim 1, The encoding may include hierarchically encoding the audio data, hierarchically encoding data for extending a channel of the audio data, The relocating may include grouping the payloads such that a lower layer side of payloads of each layer of the audio data and a lower layer side of payloads of each layer of data for expanding the channel form a group. Bit stream processing / transmission method characterized in that the rearrangement. The method of claim 1, The encoding may include hierarchically encoding the audio data, hierarchically encoding data for extending a channel of the audio data, The relocating may include grouping the payloads such that an upper layer side of payloads of each layer of the audio data and an upper layer side of payloads of each layer of data for extending the channel are one group. Bit stream processing / transmission method characterized in that the rearrangement. The method of claim 1, The encoding may include hierarchically encoding the audio data, encoding data for extending a bandwidth of the audio data, The relocating may be performed by grouping the payloads so that some of the payloads of the audio data belonging to one subframe and some of the payloads of the audio data belonging to another subframe are one group. Bit stream processing / transmission method. The method of claim 1, The encoding may include hierarchically encoding the audio data, encoding data for extending a bandwidth of the audio data, The relocating may include the payload of the data for extending the bandwidth of audio data belonging to one subframe and the payload of the data for extending the bandwidth of audio data belonging to another subframe in one group. Bit stream processing / transmission method characterized in that the loads are grouped and rearranged. The method of claim 1, Assigning a priority to each of the groups of payloads arranged in groupings, And the transmitting step discards the partial group based on the assigned priority. The method of claim 1, Generating elementary streams from the grouping and relocated payloads; And Generating sync layer packets from the generated elementary streams, The transmitting step discards some sync layer packets of the generated sync layer packets, and transmits the remaining sync layer packets. The method of claim 1, The encoding may include encoding the audio data according to any one of encoding methods, and encoding at least one or more extension data of the audio data according to at least one encoding technique. The method of claim 1, The relocating step discards some groups of the payloads in consideration of a transmission environment. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 1 to 10. An encoder for encoding audio data and at least one extension data of the audio data; A processing unit for grouping and rearranging payloads as a result of encoding by the encoder; And And a transmitter for discarding some groups of the grouped and relocated payloads and transmitting the remaining groups. Encoding audio data and at least one extension data of the audio data; Truncating a portion of the payloads that are a result of the encoding in the encoding step; And And transmitting the truncated payloads. The method of claim 13, And wherein said truncation truncates some of the payloads of said audio data and not truncates the payload of said extension data. The method of claim 13, The encoding may include hierarchically encoding the audio data, encoding data for extending a bandwidth of the audio data, The truncating step may include cutting some of the payloads of the audio data, and not cutting the payload of the data for extending the bandwidth of the audio data. The method of claim 13, The truncating step may cut some of the payloads of the audio data belonging to one subframe, cut some of the payloads of the audio data belonging to another subframe, And generating an elementary stream from the truncated payloads. The method of claim 13, Generating an elementary stream from the payload of the data for extending the bandwidth of the audio data belonging to one subframe and the payload of the data for extending the bandwidth of the audio data belonging to another subframe Bit stream processing / transmission method comprising a. The method of claim 13, Generating an elementary stream from the truncated payloads; Generating sync layer packets from the generated elementary stream, And wherein said transmitting step transmits said generated sync layer packets. The method of claim 13, Generating an elementary stream from the payloads of the extension data; Generating sync layer packets from the generated elementary stream, And wherein the transmitting step transmits the generated sync layer packets. The method of claim 13, The truncation step may include identifying a coded portion of the extension data using a code indicating that the encoding portion of the audio data is terminated and a code indicating the encoding portion of the extension data of the audio data is started, and truncating based on the identification. Bit stream processing / transmission method characterized by the above-mentioned. The method of claim 13, wherein the cutting step Bit stream processing / transmission method characterized in that the truncation of some of the payload in consideration of the transmission environment. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 13 to 21 on a computer. An encoder for encoding audio data and at least one extension data of the audio data; A cut part of payloads that are a result of being encoded by the encoder; And And a transmitter for transmitting the truncated payloads. Receiving some of the grouped and relocated payloads; Restoring payloads of the original form from the grouped and relocated payloads; And And decoding at least one extension data of the audio data and the audio data included in the recovered payloads. The method of claim 24, The receiving may include receiving some of payloads belonging to one subframe and some of payloads belonging to another subframe in one group, The restoring may include restoring one subframe and restoring the other subframe by de-interleaving the payloads received in the one group. Treatment method. The method of claim 25, The decoding may include decoding / reproducing audio data included in the restored one subframe and decoding data for extending a channel of the audio data included in the other subframe. Treatment method. The method of claim 25, The decoding may include decoding / reproducing audio data included in the reconstructed one subframe, and decoding data for extending the bandwidth of the audio data included in the other subframe. Treatment method. The method of claim 24, The receiving may include receiving a lower layer of payloads of each layer of the audio data and a lower layer of payloads of each layer of data for extending the channel of the audio data as one group, The restoring may include restoring the payload of each layer of the audio data by de-relocating the payloads received in the one group, and restoring the payload of each layer of data for expanding the channel. Bit stream reception / processing method. The method of claim 24, The receiving may include receiving an upper layer of payloads of each layer of the audio data and an upper layer of payloads of each layer of data for extending the channel of the audio data as one group, The restoring step includes restoring payloads of each layer of the audio data by de-relocating payloads received in the one group, and restoring payloads of each layer of data for expanding the channel. Bit stream reception / processing method. The method of claim 24, The receiving may include receiving some of the payloads of the audio data belonging to one subframe and some of the payloads of the audio data belonging to another subframe in one group, and receiving any one subframe. Receiving a payload of data for extending the bandwidth of the audio data belonging to and a payload of the data for extending the bandwidth of the audio data belonging to the other subframe as one group, The restoring may include restoring the payload of each layer of the audio data by de-relocating the payloads received in the one group, and restoring the payload of the data for expanding the bandwidth. How to receive / process streams. The method of claim 24, The receiving step includes receiving sync layer packets including some of the grouped and relocated payloads, Recovering elementary streams by parsing the received sync layer packets, And the restoring step restores the original payloads by parsing the restored elementary streams. The method of claim 24, The decoding may include decoding the audio data according to any one technique, and decoding at least one or more extension data of the audio data according to at least one technique. The method of claim 24, And restoring the payloads based on information grouped and rearranged by an encoding end. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 24 to 33. A receiver for receiving some of the grouped and relocated payloads; A reconstruction unit for reconstructing payloads of an original form from the grouped and relocated payloads; And And a decoder which decodes audio data included in the reconstructed payloads and at least one or more extension data of the audio data. Receiving payloads that are partially truncated; Restoring payloads in their original form from the partially cut payloads; And And decoding audio data included in the reconstructed payloads and extended data of the audio data. The method of claim 36, The restoring step includes the step of recovering some of the payloads of the audio data and recovering the original payloads from the unloaded payloads. Way. The method of claim 36, The restoring may include cutting some of the payloads of the audio data, and recovering the payloads of the original form from the uncut payloads. Bit stream reception / processing method. The method of claim 36, And the decoding comprises restoring the part by decoding data for extending the bandwidth of the audio data. The method of claim 36, Determining whether the portion has been cut by comparing the length information of the audio data included in the header information of the cut portions of the payload with the actual length of the audio data, And the decoding comprises restoring the part based on the determination result. The method of claim 36, The decoding may include hierarchically decoding audio data included in the reconstructed payloads, and decoding data for extending a bandwidth of the audio data. The method of claim 36, The restoring may include payloads of which part of the audio data belonging to one elementary stream is truncated and payloads of which part is truncated from the payload of extension data belonging to another elementary stream. And reconstructing any one subframe including the payload of data. The method of claim 36, The reconstructing may include recovering payloads of a portion of the audio data belonging to one elementary stream and the payloads of data for extending the bandwidth of the audio data belonging to another elementary stream. And recovering any one subframe including the truncated payloads and the payload of data for extending the bandwidth. The method of claim 36, The receiving step includes receiving SL packets including payloads partially truncated and sync layer packets including payload of the extension data, Restoring an elementary stream comprising payloads of which the portion has been truncated by parsing the received sync layer packets and an elementary stream comprising a payload of the extension data, The restoring step comprises: restoring any one subframe including the partially cut payloads and the payload of the extended data by parsing the restored elementary streams. Way. The method of claim 36, The decoding may include identifying a start point of an encoding portion of the extension data by detecting a code indicating that the encoding portion of the audio data is terminated and a code indicating the encoding portion of the extension data of the audio data is started, and based on the identification. And decoding the extended data. The method of claim 36, And wherein said decoding step identifies an end point of an encoding portion of said extension data based on length information of said extension data, and decodes said extension data based on said identification. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 36 to 46 on a computer. A receiver for receiving payloads partially cut off; A restoration unit for restoring payloads of the original shape from the payloads in which the portion is cut off; And And a decoder which decodes audio data included in the reconstructed payloads and at least one or more extension data of the audio data.

Images