WO2007013783A1 - Method for processing audio signal - Google Patents
Method for processing audio signal Download PDFInfo
- Publication number
- WO2007013783A1 WO2007013783A1 PCT/KR2006/002984 KR2006002984W WO2007013783A1 WO 2007013783 A1 WO2007013783 A1 WO 2007013783A1 KR 2006002984 W KR2006002984 W KR 2006002984W WO 2007013783 A1 WO2007013783 A1 WO 2007013783A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- division
- channel
- channels
- layer
- arbitrary
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 230000005236 sound signal Effects 0.000 title claims abstract description 10
- 239000011159 matrix material Substances 0.000 claims abstract description 12
- 238000006243 chemical reaction Methods 0.000 claims description 20
- 230000011664 signaling Effects 0.000 description 44
- 238000010586 diagram Methods 0.000 description 9
- 238000013507 mapping Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000000470 constituent Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
Definitions
- the present invention relates to a multi-channel coding method, and more particularly to a method for processing an audio signal.
- signals may be configured in various ways (e.g., a block, a band, and a channel.).
- the above- mentioned signals can be processed without being divided into several units within in a stationary period in which signals can maintain predetermined statistical characteristics because it is an advantage to compress the signals.
- the signal is preferable for the signal to be divisionally processed in a transient period in which signal characteristics are abruptly changed, because of the prevention of signal distortion.
- a user desires to divisionally process the above-mentioned signals, there is no detailed method for signaling the divided information. Therefore, it is difficult to effectively process the above-mentioned signals . Disclosure of Invention
- the present invention is directed to a method for signaling division information that substantially obviates one or more problems due to limitations and disadvantages of the related art.
- An object of the present invention devised to solve the problem lies on a method for effectively signaling divided signals.
- the object of the present invention can be achieved by providing a method for processing an audio signal comprising: generating a fixed output channel using a down- mix signal and a basic matrix/ and generating an arbitrary- output channel using the fixed output channel and a post matrix.
- FIG. 1 is a conceptual diagram illustrating a signaling method for block division information according to an embodiment of the present invention
- FIG. 2 and FIG. 3 are conceptual diagram illustrating a signaling method for band and channel division information according to an embodiment of the present invention
- FIG. 4 is a conceptual diagram illustrating a method for creating a multi-channel signal according to another embodiment of the present invention
- FIG. 5 is a conceptual diagram illustrating a signaling method for channel division information according to another embodiment of the present invention.
- a signaling method for division information (also called “splitting information") according to the present invention will hereinafter be described with reference to the annexed drawings.
- the signaling method for the division information according to the present invention is classified according to signal categories.
- the above-mentioned signal is configured in various ways, for example, a block, a band, and a channel.
- the above-mentioned “Signaling method” may include the meaning of "Signaling” or the meaning of "Recognition of the signaled signal”.
- Node is a point indicating whether the signal is divided or not.
- Spatial Information is information capable of downmixing or upmixing a multi-channel signal.
- the spatial information is indicative of spatial parameters, however, it is not limited to the above-mentioned examples, and can be applied to other examples as necessary.
- the above-mentioned spatial parameters are a Channel Level Difference (CLD) indicating a difference in energy between two channels, Inter-Channel Coherences (ICC) indicating correlation between two channels, and Channel Prediction Coefficients (CPC) used for creating three channels from two channels.
- CLD Channel Level Difference
- ICC Inter-Channel Coherences
- CPC Channel Prediction Coefficients
- Block Division A block processing is required to compress consecutive data of a time domain in the same manner as in audio signals.
- Block Processing indicates that an input signal is divisionally processed at intervals of a predetermined distance.
- the above-mentioned interval is defined as a block, and one or more blocks are combined to configure a frame.
- the above-mentioned frame is indicative of a unit for transmitting/storing data.
- Block Division or “Block Splitting” is indicative of a specific process in which an input signal is changed to different-sized blocks during the signal processing.
- Block Size Information is specific information indicating a block size acquired when the input signal is processed while being changed to different-sized blocks. Generally, if the signal is configured in the form of a block, the signal processing is performed using a long block or a short block.
- the signal has various characteristics for every interval, such that it is difficult to conclusively determine that all the signals can be processed according to the long-block signal processing scheme and the short- block signal processing scheme.
- a specific-sized block is selected from among different-sized blocks suitable for signal characteristics within a specific interval, and the block division is then performed on the selected block.
- blocks are configured to have two or more different sizes.
- a predetermined-sized block from among the two or more different-sized blocks can be selected from the frame in various ways. For this purposes, there is a need to indicate which blocks are contained in a current frame, such that the signaling method is required for the above-mentioned operations .
- the above-mentioned signaling method is classified into a sequential signaling method and a hierarchical signaling method.
- the sequential signaling method pre-defines the frame size (i.e., length denoted by "N"), and performs the signaling process using the number of minimum-sized blocks M .
- the frame length "N" is a multiple of a specific M.
- the frame size may be a fixed value, or may be a specific value capable of being transmitted to a destination as additional information.
- block size information may be signaling-processed in the order of M*l, M*l, M*4, M*2 -> 1, 1, 4, 2 ⁇ 0, 0, 3, 1.
- the hierarchical signaling method may be classified into a method for transmitting layer' s depth information and a method for not transmitting the layer' s depth information and a detailed description thereof will hereinafter be described with reference to the annexed drawings .
- FIG. 1 is a conceptual diagram illustrating a signaling method for block division information according to an embodiment of the present invention.
- each layer is denoted by a layer, and the depth of the layer is set to "5".
- a “Layer 1" includes a first block 210, which is the longest block used as a basic unit for block division, and the length of the first block 210 is N.
- Reference numbers (1), (2), ..., (a), (b) , (c) , and (d) indicate exemplary binary signaling sequences.
- the block division information indicating whether the block is divided or not is represented by a division ID
- identifier and a non-division ID.
- a specific number "1" is used as the division ID, and a specific number "0" is used as the non-division ID.
- the above-mentioned division ID and the non-division ID are represented in nodes for each layer.
- the division ID indicates that a predetermined block contained in an upper layer is divided into equal halves in a lower layer, and also indicates that a lower node is assigned to the lower layer.
- the non-division ID indicates that a predetermined block of the upper layer is not divided by the lower layer, and also indicates that any lower node corresponding to a node which is represented by the non- division ID is not assigned to the lower layer. To un- assign the lower node means that there is no performing additional signaling operations.
- the block division information (1) of the first block 210 has the value of 1 in the uppermost layer (i.e., the Layer 1), the block division of the first block 210 is performed.
- Layer 2 acting as the lower layer of the Layer 1 includes two blocks 220 and 221, each of which has the length of N/2.
- Block division information (2) of the block 220 contained in the Layer 2 has the value of "1”
- block division information (3) of the block 221 has the value of "1”
- Layer 3 acting as a lower layer of the Layer 2 includes four blocks 230, 231, 232, and 233, each of which has the length of N/4.
- the block division information (4) associated with the block 230 contained in the Layer 3 has the value of "0".
- the block division information (5) associated with the block 231 3 has the value of "1".
- the block division information (6) associated with the block 232 has the value of "1”.
- the block division information (7) associated with the block 233 contained in the Layer 3 has the value of "0".
- the block division is not performed on the blocks 230 and 233 of the Layer 3, but is performed on the blocks 231 and 232 of the Layer 3.
- a lower node is not assigned to a Layer 4 acting as a lower layer of the above-mentioned non-block-divided blocks 230 and 233 of the Layer 3.
- the block-divided blocks 231 and 232 of the Layer 3 assign a lower node to a lower layer. And the presence or absence of block division is represented in the lower node .
- Layer 4 has the length of N/8, and includes blocks
- the block division information (8) associated with the block 240 of the Layer 4 has the value of "0".
- the block division information (a) associated with the block 242 of the Layer 4 has the value of "0".
- the block division information (b) associated with the block 243 of the Layer 4 has the value of "0".
- the block division is not performed on the blocks 240, 242, and 243 of the Layer 4, but is performed on the block 241 of the Layer 4.
- a lower node is not assigned to a Layer 5 acting as a lower layer of the above-mentioned non-block-divided blocks 240, 242, and 243 of the Layer 4.
- the block-divided block 241 of the Layer 4 assigns a lower node to the Layer 5, such that it indicates the presence or absence of block division in the above- mentioned lower node.
- the Layer 5 has the length of N/l ⁇ , and includes blocks 250 and 251 which are divided on block 241 of the Layer 4.
- the block division information (c) associated with the block 250 of the Layer 5 has the value of "0".
- the block division information (d) associated with the block 251 of the Layer 5 has the value of "0".
- each of the blocks contained in the Layer 4 has the value of "O' , such that the hierarchical block division is not performed any more, and a block division depth of the block can be recognized.
- the layout structure of blocks capable of being hierarchically-block-divided includes an N/4 block (i.e., a block having the length of N/4), an N/8 block, an N/16 block, an N/l ⁇ block, an N/8 block, an N/8 block, and an N/8 block.
- block division information capable of being denoted by a binary number according to binary signaling sequences (1) (2) (3) (4) (5) (6) (7) (8) (9) (a) (b) (c) (d) , the block division information can be denoted by 13 bits "1110110010000".
- the above-mentioned description has disclosed an exemplary case in which the layer' s depth information is not additionally represented, and can be recognized by only block division information denoted by the division ID and non-division ID.
- the layer' s depth information is represented by a division-termination ID and a division- continuation ID.
- the above-mentioned division-termination ID is indicative of the lowermost layer in which block division is not performed any more.
- the above-mentioned division- continuation ID is indicative of the remaining layers except the lowermost layer. In this case, the division- continuation ID is denoted by "1", and the division- termination ID is denoted by "0".
- the depth of the layer depicted in FIG. 1 is "5", and can also be represented by "11110" using the division-termination ID "0" and the division-continuation ID "1".
- the size of a sub-block can be recognized by the above-mentioned signaling method.
- only the non-division ID can be represented at a node assigned to the lowermost layer, such that the signaling process can be performed in the range from a current layer to a previous layer of the lowermost layer.
- a specific value indicating whether the node assigned to the lowermost layer is divided may be represented by "0" indicating the division termination.
- FIG. 2 is a conceptual diagram illustrating a method for signaling band division information according to another embodiment of the present invention.
- FIG. 2 shows hierarchical band division configured in the structure of a tree in a sub-band filterbank.
- a frequency resolution of the sub-band can be defined in various ways, and a detailed description thereof will hereinafter be described in detail.
- the band division of FIG. 2 includes a plurality of bands in the uppermost layer, whereas an uppermost layer of FIG. 1 is composed of a single long block.
- the band division information indicating whether the band is divided or not is represented by the division ID and the non-division ID.
- the value of N ⁇ l" is used as the division ID, and the value of "0" is used as the non-division ID.
- the division ID and the non-division ID can be indicated at nodes for each layer.
- the division ID indicates that a band of an M-th layer is divided into equal halves at an (M+l)-th layer.
- the non-division ID indicates that a band of the M- th layer is not divided at the (M+l)-th layer and also indicates that that any lower node corresponding to a node which is represented by the non-division ID is not assigned to the lower layer. To un-assign the lower node means that there is no performing additional signaling operations .
- the Layer 1 acting as the uppermost layer includes first to sixth bands 310, 311, 312, 313, 314, and 315.
- Band division information (1) of the first band 310 is denoted by "1”.
- Band division information (2) of the second band 311 is denoted by "1”.
- Band division information (3) of the third band 312 is denoted by "0”.
- Band division information (4) of the fourth band 313 is denoted by "0”.
- Band division information (5) of the fifth band 314 is denoted by "0”.
- Band division information (6) of the fourth band 313 is denoted by "0".
- the above-mentioned band division information is indicated at the node assigned to the Layer 1. According to the band division information (1) and
- the first band 310 creates a signal conversion module 310T
- the second band 311 creates a signal conversion module 311T, such that lower bands 320, 321,
- the third, fourth, fifth, or sixth band 312, 313, 314, or 315 at which there is no band division does not create the band conversion module.
- Lower bands corresponding to the Layer 2 are not also created in the third, fourth, fifth, or sixth band 312, 313, 314, or 315. Therefore, any lower node corresponding to 312, 313, 314 and 315 is not assigned to the layer 2.
- the Layer 2 includes two bands 320 and 321 which are divided on the band 310 of the layer 1, and also includes two bands 322 and 323 which are divided on the band 311 of the layer 1.
- Band division information (7) of the band 320 is denoted by "1".
- Band division information (9) of the band 322 is denoted by “0".
- Band division information (10) of the band 323 is denoted by "0".
- the band 320 creates a band conversion module 320T
- the band 321 creates a band conversion module 321T, such that lower bands 330, 331, 332, and 333 are created in the Layer 3.
- Lower nodes are assigned to the lower bands 330, 331, 332, and 333.
- the bands 322 and 323 at which there is no band division does not create the band conversion module.
- Lower bands corresponding to the Layer 3 are not also created in the bands 322 and 323. Therefore, a lower node is also not assigned to the bands 322 and 323.
- the Layer 3 includes two bands 330 and 331 which are divided on the band 320 of the layer 2, and also includes two bands 332 and 333 which are divided on the band 321 of the layer 2.
- Band division information (11) of the band 330 is denoted by "1".
- Band division information (12) of the band 331 is denoted by "0”.
- the band 330 creates a signal conversion module 330T, and the lower bands 340 and 341 are created in the Layer 4. Lower nodes are assigned to the lower bands 340 and 341.
- the Layer 4 includes two bands 340 and 341 331 which are divided on the band 330 of the layer 3.
- Band division information (15) of the band 340 is denoted by "0".
- Band division information (16) of the band 341 is denoted by "0".
- the lowermost layer is equal to the Layer 4.
- block division information capable of being denoted by a binary number according to binary signaling sequences (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (11) (12) (13) (14) (15) (16), the block division information can be denoted by 16 bits "1100001100100000".
- FIG. 3 is a block diagram illustrating a signaling method for band division information according to another embodiment of the present invention. Compared with FIG. 2, the band division of FIG. 3 is similar to that of FIG. 2 in light of a method for performing the band division.
- FIG. 3 a binary signaling sequence of the band division information in FIG. 3 is different from that of FIG. 2.
- the block division information capable of being denoted by a binary- number according to binary signaling sequences (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (11) (12) (13) (14) (15) (16), the block division information can be denoted by 16 bits "1110001001000000".
- the above-mentioned description has disclosed an exemplary case in which the layer' s depth information is not additionally represented, and can be recognized by only band division information denoted by the division ID and non-division ID.
- band division information for additionally representing the layer's depth information can also be signaling-processed.
- the layer's depth information is represented by a division-termination ID and a division- continuation ID.
- the above-mentioned division-termination ID is indicative of the lowermost layer in which band division is not performed any more.
- the above-mentioned division- continuation ID is indicative of the remaining layers except the lowermost layer. In this case, the division- continuation ID is denoted by "1", and the division- termination ID is denoted by "0".
- the size of a sub-band can be recognized by the above-mentioned signaling method.
- only the non-division ID can be represented at a node assigned to the lowermost layer, such that the signaling process can be performed in the range from a current layer to a previous layer of the lowermost layer.
- a specific value indicating whether the node assigned to the lowermost layer is divided may be represented by "0" indicating the division termination.
- Channel division information relates to channel configuration information used for channel configuration, such that a detailed description of channel division will hereinafter be described with reference to the above- mentioned channel configuration information.
- Basic spatial information is required for coding the multi-channel audio signal.
- the above-mentioned basic spatial information includes basic configuration information capable of indicating configuration information associated with basic environments and basic data corresponding to the basic configuration information.
- the multi-channel audio coding selectively requires extension spatial information.
- the above- mentioned extension spatial information includes extension configuration information indicating configuration information associated with extension environments and extension data corresponding to the extension configuration information.
- the configuration information of the above-mentioned extension environment may exist one or more.
- the above-mentioned extension environment can be identified by a type ID.
- the channel configuration referred by the above-mentioned multi-channel signal coding is mainly classified into two channel configurations, i.e., a basic channel configuration and an extension channel configuration .
- One or more channel configuration information is used as the above-mentioned basic channel configuration information.
- the basic channel configuration information indicates a single channel configuration information selected from among several channel configuration information.
- the basic channel configuration information is referred to as "fixed channel configuration information”
- multiple channels i.e., a multi-channel
- Fixed channel configuration information and associated channel configuration data are required to create the above-mentioned fixed output channel.
- the fixed channel configuration information is indicative of a single channel configuration component from among several pre-established channel configuration components.
- the above-mentioned pre-established channel configuration may be represented in various ways.
- the channel may be configured in the form of "5- 1-5", "5-2-5", “7-2-7”, or "7-5-7".
- the above-mentioned "5-2-5" configuration is indicative of a specific channel structure in which six input channels are down-mixed in two channels, and the down-mixed channels is outputted to six channels.
- the remaining channel configurations other than the "5-2-5" configuration have the same channel structure as that of the "5-2-5" configuration.
- the above-mentioned fixed channel configuration information is contained in the basic configuration information, and data associated with the fixed channel configuration information is contained in basic data.
- CLD Channel Level Difference
- ICC Inter-Channel Coherences
- CPC Channel Prediction Coefficients
- the above-mentioned extension channel configuration indicates a channel configuration formed after the fixed channel configuration.
- the above-mentioned extension channel configuration is arbitrarily formed by encoded signals.
- the extension channel configuration information is referred to as arbitrary channel configuration information
- the multi-channel created by the arbitrary channel configuration information is referred to as an arbitrary output channel.
- the above-mentioned arbitrary channel configuration information is contained in the extension configuration information, and is identified by a type ID called a channel ID.
- the arbitrary channel configuration data corresponding to the arbitrary channel configuration information is contained in the extension data.
- the above-mentioned arbitrary channel configuration data may use only the CLD parameter indicating a difference in energy between two channels for a simple operation.
- the arbitrary channel configuration information is represented by the division ID and the non-division ID.
- the division ID acting as a constituent element of the above-mentioned arbitrary channel configuration information indicates the increase the number of channels.
- the non-division ID indicates a specific case in which there is no change in the number of channels.
- the division ID indicates that one input channel is converted to two output channels.
- Non- division ID indicates that an input channel is outputted without any change of number of channels.
- lower channels are created in the lower layer, and lower nodes corresponding to the created channels are assigned to the lower layer.
- the lower channels are not created in the lower layer, such that lower nodes corresponding to the lower channels are not assigned to the lower layer.
- FIGS. 2 ⁇ 3 show not only the above-mentioned band
- FIG. 2 Details description of FIG. 2 will be firstly described as follows.
- the Layer 1 acting as the uppermost layer includes six bands 310, 311, 312, 313, 314, and 315.
- the aforementioned bands 310, 311, 312, 313, 314, and 315 may serve as the above-mentioned fixed multi-channels, respectively.
- the division ID is denoted by "1”
- the non-division ID is denoted by "0”.
- a method for representing the arbitrary channel configuration information sequentially indicates the value "0" or 1" contained in the nodes assigned to the channels 310, 311, 312, 313, 314, and 315 of the Layer 1.
- the method for representing the arbitrary channel configuration information sequentially indicates the value "0" or 1" contained in the nodes assigned to the channels 320, 321, 322, and 323 of the Layer 2.
- the method for representing the arbitrary channel configuration information sequentially indicates the value "0" or 1" contained in the nodes assigned to the channels 330, 331, 332, and 333 of the Layer 3.
- the method for representing the arbitrary channel configuration information sequentially indicates the value "0" or 1" contained in the nodes assigned to the channels 340 and 341 of the Layer 4.
- the above-mentioned method sequentially indicates whether the number of channels increases at nodes of the upper layer, and then sequentially indicates whether the number of channels increases at nodes of the lower layer.
- the arbitrary channel configuration information according to the above-mentioned method is represented by 16 bits "1100001100100000".
- the method for representing the arbitrary channel configuration information is referred to as a "hierarchical priority method”.
- a first node of a upper layer is denoted by "1" when the signaling result is acquired from the first node of the upper layer
- lower nodes corresponding to the first node of the upper layer indicate whether the number of channels sequentially increases. If the first node of the upper layer is denoted by "0" when the signaling result is acquired from the first node of the upper layer, a current node moves to a second node of the upper, such that the second node indicates that the number of channels sequentially increases. Therefore, the arbitrary channel configuration information acquired by the above-mentioned method is represented by 16 bits "1110001001000000".
- the method for representing the arbitrary channel configuration information is referred to a "branch priority method".
- FIG. 4 is a conceptual diagram illustrating a method for creating a multi-channel signal according to the present invention.
- an arbitrary output channel (y) is created by calculation between a down-mix signal (x) and a basic matrix (ml), and another arbitrary output channel (z) is created by calculation between a fixed output channel (y) and a post matrix (m2) .
- Two or more basic matrixes (ml) may exist as necessary.
- Configuration elements of the basic matrix (ml) may be acquired by using at least one of CLD, ICC, CPC and the above-mentioned fixed channel configuration information.
- Configuration elements of the post matrix (m2) may be acquired by using CLD and the above-mentioned arbitrary channel configuration information.
- the above-mentioned exemplary method sequentially recognizes the division ID and the non-division ID, which act as the configuration components of the arbitrary channel configuration information, and performs the signal processing according to the recognized ID.
- the recognized ID is determined to be the division ID
- a single input channel is connected to the channel conversion module which is an example of the signal conversion, resulting in the creation of two lower channels .
- the recognized ID is determined to be the non-division ID
- the above-mentioned input channel is outputted without any change of the number of channels. A detailed description thereof will hereinafter be described.
- an initial value of the number of IDs to be decoded is set to "1"
- an initial value of the number of arbitrary output channels is set to "0”
- an initial value of the number of channel conversion modules is set to "0".
- an ID to be decoded is recognized.
- the recognized ID is determined to be the division ID
- the number of channel conversion modules increases by 1
- the number of IDs to be recognized increases by 1.
- the recognized ID is determined to be the non- division ID
- the number of arbitrary output channels increases by 1, and the number of IDs to be recognized is decreased by 1.
- the above-mentioned signal processing method is repeated according to the number of fixed output channels.
- FIG. 3 In this case, the "1" means the division ID, and "0" means the non-division ID.
- FIG. 5 is a conceptual diagram illustrating a method for signaling channel division information according to the present invention.
- the fixed output channels 310, 311, 312, 313, 314, and 315 are re-arranged by the re- mapping module 100.
- the re-arranged fixed output channels 310', 311', 312', 313', 314', and 315' act as the channels of the uppermost layer, such that the above-mentioned arbitrary output channel is created.
- the above-mentioned arbitrary output channels may be re- arranged or re-mapped in different orders.
- the arbitrary output channel may also be mapped to the speaker.
- the above-mentioned description has disclosed an exemplary case in which the layer' s depth information is not additionally represented, and can be recognized by the arbitrary channel configuration information denoted by the division ID and non-division ID.
- the layer's depth information is represented by a division-termination ID and a division- continuation ID.
- the above-mentioned division-termination ID is indicative of the lowermost layer in which channel division is not performed any more.
- the above-mentioned division-continuation ID is indicative of the remaining layers except the lowermost layer. In this case, the division-continuation ID is denoted by "1", and the division-termination ID is denoted by "0".
- only the non-division ID can be represented at a node assigned to the lowermost layer, such that the signaling process can be performed in the range from a current layer to a previous layer of the lowermost layer.
- the division ID is denoted by "1” and the non-division ID is denoted by "0” and the division-continuation ID is denoted by "1”, and the division-termination ID is denoted by "0”
- a specific value indicating whether the node assigned to the lowermost layer is divided may be represented by "0" indicating the division termination.
- the lowermost layer can be recognized by the above- mentioned depth information, and it is assumed that the omitted value "0" exists, such that the above-mentioned arbitrary output channel can be configured.
- the decoder may not use the received arbitrary channel configuration information as necessary.
- the above-mentioned operations of the decoder may occur in an exemplary case in which the decoder recognizes the arbitrary channel configuration information and the size of the arbitrary channel configuration information, but skips over a predetermined range corresponding to the above-mentioned size.
- a signaling method for division information according to the present invention has the following effects. Firstly, if a predetermined-sized long block is divided into different-sized short blocks, the above- mentioned signaling method according to the present invention can perform the signaling of the hierarchical block division information using minimum number of bits. Secondly, the signaling method according to the present invention need not additionally transmit specific information indicating the number of bits used for the signaling process, and can recognize not only the depth of a divided layer by a signaled signal but also the end of the signaled signal.
- the signaling method according to the present invention can divide a plurality of sub-bands into number of different-sized sub-bands (e.g., sub-bands having different frequency bandwidths) using a minimum number of bits .
- the signaling method according to the present invention can perform the signaling of specific information associated with an upmixing process, which allows a signal received in input channel (s) to be outputted via many more output channels than the input channel (s) .
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Mathematical Physics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Mobile Radio Communication Systems (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Time-Division Multiplex Systems (AREA)
- Stereophonic System (AREA)
Abstract
A method for processing an audio signal during the multi-channel audio coding is disclosed. The present invention provides the method for processing an audio signal comprising: generating a fixed output channel using a down-mix signal and a basic matrix; and generating an arbitrary output channel using the fixed output channel and a post matrix.
Description
METHOD FOR PROCESSING AUDIO SIGNAL
Technical Field
The present invention relates to a multi-channel coding method, and more particularly to a method for processing an audio signal.
Background Art
Generally, signals may be configured in various ways (e.g., a block, a band, and a channel.). The above- mentioned signals can be processed without being divided into several units within in a stationary period in which signals can maintain predetermined statistical characteristics because it is an advantage to compress the signals.
It is preferable for the signal to be divisionally processed in a transient period in which signal characteristics are abruptly changed, because of the prevention of signal distortion. However, if a user desires to divisionally process the above-mentioned signals, there is no detailed method for signaling the divided information. Therefore, it is difficult to effectively process the above-mentioned signals .
Disclosure of Invention
Accordingly, the present invention is directed to a method for signaling division information that substantially obviates one or more problems due to limitations and disadvantages of the related art.
An object of the present invention devised to solve the problem lies on a method for effectively signaling divided signals. The object of the present invention can be achieved by providing a method for processing an audio signal comprising: generating a fixed output channel using a down- mix signal and a basic matrix/ and generating an arbitrary- output channel using the fixed output channel and a post matrix.
Brief Description of Drawings
The accompanying drawings, which are included to provide a further understanding of the invention, illustrate embodiments of the invention and together with the description serve to explain the principle of the invention.
In the drawings :
FIG. 1 is a conceptual diagram illustrating a
signaling method for block division information according to an embodiment of the present invention;
FIG. 2 and FIG. 3 are conceptual diagram illustrating a signaling method for band and channel division information according to an embodiment of the present invention;
FIG. 4 is a conceptual diagram illustrating a method for creating a multi-channel signal according to another embodiment of the present invention; and FIG. 5 is a conceptual diagram illustrating a signaling method for channel division information according to another embodiment of the present invention.
Best Mode for Carrying Out the Invention Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
A signaling method for division information (also called "splitting information") according to the present invention will hereinafter be described with reference to the annexed drawings.
The signaling method for the division information according to the present invention is classified according to signal categories.
Prior to describing the present invention, it should be noted that the above-mentioned signal is configured in various ways, for example, a block, a band, and a channel. The above-mentioned "Signaling method" may include the meaning of "Signaling" or the meaning of "Recognition of the signaled signal".
The term "Node" is a point indicating whether the signal is divided or not.
The term "Spatial Information" is information capable of downmixing or upmixing a multi-channel signal.
It should be noted that the spatial information is indicative of spatial parameters, however, it is not limited to the above-mentioned examples, and can be applied to other examples as necessary. The above-mentioned spatial parameters are a Channel Level Difference (CLD) indicating a difference in energy between two channels, Inter-Channel Coherences (ICC) indicating correlation between two channels, and Channel Prediction Coefficients (CPC) used for creating three channels from two channels.
Block division, band division, and channel division will hereinafter be described in detail.
1) Block Division
A block processing is required to compress consecutive data of a time domain in the same manner as in audio signals.
The term "Block Processing" indicates that an input signal is divisionally processed at intervals of a predetermined distance.
In this case, the above-mentioned interval is defined as a block, and one or more blocks are combined to configure a frame. The above-mentioned frame is indicative of a unit for transmitting/storing data.
The term "Block Division" or "Block Splitting" is indicative of a specific process in which an input signal is changed to different-sized blocks during the signal processing.
The term "Block Size Information" is specific information indicating a block size acquired when the input signal is processed while being changed to different-sized blocks. Generally, if the signal is configured in the form of a block, the signal processing is performed using a long block or a short block.
In the case of using the short block, several short blocks are combined, and the combined blocks correspond
to a single long block.
However, the signal has various characteristics for every interval, such that it is difficult to conclusively determine that all the signals can be processed according to the long-block signal processing scheme and the short- block signal processing scheme.
Preferably, a specific-sized block is selected from among different-sized blocks suitable for signal characteristics within a specific interval, and the block division is then performed on the selected block.
In more detail, blocks are configured to have two or more different sizes. A predetermined-sized block from among the two or more different-sized blocks can be selected from the frame in various ways. For this purposes, there is a need to indicate which blocks are contained in a current frame, such that the signaling method is required for the above-mentioned operations .
The above-mentioned signaling method is classified into a sequential signaling method and a hierarchical signaling method.
The sequential signaling method pre-defines the frame size (i.e., length denoted by "N"), and performs the signaling process using the number of minimum-sized
blocks M .
In this case, the frame length "N" is a multiple of a specific M. The frame size may be a fixed value, or may be a specific value capable of being transmitted to a destination as additional information.
For example, provided that N is 2048 (N=2048), M is
256 (M=25β) , and the blocks are arranged in the order of
256 -> 256 -> 1024 -> 512, block size information may be signaling-processed in the order of M*l, M*l, M*4, M*2 -> 1, 1, 4, 2 ^ 0, 0, 3, 1.
The hierarchical signaling method may be classified into a method for transmitting layer' s depth information and a method for not transmitting the layer' s depth information and a detailed description thereof will hereinafter be described with reference to the annexed drawings .
FIG. 1 is a conceptual diagram illustrating a signaling method for block division information according to an embodiment of the present invention. Referring to FIG. 1, each layer is denoted by a layer, and the depth of the layer is set to "5".
A "Layer 1" includes a first block 210, which is the longest block used as a basic unit for block division, and the length of the first block 210 is N.
Reference numbers (1), (2), ..., (a), (b) , (c) , and (d) indicate exemplary binary signaling sequences.
According to the present embodiment, the block division information indicating whether the block is divided or not is represented by a division ID
(identifier) and a non-division ID. A specific number "1" is used as the division ID, and a specific number "0" is used as the non-division ID.
The above-mentioned division ID and the non-division ID are represented in nodes for each layer.
The division ID indicates that a predetermined block contained in an upper layer is divided into equal halves in a lower layer, and also indicates that a lower node is assigned to the lower layer. The non-division ID indicates that a predetermined block of the upper layer is not divided by the lower layer, and also indicates that any lower node corresponding to a node which is represented by the non- division ID is not assigned to the lower layer. To un- assign the lower node means that there is no performing additional signaling operations.
Since the block division information (1) of the first block 210 has the value of 1 in the uppermost layer (i.e., the Layer 1), the block division of the first
block 210 is performed.
Layer 2 acting as the lower layer of the Layer 1 includes two blocks 220 and 221, each of which has the length of N/2. Block division information (2) of the block 220 contained in the Layer 2 has the value of "1", and block division information (3) of the block 221 has the value of "1", such that Layer 3 acting as a lower layer of the Layer 2 includes four blocks 230, 231, 232, and 233, each of which has the length of N/4.
The block division information (4) associated with the block 230 contained in the Layer 3 has the value of "0". The block division information (5) associated with the block 231 3 has the value of "1". The block division information (6) associated with the block 232 has the value of "1". The block division information (7) associated with the block 233 contained in the Layer 3 has the value of "0".
Therefore, according to the block division information of the Layer 3, the block division is not performed on the blocks 230 and 233 of the Layer 3, but is performed on the blocks 231 and 232 of the Layer 3.
In this case, a lower node is not assigned to a Layer 4 acting as a lower layer of the above-mentioned
non-block-divided blocks 230 and 233 of the Layer 3.
The block-divided blocks 231 and 232 of the Layer 3 assign a lower node to a lower layer. And the presence or absence of block division is represented in the lower node .
Layer 4 has the length of N/8, and includes blocks
240 and 241 which are divided on block 231 of the Layer 3, and also includes other blocks 242 and 243 are divided on block 232 of the Layer 3. The block division information (8) associated with the block 240 of the Layer 4 has the value of "0". The block division information (9) associated with the block
241 of the Layer 4 has the value of "1". The block division information (a) associated with the block 242 of the Layer 4 has the value of "0". The block division information (b) associated with the block 243 of the Layer 4 has the value of "0".
Therefore, according to the block division information of the Layer 4, the block division is not performed on the blocks 240, 242, and 243 of the Layer 4, but is performed on the block 241 of the Layer 4.
In this case, a lower node is not assigned to a Layer 5 acting as a lower layer of the above-mentioned non-block-divided blocks 240, 242, and 243 of the Layer 4.
The block-divided block 241 of the Layer 4 assigns a lower node to the Layer 5, such that it indicates the presence or absence of block division in the above- mentioned lower node. The Layer 5 has the length of N/lβ, and includes blocks 250 and 251 which are divided on block 241 of the Layer 4.
The block division information (c) associated with the block 250 of the Layer 5 has the value of "0". The block division information (d) associated with the block 251 of the Layer 5 has the value of "0".
Therefore, each of the blocks contained in the Layer 4 has the value of "O' , such that the hierarchical block division is not performed any more, and a block division depth of the block can be recognized.
The layout structure of blocks capable of being hierarchically-block-divided includes an N/4 block (i.e., a block having the length of N/4), an N/8 block, an N/16 block, an N/lβ block, an N/8 block, an N/8 block, and an N/8 block.
If the signal length is N, block-divided blocks have any one of the lengths (i.e., N/2, N/4, N/8, N/lβ, and N/32....), as represented by "N/x1" (where i = 1, 2, ..., P, P is an integer, and x=2 ) .
In the case of representing block division information capable of being denoted by a binary number according to binary signaling sequences (1) (2) (3) (4) (5) (6) (7) (8) (9) (a) (b) (c) (d) , the block division information can be denoted by 13 bits "1110110010000".
The above-mentioned description has disclosed an exemplary case in which the layer' s depth information is not additionally represented, and can be recognized by only block division information denoted by the division ID and non-division ID.
However, it should be noted that the other block division information for additionally representing the layer's depth information can also be signaling-processed.
For example, the layer' s depth information is represented by a division-termination ID and a division- continuation ID.
The above-mentioned division-termination ID is indicative of the lowermost layer in which block division is not performed any more. The above-mentioned division- continuation ID is indicative of the remaining layers except the lowermost layer. In this case, the division- continuation ID is denoted by "1", and the division- termination ID is denoted by "0".
The depth of the layer depicted in FIG. 1 is "5",
and can also be represented by "11110" using the division-termination ID "0" and the division-continuation ID "1".
The size of a sub-block can be recognized by the above-mentioned signaling method.
In this way, in the case of additionally representing the depth information, only the non-division ID can be represented at a node assigned to the lowermost layer, such that the signaling process can be performed in the range from a current layer to a previous layer of the lowermost layer.
For example, provided that the division ID is denoted by "1" and the non-division ID is denoted by "0" and the division-continuation ID is denoted by "1" and the division-termination ID is denoted by "0", a specific value indicating whether the node assigned to the lowermost layer is divided may be represented by "0" indicating the division termination.
2) Band Division
Band division will hereinafter be described with
reference to FIGS. 2~3.
FIG. 2 is a conceptual diagram illustrating a method for signaling band division information according to
another embodiment of the present invention.
FIG. 2 shows hierarchical band division configured in the structure of a tree in a sub-band filterbank. A frequency resolution of the sub-band can be defined in various ways, and a detailed description thereof will hereinafter be described in detail.
Compared with the block division of FIG. 1, the band division of FIG. 2 includes a plurality of bands in the uppermost layer, whereas an uppermost layer of FIG. 1 is composed of a single long block.
According to the present embodiment, the band division information indicating whether the band is divided or not is represented by the division ID and the non-division ID. The value of Nλl" is used as the division ID, and the value of "0" is used as the non-division ID.
The division ID and the non-division ID can be indicated at nodes for each layer.
The division ID indicates that a band of an M-th layer is divided into equal halves at an (M+l)-th layer. The non-division ID indicates that a band of the M- th layer is not divided at the (M+l)-th layer and also indicates that that any lower node corresponding to a node which is represented by the non-division ID is not assigned to the lower layer. To un-assign the lower node
means that there is no performing additional signaling operations .
The Layer 1 acting as the uppermost layer includes first to sixth bands 310, 311, 312, 313, 314, and 315. Band division information (1) of the first band 310 is denoted by "1". Band division information (2) of the second band 311 is denoted by "1". Band division information (3) of the third band 312 is denoted by "0". Band division information (4) of the fourth band 313 is denoted by "0". Band division information (5) of the fifth band 314 is denoted by "0". Band division information (6) of the fourth band 313 is denoted by "0".
The above-mentioned band division information is indicated at the node assigned to the Layer 1. According to the band division information (1) and
(2), the first band 310 creates a signal conversion module 310T, and the second band 311 creates a signal conversion module 311T, such that lower bands 320, 321,
322, and 323 are created in the Layer 2. Lower nodes are assigned to the lower bands 320, 321, 322, and 323. It should be noted that the above-mentioned signal conversion module can also be called a "band conversion module" in the present embodiment.
In the meantime, the third, fourth, fifth, or sixth
band 312, 313, 314, or 315 at which there is no band division does not create the band conversion module. Lower bands corresponding to the Layer 2 are not also created in the third, fourth, fifth, or sixth band 312, 313, 314, or 315. Therefore, any lower node corresponding to 312, 313, 314 and 315 is not assigned to the layer 2.
The Layer 2 includes two bands 320 and 321 which are divided on the band 310 of the layer 1, and also includes two bands 322 and 323 which are divided on the band 311 of the layer 1.
Band division information (7) of the band 320 is denoted by "1". Band division information (8) of the band
321 is denoted by "1". Band division information (9) of the band 322 is denoted by "0". Band division information (10) of the band 323 is denoted by "0".
According to the above-mentioned band division information (7) and (8), the band 320 creates a band conversion module 320T, and the band 321 creates a band conversion module 321T, such that lower bands 330, 331, 332, and 333 are created in the Layer 3. Lower nodes are assigned to the lower bands 330, 331, 332, and 333.
In the meantime, the bands 322 and 323 at which there is no band division does not create the band conversion module. Lower bands corresponding to the Layer
3 are not also created in the bands 322 and 323. Therefore, a lower node is also not assigned to the bands 322 and 323.
The Layer 3 includes two bands 330 and 331 which are divided on the band 320 of the layer 2, and also includes two bands 332 and 333 which are divided on the band 321 of the layer 2.
Band division information (11) of the band 330 is denoted by "1". Band division information (12) of the band 331 is denoted by "0". Band division information
(13) of the third band 332 is denoted by "0". Band division information (14) of the band 333 is denoted by
"0".
According to the above-mentioned band division information (11), the band 330 creates a signal conversion module 330T, and the lower bands 340 and 341 are created in the Layer 4. Lower nodes are assigned to the lower bands 340 and 341.
In the meantime, the bands 331, 332, and 333 at which there is no band division does not create the band conversion module. Lower bands corresponding to the Layer
4 are not also created in the bands 331, 332, and 333. Therefore, a lower node is also not assigned to the bands 322 and 323. Therefore, a lower node is also not assigned
to the bands 331, 332, and 333.
The Layer 4 includes two bands 340 and 341 331 which are divided on the band 330 of the layer 3.
Band division information (15) of the band 340 is denoted by "0". Band division information (16) of the band 341 is denoted by "0".
Therefore, there is no lower layer capable of performing the band division, and the signaling process is terminated. In this case, the lowermost layer is equal to the Layer 4.
In the case of representing block division information capable of being denoted by a binary number according to binary signaling sequences (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (11) (12) (13) (14) (15) (16), the block division information can be denoted by 16 bits "1100001100100000".
FIG. 3 is a block diagram illustrating a signaling method for band division information according to another embodiment of the present invention. Compared with FIG. 2, the band division of FIG. 3 is similar to that of FIG. 2 in light of a method for performing the band division.
However, as shown in FIG. 3, a binary signaling sequence of the band division information in FIG. 3 is
different from that of FIG. 2.
Therefore, in the case of representing block division information capable of being denoted by a binary- number according to binary signaling sequences (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (11) (12) (13) (14) (15) (16), the block division information can be denoted by 16 bits "1110001001000000".
The above-mentioned description has disclosed an exemplary case in which the layer' s depth information is not additionally represented, and can be recognized by only band division information denoted by the division ID and non-division ID.
However, it should be noted that the other band division information for additionally representing the layer's depth information can also be signaling-processed.
For example, the layer's depth information is represented by a division-termination ID and a division- continuation ID.
The above-mentioned division-termination ID is indicative of the lowermost layer in which band division is not performed any more. The above-mentioned division- continuation ID is indicative of the remaining layers except the lowermost layer. In this case, the division- continuation ID is denoted by "1", and the division-
termination ID is denoted by "0".
The depth of the layer depicted in FIGS. 2~3 is "4",
and can also be represented by "1110" using the division- termination ID "0" and the division-continuation ID "1". The size of a sub-band can be recognized by the above-mentioned signaling method.
In this way, in the case of additionally representing the depth information, only the non-division ID can be represented at a node assigned to the lowermost layer, such that the signaling process can be performed in the range from a current layer to a previous layer of the lowermost layer.
For example, provided that the division ID is denoted by "1" and the non-division ID is denoted by "0" and the division-continuation ID is denoted by "1", and the division-termination ID is denoted by "0", a specific value indicating whether the node assigned to the lowermost layer is divided may be represented by "0" indicating the division termination.
3) Channel Division
Channel division information relates to channel configuration information used for channel configuration, such that a detailed description of channel division will
hereinafter be described with reference to the above- mentioned channel configuration information.
Particularly, an example of channel configuration acquired when a multi-channel audio signal is encoded or decoded will be described in detail.
Basic spatial information is required for coding the multi-channel audio signal. The above-mentioned basic spatial information includes basic configuration information capable of indicating configuration information associated with basic environments and basic data corresponding to the basic configuration information. Also, the multi-channel audio coding selectively requires extension spatial information. The above- mentioned extension spatial information includes extension configuration information indicating configuration information associated with extension environments and extension data corresponding to the extension configuration information. The configuration information of the above-mentioned extension environment may exist one or more. The above-mentioned extension environment can be identified by a type ID.
In the meantime, the channel configuration referred by the above-mentioned multi-channel signal coding is mainly classified into two channel configurations, i.e.,
a basic channel configuration and an extension channel configuration .
One or more channel configuration information is used as the above-mentioned basic channel configuration information. Particularly, the basic channel configuration information indicates a single channel configuration information selected from among several channel configuration information.
For the convenience of description, the basic channel configuration information is referred to as "fixed channel configuration information", and multiple channels (i.e., a multi-channel) created by the fixed channel configuration information is referred to as a "fixed output channel". Fixed channel configuration information and associated channel configuration data are required to create the above-mentioned fixed output channel.
The fixed channel configuration information is indicative of a single channel configuration component from among several pre-established channel configuration components. The above-mentioned pre-established channel configuration may be represented in various ways. For example, the channel may be configured in the form of "5- 1-5", "5-2-5", "7-2-7", or "7-5-7".
The above-mentioned "5-2-5" configuration is indicative of a specific channel structure in which six input channels are down-mixed in two channels, and the down-mixed channels is outputted to six channels. The remaining channel configurations other than the "5-2-5" configuration have the same channel structure as that of the "5-2-5" configuration.
The above-mentioned fixed channel configuration information is contained in the basic configuration information, and data associated with the fixed channel configuration information is contained in basic data.
A variety of parameters may be used as the above- mentioned basic data, for example, a Channel Level Difference (CLD) parameter indicating a difference in energy between two channels, an Inter-Channel Coherences (ICC) parameter indicating correlation between two channels, and a Channel Prediction Coefficients (CPC) parameter used creating three channels from two channels.
The above-mentioned extension channel configuration indicates a channel configuration formed after the fixed channel configuration.
The above-mentioned extension channel configuration is arbitrarily formed by encoded signals. For the convenience of description, the extension channel
configuration information is referred to as arbitrary channel configuration information, and the multi-channel created by the arbitrary channel configuration information is referred to as an arbitrary output channel. The above-mentioned arbitrary channel configuration information is contained in the extension configuration information, and is identified by a type ID called a channel ID.
The arbitrary channel configuration data corresponding to the arbitrary channel configuration information is contained in the extension data.
If required, the above-mentioned arbitrary channel configuration data may use only the CLD parameter indicating a difference in energy between two channels for a simple operation.
The arbitrary channel configuration information is represented by the division ID and the non-division ID. The division ID acting as a constituent element of the above-mentioned arbitrary channel configuration information indicates the increase the number of channels. The non-division ID indicates a specific case in which there is no change in the number of channels.
For example, the division ID indicates that one input channel is converted to two output channels. Non-
division ID indicates that an input channel is outputted without any change of number of channels.
In the case of representing the division ID at a node of an upper layer assigned to the channel of the upper layer, lower channels are created in the lower layer, and lower nodes corresponding to the created channels are assigned to the lower layer.
However, in the case of representing the non- division ID at the node of the upper layer assigned to the channel of the upper layer, the lower channels are not created in the lower layer, such that lower nodes corresponding to the lower channels are not assigned to the lower layer.
A method for representing the above-mentioned arbitrary channel configuration information using the division ID and the non-division ID will hereinafter be
described with reference to FIGS. 2~3.
FIGS. 2~3 show not only the above-mentioned band
division but also channel division. Detailed description of FIG. 2 will be firstly described as follows.
The Layer 1 acting as the uppermost layer includes six bands 310, 311, 312, 313, 314, and 315. The aforementioned bands 310, 311, 312, 313, 314, and 315 may
serve as the above-mentioned fixed multi-channels, respectively. According to the present invention, the division ID is denoted by "1", and the non-division ID is denoted by "0". A method for representing the arbitrary channel configuration information sequentially indicates the value "0" or 1" contained in the nodes assigned to the channels 310, 311, 312, 313, 314, and 315 of the Layer 1.
The method for representing the arbitrary channel configuration information sequentially indicates the value "0" or 1" contained in the nodes assigned to the channels 320, 321, 322, and 323 of the Layer 2.
The method for representing the arbitrary channel configuration information sequentially indicates the value "0" or 1" contained in the nodes assigned to the channels 330, 331, 332, and 333 of the Layer 3.
The method for representing the arbitrary channel configuration information sequentially indicates the value "0" or 1" contained in the nodes assigned to the channels 340 and 341 of the Layer 4.
In other words, the above-mentioned method sequentially indicates whether the number of channels increases at nodes of the upper layer, and then sequentially indicates whether the number of channels
increases at nodes of the lower layer.
The arbitrary channel configuration information according to the above-mentioned method is represented by 16 bits "1100001100100000". For the convenience of description, the method for representing the arbitrary channel configuration information is referred to as a "hierarchical priority method".
According to the method for representing the arbitrary channel configuration information as shown in the FIG. 3, if a first node of a upper layer is denoted by "1" when the signaling result is acquired from the first node of the upper layer, lower nodes corresponding to the first node of the upper layer indicate whether the number of channels sequentially increases. If the first node of the upper layer is denoted by "0" when the signaling result is acquired from the first node of the upper layer, a current node moves to a second node of the upper, such that the second node indicates that the number of channels sequentially increases. Therefore, the arbitrary channel configuration information acquired by the above-mentioned method is represented by 16 bits "1110001001000000".
For the convenience of description, the method for
representing the arbitrary channel configuration information is referred to a "branch priority method".
A method for creating the fixed output channel and the arbitrary output channel will hereinafter be described with reference to FIG. 4.
FIG. 4 is a conceptual diagram illustrating a method for creating a multi-channel signal according to the present invention.
Referring to FIG. 4, an arbitrary output channel (y) is created by calculation between a down-mix signal (x) and a basic matrix (ml), and another arbitrary output channel (z) is created by calculation between a fixed output channel (y) and a post matrix (m2) . Two or more basic matrixes (ml) may exist as necessary. Configuration elements of the basic matrix (ml) may be acquired by using at least one of CLD, ICC, CPC and the above-mentioned fixed channel configuration information.
Configuration elements of the post matrix (m2) may be acquired by using CLD and the above-mentioned arbitrary channel configuration information.
A method for creating the arbitrary output channel will hereinafter be described in detail.
Firstly, a method for configuring an arbitrary
channel using the arbitrary channel configuration information will be described in detail.
An exemplary method for representing the above- mentioned arbitrary channel configuration information using the above-mentioned branch priority method will be described.
The above-mentioned exemplary method sequentially recognizes the division ID and the non-division ID, which act as the configuration components of the arbitrary channel configuration information, and performs the signal processing according to the recognized ID.
If the recognized ID is determined to be the division ID, a single input channel is connected to the channel conversion module which is an example of the signal conversion, resulting in the creation of two lower channels .
Otherwise, if the recognized ID is determined to be the non-division ID, the above-mentioned input channel is outputted without any change of the number of channels. A detailed description thereof will hereinafter be described.
At a first stage, an initial value of the number of IDs to be decoded is set to "1", and an initial value of the number of arbitrary output channels is set to "0",
and an initial value of the number of channel conversion modules is set to "0".
At a second stage, an ID to be decoded is recognized.
At a third stage, if the recognized ID is determined to be the division ID, the number of channel conversion modules increases by 1, and the number of IDs to be recognized increases by 1.
If the recognized ID is determined to be the non- division ID, the number of arbitrary output channels increases by 1, and the number of IDs to be recognized is decreased by 1.
Until the number of IDs to be decoded reaches "0", the above-mentioned second and third stages are repeated.
The above-mentioned signal processing method is repeated according to the number of fixed output channels.
For example, the arbitrary channel configuration acquired when the arbitrary channel configuration information is denoted by "11100010010000" is shown in
FIG. 3. In this case, the "1" means the division ID, and "0" means the non-division ID.
The number of "l"s indicates the number of channel conversion modules (i.e., a signal conversion module of FIG. 3), and the number of Nλ0"s indicates the number of arbitrary output channels.
In the meantime, the fixed output channels may be rearranged (i.e., re-mapped) in different orders, and the arbitrary output channel may be then created, as shown in FIG. 5. FIG. 5 is a conceptual diagram illustrating a method for signaling channel division information according to the present invention.
Referring to FIG. 5, the fixed output channels 310, 311, 312, 313, 314, and 315 are re-arranged by the re- mapping module 100. The re-arranged fixed output channels 310', 311', 312', 313', 314', and 315' act as the channels of the uppermost layer, such that the above-mentioned arbitrary output channel is created. Needless to say, the above-mentioned arbitrary output channels may be re- arranged or re-mapped in different orders.
In the meantime, if channel mapping information for mapping the channels of the arbitrary channel configuration information to a speaker is contained in the arbitrary channel configuration information, the arbitrary output channel may also be mapped to the speaker.
The above-mentioned description has disclosed an exemplary case in which the layer' s depth information is not additionally represented, and can be recognized by the arbitrary channel configuration information denoted
by the division ID and non-division ID.
However, it should be noted that the other arbitrary channel configuration information for additionally representing the layer' s depth information can also be represented.
For example, the layer's depth information is represented by a division-termination ID and a division- continuation ID.
The above-mentioned division-termination ID is indicative of the lowermost layer in which channel division is not performed any more. The above-mentioned division-continuation ID is indicative of the remaining layers except the lowermost layer. In this case, the division-continuation ID is denoted by "1", and the division-termination ID is denoted by "0".
The depth of the layer depicted in FIGS. 2~3 is "4",
and can also be represented by "1110" using the division- termination ID "0" and the division-continuation ID "1".
In this way, in the case of additionally representing the depth information, only the non-division ID can be represented at a node assigned to the lowermost layer, such that the signaling process can be performed in the range from a current layer to a previous layer of the lowermost layer.
For example, provided that the division ID is denoted by "1" and the non-division ID is denoted by "0" and the division-continuation ID is denoted by "1", and the division-termination ID is denoted by "0", a specific value indicating whether the node assigned to the lowermost layer is divided may be represented by "0" indicating the division termination.
Although the above-mentioned situation actually occurs, the lowermost layer can be recognized by the above- mentioned depth information, and it is assumed that the omitted value "0" exists, such that the above-mentioned arbitrary output channel can be configured.
In the meantime, although the above-mentioned arbitrary channel configuration information is transmitted to the decoder, it should be noted that the decoder may not use the received arbitrary channel configuration information as necessary. The above-mentioned operations of the decoder may occur in an exemplary case in which the decoder recognizes the arbitrary channel configuration information and the size of the arbitrary channel configuration information, but skips over a predetermined range corresponding to the above-mentioned size.
It will be apparent to those skilled in the art that various modifications and variations can be made in the
present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
Industrial Applicability
A signaling method for division information according to the present invention has the following effects. Firstly, if a predetermined-sized long block is divided into different-sized short blocks, the above- mentioned signaling method according to the present invention can perform the signaling of the hierarchical block division information using minimum number of bits. Secondly, the signaling method according to the present invention need not additionally transmit specific information indicating the number of bits used for the signaling process, and can recognize not only the depth of a divided layer by a signaled signal but also the end of the signaled signal.
Thirdly, the signaling method according to the present invention can divide a plurality of sub-bands into number of different-sized sub-bands (e.g., sub-bands having different frequency bandwidths) using a minimum number of
bits .
Fourthly, the signaling method according to the present invention can perform the signaling of specific information associated with an upmixing process, which allows a signal received in input channel (s) to be outputted via many more output channels than the input channel (s) .
Claims
1. A method for processing an audio signal comprising: generating a fixed output channel using a down-mix signal and a basic matrix; and generating an arbitrary output channel using the fixed output channel and a post matrix.
2. The method of claim 1, wherein the basic matrix includes configuration components, which are derived from not only at least one of a difference in energy between two channels, correlation between two channels, and a Channel Prediction Coefficients used for creating three channels from two channels, but also fixed channel configuration information; and the post matrix includes configuration components, which are derived from a difference in energy between two channels and arbitrary channel configuration information.
3. The method of claim 2, wherein the arbitrary channel configuration information indicates whether the number of channels increases at a node of a layer using a division identifier (ID) and a non-division identifier (ID) and number of lower nodes equal to the number of divisions are assigned to a lower layer if an node of an upper layer is represented by the division ID, and the lower nodes are not assigned to the lower layer if the node of the upper layer is represented by the non-division ID.
4. The method of claim 3, wherein the arbitrary channel configuration information sequentially indicates whether the number of channels increases at the node of the upper layer, and sequentially indicates whether the number of channels increases at the lower node of the lower layer.
5. The method of claim 3, wherein the arbitrary channel configuration information indicates whether the number of channels of a lower node corresponding to a first node of the upper layer assigned to the lower layer increases if the first node of the upper layer is represented by the division ID and the arbitrary channel configuration information indicates whether the number of channels of a second node of the upper layer increases if the first node of the upper layer is represented by the non-division ID.
6. The method of claim 5, wherein the arbitrary output channel includes sequentially recognizing a division ID or a non-division ID acting as configuration components of the arbitrary channel configuration information, and performing signal processing according to the recognized ID and a single input channel connects to a channel conversion module and generates two lower channels if the recognized ID is the division ID and the input channel is outputted without any change of number of channels if the recognized ID is the non-division ID.
7. The method of claim β, wherein the generating the arbitrary output channel includes setting an initial value of number of IDs, an initial value of number of the arbitrary output channels, and an initial value of number of channel conversion modules, recognizing the ID, increasing the number of the IDs and the number of the channel conversion modules by predetermined increment units if the recognized ID is the division ID, increasing the number of the arbitrary output channels by predetermined increment units, and reducing the number of the IDs by predetermined increment units if the recognized ID is the non-division ID, and repeating recognizing, increasing the number of the IDs and the number of the channel conversion modules, and increasing the number of the arbitrary output channels and reducing the number of the IDs until the number of the IDs reaches zero "0".
8. The method of any one of claim 3 to claim 7, further comprising: recognizing the arbitrary channel configuration information and a length of arbitrary channel configuration data corresponding to the arbitrary channel configuration information without decoding for the arbitrary channel configuration information and the length of arbitrary channel configuration data.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/997,321 US7706905B2 (en) | 2005-07-29 | 2006-07-28 | Method for processing audio signal |
JP2008523806A JP5113051B2 (en) | 2005-07-29 | 2006-07-28 | Audio signal processing method |
CN2006800277709A CN101233571B (en) | 2005-07-29 | 2006-07-28 | Method and device for processing audio signal |
EP06769318A EP1915757A4 (en) | 2005-07-29 | 2006-07-28 | Method for processing audio signal |
Applications Claiming Priority (12)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US70346305P | 2005-07-29 | 2005-07-29 | |
US60/703,463 | 2005-07-29 | ||
US71652605P | 2005-09-14 | 2005-09-14 | |
US60/716,526 | 2005-09-14 | ||
KR1020060004048A KR20070031212A (en) | 2005-09-14 | 2006-01-13 | Method and Apparatus for encoding/decoding audio signal |
KR10-2006-0004048 | 2006-01-13 | ||
KR10-2006-0017659 | 2006-02-23 | ||
KR1020060017659A KR20070014936A (en) | 2005-07-29 | 2006-02-23 | Method and apparatus for encoding/decoding audio signal |
KR1020060017660A KR20070014937A (en) | 2005-07-29 | 2006-02-23 | Method and apparatus for encoding/decoding audio signal |
KR10-2006-0017660 | 2006-02-23 | ||
US81602206P | 2006-06-22 | 2006-06-22 | |
US60/816,022 | 2006-06-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2007013783A1 true WO2007013783A1 (en) | 2007-02-01 |
Family
ID=37683623
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2006/002985 WO2007013784A1 (en) | 2005-07-29 | 2006-07-28 | Method for generating encoded audio signal amd method for processing audio signal |
PCT/KR2006/002974 WO2007013775A1 (en) | 2005-07-29 | 2006-07-28 | Mehtod for generating encoded audio signal and method for processing audio signal |
PCT/KR2006/002982 WO2007013781A1 (en) | 2005-07-29 | 2006-07-28 | Method for generating encoded audio signal and method for processing audio signal |
PCT/KR2006/002984 WO2007013783A1 (en) | 2005-07-29 | 2006-07-28 | Method for processing audio signal |
PCT/KR2006/002981 WO2007013780A1 (en) | 2005-07-29 | 2006-07-28 | Method for signaling of splitting information |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2006/002985 WO2007013784A1 (en) | 2005-07-29 | 2006-07-28 | Method for generating encoded audio signal amd method for processing audio signal |
PCT/KR2006/002974 WO2007013775A1 (en) | 2005-07-29 | 2006-07-28 | Mehtod for generating encoded audio signal and method for processing audio signal |
PCT/KR2006/002982 WO2007013781A1 (en) | 2005-07-29 | 2006-07-28 | Method for generating encoded audio signal and method for processing audio signal |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2006/002981 WO2007013780A1 (en) | 2005-07-29 | 2006-07-28 | Method for signaling of splitting information |
Country Status (7)
Country | Link |
---|---|
EP (5) | EP1920439A4 (en) |
KR (5) | KR100888970B1 (en) |
CN (5) | CN101233568B (en) |
AU (1) | AU2006273012B2 (en) |
CA (1) | CA2617050C (en) |
RU (1) | RU2414741C2 (en) |
WO (5) | WO2007013784A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7933415B2 (en) | 2002-04-22 | 2011-04-26 | Koninklijke Philips Electronics N.V. | Signal synthesizing |
US8515771B2 (en) | 2009-09-01 | 2013-08-20 | Panasonic Corporation | Identifying an encoding format of an encoded voice signal |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1853092B1 (en) | 2006-05-04 | 2011-10-05 | LG Electronics, Inc. | Enhancing stereo audio with remix capability |
EP2084901B1 (en) | 2006-10-12 | 2015-12-09 | LG Electronics Inc. | Apparatus for processing a mix signal and method thereof |
WO2008060111A1 (en) | 2006-11-15 | 2008-05-22 | Lg Electronics Inc. | A method and an apparatus for decoding an audio signal |
JP5450085B2 (en) | 2006-12-07 | 2014-03-26 | エルジー エレクトロニクス インコーポレイティド | Audio processing method and apparatus |
KR101062353B1 (en) | 2006-12-07 | 2011-09-05 | 엘지전자 주식회사 | Method for decoding audio signal and apparatus therefor |
KR20080082916A (en) | 2007-03-09 | 2008-09-12 | 엘지전자 주식회사 | A method and an apparatus for processing an audio signal |
EP2278582B1 (en) * | 2007-06-08 | 2016-08-10 | LG Electronics Inc. | A method and an apparatus for processing an audio signal |
JP2010538571A (en) * | 2007-09-06 | 2010-12-09 | エルジー エレクトロニクス インコーポレイティド | Audio signal decoding method and apparatus |
JP2011507013A (en) | 2007-12-06 | 2011-03-03 | エルジー エレクトロニクス インコーポレイティド | Audio signal processing method and apparatus |
TWI444989B (en) | 2010-01-22 | 2014-07-11 | Dolby Lab Licensing Corp | Using multichannel decorrelation for improved multichannel upmixing |
WO2014175617A1 (en) | 2013-04-23 | 2014-10-30 | ㈜ 소닉티어 | Method and apparatus for encoding/decoding scalable digital audio using direct audio channel data and indirect audio channel data |
KR101421201B1 (en) * | 2013-04-23 | 2014-07-22 | 한국산업은행 | Method and apparatus for encoding/decoding scalable digital audio using uncompressed audio channel data and compressed audio channel data |
TWI693594B (en) * | 2015-03-13 | 2020-05-11 | 瑞典商杜比國際公司 | Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element |
ES2904275T3 (en) | 2015-09-25 | 2022-04-04 | Voiceage Corp | Method and system for decoding the left and right channels of a stereo sound signal |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030035553A1 (en) * | 2001-08-10 | 2003-02-20 | Frank Baumgarte | Backwards-compatible perceptual coding of spatial cues |
WO2003090207A1 (en) * | 2002-04-22 | 2003-10-30 | Koninklijke Philips Electronics N.V. | Parametric multi-channel audio representation |
WO2003090206A1 (en) * | 2002-04-22 | 2003-10-30 | Koninklijke Philips Electronics N.V. | Signal synthesizing |
WO2003090208A1 (en) * | 2002-04-22 | 2003-10-30 | Koninklijke Philips Electronics N.V. | pARAMETRIC REPRESENTATION OF SPATIAL AUDIO |
US20060116886A1 (en) * | 2004-12-01 | 2006-06-01 | Samsung Electronics Co., Ltd. | Apparatus and method for processing multi-channel audio signal using space information |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SG49883A1 (en) * | 1991-01-08 | 1998-06-15 | Dolby Lab Licensing Corp | Encoder/decoder for multidimensional sound fields |
DE4209544A1 (en) * | 1992-03-24 | 1993-09-30 | Inst Rundfunktechnik Gmbh | Method for transmitting or storing digitized, multi-channel audio signals |
KR100265112B1 (en) * | 1997-03-31 | 2000-10-02 | 윤종용 | Dvd dics and method and apparatus for dvd disc |
CN1214690C (en) * | 1997-09-05 | 2005-08-10 | 雷克西康公司 | 5-2-5 Matrix encoder and decoder system |
SE0402650D0 (en) * | 2004-11-02 | 2004-11-02 | Coding Tech Ab | Improved parametric stereo compatible coding or spatial audio |
US7787631B2 (en) * | 2004-11-30 | 2010-08-31 | Agere Systems Inc. | Parametric coding of spatial audio with cues based on transmitted channels |
US7903824B2 (en) * | 2005-01-10 | 2011-03-08 | Agere Systems Inc. | Compact side information for parametric coding of spatial audio |
-
2006
- 2006-07-28 WO PCT/KR2006/002985 patent/WO2007013784A1/en active Application Filing
- 2006-07-28 KR KR1020087004586A patent/KR100888970B1/en active IP Right Grant
- 2006-07-28 CA CA2617050A patent/CA2617050C/en active Active
- 2006-07-28 KR KR1020087004585A patent/KR100857102B1/en active IP Right Grant
- 2006-07-28 EP EP06769319A patent/EP1920439A4/en not_active Ceased
- 2006-07-28 EP EP06769316A patent/EP1920437A4/en not_active Ceased
- 2006-07-28 KR KR1020087004587A patent/KR100857103B1/en active IP Right Grant
- 2006-07-28 EP EP06769318A patent/EP1915757A4/en not_active Ceased
- 2006-07-28 WO PCT/KR2006/002974 patent/WO2007013775A1/en active Application Filing
- 2006-07-28 CN CN2006800274861A patent/CN101233568B/en active Active
- 2006-07-28 WO PCT/KR2006/002982 patent/WO2007013781A1/en active Application Filing
- 2006-07-28 CN CN2006800277662A patent/CN101233570B/en active Active
- 2006-07-28 WO PCT/KR2006/002984 patent/WO2007013783A1/en active Application Filing
- 2006-07-28 CN CN2006800277709A patent/CN101233571B/en active Active
- 2006-07-28 KR KR1020087004588A patent/KR100841332B1/en active IP Right Grant
- 2006-07-28 AU AU2006273012A patent/AU2006273012B2/en active Active
- 2006-07-28 KR KR1020087004589A patent/KR100857104B1/en active IP Right Grant
- 2006-07-28 WO PCT/KR2006/002981 patent/WO2007013780A1/en active Application Filing
- 2006-07-28 RU RU2008107773/28A patent/RU2414741C2/en not_active Application Discontinuation
- 2006-07-28 CN CN2006800274908A patent/CN101233569B/en active Active
- 2006-07-28 EP EP06769309A patent/EP1915756A4/en not_active Ceased
- 2006-07-28 EP EP06769317A patent/EP1920438A4/en not_active Ceased
- 2006-07-28 CN CN2006800274842A patent/CN101233567B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030035553A1 (en) * | 2001-08-10 | 2003-02-20 | Frank Baumgarte | Backwards-compatible perceptual coding of spatial cues |
WO2003090207A1 (en) * | 2002-04-22 | 2003-10-30 | Koninklijke Philips Electronics N.V. | Parametric multi-channel audio representation |
WO2003090206A1 (en) * | 2002-04-22 | 2003-10-30 | Koninklijke Philips Electronics N.V. | Signal synthesizing |
WO2003090208A1 (en) * | 2002-04-22 | 2003-10-30 | Koninklijke Philips Electronics N.V. | pARAMETRIC REPRESENTATION OF SPATIAL AUDIO |
US20060116886A1 (en) * | 2004-12-01 | 2006-06-01 | Samsung Electronics Co., Ltd. | Apparatus and method for processing multi-channel audio signal using space information |
Non-Patent Citations (1)
Title |
---|
See also references of EP1915757A4 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7933415B2 (en) | 2002-04-22 | 2011-04-26 | Koninklijke Philips Electronics N.V. | Signal synthesizing |
US8798275B2 (en) | 2002-04-22 | 2014-08-05 | Koninklijke Philips N.V. | Signal synthesizing |
US8515771B2 (en) | 2009-09-01 | 2013-08-20 | Panasonic Corporation | Identifying an encoding format of an encoded voice signal |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7702407B2 (en) | Method for generating encoded audio signal and method for processing audio signal | |
CA2617050C (en) | Method for signaling of splitting information | |
KR20070031213A (en) | Method and Apparatus for encoding/decoding audio signal | |
KR20070014937A (en) | Method and apparatus for encoding/decoding audio signal | |
BRPI0614611A2 (en) | method for signaling fragmentation information |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200680027770.9 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2008523806 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2006769318 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11997321 Country of ref document: US |