WO2007097549A1 - Method and apparatus for processing an audio signal - Google Patents

Method and apparatus for processing an audio signal Download PDF

Info

Publication number
WO2007097549A1
WO2007097549A1 PCT/KR2007/000865 KR2007000865W WO2007097549A1 WO 2007097549 A1 WO2007097549 A1 WO 2007097549A1 KR 2007000865 W KR2007000865 W KR 2007000865W WO 2007097549 A1 WO2007097549 A1 WO 2007097549A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
extension
decoding
information
extension signal
Prior art date
Application number
PCT/KR2007/000865
Other languages
French (fr)
Inventor
Hee Suck Pang
Dong Soo Kim
Jae Hyun Lim
Hyen O Oh
Yang Won Jung
Original Assignee
Lg Electronics Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020070013364A external-priority patent/KR20070087494A/en
Application filed by Lg Electronics Inc. filed Critical Lg Electronics Inc.
Priority to ES07709014T priority Critical patent/ES2413807T3/en
Priority to EP07709014.0A priority patent/EP1987594B1/en
Priority to CN200780001487.3A priority patent/CN101361275B/en
Priority to JP2008556238A priority patent/JP5254808B2/en
Priority to US12/280,313 priority patent/US7991494B2/en
Publication of WO2007097549A1 publication Critical patent/WO2007097549A1/en

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/167—Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes

Definitions

  • the present invention relates to a method and apparatus for processing an audio signal.
  • the present invention is suitable for a wide scope of applications, it is particularly suitable for processing a residual signal.
  • an audio signal includes a downmix signal and an ancillary data signal.
  • the ancillary data signal can include a spatial information signal and an extension signal.
  • the extension signal means an additional signal necessary to enable a signal to be reconstructed close to an original signal in generating a multi-channel signal by upmixing the downmix signal.
  • the extension signal can include a residual signal.
  • the residual signal means a signal corresponding to a difference between an original signal and a coded signal.
  • the residual signal is usable for the following cases. For instance, the residual signal is usable for compensation of an artistic downmix signal or specific channel compensation in decoding. And, the residual signal is usable for both of the compensations as well. So, it is able to reconstruct an inputted audio signal into a signal closer to an original signal using the residual signal to enhance sound quality.
  • header information for an audio signal is not variable in general, the header information is inserted in a bit stream once only. But in case that the header information is inserted in the bit stream once only, if an audio signal needs to be decoded from a random timing point for broadcasting or VOD, it may be unable to decode data frame information due to the absence of the header information.
  • the present invention is directed to a method and apparatus for processing an audio signal that substantially obviate one or more of the problems due to limitations and disadvantages of the related art.
  • An object of the present invention is to provide a method and apparatus for processing an audio signal, by which a processing efficiency of the audio signal is enhanced by skipping decoding of an extension signal.
  • a further object of the present invention is to provide a method and apparatus for processing an audio signal, by which the audio signal is processed according to level information.
  • the present invention selectively decodes an extension signal to enable more efficient decoding.
  • the present invention is able to enhance a sound quality of an audio signal.
  • the present invention is able to reduce complexity.
  • the present invention is able to enhance a sound quality by decoding a predetermined low frequency part only and also reduce a load of operation.
  • the present invention is able to process an audio signal from a random timing point in a manner of identifying a presence or non- presence of header information within the audio signal.
  • FIG. 1 is a block diagram of an audio signal encoding apparatus and an audio signal decoding apparatus according to an embodiment of the present invention
  • FIG. 2 is a schematic block diagram of an extension signal decoding unit 90 according to an embodiment of the present invention
  • FIG. 3 and FIG. 4 are diagrams to explain fixed bits assignment of length information for an extension signal according to an embodiment of the present invention.
  • FIG. 5 and FIG. 6 are diagrams to explain variable bits assignment of length information for an extension signal by depending on a length type according to an embodiment of the present invention
  • FIG. 7 and FIG. 8 are diagrams to explain adaptive bits assignment of length information for an extension signal by depending on a real length of the extension signal according to an embodiment of the present invention
  • FIG. 9 is a diagram of a bit stream structure configuring an audio signal with a downmix signal, an ancillary signal, and an extension signal according to an embodiment of the present invention
  • FIG. 10 is a diagram of a bit stream structure configuring an audio signal with an ancillary signal including an extension signal and a downmix signal according to an embodiment of the present invention
  • FIG. 11 is a diagram of a bit stream structure configuring an independent audio signal with a downmix signal or an ancillary signal according to an embodiment of the present invention
  • FIG. 12 is a diagram of a broadcasting streaming structure configuring an audio signal with a downmix signal and an ancillary signal according to an embodiment of the present invention
  • FIG. 13 is a flowchart of a method of processing an extension signal using length information of the extension signal in accordance with identification information indicating whether a header is included within an ancillary signal in case if using an audio signal for broadcasting or the like according to an embodiment of the present invention.
  • FIG. 14 is a flowchart of a method of decoding an extension signal selectively using length information of the extension signal in accordance with a level of a bit stream according to an embodiment of the present invention.
  • a method for processing an audio signal includes the steps of extracting an ancillary signal for generating the audio signal and an extension signal included in the ancillary signal from a received bit stream, reading length information of the extension signal, skipping decoding of the extension signal or not using a result of the decoding based on the length information, and generating the audio signal using the ancillary signal.
  • a method for processing an audio signal includes the steps of acquiring sync information indicating a location of an ancillary signal for generating the audio signal and a location of an extension signal included in the ancillary signal, skipping decoding of the extension signal or not using a result of the decoding based on the sync information, and generating the audio signal using the ancillary signal.
  • an apparatus for processing an audio signal includes a signal extracting unit extracting an ancillary signal for generating the audio signal and an extension signal included in the ancillary signal from a received bit stream, an extension signal length reading unit reading length information of the extension signal, a selective decoding unit skipping decoding of the extension signal or not using a result of the decoding based on the length information, and an upmixing unit generating the audio signal using the ancillary signal.
  • an apparatus for processing an audio signal includes a sync information acquiring unit acquiring sync information indicating a location of an ancillary signal for generating the audio signal and a location of an extension signal included in the ancillary signal, a selective decoding unit skipping decoding of the extension signal or not using a result of the decoding based on the sync information, and an upmixing unit generating the audio signal using the ancillary signal.
  • FIG. 1 is a block diagram of an audio signal encoding apparatus and an audio signal decoding apparatus according to an embodiment of the present invention.
  • an encoding apparatus includes a downmixing unit 10, a downmix signal encoding unit 20, an ancillary signal encoding unit 30, an extension signal encoding unit 40, and a multiplexing unit 50.
  • the downmixing unit 10 In case that multi-source audio signals Xl, X2 , ..., Xn are inputted to the downmixing unit 10, the downmixing unit 10 generates a downmix signal by downmixing the multi- source audio signals.
  • the downmix signal includes a mono signal, a stereo signal, or a multi-source audio signal.
  • the source includes a channel and is described as the channel for convenience. In the specification of the present invention, explanation is made with reference to a mono or stereo downmix signal. Yet, the present invention is not limited to the mono or stereo downmix signal.
  • the encoding apparatus is able to use an artistic downmix signal provided from an outside selectively and directly.
  • an ancillary signal can be generated from a multi-channel audio signal and an extension signal corresponding to additional information can be generated as well.
  • the ancillary signal can include a spatial information signal and an extension signal.
  • the generated downmix, ancillary and extension signals are encoded by the downmix signal encoding unit 20, the ancillary signal encoding unit 30, and the extension signal encoding unit 40 and are then transferred to the multiplexing unit 50, respectively.
  • the ⁇ spatial information' means the information necessary for the encoding apparatus to transfer a downmix signal generated from downmixing multi-channel signals to the decoding apparatus and necessary for the decoding apparatus to generate multichannel signals by upmixing the downmix signal.
  • the spatial information includes spatial parameters.
  • the spatial parameters include CLD (channel level difference) indicating an energy difference between channels, ICC (inter-channel coherences) meaning a correlation between channels, CPC (channel prediction coefficients) used in generating three channels from two channels, etc.
  • the 'extension signal' means additional information necessary to enable a signal to be reconstructed closer to an original signal in generating multi-channel signals by upmixing the downmix signal by the decoding apparatus.
  • the additional information includes a residual signal, an artistic downmix residual signal, an artistic tree extension signal, etc.
  • the residual signal indicates a signal corresponding to a difference between an original signal and an encoded signal.
  • the residual signal includes a general residual signal or an artistic downmix residual signal for compensation of an artistic downmix signal.
  • the downmix signal encoding unit 20 or the downmix signal decoding unit 70 means a codec that encodes or decodes an audio signal not included with an ancillary signal.
  • a downmix audio signal is taken as an example of not included with the ancillary signal the audio signal.
  • the downmix signal encoding unit 20 or the downmix signal decoding unit 70 is able to include MP3, AC-3, DTS, or AAC. If a codec function is performed on an audio signal, the downmix signal encoding unit 20 and the downmix signal decoding unit 70 can include a codec to be developed in the future as well as a previously developed codec.
  • the multiplexing unit 50 can generate a bit stream by multiplexing a downmix signal, an ancillary signal, and an extension signal and then transfer the generated bit stream to the decoding apparatus.
  • both of the downmix signal and the ancillary signal can be transferred in a bit stream format to the decoding apparatus.
  • the ancillary signal and the downmix signal can be transferred in independent bit stream formats to the decoding apparatus, respectively. Details of the bit streams are explained in FIGs. 9 to 11. In case that it is unable to use previously transferred header information since an audio signal starts to be decoded from a random timing point instead of being decoded from the beginning like a bit stream for broadcasting, it is able to decode the audio signal using another header information inserted in the audio signal.
  • header information can be inserted in an audio signal at least once. If header information exists in a front part of an audio signal only once, it is unable to perform decoding due to the absence of the header information in case of receiving an audio signal at a random timing point.
  • header information can be included according to a preset format (e.g., temporal interval, spatial interval, etc.). It is able to insert identification information indicating a presence or non-presence of header information in a bit stream. And, an audio signal is able to selectively include a header according to the identification information.
  • the decoding apparatus includes a demultiplexing unit 60, a downmix signal decoding unit 70, an ancillary signal decoding unit 80, an extension signal decoding unit 90, and an upmixing unit 100.
  • the demultiplexing unit 60 receives a bit stream and then separates an encoded downmix signal, an encoded ancillary signal, and an encoded extension signal from the received bit stream.
  • the downmix signal decoding unit 70 decodes the encoded downmix signal.
  • the ancillary signal decoding unit 80 decodes the encoded ancillary signal .
  • the extension signal can be included in the ancillary signal. It is necessary to efficiently decode the extension signal to efficiently generate multi-channel audio signals. So, the extension signal decoding unit 90 is able to selectively decode the encoded extension signal. In particular, the encoded extension signal can be decoded or the decoding of the encoded extension signal can be skipped. Occasionally, if the decoding of the extension signal is skipped, the encoded signal can be reconstructed to be closer to an original signal and coding efficiency can be raised.
  • the decoding apparatus For instance, if a level of the decoding apparatus is lower than that of a bit stream, the decoding apparatus is unable to decode the received extension signal. So, the decoding of the extension signal can be skipped. Even if the decoding of the extension signal is available because the level of the decoding apparatus is higher than that of the bit stream, the decoding of the extension signal is able to be skipped by another information obtained from the audio signal. In this case, for instance, the another information may include information indicating whether to execute the decoding of the extension signal. This is explained in detail with reference to FIG. 14 later.
  • length information of the extension signal is read from the bit stream and the decoding of the extension signal is able to be skipped using the length information.
  • it is able to skip the decoding of the extension signal using sync information indicating a position of the extension signal. This is explained in detail with reference to FIG. 2 later.
  • the length information of the extension signal can be defined in various ways. For instance, fixed bits can be assigned, or variable bits can be assigned according to a predetermined length information type, or bits suitable for a length of a real extension signal can be adaptively assigned while the length of the extension signal is read. Details of the fixed bits assignment are explained in FIG.
  • the length information of the extension signal can be located within an ancillary data area.
  • the ancillary data area indicates an area where additional information necessary to reconstruct a downmix signal into an original signal exists.
  • a spatial information signal or an extension signal can be taken as an example of the ancillary data.
  • the length information of the extension signal can be located within the ancillary signal or an extension area of the ancillary signal .
  • the length information of the extension signal is located within a header extension area of the ancillary signal, a frame data extension area of the ancillary signal, or both of the header extension area and the frame data extension area of the ancillary signal.
  • FIG. 2 is a schematic block diagram of an extension signal decoding unit 90 according to an embodiment of the present invention.
  • the extension signal decoding unit 90 includes an extension signal type information acquiring unit 91, an extension signal length reading unit 92, and a selective decoding unit 93.
  • the selective decoding unit 93 includes a level deciding unit 94, an extension signal information acquiring unit 95, and an extension signal information skipping unit 96.
  • the extension signal decoding unit 90 receives a bit stream for an extension signal from the demultiplexing unit 60 and then outputs a decoded extension signal. Occasionally, the extension signal decoding unit 90 may not output an extension signal or can output an extension signal by padding a bit stream for the extension signal with zeros completely.
  • the extension signal type acquiring unit 91 acquires information indicating a type of an extension signal from a bit stream.
  • the information indicating the type of the extension signal can include a residual signal, an artistic downmix residual signal, an artistic tree extension signal, or the like.
  • the residual signal is a generic term of a general residual signal or an artistic downmix residual signal for compensation of an artistic downmix signal.
  • the residual signal is usable for compensation of an artistic downmix signal in multi-channel audio signals or specific channel compensation in decoding.
  • the two cases are usable as well.
  • the extension signal length reading unit 92 reads a length of the extension signal decided by the type information of the extension signal. This can be achieved regardless of whether to perform the decoding of the extension signal.
  • the selective decoding unit 93 selectively performs decoding on the extension signal. This can be decided by the level deciding unit 94. In particular, the level deciding unit 94 selects whether to execute the decoding of the extension signal by comparing a level of a bit stream to a level of a decoding apparatus.
  • the decoding apparatus acquires information for the extension signal via the extension signal information acquiring unit 95 and then decodes the information to output the extension signal.
  • the outputted extension signal is transferred to an upmixing unit 100 to be used in reconstruct an original signal or generating an audio signal.
  • the level of the decoding apparatus is lower than that of the bit stream, it is able to skip the decoding of the extension signal via the extension signal information skipping unit 96. In this case, it is able to skip the decoding of the extension signal based on the length information read by the extension signal length reading unit 92.
  • the reconstruction can be achieved to get closer to the original signal to enhance a sound quality. If necessary, it is able to reduce a load of operation of the decoding apparatus by omitting the decoding of the extension signal.
  • bit or byte length information of the extension signal can be inserted in data. And, the decoding can keep proceeding by skipping a bit field of the extension signal as many as a value obtained from the length information.
  • the method of omitting the decoding of the extension signal it is able to skip the decoding of the extension signal based on sync information indicating a position of the extension signal. For instance, it is able to insert a sync word having predetermined bits in the point where the extension signal ends.
  • the decoding apparatus keeps searching the bit field of the residual signal until finding a sync word of the extension signal. Once finding the sync word, the decoding apparatus stops the search process and then keeps performing the decoding. In particular, it is able to skip the decoding of the extension signal until the sync word of the extension signal is found.
  • a decoding method in case of performing the decoding of the extension signal, it is able to perform the decoding after parsing the extension signal.
  • the sync word of the extension signal is read but may not be available .
  • FIG. 3 and FIG. 4 are diagrams to explain fixed bits assignment of length information for an extension signal according to an embodiment of the present invention.
  • the length information of the extension signal can be defined by a bit or byte unit. If the length information is decided by the byte unit, this means that the extension signal is assigned bytes.
  • FIG. 3 shows a method of defining length information for an extension signal in a simplest way.
  • FIG. 4 shows the method shown in FIG. 3 schematically.
  • a syntax element for indicating the length information of the extension signal is defined and predetermined bits are assigned to the syntax element. For instance, ⁇ bsResidualSignalLength' is defined as the syntax element and 16 bits are assigned as fixed bits. Yet, this method may consume a relatively considerable amount of bits. So, the methods shown in FIG. 5, FIG. 6, FIG. 7, and FIG. 8 are explained as follows.
  • FIG. 5 and FIG. 6 are diagrams to explain variable bits assignment of length information for an extension signal by depending on a length type according to an embodiment of the present invention.
  • FIG. 5 shows a method of defining one more syntax element for defining how many bits are used for ⁇ bsResidualSignalLength' to further reduce bit consumption.
  • FIG. 6 schematically illustrates the method shown in FIG. 5.
  • ⁇ bsResidualSignalLengthtype' is newly defined as a length type. If a value of the ⁇ bsResidualSignalLengthtype' is zero, four bits are assigned to the ⁇ bsResidualSignalLength' .
  • a value of the ⁇ bsResidualSignalLengthtype' is 1, eight bits are assigned to the ⁇ bsResidualSignalLength' . If a value of the ⁇ bsResidualSignalLengthtype' is 2, twelve bits are assigned to the ⁇ bsResidualSignalLength' . If a value of the ⁇ bsResidualSignalLengthtype' is 3, sixteen bits are assigned to the ⁇ bsResidualSignalLength' . In this case, the assigned bits are exemplary. So, bits different from the above-defined bits can be assigned. To reduce the bit consumption more than those of the above methods, the method shown in FIG. 7 and FIG. 8 is provided.
  • FIG. 7 and FIG. 8 are diagrams to explain adaptive bits assignment of length information for an extension signal by depending on a real length of the extension signal according to an embodiment of the present invention.
  • a length information value of the extension signal can be read up to an initially determined value. If the length information value equals to a predetermined value, it is able to read additionally up to a further determined value. If the length information value equals to another predetermined value, it is able to read additionally up to another further determined value. In this case, if the length information value is not another predetermined value, the corresponding value is outputted as the length information value as it is.
  • the length information of the extension signal is adaptively read according to a real data length, whereby the bit consumption can be maximally reduced. The example shown in FIG. 7 or FIG. 8 is explained.
  • FIG.8 schematically illustrates another example of the adaptive bits assignment of length information for an extension signal.
  • the length information of the extension signal can be length information of the extension signal header or length information of the extension signal frame data. So, the length information of the extension signal can be located in a header area and/or a frame data area. Bit stream structures for this are explained with reference to FIGs. 9 to 12.
  • FIG. 9 and FIG. 10 show embodiments of the present invention, in which a bit stream structure configuring an audio signal with a downmix signal, an ancillary signal, and an extension signal is shown.
  • An audio signal includes a downmix signal and an ancillary signal.
  • a spatial information signal can be taken.
  • Each of the downmix signal and the ancillary signal is transferred by a frame unit.
  • the ancillary signal can include header information and data information or can include data information only.
  • the header information precedes and is followed by the data information.
  • a downmix signal header and an ancillary signal header can exist as the header information in a front part.
  • downmix signal data and ancillary signal data can configure one frame as the data information behind the front part.
  • an extension signal can be included within the ancillary signal or can be used as an independent signal.
  • FIG. 9 shows a case that the extension signal is used as the independent signal
  • FIG. 10 shows a case that the extension signal is located in the extension area within the ancillary signal.
  • an extension signal header can exist as header information in the front part as well as the downmix header and the spatial information header.
  • extension signal data can be further included as data information as well as the downmix signal data and the ancillary signal data to configure one frame.
  • extension signal can be selectively decoded, it can be located at a last part of the frame or can consecutively exist right behind the ancillary signal.
  • the length information explained in FIGs. 3 to 8 can exist within the header area of the extension signal and/or the data area of the extension signal.
  • the length information existing within the header area (extension signal header) indicates the length information of the extension signal header
  • the length information existing within the data area (extension signal data) indicates the length information of the extension signal data.
  • the length information existing each of the areas is read from a bit stream and the decoding apparatus is able to skip the decoding of the extension signal based on the length information.
  • FIG. 11 is a diagram of a bit stream structure configuring an independent audio signal with a downmix signal or an ancillary signal according to an embodiment of the present invention.
  • An audio signal includes a downmix signal and an ancillary signal.
  • a spatial information signal can be taken.
  • the downmix signal and the ancillary signal can be transferred as independent signals, respectively.
  • the downmix signal has a structure that a downmix signal header (downmix signal
  • the ancillary signal has a structure that an ancillary signal header (ancillary signal header ⁇ ) as header information is located at a front part and that
  • ancillary signal datas (ancillary signal data ⁇ , ⁇ , ..., ®) as data information follow the ancillary signal header. Since the extension signal can be included within the ancillary signal, a structure that the extension signal follows the ancillary signal data can be provided. So, an extension signal header ⁇ follows the ancillary signal header ® and the extension signal data ⁇ follows the ancillary signal data ⁇ . Likewise, the extension signal data ⁇ follows the ancillary signal data ⁇ . In this case, length information of the extension signal can be included
  • each of the extension signal header ® , the extension signal data ⁇ , and/or the extension signal data ⁇ , ..., and ⁇ is included in each of the extension signal header ® , the extension signal data ⁇ , and/or the extension signal data ⁇ , ..., and ⁇ .
  • FIG. 12 is a diagram of a broadcasting streaming structure configuring an audio signal with a downmix signal and an ancillary signal according to an embodiment of the present invention.
  • the header information can be inserted in the audio signal once at least.
  • the header information can be included according to a preset format (e.g., temporal interval, spatial interval, etc.).
  • the header information can be inserted in each frame, periodically inserted in each frame with a fixed interval, or non-periodically inserted in each frame with a random interval.
  • the header information can be inserted once according to a fixed time interval (e.g., 2 seconds).
  • a broadcast streaming structure configuring one audio signal has a structure that at least once header information is inserted between data informations. For instance, in case of a broadcast streaming structure configuring one audio signal, a downmix signal comes first and an ancillary signal follows the downmix signal. Sync information for distinguishing between the downmix signal and the ancillary signal can be located at a front part of the ancillary signal. And, identification information indicating whether header information for the ancillary signal exists can be located. For instance, if header identification information is 0, a next read frame only has a data frame without header information. If the header identification information is 1, a next read frame has both header information and a data frame. This is applicable to the ancillary signal or the extension signal.
  • header informations may be the same of the header information having been initially transferred or can be variable.
  • header information is variable, new header information is decoded and data information transferred after the new header information is then decoded according to the decoded new header information.
  • the header identification information is 0, a transferred frame only has a data frame without header information.
  • previously transferred header information can be used. For instance, if the header identification information is 1 in FIG. 12, an ancillary signal header ⁇ and an extension signal header ⁇ can exist. Yet, if a next incoming frame has no header information since the header identification information set to 0, it is able to use information of the extension signal header ⁇ previously transferred to process extension signal data ⁇ .
  • FIG. 13 is a flowchart of a method of processing an extension signal based on length information of the extension signal in accordance with identification information indicating whether a header is included within an ancillary signal in case of using an audio signal for broadcasting or the like according to an embodiment of the present invention.
  • an ancillary signal for an audio signal generation and an extension signal included in the ancillary signal are extracted from a received bit stream (1301).
  • the extension signal can be included within the ancillary signal.
  • Identification information indicating whether a header is included in the ancillary signal is extracted (1303). For instance, if the header identification information is 1, it indicates that an ancillary signal header is included in the ancillary signal. If the header identification information is 0, it indicates that an ancillary signal header is not included in the ancillary signal. In case that the extension signal is included in the ancillary signal, if the header identification information is 1, it indicates that an extension signal header is included in the extension signal.
  • the header identification information is 0, it indicates that an extension signal header is not included in the extension signal. It is decided that whether a header is included in the ancillary signal according to the header identification information (1305). If the header is included in the ancillary signal, length information is extracted from the header (1307) . And, it is able to skip decoding of the extension signal based on the length information (1309) . In this case, the header plays a role in enabling each ancillary signal and/or each extension signal to be interpreted.
  • the header information can include information for a residual signal, length information for a residual signal, sync information indicating a location of a residual signal, a sampling frequency, a frame length, the number of a parameter band, tree information, quantization mode information, ICC (inter-channel correlation) , parameter smoothing information, gain information for a clipping-prevention, QMF (quadrature mirror filter) associated information, etc.
  • the header is not included in the ancillary signal according to the header identification information, it is able to skip decoding of the extension signal based on the previously extracted length information for the header (1311) .
  • FIG. 14 is a flowchart of a method of decoding an extension signal selectively based on length information of the extension signal according to an embodiment of the present invention.
  • a profile means that technical elements for algorithm in a coding process are standardized.
  • the profile is a set of technical elements necessary to decode a bit stream and corresponds to a sort of a sub-standard.
  • a level defines a range of the technical elements, which are prescribed in the profile, to be supported.
  • the level plays a role in defining capability of a decoding apparatus and complexity of a bit stream.
  • level information can include definitions for the profile and level.
  • a decoding method of an extension signal can selectively vary according to the level information of the bit stream and the level information of the decoding apparatus. For instance, even if the extension signal exists in a transferred audio signal, decoding of the extension signal may be or may not be executed as a result of deciding the level information.
  • the decoding is executed, a predetermined low frequency part can be used only. Besides, it is able to skip the decoding of the extension signal as many as length information of the extension signal in order not to execute the decoding of the extension signal.
  • the extension signal is entirely read, the decoding cannot be executed. Furthermore, a portion of the extension signal is read, decoding can be performed on the read portion only, and the decoding cannot be performed on the rest of the extension signal. Alternatively, the extension signal is entirely read, a portion of the extension signal can be decoded, and the rest of the extension signal cannot be decoded.
  • an ancillary signal for generating an audio signal and an extension signal included in the ancillary signal can be extracted from a received bit stream (1410) .
  • information for the extension signal can be extracted.
  • the information for the extension signal may include extension data type information indicating a data type of the extension signal.
  • the extension data type information includes residual coding data, artistic downmix residual coding data, artistic tree extension data, or the like. So, the type of the extension signal is decided and it is able to read length information of the extension signal from an extension area of the audio signal (1420) . Subsequently, a level of the bit stream is decided. This can be decided with reference to following information.
  • the level information for the bit stream can include the number of output channels, a sampling rate, a bandwidth of a residual signal, and the like. So, if the above-explained level informations of the bit stream are inputted, they are compared to level information for a decoding apparatus to decide whether the extension signal will be decoded (1430) . In this case, a level of the decoding apparatus can be previously set. In general, the level of the decoding apparatus should be equal to or greater than a level of the audio signal. This is because the decoding apparatus should be able to decode the transferred audio signal entirely.
  • decoding is occasionally possible. Yet, a corresponding quality may be degraded. For instance, if the level of the decoding apparatus is lower than that of the audio signal, the decoding apparatus may be unable to decode the audio signal. Yet, in some cases, the audio signal can be decoded based on the level of the decoding apparatus.
  • the level of the decoding apparatus In case that the level of the decoding apparatus is decided lower than that of the bit stream, it is able to skip the decoding of the extension signal based on the length information of the extension signal (1440) . On the other hand, in case that the level of the decoding apparatus is equal to or higher than that of the bit stream, it is able to execute the decoding of the extension signal (1460). Yet, although the decoding of the extension signal is executed, the decoding can be performed on a predetermined low frequency portion of the extension signal only (1450) .
  • the decoding apparatus is a low power decoder, if the extension signal is entirely decoded, efficiency is degraded, or since the decoding apparatus is unable to decode the entire extension signal a predetermined low frequency portion of the extension signal is usable. And, this is possible if the level of the bit stream or the level of the decoding apparatus meets a prescribed condition only.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Theoretical Computer Science (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Reduction Or Emphasis Of Bandwidth Of Signals (AREA)
  • Transmission Systems Not Characterized By The Medium Used For Transmission (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Synchronisation In Digital Transmission Systems (AREA)

Abstract

A method for processing an audio signal, comprising the steps of extracting an ancillary signal for generating the audio signal and an extension signal included in the ancillary signal from a received bit stream, checking a level of the bit stream, selectively decoding the extension signal according to the level of the bit stream, and generating the audio signal using the ancillary signal. Accordingly, in case of processing the audio signal by the present invention, it is able to reduce a corresponding load of operation to enable efficient processing and enhance a sound quality.

Description

Method and Apparatus for Processing an Audio Signal
TECHNICAL FIELD
The present invention relates to a method and apparatus for processing an audio signal. Although the present invention is suitable for a wide scope of applications, it is particularly suitable for processing a residual signal.
BACKGROUND ART
Generally, an audio signal includes a downmix signal and an ancillary data signal. And, the ancillary data signal can include a spatial information signal and an extension signal. In this case, the extension signal means an additional signal necessary to enable a signal to be reconstructed close to an original signal in generating a multi-channel signal by upmixing the downmix signal. For instance, the extension signal can include a residual signal. The residual signal means a signal corresponding to a difference between an original signal and a coded signal. In multi-channel audio coding, the residual signal is usable for the following cases. For instance, the residual signal is usable for compensation of an artistic downmix signal or specific channel compensation in decoding. And, the residual signal is usable for both of the compensations as well. So, it is able to reconstruct an inputted audio signal into a signal closer to an original signal using the residual signal to enhance sound quality.
DISCLOSURE OF THE INVENTION TECHNICAL PROBLEM
However, if a decoder performs decoding on an extension signal unconditionally, although a sound quality may be improved according to a type of the decoder, complexity is raised and an operational load is increased.
Moreover, since header information for an audio signal is not variable in general, the header information is inserted in a bit stream once only. But in case that the header information is inserted in the bit stream once only, if an audio signal needs to be decoded from a random timing point for broadcasting or VOD, it may be unable to decode data frame information due to the absence of the header information.
TECHNICAL SOLUTION
Accordingly, the present invention is directed to a method and apparatus for processing an audio signal that substantially obviate one or more of the problems due to limitations and disadvantages of the related art.
An object of the present invention is to provide a method and apparatus for processing an audio signal, by which a processing efficiency of the audio signal is enhanced by skipping decoding of an extension signal.
Another object of the present invention is to provide a method and apparatus for processing an audio signal, by which decoding of an extension signal is skipped using length information of the extension signal. Another object of the present invention is to provide a method and apparatus for processing an audio signal, by which an audio signal for broadcasting is reproducible from a random timing point.
A further object of the present invention is to provide a method and apparatus for processing an audio signal, by which the audio signal is processed according to level information.
ADVANTAGEOUS EFFECTS The present invention provides the following effects or advantages.
First of all, in case of performing decoding, the present invention selectively decodes an extension signal to enable more efficient decoding. In case of performing decoding on an extension signal, the present invention is able to enhance a sound quality of an audio signal. In case of not performing decoding on an extension signal, the present invention is able to reduce complexity. Moreover, even if decoding is performed on an extension signal, the present invention is able to enhance a sound quality by decoding a predetermined low frequency part only and also reduce a load of operation. Besides, in case of using an audio signal for broadcasting or the like, the present invention is able to process an audio signal from a random timing point in a manner of identifying a presence or non- presence of header information within the audio signal.
BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
In the drawings:
FIG. 1 is a block diagram of an audio signal encoding apparatus and an audio signal decoding apparatus according to an embodiment of the present invention; FIG. 2 is a schematic block diagram of an extension signal decoding unit 90 according to an embodiment of the present invention;
FIG. 3 and FIG. 4 are diagrams to explain fixed bits assignment of length information for an extension signal according to an embodiment of the present invention;
FIG. 5 and FIG. 6 are diagrams to explain variable bits assignment of length information for an extension signal by depending on a length type according to an embodiment of the present invention;
FIG. 7 and FIG. 8 are diagrams to explain adaptive bits assignment of length information for an extension signal by depending on a real length of the extension signal according to an embodiment of the present invention; FIG. 9 is a diagram of a bit stream structure configuring an audio signal with a downmix signal, an ancillary signal, and an extension signal according to an embodiment of the present invention;
FIG. 10 is a diagram of a bit stream structure configuring an audio signal with an ancillary signal including an extension signal and a downmix signal according to an embodiment of the present invention;
FIG. 11 is a diagram of a bit stream structure configuring an independent audio signal with a downmix signal or an ancillary signal according to an embodiment of the present invention;
FIG. 12 is a diagram of a broadcasting streaming structure configuring an audio signal with a downmix signal and an ancillary signal according to an embodiment of the present invention;
FIG. 13 is a flowchart of a method of processing an extension signal using length information of the extension signal in accordance with identification information indicating whether a header is included within an ancillary signal in case if using an audio signal for broadcasting or the like according to an embodiment of the present invention; and
FIG. 14 is a flowchart of a method of decoding an extension signal selectively using length information of the extension signal in accordance with a level of a bit stream according to an embodiment of the present invention.
BEST MODE FOR CARRYING OUT THE INVENTION
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings .
To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, a method for processing an audio signal according to the present invention includes the steps of extracting an ancillary signal for generating the audio signal and an extension signal included in the ancillary signal from a received bit stream, reading length information of the extension signal, skipping decoding of the extension signal or not using a result of the decoding based on the length information, and generating the audio signal using the ancillary signal.
To further achieve these and other advantages and in accordance with the purpose of the present invention, a method for processing an audio signal includes the steps of acquiring sync information indicating a location of an ancillary signal for generating the audio signal and a location of an extension signal included in the ancillary signal, skipping decoding of the extension signal or not using a result of the decoding based on the sync information, and generating the audio signal using the ancillary signal.
To further achieve these and other advantages and in accordance with the purpose of the present invention, an apparatus for processing an audio signal includes a signal extracting unit extracting an ancillary signal for generating the audio signal and an extension signal included in the ancillary signal from a received bit stream, an extension signal length reading unit reading length information of the extension signal, a selective decoding unit skipping decoding of the extension signal or not using a result of the decoding based on the length information, and an upmixing unit generating the audio signal using the ancillary signal. To further achieve these and other advantages and in accordance with the purpose of the present invention, an apparatus for processing an audio signal includes a sync information acquiring unit acquiring sync information indicating a location of an ancillary signal for generating the audio signal and a location of an extension signal included in the ancillary signal, a selective decoding unit skipping decoding of the extension signal or not using a result of the decoding based on the sync information, and an upmixing unit generating the audio signal using the ancillary signal.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
MODE FOR INVENTION
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
FIG. 1 is a block diagram of an audio signal encoding apparatus and an audio signal decoding apparatus according to an embodiment of the present invention.
Referring to FIG. 1, an encoding apparatus includes a downmixing unit 10, a downmix signal encoding unit 20, an ancillary signal encoding unit 30, an extension signal encoding unit 40, and a multiplexing unit 50.
In case that multi-source audio signals Xl, X2 , ..., Xn are inputted to the downmixing unit 10, the downmixing unit 10 generates a downmix signal by downmixing the multi- source audio signals. The downmix signal includes a mono signal, a stereo signal, or a multi-source audio signal. The source includes a channel and is described as the channel for convenience. In the specification of the present invention, explanation is made with reference to a mono or stereo downmix signal. Yet, the present invention is not limited to the mono or stereo downmix signal. The encoding apparatus is able to use an artistic downmix signal provided from an outside selectively and directly. In the course of downmixing, an ancillary signal can be generated from a multi-channel audio signal and an extension signal corresponding to additional information can be generated as well. In this case, the ancillary signal can include a spatial information signal and an extension signal. The generated downmix, ancillary and extension signals are encoded by the downmix signal encoding unit 20, the ancillary signal encoding unit 30, and the extension signal encoding unit 40 and are then transferred to the multiplexing unit 50, respectively.
In the present invention, the λspatial information' means the information necessary for the encoding apparatus to transfer a downmix signal generated from downmixing multi-channel signals to the decoding apparatus and necessary for the decoding apparatus to generate multichannel signals by upmixing the downmix signal. The spatial information includes spatial parameters. The spatial parameters include CLD (channel level difference) indicating an energy difference between channels, ICC (inter-channel coherences) meaning a correlation between channels, CPC (channel prediction coefficients) used in generating three channels from two channels, etc. And, the 'extension signal' means additional information necessary to enable a signal to be reconstructed closer to an original signal in generating multi-channel signals by upmixing the downmix signal by the decoding apparatus. For instance, the additional information includes a residual signal, an artistic downmix residual signal, an artistic tree extension signal, etc. In this case, the residual signal indicates a signal corresponding to a difference between an original signal and an encoded signal. In the following description, it is assumed that the residual signal includes a general residual signal or an artistic downmix residual signal for compensation of an artistic downmix signal.
In the present invention, the downmix signal encoding unit 20 or the downmix signal decoding unit 70 means a codec that encodes or decodes an audio signal not included with an ancillary signal. In the present specification, a downmix audio signal is taken as an example of not included with the ancillary signal the audio signal. And, the downmix signal encoding unit 20 or the downmix signal decoding unit 70 is able to include MP3, AC-3, DTS, or AAC. If a codec function is performed on an audio signal, the downmix signal encoding unit 20 and the downmix signal decoding unit 70 can include a codec to be developed in the future as well as a previously developed codec. The multiplexing unit 50 can generate a bit stream by multiplexing a downmix signal, an ancillary signal, and an extension signal and then transfer the generated bit stream to the decoding apparatus. In this case, both of the downmix signal and the ancillary signal can be transferred in a bit stream format to the decoding apparatus. Alternatively, the ancillary signal and the downmix signal can be transferred in independent bit stream formats to the decoding apparatus, respectively. Details of the bit streams are explained in FIGs. 9 to 11. In case that it is unable to use previously transferred header information since an audio signal starts to be decoded from a random timing point instead of being decoded from the beginning like a bit stream for broadcasting, it is able to decode the audio signal using another header information inserted in the audio signal. In case of header information is lost in the course of transferring an audio signal, decoding should start from any timing point of receiving a signal. So, header information can be inserted in an audio signal at least once. If header information exists in a front part of an audio signal only once, it is unable to perform decoding due to the absence of the header information in case of receiving an audio signal at a random timing point. In this case, header information can be included according to a preset format (e.g., temporal interval, spatial interval, etc.). It is able to insert identification information indicating a presence or non-presence of header information in a bit stream. And, an audio signal is able to selectively include a header according to the identification information. For instance, an ancillary signal is able to selectively include a header according to the header identification information. Details of the bit stream structures are explained in FIGs. 9 to 12. The decoding apparatus includes a demultiplexing unit 60, a downmix signal decoding unit 70, an ancillary signal decoding unit 80, an extension signal decoding unit 90, and an upmixing unit 100.
The demultiplexing unit 60 receives a bit stream and then separates an encoded downmix signal, an encoded ancillary signal, and an encoded extension signal from the received bit stream. The downmix signal decoding unit 70 decodes the encoded downmix signal. And, the ancillary signal decoding unit 80 decodes the encoded ancillary signal .
Meanwhile, the extension signal can be included in the ancillary signal. It is necessary to efficiently decode the extension signal to efficiently generate multi-channel audio signals. So, the extension signal decoding unit 90 is able to selectively decode the encoded extension signal. In particular, the encoded extension signal can be decoded or the decoding of the encoded extension signal can be skipped. Occasionally, if the decoding of the extension signal is skipped, the encoded signal can be reconstructed to be closer to an original signal and coding efficiency can be raised.
For instance, if a level of the decoding apparatus is lower than that of a bit stream, the decoding apparatus is unable to decode the received extension signal. So, the decoding of the extension signal can be skipped. Even if the decoding of the extension signal is available because the level of the decoding apparatus is higher than that of the bit stream, the decoding of the extension signal is able to be skipped by another information obtained from the audio signal. In this case, for instance, the another information may include information indicating whether to execute the decoding of the extension signal. This is explained in detail with reference to FIG. 14 later. And for instance, in order to omit the decoding of the extension signal, length information of the extension signal is read from the bit stream and the decoding of the extension signal is able to be skipped using the length information. Alternatively, it is able to skip the decoding of the extension signal using sync information indicating a position of the extension signal. This is explained in detail with reference to FIG. 2 later.
The length information of the extension signal can be defined in various ways. For instance, fixed bits can be assigned, or variable bits can be assigned according to a predetermined length information type, or bits suitable for a length of a real extension signal can be adaptively assigned while the length of the extension signal is read. Details of the fixed bits assignment are explained in FIG.
3 and FIG. 4. Details of the variable bits assignment are explained in FIG. 5 and FIG. 6. And, details of the adaptive bits assignment are explained in FIG. 7 and FIG. 8.
The length information of the extension signal can be located within an ancillary data area. In this case, the ancillary data area indicates an area where additional information necessary to reconstruct a downmix signal into an original signal exists. For instance, a spatial information signal or an extension signal can be taken as an example of the ancillary data. So, the length information of the extension signal can be located within the ancillary signal or an extension area of the ancillary signal . In particular, the length information of the extension signal is located within a header extension area of the ancillary signal, a frame data extension area of the ancillary signal, or both of the header extension area and the frame data extension area of the ancillary signal. These are explained in detail with reference to FIGs. 9 to 11 later.
FIG. 2 is a schematic block diagram of an extension signal decoding unit 90 according to an embodiment of the present invention. Referring to FIG. 2, the extension signal decoding unit 90 includes an extension signal type information acquiring unit 91, an extension signal length reading unit 92, and a selective decoding unit 93. And, the selective decoding unit 93 includes a level deciding unit 94, an extension signal information acquiring unit 95, and an extension signal information skipping unit 96. The extension signal decoding unit 90 receives a bit stream for an extension signal from the demultiplexing unit 60 and then outputs a decoded extension signal. Occasionally, the extension signal decoding unit 90 may not output an extension signal or can output an extension signal by padding a bit stream for the extension signal with zeros completely. For the case of not outputting an extension signal, a method of skipping the decoding of the extension signal is usable. The extension signal type acquiring unit 91 acquires information indicating a type of an extension signal from a bit stream. For instance, the information indicating the type of the extension signal can include a residual signal, an artistic downmix residual signal, an artistic tree extension signal, or the like. In the present invention, the residual signal is a generic term of a general residual signal or an artistic downmix residual signal for compensation of an artistic downmix signal. The residual signal is usable for compensation of an artistic downmix signal in multi-channel audio signals or specific channel compensation in decoding. Optionally, the two cases are usable as well. If the type of the extension signal is decided by the extension signal type information, the extension signal length reading unit 92 reads a length of the extension signal decided by the type information of the extension signal. This can be achieved regardless of whether to perform the decoding of the extension signal. Once the length of the extension signal is read, the selective decoding unit 93 selectively performs decoding on the extension signal. This can be decided by the level deciding unit 94. In particular, the level deciding unit 94 selects whether to execute the decoding of the extension signal by comparing a level of a bit stream to a level of a decoding apparatus. For instance, if the level of the decoding apparatus is equal to or higher than that of the bit stream, the decoding apparatus acquires information for the extension signal via the extension signal information acquiring unit 95 and then decodes the information to output the extension signal. The outputted extension signal is transferred to an upmixing unit 100 to be used in reconstruct an original signal or generating an audio signal. Yet, if the level of the decoding apparatus is lower than that of the bit stream, it is able to skip the decoding of the extension signal via the extension signal information skipping unit 96. In this case, it is able to skip the decoding of the extension signal based on the length information read by the extension signal length reading unit 92. Thus, in case that the extension signal is used, the reconstruction can be achieved to get closer to the original signal to enhance a sound quality. If necessary, it is able to reduce a load of operation of the decoding apparatus by omitting the decoding of the extension signal.
As an example of the method of omitting the decoding of the extension signal in the extension signal information skipping unit 96, in case of using the length information of the extension signal, bit or byte length information of the extension signal can be inserted in data. And, the decoding can keep proceeding by skipping a bit field of the extension signal as many as a value obtained from the length information. Methods of defining the length information of the extension signal shall be explained with reference to FIGs. 3 to 8.
As another example of the method of omitting the decoding of the extension signal, it is able to skip the decoding of the extension signal based on sync information indicating a position of the extension signal. For instance, it is able to insert a sync word having predetermined bits in the point where the extension signal ends. The decoding apparatus keeps searching the bit field of the residual signal until finding a sync word of the extension signal. Once finding the sync word, the decoding apparatus stops the search process and then keeps performing the decoding. In particular, it is able to skip the decoding of the extension signal until the sync word of the extension signal is found. As another example of a decoding method according to the selection, in case of performing the decoding of the extension signal, it is able to perform the decoding after parsing the extension signal. When the decoding of the extension signal is performed, the sync word of the extension signal is read but may not be available .
FIG. 3 and FIG. 4 are diagrams to explain fixed bits assignment of length information for an extension signal according to an embodiment of the present invention. The length information of the extension signal can be defined by a bit or byte unit. If the length information is decided by the byte unit, this means that the extension signal is assigned bytes. FIG. 3 shows a method of defining length information for an extension signal in a simplest way. And, FIG. 4 shows the method shown in FIG. 3 schematically. A syntax element for indicating the length information of the extension signal is defined and predetermined bits are assigned to the syntax element. For instance, ΛbsResidualSignalLength' is defined as the syntax element and 16 bits are assigned as fixed bits. Yet, this method may consume a relatively considerable amount of bits. So, the methods shown in FIG. 5, FIG. 6, FIG. 7, and FIG. 8 are explained as follows.
FIG. 5 and FIG. 6 are diagrams to explain variable bits assignment of length information for an extension signal by depending on a length type according to an embodiment of the present invention.
FIG. 5 shows a method of defining one more syntax element for defining how many bits are used for λbsResidualSignalLength' to further reduce bit consumption. And, FIG. 6 schematically illustrates the method shown in FIG. 5. For instance, ΛbsResidualSignalLengthtype' is newly defined as a length type. If a value of the λbsResidualSignalLengthtype' is zero, four bits are assigned to the λbsResidualSignalLength' . If a value of the λbsResidualSignalLengthtype' is 1, eight bits are assigned to the λbsResidualSignalLength' . If a value of the λbsResidualSignalLengthtype' is 2, twelve bits are assigned to the ΛbsResidualSignalLength' . If a value of the λbsResidualSignalLengthtype' is 3, sixteen bits are assigned to the ΛbsResidualSignalLength' . In this case, the assigned bits are exemplary. So, bits different from the above-defined bits can be assigned. To reduce the bit consumption more than those of the above methods, the method shown in FIG. 7 and FIG. 8 is provided.
FIG. 7 and FIG. 8 are diagrams to explain adaptive bits assignment of length information for an extension signal by depending on a real length of the extension signal according to an embodiment of the present invention.
If an extension signal is inputted, a length information value of the extension signal can be read up to an initially determined value. If the length information value equals to a predetermined value, it is able to read additionally up to a further determined value. If the length information value equals to another predetermined value, it is able to read additionally up to another further determined value. In this case, if the length information value is not another predetermined value, the corresponding value is outputted as the length information value as it is. Thus, the length information of the extension signal is adaptively read according to a real data length, whereby the bit consumption can be maximally reduced. The example shown in FIG. 7 or FIG. 8 is explained.
In FIG. 7, a residual signal is taken as an example of the extension signal. If a residual signal is inputted, four bits of the residual signal length are read. If a length information value (bsResidualSignalLength) is 24-l (=15) , eight bits are further read as a value of bsResidualSignalLengthl. If the length information value
(bsResidualSignalLength) is (24-l) + (28-l) (=15+255), twelve bits are further read as a value of bsResidualSignalLength2.
In the same manner, if the length information value (bsResidualSignalLength) is (24-l ) + (28-l) + (212-1) (=15+255+4095), sixteen bits are further read as a value of bsResidualSignalLength3.
FIG.8 schematically illustrates another example of the adaptive bits assignment of length information for an extension signal.
In FIG. 8, if an extension signal is inputted, four bits are preferentially read. If a value resulting from reading length information is smaller than four bits, the corresponding value becomes the length information. Yet, if a value resulting from reading length information is greater than four bits, eight bits are further read in addition. If the additionally read value is smaller than eight bits, a total read length information value corresponds to 12 (=4+8) . Yet, if the additionally read value is greater than eight bits, sixteen bits are further read in addition again. This is explained in detail as follows. First of all, if length information is inputted, four bits are read. A real length information value ranges 0-14. If the length information value becomes 24-l (=15), the extension signal is further read in addition. In this case, the extension signal can be additionally read up to 28-2 (=254) . Yet, if the length information value corresponds to a value smaller than 24-l (=15) , a value of the read 0~(24-2) (=14) is outputted as it is. Once the length information value becomes (24-l) + (28-l) , the extension signal is further read in addition. In this case, the extension signal can be additionally read up to (2lδ-l). Yet, if the length information value corresponds to a value smaller than 216-1, a value of the read 0~(216-l) (=14) is outputted as it is. In this case, as mentioned in the foregoing description, the assigned bits are exemplary for explanation. So, another bits different from the above- defined bits can be assigned.
Meanwhile, the length information of the extension signal can be length information of the extension signal header or length information of the extension signal frame data. So, the length information of the extension signal can be located in a header area and/or a frame data area. Bit stream structures for this are explained with reference to FIGs. 9 to 12.
FIG. 9 and FIG. 10 show embodiments of the present invention, in which a bit stream structure configuring an audio signal with a downmix signal, an ancillary signal, and an extension signal is shown.
An audio signal includes a downmix signal and an ancillary signal. As an example of the ancillary signal, a spatial information signal can be taken. Each of the downmix signal and the ancillary signal is transferred by a frame unit. The ancillary signal can include header information and data information or can include data information only. Thus, in the file/general streaming structure configuring one audio signal, the header information precedes and is followed by the data information. For instance, in case of a file/general streaming structure configuring one audio signal with a downmix signal and an ancillary signal, a downmix signal header and an ancillary signal header can exist as the header information in a front part. And, downmix signal data and ancillary signal data can configure one frame as the data information behind the front part. In this case, by defining an extension area of the ancillary data, it is able to locate an extension signal. The extension signal can be included within the ancillary signal or can be used as an independent signal. FIG. 9 shows a case that the extension signal is used as the independent signal and FIG. 10 shows a case that the extension signal is located in the extension area within the ancillary signal. So, in case that there exists the extension signal, in the file/general streaming structure, an extension signal header can exist as header information in the front part as well as the downmix header and the spatial information header. Behind the front part, extension signal data can be further included as data information as well as the downmix signal data and the ancillary signal data to configure one frame. Since the extension signal can be selectively decoded, it can be located at a last part of the frame or can consecutively exist right behind the ancillary signal. The length information explained in FIGs. 3 to 8 can exist within the header area of the extension signal and/or the data area of the extension signal. In this case, the length information existing within the header area (extension signal header) indicates the length information of the extension signal header, and the length information existing within the data area (extension signal data) indicates the length information of the extension signal data. Thus, the length information existing each of the areas is read from a bit stream and the decoding apparatus is able to skip the decoding of the extension signal based on the length information.
FIG. 11 is a diagram of a bit stream structure configuring an independent audio signal with a downmix signal or an ancillary signal according to an embodiment of the present invention.
An audio signal includes a downmix signal and an ancillary signal. As an example of the ancillary signal, a spatial information signal can be taken. The downmix signal and the ancillary signal can be transferred as independent signals, respectively. In this case, the downmix signal has a structure that a downmix signal header (downmix signal
header©) as header information is located at a front part and that downmix signal datas (downmix signal data ® , © , © , ..., © ) as data information follow the downmix signal header. Likewise, the ancillary signal has a structure that an ancillary signal header (ancillary signal header ©) as header information is located at a front part and that
ancillary signal datas (ancillary signal data ©, ©, ..., ®) as data information follow the ancillary signal header. Since the extension signal can be included within the ancillary signal, a structure that the extension signal follows the ancillary signal data can be provided. So, an extension signal header © follows the ancillary signal header ® and the extension signal data © follows the ancillary signal data © . Likewise, the extension signal data © follows the ancillary signal data © . In this case, length information of the extension signal can be included
in each of the extension signal header ® , the extension signal data ©, and/or the extension signal data ©, ..., and ©.
Meanwhile, unlike the file/general streaming structure, in case that it is unable to use previously transferred header information since an audio signal is decoded from a random timing point instead of being decoded from the beginning, it is able to decode the audio signal using another header information included in the audio signal. In case of using an audio signal for broadcasting or the like or losing header information in the course of transferring an audio signal, decoding should start from any moment of receiving a signal. So, it is able to improve coding efficiency by defining identification information indicating whether the header exits. A streaming structure for broadcasting is explained with reference to FIG. 12 as follows .
FIG. 12 is a diagram of a broadcasting streaming structure configuring an audio signal with a downmix signal and an ancillary signal according to an embodiment of the present invention.
In case of a broadcast streaming, if header information exists in a front part of an audio signal once only, it is unable to execute decoding due to the absence of header information in case of receiving an audio signal at a random timing point. So, the header information can be inserted in the audio signal once at least. In this case, the header information can be included according to a preset format (e.g., temporal interval, spatial interval, etc.). In particular, the header information can be inserted in each frame, periodically inserted in each frame with a fixed interval, or non-periodically inserted in each frame with a random interval. Alternatively, the header information can be inserted once according to a fixed time interval (e.g., 2 seconds).
A broadcast streaming structure configuring one audio signal has a structure that at least once header information is inserted between data informations. For instance, in case of a broadcast streaming structure configuring one audio signal, a downmix signal comes first and an ancillary signal follows the downmix signal. Sync information for distinguishing between the downmix signal and the ancillary signal can be located at a front part of the ancillary signal. And, identification information indicating whether header information for the ancillary signal exists can be located. For instance, if header identification information is 0, a next read frame only has a data frame without header information. If the header identification information is 1, a next read frame has both header information and a data frame. This is applicable to the ancillary signal or the extension signal. These header informations may be the same of the header information having been initially transferred or can be variable. In case that the header information is variable, new header information is decoded and data information transferred after the new header information is then decoded according to the decoded new header information. In case that the header identification information is 0, a transferred frame only has a data frame without header information. In this case, to process the data frame, previously transferred header information can be used. For instance, if the header identification information is 1 in FIG. 12, an ancillary signal header © and an extension signal header © can exist. Yet, if a next incoming frame has no header information since the header identification information set to 0, it is able to use information of the extension signal header © previously transferred to process extension signal data ©.
FIG. 13 is a flowchart of a method of processing an extension signal based on length information of the extension signal in accordance with identification information indicating whether a header is included within an ancillary signal in case of using an audio signal for broadcasting or the like according to an embodiment of the present invention.
Referring to FIG. 13, an ancillary signal for an audio signal generation and an extension signal included in the ancillary signal are extracted from a received bit stream (1301). The extension signal can be included within the ancillary signal. Identification information indicating whether a header is included in the ancillary signal is extracted (1303). For instance, if the header identification information is 1, it indicates that an ancillary signal header is included in the ancillary signal. If the header identification information is 0, it indicates that an ancillary signal header is not included in the ancillary signal. In case that the extension signal is included in the ancillary signal, if the header identification information is 1, it indicates that an extension signal header is included in the extension signal. If the header identification information is 0, it indicates that an extension signal header is not included in the extension signal. It is decided that whether a header is included in the ancillary signal according to the header identification information (1305). If the header is included in the ancillary signal, length information is extracted from the header (1307) . And, it is able to skip decoding of the extension signal based on the length information (1309) . In this case, the header plays a role in enabling each ancillary signal and/or each extension signal to be interpreted. For instance, the header information can include information for a residual signal, length information for a residual signal, sync information indicating a location of a residual signal, a sampling frequency, a frame length, the number of a parameter band, tree information, quantization mode information, ICC (inter-channel correlation) , parameter smoothing information, gain information for a clipping-prevention, QMF (quadrature mirror filter) associated information, etc. Moreover, if the header is not included in the ancillary signal according to the header identification information, it is able to skip decoding of the extension signal based on the previously extracted length information for the header (1311) .
FIG. 14 is a flowchart of a method of decoding an extension signal selectively based on length information of the extension signal according to an embodiment of the present invention.
A profile means that technical elements for algorithm in a coding process are standardized. In particular, the profile is a set of technical elements necessary to decode a bit stream and corresponds to a sort of a sub-standard. A level defines a range of the technical elements, which are prescribed in the profile, to be supported. In particular, the level plays a role in defining capability of a decoding apparatus and complexity of a bit stream. In the present invention, level information can include definitions for the profile and level. A decoding method of an extension signal can selectively vary according to the level information of the bit stream and the level information of the decoding apparatus. For instance, even if the extension signal exists in a transferred audio signal, decoding of the extension signal may be or may not be executed as a result of deciding the level information. Moreover, although the decoding is executed, a predetermined low frequency part can be used only. Besides, it is able to skip the decoding of the extension signal as many as length information of the extension signal in order not to execute the decoding of the extension signal. Alternatively, although the extension signal is entirely read, the decoding cannot be executed. Furthermore, a portion of the extension signal is read, decoding can be performed on the read portion only, and the decoding cannot be performed on the rest of the extension signal. Alternatively, the extension signal is entirely read, a portion of the extension signal can be decoded, and the rest of the extension signal cannot be decoded.
For instance, referring to FIG. 14, an ancillary signal for generating an audio signal and an extension signal included in the ancillary signal can be extracted from a received bit stream (1410) . And, information for the extension signal can be extracted. In this case, the information for the extension signal may include extension data type information indicating a data type of the extension signal. For instance, the extension data type information includes residual coding data, artistic downmix residual coding data, artistic tree extension data, or the like. So, the type of the extension signal is decided and it is able to read length information of the extension signal from an extension area of the audio signal (1420) . Subsequently, a level of the bit stream is decided. This can be decided with reference to following information. For instance, if the type of the extension signal is the residual coding data, the level information for the bit stream can include the number of output channels, a sampling rate, a bandwidth of a residual signal, and the like. So, if the above-explained level informations of the bit stream are inputted, they are compared to level information for a decoding apparatus to decide whether the extension signal will be decoded (1430) . In this case, a level of the decoding apparatus can be previously set. In general, the level of the decoding apparatus should be equal to or greater than a level of the audio signal. This is because the decoding apparatus should be able to decode the transferred audio signal entirely. Yet, in case that limitation is put on the decoding apparatus (e.g., in case that the level of the decoding apparatus is smaller than that of the audio signal), decoding is occasionally possible. Yet, a corresponding quality may be degraded. For instance, if the level of the decoding apparatus is lower than that of the audio signal, the decoding apparatus may be unable to decode the audio signal. Yet, in some cases, the audio signal can be decoded based on the level of the decoding apparatus.
In case that the level of the decoding apparatus is decided lower than that of the bit stream, it is able to skip the decoding of the extension signal based on the length information of the extension signal (1440) . On the other hand, in case that the level of the decoding apparatus is equal to or higher than that of the bit stream, it is able to execute the decoding of the extension signal (1460). Yet, although the decoding of the extension signal is executed, the decoding can be performed on a predetermined low frequency portion of the extension signal only (1450) . For instance, there is a case that since the decoding apparatus is a low power decoder, if the extension signal is entirely decoded, efficiency is degraded, or since the decoding apparatus is unable to decode the entire extension signal a predetermined low frequency portion of the extension signal is usable. And, this is possible if the level of the bit stream or the level of the decoding apparatus meets a prescribed condition only.
INDUSTRIAL APPLICABILITY
Accordingly, various environments for encoding and decoding signals exist in general and there can exist various methods of processing signals according to the various environment conditions. In the present invention, a method of processing an audio signal is taken as an example, which does not restrict the scope of the present invention. In this case, the signals include audio signals and/or video signals. While the present invention has been described and illustrated herein with reference to the preferred embodiments thereof, it will be apparent to those skilled in the art that various modifications and variations can be made therein without departing from the spirit and scope of the invention. Thus, it is intended that the present invention covers the modifications and variations of this invention that come within the scope of the appended claims and their equivalents.

Claims

WHAT IS CLAIMED IS:
1. A method for processing an audio signal, comprising the steps of: extracting an ancillary signal for generating the audio signal and an extension signal included in the ancillary signal from a received bit stream; checking a level of the bit stream; selectively decoding the extension signal according to the level of the bit stream; and generating the audio signal using the ancillary signal .
2. The method of claim 1, wherein in the step of checking the level of the bit stream, a number of output channels of the audio signal, a sampling rate, and information for a bandwidth of the extension signal are used.
3. The method of claim 1, wherein in the decoding step, if the level of the bit stream is higher than a level of a decoder, the extension signal is selectively decoded according to the level of the decoder.
4. The method of one of claims 1 to 3, wherein the extension signal is a residual signal.
5. The method of claim 1, further comprising the step of reading length information of the extension signal, wherein decoding of the extension signal is skipped for the extension signal or a result of the decoding is not used, based on the length information.
6. The method of claim 5, wherein the length information of the extension signal is assigned adaptive bits according to a length of the extension signal.
7. The method of claim 1, wherein in the decoding step, a predetermined low frequency part of the extension signal is decoded according to a level of a decoder.
8. The method of claim 1, further comprising the step of acquiring sync information indicating a location of the extension signal, wherein decoding of the extension signal is skipped using the sync information.
9. An apparatus for processing an audio signal, comprising: a signal extracting unit extracting an ancillary signal for generating the audio signal and an extension signal included in the ancillary signal from a received bit stream; a level deciding unit checking a level of the bit stream; a selective decoding unit selectively decoding the extension signal according to the level of the bit stream; and an upmixing unit generating the audio signal using the ancillary signal.
PCT/KR2007/000865 2006-02-23 2007-02-16 Method and apparatus for processing an audio signal WO2007097549A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
ES07709014T ES2413807T3 (en) 2006-02-23 2007-02-16 Method and apparatus for processing an audio signal
EP07709014.0A EP1987594B1 (en) 2006-02-23 2007-02-16 Method and apparatus for processing an audio signal
CN200780001487.3A CN101361275B (en) 2006-02-23 2007-02-16 Method and apparatus for processing an audio signal
JP2008556238A JP5254808B2 (en) 2006-02-23 2007-02-16 Audio signal processing method and apparatus
US12/280,313 US7991494B2 (en) 2006-02-23 2007-02-16 Method and apparatus for processing an audio signal

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
US77577506P 2006-02-23 2006-02-23
US60/775,775 2006-02-23
US79190706P 2006-04-14 2006-04-14
US60/791,907 2006-04-14
US80382506P 2006-06-02 2006-06-02
US60/803,825 2006-06-02
KR10-2007-0013364 2007-02-08
KR1020070013364A KR20070087494A (en) 2006-02-23 2007-02-08 Method and apparatus for decoding multi-channel audio signal

Publications (1)

Publication Number Publication Date
WO2007097549A1 true WO2007097549A1 (en) 2007-08-30

Family

ID=39791275

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2007/000865 WO2007097549A1 (en) 2006-02-23 2007-02-16 Method and apparatus for processing an audio signal

Country Status (10)

Country Link
US (4) US7991495B2 (en)
EP (4) EP1987596B1 (en)
JP (4) JP5390197B2 (en)
KR (5) KR100904437B1 (en)
BR (1) BRPI0706488A2 (en)
CA (1) CA2636330C (en)
ES (4) ES2413807T3 (en)
HK (1) HK1127825A1 (en)
TW (5) TWI336599B (en)
WO (1) WO2007097549A1 (en)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102004043521A1 (en) * 2004-09-08 2006-03-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Device and method for generating a multi-channel signal or a parameter data set
WO2007046659A1 (en) * 2005-10-20 2007-04-26 Lg Electronics Inc. Method for encoding and decoding multi-channel audio signal and apparatus thereof
KR101438387B1 (en) * 2006-07-12 2014-09-05 삼성전자주식회사 Method and apparatus for encoding and decoding extension data for surround
US8571875B2 (en) 2006-10-18 2013-10-29 Samsung Electronics Co., Ltd. Method, medium, and apparatus encoding and/or decoding multichannel audio signals
DE102007007830A1 (en) * 2007-02-16 2008-08-21 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for generating a data stream and apparatus and method for reading a data stream
WO2010005050A1 (en) * 2008-07-11 2010-01-14 日本電気株式会社 Signal analyzing device, signal control device, and method and program therefor
CA2836871C (en) 2008-07-11 2017-07-18 Stefan Bayer Time warp activation signal provider, audio signal encoder, method for providing a time warp activation signal, method for encoding an audio signal and computer programs
KR101428487B1 (en) * 2008-07-11 2014-08-08 삼성전자주식회사 Method and apparatus for encoding and decoding multi-channel
MY154452A (en) 2008-07-11 2015-06-15 Fraunhofer Ges Forschung An apparatus and a method for decoding an encoded audio signal
JP5608660B2 (en) * 2008-10-10 2014-10-15 テレフオンアクチーボラゲット エル エム エリクソン（パブル） Energy-conserving multi-channel audio coding
KR20110018107A (en) * 2009-08-17 2011-02-23 삼성전자주식회사 Residual signal encoding and decoding method and apparatus
CN102696070B (en) * 2010-01-06 2015-05-20 Lg电子株式会社 An apparatus for processing an audio signal and method thereof
CA3097372C (en) 2010-04-09 2021-11-30 Dolby International Ab Mdct-based complex prediction stereo coding
WO2012000882A1 (en) 2010-07-02 2012-01-05 Dolby International Ab Selective bass post filter
KR101742136B1 (en) 2011-03-18 2017-05-31 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. Frame element positioning in frames of a bitstream representing audio content
CA2870452C (en) 2011-04-15 2020-03-10 Dominion Energy Technologies, Inc. System and method for single and multi zonal optimization of utility services delivery and utilization
CA2874132A1 (en) 2011-06-09 2013-01-17 Dominion Energy Technologies, Inc. System and method for grid based cyber security
US9380545B2 (en) 2011-08-03 2016-06-28 Astrolink International Llc System and methods for synchronizing edge devices on channels without carrier sense
TWI505262B (en) 2012-05-15 2015-10-21 Dolby Int Ab Efficient encoding and decoding of multi-channel audio signal with multiple substreams
KR102071860B1 (en) 2013-01-21 2020-01-31 돌비 레버러토리즈 라이쎈싱 코오포레이션 Optimizing loudness and dynamic range across different playback devices
TR201802631T4 (en) 2013-01-21 2018-03-21 Dolby Laboratories Licensing Corp Program Audio Encoder and Decoder with Volume and Limit Metadata
US10097240B2 (en) 2013-02-19 2018-10-09 Astrolink International, Llc System and method for inferring schematic and topological properties of an electrical distribution grid
US9438312B2 (en) * 2013-06-06 2016-09-06 Astrolink International Llc System and method for inferring schematic relationships between load points and service transformers
CA2915066A1 (en) 2013-06-13 2014-12-18 Astrolink International Llc Non-technical losses in a power distribution grid
JP2016521962A (en) 2013-06-13 2016-07-25 アストロリンク インターナショナル エルエルシー Estimate the feed lines and phases that power the transmitter
BR112017009037A2 (en) 2014-10-30 2018-07-03 Astrolink International Llc system, method and apparatus for network location
CA2964365A1 (en) 2014-10-30 2016-05-06 Jerritt Harold HANSELL System and methods for assigning slots and resolving slot conflicts in an electrical distribution grid
WO2016171002A1 (en) * 2015-04-24 2016-10-27 ソニー株式会社 Transmission device, transmission method, reception device, and reception method
CN106023999B (en) * 2016-07-11 2019-06-11 武汉大学 For improving the decoding method and system of three-dimensional audio spatial parameter compression ratio
US20180144757A1 (en) * 2016-11-23 2018-05-24 Electronics And Telecommunications Research Institute Method and apparatus for generating bitstream for acoustic data transmission
JP2018092012A (en) * 2016-12-05 2018-06-14 ソニー株式会社 Information processing device, information processing method, and program

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5166685A (en) * 1990-09-04 1992-11-24 Motorola, Inc. Automatic selection of external multiplexer channels by an A/D converter integrated circuit
JPH08202397A (en) * 1995-01-30 1996-08-09 Olympus Optical Co Ltd Voice decoding device
US5703584A (en) * 1994-08-22 1997-12-30 Adaptec, Inc. Analog data acquisition system
EP1315148A1 (en) 2001-11-17 2003-05-28 Deutsche Thomson-Brandt Gmbh Determination of the presence of ancillary data in an audio bitstream
EP1617413A2 (en) 2004-07-14 2006-01-18 Samsung Electronics Co, Ltd Multichannel audio data encoding/decoding method and apparatus

Family Cites Families (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3323730A1 (en) 1983-07-01 1985-01-10 Hoechst Ag, 6230 Frankfurt LIQUID MAGNESIUM-BASED FORMULATIONS
JP2811175B2 (en) * 1986-01-27 1998-10-15 富士写真フイルム株式会社 Orthogonal transform coding method for image data
JPH03245197A (en) * 1990-02-23 1991-10-31 Toshiba Corp Voice coding system
US5632005A (en) * 1991-01-08 1997-05-20 Ray Milton Dolby Encoder/decoder for multidimensional sound fields
DE4217276C1 (en) 1992-05-25 1993-04-08 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung Ev, 8000 Muenchen, De
DE4236989C2 (en) 1992-11-02 1994-11-17 Fraunhofer Ges Forschung Method for transmitting and / or storing digital signals of multiple channels
DE69428939T2 (en) * 1993-06-22 2002-04-04 Deutsche Thomson-Brandt Gmbh Method for maintaining a multi-channel decoding matrix
EP0637191B1 (en) * 1993-07-30 2003-10-22 Victor Company Of Japan, Ltd. Surround signal processing apparatus
DK0912076T3 (en) * 1994-02-25 2002-01-28 Henrik Moller Binaural synthesis, head-related transfer functions and their applications
RU2158970C2 (en) 1994-03-01 2000-11-10 Сони Корпорейшн Method for digital signal encoding and device which implements said method, carrier for digital signal recording, method for digital signal decoding and device which implements said method
JP3129143B2 (en) * 1994-05-31 2001-01-29 松下電器産業株式会社 Data transfer method
JP3397001B2 (en) 1994-06-13 2003-04-14 ソニー株式会社 Encoding method and apparatus, decoding apparatus, and recording medium
JPH08123494A (en) 1994-10-28 1996-05-17 Mitsubishi Electric Corp Speech encoding device, speech decoding device, speech encoding and decoding method, and phase amplitude characteristic derivation device usable for same
JP3088319B2 (en) 1996-02-07 2000-09-18 松下電器産業株式会社 Decoding device and decoding method
JPH09246989A (en) * 1996-03-08 1997-09-19 Canon Inc Decoder and method therefor
JPH10304360A (en) * 1996-10-15 1998-11-13 Matsushita Electric Ind Co Ltd Method for encoding video/voice, device therefor and medium for recording coded program
JPH10124099A (en) * 1996-10-15 1998-05-15 Olympus Optical Co Ltd Speech recording device
JPH10233692A (en) * 1997-01-16 1998-09-02 Sony Corp Audio signal coder, coding method, audio signal decoder and decoding method
US6711266B1 (en) 1997-02-07 2004-03-23 Bose Corporation Surround sound channel encoding and decoding
US6356639B1 (en) * 1997-04-11 2002-03-12 Matsushita Electric Industrial Co., Ltd. Audio decoding apparatus, signal processing device, sound image localization device, sound image control method, audio signal processing device, and audio signal high-rate reproduction method used for audio visual equipment
JPH10294668A (en) * 1997-04-22 1998-11-04 Matsushita Electric Ind Co Ltd Method, device for decoding audio encoded data and record medium
US6307941B1 (en) 1997-07-15 2001-10-23 Desper Products, Inc. System and method for localization of virtual sound
CA2325482C (en) 1998-03-25 2009-12-15 Lake Technology Limited Audio signal processing method and apparatus
US6574339B1 (en) 1998-10-20 2003-06-03 Samsung Electronics Co., Ltd. Three-dimensional sound reproducing apparatus for multiple listeners and method thereof
JP3346556B2 (en) 1998-11-16 2002-11-18 日本ビクター株式会社 Audio encoding method and audio decoding method
JP2000200096A (en) * 1999-01-07 2000-07-18 Kobe Steel Ltd Digital information reproducing device
KR100416757B1 (en) 1999-06-10 2004-01-31 삼성전자주식회사 Multi-channel audio reproduction apparatus and method for loud-speaker reproduction
KR20010009258A (en) 1999-07-08 2001-02-05 허진호 Virtual multi-channel recoding system
US6829012B2 (en) * 1999-12-23 2004-12-07 Dfr2000, Inc. Method and apparatus for a digital parallel processor for film conversion
JP2001292446A (en) * 2000-04-05 2001-10-19 Nec Corp Video and audio coding method
US6973130B1 (en) 2000-04-25 2005-12-06 Wee Susie J Compressed video signal including information for independently coded regions
WO2004019656A2 (en) 2001-02-07 2004-03-04 Dolby Laboratories Licensing Corporation Audio channel spatial translation
JP2002262287A (en) * 2001-03-05 2002-09-13 Canon Inc Information processing method and information processor and storage medium therefor
JP3566220B2 (en) 2001-03-09 2004-09-15 三菱電機株式会社 Speech coding apparatus, speech coding method, speech decoding apparatus, and speech decoding method
JP2002297496A (en) * 2001-04-02 2002-10-11 Hitachi Ltd Media delivery system and multimedia conversion server
US7292901B2 (en) * 2002-06-24 2007-11-06 Agere Systems Inc. Hybrid multi-channel/cue coding/decoding of audio signals
US7583805B2 (en) 2004-02-12 2009-09-01 Agere Systems Inc. Late reverberation-based synthesis of auditory scenes
JP3747806B2 (en) 2001-06-11 2006-02-22 ソニー株式会社 Data processing apparatus and data processing method
SE0202159D0 (en) 2001-07-10 2002-07-09 Coding Technologies Sweden Ab Efficientand scalable parametric stereo coding for low bitrate applications
MXPA03005133A (en) * 2001-11-14 2004-04-02 Matsushita Electric Ind Co Ltd Audio coding and decoding.
DE60323331D1 (en) 2002-01-30 2008-10-16 Matsushita Electric Ind Co Ltd METHOD AND DEVICE FOR AUDIO ENCODING AND DECODING
EP1480922A1 (en) 2002-02-25 2004-12-01 Foundation for Development Aid ACP-EEC ASBL Fibrous non-woven material, non-woven body and non-woven composite body, method for producing a fibrous non-woven material, and use of the same
EP1341160A1 (en) 2002-03-01 2003-09-03 Deutsche Thomson-Brandt Gmbh Method and apparatus for encoding and for decoding a digital information signal
JP3751001B2 (en) 2002-03-06 2006-03-01 株式会社東芝 Audio signal reproducing method and reproducing apparatus
DE60326782D1 (en) 2002-04-22 2009-04-30 Koninkl Philips Electronics Nv Decoding device with decorrelation unit
ES2268340T3 (en) 2002-04-22 2007-03-16 Koninklijke Philips Electronics N.V. REPRESENTATION OF PARAMETRIC AUDIO OF MULTIPLE CHANNELS.
JP4404180B2 (en) * 2002-04-25 2010-01-27 ソニー株式会社 Data distribution system, data processing apparatus, data processing method, and computer program
JP4296752B2 (en) 2002-05-07 2009-07-15 ソニー株式会社 Encoding method and apparatus, decoding method and apparatus, and program
JP2004023481A (en) 2002-06-17 2004-01-22 Alpine Electronics Inc Acoustic signal processing apparatus and method therefor, and audio system
AU2003244932A1 (en) 2002-07-12 2004-02-02 Koninklijke Philips Electronics N.V. Audio coding
DE60327039D1 (en) 2002-07-19 2009-05-20 Nec Corp AUDIO DEODICATION DEVICE, DECODING METHOD AND PROGRAM
JP2004064363A (en) 2002-07-29 2004-02-26 Sony Corp Digital audio processing method, digital audio processing apparatus, and digital audio recording medium
US7536305B2 (en) 2002-09-04 2009-05-19 Microsoft Corporation Mixed lossless audio compression
US20060100861A1 (en) 2002-10-14 2006-05-11 Koninkijkle Phillips Electronics N.V Signal filtering
US8437868B2 (en) 2002-10-14 2013-05-07 Thomson Licensing Method for coding and decoding the wideness of a sound source in an audio scene
WO2004036955A1 (en) 2002-10-15 2004-04-29 Electronics And Telecommunications Research Institute Method for generating and consuming 3d audio scene with extended spatiality of sound source
WO2004036954A1 (en) 2002-10-15 2004-04-29 Electronics And Telecommunications Research Institute Apparatus and method for adapting audio signal according to user's preference
WO2004080125A1 (en) 2003-03-04 2004-09-16 Nokia Corporation Support of a multichannel audio extension
KR100917464B1 (en) 2003-03-07 2009-09-14 삼성전자주식회사 Method and apparatus for encoding/decoding digital data using bandwidth extension technology
TWI236232B (en) 2004-07-28 2005-07-11 Via Tech Inc Method and apparatus for bit stream decoding in MP3 decoder
US7447317B2 (en) 2003-10-02 2008-11-04 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V Compatible multi-channel coding/decoding by weighting the downmix channel
KR100571824B1 (en) * 2003-11-26 2006-04-17 삼성전자주식회사 Method for encoding/decoding of embedding the ancillary data in MPEG-4 BSAC audio bitstream and apparatus using thereof
US7394903B2 (en) * 2004-01-20 2008-07-01 Fraunhofer-Gesellschaft Zur Forderung Der Angewandten Forschung E.V. Apparatus and method for constructing a multi-channel output signal or for generating a downmix signal
CA2553708C (en) * 2004-02-06 2014-04-08 Sony Corporation Information processing device, information processing method, program, and data structure
US7805313B2 (en) 2004-03-04 2010-09-28 Agere Systems Inc. Frequency-based coding of channels in parametric multi-channel coding systems
JP5032977B2 (en) * 2004-04-05 2012-09-26 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Multi-channel encoder
JP4614732B2 (en) 2004-10-22 2011-01-19 パナソニック株式会社 Decoding device
SE0402650D0 (en) 2004-11-02 2004-11-02 Coding Tech Ab Improved parametric stereo compatible coding or spatial audio
US7787631B2 (en) 2004-11-30 2010-08-31 Agere Systems Inc. Parametric coding of spatial audio with cues based on transmitted channels
US7903824B2 (en) * 2005-01-10 2011-03-08 Agere Systems Inc. Compact side information for parametric coding of spatial audio
US7573912B2 (en) * 2005-02-22 2009-08-11 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschunng E.V. Near-transparent or transparent multi-channel encoder/decoder scheme
JP5228305B2 (en) 2006-09-08 2013-07-03 ソニー株式会社 Display device and display method
FR2913132B1 (en) 2007-02-22 2010-05-21 Somfy Sas RADIO CONTROL DEVICE, ELECTRIC ACTUATOR AND DOMOTIC INSTALLATION COMPRISING SUCH A DEVICE

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5166685A (en) * 1990-09-04 1992-11-24 Motorola, Inc. Automatic selection of external multiplexer channels by an A/D converter integrated circuit
US5703584A (en) * 1994-08-22 1997-12-30 Adaptec, Inc. Analog data acquisition system
JPH08202397A (en) * 1995-01-30 1996-08-09 Olympus Optical Co Ltd Voice decoding device
EP1315148A1 (en) 2001-11-17 2003-05-28 Deutsche Thomson-Brandt Gmbh Determination of the presence of ancillary data in an audio bitstream
EP1617413A2 (en) 2004-07-14 2006-01-18 Samsung Electronics Co, Ltd Multichannel audio data encoding/decoding method and apparatus

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
HERRE J, THE REFERENCE MODEL ARCHITECTURE FOR MPEG SPATIAL AUDIO CODING
SCHRODER E F ET AL.: "Der MPEG-2-Standard: Generische Codierung fur Bewegtbilder und zugehorige Audio-Information. Audio-Codierung (Teil 4", FERNSEH- UND KINO-TECHNIK, vol. 48, no. 7-8, 30 August 1994 (1994-08-30), pages 30
See also references of EP1987594A4 *

Also Published As

Publication number Publication date
EP1987595A4 (en) 2010-03-03
JP5394753B2 (en) 2014-01-22
KR20080059156A (en) 2008-06-26
US7974287B2 (en) 2011-07-05
ES2391117T3 (en) 2012-11-21
EP1987594B1 (en) 2013-05-08
KR100904436B1 (en) 2009-06-24
EP1987597A4 (en) 2010-03-17
ES2407820T3 (en) 2013-06-14
JP2009527792A (en) 2009-07-30
TWI333795B (en) 2010-11-21
KR100904437B1 (en) 2009-06-24
EP1987596A1 (en) 2008-11-05
EP1987597A1 (en) 2008-11-05
KR20080095894A (en) 2008-10-29
US7991495B2 (en) 2011-08-02
JP5390197B2 (en) 2014-01-15
TW200738039A (en) 2007-10-01
BRPI0706488A2 (en) 2011-03-29
US20100135299A1 (en) 2010-06-03
ES2391116T3 (en) 2012-11-21
TWI447707B (en) 2014-08-01
EP1987594A1 (en) 2008-11-05
KR20080055816A (en) 2008-06-19
TWI336599B (en) 2011-01-21
EP1987594A4 (en) 2010-03-31
EP1987596B1 (en) 2012-08-22
JP5254808B2 (en) 2013-08-07
CA2636330C (en) 2012-05-29
TW200738040A (en) 2007-10-01
HK1127825A1 (en) 2009-10-09
EP1987597B1 (en) 2013-04-10
KR20080053296A (en) 2008-06-12
EP1987596A4 (en) 2010-03-10
JP2009527791A (en) 2009-07-30
JP5394754B2 (en) 2014-01-22
KR100904438B1 (en) 2009-06-24
US20090240504A1 (en) 2009-09-24
EP1987595B1 (en) 2012-08-15
TWI337341B (en) 2011-02-11
US20100046758A1 (en) 2010-02-25
KR100904439B1 (en) 2009-06-26
JP2009527789A (en) 2009-07-30
TW200737125A (en) 2007-10-01
ES2413807T3 (en) 2013-07-17
KR101276849B1 (en) 2013-06-18
EP1987595A1 (en) 2008-11-05
CA2636330A1 (en) 2007-08-30
TW201013638A (en) 2010-04-01
TW200741650A (en) 2007-11-01
US7881817B2 (en) 2011-02-01
US7991494B2 (en) 2011-08-02
US20100046759A1 (en) 2010-02-25
JP2009527790A (en) 2009-07-30
TWI333644B (en) 2010-11-21
KR20080055817A (en) 2008-06-19

Similar Documents

Publication Publication Date Title
CA2636330C (en) Method and apparatus for processing an audio signal
US20090164227A1 (en) Apparatus for Processing Media Signal and Method Thereof
WO2010047566A2 (en) An apparatus for processing an audio signal and method thereof
AU2007218453B2 (en) Method and apparatus for processing an audio signal
CN101361276B (en) Method and apparatus for processing an audio signal
RU2404507C2 (en) Audio signal processing method and device

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200780001487.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2007709014

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2008556238

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 12280313

Country of ref document: US