CA2326495C - Technique for parametric coding of a signal containing information - Google Patents

Technique for parametric coding of a signal containing information Download PDF

Info

Publication number
CA2326495C
CA2326495C CA002326495A CA2326495A CA2326495C CA 2326495 C CA2326495 C CA 2326495C CA 002326495 A CA002326495 A CA 002326495A CA 2326495 A CA2326495 A CA 2326495A CA 2326495 C CA2326495 C CA 2326495C
Authority
CA
Canada
Prior art keywords
signal
component
representation
information
coefficients
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CA002326495A
Other languages
French (fr)
Other versions
CA2326495A1 (en
Inventor
Deepen Sinha
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia of America Corp
Original Assignee
Lucent Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lucent Technologies Inc filed Critical Lucent Technologies Inc
Publication of CA2326495A1 publication Critical patent/CA2326495A1/en
Application granted granted Critical
Publication of CA2326495C publication Critical patent/CA2326495C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S1/00Two-channel systems
    • H04S1/007Two-channel systems in which the audio signals are in digital form
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2420/00Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/03Application of parametric coding in stereophonic audio systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Mathematical Physics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Stereophonic System (AREA)

Abstract

In a communications system, parametric coding in accordance with the invention is implemented to generate a representation of a stereo audio signal, which is composed of a left channel signal (L) and a right channel signal (R). To efficiently utilize transmission bandwidth, such a representation contains (1) information concerning only one of the L and R signals, and (2) parametric information based on which, together with (1), the other signal can be recovered. Because of the design of the parametric coding, the representation advantageously captures localization cues of the stereo audio signal, including intensity and phase characteristics of L and R. As a result, tie stereo audio signal recovered from the transmitted representation affords a high stereo quality.

Description

i TECHNIQUE FOR PARAMETRIC CODING OF A SIGNAL
CONTAINING INFORMATION
Field Of The Invention The invention relates to systems and methods for communications of a signal containing information, and more particularly to systems and methods for coding a signal containing, e.g., stereo audio information, to efficiently utilize limited transmission bandwidth.
Background Of The Invention to Communications of stereo audio information play an important role in multimedia applications, and Internet applications such as a music-on-demand service, music preview for online compact disk (CD) purchases, etc. To efficiently utilize bandwidth to communicate audio 25 information in general, a perceptual audio coding (PAC) technique has been developed. For details on the PAC
technique, one may refer to U.S. Patent No. 5,285,498 issued February 8, 1994 to Johnston; and U.S. Patent No. 5,040,217 issued August 13, 1991 to Brandenburg et al. In accordance 20 with such a PAC technique, each of a succession of time domain blocks of an audio signal representing audio information is coded in the frequency domain. Specifically, the frequency domain representation of each block is divided into coder bands, each of which is individually coded, based 25 on psycho-acoustic criteria, in such a way that the audio information is significantly compressed, thereby requiring a smaller number of bits to represent the audio information than would be the case if the audio information were represented in a more simplistic digital format, such as the 30 PCM format.
In prior art, a stereo audio signal including a left channel signal (L) and a right channel signal (R) may be Sinha 16 2 further encoded to realize additional savings in transmission bandwidth. For example, a stereo audio signal may be further encoded in accordance with a well known adaptive mean-side (M-S) formation scheme, where M = (L +
s R)/2 and S = (L - R)/2. Such a prior art scheme takes advantage of the correlation between L and R, involves selectively turning on or off the M and S formation in each time domain block of the stereo audio signal for each coderband, and yet ensures meeting certain biaural masking to constraints. It should be noted that in the adaptive M-S
formation scheme, M provides a monophonic effect of the stereo signal while S adds thereto a stereo separation based on the difference between L and R. As such, the more separate L and R, the more bits are required to represent 15 S. However, in a narrow band transmission, e.g., via a 28.8 kb/sec Internet connection, which is common, an M-S
encoded stereo audio signal is undesirably susceptible to aliasing distortion attributed to the limited transmission bandwidth. Alternatively, by sacrificing the S information 2o in favor of the M information in the narrow band transmission, mode distortion is introduced to the received signal, thereby significantly degrading its stereo quality.
Another prior art technique for further encoding a stereo audio signal to save transmission bandwidth is known 25 as the intensity stereo coding. For details on such a coding technique, one may refer to: J. Herre et al., "Combined Stereo Coding," 93rd Convention, Audio Engineering Society, October 1-4, 1992. The intensity stereo coding was developed based on the recognition that 3o the ability of a human auditory system to resolve the exact locations of audio sources of L and R decreases towards high frequencies. Typically, it is used to encode the intensity or magnitude of high frequency components of only one of L and R. However, the resulting encoded information 35 facilitates recovery of the high frequency components of both L and R.

I

Summary Of The Invention In accordance with the invention, the representation of a composite signal (e.g., a stereo audio signal) for transmission, which includes a first signal and a second signal (e. g., L and R), contains first information derived from at least the first signal, and second information concerning one or more coefficients resulting from parametric coding of the second signal. The first signal may be recovered based on the first information, and the to second signal may be recovered based on the first information and the second information.
Advantageously, because of the coefficients used in the representation of the composite signal in accordance with the inventive parametric coding, the transmission bandwidth is efficiently utilized for communicating the composite signal. In addition, due to the design of the parametric coding, such coefficients describe not only an intensity relation between the first signal and the second signal, but also phase relations therebetween. As a result, the signal quality afforded by the inventive parametric coding is superior to that afforded, e.g., by the intensity stereo coding described above.
In accordance with one aspect of the present invention there is provided an apparatus for processing a signal which includes a first component and a second component thereof, the apparatus comprising: a processor for deriving one or more coefficients describing at least a phase relation between the first component and the second component; and a controller for generating a representation of the signal, 3o the representation containing first information derived from at least the first component, and second information i 3a concerning at least the one or more coefficients, a value of the second component being predictable based on the first information and the second information.
In accordance with another aspect of the present invention there is provided a method for processing a signal which includes a first component and a second component thereof, the method comprising: deriving one or more coefficients describing at least a phase relation between the first component and the second component; and generating 1o a representation of the signal, the representation containing first information derived from at least the first component, and second information concerning at least the one or more coefficients, a value of the second component being predictable based on the first information and the second information.
Brief Description Of The Drawings Fig. 1 illustrates an arrangement embodying the principles of the invention for communicating audio information through a communication network;
2o Fig. 2 is a block diagram of a server in the arrangement of Fig. l;
Fig. 3 illustrates a sequence of packets generated by the server of Fig. 2, which contain the audio information;
and Sinha 16 4 Fig. 4 is a flow chart depicting the steps whereby a client terminal in the arrangement of Fig. 1 processes the packets from the server.
Detailed Description Fig. 1 illustrates arrangement 100 embodying the principles of the invention for communicating information, e.g., stereo audio information. In this illustrative embodiment, server 105 in arrangement 100 provides a music-on-demand service to client terminals through Internet 120.
to One such client terminal is numerically denoted 130 which may be a personal computer (PC). As is well known, Internet 120 is a packet switched network for transporting information in packets in accordance with the standard transmission control protocol/Internet protocol (TCP/IP).
Conventional software including browser software, e.g., the NETSCAPE NAVIGATOR or MICROSOFT EXPLORER browser is installed in client terminal 130 for communicating information with server 105, which is identified by a predetermined uniform resource locator (URL) on Internet 120. For example, to request the music-on-demand service provided by server 105, a modem (not shown) in client terminal 130 is used to establish communication connection 125 with Internet 120. In this instance, connection 125 affords a 28.8 kb/sec communication rate, which is common.
After connection 125 is established, in a conventional manner, client terminal 130 is assigned an IP address for its identification. The user at client terminal 130 may then access the music-on-demand service at the predetermined URL identifying server 105, and request a 3o selected musical piece from the service. Such a request includes the IP address identifying client terminal 130, and information concerning the selected musical piece and communication rate of terminal 130, i.e., 28.8 kb/s in this instance, which affords narrow bandwidth for communication 3s of the musical piece.

Sinha 16 5 In prior art, when a stereo audio signal representing, e.g., a musical piece, is transmitted through a narrow band, which is the case here, the quality of the received signal is invariably degraded significantly due to the limited transmission bandwidth. In accordance with the invention, parametric coding is devised to compress stereo audio information to efficiently utilize the transmission bandwidth, albeit limited, to reduce the degradation of the received signal. In order to fully appreciate the 1o parametric coding described below, characterization of a stereo audio signal, which includes a left channel signal L
and a right channel signal R, will now be described.
A stereo audio signal can be characterized using localization cues, which define the location or tilt of the z5 underlying stereo sounds in an auditory space. Of course, some sounds may not be localized, which are perceived as diffuse across a left-to-right span. In any event, the localization cues include (a) low frequency phase cues, (b) intensity cues, and (c) group delay or envelope cues. The 20 low frequency phase cues may be derived from the relative phase of L and R at low frequencies of the signals.
Specifically, the phase relationship between their frequency components below 1200 Hz was found to be of particular importance. The intensity cues may be derived 25 from the relative power of L and R at high frequencies of the signals, e.g., above 1.200 Hz. The envelope cues may be derived from the relative phase of L and R signal envelopes, and may be determined based on the group delay between the two signals. It should be noted that cues (b) so and (c) may be collectively referred to as the "phase cues."
The inventive parametric coding technique is designed to well capture the localization cues of a stereo audio signal for transmission, despite limited available 35 transmission bandwidth. In accordance with the invention, Sinha 16 6 a representation of the stereo audio signal contains (i) information concerning only one of L and R, e.g., L here, and (ii) parametric information concerning the other signal, e.g., R, resulting from parametric coding of R with respect to L. Such a stereo audio signal representation is hereinafter referred to as the "ST representation." In addition, such parametric information concerning R is hereinafter referred to as "param-R." As fully described below, param-R is obtained by quantizing a set of 1o parameters describing the aforementioned localization cues of the stereo audio signal. As a result, R can be predicted based on the param-R and L information, i.e., (i) and (ii). Thus, the stereo audio signal recovered based on the ST representation includes L and a prediction of R, i5 affording an acceptable stereo audio quality, where L is derived from the L information in the ST representation, and the prediction of R is derived from both the param-R
and L information therein.
Param-R in the ST representation is obtained based on 2o the following relation:
Rf =aLf, (1) where Rt represents the frequency spectrum of R, Lt represents the frequency spectrum of L, and a represents a predictor coefficient from which param-R is derived. To 25 improve the prediction of Rf based on Lf in (1), multiple predictor coefficients across the frequency range may be used, and hence:
Rf =a'Lf , (2) where i represents an index for an irh prediction frequency 3o band in the frequency range. For example, where a perceptual audio coding (PAC) technique is applied to an audio signal, which is the case here and described below, Sinha 16 each irh prediction frequency band may coincide with a different one of the coder bands which approximate the well known critical bands of the human auditory system, in accordance with the PAC technique.
Referring to expression (2), the success of predicting Rlf depends on how well the predictor coefficients, al, can describe the above-identified localization cues of the stereo audio signal. An enhanced prediction scheme for well describing the intensity cues, and phase cues, i.e., 1o the low-frequency phase cues and envelope cues, will now be described. This scheme relies on imposing some constraints on L and R so that the intensity and phase cue information thereof is available in a single domain to perform the prediction. It is well known in the signal processing theory that if a real signal satisfies a "causality constraint," the real part of the signal spectrum provides a sufficient representation thereof as the imaginary part of the spectrum may be recovered based on the real part without any additional information. Thus, the enhanced 2o prediction scheme in question may be mathematically expressed as follows:
__ R freal-causal a L freal-causal ~ ) Based on expression (3), the aforementioned parametric coding is achieved by computing the predictor coefficients a' from the real parts of Llf and R-~ after the causality constraints are respectively imposed onto L and R in the time domain, and param-R comprises information concerning a1 for each irh prediction frequency band.
It should be pointed out at this juncture that in 3o practice,. the imposition of a causality constraint on L (or R) in the time domain is readily accomplished by zero padding the samples representing L (or R). Thus, in a well , f real-causal ( is reallZed b known manner L1 Or R1f rea':-causal) y appending "zeros" to a block of N samples representing L to Sinha 16 8 lengthen the block to (2N-1) samples long, followed by a frequency transform of the zero-padded block and extraction of the real part of the resulting transform, where N is a predetermined number.
For an even more enhanced prediction, a mufti-tap predictor may be utilized whereby a,l represents a set of predictor coefficients for an it'' prediction frequency band. For example, where a 2-tap predictor is used, a,' -faro all which may be expressed as follows:
1o r=a~~+a~P' , (4) where r represents the set of real parts of the frequency components in R't ~E31-~a~~53~ in the it'' prediction band, F
represents the set of real parts of the frequency components in Llt 131-~.-~"S.m in the irr' prediction band, ~' ' represents the set of real parts of the frequency components in Llt r=m-~3"~~~ in the ( i-1 ) r'' prediction band.
As such, the predictor coefficients alo and all may be determined by solving the following equation:
ATP QTV_' ao P.Tr ~T ~i ~iT ~, ai ~iT r 2o where the superscript "T" denotes a standard matrix transposition operation. Thus, r a° =G-'H , (6) as where G - ~T ~ ~T ~~
~T ~i LiT y r Sinha 16 9 ~Tr H= ;
P~T r and the superscript "-1" denotes a standard matrix inverse operation.
In this illustrative embodiment, param-R in the ST
representation comprises information concerning predictor coefficients alo and a,11 describing the localization cues, i.e., the low frequency phase cues, intensity cues and envelope cues, of the underlying stereo audio signal. As mentioned before, param-R together with the L information 1o in the ST representation is used for predicting R. With the communication rate 28.8 kb/sec affordable by connection 125 in this instance, about 22 kb/sec may be allocated to the transmission of the L information and about 2 kb/sec to the transmission of param-R.
Referring back to equation (6), it can be shown that if L is weak, and thus det= G (i . e, determinant of G) has a small value, equation ( 6 ) for solving a,lo and a,11 would be numerically ill conditioned. As a consequence, use of the resulting a,lo and a,11, and thus param-R, to predict R based on L is not viable.
To avoid the numerically ill condition in (6), a second parametric coding technique in accordance with the invention will now be described. According to this second technique, the ST representation contains (i) information concerning L*, and (ii) parametric information concerning R
resulting from parametric coding of R with respect to L*, denoted param-R[w.r.t. L*], where, e.g., L' =aL+bR , (7) where a + b = 1 and a » b > 0.

Sinha 16 10 It should be noted that the parametric coding technique previously described is merely a special case of the second technique with a = 1 and b = 0. In any event, the disclosure hereupon is based on the generalized, second parametric coding technique involving L*.
It should also be noted that it may be more advantageous to employ the generalized parametric coding technique especially when the stereo audio signal to be coded includes an extremely strong stereo tilt (i.e., 1o almost completely dominated by either L or R). By controlling the a and b values, the pair L* and R in accordance with the generalized technique exhibits a reduced stereo separation, thereby increasing the "naturalness" of the parametric coding.
Fig. 2 illustrates server 105 wherein audio coder 203 is used to process a stereo audio signal representing a musical piece, which consists of L and R. Specifically, analog-to-digital (A/D) convertor 205 in coder 203 digitizes L and R, thereby providing PCM samples of L and R
2o denoted L(n) and R(n), respectively, where n represents an index for an nrh sample interval. Based on L(n) and R(n), mixer 207 generates L*(n) on lead 209a in accordance with expression (7) above, where values of a and b are adaptively selected by adapter 211 described below. In addition, R(n) and L(n) bypass mixer 207 onto leads 209b and 209c, respectively. Leads 209a-209c extend, and thereby provide the respective L*(n), R(n) and L(n), to parametric stereo coder 215 described below. L*(n) is also provided to PAC coder 217.
3o In a conventional manner, PAC coder 217 divides the PCM samples L*(n) into time domain blocks, and performs a modified discrete cosine transform (MDCT) on each block to provide a frequency domain representation therefor. The resulting MDCT coefficients are grouped according to coder bands for quantization. As mentioned before, these coder Sinha 16 11 bands approximate the well known critical bands of the human auditory system. PAC coder 217 also analyzes the audio signal samples, L*(nl, to determine the appropriate level of quantization (i.e., quantization stepsize) for s each coder band. This level of quantization is determined based on an assessment of how well the audio signal in a given coder band masks noise. The quantized MDCT
coefficients then undergo a conventional Huffman compression process, resulting in a bit stream representing 1o L* on lead 222a.
Based on received L*(n) and R(n), parametric stereo coder 215 generates a parametric signal P*R. P*F contains information concerning param-R[w.r.t. L*] which comprises predictor coefficients aio and ail in accordance with 15 equation (6) above, although "1" and "1"' therein are derived from L* here, rather than L, pursuant to the generalized parametric coding technique.
P*~ is quantized by conventional nonlinear quantizer 225, thereby providing a bit stream representing P*~ on 20 lead 222b. Leads 222a and 222b extend to ST representation formatter 231 where for each time domain block, the bit stream representing P*R on lead 222b corresponding to the time domain block is appended to that representing L* on lead 222a corresponding to the same time domain block, 25 resulting in the ST representation of the musical piece being processed. The latter is stored in memory 270, along with the ST representations of other musical pieces processed in a similar manner.
The adaptation algorithm implemented by adapter 211 3o for selecting the values of a and b will now be described.
This adaptation algorithm involves finding a smooth estimate of an upcoming value of a = a~"r+1. which is a function of the current time domain blocks of L(n) and R(n) from coder 215, in accordance with the following iterative 35 process:

Sinha 16 12 __ E ,'1 ~ 9 acur+1 Ycur + \1 Yl"'cur r ( ) and a~ =1 where cur represents an iterative index greater than or equal to zero; y represents a constant having a value close to one, e.g., Y = 0.95 in this instance; and E~"r is defined as follows:
Q r ~ ~J~
s~u,- = 0. 5 + 0. 5 n ~ ~ SJ~ 'f ~ , where P ( f ) and s]Z ( f ) respectively are spectrum 1o representations of the current time domain blocks of L(n) and R(n) in the form of vectors; "." represents a standard inner product operation; and I ~ (f)l and I~(f)I represent the magnitudes of P (f) and ~(f), respectively.
Since a + b = 1 as mentioned before, the value selected by adapter 211 for b simply equals 1 - a. It should be noted that alternatively, a and b may be predetermined constant values, thereby obviating the need of adapter 211.
In response to the aforementioned request from client 2o terminal 130 for transmission of the selected musical piece thereto, processor 280 causes packetizer 285 to retrieve from memory 270 the ST representation of the selected musical piece and generate a sequence of packets in accordance with the standard TCP/IP. These packets have information fields jointly containing the ST representation of the selected musical piece. Each packet in the sequence is destined for client terminal 130 as it contains in its header, as a destination address, the IP address of Sinha 16 13 terminal 130 requesting the music-on-demand service.
Fig. 3 illustrates one such packet sequence. To facilitate the assembly of the packets by client terminal 130 when it receives them, the header of each packet contains synchronization information. In particular, the synchronization information in each packet includes a sequence index indicating a time segment i, 1 < i < N, to which the packet corresponds, where N is the total number of time segments which the selected musical piece 1o comprises. In this illustrative embodiment, each time segment has the same predetermined length. For example, field 301 in the header of packet 310 contains a sequence index "1" indicating that packet 310 corresponds to the first time segment; field 303 in the header of packet 320 contains a sequence index "2" indicating that packet 320 corresponds to the second time segment; field 305 in the header of packet 430 contains a sequence index "3"
indicating that packet 330 corresponds to the third time segment; and so on arid so forth.
2o Client terminal 130 processes the packet sequence from server 105 on a time segment by time segment basis, in accordance with a routine which may be realized using software and/or hardware installed in terminal 130. Fig. 4 illustrates such a routine denoted 400. At step 407 of routine 400, for each time segment i, terminal 130 sets a predetermined time limit within which any packet corresponding to the time segment is received for processing. Terminal 130 at step 411 examines the aforementioned sequence index in the header of each 3o received packet. Based on the sequence index values of the received packets, terminal 130 at step 414 determines whether the packet for time segment i has been received before the time limit expires. If the expected packet has been received, routine 400 proceeds to step 417 where terminal 130 extracts the ST representation content from Sinha 16 14 the packet. At step 421, terminal 130 performs on the extracted content the inverse function to audio coder 203 described above to recover the L and R corresponding to time segment i.
Otherwise, if the aforementioned time limit expires before the expected packet is received for time segment i, terminal 130 performs well known error concealment for time segment i, e.g., interpolation based on the results of audio recovery in neighboring time segments, as indicated 1o at step 424.
The foregoing merely illustrates the principles of the invention. It will thus be appreciated that those skilled in the art will be able to devise numerous other arrangements which embody the principles of the invention and are thus within its spirit and scope.
For example, an alternative scheme may be applied to capture the localization cues of a stereo audio signal and effectively represent the signal. This alternative scheme is also based on a prediction in the frequency domain, but 2o works with "real" MDCT representations of the signal, as opposed to the complex DFT representations thereof as before. The MDCT may be viewed as a block transform with a 50% overlap between two consecutive analysis blocks. That is, for a transform block length B, there is a B/2 overlap between the two consecutive blocks. Furthermore, the transform produces B/2 real transform (frequency) outputs.
For details on such a transform, one may refer to: H.
Malavar, "Lapped Orthogonal Transforms," Prentice Hall, Englewood Cliffs, New Jersey. The alternative scheme stems 3o from my recognition that the phase cue information of each frequency content, which is not apparent in the real representation, is embedded in the evolution of MDCT
coefficients, i.e., the inter-block correlation of a frequency bin in the MDCT representation. Thus; the alternative scheme in which the prediction of, say, a right Sinha 16 15 MDCT coefficient is based on left MDCT coefficients in the same frequency bin for the current as well as previous transform block captures intensity and phase cues for stationary signals. For example, such a prediction may be expressed as follows:
R~ ~k~=aoL'~.~k~+a;L'f~k-l~ , where "k" is an index indicating the current MDCT block and "k-1" indicates the previous block. Advantageously, the alternative scheme can be effectively integrated into a PAC
1o codec with a low computational overhead because the required MDCT representation is made available in the codec anyway, and the alternative scheme performs well especially when the stereo audio signal to be coded is relatively stationary.
In addition, the parametric coding schemes disclosed above are illustratively predicated upon a prediction of R
based on L. Conversely, the parametric coding schemes may be predicated upon a prediction of L based on R. In that case, the above discussion still follows, with R and L
2o interchanged.
Further, in the disclosed embodiment, the parametric coding technique is illustratively applied to a packet switched communications system. However, the inventive technique is equally applicable to broadcasting systems including hybrid in-band on channel (IBOC) AM systems, hybrid IBOC FM systems, satellite broadcasting systems, Internet radio systems, TV broadcasting systems, etc.
Finally, server 105 is disclosed herein in a form in which various server functions are performed by discrete 3o functional blocks. However, any one or more of these functions could equally well be embodied in an arrangement in which the functions of any one or more of those blocks or indeed, all of the functions thereof, are realized, for Sinha 16 16 example, by one or more appropriately programmed processors.

Claims (52)

1. Apparatus for processing a signal which includes a first component and a second component thereof, the apparatus comprising:
a processor for deriving one or more coefficients describing at least a phase relation between the first component and the second component; and a controller for generating a representation of the signal, the representation containing first information derived from at least the first component, and second information concerning at least the one or more coefficients, a value of the second component being predictable based on the first information and the second information.
2. The apparatus of claim 1 wherein the signal includes a stereo audio signal.
3. The apparatus of claim 2 wherein the first component includes a left channel signal of the stereo audio signal, and the second component includes a right channel signal thereof.
4. The apparatus of claim 1 wherein the phase relation concerns a phase of at least part of the first component relative to a phase of at least part of the second component.
5. The apparatus of claim 1 wherein the one or more coefficients also describe an intensity of at least part of the first component relative to an intensity of at least part of the second component.
6. The apparatus of claim 1 wherein the one or more coefficients are derived by subjecting the first component and the second component to causality constraints.
7. The apparatus of claim 1 wherein the first information is derived from a combination of the first component and the second component.
8. The apparatus of claim 7 wherein the combination of the first component and the second component is adaptively determined.
9. Apparatus for processing a composite signal which includes a first signal and a second signal, the apparatus comprising:
a mixer for generating a mixed signal based on the first signal and the second signal;
a first coder for coding the mixed signal to generate a representation of the mixed signal;
a second coder responsive to the mixed signal and the first signal for providing information concerning one or more coefficients for predicting the first signal; and a processor for generating a representation of the composite signal, the representation of the composite signal includes the representation of the mixed signal and the information concerning the one or more coefficients.
10. The apparatus of claim 9 wherein the mixed signal is generated in an adaptive manner.
11. The apparatus of claim 9 wherein the composite signal includes a stereo audio signal.
12. The apparatus of claim 11 wherein the mixed signal is coded in accordance with a perceptual audio coding (PAC) technique.
13. The apparatus of claim 11 wherein the first signal includes a left channel signal of the stereo audio signal, and the second signal includes a right channel signal thereof.
14. The apparatus of claim 9 further comprising a controller for packaging the representation of the composite signal in a sequence of packets, each packet including an indicator indicating a sequence order of the packet with respect to other packets.
15. Apparatus for recovering a signal which includes a first component and a second component thereof, the apparatus comprising:
an interface for receiving a representation of the signal, the representation including first information derived from at least the first component, and second information concerning one or more coefficients, which describe at least a phase relation between the first component and the second component; and a processor for recovering the signal based on the representation, the processor predicting a value of the second component based on the first information and the second information in the representation in recovering the signal.
16. The apparatus of claim 15 wherein the representation is packaged in a sequence of packets.
17. The apparatus of claim 16 wherein the signal is recovered on a time-segment basis, each time segment being associated with a different packet in the sequence.
18. The apparatus of claim 17 wherein each packet includes an indicator identifying the time segment with which the packet is associated.
19. The apparatus of claim 18 wherein the processor performs concealment for a time segment in recovering the signal when the packet associated with the time segment is
20 not received within a predetermined period.
20. The apparatus of claim 15 wherein the signal includes a stereo audio signal.
21. The apparatus of claim 20 wherein the first component includes a left channel signal of the stereo audio signal, and the second component includes a right channel signal thereof.
22. The apparatus of claim 15 wherein the phase relation concerns a phase of at least part of the first component relative to a phase of at least part of the second component.
23. The apparatus of claim 15 wherein the one or more coefficients also describe an intensity of at least part of the first component relative to an intensity of at least part of the second component.
24. The apparatus of claim 15 wherein the one or more coefficients are derived by subjecting the first component and the second component to causality constraints.
25. The apparatus of claim 15 wherein the first information is derived from a combination of the first component and the second component.
26. The apparatus of claim 25 wherein the combination of the first component and the second component is adaptively determined.
27. A method for processing a signal which includes a first component and a second component thereof, the method comprising:
deriving one or more coefficients describing at least a phase relation between the first component and the second component; and generating a representation of the signal, the representation containing first information derived from at least the first component, and second information concerning at least the one or more coefficients, a value of the second component being predictable based on the first information and the second information.
28. The method of claim 27 wherein the signal includes a stereo audio signal.
29. The method of claim 28 wherein the first component includes a left channel signal of the stereo audio signal, and the second component includes a right channel signal thereof.
30. The method of claim 27 wherein the phase relation concerns a phase of at least part of the first component relative to a phase of at least part of the second component.
31. The method of claim 27 wherein the one or more coefficients also describe an intensity of at least part of the first component relative to an intensity of at least part of the second component.
32. The method of claim 27 wherein the one or more coefficients are derived by subjecting the first component and the second component to causality constraints.
33. The method of claim 27 wherein the first information is derived from a combination of the first component and the second component.
34. The method of claim 33 wherein the combination of the first component and the second component is adaptively determined.
35. A method for processing a composite signal which includes a first signal and a second signal, the method comprising:
generating a mixed signal based on the first signal and the second signal;
coding the mixed signal to generate a representation of the mixed signal;
in response to the mixed signal and the first signal, providing information concerning one or more coefficients for predicting the first signal; and generating a representation of the composite signal, the representation of the composite signal includes the representation of the mixed signal and the information concerning the one or more coefficients.
36. The method of claim 35 wherein the mixed signal is generated in an adaptive manner.
37. The method of claim 35 wherein the composite signal includes a stereo audio signal.
38. The method of claim 37 wherein the mixed signal is coded in accordance with a PAC technique.
39. The method of claim 37 wherein the first signal includes a left channel signal of the stereo audio signal, and the second signal includes a right channel signal thereof.
40. The method of claim 37 further comprising packaging the representation of the composite signal in a sequence of packets, each packet including an indicator indicating a sequence order of the packet with respect to other packets.
41. A method for recovering a signal which includes a first component and a second component thereof, the method comprising:

receiving a representation of the signal, the representation including first information derived from at least the first component, and second information concerning one or more coefficients, which describe at least a phase relation between the first component and the second component;
recovering the signal based on the representation; and predicting a value of the second component based on the first information and the second information in the representation in recovering the signal.
42. The method of claim 41 wherein the representation is packaged in a sequence of packets.
43. The method of claim 42 wherein the signal is recovered on a time-segment basis, each time segment being associated with a different packet in the sequence.
44. The method of claim 43 wherein each packet includes an indicator identifying the time segment with which the packet is associated.
45. The method of claim 44 further comprising performing concealment for a time segment in recovering the signal when the packet associated with the time segment is not received within a predetermined period.
46. The method of claim 41 wherein the signal includes a stereo audio signal.
47. The method of claim 46 wherein the first component includes a left channel signal of the stereo audio signal, and the second component includes a right channel signal thereof.
48. The method of claim 41 wherein the phase relation concerns a phase of at least part of the first component relative to a phase of at least part of the second component.
49. The method of claim 41 wherein the one or more coefficients also describe an intensity of at least part of the first component relative to an intensity of at least part of the second component.
50. The method of claim 41 wherein the one or more coefficients are derived by subjecting the first component and the second component to causality constraints.
51. The method of claim 41 wherein the first information is derived from a combination of the first component and the second component.
52. The method of claim 51 wherein the combination of the first component and the second component is adaptively determined.
CA002326495A 1999-12-03 2000-11-22 Technique for parametric coding of a signal containing information Expired - Fee Related CA2326495C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/454,026 1999-12-03
US09/454,026 US6539357B1 (en) 1999-04-29 1999-12-03 Technique for parametric coding of a signal containing information

Publications (2)

Publication Number Publication Date
CA2326495A1 CA2326495A1 (en) 2001-06-03
CA2326495C true CA2326495C (en) 2004-02-03

Family

ID=23802983

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002326495A Expired - Fee Related CA2326495C (en) 1999-12-03 2000-11-22 Technique for parametric coding of a signal containing information

Country Status (5)

Country Link
US (1) US6539357B1 (en)
EP (1) EP1107232B1 (en)
JP (2) JP2001209399A (en)
CA (1) CA2326495C (en)
DE (1) DE60039278D1 (en)

Families Citing this family (69)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6961432B1 (en) * 1999-04-29 2005-11-01 Agere Systems Inc. Multidescriptive coding technique for multistream communication of signals
JP3507743B2 (en) * 1999-12-22 2004-03-15 インターナショナル・ビジネス・マシーンズ・コーポレーション Digital watermarking method and system for compressed audio data
US7583805B2 (en) * 2004-02-12 2009-09-01 Agere Systems Inc. Late reverberation-based synthesis of auditory scenes
US7644003B2 (en) * 2001-05-04 2010-01-05 Agere Systems Inc. Cue-based audio coding/decoding
US20030035553A1 (en) * 2001-08-10 2003-02-20 Frank Baumgarte Backwards-compatible perceptual coding of spatial cues
US7292901B2 (en) * 2002-06-24 2007-11-06 Agere Systems Inc. Hybrid multi-channel/cue coding/decoding of audio signals
US7116787B2 (en) * 2001-05-04 2006-10-03 Agere Systems Inc. Perceptual synthesis of auditory scenes
US6804565B2 (en) * 2001-05-07 2004-10-12 Harman International Industries, Incorporated Data-driven software architecture for digital sound processing and equalization
US7447321B2 (en) 2001-05-07 2008-11-04 Harman International Industries, Incorporated Sound processing system for configuration of audio signals in a vehicle
US7451006B2 (en) * 2001-05-07 2008-11-11 Harman International Industries, Incorporated Sound processing system using distortion limiting techniques
US8605911B2 (en) 2001-07-10 2013-12-10 Dolby International Ab Efficient and scalable parametric stereo coding for low bitrate audio coding applications
SE0202159D0 (en) 2001-07-10 2002-07-09 Coding Technologies Sweden Ab Efficientand scalable parametric stereo coding for low bitrate applications
DE10154932B4 (en) * 2001-11-08 2008-01-03 Grundig Multimedia B.V. Method for audio coding
ES2237706T3 (en) 2001-11-29 2005-08-01 Coding Technologies Ab RECONSTRUCTION OF HIGH FREQUENCY COMPONENTS.
JP4805540B2 (en) * 2002-04-10 2011-11-02 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Stereo signal encoding
BRPI0308691B1 (en) * 2002-04-10 2018-06-19 Koninklijke Philips N.V. "Methods for encoding a multi channel signal and for decoding multiple channel signal information, and arrangements for encoding and decoding a multiple channel signal"
KR100978018B1 (en) * 2002-04-22 2010-08-25 코닌클리케 필립스 일렉트로닉스 엔.브이. Parametric representation of spatial audio
BR0304542A (en) * 2002-04-22 2004-07-20 Koninkl Philips Electronics Nv Method and encoder for encoding a multichannel audio signal, apparatus for providing an audio signal, encoded audio signal, storage medium, and method and decoder for decoding an audio signal
US20040005065A1 (en) * 2002-05-03 2004-01-08 Griesinger David H. Sound event detection system
RU2363116C2 (en) * 2002-07-12 2009-07-27 Конинклейке Филипс Электроникс Н.В. Audio encoding
EP1523863A1 (en) * 2002-07-16 2005-04-20 Koninklijke Philips Electronics N.V. Audio coding
SE0202770D0 (en) 2002-09-18 2002-09-18 Coding Technologies Sweden Ab Method of reduction of aliasing is introduced by spectral envelope adjustment in real-valued filterbanks
DE60310449T2 (en) 2002-11-28 2007-10-31 Koninklijke Philips Electronics N.V. AUDIO SIGNAL CODING
US7181019B2 (en) * 2003-02-11 2007-02-20 Koninklijke Philips Electronics N. V. Audio coding
CN1761998B (en) 2003-03-17 2010-09-08 皇家飞利浦电子股份有限公司 Method, component, audio encoder and system for generating mono-channel signals
KR20050116828A (en) * 2003-03-24 2005-12-13 코닌클리케 필립스 일렉트로닉스 엔.브이. Coding of main and side signal representing a multichannel signal
US20040264713A1 (en) * 2003-06-27 2004-12-30 Robert Grzesek Adaptive audio communication code
US7792670B2 (en) * 2003-12-19 2010-09-07 Motorola, Inc. Method and apparatus for speech coding
US7805313B2 (en) * 2004-03-04 2010-09-28 Agere Systems Inc. Frequency-based coding of channels in parametric multi-channel coding systems
EP1895512A3 (en) * 2004-04-05 2014-09-17 Koninklijke Philips N.V. Multi-channel encoder
ATE395686T1 (en) * 2004-04-05 2008-05-15 Koninkl Philips Electronics Nv MULTI-CHANNEL ENCODER
PL3561810T3 (en) * 2004-04-05 2023-09-04 Koninklijke Philips N.V. Method of encoding left and right audio input signals, corresponding encoder, decoder and computer program product
DE602005022235D1 (en) * 2004-05-19 2010-08-19 Panasonic Corp Audio signal encoder and audio signal decoder
EP1761915B1 (en) * 2004-06-21 2008-12-03 Koninklijke Philips Electronics N.V. Method and apparatus to encode and decode multi-channel audio signals
KR101147187B1 (en) * 2004-07-14 2012-07-09 돌비 인터네셔널 에이비 Method, device, encoder apparatus, decoder apparatus and audio system
WO2006008697A1 (en) * 2004-07-14 2006-01-26 Koninklijke Philips Electronics N.V. Audio channel conversion
KR100658222B1 (en) * 2004-08-09 2006-12-15 한국전자통신연구원 3 Dimension Digital Multimedia Broadcasting System
JP4936894B2 (en) * 2004-08-27 2012-05-23 パナソニック株式会社 Audio decoder, method and program
DE102004042819A1 (en) * 2004-09-03 2006-03-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for generating a coded multi-channel signal and apparatus and method for decoding a coded multi-channel signal
KR101158709B1 (en) 2004-09-06 2012-06-22 코닌클리케 필립스 일렉트로닉스 엔.브이. Audio signal enhancement
DE102004043521A1 (en) * 2004-09-08 2006-03-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Device and method for generating a multi-channel signal or a parameter data set
US7720230B2 (en) * 2004-10-20 2010-05-18 Agere Systems, Inc. Individual channel shaping for BCC schemes and the like
US8204261B2 (en) 2004-10-20 2012-06-19 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Diffuse sound shaping for BCC schemes and the like
EP1817766B1 (en) * 2004-11-30 2009-10-21 Agere Systems Inc. Synchronizing parametric coding of spatial audio with externally provided downmix
US8340306B2 (en) 2004-11-30 2012-12-25 Agere Systems Llc Parametric coding of spatial audio with object-based side information
US7787631B2 (en) * 2004-11-30 2010-08-31 Agere Systems Inc. Parametric coding of spatial audio with cues based on transmitted channels
US7903824B2 (en) * 2005-01-10 2011-03-08 Agere Systems Inc. Compact side information for parametric coding of spatial audio
EP1691348A1 (en) * 2005-02-14 2006-08-16 Ecole Polytechnique Federale De Lausanne Parametric joint-coding of audio sources
CN101151660B (en) * 2005-03-30 2011-10-19 皇家飞利浦电子股份有限公司 Multi-channel audio coder, demoder and method thereof
US7991610B2 (en) 2005-04-13 2011-08-02 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Adaptive grouping of parameters for enhanced coding efficiency
US7961890B2 (en) 2005-04-15 2011-06-14 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung, E.V. Multi-channel hierarchical audio coding with compact side information
EP1876585B1 (en) * 2005-04-28 2010-06-16 Panasonic Corporation Audio encoding device and audio encoding method
EP1876586B1 (en) * 2005-04-28 2010-01-06 Panasonic Corporation Audio encoding device and audio encoding method
US8626503B2 (en) * 2005-07-14 2014-01-07 Erik Gosuinus Petrus Schuijers Audio encoding and decoding
KR101277041B1 (en) * 2005-09-01 2013-06-24 파나소닉 주식회사 Multi-channel acoustic signal processing device and method
US7974713B2 (en) * 2005-10-12 2011-07-05 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Temporal and spatial shaping of multi-channel audio signals
CA2656867C (en) * 2006-07-07 2013-01-08 Johannes Hilpert Apparatus and method for combining multiple parametrically coded audio sources
WO2008069584A2 (en) 2006-12-07 2008-06-12 Lg Electronics Inc. A method and an apparatus for decoding an audio signal
KR101100222B1 (en) 2006-12-07 2011-12-28 엘지전자 주식회사 A method an apparatus for processing an audio signal
CN101071570B (en) * 2007-06-21 2011-02-16 北京中星微电子有限公司 Coupling track coding-decoding processing method, audio coding device and decoding device
KR100922897B1 (en) * 2007-12-11 2009-10-20 한국전자통신연구원 An apparatus of post-filter for speech enhancement in MDCT domain and method thereof
CN102160113B (en) * 2008-08-11 2013-05-08 诺基亚公司 Multichannel audio coder and decoder
ES2415155T3 (en) 2009-03-17 2013-07-24 Dolby International Ab Advanced stereo coding based on a combination of adaptively selectable left / right or center / side stereo coding and parametric stereo coding
TWI433137B (en) 2009-09-10 2014-04-01 Dolby Int Ab Improvement of an audio signal of an fm stereo radio receiver by using parametric stereo
CA3105050C (en) 2010-04-09 2021-08-31 Dolby International Ab Audio upmixer operable in prediction or non-prediction mode
ES2950751T3 (en) * 2010-04-13 2023-10-13 Fraunhofer Ges Forschung Audio or video encoder, audio or video decoder and related methods for processing multi-channel audio or video signals using a variable prediction direction
UA107771C2 (en) * 2011-09-29 2015-02-10 Dolby Int Ab Prediction-based fm stereo radio noise reduction
CN108877815B (en) 2017-05-16 2021-02-23 华为技术有限公司 Stereo signal processing method and device
US10891960B2 (en) * 2017-09-11 2021-01-12 Qualcomm Incorproated Temporal offset estimation

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL8601182A (en) * 1986-05-12 1987-12-01 Philips Nv METHOD AND DEVICE FOR RECORDING AND / OR PLAYING AN IMAGE SIGNAL AND AN ASSOCIATED AUDIO SIGNAL IN RESPECT OF A REGISTRATION CARRIER, AND OBTAINING A REGISTRATION CARRIER BY THE METHOD
NL9000338A (en) * 1989-06-02 1991-01-02 Koninkl Philips Electronics Nv DIGITAL TRANSMISSION SYSTEM, TRANSMITTER AND RECEIVER FOR USE IN THE TRANSMISSION SYSTEM AND RECORD CARRIED OUT WITH THE TRANSMITTER IN THE FORM OF A RECORDING DEVICE.
US5632005A (en) * 1991-01-08 1997-05-20 Ray Milton Dolby Encoder/decoder for multidimensional sound fields
JPH04324727A (en) * 1991-04-24 1992-11-13 Fujitsu Ltd Stereo coding transmission system
DE4202140A1 (en) * 1992-01-27 1993-07-29 Thomson Brandt Gmbh Digital audio signal transmission using sub-band coding - inserting extra fault protection signal, or fault protection bit into data frame
US5285498A (en) * 1992-03-02 1994-02-08 At&T Bell Laboratories Method and apparatus for coding audio signals based on perceptual model
SG43996A1 (en) * 1993-06-22 1997-11-14 Thomson Brandt Gmbh Method for obtaining a multi-channel decoder matrix
US5438623A (en) * 1993-10-04 1995-08-01 The United States Of America As Represented By The Administrator Of National Aeronautics And Space Administration Multi-channel spatialization system for audio signals
US5703877A (en) 1995-11-22 1997-12-30 General Instrument Corporation Of Delaware Acquisition and error recovery of audio data carried in a packetized data stream
DE19628292B4 (en) * 1996-07-12 2007-08-02 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method for coding and decoding stereo audio spectral values
US5796844A (en) * 1996-07-19 1998-08-18 Lexicon Multichannel active matrix sound reproduction with maximum lateral separation

Also Published As

Publication number Publication date
EP1107232B1 (en) 2008-06-25
JP4865010B2 (en) 2012-02-01
JP2009205185A (en) 2009-09-10
EP1107232A2 (en) 2001-06-13
EP1107232A3 (en) 2002-10-16
US6539357B1 (en) 2003-03-25
DE60039278D1 (en) 2008-08-07
JP2001209399A (en) 2001-08-03
CA2326495A1 (en) 2001-06-03

Similar Documents

Publication Publication Date Title
CA2326495C (en) Technique for parametric coding of a signal containing information
US6366888B1 (en) Technique for multi-rate coding of a signal containing information
JP3263168B2 (en) Method and decoder for encoding audible sound signal
KR100608062B1 (en) Method and apparatus for decoding high frequency of audio data
CA2736060C (en) Audio coding system using characteristics of a decoded signal to adapt synthesized spectral components
KR100299528B1 (en) Apparatus and method for encoding / decoding audio signal using intensity-stereo process and prediction process
KR970007661B1 (en) Method and apparatus for coding audio signals based on perceptual model
US9251797B2 (en) Preserving matrix surround information in encoded audio/video system and method
EP0563832A1 (en) Stereo audio encoding apparatus and method
US20080140405A1 (en) Audio coding system using characteristics of a decoded signal to adapt synthesized spectral components
JP3552232B2 (en) Method of organizing data during transmission and / or storage of digital signals on several interdependent channels
US6012025A (en) Audio coding method and apparatus using backward adaptive prediction
JP4173209B2 (en) Method and apparatus for encoding digitized audio signal
JP3099876B2 (en) Multi-channel audio signal encoding method and decoding method thereof, and encoding apparatus and decoding apparatus using the same
Ofir et al. Packet loss concealment for audio streaming based on the GAPES and MAPES algorithms
WO1998035447A2 (en) Audio coding method and apparatus
IL165648A (en) Audio coding system using characteristics of a decoded signal to adapt synthesized spectral components

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed

Effective date: 20161122