KR20170087529A - Audio encoder and decoder - Google Patents

Abstract

The present disclosure provides methods, devices, and computer program products for encoding and decoding multi-channel audio signals based on an input signal. In accordance with this disclosure, a hybrid approach using both parametric stereo coding and discrete representation of the processed multi-channel audio signal can be used to improve the quality of the encoded and decoded audio for any bit rates .

Description

AUDIO ENCODER AND DECODER}

Cross-reference to related applications

This application claims priority to U.S. Provisional Patent Application No. 61 / 808,680, filed April 5, 2013, the entire contents of which are incorporated herein by reference.

Technical field

The present invention relates generally to multi-channel audio coding. More particularly, the present invention relates to encoders and decoders for hybrid coding with parametric coding and discrete multi-channel coding.

For conventional multi-channel audio coding, possible coding schemes include parametric coding such as discrete multi-channel coding or MPEC sound. The system used depends on the bandwidth of the audio system. Parametric coding methods are known to be efficient and scalable in terms of listening quality, which makes them particularly attractive in low bit rate applications. In high bit rate applications, the discrete multi-channel coding is often used. Conventional distribution or processing formats and related coding techniques can be improved in terms of their bandwidth efficiency, especially in applications with a bit rate between the low bit rate and the high bit rate.

US 7292901 (Kroun et al.) Relates to a hybrid coding method, wherein a hybrid audio signal is formed from at least one downmixed spectral component and at least one upmixed spectral component. While the above method suggests that such an application increases the capacity of an application with a particular bit rate, further improvements may be required that further increase the efficiency of the audio processing system.

The configuration as disclosed in the present application (or its correction) is disclosed.

1 shows a generalized block diagram of a decoding system according to an exemplary embodiment;
Figure 2 shows a first part of the decoding system in figure 1;
Figure 3 shows a second part of the decoding system in figure 1;
Figure 4 shows a third part of the decoding system in Figure 1;
5 shows a generalized block diagram of an encoding system according to an exemplary embodiment;
6 shows a generalized block diagram of a decoding system according to an exemplary embodiment;
Figure 7 shows a third part of the decoding system of Figure 6;
Figure 8 shows a generalized block diagram of an encoding system according to an exemplary embodiment;

Exemplary embodiments are now described with reference to the accompanying drawings.

All drawings are graphical and generally show only the parts necessary to describe the present disclosure in detail, and other parts may be omitted or merely suggested. Like reference numerals are used to refer to like parts throughout the several views, unless otherwise indicated.

Overview - Decoder

As used herein, an audio signal may be any of those combined with a pure audio signal, an audio visual signal, or an audio portion or metadata of a multimedia signal.

As used herein, downmixing of a plurality of signals means combining the plurality of signals such that a smaller number of signals are obtained, for example, by forming linear bonds. The inverse operation of downmixing is referred to as upmixing, which performs an operation on a lower number of signals to obtain a higher number of signals.

According to a first aspect, exemplary embodiments propose methods, devices and computer program products for reconstructing a multi-channel audio signal based on an input signal. The proposed methods, devices and computer program products generally have the same features and advantages.

According to exemplary embodiments, a decoder for a multi-channel audio processing system for reconstructing M encoded channels is provided. Wherein the decoder comprises a first receiving stage configured to receive N waveform-coded downmix signals having spectral coefficients corresponding to frequencies between the first and second cross-over frequencies . Where 1 < N < M.

The decoder further comprises a second receiving stage configured to receive M waveform-coded signals having spectral coefficients corresponding to frequencies up to the first cross-over frequency, wherein the M waveform-coded Each of the signals corresponds to one of each of the M encoded channels.

The decoder is further configured to down-mix the M waveform-coded signals with N downmix signals having spectral coefficients corresponding to frequencies up to the first cross-over frequency. And further includes mix stage downstreams.

The decoder is further adapted to combine each of the N downmix signals received by the first receiving stage and a corresponding one of the N downmix signals from the downmix stage into N combined downmix signals The first receiving stage configured and the first combining stage downstreams of the downmix stage.

Wherein the decoder is further configured to expand each of the N combined downmix signals from the combining stage to a frequency range higher than the second cross-over frequency by performing a high frequency reconstruction, And further comprising reconstruction stage downstreams.

The decoder may further comprise a parametric upmix of the N frequency expanded signals from the high frequency reconstruction stage with M upmix signals having spectral coefficients corresponding to frequencies higher than the first cross- Further comprising: upmix stage downstreams of the high frequency reconstruction stage, wherein each of the M upmix signals corresponds to one of the M encoded channels.

Wherein the decoder is further configured to combine the M upmix signals from the upmix stage with the M waveform-coded signals received by the second receiving stage, wherein the upmix stage and the second receiving stage Lt; RTI ID = 0.0 > downstages < / RTI >

The M waveform-coded signals are purely waveform-coded signals that are not mixed parametric signals, that is, they are non-downmixed discrete representations of the processed multi-channel audio signal . The advantage that the low frequencies are represented by these waveform-coded signals may be that the human hearing is more sensitive to the portion of the audio signal having low frequencies. By coding this part with better quality, the overall impression of the decoded audio can be increased.

The advantage of having at least two downmix signals is that this embodiment provides an increase in the dimensionality of the downmix signals compared to systems having only one downmix channel. According to the present embodiment, a better decoded audio quality can be provided accordingly and can be greater than the gain at the bit rate provided by one downmix signaling system.

The advantage of using hybrid coding with parametric downmix and discrete multi-channel coding is that this can be achieved at any bit rates compared to using conventional parametric coding approaches such as MPEG Surround with HE-AAC So that the quality of the decoded audio signal can be improved. At bit rates around 72 kbps (kilobits per second), conventional parametric coding models can be saturated. That is, the quality of the decoded audio signal is limited by the drawbacks of the parametric model, which is not due to lack of bits for coding. As a result, for bit rates from about 72 kbps, it may be more beneficial to use bits in discretely waveform-coded low frequencies. At the same time, a hybrid approach using parametric downmixing and discrete multi-channel coding is a promising approach because all of these bits are used at the lower frequencies of the waveform-coding and spectral band replication (SBR) It is possible to improve the quality of the decoded audio for any bit rates, such as 128 kbps or less.

The advantage of having N waveform-coded downmix signals with only spectral data corresponding to frequencies between the first cross-over frequency and the second cross-over frequency is that the required bit rate for the audio signal processing system Can be reduced. Alternatively, the saved bits may be used for lower frequencies of waveform-coding by having a band-pass filtered downmix signal, for example the sample frequency for those frequencies may be higher, or the first cross - Over frequency can be increased.

As described above, since the human auditory sense is more sensitive to a portion of an audio signal having low frequencies, high frequencies, such as portions of an audio signal having frequencies higher than the second cross-over frequency, Can be regenerated by high frequency reconstruction without lowering audio quality.

A further advantage of this embodiment is that the complexity of the upmix is reduced because the parametric upmix performed in the upmix stage only operates on spectral coefficients corresponding to frequencies higher than the first cross- It is.

According to another embodiment, the coupling performed in the first combining stage is performed in the frequency domain, wherein the N waveforms having spectral coefficients corresponding to frequencies between the first and second cross- Each of the coded downmix signals is combined with a corresponding one of the N downmix signals having spectral coefficients corresponding to frequencies up to the first cross-over frequency and N combined downmixes.

The advantage of this embodiment is that the M waveform-coded signals and the N waveform-coded downmix signals are provided for the M waveform-coded signals and the N waveform-coded downmix signals, respectively Can be coded by the waveform coder using overlapping windowed transforms with independent windowing, and still be decodable by the decoder.

According to another embodiment, extending each of the N combined downmix signals in the high frequency reconstruction stage to a frequency range higher than the second cross-over frequency is performed in the frequency domain.

According to another embodiment, the M upmix signals having spectra coefficients corresponding to frequencies higher than the first cross-over frequency, i.e., the combination performed in the second combining step, Combining with the M waveform-coded signals having spectral coefficients corresponding to frequencies up to < RTI ID = 0.0 >

As noted above, the advantage of combining the signals in the QMF domain is that independent windowing of overlapping windowed transformations used to code the signals in the MDCT domain can be used.

According to another embodiment, performing the parametric upmix of the N frequency expanded combined downmix signals into the M upmix signals in the upmix stage is performed in the frequency domain.

According to yet another embodiment, downmixing the M waveform-coded signals with N downmix signals having spectral coefficients corresponding to frequencies up to the first cross-over frequency is performed in the frequency domain do.

According to an embodiment, the frequency domain is a QMF (Quadrature Mirror Filters) domain.

According to another embodiment, the downmix performed in the downmixing stage is performed in the time domain, where the M waveform-coded signals have spectral coefficients corresponding to frequencies up to the first cross-over frequency And downmixed into N downmix signals.

According to yet another embodiment, the first cross-over frequency is dependent on the bit transmission rate of the multi-channel audio processing system. This may enable the available bandwidth to be exploited to improve the quality of the decoded audio signal since portions of the audio signal with frequencies lower than the first cross-over frequency are purely waveform-coded.

According to another embodiment, expanding each of the N combined downmix signals to a higher frequency range than the second cross-over frequency by performing a high frequency reconstruction in the high frequency reconstruction stage uses high frequency reconstruction parameters . The high frequency reconstruction parameters may be received by the decoder, e.g., at the receiving stage, and then transmitted to a high frequency reconstruction stage. The high frequency reconstruction may comprise, for example, performing spectral band replication (SBR).

According to another embodiment, the parametric upmix in the upmixing stage is done using upmix parameters. The upmix parameters are received, for example, by the encoder at the receiving stage and transmitted to the upmixing stage. Wherein a decorrelated version of the N frequency expanded combined downmix signals is generated to produce a decorrelated version of the N frequency expanded combined downmix signals and an inverse of the N frequency expanded combined downmix signals & The correlated version is a matrix operation. The parameters of the matrix operation are given by the upmix parameters.

According to another embodiment, the received N waveform-coded downmix signals at the first receiving stage and the received M waveform-coded signals at the second receiving stage are combined with the N waveform- Coded downmix signals and overlapping windowed transforms with independent windowing for the M waveform-coded signals, respectively.

An advantage of this is that it can enable improved coding quality and enable improved quality of the decoded multi-channel audio signal. For example, if at some point in time a transient is detected in higher frequency bands, the waveform coder can code this particular time frame with a shorter window sequence, whilst the default for the lower frequency band The window sequence can be maintained.

According to embodiments, the decoder may also have a third receiving stage configured to receive an additional waveform-coded signal having spectral coefficients corresponding to a subset of frequencies higher than the first cross-over frequency have. The decoder may also comprise an interleaved stage downstream of the upmix stage. The interleaved stage may be configured to interleave the additional waveform-coded signal with one of the M upmix signals. The third receiving stage may also be configured to receive a plurality of additional waveform-coded signals, the interleaving stage further comprising: interleaving the plurality of additional waveform-coded signals with a plurality of M upmix signals, .

This is because waveforms of a portion of the frequency range higher than the first cross-over frequency, which is difficult to parametrically reconstruct from the downmix signals, are interleaved with the parametrically reconstructed upmix signals And the like.

In one exemplary embodiment, the interleaving is performed by adding the additional waveform-coded signal to one of the M upmix signals. According to another exemplary embodiment, interleaving the further waveform-coded signal with one of the M upmix signals further comprises interleaving the additional waveform-coded signal with one of the M upmix signals, And replacing one of the M upmix signals in the subset of frequencies above the one cross-over frequency with the additional waveform-coded signal.

According to exemplary embodiments, the decoder may also be configured to receive the control signal, for example, by the third receiving stage. The control signal may indicate how to interleave the additional waveform-coded signal with one of the M upmix signals, and the additional waveform-coded signal may be combined with one of the M upmix signals The step of interleaving is based on the control signal. In particular, the control signal may comprise a frequency range and a time range, such as one or more time / frequency tiles (tiles) in the QMF domain, to which the further waveform-coded signal is to be interleaved with one of the M upmix signals Can be displayed. Thus, interleaving can occur in time and frequency within a channel.

An advantage of this is that time ranges and frequency ranges that do not suffer from aliasing or start-up / fade-out problems of the overlapping windowed transformations used to code the waveform-coded signals can be selected.

Overview - Encoders

According to a second aspect, exemplary embodiments propose methods, devices and computer program products for encoding a multi-channel audio signal based on an input signal.

The proposed methods, devices and computer program products generally can have the same features and advantages.

Advantages associated with features and configurations, such as those outlined in the above decoder, will generally be valid for corresponding features and configurations for the encoder.

According to exemplary embodiments, there is provided an encoder for a multi-channel audio processing system for encoding M channels, where M > 2.

The encoder has a receiving stage configured to receive M signals corresponding to the M channels to be encoded.

The encoder may also receive the M signals from the receiving stage and separately waveform-code the M signals for a frequency range corresponding to frequencies up to a first cross-over frequency to generate M waveform-coded Coding stage configured to generate signals, wherein the M waveform-coded signals have spectral coefficients corresponding to frequencies up to the first cross-over frequency.

The encoder also has a downmixing stage configured to receive the M signals from the receiving stage and downmix the M signals to N downmix signals, where 1 < N < M.

The encoder also includes a high frequency reconstruction encoding stage configured to receive the N downmix signals from the downmixing stage and to high-frequency reconstructively encode the N downmix signals, whereby the high-frequency reconstruction encoding stage And to extract high frequency reconstruction parameters that enable high frequency reconstruction of the N downmix signals higher than the second cross-over frequency.

The encoder also receives the M signals from the receiving stage, receives the N downmix signals from the downmixing stage, and converts the M signals into a signal corresponding to frequencies higher than the first cross- Wherein the parametric encoding stage is configured to perform M parametric encoding stages corresponding to the M channels for a frequency range higher than the first cross- And to extract upmix parameters that enable upmixing of the N downmix signals into the signals.

The encoder also receives the N downmix signals from the downmixing stage and performs waveform-coding of the N downmix signals for a frequency range corresponding to frequencies between the first and second cross- Coded downmix signals to generate N waveform-coded downmix signals, wherein the N waveform-coded downmix signals are generated by combining the first cross-over frequency and the second cross- - spectral coefficients corresponding to frequencies between over-frequencies.

According to one embodiment, the high frequency reconstruction coding of the N downmix signals in the high frequency reconstruction encoding stage is performed in a frequency domain, preferably a QMF (Quadrature Mirror Filters) domain.

According to another embodiment, the parametric encoding of the M signals in the parametric encoding stage is performed in the frequency domain, preferably the QMF (Quadrature Mirror Filters) domain.

According to yet another embodiment, generating M waveform-coded signals by separately waveform-coding the M signals in the first waveform-coding stage comprises applying overlapping windowed transforms to the M signals Wherein different overlapping window sequences are used for at least two of the M signals.

According to embodiments, the encoder is further configured to waveform-code one of the M signals for a frequency range corresponding to a subset of the frequency range higher than the first cross-over frequency, Encoding stage configured to generate the first waveform-encoding stage.

According to embodiments, the encoder may also include a control signal generation stage. The control signal generation stage is configured to generate a control signal indicating how to interleave the additional waveform-coded signal at the decoder with one parametric reconstruction of the M signals. For example, the control signal may indicate a frequency range and a time range in which the additional waveform-coded signal is interleaved with one of the M upmix signals.

Exemplary embodiments

1 is a generalized block diagram of a decoder 100 in a multi-channel audio processing system for reconstructing M encoded channels. The decoder 100 has three conceptual parts 200, 300 and 400, which will be described in more detail with reference to FIGS. In a first conceptual part 200, the encoder receives N waveform-coded downmix signals and M waveform-coded signals representing the multi-channel audio signal to be decoded, where 1 <N <M. In the illustrated example, N is set to two. In a second conceptual part 300, M waveform-coded signals are downmixed and combined with N waveform-coded downmix signals. High frequency reconstruction (HFR) is then performed on the combined downmix signals. In a third conceptual part 400, the high frequency reconstructed signals are upmixed and M waveform-coded signals are combined with the upmix signals to reconstruct the M encoded channels.

In the exemplary embodiment described in conjunction with FIGS. 2-4, the reconstruction of the encoded 5.1 surround sound is described. It should be noted that in this described embodiment or figures the low frequency effect signal is not mentioned. This does not mean that any low frequency effects are ignored. The low frequency effect (Lfe) is added to the five reconstructed channels in any suitable manner known by those skilled in the art. It is also noted that the decoders described above are equally well suited to other types of surround sound encoded, such as 7.1 or 9.1 surround sound.

FIG. 2 shows a first conceptual part 200 of the decoder 100 in FIG. The decoder has two receive stages (212, 214). In a first receive stage 212, the bit-stream 202 is decoded and dequantized into two waveform-coded downmix signals 208a-b. Each of the two waveform-coded downmix signals 208a-b has a waveform coefficient corresponding to frequencies between a first cross-over frequency (k _y ) and a second cross-over frequency (k _x ) Respectively.

In the second receive stage 212, the bit-stream 202 is decoded and dequantized into five waveform-coded signals 208a-e. Five waveform includes spectral coefficients corresponding to frequencies up to over frequency k _x - each coded down-mix signals (210a-e) has a first cross.

By way of example, the signals 210a-e comprise two channel pair elements and one single channel element for the center. The channel pair elements may be, for example, a combination of a left front and a left surround signal and a combination of a right front and a right surround signal. As another example, a combination of left front and right front signals and a combination of left surround and right surround signals. These channel pair elements may be coded, for example, in a sum-and-difference format. The five signals 210a-e may be coded using overlapping windowed transforms with independent windowing and still be decodable by the decoder. This may enable improved coding quality and therefore enable an improved quality of the decoded signal.

As an example, the first cross-over frequency k _y is 1.1 kHz. As an example, the second cross-over frequency k _x is in the range of 5.6-8 kHz. It should be noted that the first cross-over frequency k _y may also vary in individual signal units. That is, the encoder may detect that the signal components in a particular output signal may not be faithfully reproduced by the stereo downmix signals 208a-b, and that the associated waveform coded signals for a particular time instance 210a-e, the bandwidth, i. E. The first cross-over frequency, k _y , to effectuate appropriate waveform coding of the signal component.

As will be described later herein, the remaining stages of the encoder 100 typically operate in the QMF domain (Quadrature Mirror Filters domain). For this reason, each of the signals 208a-b, 210a-e received by the first and second receiving stages 212,214, received in a modified discrete cosine transform (MDCT) form, inverse &lt; RTI ID = 0.0 &gt; MDCT 216 &lt; / RTI &gt; Each signal is then converted back to the frequency domain by applying a QMF transform 218.

In Figure 3, the five waveform two down-mix signal comprising spectral coefficients corresponding to frequencies up to over frequency k _y - in the coded signal 210 is down-mix stage 308, the first cross- Lt; RTI ID = 0.0 &gt; 310, &lt; / RTI &gt; These downmix signals 310 and 312 are low pass using the same downmixing scheme used in the encoder to produce the two downmix signals 208a-b shown in FIG. - &lt; / RTI &gt; channel signals 210a-e.

The two new downmix signals 310 and 312 are then combined with the corresponding downmix signals 208a-b in the first combining stage 320 and 322 to produce combined downmix signals 302a-b, . Thus, each of the combined downmix signals 302a-b may include spectral coefficients corresponding to frequencies from the downmix signals 310,312 to the first cross-over frequency k _y , A first cross-over frequency k _y resulting from the two waveform-coded downmix signals 208a-b received at the first receiving stage 212 (shown in FIG. 2) Over frequency k _x Lt; RTI ID = 0.0 &gt; a &lt; / RTI &gt;

The encoder also has a high frequency reconstruction (HFR) stage 314. The HFR stage two combined down-mix respectively a second cross of the signals (302a-b) from the coupling stage by executing a high-frequency reconstruction is configured to extend to a high frequency over the frequency range than k _x. The performed high frequency reconstruction may comprise performing spectral band replication (SBR) according to some embodiments. High frequency reconstruction can be done by using high frequency reconstruction parameters that can be received by HFR stage 314 in any suitable manner.

The output from the high frequency reconstruction stage 314 is two signals 304a-b with the downmix signals 208a-b to which the HFR extensions 316 and 318 are applied. As described above, the HFR stage 314 is coupled to the input signals 210a-e from a second receiving stage 214 (shown in Figure 2) combined with the two downmix signals 208a-b And performs a high frequency reconstruction based on the existing frequencies. Somewhat simplified, the HFR ranges 316 and 318 have portions of the spectral coefficients from the downmix signals 310 and 312 copied up to the HFR range 316 and 318. As a result, portions of the five waveform-coded signals 210a-e appear in the HFR range 316, 318 of the output 304 from the HFR stage 314.

The downmixing in the downmixing stage 308 prior to the high frequency reconstruction stage 314 and the combination in the first combining stage 320 and 322 are performed in the time domain, i.e., inverse modified discrete cosine transform (MDCT) It should be noted that each signal may be converted to the time domain and then done by applying a signal 216 (shown in FIG. 2). However, it is noted that waveform-coded signals 210a-e and waveform-coded downmix signals 208a-b can be coded by waveform coder using overlapping windowed transforms with independent windowing Considering the signals 210a-e and 208a-b may not be smoothly coupled in the time domain. Thus, if at least the first combining stage 320, 322 is done in the QMF domain, a better regulated scenario is obtained.

FIG. 4 shows the third and last conceptual part 400 of the encoder 100. FIG. The output 304 from the HFR stage 314 constitutes the input to the upmix stage 402. The upmix stage 402 generates five signal outputs 404a-e by performing a parametric upmix on the frequency extended signals 304a-b. Each of the five upmix signals 404a-e corresponds to one of the five encoded channels in the encoded 5.1 surround sound for frequencies above the first cross-over frequency k _y . According to an exemplary parametric upmix procedure, the upmix stage 402 first receives the parametric mixing parameters. The upmix stage 402 also generates decorrelated versions of the two frequency-extended combined downmix signals 304a-b. The upmix stage 402 also includes decorrelated versions of the two frequency-extended combined downmix signals 304a-b and the two frequency-extended combined downmix signals 304a-b Wherein the parameters of the matrix operation are given by upmix parameters. Alternatively, any other parametric upmixing procedures known in the art may be applied. Applicable parametric upmixing procedures are described in, for example, " MPEG Surround-The ISO / MPEG Standard for Efficient and Compatible Multichannel Audio Coding &quot;, November 2008, Journal of Audio Engineering, vol. 56, No. 11, ).

The outputs 404a-e from the upmix stage 402 thus do not have frequencies below the first cross-over frequency k _y . The remaining spectral coefficients corresponding to the frequencies up to the first cross-over frequency k _y are converted into five waveform-coded signals &lt; RTI ID = 0.0 &gt; 0.0 &gt; 210a-e. &Lt; / RTI &gt;

The encoder 100 also includes a second coupling stage 416, The second combining stage 416,418 includes five waveform-coded signals 210a-e received by a second receiving stage 214 (shown in Figure 2) and the five up- Gt; 404a-e &lt; / RTI &gt;

It may be noted that any current Lfe signals may be added to the resulting combined signal 422 as a separate signal. Each of the signals 422 is then converted to the time domain by applying an inverse QMF transform 420. The output from the inverse QMF transform 414 thus becomes a fully decoded 5.1 channel audio signal.

FIG. 6 shows a modified decoding system 100 'of the decoding system of FIG. The decoding system 100 'includes conceptual portions 200', 300 'and 400' corresponding to the conceptual portions 200, 300 and 400 of FIG. The difference between the decoding system of Figure 1 and the decoding system 100'of Figure 6 is that there is a third receiving stage 616 in the conceptual portion 200'and an interleaving stage 714 in the third conceptual portion 400 ' .

The third receiving stage 616 is configured to receive an additional waveform-coded signal. The further waveform-coded signal has spectral coefficients corresponding to a subset of frequencies higher than the first cross-over frequency. The further waveform-coded signal may be transformed into the time domain by applying an inverse MDCT transform 216. [ Which can then be converted back to the frequency domain by applying QMF transform 218. [

It should be appreciated that the additional waveform-coded signal may be received as a separate signal. However, the additional waveform-coded signal may also form one or more portions of the five waveform-coded signals 210a-e. In other words, the additional waveform-coded signal may be coded jointly with one or more of the five waveform-coded signals 210a-e using the same MCDT transform, for example. If so, the third receiving stage 616 corresponds to the second receiving stage, i.e., the additional waveform-coded signal is passed through the second receiving stage 214 to the five waveform- 0.0 &gt; 210a-e. &Lt; / RTI &gt;

FIG. 7 shows a third conceptual part 300 'of the decoder 100' of FIG. 6 in more detail. In addition to the high frequency extended downmix signals 304a-b and the five waveform-coded signals 210a-e, an additional waveform-coded signal 710 is provided to the third conceptual portion 400 ' . In the illustrated example, the additional waveform-coded signal 710 corresponds to the third one of the five channels. The further waveform-coded signal 710 also has spectral coefficients corresponding to a frequency interval starting from the first cross-over frequency k _y . However, the form of a subset of the frequency range higher than the first cross-over frequency covered by the additional waveform-coded signal 710 may, of course, be varied in other embodiments. It should also be noted that a plurality of waveform-coded signals 710a-e may be received, where different waveform-coded signals may correspond to different output channels. A subset of the frequency range covered by the plurality of additional waveform-coded signals 710a-e may vary between different ones of the plurality of additional waveform-coded signals 710a-e have.

The additional waveform-coded signal 710 may be delayed by the delay stage 712 to match the timing of the upmix signals 404 output from the upmix stage 402. The upmix signals 404 and the additional waveform-coded signal 710 are then input to the interleave stage 714. [ The interleaved stage 714 is interleaved to produce an interleaved signal 704, i.e., combines the upmix signals 404 with the additional waveform-coded signal 710. In the present example, the interleaving stage 714 thus interleaves the third upmix signal 404c with the further waveform-coded signal 710. [ The interleaving may be performed by adding two signals together. However, generally speaking, the interleaving is performed by replacing the upmix signals 404 with the additional waveform-coded signal 710 in a time range and frequency range where the signals overlap.

The interleaved signal 704 is then input to the second combining stage 416,418 where the waveform-coded signals 201a- &lt; RTI ID = 0.0 &gt; e). It should be noted that the order of the interleaving stage 714 and the second combining stage 416, 418 may be reversed such that the combining is performed before the interleaving.

Further, in a situation where the additional waveform-coded signal 710 forms part of at least one of the five waveform-coded signals 210a-e, the second combining stage 416, 418 and the interleave stage RTI ID = 0.0 &gt; 714 &lt; / RTI &gt; can be combined into a single stage. In particular, such a combined stage will utilize the spectral content of the five waveform-coded signals 210a-e for frequencies up to the first cross-over frequency k _y . For frequencies above the first cross-over frequency, the combined stage will use the interleaved upmix signals 404 with the additional waveform-coded signal 710.

The interleave stage 714 may operate under control of a control signal. For this purpose, the decoder 100 'may, for example, control (via the third receiving stage 616) a control that indicates how to interleave the additional waveform-coded signal with one of the M upmix signals Signal can be received. For example, the control signal may indicate a frequency range and a time range in which the additional waveform-coded signal 710 is to be interleaved with one of the upmix signals 404. For example, the frequency range and the time range may be expressed in terms of time / frequency tiles to be interleaved. The time / frequency tiles may be time / frequency tiles related to a time / frequency grid of the QMF domain in which the interleaving occurs.

The control signal may use vectors such as binary vectors to indicate the time / frequency tiles to be interleaved. In particular, there may be a first vector with respect to the frequency direction, indicating the frequencies at which interleaving is to be performed. The indication may be made, for example, by displaying a logic one for the corresponding frequency interval in the first vector. There may also be a second vector associated with the time direction, indicating the time intervals at which the interleaving is to be performed. This indication may be made, for example, by displaying a logic one for the corresponding time interval in the second vector. For this purpose, the time frame is typically divided into a plurality of time slots such that the time indication may be in sub-frame units. By intersecting the first and second vectors, a time / frequency matrix can be constructed. For example, the time / frequency matrix may be a binary matrix having a logic one for each time / frequency tile, where the first and second vectors represent logic one. The interleaving stage 714 may then use the time / frequency matrix in interleaving execution, for example, the time at which one or more of the upmix signals 714 are displayed as in logic 1 in the time / frequency matrix / Coded &lt; / RTI &gt; signal 710 relative to the frequency tiles.

It should be noted that the vectors may use schemes different from the binary system to indicate the time / frequency tiles to be interleaved. For example, the vectors may be represented by a first value, such as zero, where no interleaving is performed, and a second value where interleaving is performed, and the interleaving may be performed on any channel identified by the second value .

FIG. 5 illustrates an exemplary block diagram of an encoding system 500 for a multi-channel audio processing system for encoding M channels according to an embodiment.

In the exemplary embodiment shown in FIG. 5, the encoding of 5.1 surround sound is described. Thus, in the illustrated example, M is set to five. It should be noted that in the described embodiment or in the figures, the low frequency effect signal is not mentioned. This does not mean that any low frequency effect is neglected. The low frequency effects (Lfe) are added to the bitstream (552) in any suitable manner well known to those skilled in the art. It should also be noted that the described encoder is equally well suited for encoding different types of surround sound, such as 7.1 or 9.1 surround sound. In the encoder 500, five signals 502 and 504 are received at a receiving stage (not shown). The encoder 500 generates five waveform-coded signals 518 by receiving the five signals 502,504 from the receiving stage and separately waveform-coding the five signals 502,504 And a first waveform-coding stage (506) configured to cause the first waveform-coding stage The waveform-coding stage 506 may for example MDCT transform each of the five received signals 502, 504. As described in connection with the decoder, the encoder may choose to encode each of the five received signals 502,504 using MDCT transforms with independent windowing. This enables an improved coding quality and thus an improved quality of the decoded signal.

The five waveform-coded signals 518 are waveform-coded for a frequency range corresponding to frequencies up to the first cross-over frequency. Thus, the five waveform-coded signals 518 have spectral coefficients corresponding to frequencies up to the first cross-over frequency. This can be accomplished by having each of the five waveform-coded signals 518 processed by a low pass filter. The five waveform-coded signals 518 are then quantized (520) according to the psychoacoustic model. The psychoacoustic model is set as precisely as possible to reproduce encoded signals that are to be perceived by the listener when decoded on the decoder side of the system, taking into account the bit rate available in the multi-channel audio processing system.

As described above, the encoder 500 performs hybrid coding with discrete multi-channel coding and parametric coding. The discrete multi-channel coding is performed in the waveform-coding stage 506 for each of the input signals 502, 504 for frequencies up to the first cross-over frequency as described above. The parametric coding is performed so that the five input signals (502, 504) from the N downmix signals for frequencies higher than the first cross-over frequency can be reconstructed at the decoder side. In the example shown in FIG. 5, N is set to two. Downmixing of the five input signals 502, 504 is performed in the downmixing stage 534. The downmixing stage 534 is beneficial to operate in the QMF domain. Thus, before being input to the downmixing stage 534, the five signals 502, 504 are converted into the QMF domain by the QMF analysis stage 526. [ The downmixing stage performs a linear downmix operation on the five signals 502, 504 and outputs two downmix signals 544, 546.

These two downmix signals 544 and 546 are converted back into the time domain by being subjected to the inverse QMF transform 554 and then received by the second waveform-coded stage 508. The second waveform-coding stage 508 waveform-codes the two downmix signals 544 and 546 for a frequency range corresponding to frequencies between the first and second cross- And generates waveform-coded downmix signals. The waveform-coding stage 508 may, for example, cause the two downmix signals to be MDCT-transformed. The two waveform-coded downmix signals thus have spectral coefficients corresponding to frequencies between the first cross-over frequency and the second cross-over frequency. The two waveform-coded downmix signals are then quantized 522 according to the psychoacoustic model.

High frequency reconstruction (HFR) parameters 538 are extracted from the two downmix signals 544, 546 to be able to reconstruct frequencies above the second cross-over frequency on the decoder side. These parameters are extracted in the HFR encoding stage 532.

The five input signals (502, 504) are received by the parametric encoding stage (530) so that the five signals from the two downmix signals (544, 546) on the decoder side can be reconstructed. The five signals 502 and 504 are parametrically coded for a frequency range corresponding to frequencies higher than the first cross-over frequency. The parametric encoding stage 530 then generates five (5) channels corresponding to the five input signals 502,504 (which are five channels in the encoded 5.1 surround sound) for a frequency range higher than the first cross- And to extract the upmix parameters 536 that can upmix the two downmix signals 544, 546 with the reconstructed signals. It should be noted that the upmix parameters 536 are extracted only for frequencies above the first cross-over frequency. This may reduce the complexity of the parametric encoding stage 530 and the bit rate of the corresponding parametric data.

Downmixing 534 may be accomplished in the time domain. In such a case, since the HRF encoding stage 532 typically operates in the QMF domain, the QMF analysis stage 526 is located downstream of the downmixing stage 534 prior to the HFR encoding stage 532 . In this case, the inverse QMF stage 554 may be omitted.

The encoder 500 also includes a bitstream generation stage, i.e., a bitstream multiplexer 524. According to an exemplary embodiment of the encoder 500, the bitstream generation stage includes five encoded and quantized signals 548, two parameter signals 536 and 538, and two encoded and quantized down Mix signals &lt; RTI ID = 0.0 &gt; 550 &lt; / RTI &gt; Which are also converted to bitstream 552 by the bitstream generation stage 524 and distributed in a multi-channel audio system.

In the multi-channel audio system described above, for example when streaming audio on the Internet, there is often a maximum available bit rate. Since the characteristics of the respective time frames of the input signals 502 and 504 are different, exactly the same bits between the five waveform-coded signals 548 and the two downmix waveform-coded signals 550 May not be used. Moreover, each of the separate signals 548 and 550 may require more or less allocated bits, so that the signals can be reconstructed according to the psychoacoustic model. According to an exemplary embodiment, the first and second waveform-coding stages 506,508 share a common bit store. The bits available per coded frame are first distributed between the first and second waveform-encoding stages 506,508 depending on the current acoustic psychological model and the characteristics of the signals to be encoded. The bits are then distributed among the separate signals 548, 550 as described above. The number of bits used for the upmix parameters 536 and the high frequency reconstruction parameters 538 is, of course, taken into account when distributing the available bits. To adjust the psychoacoustic model for the first and second waveform-coded stages (506, 508) for a perceptually smooth transition around the first cross-over frequency with respect to the number of bits allocated in a particular time frame You need to be careful.

Figure 8 illustrates an alternative embodiment of the encoding system 800. [ The difference between the encoding system 800 and the encoding system 500 of FIG. 5 is that the encoder 800 generates input signals 502,504 for a frequency range corresponding to a subset of the frequency range higher than the first cross- To generate an additional waveform-coded signal by waveform-coding one or more of the waveform-coded signals.

For this purpose, the encoder 800 comprises an interleave detection stage 802. [ The interleaving detection stage 802 includes a portion of the input signals 502,504 that are not well reconstructed by the parametric reconstruction as encoded by the parametric encoding stage 530 and the high frequency reconstruction encoding stage 532. [ Lt; / RTI &gt; For example, the interleaving detection stage 802 may be implemented by parametric reconstruction of the input signal (502, 504) as defined by the parametric encoding stage (530) and the high frequency reconstruction encoding stage (532) (502, 504). Based on this comparison, the interleaving detection stage 802 may identify a subset 804 of frequency range higher than the first cross-over frequency to be waveform-coded. The interleaving detection stage 802 may also identify a time range in which the identified subset 804 of the frequency range higher than the first cross-over frequency is waveform-coded. The identified frequency and time subsets 804 and 806 may be input to the first waveform encoding stage 506. Based on the received frequency and time subsets 804 and 806, the first waveform encoding stage 506 may generate the input signals &lt; RTI ID = 0.0 &gt; Coded &lt; / RTI &gt; signal 808 by waveform-coding one or more of the waveform-coded signals 502,504. The additional waveform-coded signal 808 may then be encoded and quantized by the stage 520 and added to the bit-stream 846.

The interleave detection stage 802 may also include a control signal generation stage. The control signal generation stage is configured to generate a control signal (810) indicating how to interleave the additional waveform-coded signal with a parametric reconstruction of one of the input signals (502, 504) at the decoder. For example, the control signal may indicate a frequency range and a time range in which the additional waveform-coded signal is to be interleaved with parametric reconstruction as described with reference to Fig. The control signal may be added to the bitstream 846.

Equivalents, Expansion, Substitution and Others

Additional embodiments of the present disclosure will be apparent to those skilled in the art after having learned the foregoing specification. Although the present specification and drawings disclose embodiments and examples, this disclosure is not limited to these specific examples. Various modifications and changes may be made without departing from the scope of the present disclosure as defined by the appended claims. Any reference signs shown in the claims should not be construed as limiting the scope thereof.

Additionally, modifications to the disclosed embodiments can be understood by those skilled in the art by practicing the present teachings, by studying these figures, specification, and claims, and the results obtained. In the claims, the word "comprising" does not exclude other elements or steps, and does not exclude a plurality unless otherwise stated. The mere fact that any measure is recited in mutually different dependent claims does not indicate that a combination of these measures can not be beneficially used.

The systems and methods disclosed herein may be implemented in software, firmware, hardware, or a combination thereof. In a hardware implementation, the division of work between the functional units referred to in the above description does not necessarily correspond to the division into physical units; In contrast, one physical component may have multiple functions, and one operation may be performed by some physical components in concert. Any or all of the components may be implemented as software executed by a digital signal processor or microprocessor, and may be implemented as hardware or as application specific integrated circuits. Such software may be distributed on computer readable media, which may include computer storage media (or non-temporary media) and communication media (or temporary media). As is known to those skilled in the art, the term "computer storage media" is intended to be embodied in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data It includes both volatile and nonvolatile, removable and non-removable media. Computer storage media includes but is not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, A device or other magnetic storage device, or any other medium which is capable of storing the desired information and which can be accessed by a computer. It will also be understood by those skilled in the art that communication media typically includes computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transmission mechanism, will be.

100: decoder
200,300,400: conceptual part
500: encoder
506,508: Waveform-Coding Stage
520, 522: Encoding and quantization stage
524: Bitstream multiplexer
530: parametric encoding stage
532: HFR encoding stage
534: Downmixing stage

Claims (16)

A method for decoding an encoded audio bitstream in an audio processing system,
Extracting from the encoded audio bit stream a first waveform-coded signal having spectral coefficients corresponding to frequencies up to a first cross-over frequency;
Performing a parametric decoding at a second cross-over frequency to generate a reconstructed signal, wherein the second cross-over frequency is higher than the first cross-over frequency and the parametric decoding Performing the parametric decoding using reconstruction parameters obtained from the encoded audio bitstream to generate a reconstructed signal;
Extracting from the encoded audio bit stream a second waveform-coded signal having spectral coefficients corresponding to a subset of frequencies higher than the first cross-over frequency;
Interleaving the second waveform-coded signal with the reconstructed signal to produce an interleaved signal; And
And combining the interleaved signal with the first waveform-coded signal. &Lt; Desc / Clms Page number 21 &gt; The method according to claim 1,
Wherein the first cross-over frequency is dependent on a bit transmission rate of the audio processing system. The method according to claim 1,
(I) adding the reconstructed signal to the second waveform-coded signal, (ii) combining the reconstructed signal with the second waveform-coded signal, or (iii) ) Replacing the reconstructed signal with the second waveform-coded signal. &Lt; Desc / Clms Page number 14 &gt; The method according to claim 1,
(i) combining the interleaved signal with the first waveform-coded signal is performed in a frequency domain or (ii) performs parametric decoding at a second cross-over frequency to generate the reconstructed signal RTI ID = 0.0 &gt; 1, &lt; / RTI &gt; wherein the step of decoding is performed in a frequency domain. The method according to claim 1,
Wherein performing the parametric decoding is a high frequency reconstruction using (i) parametric upmixing using upmix parameters or (ii) high frequency reconstruction parameters. The method according to claim 1,
Wherein performing the parametric decoding comprises performing spectral band replication (SBR). The method according to claim 1,
Further comprising receiving a control signal used during the interleaving to generate the interleaved signal. &Lt; Desc / Clms Page number 21 &gt; 8. The method of claim 7,
Wherein the control signal indicates how to interleave the second waveform-coded signal with the reconstructed signal by specifying a frequency range or time range for the interleaving step, wherein the control signal decodes the encoded audio bit stream in the audio processing system Way. 8. The method of claim 7,
Wherein the first value of the control signal indicates that interleaving is performed for each frequency domain. The method according to claim 1,
Wherein the interleaving is performed prior to the combining step. The method according to claim 1,
Wherein the audio processing system is a hybrid decoder that performs waveform-decoding and parametric decoding. The method according to claim 1,
Wherein the first waveform-coded signal and the second waveform-coded signal share a common bit store using a psychoacoustic model. The method according to claim 1,
Wherein said interleaving and said combining are combined in a single stage or operation. The method according to claim 1,
Wherein the first waveform-coded signal and the second waveform-coded signal are signals representative of a waveform of an audio signal in the frequency domain. An audio decoder for decoding an encoded audio stream,
A demultiplexer for extracting from the encoded audio bit stream a first waveform-coded signal having spectral coefficients corresponding to frequencies up to a first cross-over frequency;
And a parametric decoder operating at a second cross-over frequency to generate a reconstructed signal, wherein the second cross-over frequency is higher than the first cross-over frequency and the parametric decoding is to generate the reconstructed signal Using the reconstruction parameters obtained from the encoded audio bitstream;
A demultiplexer for extracting from the encoded audio bit stream a second waveform-coded signal having spectral coefficients corresponding to a subset of frequencies higher than the first cross-over frequency;
An interleaver for interleaving the second waveform-coded signal with the reconstructed signal to produce an interleaved signal; And
And a combiner for combining the interleaved signal with the first waveform-coded signal. 17. A non-transitory computer readable medium comprising instructions that when executed by a processor perform the method of claim 1.

Images