WO2024256476A1 - Audio decoder, audio encoder and method for coding frames using a pitch frequency dependent spectral shaping - Google Patents
Audio decoder, audio encoder and method for coding frames using a pitch frequency dependent spectral shaping Download PDFInfo
- Publication number
- WO2024256476A1 WO2024256476A1 PCT/EP2024/066258 EP2024066258W WO2024256476A1 WO 2024256476 A1 WO2024256476 A1 WO 2024256476A1 EP 2024066258 W EP2024066258 W EP 2024066258W WO 2024256476 A1 WO2024256476 A1 WO 2024256476A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- spectral
- pitch frequency
- function
- shaping function
- spectrum
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/06—Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/032—Quantisation or dequantisation of spectral components
Definitions
- Embodiments according to the invention are related to an audio decoder, an audio encoder and a method for coding frames using a pitch frequency dependent spectral shaping.
- Embodiments are related to low-frequency emphasis and deemphasis for low-bitrate coding of tonal audio.
- Embodiments according to the invention comprise an audio decoder configured to, for a predetermined frame among consecutive frames, decode, from a data stream, a quantized spectrum, a linear prediction coefficient based spectral envelope representation and a fundamental frequency related parameter.
- the decoder is configured to determine a spectral shaping function from the linear prediction coefficient based spectral envelope representation using a first manner below a pitch frequency determined from the fundamental frequency related parameter, and a second manner above the pitch frequency, to spectrally shape the quantized spectrum using the spectral shaping function to obtain a dequantized spectrum and to reconstruct the predetermined frame using the dequantized spectrum.
- the audio decoder is configured so that the spectral shaping function is, at a predetermined spectral position, lower if the pitch frequency is spectrally higher than the predetermined spectral position, than compared to if the pitch frequency is spectrally lower than the predetermined spectral position.
- the inventors recognized that an adaptation of an emphasis of spectral coefficients may be performed efficiently based on a pitch frequency, in order to improve an acoustic quality of a decoded audio signal.
- the spectral shaping function may be modified differently in a portion above the pitch frequency in contrast to a portion below the pitch frequency. This may allow reducing a number and influence of artifacts in the reconstructed waveforms that are particularly prevalent at low frequencies, where the human auditory system is sensitive to such artifacts, for example, caused by a low coding SNR.
- an adaptation of a coding SNR may be performed based on an adaptation of a spectral shaping function using the pitch frequency.
- the inventors recognized that an information about such a pitch frequency may be obtained using a fundamental frequency related parameter.
- a fundamental frequency related parameter are readily available in the data stream (e.g. in the form of a bitstream), and hence, pitch frequency information may be harvested without, or with minor, introduction of additional signaling overhead.
- the spectral shaping function may provide or represent one scale factor or scaling factor per spectral band.
- a spectral shaping may comprise a multiplication of each coefficient level with a respective scale factor.
- spectral shaping function being lower for spectral positions below the pitch frequency than above the pitch frequency, low frequency spectral coefficients may be deemphasized in order to compensate for an encoder sided emphasis that allows the provision of a higher coding SNR, in order to prevent the artifacts.
- an amount at which the spectral shaping function is, at the predetermined spectral position, lower if the pitch frequency is spectrally higher than the predetermined spectral position, than compared to if the pitch frequency is spectrally lower than the predetermined spectral position corresponds to a dip function with using a distance between the predetermined spectral position and the pitch frequency as an attribute of the dip function.
- the dip function may comprise the shape of a parabola, at least approximately.
- a local modification of a spectral shaping function e.g. an intermediate spectral shaping function, according to a dip function may allow providing a manipulation, e.g. in the sense of emphasis or de-emphasis respectively, so that good acoustic properties of the reconstructed signal may be achieved.
- Embodiments according to the invention comprise an audio decoder configured to, for a predetermined frame among consecutive frames, decode, from a data stream, a quantized spectrum, a linear prediction coefficient based spectral envelope representation, and a fundamental frequency related parameter.
- the decoder is configured to realize the dip by means of a sequential approach.
- the decoder determines an intermediate version of a spectral shaping function from the linear prediction coefficient based spectral envelope representation, and forms, below a pitch frequency determined from the fundamental frequency related parameter, a local spectral reduction in the intermediate version of the spectral shaping function by aligning a reduction function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and applying the reduction function thus aligned to the intermediate version of the spectral shaping function.
- the decoder is configured to spectrally shape the quantized spectrum using the spectral shaping function to obtain a dequantized spectrum, and to reconstruct the predetermined frame using the dequantized spectrum.
- the determination of the spectral shaping function may, for example, be performed efficiently in a sequential approach.
- the intermediate version of the spectral shaping function may be determined based on the linear prediction coefficient, LPC, based spectral envelope representation.
- such an intermediate spectral shaping function may be determined according to a desired noise shaping above the pitch frequency, but for the whole frequency range of the intermediate shaping function.
- the intermediate spectral shaping function may be determined according to conventional approaches.
- an intermediate shaping function may be adapted below the pitch frequency, using the reduction function.
- This may allow an effortless integration of the inventive approach into existing frameworks, since only a correction of the intermediate version of a spectral shaping function, e.g. a conventionally determined spectral shaping function, may have to be added.
- an application of the reduction function may be selectively activated, e.g. based on a coding mode parameter, for example, only for frames comprising significant tonal low frequency signal portions.
- the decoder may, for example, be configured to determine an intermediate version of a spectral shaping function from the linear prediction coefficient based spectral envelope representation, e.g. according to conventional approaches, and may, for example, be configured to form (e.g. thereafter, e.g.
- the spectral shaping function may be the result of the application of the aligned reduction function to the intermediate version of the spectral shaping function.
- the below-pitch-frequency dip idea manifests itself in a different processing of frames coded in one mode compared to the processing of frames coded in a different mode.
- the embodiments comprise an audio decoder configured to, for a predetermined frame among consecutive frames, decode, from a data stream, a quantized spectrum, a linear prediction coefficient based spectral envelope representation, and a coding mode parameter.
- the decoder is configured to, if the coding mode parameter fulfils a predetermined criterion, determine a spectral shaping function from the linear prediction coefficient based spectral envelope representation using a first manner and, if the coding mode parameter does not fulfil the predetermined criterion, determine spectral the shaping function from the linear prediction coefficient based spectral envelope representation using a second manner, wherein the first manner and the second manner differ so that a difference between the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the first manner in case of the coding mode parameter fulfilling the predetermined criterion, minus the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the second manner in case of the coding mode parameter not fulfilling the predetermined criterion, comprises a dip below a pitch frequency.
- the decoder is configured to spectrally shape the quantized spectrum using the spectral shaping function to obtain a dequantized spectrum, and to reconstruct the predetermined frame using the dequantized spectrum.
- a determination of the spectral shaping function may be performed based on a coding mode parameter, so that in one case or manner, the spectral shaping function may comprise different sections below and above a pitch frequency, for implementing individual emphasizes, and wherein in the other case or manner, the spectral shaping function may not comprise a lower and higher frequency section with individually adapted emphasis correction.
- a switching between activated emphasis adaptation or correction and deactivated emphasis adaptation or correction may be performed. Accordingly, in some cases additional computational effort may be avoided.
- the spectral shaping functions as obtained using the first and second manner may differ in a dip, for example in the form of a parabola, below the pitch frequency.
- a dip for example in the form of a parabola
- the coding mode parameter may comprise an information about a tonality of the encoded audio signal.
- the “tonality” may indicate a measure describing how condensed the audio signal’s energy is at a certain point of time in the respective spectrum associated with that point in time. If the energy is spread much, such as in noisy or transient temporal phases of the audio signal, then the tonality is low. But if the energy is substantially condensed to one or more spectral peaks, then the tonality is high.
- Embodiments may allow improving an acoustic quality of tonal audio in low frequencies in particular, hence, the inventive adaptation of the spectral shaping may be switchably activated depending on an audio signal having such characteristics or not by using the encoder’s frame mode indication: frames being non-tonal may be left unmodified with respect to the dip provision, while frames being coded using a mode for tonal frames may be subject to the dip provision modification. Since the frames to be subject to dip processing are already indicated in the data stream by indicating a corresponding coding mode, it might, according to an embodiment, be possible for the decoder to determine the pitch frequency without explicit transmission in the data stream.
- an audio decoder configured to decode a fundamental frequency related parameter, may as well be configured to perform a determination of the spectral shaping function according to a first and/or second manner based on a coding mode parameter.
- the determination of the spectral shaping function with emphasis correction according to the first or respectively second manner may be performed sequentially, e.g. based on the determination of an intermediate spectral shaping function.
- embodiments according to the invention comprise encoders corresponding to the decoders as disclosed herein, as well as methods corresponding the encoders and decoders as disclosed herein.
- encoders and methods as described herein may be based on the same considerations as the decoders described herein.
- the encoders and methods can, by the way, be completed with all features and functionalities, both individually and in combination, which are also described with regard to the decoders - and vice versa.
- embodiments according to the invention comprise a method for a predetermined frame among consecutive frames, the method comprising: decoding, from a data stream, a quantized spectrum, a linear prediction coefficient based spectral envelope representation, and a fundamental frequency related parameter. Furthermore, the method comprises determining a spectral shaping function from the linear prediction coefficient based spectral envelope representation using a first manner below a pitch frequency determined from the fundamental frequency related parameter, and a second manner above the pitch frequency, spectrally shaping the quantized spectrum using the spectral shaping function to obtain a dequantized spectrum, and reconstructing the predetermined frame using the dequantized spectrum.
- the determination of the spectral shaping function is performed so that the spectral shaping function is, at a predetermined spectral position, lower if the pitch frequency is spectrally higher than the predetermined spectral position, than compared to if the pitch frequency is spectrally lower than the predetermined spectral position.
- embodiments comprise a method, for a predetermined frame among consecutive frames, the method comprising decoding, from a data stream, a quantized spectrum; a linear prediction coefficient based spectral envelope representation, and a fundamental frequency related parameter. Furthermore, the method comprises determining an intermediate version of a spectral shaping function from the linear prediction coefficient based spectral envelope representation, below a pitch frequency determined from the fundamental frequency related parameter, forming a local spectral reduction in the intermediate version of the spectral shaping function by aligning a reduction function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and applying the reduction function thus aligned to the intermediate version of the spectral shaping function. The method further comprises spectrally shaping the quantized spectrum using the spectral shaping function to obtain a dequantized spectrum, and reconstructing the predetermined frame using the dequantized spectrum.
- Embodiments comprise a method, for a predetermined frame among consecutive frames, the method comprising, decoding, from a data stream, a quantized spectrum; a linear prediction coefficient based spectral envelope representation, and a coding mode parameter. Furthermore, the method comprises, if the coding mode parameter fulfils a predetermined criterion, determining a spectral shaping function from the linear prediction coefficient based spectral envelope representation using a first manner and, if the coding mode parameter does not fulfil the predetermined criterion, determining the spectral shaping function from the linear prediction coefficient based spectral envelope representation using a second manner, wherein the first manner and the second manner differ so that a difference between the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the first manner in case of the coding mode parameter fulfilling the predetermined criterion, minus the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the second manner in case of the coding mode parameter not fulfilling the predetermined cri
- Embodiments comprise a method, for a predetermined frame among consecutive frames, the method comprising determining a linear prediction coefficient based spectral envelope representation and a spectrum, determining an inverse of a spectral shaping function from the linear prediction coefficient based spectral envelope representation using a first manner below a pitch frequency, and a second manner above the pitch frequency, spectrally shaping the spectrum using the inverse of the spectral shaping function to obtain a shaped spectrum and quantize the shaped spectrum to obtain a quantized spectrum, and encoding, into a data stream, the quantized spectrum, the linear prediction coefficient based spectral envelope representation, and a fundamental frequency related parameter from which the pitch frequency is determinable.
- the determination of the inverse of the spectral shaping function is performed so that the inverse of the spectral shaping function is, at a predetermined spectral position, higher if the pitch frequency is spectrally higher than the predetermined spectral position, than compared to if the pitch frequency is spectrally lower than the predetermined spectral position.
- Embodiments comprise a method, for a predetermined frame among consecutive frames, the method comprising determining a linear prediction coefficient based spectral envelope representation and a spectrum, determining an intermediate version of a spectral shaping function or of an inverse of the spectral shaping function from the linear prediction coefficient based spectral envelope representation, below a pitch frequency determined from the fundamental frequency related parameter, forming a local spectral reduction in the intermediate version of the spectral shaping function by aligning a reduction function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and applying the reduction function thus aligned to the intermediate version of the spectral shaping function or a local spectral increase in the intermediate version of the inverse of the spectral shaping function by aligning an increase function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and applying the increase function thus aligned to the intermediate version of the inverse of the spect
- the method further comprises spectrally shaping the spectrum using the inverse of the spectral shaping function to obtain a shaped spectrum and quantizing the shaped spectrum to obtain a quantized spectrum, and encoding, into a data stream, the quantized spectrum; the linear prediction coefficient based spectral envelope representation, and a fundamental frequency related parameter from which the pitch frequency is determinable.
- Embodiments comprise a method, for a predetermined frame among consecutive frames, the method comprising determining a linear prediction coefficient based spectral envelope representation, a spectrum and a coding mode parameter.
- the method comprises, if the coding mode parameter fulfils a predetermined criterion, determining a spectral shaping function from the linear prediction coefficient based spectral envelope representation using a first manner and, if the coding mode parameter does not fulfil the predetermined criterion, determining the spectral shaping function from the linear prediction coefficient based spectral envelope representation using a second manner, wherein the first manner and the second manner differ so that a difference between the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the first manner in case of the coding mode parameter fulfilling the predetermined criterion, minus the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the second manner in case of the coding mode parameter not fulfilling the predetermined criterion, comprises a dip below a pitch frequency.
- the method comprises, if the coding mode parameter fulfils the predetermined criterion, determining an inverse of a spectral shaping function from the linear prediction coefficient based spectral envelope representation using a first manner and, if the coding mode parameter does not fulfil the predetermined criterion, determining the inverse of the spectral shaping function from the linear prediction coefficient based spectral envelope representation using a second manner, wherein the first manner and the second manner differ so that a difference between the inverse of the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the first manner in case of the coding mode parameter fulfilling the predetermined criterion, minus the inverse of the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the second manner in case of the coding mode parameter not fulfilling the predetermined criterion, comprises an inverse of a dip below a pitch frequency.
- the method further comprises spectrally shaping the spectrum using the inverse of the spectral shaping function to obtain a shaped spectrum and quantizing the shaped spectrum to obtain a quantized spectrum, and encoding, into a data stream, the quantized spectrum; the linear prediction coefficient based spectral envelope representation, and the coding mode parameter.
- Fig. 1 shows a schematic view of a decoder according to embodiments of the invention
- Fig. 2 a-c shows schematic plots of spectral amplitudes (intensity) over spectral index (frequency) according to conventional approaches (a), and according to embodiments of the invention (b), (c); and
- Fig. 3 shows a schematic view of an encoder according to embodiments of the invention.
- deemphasis i. e., inverse of emphasis
- deemphasis i. e., inverse of emphasis
- Such artifacts occur especially in low frequencies, where the human auditory system is most sensitive to distortion caused by a low coding SNR in the absence of (de)emphasis.
- the purpose of low-frequency (de)emphasis may, for example, be to increase the SNR in lower frequencies during audio coding incorporating time- or frequencydomain quantization.
- AMR-WB+ 3GPP AMR-Wideband Plus
- EVS Enhanced Voice Services
- the former codec makes use of an ALFE approach adapted (i. e., controlled) by the values of the low-frequency spectral coefficients themselves.
- the advantage of such a solution is that no additional information needs to be transmitted to the decoder, so an increase in the coding bitrate is avoided.
- this ALFE process is not perfectly invertible, thus potentially causing additional coding artifacts.
- Fig. 1 showing a schematic view of a decoder according to embodiments of the invention, which may allow to address drawbacks of the above discussed prior approaches.
- Fig. 1 shows a decoder 100 comprising a decoding unit 110, a spectral shaping function determination unit 120, a spectral shaping unit 130 and a reconstruction unit 140.
- Decoding unit 110 is configured to decode an incoming data stream 101 in order to obtain a LPC based spectral envelope representation 111 and a quantized spectrum 112.
- the decoding unit 110 may be configured to decode a fundamental frequency related parameter 113 and/or a coding mode parameter
- the data stream 101 may comprise an encoded information about a predetermined frame, e.g. audio frame, among consecutive frames.
- Decoding may, for example, be performed according to any suitable approach, for example such as using entropy decoding, such as context adaptive variable length decoding or context adaptive binary arithmetic decoding.
- decoding unit 110 may be configured to decode, from the data stream 101, the quantized spectrum 112 by entropy decoding and/or in form of spectral coefficient levels of an MDCT
- the spectral shaping function determination unit 120 may be configured to determine a spectral shaping function 121 from the linear prediction coefficient based spectral envelope representation 111 using a first manner below a pitch frequency determined from the fundamental frequency related parameter 113, and a second manner above the pitch frequency.
- the fundamental frequency related parameter 113 may, for example, comprise an information about the lowest frequency of a periodic waveform of quantized spectrum 112. Hence, parameter 113 may describe an information about a first harmonic frequency of the quantizes spectrum 112. Based thereon, as explained above, the pitch frequency may be determined. This way, using already (e.g. according to conventional approaches) present encoded information, according to embodiments, a threshold frequency, in the form of the pitch frequency may be determined according to which the spectral shaping function can be manipulated (e.g. emphasized or de-emphasized), in order to achieve a desired SNR for a respective frequency region.
- the spectral shaping function determination unit 120 is configured to determine the spectral shaping function 121 , so that the spectral shaping function 121 is, at a predetermined spectral position, lower if the pitch frequency is spectrally higher than the predetermined spectral position, than compared to if the pitch frequency is spectrally lower than the predetermined spectral position.
- a spectral envelope, as defined by the LPC based spectral envelope representation 111 is lowered in a low frequency region, namely the spectral position below the pitch frequency.
- the spectral shaping function 121 is provided to the spectral shaping unit 130 in order to scale and dequantize the quantized spectrum, in order to obtain the dequantized spectrum 131, which is then forwarded to reconstruction unit 140 in order to determine the reconstructed audio frame 141.
- the reconstruction unit 140 may be configured to reconstruct the predetermined frame 141 using the dequantized spectrum by applying a spectrum-to-time transformation to the quantized spectrum, and/or using an overlap-add aliasing cancellation process with respect to one or more temporally neighboring frames.
- no coding mode parameter 114 may be present in the data stream 101 and/or such a coding mode parameter 114 may not be decoded and/or considered by decoder 100.
- the spectral shaping function determination 120 unit may be configured to determine an intermediate version of the spectral shaping function 121.
- the intermediate version may, for example, be a version of the spectral shaping function 121 , wherein no emphasis compensation is yet incorporated.
- the spectral shaping function determination unit 120 may optionally be configured to, below a pitch frequency determined from the fundamental frequency related parameter, form a local spectral reduction in the intermediate version of the spectral shaping function by aligning a reduction function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and applying the reduction function thus aligned to the intermediate version of the spectral shaping function.
- the spectral shaping function determination unit 120 may be configured to determine a correction function, namely the reduction function, based on which, e.g. multiplicatively, the intermediate spectral shaping function is adapted in order to incorporate an emphasis correction in a low frequency region.
- the processing thereon e.g. from quantized spectrum 112 and spectral shaping function 121 to reconstructed audio-frame 141 may be performed as explained with regard to the first example.
- no coding mode parameter 114 may be present in the data stream 101 and/or such a coding mode parameter 114 may not be decoded and/or considered by decoder 100.
- the determination of the spectral shaping function may be performed based on a decoding of the LPC based spectral envelope representation 111 , and the coding mode parameter 114.
- the coding mode parameter 114 may be included in the data stream 101 and/or such a fundamental frequency related parameter 113 may not be decoded and/or considered by decoder 100.
- the spectral shaping function determination unit120 may be configured to, if the coding mode parameter 114 fulfils a predetermined criterion, determine a spectral shaping function 121 from the linear prediction coefficient based spectral envelope representation 111 using a first manner and, if the coding mode parameter 114 does not fulfil the predetermined criterion, determine the spectral shaping function from the linear prediction coefficient based spectral envelope representation 111 using a second manner, wherein the first manner and the second manner differ so that a difference between the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation 111 using the first manner in case of the coding mode parameter 114 fulfilling the predetermined criterion, minus the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the second manner in case of the coding mode parameter not fulfilling the predetermined criterion, comprises a dip below a pitch frequency.
- the inventive determination of the spectral shaping function may be switchably selected, e.g. according to said coding mode parameter 114. Hence, computational costs may be kept low.
- the processing thereon e.g. from quantized spectrum 112 and spectral shaping function 121 to reconstructed audio-frame 141 may be performed as explained with regard to the first and second example.
- the pitch frequency may optionally be determined by the spectral shaping function determination unit, for example based on the quantized spectrum 112 (not shown), e.g. without usage of a fundamental frequency related parameter 113, or based on the quantized spectrum 112 along with the LPC based envelops representation by determining, based thereon, an intermediate dequantized spectrum and determining, based on the latter, a pitch frequency.
- the pitch frequency might be sufficiently accurate.
- the encoder would not have to transmit additional information.
- the fundamental frequency related parameter 113 might be transmitted in the data stream.
- decoder 100 may optionally be configured to, if the coding mode parameter 114 fulfils the predetermined criterion, decode, from the data stream 101 , a fundamental frequency related parameter 113 for the predetermined frame, and to derive the pitch frequency based on the fundamental frequency related parameter.
- the dip may optionally follow a dip function and the audio decoder 100 is optionally configured to determine the dip function in a manner depending on the pitch frequency so that the dip function comprises a local extremum at half of the pitch frequency, monotonically deceases - or even strictly monotonically decreases - between zero-frequency and half of the pitch frequency, and monotonically - or even strictly monotonically - increases between half of the pitch frequency and the pitch frequency, as will be discussed in the context of Fig. 2 b (NOTE: here, the dip function is negative and its input/attribute is usual frequency so that the dip function is actually a “dip”, here extending over the whole reach of the pitch frequency).
- the dip function may have a dip shape, which is independent from the pitch frequency and has a dip interval width whose upper limit is aligned with the pitch frequency, and the difference is zero for frequencies between zero frequency and the pitch frequency minus the dip interval width, e.g. as will be discussed in the context of Fig. 2 c.
- a dip function e.g. as a correction function or a reduction function for the intermediate spectral shaping function may be performed in the spectral shaping function determination unit.
- a switchable activation of an inventive emphasis correction may be implemented based on the coding mode parameter 114, whilst determining a respective pitch frequency based on the fundamental frequency related parameter 113.
- an emphasis correction may be performed in the form of spectrally lower and higher sections, e.g. as explained according to the first example, or with the more distinct adaptation according to a dip function.
- any of these cases may be adapted towards a sequential approach wherein an intermediate spectral shaping function is determined and afterwards amended.
- audio decoder 100 may optionally additionally be configured to decode, from the data stream 101, a coding mode parameter 114 for each of the consecutive frames, and to decide based on the coding mode parameter 114 so as to, for frames for which the coding mode parameter fulfils a predetermined criterion, decode a fundamental frequency related parameter from the data stream 113, determine a spectral shaping function 121 from the linear prediction coefficient based spectral envelope representation 111 using the first manner below a pitch frequency determined from the fundamental frequency related parameter, and the second manner above the pitch frequency, and for frames for which the coding mode parameter does not fulfil the predetermined criterion, determine a spectral shaping function 121 from the linear prediction coefficient based spectral envelope representation 111 using one manner over all frequencies.
- audio decoder 100 may optionally additionally be configured to, determine the spectral shaping function 121 from the linear prediction coefficient based spectral envelope representation 111, by determining an intermediate version of the spectral shaping function from the linear prediction coefficient based spectral envelope representation and below a pitch frequency determined from the fundamental frequency related parameter, to form a local spectral reduction in the intermediate version of the spectral shaping function by aligning a reduction function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and applying the reduction function thus aligned to the intermediate version of the spectral shaping function.
- audio decoder 100 may optionally additionally be configured to decode, from the data stream 101, a coding mode parameter 114 for each of the consecutive frames, and decide based on the coding mode parameter 114 so as to, for frames for which the coding mode parameter fulfils a predetermined criterion, decode the fundamental frequency related parameter 113 from the data stream 101 , determine an intermediate version of a spectral shaping function from the linear prediction coefficient based spectral envelope representation, below a pitch frequency determined from the fundamental frequency related parameter, form a local spectral reduction in the intermediate version of the spectral shaping function by aligning a reduction function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and applying the reduction function thus aligned to the intermediate version of the spectral shaping function, and for frames for which the coding mode parameter 114 does not fulfil the predetermined criterion, determine the spectral shaping function 121 so as to
- Fig.2 illustrates the need for improved ALFE below the fundamental frequency of tonal and/or harmonic audio signals, e.g. as may be inventively indicated by the pitch frequency, along with particular realizations of the present invention.
- decoder 100 may comprise a backward adaptive coding tool 150.
- a correlation between already decoded frames and subsequently decoded frames such as temporally following frames of the same audio channel or one or more frames of another channel, may, for example, be exploited in order to improve an efficiency of the decoding. Therefore, as shown, tool 150 may be provided with spectrum 131. For instance, such a reconstructed spectrum 131 may be used to perform synthesized filling of zero-quantized portions in subsequently decoded frames, or to perform MS (mid/side decoding) or to perform spectrum prediction and prediction residual decoding.
- backward adaptive coding tool 150 may be provided with additionally encoded parameters in order to perform or guide or control such an improved decoding, e.g. in the form of a prediction, e.g. from decoding unit 1010 which would decode such parameters from the data stream.
- decoder 100 may be configured to perform a frequency-domain prediction, e.g. in accordance with MPEG-H Audio (e.g. ISO / IEC (MPEG-H), International Standard 23008-3:2022, “High efficiency coding and media delivery in heterogeneous environments-Part 3: 3D audio,” Aug. 2022.) or long-term prediction (LTP) as in AAC (1990s years).
- MPEG-H Audio e.g. ISO / IEC (MPEG-H), International Standard 23008-3:2022, “High efficiency coding and media delivery in heterogeneous environments-Part 3: 3D audio,” Aug. 2022.
- LTP long-term prediction
- An approach in accordance with MPEG-H Audio may be used according to US-application 16/802,397.
- An approach according to “improved LTP” may be used according to Goran Markovic et al. (application, 2020 / 2021). According to embodiments, different variants may be used.
- a fundamental frequency parameter for example a pitch information
- a respective fundamental frequency information e.g. pitch frequency information
- Such an information may be encoded in data stream 101 and hence be decoded using decoding unit 110, e.g. in the form of the fundamental frequency related parameter 113.
- Fig. 2 shows schematic plots of spectral amplitudes (intensity) over spectral index (frequency) according to conventional approaches (a) and according to embodiments of the invention (b) and (c).
- pt is a pitch value (e.g. pitch frequency), measured in units of spectral bin indices, for a given frame f.
- pitch value e.g. pitch frequency
- pf is drawn in Fig. 2 a as the distance between harmonics, which may be equivalent to the index of the fundamental tone, hence, as an example 6 (Please note, that pt may as well be indicated in Fig. 2 between indices 0 and 6 and/or exactly at index 6).
- the interval below spectral index 6 may represent a low frequency region, wherein the human auditory system is sensitive to low coding SNR and hence such a coarse quantization
- an improved quantization and a mitigation of coding artifacts may be achieved (c): same as (b) but with adaptive low-frequency deemphasis whose spectral range is fixed (4 spectral indices, e.g. as shown from spectral indices 2 to 6; dip function 210c; improved quantization 200c).
- an amount at which the spectral shaping function 121 is, at the predetermined spectral position, lower if the pitch frequency, e.g. pt, e.g. as represented by spectral index 6, is spectrally higher than the predetermined spectral position, than compared to if the pitch frequency is spectrally lower than the predetermined spectral position may correspond to a dip function, e.g. 210 b, with using a distance between the predetermined spectral position and the pitch frequency as an attribute of the dip function.
- the dip function may be parabolashaped.
- the dip function 210b may be determined in a manner depending on the pitch frequency, e.g. as represented by spectral index 6, so that the dip function comprises a local extremum at half of the pitch frequency (hence spectral index 3), monotonically - or even strictly monotonically - increases between zero-frequency and half of the pitch frequency (see section 224), and monotonically - or even strictly monotonically - decreases between half of the pitch frequency and the pitch frequency (see section 222). It is to be noted that here, the dip function is to describe the amount of reduction and may, thus, be the absolute of the dip shape.
- the dip function’s input/attribute is defined to be the distance from the pitch frequency (towards DC, see 220) so that the dip function may actually be a “hill”, here extending over the whole reach of the pitch frequency) and it is defined from right to left which makes no difference in the explicit examples described so far, as, for instance, the parabolic shape is symmetric anyway, but the hill/dip shape may alternatively, for all embodiments described herein, by asymmetric.
- a decoder e.g. 1000, may be configured to determine a reduction function for an adaptation of an intermediate spectral shaping function in a manner depending on the pitch frequency.
- Such a spectral scaling, according to the constant quantization stepsize may represent an intermediate spectral shaping function according to embodiments, which may be identical to the spectral shaping function above the pitch frequency.
- q’f is constant above the pitch frequency (index 6) in Fig 2 b and 2 c.
- the intermediate spectral shaping function may be represented by the quantization stepsize of qf over the whole frequency range.
- determining a location for the de-emphasis of the intermediate spectral shaping or in other words scaling may be performed, resulting in the adapted spectral shaping functions as represented by q’f in Fig 2 b and 2 c, having the parabola shaped quantization step sizes in the interval between spectral indices 0 and 6 (Fig. 2 b).
- a shape of the parabola which extends over the whole interval between spectral indices 0 and 6 is dependent on the pitch frequency and may represent a corresponding reduction function.
- the dip function 210c may have a unimodal shape, which is independent from the pitch frequency, e.g. as represented by spectral index 6, and may have a dip interval width, e.g. as shown of 4 (spanning from index 2 to 6). Furthermore, the dip function may have a constant value for the distance being larger than the dip interval width, e.g. as shown from spectral index 0 to index 2.
- the dip function 210 c may be positive and its input/attribute may be the distance from the pitch frequency towards DC (see 220) so that the dip function may actually be a “hill”, here extending over a fixed reach from the pitch frequency towards DC and being zero, or some other value, for frequencies nearer to DC).
- a decoder is optionally configured to determine the reduction function (e.g. the dips in Fig. 2 b and 2 c) in a manner depending on the pitch frequency so that the reduction function comprises a local extremum leading to a local extreme of reduction of the spectral shaping function at a spectral position which corresponds to the pitch frequency minus a predetermined interval width value.
- the reduction function e.g. the dips in Fig. 2 b and 2 c
- the reduction function may be of no reducing strength between zero-frequency and the spectral position minus the interval width, of monotonically - or even strictly monotonically - deceasing reducing strength between the spectral position minus the interval width and the spectral position, and of monotonically - or even strictly monotonically - increasing reducing strength between the spectral position and the spectral position plus the interval width value.
- a decoder e.g. 1000, according to embodiments is optionally configured to determine the reduction function in a manner depending on the pitch frequency so that the reduction function comprises a local extremum leading to a local extreme of reduction of the spectral shaping function at a spectral position which depends on the pitch frequency.
- the pitch frequency is represented as spectral index 6. depending thereon, the dip function is determined so that it extends in the interval between index 0 and 6, leading to an extremum at spectral index 3 which marks the local extremum of quantization step size reduction.
- the spectral position of the extremum corresponds to half of the pitch frequency, namely 3.
- an example is provided wherein the extremum does not correspond to half of the pitch frequency.
- a reduction function may be determined in a manner depending on the pitch frequency so that the reduction function comprises a local extremum leading to a local extreme of reduction of the quantization step size function at a spectral position which corresponds to half of the pitch frequency with the reduction function being of monotonically - or even strictly monotonically - deceasing reducing strength between zero-frequency and the spectral position, and monotonically - or even strictly monotonically - increasing reducing strength between the spectral position and the pitch frequency.
- a guard interval may be present between the dip function and the pitch frequency.
- an upper limit of a dip interval of the dip function may not be equal to the pitch frequency. Rather, it may alternatively be placed at a certain distance to the pitch frequency, such as offset relative to the pitch frequency at a certain distance towards DC.
- the distance may be fixed, i.e. independent from the pitch frequency, or may vary depending therefrom, and the distance - or guard interval - may be used to modify the embodiments where the dip covers the complete interval down to DC, or only a fixed dip width.
- the parabola shaped dip of q’f may not start at, or adjoin, shown position 220 and hence the pitch frequency.
- q’f may comprise a first guard interval between a spectral index 0 (e.g. representing DC) and a first spectral index Si (e.g. an interval as shown between spectral indices 0 and 2 in Fig. 2 c), the dip, with a dip function which is defined and/or extends between spectral index Si and a second spectral index S2 and a second guard interval between S2 and the pitch frequency.
- the dip function may extend from S2 to spectral index 0, hence, q’f may not comprise the first guard interval, but only the second guard interval.
- no guard interval may be present so that a dip interval may span from index 0 to the pitch frequency.
- a position and/or width of such a first and/or second guard interval may be defined in a fixed manner or chosen in an adaptive manner.
- a spectral weighting as defined by such a guard interval may hence have a fixed predefined shape, e.g. according to a predefined function, or such a function may be adaptable during the coding procedure.
- q’f may have a constant value (e.g. constant over the whole guard interval), and as explained before, this value may be a fixed value or an adaptable value.
- the pitch pf may be determined from coding parameters (e.g. a fundamental frequency related parameter 113) already included in the bitstream (e.g. 101) for frame f, and when such a pf value cannot be determined from the bitstream (e.
- no ALFE according to the invention may optionally be applied in the spectrum associated with f.
- the coding mode parameter 114 may indicate whether such a pitch frequency can be determined.
- the time-frequency transform may be a MDCT, and 'below p may mean at spectral coefficient frequencies (represented by bin indices) lower than the spectral coefficient frequency (i. e., lower than the bin index) associated with pf.
- the term 'parabola-shaped (de)emphasis' may indicate that either the encoder-side emphasis or decoder-side deemphasis factors follow the shape of a parabola across frequency.
- pf be a pitch value (e.g. pitch frequency), as an example measured in units of spectral bin indices, for a given frame f.
- This pitch value is, preferably, derived (i. e., determined) from fundamental frequency related parameters (e.g. 113) contained or comprised in sideinformation associated with f and written to a bitstream (e.g. 101) by an audio transform encoder.
- fundamental frequency related parameters e.g. 113
- Such parameters may, e. g, represent a time-domain fundamental frequency lag If and/or a frequency-domain periodic distance df between spectral peaks, typically used as parameters for harmonic post-filtering or long-term prediction.
- the pitch value may, preferably, be derived as follows, where rs is the codec's sampling rate (Hence, the following functionality may optionally be included in spectral shaping function determination unit 120):
- the derivation of pf may simply involve a rounding of the, possibly fractional, value of df:
- pf may, optionally, be obtained as
- Pf round(max(df, TN / (number of frames per second ⁇ k))) or an equivalent formulation using rs. Then, using pf, two variations of ALFE according to embodiments are possible.
- qf is typically constant across i, but according to this aspect of the invention, qf exhibits a parabolashaped dip between bin index 0 and pf.
- a %
- b %.
- the above-described ALFE variant was found to work as desired but, due to the large set of possible values for pf and, thereby, Cf, it is hard to implement in fixed-point arithmetic. In addition, it may require pf divisions at the encoder side, see n'f, i. e., the computational complexity of ALFE v.1 is proportional to pf.
- B 8 or 4.
- a strength parameter associated with a longterm predictor and/or harmonic post-filter may be used to adapt the above ALFE parameters a and b, so as to use strong ALFE in frames with high long-term prediction and/or harmonic post-filtering strength, and weak ALFE in frames f with low such prediction and/or post-filter strength.
- b 0.25 ⁇ Sf
- Fig. 3 shows a schematic view of an encoder according to embodiments of the invention.
- Encoder 300 comprises an analyzer 310, a determination unit 320, a spectral shaping unit 330, a quantizer 340 and an encoding unit 350.
- the encoder 300 is configured to receive an audio signal 301, wherein the audio signal 301 comprises an information about a predetermined frame among consecutive frames.
- the encoder 300 is configured to determine a linear prediction coefficient, LPC, based spectral envelope representation 311 and a spectrum 312.
- encoder 300 is configured to determine, using determination unit 320 an inverse of a spectral shaping function 321 from the linear prediction coefficient based spectral envelope representation 311 using a first manner below a pitch frequency, and a second manner above the pitch frequency.
- the inverse of the spectral shaping function 321 is determined such that it is, at a predetermined spectral position, higher if the pitch frequency is spectrally higher than the predetermined spectral position, than compared to if the pitch frequency is spectrally lower than the predetermined spectral position.
- An example of such an inverse of a spectral shaping function 321 is shown with n’f in Fig. 2 b.
- the pitch frequency may be a predetermined parameter, or the encoder 300 may determine a respective pitch frequency based on the audio signal 301.
- analyzer 310 may be configured to provide a respective information for a decoding, in the form of a fundamental frequency related parameter 313 from which the pitch frequency is determinable, to encoding unit 350.
- the encoder 300 is configured to spectrally shape the spectrum 312 using the inverse of the spectral shaping function 321 to obtain a shaped spectrum 331.
- the shaped spectrum 331 is provided to the quantizer 340 to obtain a quantized spectrum 341.
- the quantized spectrum 341, the linear prediction coefficient based spectral envelope representation 311, and a fundamental frequency related parameter from which the pitch frequency is determinable 313 are encoded into a data stream 351.
- the determination unit 320 may be configured to determine an intermediate version of a spectral shaping function or of an inverse of the spectral shaping function from the linear prediction coefficient based spectral envelope representation 311.
- encoder 300 may be configured to, below a pitch frequency determined from the fundamental frequency related parameter, form a local spectral reduction in the intermediate version of the spectral shaping function by aligning a reduction function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and applying the reduction function thus aligned to the intermediate version of the spectral shaping function or a local spectral increase in the intermediate version of the inverse of the spectral shaping function by aligning an increase function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and applying the increase function thus aligned to the intermediate version of the inverse of the spectral shaping function.
- the determination unit 320 may be configured to determine the intermediate version of the inverse of the spectral shaping function from the linear prediction coefficient based spectral envelope representation 311. Furthermore, the determination unit 320 may be configured to, below a pitch frequency determined from the fundamental frequency related parameter 331 (which may hence as shown optionally be provided to determination unit 320), form a local spectral increase in the intermediate version of the inverse of the spectral shaping function by aligning an increase function with an interval whose upper limit coincides with, or is, by a predetermined guard interval width value offset towards DC from, the pitch frequency, and to apply the increase function thus aligned to the intermediate version of the inverse of the spectral shaping function.
- the inverse of spectral shaping function 321 may be provided to the spectral shaping unit 330 and used for the provision of the data stream 351 as explained in the context of the first example.
- encoder 300 comprises a reconstructor 360.
- Reconstructor 360 may comprise the same features, as a decoder 100.
- Decoder 360 is optionally provided with the quantized spectrum 341 and/or even (not shown) the data stream 351, in order to decode the spectrum as explained in the context of Fig. 1 and to use the decoded spectrum 361 in order to improve the encoding of the audio signal 301.
- encoder 300 comprises an optional backward adaptive coding tool 370, which may comprise a plurality of coding tools and which may allow to implement a feedback loop for the encoder 300 in order to improve the encoding procedure.
- the reconstructed spectrum might be used for the coding of one or more subsequent frames and as the reconstructed spectrum is also available to the decoder, the encoder would maintain synchronousity with the decoder.
- the decoder might have a corresponding backward adaptive coding tool 150, as discussed before, so as to receive spectrum 131 and perform the same sort of processing, for example prediction, as unit 370. Therefore, respective parameters, e.g. prediction parameters may be inserted in the bitstream for the corresponding unit at decoder side.
- encoder 300 may be configured to perform a frequency-domain prediction, e.g. in accordance with MPEG-H Audio (e.g. ISO I IEC (MPEG-H), International Standard 23008-3:2022, “High efficiency coding and media delivery in heterogeneous environments-Part 3: 3D audio,” Aug. 2022.) or long-term prediction (LTP) as in AAC (1990s years).
- MPEG-H Audio e.g. ISO I IEC (MPEG-H), International Standard 23008-3:2022, “High efficiency coding and media delivery in heterogeneous environments-Part 3: 3D audio,” Aug. 2022.
- LTP long-term prediction
- An approach in accordance with MPEG-H Audio may be used according to US-application 16/802,397.
- An approach according to “improved LTP” may be used according to Goran Markovic et al. (application 2020 / 2021). According to embodiments, different variants may be used.
- a fundamental frequency parameter for example a pitch information
- a respective fundamental frequency information e.g. pitch frequency information
- Such an information may be encoded in data stream 351.
- Reconstructor 360 may, for example, obtain an information about the fundamental frequency related parameter 313 via data stream 351 or may optionally be provided directly with such a parameter.
- analyzer 310 may be configured to determine besides the LPC based spectral envelope representation 311 a coding mode parameter 314.
- the coding mode parameter 314 is provided, as an optional feature, to the determination unit 320 and to encoding unit 350 in order to be encoded into data stream 351.
- the encoder 300 may optionally be configured to, if the coding mode parameter 314 fulfils a predetermined criterion, determine a spectral shaping function from the linear prediction coefficient based spectral envelope representation using a first manner and, if the coding mode parameter does not fulfil the predetermined criterion, determine the spectral shaping function from the linear prediction coefficient based spectral envelope representation using a second manner, wherein the first manner and the second manner differ so that a difference between the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the first manner in case of the coding mode parameter fulfilling the predetermined criterion, minus the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the second manner in case of the coding mode parameter not fulfilling the predetermined criterion, comprises a dip below a pitch frequency.
- the encoder 300 may optionally be configured to, if the coding mode parameter 314 fulfils the predetermined criterion, determine an inverse of a spectral shaping function 321 from the linear prediction coefficient based spectral envelope representation 311 using a first manner and, if the coding mode parameter does not fulfil the predetermined criterion, determine the inverse of the spectral shaping function 321 from the linear prediction coefficient based spectral envelope representation 311 using a second manner, wherein the first manner and the second manner differ so that a difference between the inverse of the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation 311 using the first manner in case of the coding mode parameter fulfilling the predetermined criterion, minus the inverse of the spectral shaping function as determined from the linear prediction coefficient based spectral envelope representation using the second manner in case of the coding mode parameter not fulfilling the predetermined criterion, comprises an inverse of a dip below a pitch frequency.
- the functionality for the determination of the inverse of the spectral shaping function may be implemented in determination unit 320, and the functionality for the determination of the spectral shaping function may be implemented in decoder 360 in order to improve the encoding of data stream 351.
- quantizer 340 may determine a quantization step size of the spectrum 312.
- the spectral shaping unit 330 may multiply spectrum 312 by the spectral curve as defined by the inverse 321 of the spectral shaping function and then, quantizer 340 may use a spectrally constant quantization step size for the whole spectrum 331.
- spectral shaping unit 330 and quantizer 340 may represent or may be seen as a quantization unit with spectrally varying quantization step size.
- the inverse 321 of the spectral shaping function may represent a spectrally varying scaling function entering such a quantization unit with spectrally varying quantization step size, wherein the larger the this function is, the smaller the quantization step size is which his applied by quantization unit 340 with spectrally varying quantization step size.
- the decoding side may optionally be informed of the variation of the quantization step size, for example in the form of scale factors and/or LPC based spectral envelope representation 311, which, by way of the just- described relationship between quantization step size on the one hand and spectral shaping function on the other hand, control the step size spectrally.
- the scale factors e.g.
- such scale factor bands may be Bark bands.
- aspects have been described in the context of an apparatus, it is clear that these aspects also represent a description of the corresponding method, where a block or device corresponds to a method step or a feature of a method step. Analogously, aspects described in the context of a method step also represent a description of a corresponding block or item or feature of a corresponding apparatus.
- the inventive encoded audio signal can be stored on a digital storage medium or can be transmitted on a transmission medium such as a wireless transmission medium or a wired transmission medium such as the Internet.
- embodiments of the invention can be implemented in hardware or in software.
- the implementation can be performed using a digital storage medium, for example a floppy disk, a DVD, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, having electronically readable control signals stored thereon, which cooperate (or are capable of cooperating) with a programmable computer system such that the respective method is performed.
- a digital storage medium for example a floppy disk, a DVD, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, having electronically readable control signals stored thereon, which cooperate (or are capable of cooperating) with a programmable computer system such that the respective method is performed.
- Some embodiments according to the invention comprise a data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.
- embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing one of the methods when the computer program product runs on a computer.
- the program code may for example be stored on a machine readable carrier.
- inventions comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.
- an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.
- a further embodiment of the inventive methods is, therefore, a data carrier (or a digital storage medium, or a computer-readable medium) comprising, recorded thereon, the computer program for performing one of the methods described herein.
- a further embodiment of the inventive method is, therefore, a data stream or a sequence of signals representing the computer program for performing one of the methods described herein.
- the data stream or the sequence of signals may for example be configured to be transferred via a data communication connection, for example via the Internet.
- a further embodiment comprises a processing means, for example a computer, or a programmable logic device, configured to or adapted to perform one of the methods described herein.
- a processing means for example a computer, or a programmable logic device, configured to or adapted to perform one of the methods described herein.
- a further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.
- a programmable logic device for example a field programmable gate array
- a field programmable gate array may cooperate with a microprocessor in order to perform one of the methods described herein.
- the methods are preferably performed by any hardware apparatus.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
Description
Claims
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202480053870.7A CN121729734A (en) | 2023-06-16 | 2024-06-12 | Audio decoder, audio encoder and frame encoding and decoding method using pitch frequency dependent spectral shaping |
| EP24731610.2A EP4728510A1 (en) | 2023-06-16 | 2024-06-12 | Audio decoder, audio encoder and method for coding frames using a pitch frequency dependent spectral shaping |
| US19/420,720 US20260105924A1 (en) | 2023-06-16 | 2025-12-15 | Audio decoder, audio encoder and method for coding frames using a pitch frequency dependent spectral shaping |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23179892.7A EP4478356A1 (en) | 2023-06-16 | 2023-06-16 | Audio decoder and audio encoder for coding frames using a pitch frequency dependent spectral shaping |
| EP23179892.7 | 2023-06-16 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US19/420,720 Continuation US20260105924A1 (en) | 2023-06-16 | 2025-12-15 | Audio decoder, audio encoder and method for coding frames using a pitch frequency dependent spectral shaping |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024256476A1 true WO2024256476A1 (en) | 2024-12-19 |
Family
ID=86895989
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2024/066258 Ceased WO2024256476A1 (en) | 2023-06-16 | 2024-06-12 | Audio decoder, audio encoder and method for coding frames using a pitch frequency dependent spectral shaping |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20260105924A1 (en) |
| EP (2) | EP4478356A1 (en) |
| CN (1) | CN121729734A (en) |
| WO (1) | WO2024256476A1 (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070225971A1 (en) * | 2004-02-18 | 2007-09-27 | Bruno Bessette | Methods and devices for low-frequency emphasis during audio compression based on ACELP/TCX |
| US10176817B2 (en) | 2013-01-29 | 2019-01-08 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Low-frequency emphasis for LPC-based coding in frequency domain |
| US10825461B2 (en) * | 2016-04-12 | 2020-11-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoder for encoding an audio signal, method for encoding an audio signal and computer program under consideration of a detected peak spectral region in an upper frequency band |
-
2023
- 2023-06-16 EP EP23179892.7A patent/EP4478356A1/en not_active Withdrawn
-
2024
- 2024-06-12 EP EP24731610.2A patent/EP4728510A1/en active Pending
- 2024-06-12 WO PCT/EP2024/066258 patent/WO2024256476A1/en not_active Ceased
- 2024-06-12 CN CN202480053870.7A patent/CN121729734A/en active Pending
-
2025
- 2025-12-15 US US19/420,720 patent/US20260105924A1/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070225971A1 (en) * | 2004-02-18 | 2007-09-27 | Bruno Bessette | Methods and devices for low-frequency emphasis during audio compression based on ACELP/TCX |
| US10176817B2 (en) | 2013-01-29 | 2019-01-08 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Low-frequency emphasis for LPC-based coding in frequency domain |
| US10825461B2 (en) * | 2016-04-12 | 2020-11-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoder for encoding an audio signal, method for encoding an audio signal and computer program under consideration of a detected peak spectral region in an upper frequency band |
Non-Patent Citations (5)
| Title |
|---|
| "3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Detailed Algorithmic Description (Release 14)", 17 July 2020 (2020-07-17), XP051909264, Retrieved from the Internet <URL:https://ftp.3gpp.org/3guInternal/3GPP_ultimate_versions_to_be_transposed/sentToDpc/26445-e50.zip> [retrieved on 20200717] * |
| "EVS Codec: Detailed algorithmic description", 3GPP, ETSI TS (1)26.445, May 2022 (2022-05-01) |
| "EVS Codec: General Overview", 3GPP, ETSI TS (1)26.441, 12 October 2014 (2014-10-12) |
| "High efficiency coding and media delivery in heterogeneous environments-Part 3: 3D audio", ISO / IEC (MPEG-H), INTERNATIONAL STANDARD 23008-3:2022, August 2022 (2022-08-01) |
| "Universal Mobile Telecommunications System (UMTS); Audio codec processing functions; Extended Adaptive Multi-Rate - Wideband (AMR-WB+) codec; Transcoding functions (3GPP TS 26.290 version 6.2.0 Release 6); ETSI TS 126 290", TECHNICAL SPECIFICATION, EUROPEAN TELECOMMUNICATIONS STANDARDS INSTITUTE (ETSI), 650 ROUTE DES LUCIOLES, SOPHIA ANTIPOLIS CEDEX, F-06921, FRANCE, vol. 3-SA4, no. V6.2.0, 1 March 2005 (2005-03-01), XP014027773 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN121729734A (en) | 2026-03-24 |
| US20260105924A1 (en) | 2026-04-16 |
| EP4728510A1 (en) | 2026-04-22 |
| EP4478356A1 (en) | 2024-12-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7203179B2 (en) | Audio encoder for encoding an audio signal considering a detected peak spectral region in a higher frequency band, a method for encoding an audio signal, and a computer program | |
| US11031022B2 (en) | Noise filling concept | |
| US7020605B2 (en) | Speech coding system with time-domain noise attenuation | |
| US9646616B2 (en) | System and method for audio coding and decoding | |
| JP5047268B2 (en) | Speech post-processing using MDCT coefficients | |
| WO2010028301A1 (en) | Spectrum harmonic/noise sharpness control | |
| WO2014161994A2 (en) | Advanced quantizer | |
| CN111587456B (en) | Time domain noise shaping | |
| EP4478356A1 (en) | Audio decoder and audio encoder for coding frames using a pitch frequency dependent spectral shaping | |
| US20260105925A1 (en) | Audio decoder, audio encoder and method for coding of frames using a quantization noise shaping | |
| WO2023117146A1 (en) | Method and apparatus for spectrotemporally improved spectral gap filling in audio coding using a filtering |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24731610 Country of ref document: EP Kind code of ref document: A1 |
|
| DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
| REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112025027607 Country of ref document: BR |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2024731610 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2024731610 Country of ref document: EP Effective date: 20260116 |
|
| ENP | Entry into the national phase |
Ref document number: 2024731610 Country of ref document: EP Effective date: 20260116 |
|
| ENP | Entry into the national phase |
Ref document number: 2024731610 Country of ref document: EP Effective date: 20260116 |
|
| ENP | Entry into the national phase |
Ref document number: 2024731610 Country of ref document: EP Effective date: 20260116 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2024731610 Country of ref document: EP |