EP1741039B1 - Informationssignalverarbeitung durch modifikation in der spektral-/modulationsspektralbereichsdarstellung - Google Patents

Informationssignalverarbeitung durch modifikation in der spektral-/modulationsspektralbereichsdarstellung Download PDF

Info

Publication number
EP1741039B1
EP1741039B1 EP05735002A EP05735002A EP1741039B1 EP 1741039 B1 EP1741039 B1 EP 1741039B1 EP 05735002 A EP05735002 A EP 05735002A EP 05735002 A EP05735002 A EP 05735002A EP 1741039 B1 EP1741039 B1 EP 1741039B1
Authority
EP
European Patent Office
Prior art keywords
spectral
values
modulation
sequence
audio signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP05735002A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP1741039A1 (de
Inventor
Sascha Disch
Karsten Linzmeier
Jürgen HERRE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Original Assignee
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV filed Critical Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Publication of EP1741039A1 publication Critical patent/EP1741039A1/de
Application granted granted Critical
Publication of EP1741039B1 publication Critical patent/EP1741039B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0212—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using orthogonal transformation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/06—Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L2021/02087—Noise filtering the noise being separate speech, e.g. cocktail party

Definitions

  • the present invention relates to the processing of audio signals, and more particularly to spectral / modulation spectral processing.
  • signals which consist of a carrier signal component and a modulation component frequently exist.
  • modulated signals a representation in which the signals are decomposed into carrier and modulation components is often needed to be able to filter, encode or otherwise modify them, for example.
  • Audio coding For purposes of audio coding, for example, it is known to subject the audio signal to a so-called modulation transformation. In this case, the audio signal is decomposed by a transformation into frequency bands. Then a decomposition in amount and phase is made. While the phase is not processed further, the amounts per subband are retransformed over a number of transformation blocks in a second transformation. The result is a frequency decomposition of the temporal envelope of the relevant subband into modulation coefficients. Audio codings that consist of such a modulation transformation are, for example, in M. Vinton and L. Atlas, "A Scalable and Progressive Audio Codec", in Proceedings of the 2001 IEEE ICASSP, 7-11.
  • a disadvantage of the above-mentioned audio coding schemes using a modulation transformation is the following fact. As long as no further processing steps are performed on the modulation coefficients together with the phases, the modulation coefficients form a spectral / modulation spectral representation of the audio signal which is reversible and perfectly reconstructive, ie can be reconverted back to the original audio signal in the time domain without changes. In these methods, however, the modulation coefficients are filtered in order to reduce or quantize the modulation coefficients according to psychoacoustic criteria to the smallest possible values, so that the highest possible compression rate is achieved. However, this does not generally achieve the desired goal of removing the relevant modulation components from the resulting signal or of deliberately introducing quantization noise in this component.
  • US 2003/185411 discloses an apparatus for processing an audio signal in which the result of a first transformation of the audio signal is transformed again.
  • the first transformation separates the audio signal into a magnitude and a phase spectrogram.
  • the second transformation is applied separately to each of these two spectrograms.
  • the object of the present invention is thus to provide a processing scheme for audio signals, which allows a specific processing of audio signals separately according to modulation and carrier portions.
  • the core idea of the present invention is that it is possible to achieve a more strictly processing of audio signals separately for modulation and carrier components if the transfer of the information signal from the time / spectral representation or the time / frequency representation into the spectral / modulation spectral representation or the frequency / modulation frequency representation is performed depending on both an amount component and a phase component of the time / spectral representation of the information signal. This eliminates a recombination between phase and magnitude, and thus the reintroduction of unwanted modulation components in the time representation of the processed audio signal on the synthesis side.
  • Transferring the audio signal from the time / spectral representation to the spectral / modulation spectral representation involves the problem that the time / spectral representation of the information signal is in fact not only from the audio signal but also from the phase offset the time blocks to the carrier spectral component of the audio signal depends.
  • the block-wise transformation of the audio signal from the time representation into the time / spectral representation causes the sequences of spectral values obtained per spectral component in the time / spectral representation of the audio signal to be a modulated complex Carrier, which depends only on the asynchronicity of the block repetition frequency to the carrier frequency component of the audio signal.
  • a demodulation of the sequence of spectral values in the time / spectral representation of the audio signal per spectral component is therefore undertaken in order to obtain a demodulated sequence of spectral values per spectral component.
  • the subsequent conversion of the demodulated sequences of spectral values thus obtained is carried out by block-wise transforms from the time / spectral representation into the spectral / modulation spectral representation or by blockwise spectral decomposition of the same, whereby blocks of modulation values are obtained.
  • These are manipulated or modified, such as weighted for bandpass filtering to remove the modulation component from the original audio signal with a corresponding weighting function.
  • the result is a modified demodulated sequence of spectral values or modified demodulated time / spectral representation.
  • the complex carrier is re-modulated, whereby a modified sequence of spectral values is obtained which forms part of a time / spectral representation of the processed audio signal.
  • a return of this representation into the time representation results in a processed audio signal in the time representation or time domain, which can be changed very precisely with respect to modulation and carrier components with respect to the original audio signal.
  • Fig. 1 shows an apparatus for processing an audio signal according to an embodiment of the present invention.
  • the device of Fig. 1 indicated generally at 10, includes an input 12 at which it receives the audio signal 14 to be processed.
  • the device of Fig. 1 is exemplary provided to process the audio signal 14 such that the modulation component is removed from the audio signal 14, and thus to obtain a processed audio signal with only the carrier portion.
  • the device 10 includes an output 16 for outputting the carrier portion as the processing result and the processed audio signal 18, respectively.
  • the device 10 is divided essentially into a part 20 for transferring the audio signal 14 from a time representation into a time / frequency representation, a means 22 for transferring the audio signal from the time / frequency representation into the frequency / modulation frequency representation, a portion 24 in which the actual processing takes place, namely the modification of the audio signal, and a part 26 for the return of the processed in the frequency / modulation frequency representation audio signal from this representation in the time representation.
  • the said four parts are connected in series between the input 12 and the output 16 in series, the more detailed structure and operation of which will be described hereinafter.
  • the part 20 of the device 10 comprises a fenestration device 28 and a transformation device 30, which connect to the input 12 in this order.
  • an input of the fenestration device 28 is connected to the input 12 to obtain the audio signal 14 as a sequence of information values. If the audio signal is still present as an analog signal, this can be converted, for example, by an A / D converter or a discrete sampling into a sequence of information or sampling values.
  • the windowing device 28 forms blocks of the same number of information values from the sequence of information values and additionally performs a weighting with a weighting function on each block of information values, which, for example, can not correspond exclusively to a sine window or a KBD window. The blocks may overlap, such as by 50% or not.
  • window functions having the property that they enable a good subband separation in the time / spectral representation and that the squares of their mutually corresponding weighting values applied in the overlap region, applied to one and the same information value, add up to one.
  • An output of the fenestration device 28 is connected to an input of the transformation device 30.
  • the blocks of information values output by the windowing means 28 are received by the transformation means 30. It then subjects the transformation means 30 in blocks to a spectrally decomposing transformation, such as a DFT or other complex transformation.
  • the transformation device 30 thus achieves block-by-block decomposition of the audio signal 14 into spectral components and thus produces, in particular per block of time, as obtained from the windowing device 28, a block of spectral values which comprises one spectral value per spectral component.
  • Several spectral values can be combined into subbands. In the following, however, the terms subband and Spectral component used synonymously.
  • the transformation means 30 outputs per spectral component or subband a sequence of spectral values which represent the time profile of this spectral component or of this subband.
  • the spectral values output by the transformation device 30 represent a time / frequency representation of the audio signal 14.
  • the part 22 comprises a carrier frequency determination device 32, a mixer 34 serving as a demodulation device, a windowing device 36, and a second transformation device 38.
  • the windowing device 32 comprises an input which is connected to the output of the transformation device 30. It receives there the spectral value sequences for the individual subbands and divides the spectral value sequences per subband - similarly as the fenestration 28 does with respect to the audio signal 14 - into blocks and weights the spectral values of each block with a suitable weighting function.
  • the weighting function may be one of the weighting functions already mentioned above with respect to device 28.
  • the successive blocks in a subband may or may not overlap, again exemplarily assuming a mutual overlap of 50%. In the following it is assumed that the blocks of different sub-bands are aligned with each other, as in the following with reference to Fig. 1 will be explained in more detail. Another approach with offset between the subbands block sequences would also be conceivable.
  • the windowing device outputs sequences of windowed spectral value blocks per subband.
  • the carrier frequency determination device 32 also has an input which is connected to the output of the transformation device 30 in order to obtain the spectral values of the subbands or spectral components as sequences of spectral values per subband. It is intended to find out in each subband that carrier component which results from the fact that the individual time blocks from which the individual spectral values of the subbands have been derived have a time-varying phase offset to the carrier frequency component of the audio signal.
  • the carrier component determined per subband outputs the carrier frequency determining device 32 at its output to an input of the mixer 34, which in turn has a further input which is connected to the output of the fenestration device 36.
  • the mixer 34 is designed such that, per subband, it multiplies the blocks of windowed spectral values as output from the transformation means by the complex conjugate of the respective carrier component as determined by the carrier frequency determining means 30 for the respective subband, whereby Subbands or blocks of windowed spectral values are demodulated.
  • Demodulated subbands thus result at the output of the mixer 34 or a sequence of demodulated blocks of windowed spectral values results per subband.
  • the output of the mixer 34 is connected to an input of the transformation device 38, so that the latter per subband each other - here exemplarily 50% - overlapping blocks of windowed and demodulated spectral values and transforms these blocks in the spectral / modulation spectral representation or spectrally decomposed to by processing all subbands or spectral components a previously modified only with regard to the demodulation of the subband spectral value sequences Frequency / modulation frequency representation of the audio signal 14 to produce.
  • the transformation underlying the transformation device 38 per subband can be, for example, a DFT, an MDCT, MDST or the like, and in particular also the same transformation as that of the transformation device 30 Fig. 1
  • the transformations of both transformation devices 30, 38 are DFTs.
  • the transformation means 38 successively outputs blocks of values for each sub-band or spectral component, hereinafter referred to as modulation values, representing a spectral decomposition of the blocks of windowed and demodulated spectral values.
  • modulation values representing a spectral decomposition of the blocks of windowed and demodulated spectral values.
  • the blocks of spectral values per subband, with respect to which the transformation means 38 performs the transformations, are aligned with respect to one another in time, so that a time interval always results in a matrix of modulation values composed of one modulation value block per subband.
  • the modulation values are forwarded by the transformation device 38 to the part 24 which has only one signal processing device 40.
  • the signal processing device 40 is connected to the output of the transformation device 38 and thus receives the blocks of modulation values.
  • the signal processor 40 since the device 10 is for modulation-rate rejection, the signal processor 40 performs effective low-pass filtering in the frequency domain on the incoming blocks of modulation values, namely, weighting the modulation values with a function increasing from zero to higher or lower Modulation frequencies drops.
  • the thus modified blocks of modulation values pass the signal processing means 40 to the back transfer part 26. That of the signal processing device 40 output modified blocks of modulation values represent a modified frequency / modulation frequency representation of the information signal 14, or in other words, a frequency / modulation frequency representation other than the demodulation by the mixer 34 from the frequency / modulation frequency representation of the modified information signal 18.
  • the re-transfer part 26 is in turn divided into two parts, namely a part for transferring the processed audio signal 18 from the frequency / modulation frequency representation as output from the signal processing means 40 to the time / frequency representation, and a part for returning the processed one Audio signal from the time / frequency representation in the time representation.
  • the former of the two parts comprises a transformation means 42 for performing a block-wise transformation inverse to the transformation after the transformation means 38, a mixer 46 and an assembly means 44.
  • the second part of the return part 26 comprises a transformation means 48 for performing the transformation of the transformation means 30 inverse blockwise transformation and an aggregator 50.
  • the inverse transformation means 42 is connected with its input to the output of the signal processing means 40 and transforms the modified blocks of modulation values partially bandwise from the spectral representation back into the time / frequency representation and thus reverses the spectral decomposition to a subsequence of modified blocks of To obtain spectral values.
  • These modified spectral value blocks output by the inverse transformation means 42 differ from the spectral value blocks as output by the windowing device 36, but not only by the processing by the signal processing device 40 but also by the demodulation effected by the mixer 34.
  • the mixer 46 receives the strings of modified spectral value blocks output from the inverse transform means 42 per subband and mixes them with a complex carrier corresponding to that used at the corresponding block for demodulating the audio signal at the mixer 34 is complex conjugated to modulate the spectral value blocks again with the carrier caused by the phase offsets of the time blocks.
  • the result, which is established at the output of the mixer 46, is a sequence of modified non-demodulated spectral value blocks per subband.
  • the output of the mixer 46 is connected to an input of the assembler 44.
  • the combination consists in a simple addition of mutually associated spectral values.
  • the result that is thus output at the output of the OLA 44 are thus modified subbands or modified sequences of spectral values for all spectral components and represents a modified time / frequency representation of the information signal 14 and a time / frequency representation of the modified audio signal 18.
  • the transformation device 48 receives the spectral value sequences and thus in particular successively a spectral value for all subbands or spectral components or a spectral decomposition of a section of the modified audio signal 18 successively. It generates a sequence of modified time blocks from the sequence of spectral decompositions by reversing the spectral decomposition. In turn, these modified time blocks receive the merge means 50.
  • the merge means 50 works in a similar manner to the merge means 44. It assembles the modified time blocks, which overlap by way of example by 50%, by adding corresponding information values from adjacent or successive modified time blocks. The result at the output of the combining device 50 is thus a sequence of information values representing the processed audio signal 18.
  • the processing of the audio signal by the device 10 begins with the reception of the audio signal 14 at the input 12.
  • the audio signal 14 is present in a sampled form.
  • the sampling has been carried out, for example, by means of an analog / digital converter.
  • the sampling took place with a certain sampling frequency ⁇ s .
  • the windowing device 28 combines 2N consecutive samples into time blocks, in this case exemplarily with a 50% overlap.
  • each of these blocks weights the fenestration 28 with a weighting function as described above.
  • the windowing device 28 after each N information values, forwards a new windowed time block to 2N information values to the transformation device 30.
  • the repetition frequency of the time blocks is thus ⁇ s / N.
  • the transformation means 30 transforms the windowed time blocks into a spectral representation.
  • the transformation device 30 performs a spectral decomposition of the time blocks of windowed information values into a plurality of predetermined subbands or spectral components.
  • the transformation is a DFT or discrete Fourier transformation.
  • the transformation means 30 For each time block to 2N information values, the transformation means 30 generates in this exemplary Case N complex-valued spectral values for N spectral components when the audio signal is real.
  • the complex spectral values output by the transformation device 30 represent the time / frequency representation 74 of the audio signal.
  • the complex spectral values are in Fig. 2 illustrated by box 76.
  • the transformation device 30 Since the transformation device 30 generates at least one spectral value per successive time block of information values per subband or spectral component, the transformation device 30 thus outputs a sequence of spectral values 76 with the frequency ⁇ s / N per subband or spectral component.
  • the spectral values output to a time block are in Fig. 2 shown at 74 horizontally along the frequency axis 78 arranged.
  • the spectral values output at a subsequent time block are directly adjacent thereto in the vertical direction along the axis 80.
  • the axes 78 and 80 thus represent the frequency or time axis of the time / frequency representation of the audio signal 14.
  • the sequence of spectral values per subband run in the exemplary representation of Fig. 2 along the columns and are shown at 82a, 82b, 82c and 82d.
  • the audio signal 14 is exemplified as a function that is represented by sin (bt) ⁇ (1 + ⁇ ⁇ sin (at)), where ⁇ , for example, the modulation frequency of the envelope of the information signal indicated by the dashed line 84 14, while ⁇ represents the carrier frequency of the audio signal 14, t is the time and ⁇ is the modulation depth.
  • ⁇ for example, the modulation frequency of the envelope of the information signal indicated by the dashed line 84 14
  • ⁇ represents the carrier frequency of the audio signal
  • t the time
  • ⁇ is the modulation depth.
  • ⁇ s results with this exemplary information signal by the transformation 72 per block of time a block of spectral values 76, ie a line at 74, in which primarily the spectral component or the associated spectral value at the carrier frequency ⁇ has a pronounced maximum.
  • the spectral values for this spectral component f ⁇ however, varies in time for successive time blocks due to the variation of the envelope 84. Accordingly, the magnitude of the spectral values of the spectral component ⁇ varies with the modulation frequency ⁇ .
  • the different time blocks may each have a different phase offset from the carrier frequency ⁇ due to a frequency mismatch between the time block repetition frequency ⁇ s / N and the carrier frequency of the audio signal 14.
  • the spectral values of the spectral blocks resulting from the time blocks in transformation 72 are modulated with a carrier e j ⁇ f , where j represents the imaginary unit, f the frequency and ⁇ the phase offset of the respective time block.
  • the phase offset ⁇ increases linearly. Therefore, the spectral values of a subband due to a frequency mismatch between the time block repetition frequency and the carrier frequency also undergo a modulation with a carrier component which depends on the mismatch of the two frequencies.
  • the thus determined Modulationseselfrequenz ⁇ (m, f) determines the carrier frequency determining means 32 for each subband ⁇ b or each frequency f blockwise, where m indicates a block index, as will be explained in more detail below.
  • the carrier frequency determination device 32 combines M consecutive spectral values 76 of a subband ⁇ b , for example the spectral values a ( ⁇ b , 0) to a ( ⁇ b , M-1). Among these M spectral values, it determines a phase course through phase unwrapping. It then determines, for example by means of a least squares algorithm, a straight line equation which comes closest to the phase curve.
  • the carrier frequency determiner 32 From the slope and an intercept, or a phase or initial offset of the line equation, the carrier frequency determiner 32 obtains the desired modulation carrier frequency ⁇ d for subband b with respect to time block m, or a spectral value block phase offset ⁇ for subband b with respect to time block m. This determination carries out the carrier frequency determination device for all subbands over temporally identical spectral values, ie for all spectral value blocks a ( ⁇ b, 0 ) to a ( ⁇ b , M-1 ) with ⁇ b for all subbands 0 ⁇ b ⁇ N.
  • the carrier frequency determiner 32 determines a modulation carrier frequency ⁇ d and the spectral value block phase offset ⁇ , block by block.
  • the block ordering underlying the determination of the complex carriers for all subbands by the device 32 is that used by the fenestration device for fenestration.
  • the carrier frequency determiner 32 outputs the determined values for the complex carriers to the demodulator 34.
  • the mixer 34 now mixes the windowed blocks of spectral values of the individual subbands as output from the windowing means 36 with the complex conjugate of the respective modulation carrier frequencies ⁇ d taking into account the spectral value block phase offsets ⁇ by multiplying these subband spectral value blocks by e -j ⁇ ( ⁇ _d ⁇ n + ⁇ )) , wherein, as mentioned above, respectively a different pair of ⁇ d and ⁇ is used for each subband and within each subband for the successive blocks. In this way, the mixer 34 outputs demodulated subband spectral value blocks aligned with each other ie, two-dimensional blocks of N spectral value blocks for each M demodulated spectral values.
  • the phase characteristic of the spectral values in the subbands within the blocks is on average flatter and substantially around phase 0. In this way it is achieved that in the subsequent transformation by the transformation means 38, the demodulated and windowed blocks of spectral values lead to a spectral decomposition in which the frequency 0 or the DC component is very well centered.
  • the transformation 86 following the demodulation 84 by the mixer 34, is performed by the transformation means 38 on a block-by-block basis on each sub-band or demodulated blocks of spectral values.
  • the demodulated spectral value blocks of the N subbands are subjected in block by block to spectral decomposition by the transformation 86.
  • the result of the spectral decomposition of the blocks of spectral values may also be referred to as a modulation frequency representation.
  • the transform 86 yields a matrix of M x N modulation values representing the frequency / modulation frequency representation of the information signal 14 over the time period of the M time blocks that contributed to that matrix.
  • the frequency / modulation frequency representation 88 has two dimensions, namely the frequency 90 and the modulation frequency 92.
  • the individual modulation values are symbolized at 88 with box 93.
  • the transformation device 38 forwards the modulation matrix to the processing device 40.
  • the processing device 40 is according to the present. Embodiment provided to filter out the modulation signal from the audio signal 14. In the present exemplary case, therefore, the processing means 40 performs low pass filtering on the modulation frequency components in the frequency / modulation frequency matrix.
  • Fig. 1 For illustration, at 94, a diagram is shown in which the modulation frequency is plotted along the x-axis and the amount of the modulation values is plotted along the y-axis.
  • the diagram 94 illustrates a section of the modulation matrix 88 for the exemplary case of the audio signal 14 of FIG Fig. 1 , namely the sinus modulated sine.
  • plot of the amounts of the modulation values along the modulation frequency for the subband having the frequency ⁇ , ie the carrier frequency, is shown in the diagram 94.
  • the modulation frequency spectrum is substantially perfectly centered - at least in the case of the FFT as the transformation 86 - or correctly aligned.
  • the modulation frequency spectrum at the carrier frequency ⁇ two sidebands 96 and 98, which are arranged at the modulation frequency ⁇ , ie the modulation frequency of the envelope 84 of the audio signal 14.
  • the modulation values of the modulation matrix 88 have a DC component 100 at the frequency ⁇ .
  • the signal processing device 40 is now designed as a low-pass filter with a filter characteristic 102, which is shown with a dashed line, to remove the two sidebands 96 and 98 from the frequency / modulation frequency representation 88. In this way, the audio signal 14 is freed from its modulation component, after which only the carrier component remains.
  • the modulation matrix modified in this way forwards the processing device 40 to the inverse transformation device 42.
  • the inverse transformation means 42 processes the modified modulation matrix for each subband such that the block of modulation values for the respective subband, ie one Column in the modulation matrix 88, a to the transformation of the transformation means 38 inverse transform is subjected, so that these modulation value blocks are transferred from the frequency / modulation frequency representation back in the time / frequency representation. In this way, inverse transform means 42 generates from each such block of modulation values for each subband a block of spectral values for that subband.
  • the preceding description referred primarily to the processing of the first M spectral values or of M consecutive spectral values for each subband.
  • the processing by means 32, 34, 36, 38, 40 and 42 is also repeated for subsequent blocks of every M spectral values for each of the N subbands, with an overlap of the blocks to each of M spectral values of, in the present case, by way of example 50%, ie with an overlap per subband around M / 2 spectral values.
  • the blocks are in Fig.
  • the transformation means 38 generates a modulation matrix of M x N modulation values each, which are filtered by the signal processing means 40 in the manner described above.
  • the inverse transformation device 42 again generates from these modified modulation matrices 88 a block of spectral values for each subband, ie a block of spectral values modified with the matrix but still demodulated.
  • the blocks of spectral values per subband output by the inverse transform means 42 differ from those obtained from the information signal 14 at the output of the windowing device 36, however not only by the processing by the processing means 40, but also by the change caused by the demodulation.
  • the spectral value blocks are therefore modulated in the modulation device 46 again with the modulation carrier component with which they were previously demodulated.
  • sequences of blocks of spectral values per subband resulting after the modulation stage 46 are now combined for each subband by the merging device 44 to form a uniform stream 82a-82d of spectral values per subband, by the examples corresponding to the blocks of spectral values, in this case by 50%, overlapping each other and combining corresponding spectral values according to the weighting function used in the fenestration device 36, namely, by adding in the case of the sine or KBD windows exemplified above.
  • the streams of spectral values per subband resulting at the output of the merging means 44 represent the time / frequency representation of the processed audio signal 18.
  • the streams are received by the inverse transform means 48.
  • each time step n it uses the spectral values for all subbands ⁇ b , ie all the spectral values a ( ⁇ b , n) where 0 ⁇ b ⁇ N, in order to perform a transformation from the frequency to the time representation in order to calculate for each n, ie with a repetition period of 2 ⁇ N / ⁇ s to obtain a time block.
  • time blocks are overlaid by the merging device 50 by way of example by way of example 50% overlapping and combining mutually corresponding information values in these time blocks is brought together into a uniform stream of information values, which finally represents the processed audio signal in the time domain 18, which is output at the output 16.
  • the processed audio signal is in Fig. 1 at 18 in a diagram in which the x-axis is the time and the y-axis the amplitude of the audio signal 18.
  • the x-axis is the time and the y-axis the amplitude of the audio signal 18.
  • the modulation components or the envelope component 84 has been removed.
  • FIG Fig. 1 and 2 a processing device that used a signal adaptive filter bank to decompose signals into carriers and modulation components and used the resulting representation of the modulated signals to filter them.
  • a demodulation is carried out per sub-band with respect to a carrier component. After estimating this subband carrier component in the carrier frequency determiner 32, the demodulation per subband is achieved by multiplication with the complex conjugate of that component.
  • the subband signals demodulated in this way are then transformed into the modulation range by means of a further frequency decomposition by means of the window device 36 and the transformation device 38.
  • Fig. 1 DFT with 50% overlap and windowing was used as the first transformation 72, although deviations and variations are conceivable.
  • Several blocks of the first transformation 72 were again - there with 50% overlap example - summarized by the fenestration device 36 and partially bandwise with a complex modulator, which has been determined by the carrier frequency determining means 32, demodulated by the mixer 34 and then transformed with a DFT.
  • the frequency of this modulator has been obtained from the phases of the respective blocks of the sub-band to be demodulated, namely by approximating a line through the unwrapped phase characteristic of the spectral values of the corresponding blocks.
  • this can also be done differently.
  • the carrier frequency determiner 32 may approximate one plane to the phase portion of all subbands in this section per spectral block section n to n + M-1. Furthermore, it would be possible for the carrier frequency determination device 32 to carry out the determination of the complex modulator not in blocks but continuously via the stream of spectral values per subband. For this purpose, for example, the carrier frequency determining device 32 could, for example, first unwrap the phases of the sequence of spectral values of a respective subband, then low pass filter it, and then use the local enhancement of the filtered phase response to adapt the complex modulator. Accordingly, the modulation part at the mixer 46 would also be changed.
  • the carrier frequency determiner attempts to influence the phase response by either increasing or decreasing the phase of the complex spectral values of a subband having an increasing or decreasing amount across the sequence such that an average slope of the phase of the sequence of spectral values is reduced. or the unwrapped phase curve is essentially one solid phase value, preferably the phase 0, varies around.
  • the complex demodulated subband signal can also be transformed into the frequency / modulation frequency representation separately or separated spectrally, each with a real-valued transformation into real and imaginary parts.
  • the real part then represented, after the demodulation stage, the amplitude modulation of the subband signal with respect to the carrier used for demodulation.
  • the imaginary part then represented the frequency modulation of this carrier.
  • the amplitude modulation component of the subband signal is reflected in the symmetric component of the DFT spectrum along the modulation frequency axis, while the frequency modulation component of the carrier corresponds to the asymmetric component of the DFT spectrum along the modulation frequency axis ,
  • the exemplary embodiment described above has been illustrated by way of example on a simple sine-modulated sinusoidal signal.
  • the embodiment of Fig. 1 and 2 is also suitable for filtering the course of the envelope of a mixture of amplitude modulated signals of any frequency, such as amplitude modulated tonal signals.
  • the individual frequency components of the envelope are directly represented in the modulation matrix 88 for consistent processing, in contrast to the already known magnitude-phase representation according to the modulation transformation analysis method for audio coding described in the introduction to the description.
  • the filtering of frequency modulated signals low modulation depth, ie with a frequency deviation, the essential is smaller than the subband width of the first DFT is, with the embodiment of Fig. 1 and 2 possible.
  • Fig. 1 and 2 Thus, an arrangement for modulation filtering, which was expressed in other words again based on a signal adaptive transformation, a filtering in the modulation range and a corresponding inverse transformation. Without signal manipulation in the modulation range, in the present embodiment of the filtering, the arrangement is made Fig. 1 perfectly reconstructed.
  • an appropriate spectral range filter such as filter 102, ie, attenuating the modulation values with increasing distance from a center modulation frequency of zero, the modulation components to be removed may be attenuated as desired.
  • filter 102 ie, attenuating the modulation values with increasing distance from a center modulation frequency of zero
  • the modulation components to be removed may be attenuated as desired.
  • other types of processing of audio signals in the frequency / modulation frequency representation are also conceivable. So it might also be desirable to remove only the carrier.
  • the filtering would consist of a high-pass filtering, ie a weighting function with a modulation frequency edge at a certain modulation frequency, which weakens modulation values at lower modulation frequencies more than those at higher modulation frequencies.
  • the signal processing in the signal processing device 40 could again consist of bandpass filtering, ie weighting with a weighting function falling away from a certain center modulation frequency, to separate portions of the audio signal originating from different sources, ie to achieve a source separation.
  • Other applications in which the foregoing embodiment may be used may involve audio coding for encoding audio signals, disturbed signal reconstruction, and error concealment.
  • the device 10 could be used as a music effect device to special acoustic effects in the incoming audio signal.
  • the processing in the signal processing device 40 can accordingly take on a very wide variety of forms, such as the quantization of the modulation values, the zeroing of some modulation values, the weighting of individual sections of the or all modulation values or the like.
  • Another application would be the use of the device 10 of Fig. 1 as a watermark embedder.
  • the watermark embedder would receive an audio signal 14, wherein the processor 40 could introduce a received watermark into the audio signal by modifying individual segments or modulation values according to the watermark.
  • the selection of the segments or modulation values could be different or time-varying for successive modulation matrices and would be made such that by psychoacoustic masking effects the modifications due to the human acoustic watermark insertion in the resulting watermarked audio signal 18 are inaudible.
  • the transformation devices can of course also be embodied as filter banks which produce a spectral representation through many individual bandpass filters. It should also be noted that the resulting audio signal 18 does not have to be output in the time domain representation after processing. It would also be conceivable to output the information signal, for example in a time / spectral representation or even in the spectral / modulation spectral representation. In the latter case, of course, it would then have to be ensured that the necessary modulation 46 can again be performed on the receiver side with the suitable carrier, for example by supplying the complex carriers varying for each subband and spectral value block which were used for demodulation 84. In this way, the above embodiment could be used to implement a compression method.
  • the inventive scheme can also be implemented in software.
  • the implementation may be on a digital storage medium, in particular a floppy disk or a CD with electronically readable control signals, which may cooperate with a programmable computer system such that the corresponding method is executed.
  • the invention thus also consists in a computer program product with program code stored on a machine-readable carrier for carrying out the method according to the invention when the computer program product runs on a computer.
  • the invention can thus be realized as a computer program with a program code for carrying out the method when the computer program runs on a computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Computational Linguistics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Optical Communication System (AREA)
  • Holo Graphy (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Digital Transmission Methods That Use Modulated Carrier Waves (AREA)
  • Liquid Crystal (AREA)
  • Spectrometry And Color Measurement (AREA)
EP05735002A 2004-04-30 2005-03-22 Informationssignalverarbeitung durch modifikation in der spektral-/modulationsspektralbereichsdarstellung Active EP1741039B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102004021403A DE102004021403A1 (de) 2004-04-30 2004-04-30 Informationssignalverarbeitung durch Modifikation in der Spektral-/Modulationsspektralbereichsdarstellung
PCT/EP2005/003064 WO2005109240A1 (de) 2004-04-30 2005-03-22 Informationssignalverarbeitung durch modifikation in der spektral-/modulationsspektralbereichsdarstellung

Publications (2)

Publication Number Publication Date
EP1741039A1 EP1741039A1 (de) 2007-01-10
EP1741039B1 true EP1741039B1 (de) 2010-02-17

Family

ID=34965409

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05735002A Active EP1741039B1 (de) 2004-04-30 2005-03-22 Informationssignalverarbeitung durch modifikation in der spektral-/modulationsspektralbereichsdarstellung

Country Status (16)

Country Link
US (1) US7574313B2 (no)
EP (1) EP1741039B1 (no)
JP (1) JP4473913B2 (no)
KR (1) KR100851424B1 (no)
CN (1) CN100583085C (no)
AT (1) ATE458225T1 (no)
AU (1) AU2005241157B8 (no)
BR (1) BRPI0509818B1 (no)
CA (1) CA2564970C (no)
DE (2) DE102004021403A1 (no)
HK (1) HK1097326A1 (no)
IL (1) IL178671A (no)
MX (1) MXPA06012424A (no)
NO (1) NO337309B1 (no)
RU (1) RU2351006C2 (no)
WO (1) WO2005109240A1 (no)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19947877C2 (de) * 1999-10-05 2001-09-13 Fraunhofer Ges Forschung Verfahren und Vorrichtung zum Einbringen von Informationen in einen Datenstrom sowie Verfahren und Vorrichtung zum Codieren eines Audiosignals
DE102004023436B4 (de) * 2004-05-10 2006-06-14 M2Any Gmbh Vorrichtung und Verfahren zum Analysieren eines Informationssignals
DE102006047197B3 (de) 2006-07-31 2008-01-31 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Verarbeiten eines reellen Subband-Signals zur Reduktion von Aliasing-Effekten
DE102006051673A1 (de) 2006-11-02 2008-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Nachbearbeiten von Spektralwerten und Encodierer und Decodierer für Audiosignale
US8214200B2 (en) * 2007-03-14 2012-07-03 Xfrm, Inc. Fast MDCT (modified discrete cosine transform) approximation of a windowed sinusoid
EP2015293A1 (en) * 2007-06-14 2009-01-14 Deutsche Thomson OHG Method and apparatus for encoding and decoding an audio signal using adaptively switched temporal resolution in the spectral domain
US20090048828A1 (en) * 2007-08-15 2009-02-19 University Of Washington Gap interpolation in acoustic signals using coherent demodulation
US8126578B2 (en) * 2007-09-26 2012-02-28 University Of Washington Clipped-waveform repair in acoustic signals using generalized linear prediction
US9436759B2 (en) 2007-12-27 2016-09-06 Nant Holdings Ip, Llc Robust information extraction from utterances
ES2796493T3 (es) * 2008-03-20 2020-11-27 Fraunhofer Ges Forschung Aparato y método para convertir una señal de audio en una representación parametrizada, aparato y método para modificar una representación parametrizada, aparato y método para sintetizar una representación parametrizada de una señal de audio
EP2362375A1 (en) * 2010-02-26 2011-08-31 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Apparatus and method for modifying an audio signal using harmonic locking
EP2431970A1 (en) 2010-09-21 2012-03-21 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Watermark generator, watermark decoder, method for providing a watermarked signal based on discrete valued data and method for providing discrete valued data in dependence on a watermarked signal
FR2977439A1 (fr) * 2011-06-28 2013-01-04 France Telecom Fenetres de ponderation en codage/decodage par transformee avec recouvrement, optimisees en retard.
US20130070811A1 (en) * 2011-09-20 2013-03-21 Electronics And Telecommunications Research Institute Transmission/reception apparatus and method for filtered multi-tone system
US8634502B2 (en) * 2011-09-30 2014-01-21 Silicon Laboratories Inc. Receiver with asynchronous and synchronous demodulator
RU2505868C2 (ru) * 2011-12-07 2014-01-27 Ооо "Цифрасофт" Способ встраивания цифровой информации в аудиосигнал
TWI575962B (zh) * 2012-02-24 2017-03-21 杜比國際公司 部份複數處理之重疊濾波器組中的低延遲實數至複數轉換
WO2014168777A1 (en) * 2013-04-10 2014-10-16 Dolby Laboratories Licensing Corporation Speech dereverberation methods, devices and systems
EP2830061A1 (en) 2013-07-22 2015-01-28 Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for encoding and decoding an encoded audio signal using temporal noise/patch shaping
KR101831286B1 (ko) 2013-08-23 2018-02-22 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에.베. 엘리어싱 오류 신호를 사용하여 오디오 신호를 처리하기 위한 장치 및 방법
EP2963646A1 (en) 2014-07-01 2016-01-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Decoder and method for decoding an audio signal, encoder and method for encoding an audio signal
KR102356028B1 (ko) 2015-02-06 2022-01-26 삼성디스플레이 주식회사 표시 장치
CA2976864C (en) 2015-02-26 2020-07-14 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for processing an audio signal to obtain a processed audio signal using a target time-domain envelope
WO2016142002A1 (en) 2015-03-09 2016-09-15 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Audio encoder, audio decoder, method for encoding an audio signal and method for decoding an encoded audio signal
RU2746708C1 (ru) * 2020-07-29 2021-04-19 Закрытое акционерное общество "Перспективный мониторинг" Способ и устройство ввода водяного знака в аудиосигнал

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5173923A (en) * 1991-11-22 1992-12-22 Bell Communications Research, Inc. Spread-time code division multiple access technique with arbitrary spectral shaping
US5321497A (en) 1992-03-09 1994-06-14 Wyko Corporation Interferometric integration technique and apparatus to confine 2π discontinuity
US5671168A (en) * 1995-07-06 1997-09-23 Technion Research & Development Foundation Ltd. Digital frequency-domain implementation of arrays
EP0875107B1 (de) 1996-03-07 1999-09-01 Fraunhofer-Gesellschaft Zur Förderung Der Angewandten Forschung E.V. Codierverfahren zur einbringung eines nicht hörbaren datensignals in ein audiosignal, decodierverfahren, codierer und decodierer
DE19640814C2 (de) 1996-03-07 1998-07-23 Fraunhofer Ges Forschung Codierverfahren zur Einbringung eines nicht hörbaren Datensignals in ein Audiosignal und Verfahren zum Decodieren eines nicht hörbar in einem Audiosignal enthaltenen Datensignals
US5724270A (en) * 1996-08-26 1998-03-03 He Holdings, Inc. Wave-number-frequency adaptive beamforming
US5915027A (en) 1996-11-05 1999-06-22 Nec Research Institute Digital watermarking
DE19947877C2 (de) * 1999-10-05 2001-09-13 Fraunhofer Ges Forschung Verfahren und Vorrichtung zum Einbringen von Informationen in einen Datenstrom sowie Verfahren und Vorrichtung zum Codieren eines Audiosignals
US6725372B1 (en) 1999-12-02 2004-04-20 Verizon Laboratories Inc. Digital watermarking
JP3507743B2 (ja) 1999-12-22 2004-03-15 インターナショナル・ビジネス・マシーンズ・コーポレーション 圧縮オーディオデータへの電子透かし方法およびそのシステム
AU2001231109A1 (en) 2000-01-24 2001-07-31 Businger, Peter A. Transform domain allocation for multimedia watermarking
FR2807897B1 (fr) * 2000-04-18 2003-07-18 France Telecom Methode et dispositif d'enrichissement spectral
KR100898879B1 (ko) 2000-08-16 2009-05-25 돌비 레버러토리즈 라이쎈싱 코오포레이션 부수 정보에 응답하여 하나 또는 그 이상의 파라메터를변조하는 오디오 또는 비디오 지각 코딩 시스템
US20020168082A1 (en) 2001-03-07 2002-11-14 Ravi Razdan Real-time, distributed, transactional, hybrid watermarking method to provide trace-ability and copyright protection of digital content in peer-to-peer networks
US7136418B2 (en) * 2001-05-03 2006-11-14 University Of Washington Scalable and perceptually ranked signal coding and decoding
US7006452B2 (en) 2001-05-22 2006-02-28 Intel Corporation Matching DSL data link layer protocol detection
DE10129239C1 (de) 2001-06-18 2002-10-31 Fraunhofer Ges Forschung Vorrichtung und Verfahren zum Einbetten eines Wasserzeichens in ein Audiosignal
US6963842B2 (en) * 2001-09-05 2005-11-08 Creative Technology Ltd. Efficient system and method for converting between different transform-domain signal representations
US20030187663A1 (en) * 2002-03-28 2003-10-02 Truman Michael Mead Broadband frequency translation for high frequency regeneration
US7243060B2 (en) * 2002-04-02 2007-07-10 University Of Washington Single channel sound separation
EP1506548A2 (en) 2002-05-10 2005-02-16 Koninklijke Philips Electronics N.V. Watermark embedding and retrieval
US7254500B2 (en) * 2003-03-31 2007-08-07 The Salk Institute For Biological Studies Monitoring and representing complex signals
US7318035B2 (en) * 2003-05-08 2008-01-08 Dolby Laboratories Licensing Corporation Audio coding systems and methods using spectral component coupling and spectral component regeneration
JP4535278B2 (ja) * 2005-07-04 2010-09-01 株式会社デンソー イオン電流検出装置
JP2008001004A (ja) * 2006-06-23 2008-01-10 Canon Inc 液体収納容器の液体供給部の製造方法、液体収納容器

Also Published As

Publication number Publication date
HK1097326A1 (en) 2007-06-22
RU2006142324A (ru) 2008-06-10
IL178671A0 (en) 2007-02-11
MXPA06012424A (es) 2007-01-17
DE502005009035D1 (de) 2010-04-01
BRPI0509818A (pt) 2007-09-18
US7574313B2 (en) 2009-08-11
NO337309B1 (no) 2016-03-07
WO2005109240A1 (de) 2005-11-17
KR100851424B1 (ko) 2008-08-11
NO20065423L (no) 2007-01-26
CN1950815A (zh) 2007-04-18
AU2005241157B8 (en) 2008-11-06
US20070100610A1 (en) 2007-05-03
JP2007535849A (ja) 2007-12-06
BRPI0509818B1 (pt) 2022-06-07
JP4473913B2 (ja) 2010-06-02
RU2351006C2 (ru) 2009-03-27
IL178671A (en) 2011-03-31
CA2564970C (en) 2012-02-07
KR20070015174A (ko) 2007-02-01
AU2005241157A1 (en) 2005-11-17
AU2005241157B2 (en) 2008-05-22
ATE458225T1 (de) 2010-03-15
EP1741039A1 (de) 2007-01-10
CA2564970A1 (en) 2005-11-17
DE102004021403A1 (de) 2005-11-24
CN100583085C (zh) 2010-01-20

Similar Documents

Publication Publication Date Title
EP1741039B1 (de) Informationssignalverarbeitung durch modifikation in der spektral-/modulationsspektralbereichsdarstellung
DE60317722T2 (de) Verfahren zur Reduzierung von Aliasing-Störungen, die durch die Anpassung der spektralen Hüllkurve in Realwertfilterbanken verursacht werden
DE102008015702B4 (de) Vorrichtung und Verfahren zur Bandbreitenerweiterung eines Audiosignals
DE60013785T2 (de) VERBESSERTE SUBJEKTIVE QUALITäT VON SBR (SPECTRAL BAND REPLICATION)UND HFR (HIGH FREQUENCY RECONSTRUCTION) KODIERVERFAHREN DURCH ADDIEREN VON GRUNDRAUSCHEN UND BEGRENZUNG DER RAUSCHSUBSTITUTION
DE102006047197B3 (de) Vorrichtung und Verfahren zum Verarbeiten eines reellen Subband-Signals zur Reduktion von Aliasing-Effekten
DE10200653B4 (de) Skalierbarer Codierer, Verfahren zum Codieren, Decodierer und Verfahren zum Decodieren für einen skalierten Datenstrom
DE602006000399T2 (de) Teilweise komplexmodulierte filterbank
EP1979901B1 (de) Verfahren und anordnungen zur audiosignalkodierung
DE4316297C1 (de) Frequenzanalyseverfahren
DE69221228T2 (de) Adaptives Filterverfahren eines in Teilbändern transformierten Signals und entsprechende Filteranordnung
DE10234130B3 (de) Vorrichtung und Verfahren zum Erzeugen einer komplexen Spektraldarstellung eines zeitdiskreten Signals
EP1016319B1 (de) Verfahren und vorrichtung zum codieren eines zeitdiskreten stereosignals
DE60310449T2 (de) Audiosignalkodierung
EP1869671A1 (de) Verfahren und vorrichtung zur geräuschunterdrückung
DE602004009926T2 (de) Vorrichtung und verfahren zum einbetten eines wasserzeichens unter verwendung von subbandfilterung
DE60105576T2 (de) Verfahren und vorrichtung zur spektralen anreicherung
EP1239455A2 (de) Verfahren und Anordnung zur Durchführung einer an die Übertragungsfunktion menschilcher Sinnesorgane angepassten Fourier Transformation sowie darauf basierende Vorrichtungen zur Geräuschreduktion und Spracherkennung
EP0608281B1 (de) Verfahren zur reduzierung des frequenzübersprechens bei der übertragung und/ oder speicherung akustischer oder optischer signale
DE69515509T2 (de) Sprachverarbeitung
DE3732047C2 (no)
DE69522883T2 (de) Vorrichtung zur bestimmung des signalspektrums eines digitalen breitbandsignals und zur ableitung einer bitzuweisungsinformation
EP1538749A2 (de) Verfahren und Filterbank zur spektralen Modifikation eines digitalen Signals
EP1834322B1 (de) Verfahren zum codieren eines analogen signals
WO2006072526A1 (de) Verfahren zur bandbreitenerweiterung
DE602004007249T2 (de) Einheitliche Behandlung von aufgelösten und nicht-aufgelösten Oberwellen

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20061016

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWAN

REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1097326

Country of ref document: HK

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REF Corresponds to:

Ref document number: 502005009035

Country of ref document: DE

Date of ref document: 20100401

Kind code of ref document: P

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20100217

LTIE Lt: invalidation of european patent or patent extension

Effective date: 20100217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100528

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100617

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100617

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

BERE Be: lapsed

Owner name: FRAUNHOFER-GESELLSCHAFT ZUR FORDERUNG DER ANGEWAN

Effective date: 20100331

REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1097326

Country of ref document: HK

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100518

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100331

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100517

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20101118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100331

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100331

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100322

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100322

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100818

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100217

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 14

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230512

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240321

Year of fee payment: 20

Ref country code: GB

Payment date: 20240322

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240320

Year of fee payment: 20