EP1907812A2 - Method for switching rate- and bandwidth-scalable audio decoding rate - Google Patents
Method for switching rate- and bandwidth-scalable audio decoding rateInfo
- Publication number
- EP1907812A2 EP1907812A2 EP06779036A EP06779036A EP1907812A2 EP 1907812 A2 EP1907812 A2 EP 1907812A2 EP 06779036 A EP06779036 A EP 06779036A EP 06779036 A EP06779036 A EP 06779036A EP 1907812 A2 EP1907812 A2 EP 1907812A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- post
- rate
- signal
- decoding
- band
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000012805 post-processing Methods 0.000 claims abstract description 46
- 230000007704 transition Effects 0.000 claims abstract description 16
- 230000005236 sound signal Effects 0.000 claims abstract description 9
- 238000001914 filtration Methods 0.000 claims description 22
- 230000003044 adaptive effect Effects 0.000 claims description 13
- 230000001419 dependent effect Effects 0.000 claims description 7
- 230000003247 decreasing effect Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 abstract description 6
- 230000015572 biosynthetic process Effects 0.000 description 19
- 238000003786 synthesis reaction Methods 0.000 description 19
- 230000003595 spectral effect Effects 0.000 description 15
- 230000005284 excitation Effects 0.000 description 13
- 230000004044 response Effects 0.000 description 11
- 238000001228 spectrum Methods 0.000 description 7
- 230000006872 improvement Effects 0.000 description 6
- 230000007423 decrease Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000011282 treatment Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000013139 quantization Methods 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000010363 phase shift Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001131 transforming effect Effects 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000013213 extrapolation Methods 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
- G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
- G10L19/12—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/26—Pre-filtering or post-filtering
Definitions
- the present invention relates to a rate switching method for decoding an audio signal encoded by a multi-rate audio coding system and more particularly a scalable audio scalability and possibly bandwidth encoding system. It also relates to an application of said method to a bit rate and bandwidth scalable audio decoding system and a bandwidth scalable and scalable audio decoder.
- the invention finds a particularly advantageous application in the field of the transmission of speech and / or audio signals over voice-over-IP packet networks, in order to provide a quality which can be modulated according to the capacity of the transmission channel.
- the method according to the invention makes it possible to obtain transitions without artefacts between the different bit rates of a scalable audio encoder / decoder (scalable) in bandwidth and throughput, especially in the case of transitions between the telephone band and the band.
- the broadband in the context of scalable bandwidth and bandwidth audio coding with a telephone band core with rate dependent postprocessing and one or more broadband enhancement layers.
- the term “telephone band” or “narrow band” the frequency band located between 300 and 3400 Hz, while the term “broadband” is reserved for the band spreading from 50 to 7000 Hz.
- variable rate bit stream In some applications, such as mobile telephony, voice over IP, or ad-hoc network communications, it is preferable to generate a variable rate bit stream, the bit rate values being taken in a pre-defined set.
- Hierarchical coding also called "scalable" coding, which generates a so-called hierarchical bitstream because it comprises a core rate and one or more improvement layers.
- the 48, 56 and 64 kbit / s G.722 system is a simple example of scalable rate scaling.
- the MPEG-4 CELP codec is scalable in bandwidth and bandwidth (T. Nomura et al., A scalable bitrate and bandwidth CELP coder, ICASSP 1998).
- the coding is based at all rates on the representation by the same coding scheme of a signal. audio in the same bandwidth.
- the signal is defined in a telephone band (300-3400 Hz) and the coding is based on the ACELP (Algebraic Code Excited Linear Prediction) model, except for the generation of noise. comfort, which is nevertheless achieved by a model of the LPC type ("Linear Predictive Coding") compatible with the ACELP model.
- ACELP Algebraic Code Excited Linear Prediction
- LPC type Linear Predictive Coding
- the AMR-NB coding conventionally uses a post-processing in the form of an adaptive post-filtering and a high-pass filtering, the coefficients of the adaptive post-filtering being dependent on the decoding bit rate.
- no precautions are taken to deal with potential problems related to the use of variable post-processing parameters depending on the rate.
- AMR-WB wide band CELP coding does not use post-processing, mainly for reasons of complexity.
- Flow switching is even more problematic in scalable audio scalability and bandwidth encoding. Indeed, in this case the coding is based on different models and bandwidths depending on the rate.
- the bit stream includes a base layer and one or more enhancement layers.
- the base layer is generated by a fixed low rate codec, known as a "core coded", guaranteeing the minimum quality of the coding.
- This layer must be received by the decoder to maintain an acceptable level of quality. Improvement layers are used to improve quality. If they are all sent by the coder, it may happen that they are not all received by the decoder.
- the main advantage of hierarchical coding is that it allows an adaptation of the bit rate by simple truncation of the bit stream.
- the number of layers namely the number of possible truncations of the bitstream, defines the granularity of the coding.
- Hierarchical coding techniques that are scalable in rate and bandwidth with a CELP heart-type coder in a telephone band and one or more broadband enhancement layer (s). Examples of such systems are given in H. Taddei et al., Scalable Three Bitrate (8, 14.2 and 24 kbit / s) Audio Coder; 107th AES Convention, 1999 with a strong granularity of 8, 14.2 and 24 kbit / s, and in B. Kovesi, D. Massaloux, A. Sollaud, A scalable speech and audio coding scheme with continuous bitrate flexibility, ICASSP 2004 with fine granularity of 6.4 to 32 kbit / s, or the MPEG-4 CELP coding.
- the method proposed in the international application WO 01/48931 is in fact a band extension technique which consists in generating a pseudo-wide band signal from a telephone band signal, in particular by extracting a signal. spectral profile ".
- Similar techniques known from the prior art primarily address the problems of switching from the broadband to the telephone band in an attempt to avoid band reduction by the use of a band extension technique without transmission of information for generating an expanded band signal from the received bandband signal. It should be noted that these methods do not attempt to really control the transition between bandwidths and that they also have the disadvantage of to rely on band extension techniques whose quality is very variable and which can not therefore ensure stable output quality.
- the technical problem to be solved by the object of the present invention is to propose a method of switching the rate at the decoding of an audio signal coded by a multi-rate audio coding system, said decoding comprising at least one step of rate-dependent post-processing, which would make it possible to process the transitions between different rates for which post-processing is used according to the decoding rate, so as to eliminate the particularly sensitive artefacts during rapid rate variations at decoding.
- a post-processing introduces a phase shift on the signal, and the use of two different post-treatments involves phase continuity problems during transitions.
- the solution to the technical problem posed is, according to the present invention, in that, when switching from an initial flow rate to a final flow rate, said method comprises a transition step by continuously passing a signal at the initial flow rate to a signal at the final rate, at least one of said signals being post-processed.
- the invention provides that, the decoding comprising a rate-dependent post-processing, a continuous transition from a post-processing to the initial flow to a post-treatment at the final flow is performed during said transition step.
- This characteristic of the invention will be described in detail below, it corresponds to performing a "crossfade" on the post-processing applied to the audio signal decoded at the initial rate. It will be seen that this arrangement is particularly advantageous when switching the rate between the telephone band, where the decoded signal is post-processed and the broadband, where the audio signal is generally not post-processed.
- said continuous passage is achieved by weighting by decreasing the weight of the signal at the initial flow and increasing the weight of the signal at the final flow.
- the invention also provides for the case where the initial rate signal and the final rate signal are post-processed.
- the invention also relates to a computer program comprising code instructions for implementing the method according to the invention when said program is executed by a computer.
- the invention further relates to an application of the method according to the invention to an audio scalable scalable audio decoding system.
- the invention further relates to an application of the method according to the invention to a bit rate and bandwidth scalable audio decoding system in which the initial bit rate is obtained by at least a first decoding layer in a first frequency band, and the final rate is obtained by at least one second decoding layer, called the extension layer of said first frequency band in a second frequency band, the post-processing step being applied to the decoding performed at the initial rate.
- the invention further relates to an application of the method according to the invention to a band-rate and bandwidth-sensitive audio decoding system in which the final bit rate is obtained by at least a first decoding layer in a first frequency band, and the initial rate is obtained by at least one second decoding layer, called the extension layer of said first frequency band in a second frequency band, the post-processing step being applied to the decoding performed at the final rate.
- a particular example of "extended band” is that of the "enlarged band” defined above, said first band being in this case the telephone band.
- the invention also relates to a multi-rate audio decoder, characterized in that, said decoder comprising a rate-dependent aftertreatment stage, said post-processing stage is suitable, when switching from an initial rate to a rate final, to make a transition by continuously passing a signal at the initial rate to a signal at the final rate, at least one of said signals being post-processed.
- said post-processing stage is able to carry out said continuous passage by weighting by reducing the weight of the signal at the initial flow rate and by increasing the weight of the signal at the final flow rate.
- Figure 1 is a diagram of a scalable encoder in flow and bandwidth four layers.
- FIG. 2 is a diagram of a decoder according to the invention associated with the coder of FIG. 1.
- FIG. 3 shows a structure of the bitstream associated with the encoder of FIG. 1.
- FIG. 4 is a flowchart of a method of switching between a post-processed signal and a non-post-processed signal in a telephone band of the decoder according to FIG. invention.
- FIG. 5 is a flowchart of the switching method according to the invention between a telephone band and an enlarged band with band extension.
- FIG. 6 is a flowchart of the switching method according to the invention between a telephone band and an enlarged band with a transform predictive decoding layer.
- FIG. 7 is a flowchart of the management of the counting of received frames in wide band for switching between flows and between bands in accordance with the method according to the invention.
- Fig. 8 is a table summarizing the operation of the flowchart of Fig. 7.
- Figure 9 is a table giving the adaptive attenuation coefficients when switching from the telephone band to the enlarged band.
- the invention is now described in the context of a scalable audio codec in bit rate and bandwidth.
- the scalable bandwidth and bandwidth coding structure considered herein has a CELP coder in the form of a telephone band, a particular case of which uses the G.729A coder as described in ITU-T G729 Recommendation, Coding of Speech at 8 kbit / s us lag Conjugate Algebraic Structure Code Excited L prodiction (CS-ACELP), Mareh 1996 and in R, Salami et al., Description of ITU-T Recommendation G.729 Annex A: 8 kbit / s Reduced Complexity CS-ACELP coded, ICASSP 1997.
- CELP core coding In addition to the CELP core coding, there are three improvement stages, namely an improvement of the CELP coding in a telephone band, a band extension and a predictive coding by transform.
- the flow switching considered here will involve switching between the telephone band and the enlarged band and vice versa.
- Figure 1 gives a diagram of the encoder used.
- a 50-7000 Hz bandwidth audio signal sampled at 16 kHz is cut into frames of 320 samples, or 20 ms.
- a high-pass filtering 101 of 50 Hz cut-off frequency is applied to the input signal.
- the resulting signal, called S WB is reused in several branches of the encoder.
- a low pass filtering and a two subsampling, 102, of 16 to 8 kHz are applied to the signal S WB .
- This operation makes it possible to obtain a sampled telephone band signal at 8 kHz.
- This signal is processed by the heart encoder 103, according to a CELP coding.
- This coding corresponds here to the G.729A encoder, which generates the heart of the bitstream with a bit rate of 8 kbit / s.
- a first enhancement layer introduces a second CELP coding stage 103.
- This second stage consists of an innovative dictionary that enriches the CELP excitation and offers a quality improvement, especially on unvoiced sounds.
- the rate of this second coding stage is 4 kbit / s and the associated parameters are the positions and the signs of the pulses as well as the gain of the associated innovative dictionary for each subframe of 40 samples (5 ms at 8 kHz).
- the decoding of the core encoder and the first enhancement layer are performed to obtain the synthesis signal 104 in a 12 kbit / s telephone band.
- An oversampling of two from 8 to 16 kHz and a low-pass filtering 105 make it possible to obtain the 16 kHz sample version of the first two stages of the encoder.
- the third enhancement layer makes it possible to switch to an enlarged band 106.
- the input signal S WB can be pre-processed by a pre-emphasis filter. This filter makes it possible to better represent the high frequencies from the broadband linear prediction filter. To compensate for the effect of the preemphasis filter, a de-emphasis inverse filter is then used in the synthesis. An alternative to this coding and decoding structure will not use any pre-emphasis and de-emphasis filters.
- the next step is to calculate and quantify the wideband linear prediction filters.
- the order of the linear prediction filter is 18, but in a variant, a lower prediction order will be chosen, for example 16.
- the linear prediction filter can be calculated by the autocorrelation method and the algorithm of Levinson-Durbin.
- This broadband AWB (Z) linear prediction filter is quantized using a prediction of these coefficients from the NB (z) filter from the telephone band core encoder.
- the coefficients can then be quantized using, for example, multi-stage vector quantization and using the LSF (Line Spectrum Frequency) parameters of the bandband heart coder as described in H. Ehara, T. Morii, M. Oshikiri and K. Yoshida, Predictive VQ for scalable bandwidth LSP quantization, ICASSP 2005.
- the wide band excitation is obtained from the parameters of the telephone band excitation of the core encoder: the fundamental period delay or "pitch", the associated gain as well as the algebraic excitations of the core encoder and the first layer of the core coder. enrichment of CELP excitation and associated gains. This excitation is generated by using an oversampled version of the parameters of the excitation of the telephone band stages.
- This excitation in broadband is then shaped by the synthesis filter ⁇ WB (Z) calculated previously.
- the de-emphasis filter is applied to the output signal of the synthesis filter.
- the signal obtained is an expanded band signal which is not adjusted in energy.
- high-pass filtering is applied to the signal! synthetic broadband.
- the same high-pass filter is applied to the error signal corresponding to the difference between the original delayed signal and the synthesis signal of the two previous stages.
- This gain is calculated by a ratio of energy between the two signals.
- the quantized gw ⁇ gain is then applied to the Su WB signal by subframe of 80 samples (5 ms at 16 kHz), the signal thus obtained is added to the synthesis signal of the preceding stage to create the broadband signal corresponding to the 14 kbit / s rate.
- the further coding is performed in the frequency domain using a transform predictive coding scheme.
- These signals are then encoded by the Time Domain Aliasing Cancellation (TDAC) type transforming scheme (Y. Mahieux and JP Petit, Transform coding of audio signed at 64 kbit / s, IEEE GLOBECOM 1990).
- TDAC Time Domain Aliasing Cancellation
- a Modified Discrete Cosine Transform (or MDCT) is applied, on the one hand, 110, on blocks of 640 samples of the weighted input signal with an overlap of 50% (refresh of the MDCT analysis every 20 ms), and, on the other hand, 112, on the weighted synthesis signal from the previous 14 kbit / s bandwidth stage (same block length and same overlay rate).
- the MDCT spectrum to be encoded, 113 corresponds to the difference between the weighted input signal and the 14 kbit / s synthesis signal for the 0 to 3400 Hz band, and the 3400 Hz to 7000 weighted input signal. Hz.
- the spectrum is limited to 7000 Hz by setting the last 40 coefficients to zero (only the first 280 coefficients are coded).
- the spectrum is divided into 18 bands: a band of 8 coefficients and 17 bands of 16 coefficients.
- the energy of the MDCT coefficients is calculated (scale factors).
- the 18 scale factors constitute the spectral envelope of the weighted signal which is then quantized, coded and transmitted in the frame.
- Figure 3 shows the format of the bitstream.
- the dynamic bit allocation is based on the energy of the spectrum bands from the dequantized version of the spectral envelope. This makes it possible to have compatibility between the bit allocation of the encoder and the decoder.
- the normalized MDCT coefficients (fine structure) in each band are then quantized by vector quantizers using size and dimension nested dictionaries, the dictionaries being composed of a permutation code union as described in C. Lamblin et al. , Vector Quantization in Variable Dimension and Resolution, PCT Patent FR 04 00219, 2004.
- the information on the core coder, the CELP enrichment stage in the telephone band, the CELP stage in the enlarged band and finally the spectral envelope and the standardized coefficients encoded are multiplexed and transmitted in frame.
- FIG. 2 represents a block diagram of the decoder associated with the coder of FIG. 1.
- the module 201 demultiplexes the parameters contained in the bit stream. There are several cases of decoding as a function of the number of bits received for a frame, the four cases are described starting from FIG.
- the first concerns the reception of the minimum number of bits by the decoder, for a received bit rate of 8 kbit / s. In this case, only the first stage is decoded. Thus, only the bitstream relating to the CELP core decoder 202 (G.729A +) is received and decoded.
- This synthesis can be processed by the adaptive post-filtering 203 and the high-pass filtering type 204 postprocessing of the G.729 decoder. In this embodiment example, the combination of these two operations will be called "post-processing".
- post-processing can also refer only to adaptive post-filtering or high-pass filtering post-processing.
- This signal is oversampled, 206, and filtered, 207, to produce a signal sampled at 16 kHz.
- the second case concerns the reception of the number of bits relative to the first and second decoding stages only, for a received bit rate of 12 kbit / s.
- the heart decoder as well as the first enhancement stage of the CELP excitation are decoded.
- This synthesis can be processed by the post-processing 203, 204 of the G.729 decoder. As before, this signal is then oversampled, 206, and filtered, 207 to produce a signal sampled at 16 kHz.
- the third case corresponds to receiving the number of bits relative to the first three decoding stages, for a received bit rate of 14 kbit / s.
- the first two decoding stages are first performed as in case 2, apart from the fact that the post-processing applied to the CELP decoding output is not performed, and then the module of bandwidth generates a signal sampled at 16 kHz after decoding parameters of WB-LSF spectral line pairs, 209, and gains associated with excitation, 213. Broadband excitation is generated from the parameters of the core encoder and the first enhancement stage of the CELP excitation 208.
- This excitation is then filtered by the synthesis filter 210 and optionally by the de-emphasis filter 21 1 in the case where a filter of pre-emphasis was used at the coder.
- a high-pass filter 212 is applied to the obtained signal and the energy of the band-extension signal is adjusted with the associated gains 214 every 5 ms.
- This signal is then added to the sampled 16 kHz telephone band signal obtained from the first two decoding stages 215. In order to obtain a signal limited to 7000 Hz, this signal is filtered in the transformed domain by setting to 0 the last 40 MDCT coefficients before passing through the inverse MDCT 220 and the weighted synthesis filter 221.
- This last case corresponds to the decoding of all the stages of the decoder, for a received bit rate greater than or equal to 16 kbit / s.
- the last stage consists of a decoder predictive transform. Step 3 described above is first performed. Then, according to the number of additional bits received, the decoding scheme e predictive by transform is adapted:
- the partial or complete spectral envelope is used to adjust the spectral envelope.
- the binary allocation is carried out in the same way as to the encoder.
- the decoded MDCT coefficients are computed from the dequantized thin spectral envelope and structure.
- the procedure of the preceding paragraph is used, that is to say that the MDCT coefficients calculated on the signal obtained by the band extension, 216 and 217, are adjusted in energy from the received spectral envelope 218.
- the spectrum MDCT used for the synthesis is thus constituted, on the one hand, of the synthesis signal of the two first stages of decoding added to the error signal decoded in the bands between 0 and 3400 Hz; on the other hand, for the bands between 3400 Hz and 7000 Hz decoded MDCT coefficients in the bands where the fine structure has been received and MDCT coefficients of the energy-adjusted band extension stage for the other spectral bands .
- An inverse MDCT is then applied to the decoded MDCT coefficients 220, and filtering by the weighted synthesis filter 221 provides the output signal.
- Block 205 represents a "cross-fade" module
- the number of bits received by the decoder only decodes the first or the first and second stages, ie for a received bit rate of 8 or 12 kbit the effective bandwidth of the final output of the decoder is the telephone band
- the post-processing 203, 204 in the broad sense which is part of the G.729 decoder is applied. in telephone band, before over-sampling.
- this post-processing is not activated because, at the encoder, the encoding of the higher floors has been calculated from the version without post-processing of the telephone band.
- FIG. 4 describes the embodiment of the block 205 which ensures this slow transition between the post-processed and non-post-processed telephone band signal, by applying cross-fades.
- Step 401 examines whether the current frame is a voice band frame or not, that is, whether the current frame rate is 8 or 12 kbit / s.
- a step 402 is called to check whether the previous frame was post-processed or not in the telephone band (which amounts to checking whether the bit rate of the previous frame was 8-12 kbit / s or not) .
- the non-post-processed signal Si is copied into the signal S 3 .
- step 404 the signa! S 3 will contain the result of a cross-fade, where the weight of the non-post-processed component Si increases while the weight of the post-filtered component S 2 decreases.
- Step 404 is followed by step 405 which updates the prevPF flag with the value 0.
- step 406 it is checked whether in the previous frame the post-processing was active or not in the telephone band.
- step 408 the post-processed signal S 2 is copied into the signal S 3 .
- the signal S 3 is calculated, in step 407, as the result of a crossfade, where this time the weight of the non-post-treated component Si decreases. while the weight of the post-treated component S 2 increases.
- step 409 is called to update the prevPF flag with the value 1.
- the effective bandwidth of the final output of the decoder is the telephone band (signal Si).
- a post-processing is applied in telephone band, before oversampling.
- the post-processing used for the bit rates of 8 or 12 kbit / s and the post-processing used for bit rates greater than or equal to 14 kbit / s introduce signal phase differences different from each other.
- This slow transition between the telephone band signals with the different post-treatments is carried out by applying cross-fades (which give the signal S 3 ).
- cross-fades which give the signal S 3 .
- the signal S3 will contain the result of a crossfade, where the weight of the post-processed component S1 increases while the weight of the post-treated component S2 decreases.
- the post-processed signal S2 is copied into the signal S3.
- the signal S3 is calculated as the result of a crossfade, where this time the weight of the post-processed component S1 decreases while the weight of the post-treated component S2 increases.
- Block 209 calculates the broadband linear prediction filters required for the band extension and transform prediction decoding stages. This calculation is necessary in the case where only the telephone band portion of the bitstream of a frame is received after having received an expanded band frame and it is desired to carry out a band extension in order to maintain the band. band effect.
- a set of LSF is extrapolated from the LSF of the heart decoder in a telephone band. We can for example evenly distribute 8 LSF on the band between the last LSF from the telephone band and the Nyquist frequency. This allows the linear prediction filter to be stretched to a flat amplitude response filter for high frequencies.
- Block 213 realizes the gain adaptation used for the band extension according to the present invention. The flow charts corresponding to this block are described in FIGS. 5 and 7.
- the principle of the adaptive attenuation of the gain applied to the high band is described in FIG. 5.
- the calculation of the gain of the first broadband decoding layer is done, 501, according to two possibilities.
- the gain is obtained by decoding 503.
- a extrapolation of the gain associated with this decoding layer is carried out, 502. For example, it is possible to calculate the gain by aligning the energy of the low band of the broadband decoding stage with the actual decoding of the telephone band. previously realized.
- a counter of the number of previously received wideband frames is updated, 504, according to the principle described in FIG. 7. Finally, this counter is used to parameterize the attenuation applied to the gain of the first broadband decoding stage. , 505.
- Figure 7 shows the flowchart of the count management of the number of received wideband frames.
- the update of the counter is done as follows. If the current frame is an expanded band frame, so if the gain associated with the first wide band decoding stage has been received (block 501 of Fig. 5) and the previous frame was also an expanded band frame, then the counter is incremented by 1 and saturated with the value M ⁇ X_COUNT_RCV. This value corresponds to the number of frames during which the broadband decoded signal will be attenuated when switching between a telephone bandwidth to an enlarged bandwidth.
- the counter is set to 0. Otherwise, if the previous frame was an expanded band frame and the counter has a value less than MAX_COUNT_RCV, the counter is also set to 0. In all other cases, the counter remains at the value previous.
- the operation of this flowchart is summarized in the table of Figure 8.
- the values taken by the attenuation coefficient are provided in the table of Figure 9 in the case where MAX_COUNT_RCV takes the value of 100, this table is provided for example. It can be seen that up to the frame 65 the attenuation coefficient is maintained at 0, corresponding to a phase of extension of the decoding in the telephone band. The actual transition phase is performed from the frame 66 by gradually increasing the attenuation coefficient.
- Block 219 performs the adaptive attenuation of the transform prediction coding enhancement layers according to the present invention as described in FIG. 6.
- This figure gives the flowchart of the adaptive attenuation procedure of the transform predictive decoding layer. Firstly, it is checked whether the spectral envelope of this layer has been totally received, 601. If this is the case, then an attenuation of the MDCT coefficients of correction of the low band 0-3500 Hz is carried out, 602, in using the received wideband frame counter and the attenuation table defined in Figure 9.
- the number of received broadband frames is monitored. If this number is less than MAX_COUNT_RCV, the MDCT coefficients corresponding to the first bandwidth broadband decoding stage with information transmission are used for the transform prediction decoding stage. On the other hand, if the counter has the maximum value, the procedure of upgrading the energy of the bands of the predictive decoding by transforming with the decoded spectral envelope is carried out.
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Transmission Systems Not Characterized By The Medium Used For Transmission (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0552286 | 2005-07-22 | ||
PCT/FR2006/050697 WO2007010158A2 (en) | 2005-07-22 | 2006-07-10 | Method for switching rate- and bandwidth-scalable audio decoding rate |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1907812A2 true EP1907812A2 (en) | 2008-04-09 |
EP1907812B1 EP1907812B1 (en) | 2010-12-01 |
Family
ID=36177265
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06779036A Not-in-force EP1907812B1 (en) | 2005-07-22 | 2006-07-10 | Method for switching rate- and bandwidth-scalable audio decoding rate |
Country Status (10)
Country | Link |
---|---|
US (1) | US8630864B2 (en) |
EP (1) | EP1907812B1 (en) |
JP (1) | JP5009910B2 (en) |
KR (1) | KR101295729B1 (en) |
CN (1) | CN101263554B (en) |
AT (1) | ATE490454T1 (en) |
DE (1) | DE602006018618D1 (en) |
ES (1) | ES2356492T3 (en) |
RU (1) | RU2419171C2 (en) |
WO (1) | WO2007010158A2 (en) |
Families Citing this family (39)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7461106B2 (en) * | 2006-09-12 | 2008-12-02 | Motorola, Inc. | Apparatus and method for low complexity combinatorial coding of signals |
EP2096632A4 (en) * | 2006-11-29 | 2012-06-27 | Panasonic Corp | Decoding apparatus and audio decoding method |
JP5255575B2 (en) * | 2007-03-02 | 2013-08-07 | テレフオンアクチーボラゲット エル エム エリクソン(パブル) | Post filter for layered codec |
RU2463674C2 (en) * | 2007-03-02 | 2012-10-10 | Панасоник Корпорэйшн | Encoding device and encoding method |
JP5377287B2 (en) * | 2007-03-02 | 2013-12-25 | パナソニック株式会社 | Post filter, decoding device, and post filter processing method |
US8576096B2 (en) * | 2007-10-11 | 2013-11-05 | Motorola Mobility Llc | Apparatus and method for low complexity combinatorial coding of signals |
US8209190B2 (en) * | 2007-10-25 | 2012-06-26 | Motorola Mobility, Inc. | Method and apparatus for generating an enhancement layer within an audio coding system |
EP2207166B1 (en) * | 2007-11-02 | 2013-06-19 | Huawei Technologies Co., Ltd. | An audio decoding method and device |
US9872066B2 (en) * | 2007-12-18 | 2018-01-16 | Ibiquity Digital Corporation | Method for streaming through a data service over a radio link subsystem |
DE102008009720A1 (en) * | 2008-02-19 | 2009-08-20 | Siemens Enterprise Communications Gmbh & Co. Kg | Method and means for decoding background noise information |
US20090234642A1 (en) * | 2008-03-13 | 2009-09-17 | Motorola, Inc. | Method and Apparatus for Low Complexity Combinatorial Coding of Signals |
US8639519B2 (en) * | 2008-04-09 | 2014-01-28 | Motorola Mobility Llc | Method and apparatus for selective signal coding based on core encoder performance |
PL2304719T3 (en) * | 2008-07-11 | 2017-12-29 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoder, methods for providing an audio stream and computer program |
US20100057473A1 (en) * | 2008-08-26 | 2010-03-04 | Hongwei Kong | Method and system for dual voice path processing in an audio codec |
US20100063825A1 (en) * | 2008-09-05 | 2010-03-11 | Apple Inc. | Systems and Methods for Memory Management and Crossfading in an Electronic Device |
US9773505B2 (en) * | 2008-09-18 | 2017-09-26 | Electronics And Telecommunications Research Institute | Encoding apparatus and decoding apparatus for transforming between modified discrete cosine transform-based coder and different coder |
US8175888B2 (en) | 2008-12-29 | 2012-05-08 | Motorola Mobility, Inc. | Enhanced layered gain factor balancing within a multiple-channel audio coding system |
US8200496B2 (en) * | 2008-12-29 | 2012-06-12 | Motorola Mobility, Inc. | Audio signal decoder and method for producing a scaled reconstructed audio signal |
US8140342B2 (en) * | 2008-12-29 | 2012-03-20 | Motorola Mobility, Inc. | Selective scaling mask computation based on peak detection |
US8219408B2 (en) * | 2008-12-29 | 2012-07-10 | Motorola Mobility, Inc. | Audio signal decoder and method for producing a scaled reconstructed audio signal |
KR101622950B1 (en) * | 2009-01-28 | 2016-05-23 | 삼성전자주식회사 | Method of coding/decoding audio signal and apparatus for enabling the method |
FR2947944A1 (en) * | 2009-07-07 | 2011-01-14 | France Telecom | PERFECTED CODING / DECODING OF AUDIONUMERIC SIGNALS |
US8428936B2 (en) * | 2010-03-05 | 2013-04-23 | Motorola Mobility Llc | Decoder for audio signal including generic audio and speech frames |
US8423355B2 (en) * | 2010-03-05 | 2013-04-16 | Motorola Mobility Llc | Encoder for audio signal including generic audio and speech frames |
US8886523B2 (en) * | 2010-04-14 | 2014-11-11 | Huawei Technologies Co., Ltd. | Audio decoding based on audio class with control code for post-processing modes |
US9047875B2 (en) * | 2010-07-19 | 2015-06-02 | Futurewei Technologies, Inc. | Spectrum flatness control for bandwidth extension |
JP5489900B2 (en) * | 2010-07-27 | 2014-05-14 | ヤマハ株式会社 | Acoustic data communication device |
NO2669468T3 (en) * | 2011-05-11 | 2018-06-02 | ||
RU2480904C1 (en) * | 2012-06-01 | 2013-04-27 | Анна Валерьевна Хуторцева | Method for combined filtering and differential pulse-code modulation/demodulation of signals |
CN103516440B (en) | 2012-06-29 | 2015-07-08 | 华为技术有限公司 | Audio signal processing method and encoding device |
US9129600B2 (en) | 2012-09-26 | 2015-09-08 | Google Technology Holdings LLC | Method and apparatus for encoding an audio signal |
ES2688021T3 (en) * | 2012-12-21 | 2018-10-30 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Adding comfort noise to model background noise at low bit rates |
RU2639952C2 (en) | 2013-08-28 | 2017-12-25 | Долби Лабораторис Лайсэнзин Корпорейшн | Hybrid speech amplification with signal form coding and parametric coding |
WO2015163750A2 (en) * | 2014-04-21 | 2015-10-29 | 삼성전자 주식회사 | Device and method for transmitting and receiving voice data in wireless communication system |
KR102244612B1 (en) | 2014-04-21 | 2021-04-26 | 삼성전자주식회사 | Appratus and method for transmitting and receiving voice data in wireless communication system |
US10049684B2 (en) * | 2015-04-05 | 2018-08-14 | Qualcomm Incorporated | Audio bandwidth selection |
CA3074750A1 (en) | 2017-09-20 | 2019-03-28 | Voiceage Corporation | Method and device for efficiently distributing a bit-budget in a celp codec |
RU2744485C1 (en) | 2017-10-27 | 2021-03-10 | Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. | Noise reduction in the decoder |
JPWO2022009505A1 (en) * | 2020-07-07 | 2022-01-13 |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0728494A (en) * | 1993-07-09 | 1995-01-31 | Nippon Steel Corp | Method and device for decoding compression-encoded voice signal |
US5732389A (en) * | 1995-06-07 | 1998-03-24 | Lucent Technologies Inc. | Voiced/unvoiced classification of speech for excitation codebook selection in celp speech decoding during frame erasures |
US5699485A (en) * | 1995-06-07 | 1997-12-16 | Lucent Technologies Inc. | Pitch delay modification during frame erasures |
US7145898B1 (en) * | 1996-11-18 | 2006-12-05 | Mci Communications Corporation | System, method and article of manufacture for selecting a gateway of a hybrid communication system architecture |
US6904110B2 (en) * | 1997-07-31 | 2005-06-07 | Francois Trans | Channel equalization system and method |
FI980132A (en) * | 1998-01-21 | 1999-07-22 | Nokia Mobile Phones Ltd | Adaptive post-filter |
JP2000259195A (en) * | 1999-01-08 | 2000-09-22 | Matsushita Electric Ind Co Ltd | Decode circuit and reproducing device using the same |
JP2000267686A (en) * | 1999-03-19 | 2000-09-29 | Victor Co Of Japan Ltd | Signal transmission system and decoding device |
US6496794B1 (en) * | 1999-11-22 | 2002-12-17 | Motorola, Inc. | Method and apparatus for seamless multi-rate speech coding |
GB2357682B (en) | 1999-12-23 | 2004-09-08 | Motorola Ltd | Audio circuit and method for wideband to narrowband transition in a communication device |
FI115329B (en) * | 2000-05-08 | 2005-04-15 | Nokia Corp | Method and arrangement for switching the source signal bandwidth in a communication connection equipped for many bandwidths |
JP2003050598A (en) * | 2001-08-06 | 2003-02-21 | Mitsubishi Electric Corp | Voice decoding device |
CA2388439A1 (en) * | 2002-05-31 | 2003-11-30 | Voiceage Corporation | A method and device for efficient frame erasure concealment in linear predictive based speech codecs |
US6590833B1 (en) * | 2002-08-08 | 2003-07-08 | The United States Of America As Represented By The Secretary Of The Navy | Adaptive cross correlator |
US7502743B2 (en) * | 2002-09-04 | 2009-03-10 | Microsoft Corporation | Multi-channel audio encoding and decoding with multi-channel transform selection |
DE602005022641D1 (en) * | 2004-03-01 | 2010-09-09 | Dolby Lab Licensing Corp | Multi-channel audio decoding |
US7668712B2 (en) * | 2004-03-31 | 2010-02-23 | Microsoft Corporation | Audio encoding and decoding with intra frames and adaptive forward error correction |
JP5618826B2 (en) * | 2007-06-14 | 2014-11-05 | ヴォイスエイジ・コーポレーション | ITU. T Recommendation G. Apparatus and method for compensating for frame loss in PCM codec interoperable with 711 |
US8560307B2 (en) * | 2008-01-28 | 2013-10-15 | Qualcomm Incorporated | Systems, methods, and apparatus for context suppression using receivers |
EP2311271B1 (en) * | 2008-07-29 | 2014-09-03 | Dolby Laboratories Licensing Corporation | Method for adaptive control and equalization of electroacoustic channels |
US8924222B2 (en) * | 2010-07-30 | 2014-12-30 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for coding of harmonic signals |
-
2006
- 2006-07-10 DE DE602006018618T patent/DE602006018618D1/en active Active
- 2006-07-10 EP EP06779036A patent/EP1907812B1/en not_active Not-in-force
- 2006-07-10 WO PCT/FR2006/050697 patent/WO2007010158A2/en active Application Filing
- 2006-07-10 RU RU2008106750/09A patent/RU2419171C2/en not_active IP Right Cessation
- 2006-07-10 AT AT06779036T patent/ATE490454T1/en not_active IP Right Cessation
- 2006-07-10 US US11/989,313 patent/US8630864B2/en not_active Expired - Fee Related
- 2006-07-10 JP JP2008522028A patent/JP5009910B2/en not_active Expired - Fee Related
- 2006-07-10 CN CN2006800338079A patent/CN101263554B/en not_active Expired - Fee Related
- 2006-07-10 KR KR1020087004177A patent/KR101295729B1/en not_active IP Right Cessation
- 2006-07-10 ES ES06779036T patent/ES2356492T3/en active Active
Non-Patent Citations (1)
Title |
---|
See references of WO2007010158A2 * |
Also Published As
Publication number | Publication date |
---|---|
ES2356492T3 (en) | 2011-04-08 |
KR20080033997A (en) | 2008-04-17 |
RU2008106750A (en) | 2009-08-27 |
KR101295729B1 (en) | 2013-08-12 |
EP1907812B1 (en) | 2010-12-01 |
RU2419171C2 (en) | 2011-05-20 |
JP2009503559A (en) | 2009-01-29 |
DE602006018618D1 (en) | 2011-01-13 |
US8630864B2 (en) | 2014-01-14 |
US20090306992A1 (en) | 2009-12-10 |
JP5009910B2 (en) | 2012-08-29 |
CN101263554A (en) | 2008-09-10 |
WO2007010158A2 (en) | 2007-01-25 |
WO2007010158A3 (en) | 2007-05-10 |
ATE490454T1 (en) | 2010-12-15 |
CN101263554B (en) | 2011-12-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1907812B1 (en) | Method for switching rate- and bandwidth-scalable audio decoding rate | |
EP1905010B1 (en) | Hierarchical audio encoding/decoding | |
EP1989706B1 (en) | Device for perceptual weighting in audio encoding/decoding | |
EP2656343B1 (en) | Tonsignalkodierung mit geringer verzögerung unter alternierender verwendung von prädiktiver kodierung und transformationskodierung | |
CA2512179C (en) | Method for encoding and decoding audio at a variable rate | |
CA2766864C (en) | Improved coding /decoding of digital audio signals | |
US20090306993A1 (en) | Method and apparatus for lossless encoding of a source signal, using a lossy encoded data stream and a lossless extension data stream | |
EP2277172A1 (en) | Concealment of transmission error in a digital signal in a hierarchical decoding structure | |
EP3069340B1 (en) | Transition from a transform coding/decoding to a predictive coding/decoding | |
EP3175443B1 (en) | Determining a budget for lpd/fd transition frame encoding | |
WO2007107670A2 (en) | Method for post-processing a signal in an audio decoder | |
US7974839B2 (en) | Method, medium, and apparatus encoding scalable wideband audio signal | |
Sinder et al. | Recent speech coding technologies and standards | |
FR2987931A1 (en) | MODIFICATION OF THE SPECTRAL CHARACTERISTICS OF A LINEAR PREDICTION FILTER OF A AUDIONUMERIC SIGNAL REPRESENTED BY ITS COEFFICIENTS LSF OR ISF. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20080205 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
17Q | First examination report despatched |
Effective date: 20091228 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
DAX | Request for extension of the european patent (deleted) | ||
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 602006018618 Country of ref document: DE Date of ref document: 20110113 Kind code of ref document: P |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20101201 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2356492 Country of ref document: ES Kind code of ref document: T3 Effective date: 20110408 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 |
|
LTIE | Lt: invalidation of european patent or patent extension |
Effective date: 20101201 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110301 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FD4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110302 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110401 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110401 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 |
|
26N | No opposition filed |
Effective date: 20110902 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602006018618 Country of ref document: DE Effective date: 20110902 |
|
BERE | Be: lapsed |
Owner name: FRANCE TELECOM Effective date: 20110731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110731 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110731 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110731 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110710 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101201 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20160623 Year of fee payment: 11 Ref country code: GB Payment date: 20160627 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20160622 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20160627 Year of fee payment: 11 Ref country code: DE Payment date: 20160622 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602006018618 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20170710 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20180330 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170710 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180201 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170710 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20181107 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170711 |