EP2652735A1 - Improved encoding of an improvement stage in a hierarchical encoder - Google Patents
Improved encoding of an improvement stage in a hierarchical encoderInfo
- Publication number
- EP2652735A1 EP2652735A1 EP11811097.2A EP11811097A EP2652735A1 EP 2652735 A1 EP2652735 A1 EP 2652735A1 EP 11811097 A EP11811097 A EP 11811097A EP 2652735 A1 EP2652735 A1 EP 2652735A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- stage
- coding
- signal
- quantization
- encoder
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000006872 improvement Effects 0.000 title claims abstract description 70
- 238000000034 method Methods 0.000 claims abstract description 37
- 238000012545 processing Methods 0.000 claims abstract description 14
- 238000013139 quantization Methods 0.000 claims description 104
- 230000015654 memory Effects 0.000 claims description 24
- 230000003044 adaptive effect Effects 0.000 claims description 16
- 241001123248 Arma Species 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 6
- 230000006978 adaptation Effects 0.000 claims description 5
- 230000005236 sound signal Effects 0.000 claims description 4
- 238000011002 quantification Methods 0.000 abstract description 14
- 238000007493 shaping process Methods 0.000 description 18
- 238000001914 filtration Methods 0.000 description 16
- 230000000873 masking effect Effects 0.000 description 10
- 238000004364 calculation method Methods 0.000 description 9
- 230000004044 response Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000005070 sampling Methods 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 238000010420 art technique Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003071 parasitic effect Effects 0.000 description 1
- 230000001373 regressive effect Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000003936 working memory Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
- G10L19/0208—Subband vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/06—Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/032—Quantisation or dequantisation of spectral components
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
- G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
Definitions
- the present invention relates to the field of coding of digital signals.
- the coding according to the invention is particularly suitable for the transmission and / or storage of digital signals such as audio-frequency signals (speech, music or other).
- the present invention relates more particularly to the coding of waveforms such as coding MIC (for "Coded Pulse Modulation") said PCM (for "Pulse Code Modulation”) in English, or adaptive coding of waveform of the ADPCM encoding type (for "Adaptive Differential Pulse Modulation” (ADPCM)), in particular the nested-code coding for issuing quantization indices. Scalable bit stream.
- waveforms such as coding MIC (for "Coded Pulse Modulation") said PCM (for "Pulse Code Modulation”) in English
- ADPCM encoding type for "Adaptive Differential Pulse Modulation” (ADPCM)
- ADPCM Adaptive Differential Pulse Modulation
- ITU-T Recommendation G.722 or ITU-T G.727 The general principle of nested code ADPCM coding / decoding specified by ITU-T Recommendation G.722 or ITU-T G.727 is as described with reference to Figures 1 and 2.
- FIG. 1 thus represents an encoder with nested codes of the ADPCM type (ex:
- G.722 low band G.727
- B B + K bits per sample
- a subtraction module 120 which subtracts from the input signal x (n) its prediction Xp (n) to obtain a prediction error signal denoted e (n).
- a quantization module 130 Q B + K of the error signal which receives as input the error signal e (n) to give quantization indices I B + K (n) consisting of B + K bits.
- the quantization index I B + K (n) of B + K bits at the output of the quantization module Q B + K is transmitted via the transmission channel 140 to the decoder as described with reference to FIG. 2.
- the encoder also includes:
- an adaptation module 170 Q Adapt quantizers and inverse quantizers to provide a level control parameter v (n) also known as scaling factor for the next moment;
- the dashed portion referenced 155 represents the low-rate local decoder which contains the predictors 165 and 175 and the inverse quantizer 121.
- This local decoder thus makes it possible to adapt the inverse quantizer to 170 from the low bit rate index I B (n) and adapt the predictors 165 and 175 from the reconstructed low bit rate data.
- the nested code ADPCM decoder of FIG. 2 receives as input the indices ⁇
- the output signal r , B (n) for B bits will be equal to the sum of the prediction of the signal and the output of the B-bit inverse quantizer.
- This part 255 of the decoder is identical to the low speed local decoder 155 of FIG.
- the decoder can improve the restored signal.
- the output will be equal to the sum of the prediction x p ⁇ n) and the output of the inverse quantizer 230 to B + 1 bits yi, (n) v '( not) .
- the output will be equal to the sum of the prediction x p B (n) and the output of the inverse quantizer 240 to B + 2 bits y B B i ⁇ n) v .
- R B + k (z) X (Z) + Q B + k (z)
- ITU-T G.722 nested code ADPCM (hereinafter referred to as G.722) coding broadband signals which are defined with a minimum bandwidth of [50-7000 Hz] and sampled at 16 kHz.
- the G.722 encoding is an ADPCM coding of each of the two sub-bands of the signal [0-4000 Hz] and [4000-8000 Hz] obtained by decomposition of the signal by quadrature mirror filters.
- the low band is coded by a 6, 5 and 4 bit nested code ADPCM coding while the high band is coded by a 2 bit ADPCM coder per sample.
- the total bit rate will be 64, 56 or 48 bit / s depending on the number of bits used for decoding the low band.
- This coding was first developed for use in ISDN (Digital Integrated Services Network). It has recently been deployed in high quality voice over IP telephony applications.
- the quantization noise spectrum will be relatively flat.
- the noise may have a comparable level or higher than the signal and is therefore not necessarily masked. It can then become audible in these regions. Coding noise formatting is therefore necessary.
- coding noise formatting suitable for nested code encoding is furthermore desirable.
- the purpose of the formatting of the coding noise is to obtain a quantization noise whose spectral envelope follows the short-term masking threshold; this principle is often simplified so that the noise spectrum follows the signal spectrum approximately, providing a more homogeneous signal-to-noise ratio so that the noise remains inaudible even in the lower energy areas of the signal.
- a noise shaping technique for a MIC type coding for a MIC type coding
- G.711.1 A wideband extension to ITU-T G.711.
- This recommendation thus describes coding with coding noise formatting for heart rate coding.
- a perceptual filter for encoding noise shaping is calculated based on past decoded signals from a reverse core quantizer.
- a local heart rate decoder thus makes it possible to calculate the noise shaping filter.
- this noise shaping filter is possible to calculate from decoded heart rate signals.
- a quantizer delivering improvement bits is used at the encoder.
- the decoder receiving the core bit stream and the improvement bits, calculates the coding noise shaping filter in the same way as the coder from the decoded heart rate signal and applies this filter to the output signal of the decoder.
- inverse quantizer of the enhancement bits the shaped high-speed signal being obtained by adding the filtered signal to the decoded heart signal.
- the shaping of the noise thus improves the perceptual quality of the heart rate signal. It offers a limited improvement in quality for improvement bits. Indeed, the formatting of the coding noise is not carried out for the coding of the improvement bits, the input of the quantizer being the same for the quantization of the core as for the improved quantization.
- the decoder must then remove a resulting parasitic component by a matched filtering, when the improvement bits are decoded in addition to the core bits.
- the signal received at the decoder can be decoded by a standard decoder capable of decoding the heart rate signal and nested data rates without requiring calculation of noise shaping or correction term.
- quantization is performed by minimizing a quadratic error criterion in a perceptually filtered domain.
- a coding noise shaping filter is defined and applied to a given error signal from at least one reconstructed signal of a preceding coding stage.
- the method also requires the calculation of the reconstructed signal of the current improvement stage in anticipation of a next coding stage.
- improvement terms are calculated and stored for the current improvement stage. This therefore brings significant complexity and significant storage enhancement terms or reconstructed signal samples of previous stages.
- a method for encoding an input digital audio signal (x (n)) in a hierarchical coder comprising a B-bit core coding stage and at least one current improvement coding stage k , the core coding and the coding of the improvement stages preceding the current stage k delivering quantization indices which are concatenated to form the indices of the preceding nested encoder (I B + kl ).
- the method is such that it comprises the following steps:
- the quantization of the improvement stage determines the quantization index bit or bits which are directly concatenated with the indices of the preceding stages. Unlike the state-of-the-art methods, there is no computation of an improvement signal or improvement terms.
- the input signal of the quantization is either directly the input signal of the hierarchical coder, or the same input signal having directly undergone perceptual weighting processing. This is not a signal difference between the input signal and a reconstructed signal of the previous coding stages as in the techniques of the state of the art.
- stored quantization values are not differential values. Thus, it is not useful to memorize the quantization values used for reconstruction in the previous stages to form a quantization dictionary of the improvement stage.
- the invention avoids the duplication of the dictionaries that can be encountered in the methods of the state of the art where a differential dictionary is used at the encoder and an absolute dictionary at the decoder.
- the memory required for the storage of the dictionaries and the quantification operations at the encoder and inverse quantization at the decoder is therefore reduced.
- the input signal has undergone perceptual weighting processing using a predetermined weighting filter to provide a modified input signal, prior to the quantization step, and the method further includes a step of adapting the weighting filter memories from the quantized signal of the current enhancement coding stage.
- This perceptual weighting processing applied directly to the input signal of the hierarchical coder for the enhancement coding of the stage k also reduces the complexity in terms of computational load compared to state-of-the-art techniques which performed this perceptual weighting processing on a difference signal between the input signal and a reconstructed signal of the previous coding stages.
- the encoding method described also allows existing decoders to decode the signal without having to make any additional modifications or processing to be expected while benefiting from the improvement of the signal by formatting the effective coding noise.
- the possible quantization values for the improvement stage k further contain a scale factor and a prediction value from the adaptive type core coding.
- the modified input signal to be quantized at the improvement stage k is the perceptually weighted input signal from which a prediction value derived from the adaptive type core coding is subtracted.
- the perceptual weighting treatment is performed by prediction filters forming an ARMA type filter.
- the present invention also relates to a hierarchical coder of an input digital audio signal, comprising a B-bit core coding stage and at least one current improvement coding stage k, the core coding and the coding of the stages. of improvement preceding the current stage k delivering quantization indices which are concatenated to form the indices of the preceding nested encoder.
- the encoder is such that it comprises:
- the hierarchical coder further comprises a perceptual weighting pre-processing module using a predetermined weighting filter to give a modified input signal of the quantization module and a weighting filter memory adaptation module from the quantized signal. of the current improvement coding stage.
- the hierarchical coder provides the same advantages as those of the method it implements.
- It also relates to a computer program comprising code instructions for implementing the steps of the encoding method according to the invention, when these instructions are executed by a processor.
- the invention finally relates to a storage means readable by a processor storing a computer program as described.
- FIG. 1 illustrates a coder of the ADPCM type with nested codes according to the state of the art and as previously described;
- FIG. 2 illustrates a decoder of the ADPCM type with nested codes according to the state of the art and as described above;
- FIG. 3 illustrates a general embodiment of the coding method according to the invention and an encoder according to the invention
- FIG. 4 illustrates a first particular embodiment of the coding method and an encoder according to the invention
- FIG. 5 illustrates a second particular embodiment of the coding method and an encoder according to the invention
- FIG. 6 illustrates a third particular embodiment of the coding method and an encoder according to the invention
- FIG. 7 illustrates an alternative general embodiment of the coding method and an encoder according to the invention
- FIG. 7b illustrates another alternative general embodiment of the coding method and an encoder according to the invention.
- FIG. 8 illustrates an exemplary embodiment of the core coding of an encoder according to the invention
- FIG. 9 illustrates an example of quantization reconstruction levels used in the state of the art.
- FIG. 10 illustrates a hardware embodiment of an encoder according to the invention. With reference to FIG. 3, an encoder as well as a coding method according to one embodiment of the invention is described.
- the improvement stage (of rank k) is presented as producing one additional bit per sample.
- the coding in each improvement stage involves selecting one of two possible values.
- the "absolute dictionary" - in terms of absolute levels (in the sense of "non-differential") - corresponding to all the quantization values that can be produced by the rank improvement stage k is of size 2 B + k , or sometimes slightly less than 2 B + k as for example in the G.722 coder which has only 60 possible levels instead of 64 in the quantizer of 6 bits of low band.
- Hierarchical coding implies a binary tree structure of the "absolute dictionary", which explains why it suffices to have one bit of improvement to perform the coding given the B + kl bits of the preceding stages.
- the duplication of the reconstruction levels is in fact a consequence of the low band hierarchical coding constraint which is implemented in G.722 in the form of a scalar quantization dictionary (at 4, 5 or 6 bits per sample ) structured in a tree.
- the coding of the improvement stage according to the invention is very easily generalizable for cases where the improvement stage adds several bits per sample.
- the size of the dictionary D k (n) used in the improvement stage, as defined later, is simply 2 U where U> 1 is the number of bits per sample of the improvement stage.
- the encoder as shown in FIG. 3 shows a nested coder or hierarchical coder in which a B-bit core coding and at least one rank improvement stage k is provided.
- Figure 3 simply illustrates a PCM / ADPCM coding module 302 representing the embedded coding preceding the enhancement coding at 306.
- the core encoding of the preceding nested encoding may optionally be performed using the masking filter determined at 301 to format "core" coding noise.
- An example of this type of core coding is described later with reference to FIG.
- This module 302 thus delivers the indices I B + kl (n) of the nested encoder as well as the prediction signal x F B (n) and the scaling factor v (n) in the case where it is a question of a predictive ADPCM coding similar to that described with reference to FIG.
- the module 302 simply delivers the nested quantization indices I B + k1 (n).
- This dictionary D k (n) is used by the quantizer referred to herein as an "improvement quantizer" for the rank improvement stage k.
- the quantization values of the dictionary are defined as follows, in the case of the ADPCM coding:
- the "absolute dictionary” is a dictionary structured in tree.
- the index J B + k ⁇ l conditions the different branches of the tree to be taken into account in order to determine the possible quantization values of the stage k (D k (n)).
- the scale factor v ⁇ n) is determined by the core stage of the ADPCM coding as illustrated in FIG. 1, the improvement stage therefore uses this same scale factor to scale the code words of the quantization dictionary.
- the coder of FIG. 3 does not include modules 301 and 310, that is, no coding noise shaping processing is provided. . Thus, it is the input signal x (n) itself that is quantized by the quantization module 306.
- the encoder further comprises a module 301 for calculating a masking filter and for determining the weighting filter W (z) or a predictive version W PRED (z) described later.
- the masking or weighting filter is determined here from the input signal x (n) but could very well be determined from a decoded signal, for example from the decoded signal of the preceding nested encoder x B + k ⁇ l (not) .
- the masking filter can be determined or adapted sample by sample or by block of samples.
- the encoder according to the invention performs a shaping of the coding noise of the improvement stage by using a quantization in the domain weighted by the filter W (z), that is to say by minimizing the quantization noise energy filtered by W (z).
- This weighting filter is used at 311 by the filtering module and more generally by the perceptual weighting module 310 of the input signal x (n). This pretreatment is applied directly to the input signal x (n) and not to an error signal as could be the case in state-of-the-art techniques.
- This pretreatment module 310 delivers a modified signal x '(n) at the input of the enhancement quantizer 307.
- the quantization module 307 of the improvement stage k delivers a quantization index I in h B + k (n) which will be concatenated with the indices of the preceding nested encoding (I B + kl ) to form the indices of the current nested encoding ( I B + k ), by a module not shown here.
- the quantization module 307 of the improvement stage k chooses between the two values d B + k (n) and d B + k (n) of the adaptive dictionary D k (n).
- the adaptive dictionary D k (n) therefore directly contains the quantized output value of the stage k.
- This quantized signal is used to update the memories of the weighting filter W (z) of the enhancement stage to obtain memories corresponding to an input x (n) -x B + k (n). Typically one subtracts from the memory (or memories in the case of the filter type ARMA) more recent (s) the current value of the decoded signal x B + k (n).
- the quantization of the signal x (n) is done in the weighted domain, which means that we minimize the squared error between x (n and x B + k (n) after filtering by the filter W (z) ⁇
- the quantization noise of the enhancement stage is therefore shaped by a 1 / W (z) filter to make this noise less audible. The energy of the weighted quantization noise is thus minimized.
- the general embodiment of the block 310 given in FIG. 3 shows the general case where W (z) is an infinite impulse response (IIR) filter or a finite impulse response (FIR) filter.
- the signal x '(n) is obtained by filtering x (n) by W (z) and then when the quantified value x B + k (n) is known, the memories of the filter W (z) are updated as if the filtering had been done on the signal xn) - x B + k (n).
- the dotted arrow represents the update of the filter memories.
- the input signal has undergone a perceptual weighting processing by using a predetermined weighting filter at 301 to give a modified input signal x '(n), before the quantization step. in 306.
- FIG. 3 also represents the step of adapting the weighting filter memories 311 to the quantized signal (x B + k (n)) of the current improvement coding stage.
- the filter memory contains only the input samples passed from the signal x (n) -x B + k (n), noted:
- N D being the order of the perceptual filter W (z) - In 302, the input signal x (n) is encoded by the MIC / ADPCM coding module
- an adaptive dictionary D k is constructed according to the prediction values x B (n), the scaling factor v (n) of the heart stage in the case of ADPCA adaptive type coding and indices. coding J B + k ⁇ l ( ⁇ ) as explained with reference to Figure 3.
- y (n) a 0 x (n) + a 1 x (n - 1) + a 2 x (n - 2) + a 3 x (n - 3) + a 4 x (n - 4)
- y (n) x (n) - y (n - 1) - b 2 y (n - 2) - b 3 y (n - 3) - b 4 y (n - 4)
- the innovation part is x (n), the predictive part is -h l y (nl) -b 2 y (n-2) -b 3 y (n-3) -b 4 y (n-4), transform in z
- y (n) x (n) + ⁇ a i x (ni) - ⁇ b i y (ni)
- the innovation part is x (n), the predictive part is y ; x (n-i) - y (n-1),
- H PRED (z) denotes a filter whose coefficient for its current input x (n) is zero.
- the recursive filters all-pole-- - or ARMA-- - are the so-called IIR filters for
- the signal to be quantified by the enhancement quantizer of the stage k is therefore
- This prediction b B + PRED (n) is added to the input signal x (n) at 405 to obtain the modified input signal x '(n) of the quantizer of the improvement stage k.
- the quantization of x '(n) takes place at 306 by the quantization module of the improvement stage k, to give the quantization index I ⁇ (n) of the improvement stage k and the signal decoded x B + k (n) of the stage k.
- the module 307 gives the index of the codeword I B ⁇ h k (n) (1 bit in the illustrative example) of the adaptive dictionary D k which minimizes the squared error between x '(n) and the values of quantification d B + k (n) and d B + k (n).
- This index is to be concatenated with the index of the nested encoder preceding J B + k ⁇ 1 to obtain at the decoder the index of the codeword of the stage k I B + k .
- the module 308 gives the quantized value of the input signal by inverse quantization of the index 3 ⁇ 4 * (w),
- x ⁇ B + k (n) x p B (n) + y; B k v ⁇ n).
- the preprocessing operations of the block 310 thus make it possible to format the improvement coding noise of the stage k by performing a perceptual weighting of the input signal x (n). It is the input signal itself that is perceptually weighted and not an error signal as is the case in state-of-the-art methods.
- FIG. 5 illustrates another embodiment of the preprocessing module using, in this embodiment, an ARMA type filtering (for Auto Regressive to Adjusted Average) of transfer function:
- a step of adding the prediction signal b w + pred (n) to the signal x (n) is performed to give the modified signal.
- the step of quantizing the modified signal x (n) is performed by the quantization module 306, in the same manner as that explained with reference to FIGS. 3 and 4.
- the quantization of the block 306 will output the index I ⁇ h k (n) and the decoded signal on the floor kx B + k (n).
- a step of subtracting the reconstructed signal x B + k (n) from the signal x (n) is performed to give the reconstructed noise b B + k (n).
- a step of adding the prediction signal b B + k red (n) to the signal b B + k (n) is performed to give the reconstructed filtered noise b B + k (n).
- FIG. 6 illustrates yet another embodiment of preprocessing block 310 where here the difference lies in the way in which the reconstructed filtered signal b B + k (n) is calculated.
- the reconstructed filtered noise b B + k (n) is obtained here by subtracting the reconstructed signal x B + k (n) from the signal x '(n) at 614.
- FIG. 7 illustrates an alternative embodiment for the quantization step 306 of the signal x '(n) by differently processing the predicted signal x B (n) from the core coding.
- This embodiment is presented with the example of pretreatment block 310 shown in FIG. 3, but may of course be integrated with pretreatment blocks described in FIGS. 4, 5 and 6.
- the sequence of operations according to FIG. 7 is as follows:
- the module 707 gives the index of the code word I ⁇ h k (n) (1 bit in the illustrative example) of the adaptive dictionary D k 'which minimizes the quadratic error between x "(n) and the words of code d B + k [n) and d B + k [n) This index is to be concatenated with the index of the preceding nested encoding J B + k ⁇ 1 in order to obtain at the decoder the index of the current nested encoding I B + k comprising the stage k.
- a step of updating the memories of the filter W (z) is performed at 311, to obtain memories that correspond to an input xn) - x B + k (n).
- the solution in FIG. 7 is equivalent in terms of quality and storage to that of FIG. 3, but requires less calculation in the case where the improvement stage uses more than one bit.
- instead of adding the predicted value x B (n) to all the code words (> 2) we only subtract before quantization and add to find the quantized value x B + k (n). The complexity is reduced.
- FIG. 7b Another alternative embodiment is illustrated in FIG. 7b.
- the adaptive dictionary D k " is constructed by subtracting the levels of reconstruction of the stage k weighted where appropriate by the scaling factor v (n), with the modified input signal ( ⁇ not) ).
- it is the prediction signal x B (n) that is quantized by minimizing the quadratic error.
- Figure 8 details a possible embodiment of a noise shaping heart coding.
- the module 802 calculates the coding error ' ⁇ ( ⁇ / ⁇ ) 2 A ⁇ zl ⁇ 2 )
- q w (n) x (n) - x (n) of the previous sampling instants, n- ⁇ , n- 2, ....
- This error is filtered by a prediction filter H PRED (z) to obtain the prediction signal q w pred (n).
- the filter H (z) corresponding to H PRED z) may be equal, for example, to
- the local decoder can be a standard local decoder of the MIC / ADPCM type of the G.711, G.721, G.726, G.722 or G.727 standards.
- the circled portion 807 can be seen and implemented as a noise shaping pretreatment that modifies the input of the standard encoder / decoder string.
- an encoder 900 as described according to the various embodiments above typically comprises a ⁇ processor cooperating with a memory block BM including a storage and / or working memory, as well as 'a memory MEM buffer aforesaid as a means for storing for example a dictionary of quantization reconstruction levels or any other data necessary for the implementation of the coding method as described with reference to Figures 3, 4, 5, 6 and 7.
- This encoder receives as input successive frames of the digital signal x (n) and delivers concatenated quantization indices I B + K.
- the memory block BM may comprise a computer program comprising the code instructions for implementing the steps of the method according to the invention when these instructions are executed by a ⁇ processor of the encoder and in particular the steps of obtaining possible quantization values.
- for the current improvement stage k by determining absolute reconstruction levels of the single current stage k from the indices of the preceding nested encoder, quantization of the input signal of the hierarchical coder which has or has not undergone perceptual weighting processing (x (n) or x '(n)), from said possible quantization values to form a quantization index of the stage k and a quantized signal corresponding to one of the possible quantization values.
- a means of storage readable by a computer or a processor, integrated or not integrated with the encoder, possibly removable, stores a computer program implementing a coding method according to the invention.
- Figures 3 to 7 may for example illustrate the algorithm of such a computer program.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Quality & Reliability (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1060631A FR2969360A1 (en) | 2010-12-16 | 2010-12-16 | IMPROVED ENCODING OF AN ENHANCEMENT STAGE IN A HIERARCHICAL ENCODER |
PCT/FR2011/052959 WO2012080649A1 (en) | 2010-12-16 | 2011-12-13 | Improved encoding of an improvement stage in a hierarchical encoder |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2652735A1 true EP2652735A1 (en) | 2013-10-23 |
EP2652735B1 EP2652735B1 (en) | 2015-08-19 |
Family
ID=44356295
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11811097.2A Not-in-force EP2652735B1 (en) | 2010-12-16 | 2011-12-13 | Improved encoding of an improvement stage in a hierarchical encoder |
Country Status (7)
Country | Link |
---|---|
US (1) | US20130268268A1 (en) |
EP (1) | EP2652735B1 (en) |
JP (1) | JP5923517B2 (en) |
KR (1) | KR20140005201A (en) |
CN (1) | CN103370740B (en) |
FR (1) | FR2969360A1 (en) |
WO (1) | WO2012080649A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2938688A1 (en) * | 2008-11-18 | 2010-05-21 | France Telecom | ENCODING WITH NOISE FORMING IN A HIERARCHICAL ENCODER |
EP2980793A1 (en) * | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Encoder, decoder, system and methods for encoding and decoding |
CN105679312B (en) * | 2016-03-04 | 2019-09-10 | 重庆邮电大学 | The phonetic feature processing method of Application on Voiceprint Recognition under a kind of noise circumstance |
WO2020086067A1 (en) * | 2018-10-23 | 2020-04-30 | Nine Energy Service | Multi-service mobile platform for well servicing |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100261253B1 (en) * | 1997-04-02 | 2000-07-01 | 윤종용 | Scalable audio encoder/decoder and audio encoding/decoding method |
KR100711989B1 (en) * | 2002-03-12 | 2007-05-02 | 노키아 코포레이션 | Efficient improvements in scalable audio coding |
WO2007093726A2 (en) * | 2006-02-14 | 2007-08-23 | France Telecom | Device for perceptual weighting in audio encoding/decoding |
US20110022924A1 (en) * | 2007-06-14 | 2011-01-27 | Vladimir Malenovsky | Device and Method for Frame Erasure Concealment in a PCM Codec Interoperable with the ITU-T Recommendation G. 711 |
ATE502377T1 (en) * | 2007-06-15 | 2011-04-15 | France Telecom | ENCODING DIGITAL AUDIO SIGNALS |
ES2416056T3 (en) * | 2007-07-06 | 2013-07-30 | France Telecom | Hierarchical coding of digital audio signals |
WO2010031003A1 (en) * | 2008-09-15 | 2010-03-18 | Huawei Technologies Co., Ltd. | Adding second enhancement layer to celp based core layer |
FR2938688A1 (en) * | 2008-11-18 | 2010-05-21 | France Telecom | ENCODING WITH NOISE FORMING IN A HIERARCHICAL ENCODER |
CN102714776B (en) * | 2009-10-15 | 2015-02-11 | 唯听助听器公司 | Hearing aid with audio codec and method |
FR2960335A1 (en) * | 2010-05-18 | 2011-11-25 | France Telecom | ENCODING WITH NOISE FORMING IN A HIERARCHICAL ENCODER |
FR2981781A1 (en) * | 2011-10-19 | 2013-04-26 | France Telecom | IMPROVED HIERARCHICAL CODING |
-
2010
- 2010-12-16 FR FR1060631A patent/FR2969360A1/en not_active Withdrawn
-
2011
- 2011-12-13 EP EP11811097.2A patent/EP2652735B1/en not_active Not-in-force
- 2011-12-13 WO PCT/FR2011/052959 patent/WO2012080649A1/en active Application Filing
- 2011-12-13 JP JP2013543859A patent/JP5923517B2/en not_active Expired - Fee Related
- 2011-12-13 US US13/995,014 patent/US20130268268A1/en not_active Abandoned
- 2011-12-13 KR KR20137018623A patent/KR20140005201A/en not_active Application Discontinuation
- 2011-12-13 CN CN201180067643.2A patent/CN103370740B/en not_active Expired - Fee Related
Non-Patent Citations (1)
Title |
---|
See references of WO2012080649A1 * |
Also Published As
Publication number | Publication date |
---|---|
EP2652735B1 (en) | 2015-08-19 |
WO2012080649A1 (en) | 2012-06-21 |
CN103370740B (en) | 2015-09-30 |
JP2014501395A (en) | 2014-01-20 |
JP5923517B2 (en) | 2016-05-24 |
US20130268268A1 (en) | 2013-10-10 |
KR20140005201A (en) | 2014-01-14 |
FR2969360A1 (en) | 2012-06-22 |
CN103370740A (en) | 2013-10-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2366177B1 (en) | Encoding of an audio-digital signal with noise transformation in a scalable encoder | |
EP2586133B1 (en) | Controlling a noise-shaping feedback loop in a digital audio signal encoder | |
CA2874965C (en) | Effective pre-echo attenuation in a digital audio signal | |
EP2277172A1 (en) | Concealment of transmission error in a digital signal in a hierarchical decoding structure | |
EP3161659A1 (en) | Resampling of an audio signal by interpolation for low-delay encoding/decoding | |
EP1989706A2 (en) | Device for perceptual weighting in audio encoding/decoding | |
FR2888699A1 (en) | HIERACHIC ENCODING / DECODING DEVICE | |
EP2936488B1 (en) | Effective attenuation of pre-echos in a digital audio signal | |
WO2013001226A1 (en) | Delay-optimized overlap transform, coding/decoding weighting windows | |
EP3084959B1 (en) | Resampling of an audio signal interrupted with a variable sampling frequency according to the frame | |
EP2652735B1 (en) | Improved encoding of an improvement stage in a hierarchical encoder | |
EP2769378A2 (en) | Improved hierarchical coding | |
EP2005424A2 (en) | Method for post-processing a signal in an audio decoder | |
EP2171713B1 (en) | Coding of digital audio signals | |
WO2011144863A1 (en) | Encoding with noise shaping in a hierarchical encoder | |
EP2232833A2 (en) | Processing of binary errors in a digital audio binary frame | |
FR2980620A1 (en) | Method for processing decoded audio frequency signal, e.g. coded voice signal including music, involves performing spectral attenuation of residue, and combining residue and attenuated signal from spectrum of tonal components | |
FR3018942A1 (en) | ESTIMATING CODING NOISE INTRODUCED BY COMPRESSION CODING OF ADPCM TYPE | |
FR3007184A1 (en) | MONITORING THE QUENTIFICATION NOISE ATTENUATION TREATMENT INTRODUCED BY COMPRESSIVE CODING | |
FR2987931A1 (en) | MODIFICATION OF THE SPECTRAL CHARACTERISTICS OF A LINEAR PREDICTION FILTER OF A AUDIONUMERIC SIGNAL REPRESENTED BY ITS COEFFICIENTS LSF OR ISF. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20130715 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/24 20130101ALI20150417BHEP Ipc: G10L 19/02 20130101AFI20150417BHEP |
|
INTG | Intention to grant announced |
Effective date: 20150507 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 744294 Country of ref document: AT Kind code of ref document: T Effective date: 20150915 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602011019010 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 5 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 744294 Country of ref document: AT Kind code of ref document: T Effective date: 20150819 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20150819 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151119 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151120 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151219 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151221 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602011019010 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151231 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20160520 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151213 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151231 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151231 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151213 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20161128 Year of fee payment: 6 Ref country code: DE Payment date: 20161121 Year of fee payment: 6 Ref country code: FR Payment date: 20161121 Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20111213 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602011019010 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20171213 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20180831 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150819 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180703 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171213 |