EP2867893A1 - Effective pre-echo attenuation in a digital audio signal - Google Patents
Effective pre-echo attenuation in a digital audio signalInfo
- Publication number
- EP2867893A1 EP2867893A1 EP13744654.8A EP13744654A EP2867893A1 EP 2867893 A1 EP2867893 A1 EP 2867893A1 EP 13744654 A EP13744654 A EP 13744654A EP 2867893 A1 EP2867893 A1 EP 2867893A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- echo
- attack
- attenuation
- signal
- filtering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 23
- 238000000034 method Methods 0.000 claims abstract description 43
- 230000003595 spectral effect Effects 0.000 claims abstract description 26
- 238000007493 shaping process Methods 0.000 claims abstract description 24
- 238000012545 processing Methods 0.000 claims abstract description 23
- 238000004364 calculation method Methods 0.000 claims abstract description 9
- 238000001514 detection method Methods 0.000 claims abstract description 8
- 238000001914 filtration Methods 0.000 claims description 75
- 230000006978 adaptation Effects 0.000 claims description 14
- 230000003044 adaptive effect Effects 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 10
- 238000002592 echocardiography Methods 0.000 claims description 9
- 230000004044 response Effects 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 5
- 238000012546 transfer Methods 0.000 claims description 4
- 238000005259 measurement Methods 0.000 claims description 3
- 238000013016 damping Methods 0.000 abstract 1
- 230000006870 function Effects 0.000 description 24
- 230000007704 transition Effects 0.000 description 17
- 230000015654 memory Effects 0.000 description 14
- 238000009499 grossing Methods 0.000 description 11
- 230000009467 reduction Effects 0.000 description 9
- 238000003786 synthesis reaction Methods 0.000 description 6
- 230000002238 attenuated effect Effects 0.000 description 5
- 230000015572 biosynthetic process Effects 0.000 description 5
- 238000003672 processing method Methods 0.000 description 5
- 238000013139 quantization Methods 0.000 description 5
- 230000002123 temporal effect Effects 0.000 description 5
- 230000015556 catabolic process Effects 0.000 description 4
- 238000006731 degradation reaction Methods 0.000 description 4
- 230000000116 mitigating effect Effects 0.000 description 4
- 230000003071 parasitic effect Effects 0.000 description 4
- 230000000750 progressive effect Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000012885 constant function Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000002401 inhibitory effect Effects 0.000 description 2
- 230000000873 masking effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 101150056906 recJ gene Proteins 0.000 description 2
- 230000002829 reductive effect Effects 0.000 description 2
- 230000002441 reversible effect Effects 0.000 description 2
- 230000001052 transient effect Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000009849 deactivation Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005530 etching Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000008450 motivation Effects 0.000 description 1
- 238000009527 percussion Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000010183 spectrum analysis Methods 0.000 description 1
- 230000003936 working memory Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0316—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
- G10L21/0364—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude for improving intelligibility
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/022—Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
- G10L19/025—Detection of transients or attacks for time/frequency resolution switching
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/03—Spectral prediction for preventing pre-echo; Temporary noise shaping [TNS], e.g. in MPEG2 or MPEG4
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/26—Pre-filtering or post-filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
Definitions
- the invention relates to a pre-echo attenuation processing method and device for decoding a digital audio signal.
- compression processes for the transport of digital audio signals on transmission networks, whether for example fixed or mobile networks, or for the storage of signals, compression processes (or source coding) using coding systems of the time coding type or frequency coding by transform.
- the method and the device which are the subject of the invention, thus have as their field of application the compression of sound signals, in particular frequency-coded digital audio signals.
- FIG. 1 represents by way of illustration, a schematic diagram of the coding and decoding of a digital audio signal by transform including an addition / overlap synthesis analysis according to the prior art.
- Certain musical sequences such as percussion and certain segments of speech like the plosives (/ k /, lit, ...), are characterized by extremely sudden attacks which result in very fast transitions and a very strong variation of the dynamic signal within a few samples.
- An example of transition is given in Figure 1 from sample 410.
- the input signal is cut into blocks of samples of length L, represented in FIG. 1 by dotted vertical lines.
- the input signal is denoted x (ri), where n is the index of the sample.
- L 160 samples.
- the division in blocks, also called frames, operated by the transform coding is totally independent of the sound signal and the transitions can therefore appear at any point in the analysis window.
- the reconstructed signal is tainted by "noise" (or distortion) generated by the quantization (Q) - inverse quantization (Q 1 ) operation.
- This coding noise is temporally distributed relatively uniformly over the entire temporal support of the transformed block, that is to say on any the length of the window of length 2L of samples (with overlap of L samples).
- the energy of the coding noise is generally proportional to the energy of the block and is a function of the coding / decoding rate.
- an attacking block such as block 320-480 of FIG. 1
- the signal energy is high, so the noise is also high.
- the level of the coding noise is typically lower than that of the signal for the high energy segments that immediately follow the transition, but the level is higher than that of the signal for the lower energy segments, especially on the part preceding the transition (samples 160 - 410 of Figure 1).
- the signal-to-noise ratio is negative and the resulting degradation can appear very troublesome to listen.
- Pre-echo is the coding noise prior to the transition and post-echo the noise after the transition.
- the human ear also performs a post-masking of a longer duration, from 5 to 60 milliseconds, during the passage of high energy sequences to low energy sequences.
- the rate or level of inconvenience acceptable for post-echoes is therefore greater than for pre-echoes.
- MPEG AAC Advanced Audio Coding
- MPEG AAC Advanced Audio Coding
- Transform encoders used for conversational applications such as ITU-T G.722.1, G.722.1C or G.719 often use a window of 40 ms duration at 16, 32 or 48 kHz (respectively) and a frame length of 20 ms. ms. It should be noted that the ITU-T G.719 encoder incorporates a window switch mechanism with transient detection, however the pre-echo is not completely reduced at low bit rate (typically at 32 kbit / s).
- the aforementioned filtering process does not allow to find the original signal, but provides a strong reduction of pre-echo. However, it requires transmitting the additional parameters to the decoder.
- the attenuation factor per sub-block g (k) is calculated for example as a function of the ratio R (k) between the energy of the sub-block of higher energy and the energy of the k-th sub-block in question. :
- the factor g (k) is then set to an attenuation-inhibiting attenuation value, i.e. 1. Otherwise, the attenuation factor is between 0 and 1.
- the frame that precedes the pre-echo frame has a homogeneous energy that corresponds to the energy of a low energy segment (typically a background noise). According to experience, it is not useful or even desirable that after the pre-echo attenuation processing the signal energy becomes lower than the average energy per sub-block of the signal preceding the treatment zone.
- the limit value of the factor lim (k) can be calculated in order to obtain exactly the same energy as the average energy per sub-block of the segment preceding the sub-block to be processed. This value is of course limited to a maximum of 1 since it is of interest here to the attenuation values. More precisely :
- lim g (k) max (g (k), lim g (k))
- the attenuation factors (or gains) g (k) determined by sub-blocks are then smoothed by an applied smoothing function sample by sample to avoid abrupt changes in the attenuation factor at the block boundaries.
- L ' represents the length of a sub-block.
- x rec (n) is the signal decoded and post-processed by the pre-echo reduction.
- FIGS. 2 and 3 illustrate the implementation of the attenuation method as described in the patent application of the state of the art, cited above, and summarized above.
- the signal is sampled at 32 kHz, the length of the frame is
- a frame of an original signal sampled at 32 kHz is shown.
- An attack (or transition) in the signal is located in the sub-block beginning at the index 320.
- This signal has been coded by a low rate (24 kbit / s) MDCT type transform coder.
- Part c) shows the evolution of the pre-echo attenuation factor (solid line) obtained by the method described in the aforementioned prior art patent application.
- the dashed line represents the factor before smoothing. Note here that the position of the attack is estimated around the sample 380 (in the block delimited by the samples 320 and 400).
- Part d) illustrates the result of the decoding after application of pre-echo processing (multiplication of signal b) with signal c)).
- pre-echo has been attenuated.
- Figure 2 also shows that the smoothed factor does not go back to 1 at the time of the attack, which implies a decrease in the amplitude of the attack. The noticeable impact of this decrease is very small but can nevertheless be avoided.
- FIG. 3 illustrates the same example as FIG. 2, in which, before smoothing, the attenuation factor value is forced to 1 for the few samples of the sub-block preceding the sub-block where the attack is located. Part (c) of Figure 3 gives an example of such a correction.
- the value of factor 1 has been assigned to the last 16 samples of the sub-block preceding the attack, starting from the index 364.
- the smoothing function progressively increases the factor to have a value close to 1 at the moment. of the attack.
- the amplitude of the attack is then preserved, as illustrated in part d) of FIG. 3, but some pre-echo samples are not attenuated.
- pre-echo attenuation reduction does not reduce the pre-echo to the level of the attack, because of the smoothing gain.
- FIG 4 Another example with the same setting as that of Figure 3 is illustrated in Figure 4.
- This figure represents 2 frames to better show the nature of the signal before the attack.
- the energy of the original signal before the attack is stronger (part a) than in the case illustrated in Figure 3, and the signal before the attack is audible (samples 0 - 850).
- the signal before the attack is audible (samples 0 - 850).
- the signal energy of the pre-echo zone is attenuated to the average energy of the signal preceding the treatment zone.
- part c) the attenuation factor calculated taking into account the energy limitation is close to 1 and that the pre-echo is always present on part d) after application of the pre-echo treatment ( multiplication of the signal b) with the signal c)), despite the good leveling of the signal in the pre-echo zone.
- the pre-echo treatment multiplication of the signal b) with the signal c)
- FIGS. 5a and 5b respectively show the spectrograms of the original signal at 5a, corresponding to the signal represented in part a) of FIG. 4, and the spectrogram of the signal with attenuation of preechos according to the state of the art, at 5b, corresponding to the signal represented in part d) of FIG. 4.
- the present invention improves the state of the art.
- the present invention relates to a pre-echo attenuation processing method in a digital audio signal generated from a transform coding, wherein, upon decoding, the method comprises the following steps:
- the method is such that it further comprises:
- the spectral shaping applied improves the pre-echo attenuation.
- the treatment makes it possible to attenuate the pre-echo components that could remain during the implementation of the pre-echo attenuation as described in the state of the art.
- the filtering being applied to the detected position of the attack, it makes it possible to process the attenuation of the pre-echo up to the nearest attack. This therefore offsets the disadvantage of temporal attenuation echo control which is limited to a zone not going to the attack position (margin of 16 samples for example).
- This filtering does not require information from the encoder.
- This pre-echo attenuation processing technique may be implemented with or without knowledge of a signal derived from a time decoding and for the coding of a monophonic signal or a stereophonic signal.
- the adaptation of the filtering makes it possible to adapt to the signal and to remove only the disturbing parasitic components.
- the method further comprises calculating at least one decision parameter on the filtering to be applied to the pre-echo zone and the adaptation of the filtering coefficients according to said at least one parameter of decision.
- the treatment is then applied only when necessary to a suitable level of filtering.
- the at least one decision parameter is a measure of the strength of the detected attack.
- the force of the attack determines the presence of audible high-frequency components in the pre-echo zone.
- the attack is abrupt, the risk of having an annoying parasitic component in the pre-echo zone is large and the filtering to be implemented according to the invention is then to be expected.
- the measurement of the force of the detected attack is of the form:
- This calculation is of less complexity and makes it possible to define well the strength of the detected attack.
- the said at least one decision parameter may also be the value of the attenuation factor in the sub-block preceding that containing the position of the attack.
- said at least one decision parameter is based on a spectral distribution analysis of the signal of the pre-echo zone and / or of the signal preceding the pre-echo zone.
- the adaptation of the filter coefficients is carried out then by setting 0 or a value close to 0 of the filter coefficients.
- the adaptation of the filtering coefficients can be done in a discrete manner as a function of the comparison of at least one decision parameter with a predetermined threshold.
- the filter coefficients can take predetermined values according to a set of values.
- the smallest set of values being one where only two values are possible, it is a saying for example the choice between a filtering and no filtering.
- the adaptation of the filtering coefficients is carried out continuously according to said at least one decision parameter.
- the filtering is a finite impulse response with a null phase transfer function:
- This type of filtering is of low complexity and allows more processing without delay (the processing stops before the end of the current frame). Thanks to its zero delay, the filtering can attenuate the high frequencies before the attack without modifying the attack itself.
- This type of filtering makes it possible to avoid discontinuities and makes it possible to pass from an unfiltered signal to a filtered signal in a progressive manner.
- the attenuation step is performed at the same time as the spectral shaping filtering by integrating the attenuation factors with the coefficients defining the filtering.
- the present invention also relates to a pre-echo attenuation processing device in a digital audio signal generated from a transform coder, in which the device associated with a decoder comprises: a detection module for detecting a driving position in the decoded signal;
- a determination module for determining a pre-echo zone preceding the detected driving position in the decoded signal
- an attenuation module for attenuating the pre-echoes in the sub-blocks of the pre-echo zone by the corresponding attenuation factors.
- the device is such that it further comprises:
- an adaptive filtering module for effecting a spectral shaping of the pre-echo zone on the current frame to the detected position of the attack.
- the invention relates to a decoder of a digital audio signal comprising a device as described above.
- the invention is directed to a computer program comprising code instructions for implementing the steps of the attenuation processing method as described, when these instructions are executed by a processor.
- the invention relates to a storage medium, readable by a processor, integrated or not to the processing device, possibly removable, storing a computer program implementing a method of treatment as described above.
- FIG. 1 previously described illustrates a state-of-the-art transform coding-decoding system
- FIGS. 5a and 5b respectively show the spectrogram of the original signal and the spectrogram of the pre-echo attenuation signal according to the state of the art (corresponding to parts a) and d) respectively of FIG. 4);
- FIG. 6 illustrates a pre-echo attenuation processing device in a digital audio signal decoder, as well as the steps implemented by the processing method according to one embodiment of the invention;
- FIG. 7 illustrates the frequency response of a spectral shaping filter implemented according to one embodiment of the invention, as a function of the parameter of the filter
- FIG. 8 illustrates an exemplary digital audio signal for which the processing according to the invention has been implemented
- FIG. 9 illustrates the spectrogram of the signal corresponding to the signal d) of FIG. 4, for which the treatment according to the invention is implemented;
- FIG. 10 illustrates an exemplary signal having initially high frequency components for which a pre-echo mitigation method according to the state of the art is implemented
- FIG. 11 illustrates the same signal as FIG. 11, having originally high frequency components for which the processing according to the invention has been implemented without taking into account a decision criterion of the level of filtering. to apply;
- FIG. 12 illustrates a hardware example of an attenuation processing device according to the invention.
- a preecho attenuation processing device 600 implements a pre-echo attenuation method in the decoded signal, for example that described in the patent application FR 08 56248. It also implements a shaping filtering. spectral of the pre-echo zone.
- the device 600 comprises a detection module 601 able to implement a step of detecting (Detect.) The position of an attack in a decoded audio signal.
- An onset is a rapid transition and a sudden change in the dynamics (or amplitude) of the signal.
- This type of signal may be referred to by the more general term "transient”.
- transient we will use only the terms of attack or transition to designate also transients.
- the synthesis window MDCT contains only 415 non-zero samples, unlike the 640 samples in the case of using conventional sinusoidal windows.
- other analysis / synthesis windows may be used, or switches between long and short windows may be used.
- the MDCT x MDCT (n) memory is used which gives a time-folding version ("folding") of the future signal.
- Figure 1 shows that the pre-echo influences the frame before the one where the attack is located, and it is desirable to detect an attack in the future frame which is partially contained in the MDCT memory.
- the average energy level in the previous frame (or half-frame).
- the signal contained in the MDCT memory includes time folding (which is compensated when the next frame is received).
- the MDCT memory is used here essentially to estimate the energy by sub-blocks of the signal in the next (future) frame and it is considered that this estimate is sufficiently precise for the purposes of the detection and reduction of pre- echo when performed with the available MDCT memory at the current frame instead of the fully decoded signal at the future frame.
- the current frame and the MDCT memory can be seen as concatenated signals forming a signal of length (K + K ') L' cut in ( ⁇ + ⁇ ') consecutive sub-blocks.
- the energy in the k-th sub-block is defined as:
- n kV when the k-th sub-block is in the current frame and, like:
- the average energy of the sub-blocks in the current frame is thus obtained as:
- the average energy of the sub-blocks in the second part of the current frame is also defined as:
- a transition associated with a pre-echo is detected if the ratio max (En ⁇ k))
- R (k) exceeds a predefined threshold, in one of the sub-blocks considered.
- the device 600 also comprises a determination module 602 implementing a determination step (ZPE) of a pre-echo zone preceding the detected driving position.
- ZPE determination step
- the energies In [k) are concatenated in chronological order, with the time envelope of the decoded signal first, then the envelope of the signal of the next frame estimated from the memory of the MDCT transform. According to this envelope concatenated temporal and mean energies En and En 'of the previous frame, the presence of pre-echo is detected if the ratio R (k) is sufficiently strong.
- the pre-echo zone does not necessarily start at the beginning of the frame, and may involve an estimate of the length of the pre-echo. If window switching is used, the pre-echo zone must be set to take into account the windows used.
- a module 603 of the device 600 implements a sub-block attenuation factor calculation step of the determined pre-echo area, depending on the frame in which the attack was detected and the previous frame.
- the attenuations g (k) are estimated by sub-block.
- the attenuation factor by sub-block g (k) is calculated for example, as a function of the ratio R (k) between the energy of the sub-block of higher energy and the energy of the k-th sub-block in question
- the factor is then set to an attenuation-inhibiting attenuation value, i.e. 1. Otherwise, the attenuation factor is between 0 and 1.
- the limit value of the factor lim (k) can be calculated in order to obtain exactly the same energy as the average energy of the segment preceding the sub-block to be treated. This value is of course limited to a maximum of 1 since we are interested here in the attenuation values. More precisely :
- g (k) max (g (k), lim g (k))
- the attenuation factors g (k) determined by sub-blocks are then smoothed by an applied smoothing function sample by sample to avoid abrupt changes in the attenuation factor at the boundaries of the blocks.
- the gain per sample is first defined as a piecewise constant function:
- the smoothing function is for example defined by the following equations:
- the module 604 of the device 600 of FIG. 6 implements the attenuation (Att.) In the sub-blocks of the pre-echo zone, by the attenuation factors obtained.
- x rec (n) is the decoded and post-processed signal for pre-echo reduction.
- the device 600 comprises a filtering module 606 capable of performing the step (F) of applying a spectral shaping filtering of the pre-echo zone to the current frame of the decoded signal, to the position detected from the attack.
- the spectral shaping filter used is a linear filter. Since the gain multiplication operation is also a linear operation, their order can be inverted: you can also do the formatting filtering first. Spectrum of the pre-echo area then the pre-echo attenuation by multiplying each sample of the pre-echo area by the corresponding factor.
- the filter used to attenuate the high frequencies in the pre-echo zone is a FIR filter (finite impulse response filter) with 3 coefficients and with a zero transfer function phase c (ri) z ⁇ l + (l - 2c (n)) + c (n) z with c (n) a value between 0 and 0.25, where [c (n), l - 2c (n), c (n)] are the coefficients of spectral shaping filter; this filter is implemented with the difference equation:
- c (n) 0.05, 0.1, 0.15, 0.2 and 0.25.
- the motivation for using this filter is its low complexity, its null phase and therefore its zero delay (possible because the processing stops before the end of the current frame) but also its frequency response which corresponds well to the desired low-pass characteristics for this filter.
- this filter can compensate for the fact that the temporal attenuation of the pre-echo is typically limited to a zone that does not go up to the position of the attack (with a margin of, for example, 16 samples), whereas the spectral shaping filtering as defined by the transfer function c (ri) z ⁇ l + (l-2c (n)) + c (n) z can be applied up to the attack position, with possibly some interpolation samples of the filter coefficients.
- x rec (1) 0. ⁇ x rec (0) + 0.8x rec (1) + 0. ⁇ x rec (2)
- x rec (2) 0. ⁇ x rec (1) + 0.8x rec (2)
- 0. ⁇ x rec (3) 0.15x rec (2) + 0.7x rec (3) + 0.15x rec (4)
- the filter c (n) z 1 + (l - 2c (n)) + c (n) z can attenuate the high frequencies before the attack without modifying the attack itself.
- Part d) of FIG. 8 An example of a digital audio signal, for which the processing as described here is carried out, is illustrated in part d) of FIG. 8.
- Parts a), b) and c) of this figure show the same signals as those described with reference in Figure 4 previously.
- Part d) differs by the implementation of filtering according to the invention. It can thus be noted that the disturbing high frequency component is greatly reduced, so that the signal decoded after filtering has a better quality than that described in part d) of FIG. 4.
- FIG. 9 The spectrogram representing this filtered signal is represented in FIG. 9. It is clearly observed with respect to FIG. 5b representing the same signal without shaping filtering, the attenuation of the disturbing high frequencies before the attack. The attack becomes sharper at decoding.
- spectral shaping filters may be considered to replace the filter c (nz ⁇ 1 + (l-2c (n)) + c (n) z ⁇
- the spectral shaping filter can be infinite impulse response (IIR)
- the spectral shaping may be different from a pass filtering, by example a pass4 ande filter could be implemented.
- a filter of order 1, of the form c (nz ⁇ 1 + (l - c (n)) can also be used in one embodiment of the invention.
- the filtering implemented according to the method described is an adaptive filtering. It can thus be adapted to the characteristics of the decoded audio signal.
- a step of calculating a decision parameter (P) on the filtering to be applied to the pre-echo zone is implemented in the calculation module 605 of FIG. 6.
- part a the high frequencies are already present in the signal to be coded. In this case the attenuation of high frequencies could cause an audible degradation which must be avoided. In this signal example, it is observed that the attack is less abrupt than in the previous examples.
- this decision parameter is representative of the presence of high frequency components in the pre-echo zone.
- This parameter can be for example a measure of the strength of the attack (abrupt or not). If the attack is located in sub-block number k, the parameter can be calculated as:
- En (k) is the energy in the k-th sub-block.
- the force measurement of the attack can be completed taking into account also the attenuation determined for the sub-block preceding the attack g [k-1).
- An attack can be considered abrupt if this attenuation is significant, for example if g [k - l) ⁇ 0.5. This shows that the energy in the pre-echo zone is considerably increased (more than doubled) because of the pre-echo, which also signals a sudden attack.
- the spectral shaping filter is applied, according to the invention, from the beginning of the current frame to the position p0 s of position of the 'attack.
- the spectral shaping of the pre-echo zone by filtering according to the invention is adaptive as a function of the parameter P and the attenuation values.
- the filtering is either applied with coefficients [0.25, 0.5, 0.25], or deactivated with coefficients [0, 1, 0].
- the filter coefficients are then adapted in a discrete manner limited to a predefined set of values.
- the adaptation of the filter coefficients (making it possible to adapt the attenuation level of the high frequencies) is thus determined by decision parameters which measure the force of the attack, such as the parameters P and g [k-1). is in this case one of adaptation of the coefficients of the filter in a discrete manner according to two sets of possible values ([0.25, 0.5, 0.25] or [0, 1, 0]). It can be noted that the set of coefficients [0, 1, 0] corresponds to a deactivation of the filtering.
- a progressive transition between these two filters can be carried out using also for example the intermediate filters of coefficient [0.05, 0.9, 0.05], [0.1, 0.8, 0.1], [0.15, 0.7, 0.15] and [0.2, 0.6, 0.2 ].
- c (n) can also be calculated continuously as a function of P, for example with
- a high rate of zero crossing zc in the previous frame signals the presence of high frequencies in the signal.
- zc> L / 2 on the previous frame it is preferable not to apply the filtering c (n) z ⁇ l + (l - 2c (n)) + c (n) z.
- a pre-filtering of the decoded signal is also possible before calculating the zero crossing rate, or the number of zero crossings of the estimated derivative x rec g ⁇ n) - x rec [ n- 1) can be used.
- a spectral analysis of the signal can also be made to assist the decision.
- the spectral envelope in the MDCT domain resulting from the MDCT coding / decoding can be exploited in the choice of the filter to be used, however this variant assumes that the MDCT analysis / synthesis windows are sufficiently short for the local statistics of the MDCT to be used. signal before the attack remain stable over the length of a window.
- c (n) 0.25
- the value of c (n) will be chosen so that the average energy of the filtered signals in the pre-echo zone and on the past frame are as close as possible; the choice of c (n) can be made on a limited set of possible values shown in FIG. 7 or on the basis of the energy ratio (or of an equivalent quantity such as the square root of the energy) of the signal after filtering high pass in the pre-echo area and in the past frame.
- the decision parameter on the filtering to be applied to the pre-echo zone is based on a spectral distribution analysis of the signal the pre-echo zone and / or the preceding signal of the pre-echo zone; if the signal preceding the pre-echo zone already contains many high frequencies or if the amount of the high frequencies of the signal in the pre-echo zone and the signal preceding the pre-echo zone is substantially identical, the filtering according to the invention is not necessary and may even cause slight degradation. In these cases, the filtering according to the invention must be deactivated or attenuated by setting c (n) to 0 or to a low value close to 0.
- the order between the attenuation and filtering step may be reversed.
- the filtering (F) of spectral shaping is done before the attenuation (Att.).
- these samples are then weighted by multiplying each sample by the corresponding attenuation factor calculated previously:
- the attenuation of the amplitudes can also be combined (or integrated) by defining a set of "conjoint" filter coefficients, for example if for the sample n the filter has coefficients [c (ri), l-2c (") , c (ri)] and the attenuation factor is g (ri), we can directly use the filter [g pm (n) c (n), g pre (n) 2 g pm (n) c (n) , g pre (n) c (n)].
- Figure 11 illustrates the advantage of making adaptive filtering. It uses the same signals parts a), b) and c) as Figure 10 and illustrates that the implementation of the nonadaptive filtering shown in part d), unnecessarily modifies the signal in the case where the high-frequency components are already present in the signal to be encoded. It is observed that from sample 640 the high frequencies are unnecessarily attenuated, which could lead to a slight deterioration in quality.
- the use of an adaptive filtering as described above makes it possible to inhibit or attenuate the filtering under these conditions, not to remove high frequencies already present in the signal to be coded and thus to avoid possible degradation due to the filtering.
- the attenuation processing device 600 as described is here included in a decoder comprising a reverse quantization module 610 (Q 1 ) receiving a signal S, a reverse transformation module 620 (MDCT 1 ) , a module 630 for reconstruction of the addition / recovery signal (add / rec) as described with reference to FIG. 1 and delivering a reconstructed signal to the attenuation processing device according to the invention.
- a processed signal Sa is provided in which a pre-echo attenuation has been performed.
- the processing performed improved the pre-echo attenuation by attenuating, if necessary, the high-frequency components in the pre-echo area.
- this device 100 in the sense of the invention typically comprises a ⁇ processor cooperating with a memory block BM including a storage and / or working memory, and a memory buffer MEM mentioned above as a means for storing all data. necessary to implement the attenuation processing method as described with reference to Figure 6.
- This device receives as input successive frames of the digital signal Se and delivers the reconstructed signal Sa with pre-echo attenuation and filtering of Spectral shaping, if any.
- the memory block BM may comprise a computer program comprising the code instructions for implementing the steps of the method according to the invention when these instructions are executed by a processor ⁇ of the device and in particular a step of detecting a position of etching in the decoded signal, of determining a pre-echo area preceding the detected attack position in the decoded signal, of calculating sub-block attenuation factors of the pre-echo area, as a function of the frame in which the attack has been detected and the previous frame, pre-echo attenuation in the sub-blocks of the pre-echo zone by the corresponding attenuation factors and further, a step of applying spectral shaping filtering of the pre-echo area on the current frame to the detected position of the attack.
- Figure 6 can illustrate the algorithm of such a computer program.
- This attenuation device can be independent or integrated into a digital signal decoder.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Quality & Reliability (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1256285A FR2992766A1 (en) | 2012-06-29 | 2012-06-29 | EFFECTIVE MITIGATION OF PRE-ECHO IN AUDIONUMERIC SIGNAL |
PCT/FR2013/051517 WO2014001730A1 (en) | 2012-06-29 | 2013-06-28 | Effective pre-echo attenuation in a digital audio signal |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2867893A1 true EP2867893A1 (en) | 2015-05-06 |
EP2867893B1 EP2867893B1 (en) | 2018-11-28 |
Family
ID=47191858
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13744654.8A Active EP2867893B1 (en) | 2012-06-29 | 2013-06-28 | Effective pre-echo attenuation in a digital audio signal |
Country Status (12)
Country | Link |
---|---|
US (1) | US9489964B2 (en) |
EP (1) | EP2867893B1 (en) |
JP (1) | JP6271531B2 (en) |
KR (1) | KR102082156B1 (en) |
CN (1) | CN104395958B (en) |
BR (1) | BR112014032587B1 (en) |
CA (1) | CA2874965C (en) |
ES (1) | ES2711132T3 (en) |
FR (1) | FR2992766A1 (en) |
MX (1) | MX349600B (en) |
RU (1) | RU2607418C2 (en) |
WO (1) | WO2014001730A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110832581A (en) * | 2017-03-31 | 2020-02-21 | 弗劳恩霍夫应用研究促进协会 | Apparatus for post-processing audio signals using transient position detection |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2992766A1 (en) * | 2012-06-29 | 2014-01-03 | France Telecom | EFFECTIVE MITIGATION OF PRE-ECHO IN AUDIONUMERIC SIGNAL |
FR3023646A1 (en) * | 2014-07-11 | 2016-01-15 | Orange | UPDATING STATES FROM POST-PROCESSING TO A VARIABLE SAMPLING FREQUENCY ACCORDING TO THE FRAMEWORK |
FR3025923A1 (en) * | 2014-09-12 | 2016-03-18 | Orange | DISCRIMINATION AND ATTENUATION OF PRE-ECHO IN AUDIONUMERIC SIGNAL |
EP3382701A1 (en) | 2017-03-31 | 2018-10-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for post-processing an audio signal using prediction based shaping |
WO2019091576A1 (en) | 2017-11-10 | 2019-05-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoders, audio decoders, methods and computer programs adapting an encoding and decoding of least significant bits |
EP3483880A1 (en) * | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Temporal noise shaping |
EP3483879A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Analysis/synthesis windowing function for modulated lapped transformation |
EP3483884A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Signal filtering |
WO2019091573A1 (en) | 2017-11-10 | 2019-05-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for encoding and decoding an audio signal using downsampling or interpolation of scale parameters |
EP3483886A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Selecting pitch lag |
EP3483883A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio coding and decoding with selective postfiltering |
EP3483882A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Controlling bandwidth in encoders and/or decoders |
EP3483878A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio decoder supporting a set of different loss concealment tools |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2674710B1 (en) * | 1991-03-27 | 1994-11-04 | France Telecom | METHOD AND SYSTEM FOR PROCESSING PREECHOS OF AN AUDIO-DIGITAL SIGNAL ENCODED BY FREQUENTIAL TRANSFORM. |
US5731767A (en) * | 1994-02-04 | 1998-03-24 | Sony Corporation | Information encoding method and apparatus, information decoding method and apparatus, information recording medium, and information transmission method |
JP3186412B2 (en) * | 1994-04-01 | 2001-07-11 | ソニー株式会社 | Information encoding method, information decoding method, and information transmission method |
JPH08223049A (en) * | 1995-02-14 | 1996-08-30 | Sony Corp | Signal coding method and device, signal decoding method and device, information recording medium and information transmission method |
JP3307138B2 (en) * | 1995-02-27 | 2002-07-24 | ソニー株式会社 | Signal encoding method and apparatus, and signal decoding method and apparatus |
JP4581190B2 (en) * | 2000-06-19 | 2010-11-17 | ヤマハ株式会社 | Music signal time axis companding method and apparatus |
KR100821499B1 (en) * | 2000-12-14 | 2008-04-11 | 소니 가부시끼 가이샤 | Information extracting device |
CN1308912C (en) * | 2001-11-16 | 2007-04-04 | 皇家飞利浦电子股份有限公司 | Embedding supplementary data in an information signal |
AU2003208517A1 (en) * | 2003-03-11 | 2004-09-30 | Nokia Corporation | Switching between coding schemes |
US7443978B2 (en) * | 2003-09-04 | 2008-10-28 | Kabushiki Kaisha Toshiba | Method and apparatus for audio coding with noise suppression |
EP1542226A1 (en) * | 2003-12-11 | 2005-06-15 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for transmitting watermark data bits using a spread spectrum, and for regaining watermark data bits embedded in a spread spectrum |
FR2897733A1 (en) * | 2006-02-20 | 2007-08-24 | France Telecom | Echo discriminating and attenuating method for hierarchical coder-decoder, involves attenuating echoes based on initial processing in discriminated low energy zone, and inhibiting attenuation of echoes in false alarm zone |
DE102006047197B3 (en) * | 2006-07-31 | 2008-01-31 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Device for processing realistic sub-band signal of multiple realistic sub-band signals, has weigher for weighing sub-band signal with weighing factor that is specified for sub-band signal around subband-signal to hold weight |
US8463603B2 (en) * | 2008-09-06 | 2013-06-11 | Huawei Technologies Co., Ltd. | Spectral envelope coding of energy attack signal |
US8676365B2 (en) * | 2008-09-17 | 2014-03-18 | Orange | Pre-echo attenuation in a digital audio signal |
FR2936898A1 (en) * | 2008-10-08 | 2010-04-09 | France Telecom | CRITICAL SAMPLING CODING WITH PREDICTIVE ENCODER |
CN101826327B (en) * | 2009-03-03 | 2013-06-05 | 中兴通讯股份有限公司 | Method and system for judging transient state based on time domain masking |
JP5287546B2 (en) * | 2009-06-29 | 2013-09-11 | 富士通株式会社 | Information processing apparatus and program |
US9672840B2 (en) * | 2011-10-27 | 2017-06-06 | Lg Electronics Inc. | Method for encoding voice signal, method for decoding voice signal, and apparatus using same |
FR2992766A1 (en) * | 2012-06-29 | 2014-01-03 | France Telecom | EFFECTIVE MITIGATION OF PRE-ECHO IN AUDIONUMERIC SIGNAL |
FR3000328A1 (en) * | 2012-12-21 | 2014-06-27 | France Telecom | EFFECTIVE MITIGATION OF PRE-ECHO IN AUDIONUMERIC SIGNAL |
-
2012
- 2012-06-29 FR FR1256285A patent/FR2992766A1/en active Pending
-
2013
- 2013-06-28 MX MX2014015065A patent/MX349600B/en active IP Right Grant
- 2013-06-28 CA CA2874965A patent/CA2874965C/en active Active
- 2013-06-28 BR BR112014032587-1A patent/BR112014032587B1/en active IP Right Grant
- 2013-06-28 ES ES13744654T patent/ES2711132T3/en active Active
- 2013-06-28 EP EP13744654.8A patent/EP2867893B1/en active Active
- 2013-06-28 KR KR1020147036551A patent/KR102082156B1/en active IP Right Grant
- 2013-06-28 CN CN201380034828.2A patent/CN104395958B/en active Active
- 2013-06-28 RU RU2015102814A patent/RU2607418C2/en active
- 2013-06-28 JP JP2015519300A patent/JP6271531B2/en active Active
- 2013-06-28 US US14/411,790 patent/US9489964B2/en active Active
- 2013-06-28 WO PCT/FR2013/051517 patent/WO2014001730A1/en active Application Filing
Non-Patent Citations (1)
Title |
---|
See references of WO2014001730A1 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110832581A (en) * | 2017-03-31 | 2020-02-21 | 弗劳恩霍夫应用研究促进协会 | Apparatus for post-processing audio signals using transient position detection |
CN110832581B (en) * | 2017-03-31 | 2023-12-29 | 弗劳恩霍夫应用研究促进协会 | Apparatus for post-processing an audio signal using transient position detection |
Also Published As
Publication number | Publication date |
---|---|
US20150170668A1 (en) | 2015-06-18 |
EP2867893B1 (en) | 2018-11-28 |
BR112014032587A2 (en) | 2017-06-27 |
RU2015102814A (en) | 2016-08-20 |
US9489964B2 (en) | 2016-11-08 |
JP6271531B2 (en) | 2018-01-31 |
RU2607418C2 (en) | 2017-01-10 |
CN104395958B (en) | 2017-09-05 |
CN104395958A (en) | 2015-03-04 |
KR102082156B1 (en) | 2020-04-14 |
CA2874965C (en) | 2021-01-19 |
WO2014001730A1 (en) | 2014-01-03 |
FR2992766A1 (en) | 2014-01-03 |
CA2874965A1 (en) | 2014-01-03 |
JP2015522847A (en) | 2015-08-06 |
KR20150052812A (en) | 2015-05-14 |
BR112014032587B1 (en) | 2022-08-09 |
ES2711132T3 (en) | 2019-04-30 |
MX2014015065A (en) | 2015-02-17 |
MX349600B (en) | 2017-08-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2867893B1 (en) | Effective pre-echo attenuation in a digital audio signal | |
EP2936488B1 (en) | Effective attenuation of pre-echos in a digital audio signal | |
EP2586133B1 (en) | Controlling a noise-shaping feedback loop in a digital audio signal encoder | |
EP2153438B1 (en) | Post-processing for reducing quantification noise of an encoder during decoding | |
FR2897733A1 (en) | Echo discriminating and attenuating method for hierarchical coder-decoder, involves attenuating echoes based on initial processing in discriminated low energy zone, and inhibiting attenuation of echoes in false alarm zone | |
WO2006032760A1 (en) | Method of processing a noisy sound signal and device for implementing said method | |
FR2741217A1 (en) | METHOD AND DEVICE FOR REMOVING PARASITE NOISE IN A COMMUNICATION SYSTEM | |
FR2820227A1 (en) | NOISE REDUCTION METHOD AND DEVICE | |
FR2907586A1 (en) | Digital audio signal e.g. speech signal, synthesizing method for adaptive differential pulse code modulation type decoder, involves correcting samples of repetition period to limit amplitude of signal, and copying samples in replacing block | |
EP3084959B1 (en) | Resampling of an audio signal interrupted with a variable sampling frequency according to the frame | |
FR2977439A1 (en) | WINDOW WINDOWS IN ENCODING / DECODING BY TRANSFORMATION WITH RECOVERY, OPTIMIZED IN DELAY. | |
FR3007563A1 (en) | ENHANCED FREQUENCY BAND EXTENSION IN AUDIO FREQUENCY SIGNAL DECODER | |
EP2347411B1 (en) | Pre-echo attenuation in a digital audio signal | |
EP3192073B1 (en) | Discrimination and attenuation of pre-echoes in a digital audio signal | |
EP2652735B1 (en) | Improved encoding of an improvement stage in a hierarchical encoder | |
EP3167447B1 (en) | Update of post-processing states with variable sampling frequency according to the frame | |
FR3020732A1 (en) | PERFECTED FRAME LOSS CORRECTION WITH VOICE INFORMATION | |
WO2014009657A1 (en) | Processing method for improving the quality of audio frequency signals |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20150127 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20171020 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20180727 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1071154 Country of ref document: AT Kind code of ref document: T Effective date: 20181215 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013047454 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20181128 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1071154 Country of ref document: AT Kind code of ref document: T Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190328 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190228 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190228 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2711132 Country of ref document: ES Kind code of ref document: T3 Effective date: 20190430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190328 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190301 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013047454 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
26N | No opposition filed |
Effective date: 20190829 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190628 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190628 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20130628 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20230703 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240521 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240521 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20240522 Year of fee payment: 12 Ref country code: FR Payment date: 20240522 Year of fee payment: 12 |