EP2867893B1 - Atténuation efficace de pré-échos dans un signal audionumérique - Google Patents
Atténuation efficace de pré-échos dans un signal audionumérique Download PDFInfo
- Publication number
- EP2867893B1 EP2867893B1 EP13744654.8A EP13744654A EP2867893B1 EP 2867893 B1 EP2867893 B1 EP 2867893B1 EP 13744654 A EP13744654 A EP 13744654A EP 2867893 B1 EP2867893 B1 EP 2867893B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- echo
- attack
- signal
- filtering
- attenuation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005236 sound signal Effects 0.000 title claims description 21
- 238000001914 filtration Methods 0.000 claims description 80
- 238000000034 method Methods 0.000 claims description 40
- 230000003595 spectral effect Effects 0.000 claims description 26
- 238000007493 shaping process Methods 0.000 claims description 23
- 238000012545 processing Methods 0.000 claims description 20
- 230000006978 adaptation Effects 0.000 claims description 13
- 238000002592 echocardiography Methods 0.000 claims description 12
- 230000003044 adaptive effect Effects 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 10
- 230000004044 response Effects 0.000 claims description 10
- 238000004364 calculation method Methods 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 7
- 238000012546 transfer Methods 0.000 claims description 7
- 238000005259 measurement Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 description 26
- 230000007704 transition Effects 0.000 description 17
- 230000015654 memory Effects 0.000 description 14
- 238000009499 grossing Methods 0.000 description 11
- 230000009467 reduction Effects 0.000 description 9
- 238000003786 synthesis reaction Methods 0.000 description 6
- 230000002238 attenuated effect Effects 0.000 description 5
- 230000015572 biosynthetic process Effects 0.000 description 5
- 230000000116 mitigating effect Effects 0.000 description 5
- 230000000750 progressive effect Effects 0.000 description 5
- 238000013139 quantization Methods 0.000 description 5
- 230000002123 temporal effect Effects 0.000 description 5
- 230000015556 catabolic process Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 238000006731 degradation reaction Methods 0.000 description 4
- 238000003672 processing method Methods 0.000 description 4
- 101100412102 Haemophilus influenzae (strain ATCC 51907 / DSM 11121 / KW20 / Rd) rec2 gene Proteins 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 230000003071 parasitic effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 101100356020 Haemophilus influenzae (strain ATCC 51907 / DSM 11121 / KW20 / Rd) recA gene Proteins 0.000 description 2
- 101100042680 Mus musculus Slc7a1 gene Proteins 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000012885 constant function Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000002401 inhibitory effect Effects 0.000 description 2
- 230000000873 masking effect Effects 0.000 description 2
- 230000002829 reductive effect Effects 0.000 description 2
- 230000002441 reversible effect Effects 0.000 description 2
- 230000001052 transient effect Effects 0.000 description 2
- 241000287107 Passer Species 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000009849 deactivation Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 229940082150 encore Drugs 0.000 description 1
- 238000005530 etching Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000003607 modifier Substances 0.000 description 1
- 230000008450 motivation Effects 0.000 description 1
- 238000009527 percussion Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000010183 spectrum analysis Methods 0.000 description 1
- 230000003936 working memory Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/03—Spectral prediction for preventing pre-echo; Temporary noise shaping [TNS], e.g. in MPEG2 or MPEG4
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0316—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
- G10L21/0364—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude for improving intelligibility
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/26—Pre-filtering or post-filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/022—Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
- G10L19/025—Detection of transients or attacks for time/frequency resolution switching
Definitions
- the invention relates to a pre-echo attenuation processing method and device for decoding a digital audio signal.
- compression processes for the transport of digital audio signals on the transmission networks, whether for example fixed or mobile networks, or for the storage of signals, compression processes (or source coding) using coding systems of the time coding type or frequency coding by transform.
- the method and the device which are the subject of the invention, thus have as their field of application the compression of sound signals, in particular frequency-coded digital audio signals.
- the figure 1 represents for illustrative purposes, a block diagram of the coding and decoding of a digital audio signal by transform including an addition / overlap synthesis analysis according to the prior art.
- Certain musical sequences such as percussion and certain segments of speech like the plosives (/ k /, / t /, ...), are characterized by extremely sudden attacks which result in very fast transitions and a very strong variation signal dynamics in a few samples.
- An example of a transition is given to the figure 1 from sample 410.
- the input signal is cut into blocks of samples of length L, represented on the figure 1 by dotted vertical lines.
- the input signal is denoted x ( n ), where n is the index of the sample.
- L 160 samples.
- the division in blocks, also called frames, operated by the transform coding is totally independent of the sound signal and the transitions can therefore appear at any point in the analysis window. But after transform decoding, the reconstructed signal is tainted by "noise” (or distortion) generated by the quantization (Q) -quantization inverse (Q -1 ) operation.
- This coding noise is temporally distributed relatively uniformly over the entire temporal support of the transformed block, that is to say on any the length of the window of length 2L of samples (with overlap of L samples).
- the energy of the coding noise is generally proportional to the energy of the block and is a function of the coding / decoding rate.
- the level of the coding noise is typically lower than that of the signal for the high energy segments that immediately follow the transition, but the level is higher than that of the signal for the lower energy segments, especially on the part preceding the transition (samples 160 - 410 of the figure 1 ).
- the signal-to-noise ratio is negative and the resulting degradation can appear very troublesome to listen.
- Pre-echo is the coding noise prior to the transition and post-echo the noise after the transition.
- the human ear also performs a post-masking of a longer duration, from 5 to 60 milliseconds, during the passage of high energy sequences to low energy sequences.
- the rate or level of inconvenience acceptable for post-echoes is therefore greater than for pre-echoes.
- MPEG AAC Advanced Audio Coding
- MPEG AAC Advanced Audio Coding
- Transform encoders used for conversational applications such as ITU-T G.722.1, G.722.1C or G.719 often use a window of 40 ms duration at 16, 32 or 48 kHz (respectively) and a frame length of 20 ms . It should be noted that the ITU-T G.719 encoder incorporates a window switch mechanism with transient detection, however the pre-echo is not completely reduced at low bit rate (typically at 32 kbit / s).
- the aforementioned filtering process does not allow to find the original signal, but provides a strong reduction of pre-echoes. However, it requires transmitting the additional parameters to the decoder.
- Other definitions of the factor g ( k ) are possible, for example as a function of the energy En ( k ) in the current sub-block and the energy En ( k -1) in the preceding sub-block.
- the factor g ( k ) is then set to an attenuation-inhibiting attenuation value, i.e. 1. Otherwise, the attenuation factor is between 0 and 1.
- the frame that precedes the pre-echo frame has a homogeneous energy that corresponds to the energy of a low energy segment (typically a background noise).
- a background noise typically a background noise
- the attenuation factors (or gains) g ( k ) determined by sub-blocks are then smoothed by an applied smoothing function sample by sample to avoid abrupt changes in the attenuation factor at the block boundaries.
- L ' represents the length of a sub-block.
- g pre (-1) is the last attenuation factor obtained for the last sample of the previous sub-block
- the signal is sampled at 32 kHz
- part a) of the figure 2 a frame of an original signal sampled at 32 kHz is shown.
- An attack (or transition) in the signal is located in the sub-block beginning at the index 320.
- This signal has been coded by a low rate (24 kbit / s) MDCT type transform coder.
- part (b) of the figure 2 the result of the decoding without pre-echo processing is illustrated.
- the pre-echo can be observed from sample 160, in the preceding sub-blocks the one containing the attack.
- Part c) shows the evolution of the pre-echo attenuation factor (solid line) obtained by the method described in the aforementioned prior art patent application.
- the dashed line represents the factor before smoothing. Note here that the position of the attack is estimated around the sample 380 (in the block delimited by the samples 320 and 400).
- the value of factor 1 has been assigned to the last 16 samples of the sub-block preceding the attack, starting from the index 364.
- the smoothing function progressively increases the factor to have a value close to 1 at the moment. of the attack.
- the amplitude of the attack is then preserved, as illustrated in part d) of the figure 3 however, some pre-echo samples are not attenuated.
- Attenuation pre-echo reduction does not reduce the pre-echo to the attack level because of gain smoothing.
- FIG 4 Another example with the same setting as that of the figure 3 is illustrated on the figure 4 .
- This figure represents 2 frames to better show the nature of the signal before the attack.
- the energy of the original signal before the attack is stronger (part a) than in the case illustrated by the figure 3 , and the signal before the attack is audible (samples 0 - 850).
- part b) we can observe the pre-echo on the decoded signal without pre-echo processing in the 700-850 area.
- the signal energy of the pre-echo zone is attenuated to the average energy of the signal preceding the treatment zone.
- part c) the attenuation factor calculated taking into account the energy limitation is close to 1 and that the pre-echo is always present on part d) after application of the pre-echo treatment ( multiplication of the signal b) with the signal c)), despite the good leveling of the signal in the pre-echo zone.
- the pre-echo treatment multiplication of the signal b) with the signal c)
- the present invention improves the state of the art.
- the spectral shaping applied improves the pre-echo attenuation.
- the treatment makes it possible to attenuate the pre-echo components that could remain during the implementation of the pre-echo attenuation as described in the state of the art.
- the filtering being applied to the detected position of the attack, it makes it possible to process the attenuation of the pre-echo up to the nearest attack. This therefore offsets the disadvantage of temporal attenuation echo control which is limited to a zone not going to the attack position (margin of 16 samples for example).
- This pre-echo attenuation processing technique can be implemented with or without knowledge of a signal derived from a time decoding and for coding a monophonic signal or a stereophonic signal.
- the adaptation of the filtering makes it possible to adapt to the signal and to remove only the disturbing parasitic components.
- the method further comprises calculating at least one decision parameter on the filtering to be applied to the pre-echo zone and the adaptation of the filtering coefficients according to said at least one parameter of decision.
- the treatment is then applied only when necessary to a suitable level of filtering.
- the at least one decision parameter is a measure of the strength of the detected attack.
- the force of the attack determines the presence of audible high-frequency components in the pre-echo zone.
- the attack is abrupt, the risk of having an annoying parasitic component in the pre-echo zone is large and the filtering to be carried out according to the invention is then to be expected.
- This calculation is of less complexity and makes it possible to define well the strength of the detected attack.
- the said at least one decision parameter may also be the value of the attenuation factor in the sub-block preceding that containing the position of the attack.
- said at least one decision parameter is based on a spectral distribution analysis of the signal of the pre-echo zone and / or of the signal preceding the pre-echo zone.
- the adaptation of the filtering coefficients can be done in a discrete manner as a function of the comparison of at least one decision parameter with a predetermined threshold.
- the filter coefficients can take predetermined values according to a set of values.
- the smallest set of values being one where only two values are possible, it is a saying for example the choice between a filtering and no filtering.
- the adaptation of the filtering coefficients is carried out continuously according to said at least one decision parameter.
- the attenuation step is performed at the same time as the spectral shaping filtering by integrating the attenuation factors with the coefficients defining the filtering.
- the invention relates to a decoder of a digital audio signal comprising a device as described above.
- the invention is directed to a computer program comprising code instructions for implementing the steps of the attenuation processing method as described, when these instructions are executed by a processor.
- the invention relates to a storage medium, readable by a processor, integrated or not to the processing device, optionally removable, storing a computer program implementing a method of treatment as described above.
- a pre-echo attenuation processing device 600 is described.
- this device implements a pre-echo attenuation method in the decoded signal, for example that described in the patent application.
- FR 08 56248 It furthermore implements spectral shaping filtering of the pre-echo zone.
- the device 600 comprises a detection module 601 able to implement a step of detecting (Detect.) The position of an attack in a decoded audio signal.
- An onset is a rapid transition and a sudden change in the dynamics (or amplitude) of the signal.
- This type of signal may be referred to by the more general term "transient”.
- transient we will use only the terms of attack or transition to designate also transients.
- the synthesis window MDCT contains only 415 non-zero samples, unlike the 640 samples in the case of using conventional sinusoidal windows.
- other analysis / synthesis windows may be used, or switches between long and short windows may be used.
- the MDCT x MDCT ( n ) memory is used which gives a time-folding version ("folding") of the future signal.
- the figure 1 shows that the pre-echo influences the frame preceding the one where the attack is located, and it is desirable to detect an attack in the future frame which is partially contained in the MDCT memory.
- the signal contained in the MDCT memory includes time folding (which is compensated when the next frame is received).
- the MDCT memory serves essentially to estimate the energy by sub-blocks of the signal in the next (future) frame, and it is considered that this estimate is sufficiently precise for the purposes of the detection and reduction of pre- echo when performed with the available MDCT memory at the current frame instead of the fully decoded signal at the future frame.
- the current frame and the MDCT memory can be seen as concatenated signals forming a signal of length (K + K ') L' cut into (K + K ') consecutive sub-blocks.
- the ' - 1 x rec not 2 , k 0 ... , K - 1 when the k-th sub-block is in the current frame and, like:
- the ' - 1 x MDCT not 2 , k K , ...
- Other pre-echo detection criteria are possible without changing the nature of the invention.
- the device 600 also comprises a determination module 602 implementing a determination step (ZPE) of a pre-echo zone preceding the detected attack position.
- ZPE determination step
- the energies En ( k ) are concatenated in chronological order, with the time envelope of the decoded signal first, then the envelope of the signal of the next frame estimated from the memory of the MDCT transform. According to this envelope concatenated temporal and mean energies In and In' of the previous frame, the presence of pre-echo is detected if the ratio R ( k ) is sufficiently strong.
- the pre-echo zone does not necessarily start at the beginning of the frame, and may involve an estimate of the length of the pre-echo. If window switching is used, the pre-echo zone must be defined to take into account the windows used.
- a module 603 of the device 600 implements a sub-block attenuation factor calculation step of the determined pre-echo area, depending on the frame in which the attack was detected and the previous frame.
- Other definitions of the factor g ( k ) are possible, for example as a function of En ( k ) and En ( k -1).
- the factor is then set to an attenuation-inhibiting attenuation value, i.e. 1. Otherwise, the attenuation factor is between 0 and 1.
- the attenuation factors g ( k ) determined by sub-blocks are then smoothed by an applied smoothing function sample by sample to avoid abrupt changes in the attenuation factor at the boundaries of the blocks.
- the module 604 of the device 600 of the figure 6 implements the attenuation (Att.) in the sub-blocks of the pre-echo zone, by the attenuation factors obtained.
- the spectral shaping filter used is a linear filter. Since the gain multiplication operation is also a linear operation, their order can be inverted: you can also do the formatting filtering first. Spectrum of the pre-echo area then the pre-echo attenuation by multiplying each sample of the pre-echo area by the corresponding factor.
- c (n) 0.05, 0.1, 0.15, 0.2 and 0.25.
- the motivation for using this filter is its low complexity, its null phase and therefore its zero delay (possible because the processing stops before the end of the current frame) but also its frequency response which corresponds well to the desired low-pass characteristics for this filter.
- this filter can compensate for the fact that the temporal attenuation of the pre-echo is typically limited to a zone not going to the position of the attack (with a margin of, for example, 16 samples), then that the spectral shaping filtering as defined by the transfer function c ( n ) z -1 + (1 - 2c ( n )) + c ( n ) z can be applied up to the position of the attack , possibly with some interpolation samples of the filter coefficients.
- the proposed FIR filter makes it easy to smoothly move from the unfiltered domain to the filtered domain and vice versa, by interpolation or slow variation of its coefficients.
- the filter c ( n ) z -1 + (1-2c ( n )) + c ( n ) z can attenuate the high frequencies before the attack without modifying the attack itself. even.
- Part d) of the figure 8 An exemplary digital audio signal, for which the processing as described herein is performed, is illustrated in part d) of the figure 8 .
- Parts a), b) and c) of this figure show the same signals as those described with reference to the figure 4 previously.
- Part d) differs by the implementation of filtering according to the invention. It can thus be noted that the troublesome high-frequency component is greatly reduced, so that the signal decoded after filtering has a better quality than that described in part d) of FIG. figure 4 .
- An order 1 filter of the form c ( n ) z -1 + (1- c ( n )) can also be used in an embodiment which does not form part of the invention.
- the filtering implemented according to the described method is an adaptive filtering. It can thus be adapted to the characteristics of the decoded audio signal.
- a step of calculating a decision parameter (P) on the filtering to be applied to the pre-echo zone is implemented in the calculation module 605 of FIG. figure 6 .
- this decision parameter is representative of the presence of high frequency components in the pre-echo zone.
- the spectral shaping filter is applied, according to the invention, from the beginning of the current frame to the position pos position of the attack.
- the spectral shaping of the pre-echo zone by filtering according to the invention is adaptive as a function of the parameter P and the attenuation values.
- the filtering is either applied with coefficients [0.25, 0.5, 0.25], or deactivated with coefficients [0, 1, 0].
- the filter coefficients are then adapted in a discrete manner limited to a predefined set of values.
- the adaptation of the filter coefficients (making it possible to adapt the attenuation level of the high frequencies) is thus determined by decision parameters which measure the force of the attack, such as the parameters P and g ( k -1).
- a progressive transition between these two filters can be carried out using also for example the intermediate filters of coefficient [0.05, 0.9, 0.05], [0.1, 0.8, 0.1], [0.15, 0.7, 0.15] and [0.2, 0.6, 0.2 ].
- decision parameters can also be used in the decision of the choice and the adaptation of the filter, such as for example the zero crossing rate of the decoded signal of the pre-echo zone. the current frame and / or the previous frame.
- sgn x rec boy Wut not - 1 - sgn x rec , boy Wut not
- or sgn x ⁇ 1 i f x ⁇ 0 - 1 i f x ⁇ 0
- a high rate of zero crossing zc in the previous frame signals the presence of high frequencies in the signal.
- zc > L / 2 on the previous frame it is better not to apply filtering vs not z - 1 + 1 - 2 vs not + vs not z .
- a pre-filtering of the decoded signal is also possible before calculating the zero crossing rate, or the number of zero crossings of the estimated derivative x rec , g ( n ) -x rec , g ( n -1) can be used.
- a spectral analysis of the signal can also be made to assist the decision.
- the spectral envelope in the MDCT domain resulting from the MDCT coding / decoding can be exploited in the choice of the filter to be used, however this variant assumes that the analysis / synthesis windows MDCT are sufficiently short for the local statistics of the MDCT to be used. signal before the attack remain stable over the length of a window.
- one may filter the signal in the pre-echo region and the frame passed by an additional high pass filter as - c (n) z -1 + (1-2 c (n)) - c (n) z , with for example c ( n ) 0.25, and then we will choose the value of c ( n ) so that the average energy of the filtered signals in the pre-echo zone and on the past frame are as close as possible ; the choice of c ( n ) can be made on a limited set of possible values shown in figure 7 or from the ratio of energy (or an equivalent quantity such as the square root of the energy) of the signal after high-pass filtering in the pre-echo zone and in the past frame.
- the value of c ( n ) can be fixed according to the prediction coefficient r (1) / r (0) from a linear prediction analysis (LPC) for the order 1 of the signal in the pre-echo zone and the signal in the past frame.
- LPC linear prediction analysis
- the decision parameter on the filtering to be applied to the pre-echo zone is based on a spectral distribution analysis of the signal the pre-echo zone and / or the preceding signal of the pre-echo zone; if the signal preceding the pre-echo zone already contains many high frequencies or if the amount of the high frequencies of the signal in the pre-echo zone and the signal preceding the pre-echo zone is substantially identical, the filtering according to the invention is not necessary and may even cause slight degradation. In these cases, the filtering according to the invention must be deactivated or attenuated by setting c (n) to 0 or to a low value close to 0.
- the order between the attenuation and filtering step may be reversed.
- the spectral shaping filtering (F) is done before the attenuation (Att.).
- the attenuation of the amplitudes can also be combined (or integrated) by defining a set of "conjoint" filter coefficients, for example if for the sample n the filter has coefficients [c ( n ), 1-2 c ( n ), c ( n )] and the attenuation factor is g ( n ), we can directly use the filter [ g pre ( n ) c ( n ), g pre ( n ) 2g pre ( n ) c ( n) ), g pre ( n ) c ( n )].
- the figure 11 illustrates the benefit of making adaptive filtering. It uses the same signals parts a), b) and c) that the figure 10 and illustrates the fact that the implementation of the nonadaptive filtering shown in part d), unnecessarily modifies the signal in the case where the high-frequency components are already present in the signal to be encoded. It is observed that from sample 640 the high frequencies are unnecessarily attenuated, which could lead to a slight deterioration in quality.
- the use of an adaptive filtering as described above makes it possible to inhibit or attenuate the filtering under these conditions, to not remove high frequencies already present in the signal to be coded and thus to avoid possible degradation due to the filtering.
- the attenuation processing device 600 as described is here included in a decoder comprising a reverse quantization module 610 (Q -1 ) receiving a signal S, a reverse transformation module 620 (MDCT -1 ), a module 630 signal reconstruction by addition / recovery (add / rec) as described with reference to the figure 1 and delivering a reconstructed signal to the attenuation processing device according to the invention.
- a decoder comprising a reverse quantization module 610 (Q -1 ) receiving a signal S, a reverse transformation module 620 (MDCT -1 ), a module 630 signal reconstruction by addition / recovery (add / rec) as described with reference to the figure 1 and delivering a reconstructed signal to the attenuation processing device according to the invention.
- a processed signal Sa is provided in which a pre-echo attenuation has been performed.
- the processing performed improved the pre-echo attenuation by attenuating, if necessary, the high frequency components in the pre-echo area.
- the memory block BM may comprise a computer program comprising the code instructions for implementing the steps of the method according to the invention when these instructions are executed by a ⁇ P processor of the device and in particular a step of detecting a position of etching in the decoded signal, of determining a pre-echo zone preceding the detected attack position in the decoded signal, of calculating sub-block attenuation factors of the pre-echo zone, as a function of the frame in which the attack was detected and the previous frame, pre-echo attenuation in the sub-blocks of the pre-echo area by the corresponding attenuation factors and further, a a step of applying a spectral shaping filtering of the pre-echo zone on the current frame to the detected position of the attack, the filtering having a finite impulse response to a zero transfer function phase: vs not z - 1 + 1 - 2 vs not + vs not z with c (n) a coefficient between 0 and 0.25.
- This attenuation device can be independent or integrated into a digital signal decoder.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Quality & Reliability (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1256285A FR2992766A1 (fr) | 2012-06-29 | 2012-06-29 | Attenuation efficace de pre-echos dans un signal audionumerique |
PCT/FR2013/051517 WO2014001730A1 (fr) | 2012-06-29 | 2013-06-28 | Atténuation efficace de pré-échos dans un signal audionumérique |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2867893A1 EP2867893A1 (fr) | 2015-05-06 |
EP2867893B1 true EP2867893B1 (fr) | 2018-11-28 |
Family
ID=47191858
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13744654.8A Active EP2867893B1 (fr) | 2012-06-29 | 2013-06-28 | Atténuation efficace de pré-échos dans un signal audionumérique |
Country Status (12)
Country | Link |
---|---|
US (1) | US9489964B2 (ja) |
EP (1) | EP2867893B1 (ja) |
JP (1) | JP6271531B2 (ja) |
KR (1) | KR102082156B1 (ja) |
CN (1) | CN104395958B (ja) |
BR (1) | BR112014032587B1 (ja) |
CA (1) | CA2874965C (ja) |
ES (1) | ES2711132T3 (ja) |
FR (1) | FR2992766A1 (ja) |
MX (1) | MX349600B (ja) |
RU (1) | RU2607418C2 (ja) |
WO (1) | WO2014001730A1 (ja) |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2992766A1 (fr) * | 2012-06-29 | 2014-01-03 | France Telecom | Attenuation efficace de pre-echos dans un signal audionumerique |
FR3023646A1 (fr) * | 2014-07-11 | 2016-01-15 | Orange | Mise a jour des etats d'un post-traitement a une frequence d'echantillonnage variable selon la trame |
FR3025923A1 (fr) * | 2014-09-12 | 2016-03-18 | Orange | Discrimination et attenuation de pre-echos dans un signal audionumerique |
EP3382701A1 (en) | 2017-03-31 | 2018-10-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for post-processing an audio signal using prediction based shaping |
EP3382700A1 (en) | 2017-03-31 | 2018-10-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for post-processing an audio signal using a transient location detection |
EP3483882A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Controlling bandwidth in encoders and/or decoders |
EP3483880A1 (en) * | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Temporal noise shaping |
EP3483886A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Selecting pitch lag |
EP3483878A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio decoder supporting a set of different loss concealment tools |
EP3483884A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Signal filtering |
WO2019091573A1 (en) | 2017-11-10 | 2019-05-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for encoding and decoding an audio signal using downsampling or interpolation of scale parameters |
WO2019091576A1 (en) | 2017-11-10 | 2019-05-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoders, audio decoders, methods and computer programs adapting an encoding and decoding of least significant bits |
EP3483879A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Analysis/synthesis windowing function for modulated lapped transformation |
EP3483883A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio coding and decoding with selective postfiltering |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2674710B1 (fr) * | 1991-03-27 | 1994-11-04 | France Telecom | Procede et systeme de traitement des preechos d'un signal audio-numerique code par transformee frequentielle. |
US5731767A (en) * | 1994-02-04 | 1998-03-24 | Sony Corporation | Information encoding method and apparatus, information decoding method and apparatus, information recording medium, and information transmission method |
JP3186412B2 (ja) * | 1994-04-01 | 2001-07-11 | ソニー株式会社 | 情報符号化方法、情報復号化方法、及び情報伝送方法 |
JPH08223049A (ja) * | 1995-02-14 | 1996-08-30 | Sony Corp | 信号符号化方法及び装置、信号復号化方法及び装置、情報記録媒体並びに情報伝送方法 |
JP3307138B2 (ja) * | 1995-02-27 | 2002-07-24 | ソニー株式会社 | 信号符号化方法及び装置、並びに信号復号化方法及び装置 |
JP4581190B2 (ja) * | 2000-06-19 | 2010-11-17 | ヤマハ株式会社 | 音楽信号の時間軸圧伸方法及び装置 |
EP1343143B1 (en) * | 2000-12-14 | 2011-10-05 | Sony Corporation | Analysis-synthesis of audio signal |
KR20040058289A (ko) * | 2001-11-16 | 2004-07-03 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | 정보 신호 내에 부가 데이터를 삽입하는 방법 |
US7876966B2 (en) * | 2003-03-11 | 2011-01-25 | Spyder Navigations L.L.C. | Switching between coding schemes |
US7443978B2 (en) * | 2003-09-04 | 2008-10-28 | Kabushiki Kaisha Toshiba | Method and apparatus for audio coding with noise suppression |
EP1542226A1 (en) * | 2003-12-11 | 2005-06-15 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for transmitting watermark data bits using a spread spectrum, and for regaining watermark data bits embedded in a spread spectrum |
FR2897733A1 (fr) * | 2006-02-20 | 2007-08-24 | France Telecom | Procede de discrimination et d'attenuation fiabilisees des echos d'un signal numerique dans un decodeur et dispositif correspondant |
DE102006047197B3 (de) * | 2006-07-31 | 2008-01-31 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zum Verarbeiten eines reellen Subband-Signals zur Reduktion von Aliasing-Effekten |
US8463603B2 (en) * | 2008-09-06 | 2013-06-11 | Huawei Technologies Co., Ltd. | Spectral envelope coding of energy attack signal |
EP2347411B1 (fr) * | 2008-09-17 | 2012-12-05 | France Télécom | Attenuation de pre-echos dans un signal audionumerique |
FR2936898A1 (fr) * | 2008-10-08 | 2010-04-09 | France Telecom | Codage a echantillonnage critique avec codeur predictif |
CN101826327B (zh) * | 2009-03-03 | 2013-06-05 | 中兴通讯股份有限公司 | 一种基于时域掩蔽的瞬态判决方法及设备 |
JP5287546B2 (ja) * | 2009-06-29 | 2013-09-11 | 富士通株式会社 | 情報処理装置およびプログラム |
EP2772909B1 (en) * | 2011-10-27 | 2018-02-21 | LG Electronics Inc. | Method for encoding voice signal |
FR2992766A1 (fr) * | 2012-06-29 | 2014-01-03 | France Telecom | Attenuation efficace de pre-echos dans un signal audionumerique |
FR3000328A1 (fr) * | 2012-12-21 | 2014-06-27 | France Telecom | Attenuation efficace de pre-echos dans un signal audionumerique |
-
2012
- 2012-06-29 FR FR1256285A patent/FR2992766A1/fr active Pending
-
2013
- 2013-06-28 RU RU2015102814A patent/RU2607418C2/ru active
- 2013-06-28 CN CN201380034828.2A patent/CN104395958B/zh active Active
- 2013-06-28 CA CA2874965A patent/CA2874965C/fr active Active
- 2013-06-28 EP EP13744654.8A patent/EP2867893B1/fr active Active
- 2013-06-28 WO PCT/FR2013/051517 patent/WO2014001730A1/fr active Application Filing
- 2013-06-28 JP JP2015519300A patent/JP6271531B2/ja active Active
- 2013-06-28 KR KR1020147036551A patent/KR102082156B1/ko active IP Right Grant
- 2013-06-28 ES ES13744654T patent/ES2711132T3/es active Active
- 2013-06-28 BR BR112014032587-1A patent/BR112014032587B1/pt active IP Right Grant
- 2013-06-28 US US14/411,790 patent/US9489964B2/en active Active
- 2013-06-28 MX MX2014015065A patent/MX349600B/es active IP Right Grant
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
KR20150052812A (ko) | 2015-05-14 |
ES2711132T3 (es) | 2019-04-30 |
US9489964B2 (en) | 2016-11-08 |
CA2874965A1 (fr) | 2014-01-03 |
BR112014032587A2 (pt) | 2017-06-27 |
RU2607418C2 (ru) | 2017-01-10 |
CA2874965C (fr) | 2021-01-19 |
FR2992766A1 (fr) | 2014-01-03 |
RU2015102814A (ru) | 2016-08-20 |
EP2867893A1 (fr) | 2015-05-06 |
CN104395958B (zh) | 2017-09-05 |
JP6271531B2 (ja) | 2018-01-31 |
MX2014015065A (es) | 2015-02-17 |
KR102082156B1 (ko) | 2020-04-14 |
WO2014001730A1 (fr) | 2014-01-03 |
JP2015522847A (ja) | 2015-08-06 |
US20150170668A1 (en) | 2015-06-18 |
CN104395958A (zh) | 2015-03-04 |
BR112014032587B1 (pt) | 2022-08-09 |
MX349600B (es) | 2017-08-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2867893B1 (fr) | Atténuation efficace de pré-échos dans un signal audionumérique | |
EP2936488B1 (fr) | Atténuation efficace de pré-échos dans un signal audionumérique | |
EP2002428B1 (fr) | Procede de discrimination et d'attenuation fiabilisees des echos d'un signal numerique dans un decodeur et dispositif correspondant | |
EP2104936B1 (fr) | Codage par transformee, utilisant des fenetres de ponderation et a faible retard | |
EP2153438B1 (fr) | Post-traitement de reduction du bruit de quantification d'un codeur, au decodage | |
EP2586133B1 (fr) | Contrôle d'une boucle de rétroaction de mise en forme de bruit dans un codeur de signal audionumérique | |
FR2907586A1 (fr) | Synthese de blocs perdus d'un signal audionumerique,avec correction de periode de pitch. | |
EP3084959B1 (fr) | Ré-échantillonnage d'un signal audio cadencé à une fréquence d'échantillonnage variable selon la trame | |
EP2347411B1 (fr) | Attenuation de pre-echos dans un signal audionumerique | |
FR3007563A1 (fr) | Extension amelioree de bande de frequence dans un decodeur de signaux audiofrequences | |
EP3192073B1 (fr) | Discrimination et atténuation de pré-échos dans un signal audionumérique | |
EP2652735B1 (fr) | Codage perfectionne d'un etage d'amelioration dans un codeur hierarchique | |
EP3167447B1 (fr) | Mise a jour des états d'un post-traitement a une fréquence d'échantillonnage variable selon la trame | |
WO2014009657A1 (fr) | Traitement d'amelioration de la qualite des signaux audiofrequences |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20150127 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20171020 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20180727 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1071154 Country of ref document: AT Kind code of ref document: T Effective date: 20181215 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013047454 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20181128 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1071154 Country of ref document: AT Kind code of ref document: T Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190328 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190228 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190228 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2711132 Country of ref document: ES Kind code of ref document: T3 Effective date: 20190430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190328 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190301 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013047454 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
26N | No opposition filed |
Effective date: 20190829 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190628 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190628 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20130628 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181128 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20230703 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240521 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240521 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20240522 Year of fee payment: 12 Ref country code: FR Payment date: 20240522 Year of fee payment: 12 |