EP1386307B2 - Procede et dispositif pour determiner un niveau de qualite d'un signal audio - Google Patents
Procede et dispositif pour determiner un niveau de qualite d'un signal audio Download PDFInfo
- Publication number
- EP1386307B2 EP1386307B2 EP02703438.8A EP02703438A EP1386307B2 EP 1386307 B2 EP1386307 B2 EP 1386307B2 EP 02703438 A EP02703438 A EP 02703438A EP 1386307 B2 EP1386307 B2 EP 1386307B2
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- audio signal
- quality
- determining
- interruptions
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 93
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000001629 suppression Effects 0.000 claims abstract description 13
- 238000013528 artificial neural network Methods 0.000 claims description 23
- 238000001514 detection method Methods 0.000 claims description 13
- 238000011156 evaluation Methods 0.000 claims description 9
- 230000009466 transformation Effects 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 description 30
- 238000001303 quality assessment method Methods 0.000 description 8
- 238000001228 spectrum Methods 0.000 description 6
- 230000001755 vocal effect Effects 0.000 description 5
- 210000002569 neuron Anatomy 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 239000000872 buffer Substances 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 210000002364 input neuron Anatomy 0.000 description 3
- 210000004205 output neuron Anatomy 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000002592 echocardiography Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000003623 enhancer Substances 0.000 description 1
- 238000005562 fading Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/69—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for evaluating synthetic or decoded voice signals
Definitions
- the invention relates to a method for determining a quality measure of an audio signal. Furthermore, the invention relates to an apparatus for carrying out this method as well as a noise suppression module and an interruption detection and interpolation module for use in such a device.
- the assessment of the quality of a telecommunications network is an important tool for achieving or maintaining a desired service quality.
- One way to assess the quality of service of a telecommunications network is to determine the quality of a signal transmitted over the telecommunications network.
- various intrusive methods are known for this purpose.
- the system to be tested intervenes by occupying a transmission channel and transmitting a reference signal therein.
- the quality assessment is then carried out by comparing the known reference signal with the received signal, for example subjectively by one or a plurality of test persons.
- this is expensive and therefore expensive.
- intrusive methods generally have the disadvantage that, as already mentioned, the system to be tested must be intervened. In order to determine the signal quality, at least one transmission channel must be occupied and a reference signal transmitted therein. This transmission channel can not be used for data transmission during this time. In addition, while it is in principle possible for a broadcasting system such as a broadcasting service to occupy the signal source for the transmission of test signals, as this would occupy all channels and the test signal would be transmitted to all receivers, this approach is extremely impractical. Intrusive techniques are also unsuitable for simultaneously monitoring the quality of a variety of transmission channels.
- EP-A-644 526 discloses a non-intrusive noise reduction method which uses an estimate of noise energy to calculate the desired signal information.
- US-A-5,848,384 shows a method and apparatus for determining the quality of an audio signal.
- the object of the invention is to specify a method of the abovementioned type, which avoids the disadvantages of the prior art and, in particular, offers a possibility for assessing the signal quality of a signal transmitted via a telecommunication network without knowledge of the originally transmitted signal.
- a reference signal is first determined from the audio signal.
- a quality value is determined which is used to determine the quality measure.
- the inventive method thus allows an assessment of the quality of an audio signal at any terminal of the telecommunications network. Ie. it also allows the quality assessment of many transmission channels simultaneously, even allowing simultaneous evaluation of all channels.
- the quality assessment is carried out solely on the basis of the properties of the received signal, d. H. without knowledge of the source signal or the signal source.
- the invention thus enables not only a monitoring of the transmission quality of the telecommunications network, but also, for example, a quality-based cost accounting, quality-based routing in the network, a test of the degree of coverage, for example in mobile networks, a QOS (Quality of Service) control of network nodes or a quality comparison within a network or across networks.
- a quality-based cost accounting for example, a quality-based cost accounting
- quality-based routing in the network for example in mobile networks
- QOS Quality of Service
- An audio signal transmitted via a telecommunication network typically has, in addition to the desired signal information, also undesired components, such as various noise components, which were not present in the original source signal.
- the best possible estimate of the originally transmitted signal is necessary.
- To reconstruct this reference signal there are several methods. One possibility is to determine an estimate of the characteristics of the transmission channel and quasi backwards from the received signal. Another possibility is a direct estimation of the reference signal based on the known information about the received signal and the transmission channel.
- the reference signal is determined by estimating the noise components present in the received signal and then removing them from the received signal. By removing the noise components from the audio signal, a denoised audio signal is first determined, which is preferably used as a reference signal for assessing the transmission quality.
- the audio signal could, for example, be passed through appropriate filters.
- a preferred method of removing the noise from the audio signal uses a neural network.
- the audio signal is not used directly as an input signal.
- a discrete wavelet transform DWT
- This transformation provides a plurality of DWT coefficients of the audio signal which are fed to the neural network as an input.
- the neural network provides at the output a plurality of corrected DWT coefficients, from which the reference signal is obtained with the inverse DWT. This corresponds to the noisy version of the audio signal.
- the coefficients of the neural network must be set to provide the DWT coefficients of a noisy input signal the DWT coefficients of the corresponding noisy input signal.
- the neural network For the neural network to provide the desired coefficients, it must first be trained with a set of corresponding noisy or noisy signal pairs.
- any other information besides the quality value, which is determined by the comparison of the received audio signal with the reference signal determined therefrom, can also be taken into account. This may be information contained in the audio signal as well as information about the transmission channel or the telecommunication network itself.
- the quality of the received audio signal is influenced, for example, by the codecs (coder-decoder) passed through during the transmission. It is difficult to detect such signal degradation because, for example, if the codec bit rates are too small, some of the original signal information is lost. However, too small codec bit rates result in a change in the fundamental frequency (pitch) of the audio signal, which is why it is advantageous to examine the course and dynamics of the fundamental frequency in the audio signal. Since such changes can be most easily examined on the basis of audio signal sections with vowels, signal components in the audio signal with vowels are preferably first detected and then examined for pitch variations.
- the received audio signal may have more or less long signal interruptions.
- the type of interpolation of the lost signal sections depends on the length of the signal interruption. For short breaks, d. H. with interruptions up to a few samples in the audio signal is preferably a polynomial and medium-length interruptions, d. H. from a few to a few dozen samples, model-based interpolation is preferred.
- the received audio signal may include various types of audio signals. For example, it can contain voice, music, noise or silence signals.
- the quality assessment may be based on all or part of these signal components. In a preferred variant of the invention, however, the assessment of the signal quality is limited to the speech signal components. With an audio discriminator, therefore, the audio signal components first become from the audio signal extracted and only these speech signal components for determining the quality measure, ie used to determine the reference signal. In this case, to determine the quality value, the determined reference signal is, of course, not compared with the received audio signal, but only with the speech signal component extracted therefrom.
- the inventive device for machine-aided determination of a quality measure of an audio signal comprises first means for determining a reference signal from the audio signal, second means for determining a quality value by comparing the determined reference signal with the audio signal and third means for determining the quality measure taking into account the quality value.
- the first means for determining a reference signal from the audio signal may comprise a plurality of modules.
- a noise suppression module and / or an interruption detection and interpolation module is preferably provided.
- the noise suppression module suppresses noise signal components in the received audio signal. It includes the means for performing the wavelet transforms described above as well as the neural network for determining the new DWT coefficients.
- the interrupt detection and interpolation module has those means which are required on the one hand for detecting signal interruptions in the audio signal and on the other hand for polynomial interpolation of short as well as model-based interpolation of medium-length signal interruptions.
- the thus determined reference signal thus corresponds to a noisy version of the received audio signal and typically has only greater signal interruptions.
- the information about the signal discontinuities of the audio signal is not only used to obtain a better reference signal, it can also be used to determine a better quality measure.
- the third means for determining the quality measure are therefore preferably designed such that information about signal interruptions in the audio signal can be taken into account.
- the device therefore advantageously has fourth means for determining information about codec-related signal distortions.
- fourth means for determining information about codec-related signal distortions include, for example, a vocal detection module with which signal components with vowels can be detected in the audio signal. These vocal signal components are passed on to an evaluation module, which uses these signal components to determine information about codec-related signal distortions, which are also used to assess the signal quality.
- the third means are correspondingly designed such that this information about the codec-related signal distortions can be taken into account in the determination of the quality measure.
- the device therefore has, in particular, fifth means for extracting the speech signal components from the audio signal. Accordingly, not the audio signal itself, but only its voice signal component is denoudized and examined for interruptions in order to determine the reference signal. Likewise, of course, not the audio signal, but only the voice signal component is compared with this reference signal. Thus, the determination of the quality measure takes place only on the basis of the information in the speech signal component, wherein the information from the remaining signal components is not taken into account.
- FIG. 1 shows a block diagram of the inventive method.
- a quality measure 2 is determined for an audio signal 1, which can be used, for example, for the evaluation of the used (not shown) telecommunications network.
- the audio signal 1 is understood here to mean the signal which a receiver receives after the transmission via the telecommunication network.
- This audio signal 1 is true typically not coincide with the signal transmitted by the transmitter (not shown) because on the way from the transmitter to the receiver, the transmission signal is varied in a variety of ways. For example, it goes through various modules such as speech coders and decoders, multiplexers and demultiplexers, as well as speech enhancers and echo cancellers. But even the transmission channel itself can have a large impact on the signal, which, for example, in the form of interference, fading, réellesab- or interruptions, echoes, etc. express.
- the audio signal 1 thus contains not only desired signal components, d. H. the original transmission signal, but also unwanted interference signal components. It may also be that signal portions of the transmission signal are missing, d. H. lost during the transmission.
- the assessment of the signal quality does not take place on the basis of the entire audio signal 1, but only on the basis of the speech component contained therein.
- the audio signal 1 is first examined with an audio discriminator 3 to speech signal components 4 out. Found speech signal components 4 are forwarded for further processing, whereas other signal components such as music 5.1, pauses 5.2 or strong signal interference 5.3 can be sorted out and otherwise processed or discarded.
- the audio signal is 1 piecewise, d. H. to bits a each about 100 ms to 500 ms, passed to the audio discriminator 3. This splits these bits further into individual buffers of about 20 ms in length, processes these buffers and then allocates them to one of the different signal groups speech signal, music, pause or strong interference.
- the audio discriminator 3 uses, for example, an LPC (linear predictive coding) transformation for the evaluation of the signal chips, with which the coefficients of an adaptive filter corresponding to the human voice tract are calculated.
- LPC linear predictive coding
- a reference signal 6, d. H. a possible best estimate of the transmission signal originally transmitted by the transmitter, determined. This reference signal estimation takes place in several stages.
- a noise suppression module 7 unwanted signal components such as stationary noise or impulse noise are first removed from the speech signal component 4 or suppressed. This is done with the aid of a neural network, which has been previously trained by means of a plurality of noisy signals as input and each of the corresponding noise-free version of the input signal as a target signal. The thus-obtained noisy voice signal 11 is forwarded to the second stage.
- the interruption detection and interpolation module 8 interruptions in the audio signal 1 and in its voice signal component 4 are detected and interpolated if possible, d. H. the missing samples are replaced by appropriately estimated values.
- the detection of signal interruptions by means of an examination of discontinuities of the signal fundamental frequency (pitch-tracing).
- the interpolation is carried out as a function of the length of the detected interruption.
- d. H. Interruptions of a few samples in length are polynomial-interpolated, such as Lagrange, Newton, Hermite, or Cubic Spline interpolation.
- model-based interpolations such as maximum a posteriori, autoregressive, or frequency-time interpolation are used.
- interpolation or other signal reconstruction is usually no longer possible in a meaningful way.
- a terminal respond differently to missing frames. For example, in a first method, lost frames are simply replaced by zeros. In a second method, instead of the lost frames other, correctly received frames are used and in a third method locally generated noise signals, so-called "comfort noise" are used instead of the lost frames.
- the speech signal component 4 After determining the reference signal 6 with the noise suppression module 7 and the interruption detection and interpolation module 8, it is compared with the speech signal component 4 with the aid of the comparison module 9.
- an algorithm can be used, as used, for example, in intrusive methods for the comparison of the known source signal with the received signal.
- psychoacoustic models that compare signals perceptually, ie perceptibly, are suitable.
- the result of this comparison is an intrusive quality value 10.
- the input signals, ie the speech signal component 4 and the reference signal 6 are decomposed into signal pieces of about 20 to 30 ms in length and a partial quality value is calculated for each signal piece. After about 20 to 30 signal pieces, which corresponds to a signal duration of 0.5 seconds, the intrusive quality value 10 is determined as the arithmetic mean of these partial quality values.
- the intrusive quality value 10 forms the output signal of the comparison module 9.
- a voice coder or speech decoder which the transmitted signal has passed through on its way from the transmitter to the receiver, can have an influence on the audio signal 1.
- These influences include, for example, varying both the fundamental frequency and the higher harmonic frequencies of the signal. The smaller the bit rate of the speech codecs used, the greater the frequency shifts and thus the signal distortions.
- Such influences can be examined most easily with vowels, which is why the noise signal 11 which has been deafened is first supplied to a vocal detector 12.
- This includes, for example, a neural network that has been previously trained for the recognition of particular (single or all) vowels.
- Vocal signals 13, d. H. Signal components that recognize the neural network as vowels are forwarded to an evaluation module 14, other signal components are discarded.
- the evaluation module 14 divides the vocal signal 13 into signal pieces of about 30 ms and calculates thereon a DFT (discrete Fourier transform) with a frequency resolution of about 2 Hz at a sampling frequency of about 8 kHz. This allows the fundamental and higher harmonic frequencies to be determined and examined for variations. Another feature for evaluating codec-related distortions is the dynamics of the signal spectrum, with smaller dynamics implying poorer signal quality. The reference values for the dynamics evaluation are obtained for the individual vowels from example signals.
- a codec quality value 15 is derived from the information about the influence of codecs on the frequency shifts and the spectrum dynamics of the audio signal 1 and of the denoised speech signal 11.
- an interruption quality value 17 is taken into account in addition to the intrusive quality value 10 and the codec quality value 15.
- This value contains information about the length and the number of interruptions detected by the interruption detection and interpolation module 8, whereby in a preferred embodiment of the invention only the information about the long interruptions is taken into account.
- further quality information 18 about the received audio signal 1 or the noisy speech signal 11, which are determined with other modules or examinations, can be included in the calculations of the quality measure 2.
- the individual quality values are now scaled to lie in the range of numbers between 0 and 1, where a quality value of 1 denotes undiminished quality and values below 1 indicate a correspondingly reduced quality.
- the quality measure 2 is finally calculated as a linear combination of the individual quality values, wherein the individual weighting coefficients are determined experimentally and determined such that their sum is 1.
- FIG. 2 shows the noise suppression module 7.
- the voice signal portion 4 of the audio signal 1 is first subjected to a known DWT 19 (Discrete Wavelet Transformation).
- DWT's are similar to DFT's used for signal analysis.
- An essential difference, however, is the use of so-called wavelets, ie temporally limited and temporally localized waveforms with a mean value of 0, in contrast to the sinusoidal or cosine wave forms used indefinitely and thus not temporally localized in a DFT.
- the speech signal component 4 is divided into signal pieces of about 20 ms to 30 ms, which are each subjected to the DWT 19.
- the result of the DWT 19 is a set of DWT coefficients 20.1, which are input to a neural network 20 as an input vector. Its coefficients were previously trained to provide a new set of DWT coefficients 20.2 of the noisy version of this signal for a given set of DWT coefficients 20.1 of a noisy signal.
- This new set of DWT coefficients 20.2 will now be sent to IDWT 21, i. H. subjected to the DWT 19 inverse DWT. In this way, this IDWT 21 delivers a majority of the unencumbered version of the speech signal components 4, namely the desired, denoised speech signal 11.
- the training configuration of the neural network 20 is in FIG. 3 shown. It is trained with pairs of noisy and noisy versions of sample signals.
- An unencumbered example signal 22.1 is subjected to the DWT 19 and a first set 20.3 of DWT coefficients is obtained.
- the noisy sample signal 22.2 is also subjected to the same DWT 19 and a second set 20.4 of DWT coefficients is generated, which is fed into the neural network 20.
- the output vector of the neural network 20, the new DWT coefficients 20.5 is compared in a comparator 23 with the first set 20.3 of DWT coefficients. Due to the differences between these two sets of DWT coefficients, there is a correction 24 of the coefficients of the neural network 20.
- the training of the neural network 20 uses example signals 22.1, 22.2, which represent human sounds from different languages. It is also an advantage to use both female and male and child voices.
- the mentioned size of the individually processed signal pieces of 20 ms to 30 ms duration is selected so that the processing of the speech signal component 4 can be performed independently of the speech and the speaker. Even pauses in speech and very quiet signal sections are trained so that they are recognized correctly.
- each output neuron 27.1 provides one of the new DWT coefficients 20.2.
- the audio discriminator 3 splits the signal bits into individual buffers of length 20 ms. At a sampling rate of 8 kHz, this corresponds to 160 samples.
- a neural network 20 each having 160 input and output neurons 25.1, 27.1 and about 50 to 60 hidden neurons 26.1 may be used.
- a time-frequency interpolation is used for the signal reconstruction.
- a short-term spectrum for 64-sample-length (8 ms) signed frames is calculated. This is done by multiplying the signal frames by Hamming windows with a 50% overlap.
- the goal of interpolation is to address this gap.
- FIG. 5 shows such a signal 28 of about 200 samples in length.
- FIG. 5 shows FIG. 5 the signal 28 in the temporal domain.
- the abscissa axis 32 the number of samples and on the ordinate axis 33, the magnitudes are plotted.
- the interpolation is done in the frequency-time domain.
- the interruption 29 is easy to recognize as a gap of almost 10 samples.
- a polynomial interpolation is now carried out for both the phase and magnitude, with minimal phase and magnitude discontinuity.
- the pitch period 30 of the signal 28 is determined. Information from the samples before and after the gap within this pitch period 30 is taken into account for the interpolation.
- the signal areas 31.1, 31.2 show those areas of the signal 28 each before a pitch period before or after the interruption 29. These signal areas 31.1, 31.2 are not identical to the original signal piece at the interruption 29, but still show a high degree of similarity , For small gaps up to about 10 samples, it is assumed that there is still enough signal information to be able to perform a correct interpolation. For longer gaps, additional information from samples of the environment can be used.
- the invention allows the signal quality of a received audio signal to be assessed without knowing the original transmission signal. From the signal quality can of course be concluded on the quality of the transmission channels used and thus on the service quality of the entire telecommunications network.
- the fast response times of the inventive method which are in the order of about 100 ms to 500 ms, thus allow various applications such as general comparisons of service quality of different networks or subnets, quality-based cost allocation or quality-based routing in a network or across multiple networks by means of appropriate control of network nodes (gateways, routers, etc.).
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Transmission Systems Not Characterized By The Medium Used For Transmission (AREA)
- Detection And Prevention Of Errors In Transmission (AREA)
- Noise Elimination (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
- Testing Electric Properties And Detecting Electric Faults (AREA)
Claims (10)
- Procédé pour la détermination, assistée par ordinateur, d'une mesure de qualité d'un signal audio, par lequel on détermine à partir du signal audio, un signal de référence qui représente une estimation d'un signal audio initialement émis, et par lequel l'on détermine, au moyen d'une comparaison du signal de référence au signal audio, une valeur de qualité qui est utilisée pour la détermination de la mesure de qualité, caractérisé en ce que l'on détermine un signal audio non bruité en éliminant des composantes de signal bruitées du signal audio et on l'utilise comme signal de référence, et en ce que l'on détecte dans le signal audio non bruité, des composantes de signal avec éléments vocaux, et l'on détermine des informations sur des distorsions de signal dues au codeur-décodeur et on prend en compte celles-ci lors de la détermination de la mesure de qualité.
- Procédé selon la revendication 1, caractérisé en ce que l'on détermine le signal audio non bruité en soumettant le signal audio à une transformation d'ondelettes discrète dont les coefficients sont introduits dans un réseau neuronal ayant subi auparavant un apprentissage et dont les signaux de sortie sont soumis à la transformation d'ondelettes discrète inverse.
- Procédé selon l'une des revendications 1 et 2, caractérisé en ce que l'on détecte des interruptions de signal dans le signal audio et en ce que l'on détermine le signal de référence en le reconstruisant au moins partiellement au niveau des interruptions de signal, le signal de référence étant reconstruit de préférence avec une interpolation polynomiale en cas d'interruptions de signal courtes et de préférence avec une interpolation basée sur un modèle en cas d'interruptions de signal moyennement longues.
- Procédé selon la revendication 3, caractérisé en ce que, lors de la détermination de la mesure de qualité, on prend en compte des informations sur les interruptions de signal.
- Procédé selon l'une des revendications 1 à 4, caractérisé en ce que, avant la détermination du signal de référence, on extrait une composante de signal vocale du signal audio, et en ce qu'on limite la détermination de la mesure de qualité à la composante de signal vocale.
- Dispositif pour la détermination d'une mesure de qualité, lequel présente des premiers moyens pour déterminer un signal de référence à partir du signal audio, des deuxièmes moyens pour déterminer une valeur de qualité au moyen d'une comparaison du signal de référence au signal audio et des troisièmes moyens pour déterminer la mesure de qualité en tenant compte de la valeur de qualité, grâce à quoi le signal de référence représente une estimation d'un signal audio émis à l'origine, caractérisé en ce qu'il présente des moyens pour éliminer du signal audio des composantes de signal bruitées et des moyens pour déterminer des distorsions de signal dues au codeur-décodeur, celles-ci comportant un module de détection d'éléments vocaux pour détecter des composantes de signal avec éléments vocaux dans le signal audio non bruité, ainsi qu'un module d'évaluation pour déterminer les distorsions de signal provoquées par le codeur-décodeur, les troisièmes moyens étant conçus de sorte que les distorsions de signal causées par le codeur-décodeur puissent être prises en considération lors de la détermination de la mesure de qualité.
- Dispositif selon la revendication 6, caractérisé en ce que les premiers moyens comportent un module de suppression de bruit pour supprimer des composantes de signal bruitées et/ou un module de détection d'interruptions et d'interpolation pour détecter et interpoler des interruptions de signal dans le signal audio, et en ce que les troisièmes moyens sont conçus de telle sorte que des interruptions de signal peuvent être prises en compte lors de la détermination de la mesure de qualité.
- Dispositif selon l'une des revendications 6 et 7, caractérisé en ce qu'il comporte des moyens pour extraire du signal audio une composante de signal vocale, et en ce qu'il est conçu pour la détermination de la mesure de qualité de la composante de signal vocale.
- Dispositif selon la revendication 7, les premiers moyens comportant le module de suppression de bruit, caractérisé en ce que le module de suppression de bruit comporte des moyens pour la mise en oeuvre d'une transformation d'ondelettes discrète en vue du calcul de coefficients de signal d'un signal audio, un réseau neuronal en vue du calcul de coefficients de signal corrigés, ainsi que des moyens pour la mise en oeuvre d'une transformation d'ondelettes inverse des coefficients de signal corrigés en vue de la détermination du signal audio sans composantes de signal bruitées.
- Dispositif selon la revendication 7, les premiers moyens comportant le module de détection d'interruptions et d'interpolation, caractérisé en ce que le module de détection d'interruptions et d'interpolation comporte des moyens pour détecter des interruptions de signal dans un signal audio ainsi que des moyens pour interpoler des interruptions du signal audio, ces derniers étant conçus de préférence pour une interpolation polynomiale d'interruptions de signal courtes et pour une interpolation, basée sur un modèle, d'interruptions de signal moyennement longues.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP02703438.8A EP1386307B2 (fr) | 2001-03-20 | 2002-03-19 | Procede et dispositif pour determiner un niveau de qualite d'un signal audio |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP01810285 | 2001-03-20 | ||
EP01810285A EP1244094A1 (fr) | 2001-03-20 | 2001-03-20 | Procédé et dispositif de détermination de la qualité d'un signal audio |
PCT/CH2002/000164 WO2002075725A1 (fr) | 2001-03-20 | 2002-03-19 | Procede et dispositif pour determiner un niveau de qualite d'un signal audio |
EP02703438.8A EP1386307B2 (fr) | 2001-03-20 | 2002-03-19 | Procede et dispositif pour determiner un niveau de qualite d'un signal audio |
Publications (3)
Publication Number | Publication Date |
---|---|
EP1386307A1 EP1386307A1 (fr) | 2004-02-04 |
EP1386307B1 EP1386307B1 (fr) | 2005-02-09 |
EP1386307B2 true EP1386307B2 (fr) | 2013-04-17 |
Family
ID=8183803
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP01810285A Withdrawn EP1244094A1 (fr) | 2001-03-20 | 2001-03-20 | Procédé et dispositif de détermination de la qualité d'un signal audio |
EP02703438.8A Expired - Lifetime EP1386307B2 (fr) | 2001-03-20 | 2002-03-19 | Procede et dispositif pour determiner un niveau de qualite d'un signal audio |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP01810285A Withdrawn EP1244094A1 (fr) | 2001-03-20 | 2001-03-20 | Procédé et dispositif de détermination de la qualité d'un signal audio |
Country Status (5)
Country | Link |
---|---|
US (1) | US6804651B2 (fr) |
EP (2) | EP1244094A1 (fr) |
AT (1) | ATE289109T1 (fr) |
DE (1) | DE50202226D1 (fr) |
WO (1) | WO2002075725A1 (fr) |
Families Citing this family (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7177430B2 (en) * | 2001-10-31 | 2007-02-13 | Portalplayer, Inc. | Digital entroping for digital audio reproductions |
US7746797B2 (en) * | 2002-10-09 | 2010-06-29 | Nortel Networks Limited | Non-intrusive monitoring of quality levels for voice communications over a packet-based network |
US20040167774A1 (en) * | 2002-11-27 | 2004-08-26 | University Of Florida | Audio-based method, system, and apparatus for measurement of voice quality |
GB2407952B (en) * | 2003-11-07 | 2006-11-29 | Psytechnics Ltd | Quality assessment tool |
US20050228655A1 (en) * | 2004-04-05 | 2005-10-13 | Lucent Technologies, Inc. | Real-time objective voice analyzer |
DE102004029421A1 (de) * | 2004-06-18 | 2006-01-05 | Rohde & Schwarz Gmbh & Co. Kg | Verfahren und Vorrichtung zur Bewertung der Güte eines Signals |
US7856355B2 (en) * | 2005-07-05 | 2010-12-21 | Alcatel-Lucent Usa Inc. | Speech quality assessment method and system |
WO2007098258A1 (fr) * | 2006-02-24 | 2007-08-30 | Neural Audio Corporation | Système et procédé de conditionnement pour un codec audio |
US8949120B1 (en) | 2006-05-25 | 2015-02-03 | Audience, Inc. | Adaptive noise cancelation |
US20080244081A1 (en) * | 2007-03-30 | 2008-10-02 | Microsoft Corporation | Automated testing of audio and multimedia over remote desktop protocol |
JP5054205B2 (ja) * | 2008-03-04 | 2012-10-24 | カーディアック ペースメイカーズ, インコーポレイテッド | 移植式の多重長rfアンテナ |
JP4327888B1 (ja) * | 2008-05-30 | 2009-09-09 | 株式会社東芝 | 音声音楽判定装置、音声音楽判定方法及び音声音楽判定用プログラム |
JP4327886B1 (ja) * | 2008-05-30 | 2009-09-09 | 株式会社東芝 | 音質補正装置、音質補正方法及び音質補正用プログラム |
WO2011010962A1 (fr) * | 2009-07-24 | 2011-01-27 | Telefonaktiebolaget L M Ericsson (Publ) | Procédé, ordinateur, programme dordinateur et produit progiciel pour estimation de la qualité vocale |
US20110178800A1 (en) * | 2010-01-19 | 2011-07-21 | Lloyd Watts | Distortion Measurement for Noise Suppression System |
US9558755B1 (en) | 2010-05-20 | 2017-01-31 | Knowles Electronics, Llc | Noise suppression assisted automatic speech recognition |
US8239196B1 (en) * | 2011-07-28 | 2012-08-07 | Google Inc. | System and method for multi-channel multi-feature speech/noise classification for noise suppression |
US9640194B1 (en) | 2012-10-04 | 2017-05-02 | Knowles Electronics, Llc | Noise suppression for speech processing based on machine-learning mask estimation |
US9396738B2 (en) | 2013-05-31 | 2016-07-19 | Sonus Networks, Inc. | Methods and apparatus for signal quality analysis |
US9536540B2 (en) | 2013-07-19 | 2017-01-03 | Knowles Electronics, Llc | Speech signal separation and synthesis based on auditory scene analysis and speech modeling |
DE112015003945T5 (de) | 2014-08-28 | 2017-05-11 | Knowles Electronics, Llc | Mehrquellen-Rauschunterdrückung |
CN106816158B (zh) * | 2015-11-30 | 2020-08-07 | 华为技术有限公司 | 一种语音质量评估方法、装置及设备 |
WO2017127367A1 (fr) * | 2016-01-19 | 2017-07-27 | Dolby Laboratories Licensing Corporation | Performance de capture d'un dispositif d'essai pour haut-parleurs multiples |
US10283140B1 (en) * | 2018-01-12 | 2019-05-07 | Alibaba Group Holding Limited | Enhancing audio signals using sub-band deep neural networks |
US10978091B2 (en) * | 2018-03-19 | 2021-04-13 | Academia Sinica | System and methods for suppression by selecting wavelets for feature compression in distributed speech recognition |
CN115798506A (zh) * | 2022-11-10 | 2023-03-14 | 维沃移动通信有限公司 | 语音处理方法、装置、电子设备及存储介质 |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4897878A (en) * | 1985-08-26 | 1990-01-30 | Itt Corporation | Noise compensation in speech recognition apparatus |
DE3639753A1 (de) * | 1986-11-21 | 1988-06-01 | Inst Rundfunktechnik Gmbh | Verfahren zum uebertragen digitalisierter tonsignale |
US5446492A (en) * | 1993-01-19 | 1995-08-29 | Wolf; Stephen | Perception-based video quality measurement system |
DE4309985A1 (de) * | 1993-03-29 | 1994-10-06 | Sel Alcatel Ag | Geräuschreduktion zur Spracherkennung |
IT1272653B (it) * | 1993-09-20 | 1997-06-26 | Alcatel Italia | Metodo di riduzione del rumore, in particolare per riconoscimento automatico del parlato, e filtro atto ad implementare lo stesso |
US6122610A (en) * | 1998-09-23 | 2000-09-19 | Verance Corporation | Noise suppression for low bitrate speech coder |
KR100573398B1 (ko) * | 1999-05-25 | 2006-04-25 | 내셔널 세미컨덕터 코포레이션 | 다매체 및 그 밖의 신호를 위한 일반 품질 측정시스템 |
US20020054685A1 (en) * | 2000-11-09 | 2002-05-09 | Carlos Avendano | System for suppressing acoustic echoes and interferences in multi-channel audio systems |
US6937978B2 (en) * | 2001-10-30 | 2005-08-30 | Chungwa Telecom Co., Ltd. | Suppression system of background noise of speech signals and the method thereof |
-
2001
- 2001-03-20 EP EP01810285A patent/EP1244094A1/fr not_active Withdrawn
-
2002
- 2002-03-19 EP EP02703438.8A patent/EP1386307B2/fr not_active Expired - Lifetime
- 2002-03-19 US US10/101,533 patent/US6804651B2/en not_active Expired - Fee Related
- 2002-03-19 AT AT02703438T patent/ATE289109T1/de not_active IP Right Cessation
- 2002-03-19 DE DE50202226T patent/DE50202226D1/de not_active Expired - Lifetime
- 2002-03-19 WO PCT/CH2002/000164 patent/WO2002075725A1/fr not_active Application Discontinuation
Also Published As
Publication number | Publication date |
---|---|
US20020191798A1 (en) | 2002-12-19 |
ATE289109T1 (de) | 2005-02-15 |
DE50202226D1 (de) | 2005-03-17 |
EP1386307A1 (fr) | 2004-02-04 |
EP1244094A1 (fr) | 2002-09-25 |
US6804651B2 (en) | 2004-10-12 |
WO2002075725A1 (fr) | 2002-09-26 |
EP1386307B1 (fr) | 2005-02-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1386307B2 (fr) | Procede et dispositif pour determiner un niveau de qualite d'un signal audio | |
EP1088300B1 (fr) | Procede d'execution d'une evaluation automatisee de la qualite de transmission de signaux audio | |
DE69614989T2 (de) | Verfahren und Vorrichtung zur Feststellung der Sprachaktivität in einem Sprachsignal und eine Kommunikationsvorrichtung | |
DE69131883T2 (de) | Vorrichtung zur Rauschreduzierung | |
EP1825461B1 (fr) | Procede et dispositif pour elargir artificiellement la largeur de bande de signaux vocaux | |
DE60303214T2 (de) | Verfahren zur reduzierung von aliasing-störungen, die durch die anpassung der spektralen hüllkurve in realwertfilterbanken verursacht werden | |
DE60034026T2 (de) | Sprachverbesserung mit durch sprachaktivität gesteuerte begrenzungen des gewinnfaktors | |
DE69432943T2 (de) | Verfahren und Vorrichtung zur Sprachdetektion | |
DE69420027T2 (de) | Rauschverminderung | |
DE2626793C3 (de) | Elektrische Schaltungsanordnung zum Bestimmen des stimmhaften oder stimmlosen Zustandes eines Sprachsignals | |
EP1869671B1 (fr) | Procede et dispositif pour attenuer le bruit | |
DE69901894T2 (de) | Verfahren und vorrichtung zur objektiven qualitätsmessung von audiosignalen | |
DE69730721T2 (de) | Verfahren und vorrichtungen zur geräuschkonditionierung von signalen welche audioinformationen darstellen in komprimierter und digitalisierter form | |
WO1998023130A1 (fr) | Evaluation de la qualite, a adaptation auditive, de signaux audio | |
DE60311619T2 (de) | Datenreduktion in Audiokodierern unter Ausnutzung nichtharmonischer Effekte | |
DE69616724T2 (de) | Verfahren und System für die Spracherkennung | |
EP3065417B1 (fr) | Procede de suppression d'un bruit parasite dans un systeme acoustique | |
DE60110541T2 (de) | Verfahren zur Spracherkennung mit geräuschabhängiger Normalisierung der Varianz | |
EP0658874A1 (fr) | Procédé et dispositif de circuit pour l'agrandissement de la largeur de signaux de langage à bande étroite | |
DE60225505T2 (de) | Verfahren und Vorrichtung zur Analyse von Prädiktionsparametern | |
DE3230391C2 (fr) | ||
DE69423703T2 (de) | Rauschunterdrückungseinrichtung zur Vorverarbeitung und/oder Nachbearbeitung von Sprachsignalen | |
DE69525508T2 (de) | System zur Schätzung der Grundfrequenz | |
DE69221985T2 (de) | Verfahren und Vorrichtung zur Glättung von Grundperiodewellenformen | |
DE4445983A1 (de) | Rauschunterdrückung |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20030821 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK RO SI |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: THOMET, BENDICHT Inventor name: JURIC, PERO |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050209 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050209 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050209 Ref country code: IE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050209 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: CH Ref legal event code: NV Representative=s name: KELLER & PARTNER PATENTANWAELTE AG |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: SWISSQUAL LICENSE AG |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: GERMAN |
|
REF | Corresponds to: |
Ref document number: 50202226 Country of ref document: DE Date of ref document: 20050317 Kind code of ref document: P |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050319 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050319 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050319 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050331 |
|
NLT2 | Nl: modifications (of names), taken from the european patent patent bulletin |
Owner name: SWISSQUAL LICENSE AG |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050509 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050509 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050509 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050520 |
|
GBT | Gb: translation of ep patent filed (gb section 77(6)(a)/1977) |
Effective date: 20050516 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IE Payment date: 20050628 Year of fee payment: 4 |
|
NLV1 | Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act | ||
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FD4D |
|
PLBI | Opposition filed |
Free format text: ORIGINAL CODE: 0009260 |
|
PLAX | Notice of opposition and request to file observation + time limit sent |
Free format text: ORIGINAL CODE: EPIDOSNOBS2 |
|
ET | Fr: translation filed | ||
26 | Opposition filed |
Opponent name: ASCOM (SCHWEIZ) AG Effective date: 20051102 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: E. BLUM & CO. PATENTANWAELTE |
|
PLAF | Information modified related to communication of a notice of opposition and request to file observations + time limit |
Free format text: ORIGINAL CODE: EPIDOSCOBS2 |
|
PLBB | Reply of patent proprietor to notice(s) of opposition received |
Free format text: ORIGINAL CODE: EPIDOSNOBS3 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: BE Payment date: 20060929 Year of fee payment: 5 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PFA Owner name: SPIRENT COMMUNICATIONS LICENSE AG Free format text: SWISSQUAL LICENSE AG#METALLSTRASSE 9B#6300 ZUG (CH) -TRANSFER TO- SPIRENT COMMUNICATIONS LICENSE AG#METALLSTRASSE 9B#6300 ZUG (CH) |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: CD |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PFA Owner name: SPIRENT COMMUNICATIONS LICENSE AG Free format text: SPIRENT COMMUNICATIONS LICENSE AG#METALLSTRASSE 9B#6300 ZUG (CH) -TRANSFER TO- SPIRENT COMMUNICATIONS LICENSE AG#METALLSTRASSE 9B#6300 ZUG (CH) |
|
BERE | Be: lapsed |
Owner name: SWISSQUAL A.G. Effective date: 20070331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20070331 Ref country code: PT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050709 |
|
APBP | Date of receipt of notice of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA2O |
|
APAH | Appeal reference modified |
Free format text: ORIGINAL CODE: EPIDOSCREFNO |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: SWISSQUAL LICENSE AG |
|
APBQ | Date of receipt of statement of grounds of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA3O |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: SWISSQUAL LICENSE AG |
|
APBU | Appeal procedure closed |
Free format text: ORIGINAL CODE: EPIDOSNNOA9O |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20120403 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20120328 Year of fee payment: 11 |
|
PUAH | Patent maintained in amended form |
Free format text: ORIGINAL CODE: 0009272 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: PATENT MAINTAINED AS AMENDED |
|
27A | Patent maintained in amended form |
Effective date: 20130417 |
|
AK | Designated contracting states |
Kind code of ref document: B2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R102 Ref document number: 50202226 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 50202226 Country of ref document: DE Representative=s name: GESTHUYSEN PATENT- UND RECHTSANWAELTE, DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PCOW Free format text: NEW ADDRESS: ALLMENDWEG 8, 4528 ZUCHWIL (CH) Ref country code: CH Ref legal event code: AELC Ref country code: CH Ref legal event code: PFA Owner name: SWISSQUAL LICENSE AG, CH Free format text: FORMER OWNER: SPIRENT COMMUNICATIONS LICENSE AG, CH Ref country code: CH Ref legal event code: PCOW Free format text: NEW ADDRESS: BAARERSTRASSE 78, 6300 ZUG (CH) |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R102 Ref document number: 50202226 Country of ref document: DE Effective date: 20130417 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 50202226 Country of ref document: DE Representative=s name: GESTHUYSEN PATENT- UND RECHTSANWAELTE, DE Effective date: 20130423 Ref country code: DE Ref legal event code: R081 Ref document number: 50202226 Country of ref document: DE Owner name: SWISSQUAL LICENSE AG, CH Free format text: FORMER OWNER: SPIRENT COMMUNICATIONS LICENSE AG, ZUG, CH Effective date: 20130423 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20131129 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130402 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130319 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20210218 Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20210324 Year of fee payment: 20 Ref country code: DE Payment date: 20210319 Year of fee payment: 20 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R071 Ref document number: 50202226 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: PE20 Expiry date: 20220318 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20220318 |