EP0993671B1 - Method for searching a noise model in noisy sound signals - Google Patents

Method for searching a noise model in noisy sound signals Download PDF

Info

Publication number
EP0993671B1
EP0993671B1 EP98935094A EP98935094A EP0993671B1 EP 0993671 B1 EP0993671 B1 EP 0993671B1 EP 98935094 A EP98935094 A EP 98935094A EP 98935094 A EP98935094 A EP 98935094A EP 0993671 B1 EP0993671 B1 EP 0993671B1
Authority
EP
European Patent Office
Prior art keywords
model
noise
frames
energy
search
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP98935094A
Other languages
German (de)
French (fr)
Other versions
EP0993671A1 (en
Inventor
Dominique Thomson-CSF PASTOR
Gérard Thomson-CSF REYNAUD
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thales Avionics SAS
Original Assignee
Thales Avionics SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thales Avionics SAS filed Critical Thales Avionics SAS
Publication of EP0993671A1 publication Critical patent/EP0993671A1/en
Application granted granted Critical
Publication of EP0993671B1 publication Critical patent/EP0993671B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • G10L2021/02168Noise filtering characterised by the method used for estimating noise the estimation exclusively taking place during speech pauses

Definitions

  • the invention relates to improving the intelligibility of voice communications in the presence of noise. It no longer applies especially but not exclusively to telephone communications or by radiotelephone or other electronic means, at the speech recognition, etc., whenever the recording environment sound is noisy and may deteriorate the perception or recognition of the transmitted voice.
  • noise comes from engines, air conditioning, ventilation of on-board equipment, aerodynamic noise. These noises are picked up by the microphone in which the pilot or a member of the crew.
  • the invention provides a method of searching for a model of noise which can be used in particular in treatments for reducing noise.
  • Noise reduction treatments based on the noise model found allow to increase the signal / noise ratio of the transmitted signal, a aim being to deteriorate the intelligibility of the signal as little as possible.
  • the denoising denoising and denoising will be used to speak operations to remove or reduce noise components present in the signal.
  • the denoising can be based as we will see on the permanent search for an ambient noise model, on spectral analysis of this noise, and on the digital reconstruction of a useful signal eliminating as much as possible the modeled noise.
  • the noise model is sought in the noisy signals themselves and whenever a plausible noise pattern has been found, this noise model is stored for use. Then a new research begins to find a more suitable model or simply more recent.
  • the invention provides a search method automatic noise patterns in audio input signals noisy, in which we digitize the input signals, and we process these signals from a model found (for example in order to eliminate at best noise corresponding to the model), characterized in that the signals input are cut into successive frames of P samples each, and a repetitive search for a noise model is performed in permanence in the input signals themselves, looking for N successive frames having the expected characteristics of a noise, in storing the corresponding NxP samples to constitute a model of noise useful for processing denoising of input signals, and repeating the research to find a new noise model and store the new one model to replace the previous one or keep the previous model according to the respective characteristics of the two models.
  • the noise model used in particular for denoising is not a known predetermined model or a chosen model among several predetermined models, but this is a model found in the noisy signal itself, which allows not only to adapt denoising to the real annoying noise, but also to adapt the denoising to variations of this noise.
  • the noise model is obtained by considering that the signals whose energy is stable (and preferably, as we will see, whose energy is minimal), over a certain period probably represent noise; the invention is characterized, according to claim 1, in that the searching for a noise model then includes searching for N frames successive whose energies are close to each other (N being between a minimum value N1 and a maximum value N2), the calculation of the average energy of the N successive frames found, and the storage NxP samples as a new active model if the relationship between this average energy and the average energy of the frames of the active model previously stored is below a determined replacement threshold.
  • the search for N successive frames then comprises at minus the following iterative steps: calculation of the energy of a frame current of rank n can be added to a current model of preparation already comprising n-1 successive frames; ratio calculation between this energy and the energy of the previous frame of rank n-1 (and of preferably that of other previous frames between 1 and n-1); comparison of this ratio with a low threshold less than 1 and a high threshold greater than 1; and decision on the possibility of incorporating the frame of rank n in the model in being developed: the frame is not incorporated into the model if the report is not between the two thresholds; it is incorporated into the model if the ratio is between the two thresholds. The procedure is repeated on the next current frame of input signals, with incrementation of n, until the model is stopped.
  • n reaches the high value N2
  • the model developed cannot be taken count as an active model only if n-1 is already greater than or equal to the minimum N1, because the principle is that a noise model is representative if it has an approximately stable energy on at least N1 frames.
  • the model developed does not become active in place of the previous model only if the ratio between its average energy per frame and the average energy of the previous model does not exceed a threshold of predetermined replacement.
  • the search for a new model starts again as soon as the preparation of the previous one is interrupted.
  • the replacement of a previous model by a new model is inhibited as soon as speech is detected in noisy signals.
  • the presence of speech can indeed be detected by digital signal processing procedures (such as than those that can be used in speech recognition).
  • the signal analysis which allows denoising will be based on spectral analysis of signals in time intervals of duration D, which we will call “frames”, and which will have approximately this duration.
  • the general principle of the denoising process is based on a permanent and automatic search for a noise model which will be used to process the input signal to denois it.
  • This research is done on digitized u (t) signal samples stored in a buffer input.
  • This memory is capable of memorizing all the samples of several frames of the input signal (e.g. at least 2 frames).
  • the noise model sought consists of a succession multiple frames including energy stability and energy level relative suggest that it is an ambient noise and not a speech signal or some other disturbing noise. We will see later how this automatic search.
  • the denoising of the input signal u (t) is done from the model of noise that is in memory, and more precisely from the characteristics spectral of this model.
  • a Fourier transform and an estimate of average spectral density of noise are therefore performed on the model of stored noise.
  • the denoising operation is preferably done using a digital filtering from Wiener which will be discussed in more detail.
  • the filter of Wiener is parameterized by the spectral characteristics of the model of noise recorded and by the spectral characteristics of the signal u (t) to denoise.
  • the digitized input signal therefore undergoes a transform of Fourier and an estimate of spectral density.
  • the numerical values of the Fourier transform i.e. the input signal represented by its frequency components, are processed by the Wiener filter and the output of the Wiener filter represents, in frequency space, the signal digital denoised, that is to say rid as much as possible of the noise represented by the registered model.
  • the filtered digital signal is used either for the reconstruction of a sound signal in which the ambient noise has been partly eliminated, i.e. at the speech Recognition.
  • phase of automatic search for a noise model and the permanent updating of this model are crucial steps in the process and are more precisely the subject of the invention.
  • noise ambient is a signal with a stable minimum energy in the short term.
  • the number of frames intended to assess the noise stability is 5 to 20.
  • Energy must be stable over several frames, otherwise we must assume that the signal contains rather speech or noise other than ambient noise. It must be minimal, fault what we consider that the signal contains breathing or phonetic speech elements resembling noise but overlapping to ambient noise.
  • Figure 2 shows a typical evolution configuration temporal energy of a microphone signal at the time of a start speech emission, with a breath noise phase, which goes out for a few tens to hundreds of milliseconds to make room for the ambient noise alone, after which a high energy level indicates the presence speech, to finally return to ambient noise.
  • N1 5
  • a determined range of values for example between 1/3 and 3
  • the noise model is generally based on permanent ambient noise. Even before speaking, preceded by breathing, there is a phase where ambient noise alone is present for a sufficient time to be taken into account as an active noise model. This phase ambient noise alone after breathing is brief; the number N1 is chosen relatively weak, so that we have time to readjust the noise model on ambient noise after the breathing phase.
  • the ambient noise changes slowly, the change will be taken into account. account of the fact that the comparison threshold with the stored model is greater than 1. If it evolves more rapidly in the increasing direction, the evolution may not be taken into account, so it is best to plan to reset the search for a model from time to time noise. For example, in a stopped ground plane, the ambient noise will be relatively weak, and it should not be that during the phase of takeoff the noise model remains frozen on what it was at a standstill because a noise model is only replaced by a less energetic model or not much more energetic. The methods of reset envisaged.
  • FIG. 3 represents a flowchart of the operations of automatic search for an ambient noise pattern.
  • the input signal u (t), sampled at the frequency F e 1 / T e and digitized by an analog-digital converter, is stored in a buffer memory capable of storing all the samples of at least 2 frames.
  • n The number of the current frame in an operation of looking for a noise pattern is denoted by n and is counted by a counter as you search. At the initialization of the search, n is set to 1. This number n will be incremented progressively the development of a model of several successive frames. when analyzes the current frame n, the model already understands by hypothesis n-1 successive frames meeting the conditions imposed to be part of a model.
  • the signal energy of the frame is calculated by summing the squares of the numerical values of the samples of the frame. She is kept in memory.
  • the ratio between the energies of the two frames is calculated. If this ratio is between two thresholds S and S 'one of which is greater than 1 and the other is less than 1, we consider that the energies of the two frames are close and that the two frames can be part of a noise model.
  • the frames are declared incompatible and the search is reset by resetting n to 1.
  • the rank n is incremented of the current frame, and we perform, in a procedure loop iterative, an energy calculation of the next frame and a comparison with the energy of the previous frame or previous frames, using the thresholds S and S '.
  • the first type of comparison consists in comparing only the energy of the frame n to the energy of the n-1 frame.
  • the second type is to compare the energy of frame n at each of frames 1 to n-1. The second way leads to greater homogeneity of the model but it has the disadvantage of not not take sufficiently into account the cases where the noise level increases or decreases rapidly.
  • the energy of the frame of rank n is compared with the energy of the frame of rank n-1 and possibly of other frames previous (not necessarily all of them for that matter).
  • N2 is chosen so as to limit the calculation time in subsequent noise spectral density estimation operations.
  • n is less than N2
  • the homogeneous frame is added to the to help build the noise model, n is incremented and the next frame is analyzed.
  • n is equal to N2
  • the frame is also added to the n-1 previous homogeneous frames and the model of n homogeneous frames is stored for use in noise elimination. Searching for a model is also reset by resetting n to 1.
  • the previous steps relate to the first search for model. But once a model has been stored, it can at any time be replaced by a more recent model.
  • the replacement condition is still a condition of energy, but this time it relates to the average energy of the model and not more about the energy of each frame.
  • the new model is considered better and we store it in place of the previous one. Otherwise, the new model is rejected and the old remains in force.
  • the threshold SR is preferably slightly greater than 1.
  • the SR threshold was less than or equal to 1, we would store at each times the least energetic homogeneous frames, which corresponds well to the fact that ambient noise is considered to be the energy level at below which we never descend. But, we would eliminate any possibility evolution of the model if the ambient noise starts to increase.
  • SR threshold was too high above 1, there is a risk of poorly distinguish ambient noise and other disturbing noises (breathing), or even some phonemes that sound like noise (consonants hissing or hissing for example). Noise removal from a noise pattern stalled on breath or on whistling consonants or hissing could then harm the intelligibility of the denoised signal.
  • the threshold SR is approximately 1.5. At above this threshold we will keep the old model; below this threshold we will replace the old model with the new one. In both cases, we will reset the search by restarting the reading of a first frame of the input signal u (t), and by putting n at 1.
  • the digital treatments of commonly used signal in speech detection identify the presence of words based on the characteristic spectra of periodicity of certain phonemes, in particular the corresponding phonemes to vowels or voiced consonants.
  • This inhibition is to prevent certain sounds from being taken for noise when these are useful phonemes, that a model of noise based on these sounds is stored and that noise suppression after the development of the model then tends to suppress all the sounds Similar.
  • Ambient noise can indeed increase significantly and fast, for example during the acceleration phase of the engines of a plane or other vehicle, air, land or sea. But the SR threshold requires that the previous noise model be kept when the energy average noise increases too quickly.
  • Periodicity can be based on duration average speech in the intended application; for example the durations of speech are on average a few seconds for the crew of a airplane, and the reset can take place with a periodicity of a few seconds.
  • the proper denoising treatment carried out from of a stored noise model, can be performed as follows, by working on the Fourier transforms of the input signal.
  • the Fourier transform of the input signal is carried out frame by frame and provides for each frame P samples in the frequency space, each sample corresponding to a frequency F e / i with i varying from 1 to P. These P samples will be processed preferably in a Wiener filter.
  • the Wiener filter is a digital filter of P coefficients each corresponding to one of the frequencies F e / i of the frequency space.
  • Each sample of the input signal in the frequency space is multiplied by the respective coefficient W i of the filter.
  • the set of P samples thus processed constitutes a denoised signal frame, in the frequency space.
  • these denoised frames are used directly in the frequency space.
  • the coefficients W i of the Wiener filter are calculated from the spectral density of the noisy input signal and the noise spectral density of the stored noise model.
  • the spectral density of a frame of the input signal is obtained from the Fourier transform of the noisy input signal. For each frequency, we take the squared module of the sample provided by the Fourier transform, to obtain a value DS i for each frequency F e / i.
  • the module squared of the P samples is calculated for each frame, and the N squared modules corresponding to the same frequency F e / i are averaged over the N frames of the noise model.
  • P noise density values DB i are obtained.
  • the sample of rank i of the Fourier transform of an input signal frame is multiplied by W i and the succession of the P samples thus multiplied by P Wiener coefficients constitutes the denoised input frame.
  • the implementation of the method according to the invention can be done at from non-specialized computers, provided with calculation programs required and receiving the digital signal samples as they are supplied by an analog-to-digital converter.
  • This implementation can also be done from a specialized computer based on digital signal processors, which allows more signals to be processed more quickly digital.
  • FIG. 4 represents an example of general architecture of a specialized computer receiving the sound signal to denois and providing real time an audible noise signal.
  • the computer includes two signal processors digital DSP1 and DSP2 and working memories associated with these processors.
  • Noise signals are passed through a converter analog-digital CA / D and are stored in parallel in two FIFO1 and FIFO2 buffers (of the "first-in, first-out" type, i.e. first in first out).
  • One of the memories is connected to the processor DSP1, the other to the DSP2 processor.
  • the DSP1 processor is the master processor and it is dedicated rather looking for a noise model. It is therefore programmed to execute at least the following operations: frame energy calculation, energy averaging, comparison with thresholds, comparison frame rank with N1 and N2, etc. It also calculates densities energy spectral of the noise model.
  • This DSP1 processor is coupled to a dynamic working memory DRAM1 in which we store the current frame sample during a calculation, the energy of a frame current, the energy of the previous frame (s), the samples of Fourier transform of the noise model. It is also coupled with a static working memory in which the tables used are stored the computation of Fourier transforms, and the comparison thresholds S and SR.
  • the DSP2 processor is dedicated rather to the calculation of transforms Fourier signal to denois, calculating the spectral density of this signal, calculating Wiener coefficients, Wiener filtering, and inverse Fourier transform if the latter is to be performed.
  • the DSP2 processor is coupled to a dynamic working memory DRAM2 and a static working memory SRAM2.
  • DRAM2 memory stores current frame samples, transform calculation results from Fourier, results of calculation of spectral energy density of the signal, the calculated Wiener coefficients, etc.
  • the SRAM2 memory stores in particular tables used for the computation of Fourier transforms.
  • the denoised sound signal samples calculated by the DSP2 processor are transmitted, through a circulating buffer FIFO3, to a digital analog converter CNIA, and to a circuit of smoothing which reconstructs the denoised sound signal in analog form.

Description

L'invention concerne l'amélioration de l'intelligibilité des communications vocales en présence de bruit. Elle s'applique plus spécialement mais non exclusivement aux communications téléphoniques ou radiotéléphoniques ou par d'autres moyens électroniques, à la reconnaissance vocale, etc., chaque fois que l'environnement de la prise de son est bruité et risque de détériorer la perception ou la reconnaissance de la voix transmise.The invention relates to improving the intelligibility of voice communications in the presence of noise. It no longer applies especially but not exclusively to telephone communications or by radiotelephone or other electronic means, at the speech recognition, etc., whenever the recording environment sound is noisy and may deteriorate the perception or recognition of the transmitted voice.

Un exemple peut en être donné à propos des communications vocales à l'intérieur d'un avion ou d'un autre véhicule bruyant. Dans le cas d'un avion, les bruits résultent des moteurs, de la climatisation, de la ventilation des équipements de bord, des bruits aérodynamiques. Ces bruits sont captés par le microphone dans lequel parle le pilote ou un membre de l'équipage.An example can be given about communications voices inside an airplane or other noisy vehicle. In the case from an airplane, noise comes from engines, air conditioning, ventilation of on-board equipment, aerodynamic noise. These noises are picked up by the microphone in which the pilot or a member of the crew.

L'invention propose un procédé de recherche d'un modèle de bruit pouvant servir en particulier dans des traitements de réduction du bruit. Les traitements de réduction de bruit fondés sur le modèle de bruit trouvé permettent d'augmenter le rapport signal/bruit du signal transmis, un but étant de détériorer le moins possible l'intelligibilité du signal. Dans cette demande, les néologismes débruitage et débruiter seront utilisés pour parler des opérations visant à enlever ou réduire des composantes de bruit présentes dans le signal.The invention provides a method of searching for a model of noise which can be used in particular in treatments for reducing noise. Noise reduction treatments based on the noise model found allow to increase the signal / noise ratio of the transmitted signal, a aim being to deteriorate the intelligibility of the signal as little as possible. In this request, the denoising denoising and denoising will be used to speak operations to remove or reduce noise components present in the signal.

Le débruitage pourra se fonder comme on le verra sur la recherche permanente d'un modèle de bruit ambiant, sur l'analyse spectrale numérique de ce bruit, et sur la reconstruction numérique d'un signal utile éliminant autant que possible le bruit modélisé.The denoising can be based as we will see on the permanent search for an ambient noise model, on spectral analysis of this noise, and on the digital reconstruction of a useful signal eliminating as much as possible the modeled noise.

Le modèle de bruit est recherché dans les signaux bruités eux-mêmes et chaque fois qu'un modèle de bruit plausible a été trouvé, ce modèle de bruit est stocké pour pouvoir être utilisé. Puis, une nouvelle recherche commence pour trouver un modèle plus adapté ou simplement plus récent. The noise model is sought in the noisy signals themselves and whenever a plausible noise pattern has been found, this noise model is stored for use. Then a new research begins to find a more suitable model or simply more recent.

Plus précisément, l'invention propose un procédé de recherche automatique de modèles de bruit dans des signaux d'entrée sonores bruités, dans lequel on numérise les signaux d'entrée, et on traite ces signaux à partir d'un modèle trouvé (par exemple en vue d'éliminer au mieux le bruit correspondant au modèle), caractérisé en ce que les signaux d'entrée sont découpés en trames successives de P échantillons chacune, et une recherche répétitive d'un modèle de bruit est effectuée en permanence dans les signaux d'entrée eux-mêmes, en recherchant N trames successives ayant les caractéristiques attendues d'un bruit, en stockant les NxP échantillons correspondants pour constituer un modèle de bruit utile au traitement de débruitage des signaux d'entrée, et en réitérant la recherche pour trouver un nouveau modèle de bruit et stocker le nouveau modèle en remplacement du précédent ou conserver le modèle précédent selon les caractéristiques respectives des deux modèles.More specifically, the invention provides a search method automatic noise patterns in audio input signals noisy, in which we digitize the input signals, and we process these signals from a model found (for example in order to eliminate at best noise corresponding to the model), characterized in that the signals input are cut into successive frames of P samples each, and a repetitive search for a noise model is performed in permanence in the input signals themselves, looking for N successive frames having the expected characteristics of a noise, in storing the corresponding NxP samples to constitute a model of noise useful for processing denoising of input signals, and repeating the research to find a new noise model and store the new one model to replace the previous one or keep the previous model according to the respective characteristics of the two models.

Par conséquent, le modèle de bruit servant notamment au débruitage n'est pas un modèle prédéterminé connu ou un modèle choisi parmi plusieurs modèles prédéterminés, mais c'est un modèle trouvé dans le signal bruité lui-même, ce qui permet non seulement d'adapter le débruitage au véritable bruit gênant, mais aussi d'adapter le débruitage aux variations de ce bruit.Consequently, the noise model used in particular for denoising is not a known predetermined model or a chosen model among several predetermined models, but this is a model found in the noisy signal itself, which allows not only to adapt denoising to the real annoying noise, but also to adapt the denoising to variations of this noise.

Le modèle de bruit est obtenu en considérant que les signaux dont l'énergie est stable (et, de préférence, comme on le verra, dont l'énergie est minimale), sur une certaine durée représentent probablement du bruit; l'invention est caractérisée, selon la revendication 1, en ce que la recherche d'un modèle de bruit comprend alors la recherche de N trames successives dont les énergies sont proches les unes des autres (N étant compris entre une valeur minimale N1 et une valeur maximale N2), le calcul de l'énergie moyenne des N trames successives trouvées, et le stockage des NxP échantillons à titre de nouveau modèle actif si le rapport entre cette énergie moyenne et l'énergie moyenne des trames du modèle actif précédemment stocké est inférieur à un seuil de remplacement déterminé.The noise model is obtained by considering that the signals whose energy is stable (and preferably, as we will see, whose energy is minimal), over a certain period probably represent noise; the invention is characterized, according to claim 1, in that the searching for a noise model then includes searching for N frames successive whose energies are close to each other (N being between a minimum value N1 and a maximum value N2), the calculation of the average energy of the N successive frames found, and the storage NxP samples as a new active model if the relationship between this average energy and the average energy of the frames of the active model previously stored is below a determined replacement threshold.

On notera que les documents US-A-5 550 924 et WO 97 18 647 utilisent une analyse spectrale pour la recherche de modèles de bruit.Note that documents US-A-5,550,924 and WO 97 18,647 use spectral analysis to search for noise patterns.

La recherche de N trames successives comprend alors au moins les étapes itératives suivantes : calcul de l'énergie d'une trame courante de rang n susceptible d'être ajoutée à un modèle en cours d'élaboration comprenant déjà n-1 trames successives; calcul du rapport entre cette énergie et l'énergie de la trame précédente de rang n-1 (et de préférence celle d'autres trames précédentes entre 1 et n-1); comparaison de ce rapport avec un seuil bas inférieur à 1 et un seuil haut supérieur à 1; et décision sur la possibilité d'incorporer la trame de rang n au modèle en cours d'élaboration : la trame n'est pas incorporée au modèle si le rapport n'est pas compris entre les deux seuils; elle est incorporée au modèle si le rapport est compris entre les deux seuils. La procédure est réitérée sur la trame courante suivante des signaux d'entrée, avec incrémentation de n, jusqu'à l'arrêt de l'élaboration du modèle.The search for N successive frames then comprises at minus the following iterative steps: calculation of the energy of a frame current of rank n can be added to a current model of preparation already comprising n-1 successive frames; ratio calculation between this energy and the energy of the previous frame of rank n-1 (and of preferably that of other previous frames between 1 and n-1); comparison of this ratio with a low threshold less than 1 and a high threshold greater than 1; and decision on the possibility of incorporating the frame of rank n in the model in being developed: the frame is not incorporated into the model if the report is not between the two thresholds; it is incorporated into the model if the ratio is between the two thresholds. The procedure is repeated on the next current frame of input signals, with incrementation of n, until the model is stopped.

L'élaboration du modèle est arrêtée soit dans le cas où n atteint la valeur haute N2, soit dans le cas où la trame de rang n n'est pas incorporée au modèle parce que le rapport d'énergies calculé sort de la gamme prescrite. Dans ce dernier cas, le modèle élaboré ne peut être pris en compte comme modèle actif que si n-1 est déjà supérieur ou égal au minimum N1, car le principe est qu'un modèle de bruit est représentatif s'il a une énergie à peu près stable sur au moins N1 trames.The development of the model is stopped either in the case where n reaches the high value N2, either in the case where the frame of rank n is not incorporated into the model because the calculated energy ratio goes out of prescribed range. In the latter case, the model developed cannot be taken count as an active model only if n-1 is already greater than or equal to the minimum N1, because the principle is that a noise model is representative if it has an approximately stable energy on at least N1 frames.

De préférence, le modèle élaboré ne devient actif à la place du modèle précédent que si le rapport entre son énergie moyenne par trame et l'énergie moyenne du modèle précédent ne dépasse pas un seuil de remplacement prédéterminé.Preferably, the model developed does not become active in place of the previous model only if the ratio between its average energy per frame and the average energy of the previous model does not exceed a threshold of predetermined replacement.

Dans tous les cas, la recherche d'un nouveau modèle recommence dès que l'élaboration du précédent est interrompue.In any case, the search for a new model starts again as soon as the preparation of the previous one is interrupted.

Enfin, de préférence, on peut prévoir que le remplacement d'un modèle précédent par un nouveau modèle est inhibé dès que de la parole est détectée dans les signaux bruités. La présence de parole peut en effet être détectée par des procédures de traitement de signal numérique (telles que celles qu'on peut utiliser dans la reconnaissance de parole).Finally, preferably, it can be provided that the replacement of a previous model by a new model is inhibited as soon as speech is detected in noisy signals. The presence of speech can indeed be detected by digital signal processing procedures (such as than those that can be used in speech recognition).

D'autres caractéristiques et avantages de l'invention apparaítront à la lecture de la description détaillée qui suit et qui est faite en référence aux dessins annexés dans lesquels :

  • la figure 1 représente un organigramme général d'un procédé de réduction de bruit utilisant le procédé de l'invention;
  • la figure 2 représente un exemple typique de signal issu d'une prise de son bruitée;
  • la figure 3 représente l'organigramme des étapes de recherche d'un modèle de bruit dans le signal d'entrée;
  • la figure 4 représente un exemple d'architecture de circuit électronique pour la mise en oeuvre d'opérations de débruitage utilisant le procédé selon l'invention.
Other characteristics and advantages of the invention will appear on reading the detailed description which follows and which is given with reference to the appended drawings in which:
  • FIG. 1 represents a general flow diagram of a noise reduction method using the method of the invention;
  • FIG. 2 represents a typical example of a signal coming from a noisy sound recording;
  • FIG. 3 represents the flow diagram of the steps for searching for a noise model in the input signal;
  • FIG. 4 represents an example of electronic circuit architecture for the implementation of denoising operations using the method according to the invention.

Dans l'analyse de la parole, il est usuel de considérer que les régimes stationnaires de production du son s'établissent sur des durées comprises entre 10 et 20 millisecondes.In speech analysis, it is usual to consider that the stationary sound production systems are established over time between 10 and 20 milliseconds.

L'analyse de signaux qui permet le débruitage reposera sur l'analyse spectrale des signaux dans des intervalles de temps de durée D, qu'on appellera "trames", et qui auront à peu près cette durée.The signal analysis which allows denoising will be based on spectral analysis of signals in time intervals of duration D, which we will call "frames", and which will have approximately this duration.

Chaque trame comportera P=2p échantillons de signal numérisé, le nombre P dépendant de la fréquence d'échantillonnage du signal traité, de manière que la trame ait une durée de l'ordre de 10 à 20 ms quelle que soit la fréquence d'échantillonnage Fe = 1/Te. Par exemple, pour une fréquence d'échantillonnage de 10 kHz, la trame comportera P = 128 échantillons (p = 7) et durera 12,8 ms.Each frame will comprise P = 2 p samples of digitized signal, the number P depending on the sampling frequency of the processed signal, so that the frame has a duration of the order of 10 to 20 ms regardless of the frequency of sampling F e = 1 / T e . For example, for a sampling frequency of 10 kHz, the frame will contain P = 128 samples (p = 7) and will last 12.8 ms.

Le schéma de la figure 1 est un organigramme expliquant le principe général du procédé de débruitage.The diagram in Figure 1 is a flowchart explaining the general principle of the denoising process.

Le signal d'entrée à traiter, issu par exemple d'un microphone, est noté u(t), avec une partie utile s(t) et un bruit indésirable b(t), avec u(t) = s(t) + b(t), le temps t étant supposé discret (t = kTe) puisque le signal est échantillonné avant d'être numérisé dans un convertisseur analogique-numérique.The input signal to be processed, coming for example from a microphone, is noted u (t), with a useful part s (t) and an undesirable noise b (t), with u (t) = s (t) + b (t), time t being assumed to be discrete (t = kT e ) since the signal is sampled before being digitized in an analog-digital converter.

Dans la suite, on considérera, à titre d'exemple représentant l'application principale de l'invention, que le traitement des signaux d'entrée est un traitement de débruitage à partir du modèle de bruit trouvé. D'autres applications peuvent être envisagées (recherche de consonnes sifflantes ou chuintantes, par exemple).In the following, we will consider, as an example representing the main application of the invention, that the processing of input signals is a denoising treatment based on the noise model found. other applications can be considered (search for whistling consonants or hushing, for example).

Le principe général du procédé de débruitage repose sur une recherche permanente et automatique d'un modèle de bruit qui servira à traiter le signal d'entrée pour le débruiter. Cette recherche est faite sur les échantillons de signal u(t) numérisés et stockés dans une mémoire tampon d'entrée. Cette mémoire est capable de mémoriser simultanément tous les échantillons de plusieurs trames du signal d'entrée (par exemple au moins 2 trames).The general principle of the denoising process is based on a permanent and automatic search for a noise model which will be used to process the input signal to denois it. This research is done on digitized u (t) signal samples stored in a buffer input. This memory is capable of memorizing all the samples of several frames of the input signal (e.g. at least 2 frames).

Le modèle de bruit recherché est constitué par une succession de plusieurs trames dont la stabilité en énergie et le niveau d'énergie relative font penser qu'il s'agit d'un bruit ambiant et non d'un signal de parole ou d'un autre bruit perturbateur. On verra plus loin comment se fait cette recherche automatique.The noise model sought consists of a succession multiple frames including energy stability and energy level relative suggest that it is an ambient noise and not a speech signal or some other disturbing noise. We will see later how this automatic search.

Lorsqu'un modèle de bruit est trouvé, tous les échantillons des N trames successives représentant ce modèle de bruit sont conservés en mémoire, de sorte que le spectre de ce bruit peut être analysé et peut servir au débruitage. Mais la recherche automatique de bruit continue à partir du signal d'entrée u(t) pour trouver éventuellement un modèle plus récent et plus adapté, soit parce qu'il représente mieux le bruit ambiant, soit parce que le bruit ambiant a évolué. Le modèle de bruit plus récent est mis en mémoire à la place du précédent, si la comparaison avec le précédent montre qu'il est plus représentatif du bruit ambiant.When a noise pattern is found, all samples from the N successive frames representing this noise model are kept in memory, so the spectrum of this noise can be analyzed and can be used to denoising. But the automatic noise search continues from the input signal u (t) to possibly find a newer model and more suitable, either because it better represents ambient noise, or because that ambient noise has changed. The newer noise model is implemented memory in place of the previous one, if the comparison with the previous one shows that it is more representative of ambient noise.

Le débruitage du signal d'entrée u(t) se fait à partir du modèle de bruit qui est en mémoire, et plus précisément à partir des caractéristiques spectrales de ce modèle. Une transformée de Fourier et une estimation de densité spectrale moyenne de bruit sont donc effectuées sur le modèle de bruit stocké. L'opération de débruitage se fait de préférence grâce à un filtrage numérique de Wiener sur lequel on reviendra plus en détail. Le filtre de Wiener est paramétré par les caractéristiques spectrales du modèle de bruit enregistré et par les caractéristiques spectrales du signal u(t) à débruiter. Le signal d'entrée numérisé subit donc une transformée de Fourier et une estimation de densité spectrale. Les valeurs numériques de la transformée de Fourier, c'est-à-dire le signal d'entrée représenté par ses composantes fréquentielles, sont traitées par le filtre de Wiener et la sortie du filtre de Wiener représente, dans l'espace fréquentiel, le signal numérique débruité, c'est-à-dire débarrassé le mieux possible du bruit représenté par le modèle enregistré.The denoising of the input signal u (t) is done from the model of noise that is in memory, and more precisely from the characteristics spectral of this model. A Fourier transform and an estimate of average spectral density of noise are therefore performed on the model of stored noise. The denoising operation is preferably done using a digital filtering from Wiener which will be discussed in more detail. The filter of Wiener is parameterized by the spectral characteristics of the model of noise recorded and by the spectral characteristics of the signal u (t) to denoise. The digitized input signal therefore undergoes a transform of Fourier and an estimate of spectral density. The numerical values of the Fourier transform, i.e. the input signal represented by its frequency components, are processed by the Wiener filter and the output of the Wiener filter represents, in frequency space, the signal digital denoised, that is to say rid as much as possible of the noise represented by the registered model.

Le signal numérique filtré sert soit à la reconstruction d'un signal sonore dans lequel le bruit ambiant a été en partie éliminé, soit à la reconnaissance vocale. The filtered digital signal is used either for the reconstruction of a sound signal in which the ambient noise has been partly eliminated, i.e. at the speech Recognition.

La phase de recherche automatique d'un modèle de bruit et la mise à jour permanente de ce modèle sont des étapes cruciales du procédé et font plus précisément l'objet de l'invention.The phase of automatic search for a noise model and the permanent updating of this model are crucial steps in the process and are more precisely the subject of the invention.

Les postulats de départ pour l'élaboration automatique d'un modèle de bruit sont les suivants :

  • le bruit qu'on veut éliminer est le bruit de fond ambiant;
  • le bruit ambiant a une énergie relativement stable à court terme,
  • la parole est le plus souvent précédée d'un bruit de respiration du pilote qu'il ne faut pas confondre avec le bruit ambiant; mais ce bruit de respiration s'éteint quelques centaines de millisecondes avant la première émission de parole proprement dite, de sorte qu'on ne retrouve que le bruit ambiant juste avant l'émission de parole;
  • et enfin, les bruits et la parole se superposent en termes d'énergie de signal, de sorte qu'un signal contenant de la parole ou un bruit perturbateur, y compris la respiration dans le microphone, contient forcément plus d'énergie qu'un signal de bruit ambiant.
The starting postulates for the automatic development of a noise model are as follows:
  • the noise that we want to eliminate is the ambient background noise;
  • ambient noise has a relatively stable energy in the short term,
  • speech is most often preceded by a breathing noise from the pilot which should not be confused with ambient noise; but this breathing noise is extinguished a few hundred milliseconds before the first speech emission proper, so that only the ambient noise is found just before the speech emission;
  • and finally, noise and speech are superimposed in terms of signal energy, so that a signal containing speech or disturbing noise, including breathing in the microphone, necessarily contains more energy than a ambient noise signal.

Il en résulte qu'on fera l'hypothèse simple suivante : le bruit ambiant est un signal présentant une énergie minimale stable à court terme. Par court terme il faut entendre quelques trames, et on verra dans l'exemple pratique donné ci-après que le nombre de trames destiné à évaluer la stabilité du bruit est de 5 à 20. L'énergie doit être stable sur plusieurs trames, faute de quoi on doit supposer que le signal contient plutôt de la parole ou un bruit autre que le bruit ambiant. Elle doit être minimale, faute de quoi on considère que le signal contient de la respiration ou des éléments phonétiques de parole ressemblant à du bruit mais se superposant au bruit ambiant.As a result, we will make the following simple hypothesis: noise ambient is a signal with a stable minimum energy in the short term. By short term we need to understand some frames, and we will see in the example practice given below that the number of frames intended to assess the noise stability is 5 to 20. Energy must be stable over several frames, otherwise we must assume that the signal contains rather speech or noise other than ambient noise. It must be minimal, fault what we consider that the signal contains breathing or phonetic speech elements resembling noise but overlapping to ambient noise.

La figure 2 représente une configuration typique d'évolution temporelle de l'énergie d'un signal microphonique au moment d'un début d'émission de parole, avec une phase de bruit de respiration, qui s'éteint pendant quelques dizaines à centaines de millisecondes pour faire place au bruit ambiant seul, après quoi un niveau d'énergie élevé indique la présence de parole, pour revenir enfin au bruit ambiant.Figure 2 shows a typical evolution configuration temporal energy of a microphone signal at the time of a start speech emission, with a breath noise phase, which goes out for a few tens to hundreds of milliseconds to make room for the ambient noise alone, after which a high energy level indicates the presence speech, to finally return to ambient noise.

La recherche automatique du bruit ambiant consiste alors à trouver au moins N1 trames successives (par exemple N1 = 5) dont les énergies sont proches les unes des autres, c'est-à-dire que le rapport entre l'énergie de signal contenue dans une trame et l'énergie de signal contenue dans la ou, de préférence, les trames précédentes est situé à l'intérieur d'une gamme de valeurs déterminée (par exemple compris entre 1/3 et 3). Lorsqu'une telle succession de trames d'énergie relativement stable a été trouvée, on stocke les valeurs numériques de tous les échantillons de ces N trames. Cet ensemble de NxP échantillons constitue le modèle courant de bruit. Il est utilisé dans le débruitage. L'analyse des trames suivantes continue. Si on trouve une autre succession d'au moins N1 trames successives répondant aux mêmes conditions de stabilité d'énergie (rapports d'énergies de trames dans une gamme déterminée), on compare alors l'énergie moyenne de cette nouvelle succession de trames à l'énergie moyenne du modèle stocké, et on remplace ce dernier par la nouvelle succession si le rapport entre l'énergie moyenne de la nouvelle succession et l'énergie moyenne du modèle stocké est inférieur à un seuil de remplacement déterminé qui peut être de 1,5 par exemple.The automatic search for ambient noise then consists of find at least N1 successive frames (for example N1 = 5) whose energies are close to each other, that is to say that the relationship between the signal energy contained in a frame and the signal energy contained in the or, preferably, the previous frames is located inside of a determined range of values (for example between 1/3 and 3). When such a succession of relatively stable energy frames has been found, we store the numerical values of all the samples of these N frames. This set of NxP samples constitutes the current model of noise. It is used in denoising. Analysis of the following frames keep on going. If we find another succession of at least N1 frames successive ones meeting the same energy stability conditions (weft energy ratios in a given range), we compare then the average energy of this new succession of frames to the energy average of the stored model, and we replace the latter with the new succession if the ratio between the average energy of the new succession and the average energy of the stored model is below a threshold of determined replacement which can be 1.5 for example.

De ce remplacement d'un modèle de bruit par un modèle plus récent moins énergétique ou pas beaucoup plus énergétique, il résulte que le modèle de bruit se cale globalement sur le bruit ambiant permanent. Même avant une prise de parole, précédée d'une respiration, il existe une phase où le bruit ambiant seul est présent pendant une durée suffisante pour pouvoir être pris en compte comme modèle de bruit actif. Cette phase de bruit ambiant seul après respiration est brève; le nombre N1 est choisi relativement faible, afin qu'on ait le temps de recaler le modèle de bruit sur le bruit ambiant après la phase de respiration.From this replacement of a noise model by a more recent less energetic or not much more energetic, it follows that the noise model is generally based on permanent ambient noise. Even before speaking, preceded by breathing, there is a phase where ambient noise alone is present for a sufficient time to be taken into account as an active noise model. This phase ambient noise alone after breathing is brief; the number N1 is chosen relatively weak, so that we have time to readjust the noise model on ambient noise after the breathing phase.

Si le bruit ambiant évolue lentement, l'évolution sera prise en compte du fait que le seuil de comparaison avec le modèle stocké est supérieur à 1. S'il évolue plus rapidement dans le sens croissant, l'évolution risque de ne pas être prise en compte, de sorte qu'il est préférable de prévoir de temps en temps une réinitialisation de la recherche d'un modèle de bruit. Par exemple, dans un avion au sol à l'arrêt, le bruit ambiant sera relativement faible, et il ne faudrait pas qu'au cours de la phase de décollage le modèle de bruit reste figé sur ce qu'il était à l'arrêt du fait qu'un modèle de bruit n'est remplacé que par un modèle moins énergétique ou pas beaucoup plus énergétique. On expliquera plus loin les méthodes de réinitialisation envisagées.If the ambient noise changes slowly, the change will be taken into account. account of the fact that the comparison threshold with the stored model is greater than 1. If it evolves more rapidly in the increasing direction, the evolution may not be taken into account, so it is best to plan to reset the search for a model from time to time noise. For example, in a stopped ground plane, the ambient noise will be relatively weak, and it should not be that during the phase of takeoff the noise model remains frozen on what it was at a standstill because a noise model is only replaced by a less energetic model or not much more energetic. The methods of reset envisaged.

La figure 3 représente un organigramme des opérations de recherche automatique d'un modèle de bruit ambiant.FIG. 3 represents a flowchart of the operations of automatic search for an ambient noise pattern.

Le signal d'entrée u(t), échantillonné à la fréquence Fe = 1/Te et numérisé par un convertisseur analogique-numérique, est stocké dans une mémoire tampon capable de stocker tous les échantillons d'au moins 2 trames.The input signal u (t), sampled at the frequency F e = 1 / T e and digitized by an analog-digital converter, is stored in a buffer memory capable of storing all the samples of at least 2 frames.

Le numéro de la trame courante dans une opération de recherche d'un modèle de bruit est désigné par n et est compté par un compteur au fur et à mesure de la recherche. A l'initialisation de la recherche, n est mis à 1. Ce numéro n sera incrémenté au fur et à mesure de l'élaboration d'un modèle de plusieurs trames successives. Lorsqu'on analyse la trame courante n, le modèle comprend déjà par hypothèse n-1 trames successives répondant aux conditions imposées pour faire partie d'un modèle.The number of the current frame in an operation of looking for a noise pattern is denoted by n and is counted by a counter as you search. At the initialization of the search, n is set to 1. This number n will be incremented progressively the development of a model of several successive frames. when analyzes the current frame n, the model already understands by hypothesis n-1 successive frames meeting the conditions imposed to be part of a model.

On considère d'abord qu'il s'agit d'une première élaboration de modèle, aucun autre modèle précédent n'ayant été construit. On verra ensuite ce qui se passe pour des élaborations ultérieures.We first consider that this is a first elaboration of model, no other previous model having been built. We'll see then what happens for further elaborations.

L'énergie de signal de la trame est calculée par sommation des carrés des valeurs numériques des échantillons de la trame. Elle est conservée en mémoire.The signal energy of the frame is calculated by summing the squares of the numerical values of the samples of the frame. She is kept in memory.

On lit ensuite la trame suivante de rang n = 2, et son énergie est calculée de la même manière. Elle est également conservée en mémoire.We then read the next frame of rank n = 2, and its energy is calculated in the same way. It is also kept in memory.

On calcule le rapport entre les énergies des deux trames. Si ce rapport est compris entre deux seuils S et S' dont l'un est supérieur à 1 et l'autre est inférieur à 1, on considère que les énergies des deux trames sont proches et que les deux trames peuvent faire partie d'un modèle de bruit. Les seuils S et S' sont de préférence inverses l'un de l'autre (S' = 1/S) de sorte qu'il suffit de définir l'un pour avoir l'autre. Par exemple, une valeur typique est S = 3, S' = 1/3. Si les trames peuvent faire partie d'un même modèle de bruit, les échantillons qui les composent sont stockés pour commencer à construire le modèle, et la recherche continue par itération en incrémentant n d'une unité. The ratio between the energies of the two frames is calculated. If this ratio is between two thresholds S and S 'one of which is greater than 1 and the other is less than 1, we consider that the energies of the two frames are close and that the two frames can be part of a noise model. The thresholds S and S 'are preferably inverse to each other (S' = 1 / S) by so you just have to define one to get the other. For example, a value typical is S = 3, S '= 1/3. If the frames can be part of the same noise model, the samples that compose them are stored for start building the model, and the research continues iterating through incrementing n by one.

Si le rapport entre les énergies des deux premières trames sort de l'intervalle imposé, les trames sont déclarées incompatibles et la recherche est réinitialisée en remettant n à 1.If the relationship between the energies of the first two frames goes out of the imposed interval, the frames are declared incompatible and the search is reset by resetting n to 1.

Dans le cas où la recherche continue, on incrémente le rang n de la trame courante, et on effectue, dans une boucle de procédure itérative, un calcul d'énergie de la trame suivante et une comparaison avec l'énergie de la trame précédente ou des trames précédentes, en utilisant les seuils S et S'.In the case where the search continues, the rank n is incremented of the current frame, and we perform, in a procedure loop iterative, an energy calculation of the next frame and a comparison with the energy of the previous frame or previous frames, using the thresholds S and S '.

On notera à ce propos que deux types de comparaison sont possibles pour ajouter une trame à n-1 trames précédentes qui ont déjà été considérées comme homogènes en énergie : le premier type de comparaison consiste à comparer uniquement l'énergie de la trame n à l'énergie de la trame n-1. Le deuxième type consiste à comparer l'énergie de la trame n à chacune des trames 1 à n-1. La deuxième manière aboutit à une plus grande homogénéité du modèle mais elle a l'inconvénient de ne pas prendre en compte suffisamment bien les cas où le niveau de bruit croít ou décroít rapidement.Note in this connection that two types of comparison are possible to add a frame to n-1 previous frames which have already been considered homogeneous in energy: the first type of comparison consists in comparing only the energy of the frame n to the energy of the n-1 frame. The second type is to compare the energy of frame n at each of frames 1 to n-1. The second way leads to greater homogeneity of the model but it has the disadvantage of not not take sufficiently into account the cases where the noise level increases or decreases rapidly.

Ainsi, l'énergie de la trame de rang n est comparée avec l'énergie de la trame de rang n-1 et éventuellement d'autres trames précédentes (pas forcément toutes d'ailleurs).Thus, the energy of the frame of rank n is compared with the energy of the frame of rank n-1 and possibly of other frames previous (not necessarily all of them for that matter).

Si la comparaison indique qu'il n'y a pas homogénéité avec les trames précédentes, du fait que le rapport des énergies n'est pas compris entre 1/S et S, deux cas sont possibles :

  • ou bien n est inférieur ou égal à un nombre minimal N1 en dessous duquel le modèle ne peut pas être considéré comme significatif du bruit ambiant parce que la durée d'homogénéité est trop courte; par exemple N1 = 5; dans ce cas on abandonne le modèle en cours d'élaboration, et on réinitialise la recherche au début en remettant n à 1;
  • ou bien n est supérieur au nombre minimal N1. Dans ce cas, puisqu'on trouve maintenant un manque d'homogénéité, on considère qu'il y a peut-être un début de parole après une phase de bruit homogène, et on conserve à titre de modèle de bruit tous les échantillons des n-1 trames de bruit homogènes qui ont précédé le manque d'homogénéité. Ce modèle reste stocké jusqu'à ce qu'on trouve un modèle plus récent qui semble également représenter du bruit ambiant. La recherche est réinitialisée de toutes façons en remettant n à 1.
If the comparison indicates that there is no homogeneity with the previous frames, because the energy ratio is not between 1 / S and S, two cases are possible:
  • or n is less than or equal to a minimum number N1 below which the model cannot be considered as significant of the ambient noise because the duration of homogeneity is too short; for example N1 = 5; in this case we abandon the model being developed, and we reset the search at the beginning by giving n to 1;
  • or n is greater than the minimum number N1. In this case, since we now find a lack of homogeneity, we consider that there may be a start of speech after a homogeneous noise phase, and we keep as a noise model all the samples of the n -1 homogeneous noise frames which preceded the lack of homogeneity. This model remains stored until a newer model is found which also appears to represent ambient noise. The search is reset anyway by resetting n to 1.

Mais la comparaison de la trame n avec les précédentes aurait pu encore aboutir à la constatation d'une trame encore homogène en énergie avec la ou les précédentes. Dans ce cas, ou bien n est inférieur à un deuxième nombre N2 (par exemple N2 = 20) qui représente la longueur maximale souhaitée pour le modèle de bruit, ou bien n est devenu égal à ce nombre N2. Le nombre N2 est choisi de manière à limiter le temps de calcul dans les opérations ultérieures d'estimation de densité spectrale de bruit.But the comparison of frame n with the previous ones would have could still lead to the observation of a still homogeneous frame in energy with the previous one (s). In this case, either n is less than a second number N2 (for example N2 = 20) which represents the length desired noise model, or n has become equal to this number N2. The number N2 is chosen so as to limit the calculation time in subsequent noise spectral density estimation operations.

Si n est inférieur à N2, la trame homogène est ajoutée aux précédentes pour contribuer à construire le modèle de bruit, n est incrémenté et la trame suivante est analysée.If n is less than N2, the homogeneous frame is added to the to help build the noise model, n is incremented and the next frame is analyzed.

Si n est égal à N2, la trame est également ajoutée aux n-1 trames homogènes précédentes et le modèle de n trames homogènes est stocké pour servir dans l'élimination du bruit. La recherche d'un modèle est par ailleurs réinitialisée en remettant n à 1.If n is equal to N2, the frame is also added to the n-1 previous homogeneous frames and the model of n homogeneous frames is stored for use in noise elimination. Searching for a model is also reset by resetting n to 1.

Les étapes précédentes concernent la première recherche de modèle. Mais une fois qu'un modèle a été stocké, il peut à tout moment être remplacé par un modèle plus récent.The previous steps relate to the first search for model. But once a model has been stored, it can at any time be replaced by a more recent model.

La condition de remplacement est encore une condition d'énergie, mais cette fois elle porte sur l'énergie moyenne du modèle et non plus sur l'énergie de chaque trame.The replacement condition is still a condition of energy, but this time it relates to the average energy of the model and not more about the energy of each frame.

Par conséquent, si un modèle possible vient d'être trouvé, avec N trames où N1<N<N2, on calcule l'énergie moyenne de ce modèle qui est la somme des énergies des N trames, divisée par N, et on la compare à l'énergie moyenne des N' trames du modèle précédemment stocké.Therefore, if a possible model has just been found, with N frames where N1 <N <N2, we calculate the average energy of this model which is the sum of the energies of the N frames, divided by N, and we compare it to the average energy of the N 'frames of the previously stored model.

Si le rapport entre l'énergie moyenne du nouveau modèle possible et l'énergie moyenne du modèle actuel en vigueur est inférieur à un seuil de remplacement SR, le nouveau modèle est considéré comme meilleur et on le stocke à la place du précédent. Sinon, le nouveau modèle est rejeté et l'ancien reste en vigueur.If the ratio between the average energy of the new model possible and the average energy of the current model in use is less than one SR replacement threshold, the new model is considered better and we store it in place of the previous one. Otherwise, the new model is rejected and the old remains in force.

Le seuil SR est de préférence légèrement supérieur à 1.The threshold SR is preferably slightly greater than 1.

Si le seuil SR était inférieur ou égal à 1, on stockerait à chaque fois les trames homogènes les moins énergétiques, ce qui correspond bien au fait qu'on considère que le bruit ambiant est le niveau d'énergie au dessous duquel on ne descend jamais. Mais, on éliminerait toute possibilité d'évolution du modèle si le bruit ambiant se mettait à augmenter.If the SR threshold was less than or equal to 1, we would store at each times the least energetic homogeneous frames, which corresponds well to the fact that ambient noise is considered to be the energy level at below which we never descend. But, we would eliminate any possibility evolution of the model if the ambient noise starts to increase.

Si le seuil SR était trop élevé au dessus de 1, on risquerait de mal distinguer le bruit ambiant et d'autres bruits perturbateurs (respiration), voire même certains phonèmes qui ressemblent à du bruit (consonnes sifflantes ou chuintantes par exemple). L'élimination de bruit à partir d'un modèle de bruit calé sur la respiration ou sur des consonnes sifflantes ou chuintantes risquerait alors de nuire à l'intelligibilité du signal débruité.If the SR threshold was too high above 1, there is a risk of poorly distinguish ambient noise and other disturbing noises (breathing), or even some phonemes that sound like noise (consonants hissing or hissing for example). Noise removal from a noise pattern stalled on breath or on whistling consonants or hissing could then harm the intelligibility of the denoised signal.

Dans un exemple préféré le seuil SR est d'environ 1,5. Au dessus de ce seuil on conservera l'ancien modèle; en dessous de ce seuil on remplacera l'ancien modèle par le nouveau. Dans les deux cas, on réinitialisera la recherche en recommençant la lecture d'une première trame du signal d'entrée u(t), et en mettant n à 1.In a preferred example the threshold SR is approximately 1.5. At above this threshold we will keep the old model; below this threshold we will replace the old model with the new one. In both cases, we will reset the search by restarting the reading of a first frame of the input signal u (t), and by putting n at 1.

Pour rendre l'élaboration du modèle de bruit plus fiable, on peut prévoir que la recherche d'un modèle est inhibée si une émission de parole est détectée dans le signal utile. Les traitements numériques de signal couramment utilisés en détection de parole permettent d'identifier la présence de paroles en se fondant sur les spectres caractéristiques de périodicité de certains phonèmes, notamment les phonèmes correspondant à des voyelles ou à des consonnes voisées.To make the development of the noise model more reliable, we can provide that the search for a model is inhibited if an emission of speech is detected in the wanted signal. The digital treatments of commonly used signal in speech detection identify the presence of words based on the characteristic spectra of periodicity of certain phonemes, in particular the corresponding phonemes to vowels or voiced consonants.

Le but de cette inhibition est d'éviter que certains sons soient pris pour du bruit alors que ce sont des phonèmes utiles, qu'un modèle de bruit fondé sur ces sons soit stocké et que la suppression du bruit postérieure à l'élaboration du modèle tende alors à supprimer tous les sons similaires.The purpose of this inhibition is to prevent certain sounds from being taken for noise when these are useful phonemes, that a model of noise based on these sounds is stored and that noise suppression after the development of the model then tends to suppress all the sounds Similar.

Par ailleurs, il est souhaitable de prévoir de temps en temps une réinitialisation de la recherche du modèle pour permettre une remise à jour du modèle alors que les augmentations du bruit ambiant n'ont pas été prises en compte du fait que SR n'est pas beaucoup supérieur à 1.In addition, it is desirable to plan from time to time a reset of the model search to allow a reset model day when ambient noise increases were not taken into account that SR is not much greater than 1.

Le bruit ambiant peut en effet augmenter de façon importante et rapide, par exemple pendant la phase d'accélération des moteurs d'un avion ou d'un autre véhicule, aérien, terrestre ou maritime. Mais le seuil SR impose que le modèle de bruit précédent soit conservé lorsque l'énergie moyenne de bruit augmente trop vite. Ambient noise can indeed increase significantly and fast, for example during the acceleration phase of the engines of a plane or other vehicle, air, land or sea. But the SR threshold requires that the previous noise model be kept when the energy average noise increases too quickly.

Si on souhaite remédier à cette situation, on peut procéder de différentes manières, mais la manière la plus simple est de réinitialiser le modèle périodiquement en recherchant un nouveau modèle et en l'imposant comme modèle actif indépendamment de la comparaison entre ce modèle et le modèle précédemment stocké. La périodicité peut être basée sur la durée moyenne d'élocution dans l'application envisagée; par exemple les durées d'élocution sont en moyenne de quelques secondes pour l'équipage d'un avion, et la réinitialisation peut avoir lieu avec une périodicité de quelques secondes.If we wish to remedy this situation, we can proceed with different ways but the simplest way is to reset the model periodically by researching and imposing a new model as an active model regardless of the comparison between this model and the previously stored model. Periodicity can be based on duration average speech in the intended application; for example the durations of speech are on average a few seconds for the crew of a airplane, and the reset can take place with a periodicity of a few seconds.

Le traitement de débruitage proprement dit, effectué à partir d'un modèle de bruit stocké, peut être effectué de la manière suivante, en travaillant sur les transformées de Fourier du signal d'entrée.The proper denoising treatment, carried out from of a stored noise model, can be performed as follows, by working on the Fourier transforms of the input signal.

La transformée de Fourier du signal d'entrée est effectué trame par trame et fournit pour chaque trame P échantillons dans l'espace fréquentiel, chaque échantillon correspondant à une fréquence Fe/i avec i variant de 1 à P. Ces P échantillons seront traités de préférence dans un filtre de Wiener. Le filtre de Wiener est un filtre numérique de P coefficients correspondant chacun à une des fréquences Fe/i de l'espace fréquentiel. Chaque échantillon du signal d'entrée dans l'espace fréquentiel est multiplié par le coefficient Wi respectif du filtre. L'ensemble des P échantillons ainsi traités constitue une trame de signal débruité, dans l'espace fréquentiel. Pour les applications de reconnaissance vocale, on utilise directement ces trames débruitées dans l'espace fréquentiel. Pour des applications où on veut reconstituer un signal sonore réel débruité, on effectue successivement une transformée de Fourier inverse sur chaque trame, une conversion numérique-analogique, et un lissage.The Fourier transform of the input signal is carried out frame by frame and provides for each frame P samples in the frequency space, each sample corresponding to a frequency F e / i with i varying from 1 to P. These P samples will be processed preferably in a Wiener filter. The Wiener filter is a digital filter of P coefficients each corresponding to one of the frequencies F e / i of the frequency space. Each sample of the input signal in the frequency space is multiplied by the respective coefficient W i of the filter. The set of P samples thus processed constitutes a denoised signal frame, in the frequency space. For speech recognition applications, these denoised frames are used directly in the frequency space. For applications where we want to reconstruct a real denoised sound signal, we perform successively an inverse Fourier transform on each frame, a digital-analog conversion, and a smoothing.

Les coefficients Wi du filtre de Wiener sont calculés à partir de la densité spectrale du signal d'entrée bruité et de la densité spectrale de bruit du modèle de bruit stocké.The coefficients W i of the Wiener filter are calculated from the spectral density of the noisy input signal and the noise spectral density of the stored noise model.

La densité spectrale d'une trame du signal d'entrée est obtenue à partir de la transformée de Fourier du signal d'entrée bruité. Pour chaque fréquence, on prend le module au carré de l'échantillon fourni par la transformée de Fourier, pour obtenir une valeur DSi pour chaque fréquence Fe/i. The spectral density of a frame of the input signal is obtained from the Fourier transform of the noisy input signal. For each frequency, we take the squared module of the sample provided by the Fourier transform, to obtain a value DS i for each frequency F e / i.

Pour la densité spectrale du modèle de bruit, on calcule le module au carré des P échantillons pour chaque trame, et on moyenne sur les N trames du modèle de bruit les N modules au carré correspondant à une même fréquence Fe/i. On obtient P valeurs de densité de bruit DBi.For the spectral density of the noise model, the module squared of the P samples is calculated for each frame, and the N squared modules corresponding to the same frequency F e / i are averaged over the N frames of the noise model. P noise density values DB i are obtained.

Le coefficient de Wiener Wi pour la fréquence Fe/i est alors W1 = 1 - DBi/DSi.The Wiener coefficient W i for the frequency F e / i is then W 1 = 1 - DB i / DS i .

L'échantillon de rang i de la transformée de Fourier d'une trame de signal d'entrée est multiplié par Wi et la succession des P échantillons ainsi multipliés par P coefficients de Wiener constitue la trame d'entrée débruitée.The sample of rank i of the Fourier transform of an input signal frame is multiplied by W i and the succession of the P samples thus multiplied by P Wiener coefficients constitutes the denoised input frame.

La mise en oeuvre du procédé selon l'invention peut se faire à partir de calculateurs non spécialisés, pourvus des programmes de calcul nécessaires et recevant les échantillons de signaux numérisés tels qu'ils sont fournis par un convertisseur analogique-numérique.The implementation of the method according to the invention can be done at from non-specialized computers, provided with calculation programs required and receiving the digital signal samples as they are supplied by an analog-to-digital converter.

Cette mise en oeuvre peut aussi se faire à partir d'un calculateur spécialisé à base de processeurs de signaux numériques, ce qui permet de traiter plus rapidement un plus grand nombre de signaux numériques.This implementation can also be done from a specialized computer based on digital signal processors, which allows more signals to be processed more quickly digital.

La figure 4 représente un exemple d'architecture générale d'un calculateur spécialisé recevant le signal sonore à débruiter et fournissant en temps réel un signal sonore débruité.FIG. 4 represents an example of general architecture of a specialized computer receiving the sound signal to denois and providing real time an audible noise signal.

Le calculateur comprend deux processeurs de signaux numériques DSP1 et DSP2 et des mémoires de travail associées à ces processeurs.The computer includes two signal processors digital DSP1 and DSP2 and working memories associated with these processors.

Les signaux sonores bruités passent dans un convertisseur analogique-numérique CA/N et sont stockés en parallèle dans deux mémoires tampons FIFO1 et FIFO2 (du type "first-in, first-out", c'est-à-dire premier entré premier sorti). L'une des mémoires est reliée au processeur DSP1, l'autre au processeur DSP2.Noise signals are passed through a converter analog-digital CA / D and are stored in parallel in two FIFO1 and FIFO2 buffers (of the "first-in, first-out" type, i.e. first in first out). One of the memories is connected to the processor DSP1, the other to the DSP2 processor.

Le processeur DSP1 est le processeur maítre et il est dédié plutôt à la recherche d'un modèle de bruit. Il est donc programmé pour exécuter au moins les opérations suivantes : calcul d'énergie de trames, calculs de moyennes d'énergie, comparaison avec des seuils, comparaison de rang de trame avec N1 et N2, etc. Il calcule également des densités spectrales d'énergie du modèle de bruit. Ce processeur DSP1 est couplé à une mémoire de travail dynamique DRAM1 dans laquelle on stocke l'échantillon de trame courante pendant un calcul, l'énergie d'une trame courante, l'énergie de la ou des trames précédentes, les échantillons de transformée de Fourier du modèle de bruit. Il est couplé également à une mémoire de travail statique dans laquelle sont stockées les tables servant au calcul de transformées de Fourier, et les seuils de comparaison S et SR.The DSP1 processor is the master processor and it is dedicated rather looking for a noise model. It is therefore programmed to execute at least the following operations: frame energy calculation, energy averaging, comparison with thresholds, comparison frame rank with N1 and N2, etc. It also calculates densities energy spectral of the noise model. This DSP1 processor is coupled to a dynamic working memory DRAM1 in which we store the current frame sample during a calculation, the energy of a frame current, the energy of the previous frame (s), the samples of Fourier transform of the noise model. It is also coupled with a static working memory in which the tables used are stored the computation of Fourier transforms, and the comparison thresholds S and SR.

Le processeur DSP2 est dédié plutôt au calcul de transformées de Fourier du signal à débruiter, au calcul de densité spectrale de ce signal, au calcul des coefficients de Wiener, au filtrage de Wiener, et à la transformée de Fourier inverse si cette dernière doit être effectuée. Le processeur DSP2 est couplé à une mémoire de travail dynamique DRAM2 et une mémoire de travail statique SRAM2. La mémoire DRAM2 stocke des échantillons de trame courante, des résultats de calcul de transformée de Fourier, des résultats de calcul de densité spectrale d'énergie du signal, les coefficients de Wiener calculés, etc... La mémoire SRAM2 stocke notamment des tables servant au calcul de transformées de Fourier.The DSP2 processor is dedicated rather to the calculation of transforms Fourier signal to denois, calculating the spectral density of this signal, calculating Wiener coefficients, Wiener filtering, and inverse Fourier transform if the latter is to be performed. The DSP2 processor is coupled to a dynamic working memory DRAM2 and a static working memory SRAM2. DRAM2 memory stores current frame samples, transform calculation results from Fourier, results of calculation of spectral energy density of the signal, the calculated Wiener coefficients, etc. The SRAM2 memory stores in particular tables used for the computation of Fourier transforms.

Les échantillons de signal sonore débruités calculés par le processeur DSP2 sont transmis, à travers une mémoire tampon circulante FIFO3, à un convertisseur numérique analogique CNIA, et à un circuit de lissage qui reconstitue sous forme analogique le signal sonore débruité.The denoised sound signal samples calculated by the DSP2 processor are transmitted, through a circulating buffer FIFO3, to a digital analog converter CNIA, and to a circuit of smoothing which reconstructs the denoised sound signal in analog form.

Claims (8)

  1. Process for automatically searching for noise models in noisy audio input signals, comprising the digitizing of the input signals, and the processing of these signals on the basis of a model found, in which process the input signals are chopped into successive frames of P samples each, and a repetitive search for a noise model is performed continuously in the input signals themselves, by searching for N successive frames having the expected characteristics of a noise, by storing the N×P corresponding samples so as to construct a noise model useful in the denoising processing of the input signals and by iteratively repeating the search so as to find a new noise model and store the new model as replacement for the previous one or retain the previous model according to the respective characteristics of the two models, characterized in that the search for a noise model comprises the search for N successive frames whose energies are close to one another, N lying between a minimum value N1 and a maximum value N2, the calculation of the average energy of the N successive frames found, and the storing of the N×P samples in the guise of new active model if the ratio between this average energy and the average energy of the frames of the active model previously stored is less than a determined replacement threshold.
  2. Process according to Claim 1, characterized in that the search for N successive frames then comprises at least the following iterative steps: calculation of the energy of a current frame of rank n able to be appended to a model undergoing formulation already comprising n-1 successive frames; calculation of the ratio between this energy and the energy of the previous frame of rank n-1; comparison of this ratio with a low threshold less than 1 and a high threshold greater than 1; and decision regarding the possibility of incorporating the frame of rank n into the model undergoing formulation as a function of the result of the comparison.
  3. Process according to Claim 2, characterized in that the search for N successive frames also comprises the calculation of the ratio between the energy of the current frame and the energy of one or more other previous frames, the comparison with the thresholds, the frame being incorporated into the model undergoing formulation as a function of the result of the comparison.
  4. Process according to one of Claims 2 and 3, characterized in that in the case where the frame of rank n is incorporated into the model, n is incremented by one unit so as to continue the formulation of the model if n is less than N2, and, in the contrary case, the formulation of the model is halted, the average energy of the n frames is calculated, the ratio between this energy and the average energy of the frames of the previously stored model is calculated, the previous model is retained or is replaced by the model undergoing formulation according to the value of the ratio, and the iterative search for a new model is restarted.
  5. Process according to one of Claims 2 and 3, characterized in that in the case where the current frame of rank n is not incorporated into the model undergoing formulation,
    the formulation of the model of n-1 frames is halted;
    if n is greater than N1, the ratio between the average energy of the frames of the model undergoing formulation and the average energy of the frames of the previously stored model is calculated, and the previous model is. retained or is replaced by the new model according to the value of the ratio,
    and an iterative search for a new model is restarted.
  6. Process according to one of the preceding claims, characterized in that a search is made for the presence of speech in the input signal, and the search for a new model is disabled if the presence of speech is detected.
  7. Process according to one of the preceding claims, characterized in that the search is periodically reinitialized by imposing the new model regardless of the respective characteristics of the new model and of the previous model.
  8. Process according to one of the preceding claims, characterized in that the noisy input signals are processed on the basis of a found noise model, by spectral filtering, with a view to eliminating as far as possible the noise corresponding to the model.
EP98935094A 1997-07-04 1998-07-03 Method for searching a noise model in noisy sound signals Expired - Lifetime EP0993671B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FR9708509 1997-07-04
FR9708509A FR2765715B1 (en) 1997-07-04 1997-07-04 METHOD FOR SEARCHING FOR A NOISE MODEL IN NOISE SOUND SIGNALS
PCT/FR1998/001428 WO1999001862A1 (en) 1997-07-04 1998-07-03 Method for searching a noise model in noisy sound signals

Publications (2)

Publication Number Publication Date
EP0993671A1 EP0993671A1 (en) 2000-04-19
EP0993671B1 true EP0993671B1 (en) 2002-06-12

Family

ID=9508879

Family Applications (1)

Application Number Title Priority Date Filing Date
EP98935094A Expired - Lifetime EP0993671B1 (en) 1997-07-04 1998-07-03 Method for searching a noise model in noisy sound signals

Country Status (6)

Country Link
US (1) US6438513B1 (en)
EP (1) EP0993671B1 (en)
JP (1) JP4338226B2 (en)
DE (1) DE69806006T2 (en)
FR (1) FR2765715B1 (en)
WO (1) WO1999001862A1 (en)

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6633842B1 (en) * 1999-10-22 2003-10-14 Texas Instruments Incorporated Speech recognition front-end feature extraction for noisy speech
EP1104925A1 (en) * 1999-12-03 2001-06-06 Siemens Aktiengesellschaft Method for processing speech signals by substracting a noise function
EP1152399A1 (en) * 2000-05-04 2001-11-07 Faculte Polytechniquede Mons Subband speech processing with neural networks
FR2808917B1 (en) * 2000-05-09 2003-12-12 Thomson Csf METHOD AND DEVICE FOR VOICE RECOGNITION IN FLUATING NOISE LEVEL ENVIRONMENTS
US20020026253A1 (en) * 2000-06-02 2002-02-28 Rajan Jebu Jacob Speech processing apparatus
US7035790B2 (en) * 2000-06-02 2006-04-25 Canon Kabushiki Kaisha Speech processing system
US7072833B2 (en) * 2000-06-02 2006-07-04 Canon Kabushiki Kaisha Speech processing system
US7010483B2 (en) * 2000-06-02 2006-03-07 Canon Kabushiki Kaisha Speech processing system
US6954745B2 (en) * 2000-06-02 2005-10-11 Canon Kabushiki Kaisha Signal processing system
EP1170728A1 (en) * 2000-07-05 2002-01-09 Alcatel System for adaptively reducing noise in speech signals
US7062442B2 (en) * 2001-02-23 2006-06-13 Popcatcher Ab Method and arrangement for search and recording of media signals
DE60215357T2 (en) * 2001-02-23 2007-08-23 Popcatcher Ab Method for receiving a media signal
GB2380644A (en) * 2001-06-07 2003-04-09 Canon Kk Speech detection
FR2842064B1 (en) * 2002-07-02 2004-12-03 Thales Sa SYSTEM FOR SPATIALIZING SOUND SOURCES WITH IMPROVED PERFORMANCE
SE524162C2 (en) * 2002-08-23 2004-07-06 Rickard Berg Procedure for processing signals
KR100709848B1 (en) * 2003-06-05 2007-04-23 마츠시타 덴끼 산교 가부시키가이샤 Sound quality adjusting apparatus and sound quality adjusting method
EP1494040A1 (en) * 2003-06-30 2005-01-05 Sulzer Markets and Technology AG Method for compensation of quantisation noise and usage of the method
US8718298B2 (en) * 2003-12-19 2014-05-06 Lear Corporation NVH dependent parallel compression processing for automotive audio systems
EP1732063A4 (en) * 2004-03-31 2007-07-04 Pioneer Corp Speech recognition device and speech recognition method
US7139701B2 (en) * 2004-06-30 2006-11-21 Motorola, Inc. Method for detecting and attenuating inhalation noise in a communication system
KR101168002B1 (en) * 2004-09-16 2012-07-26 프랑스 텔레콤 Method of processing a noisy sound signal and device for implementing said method
JP5724361B2 (en) * 2010-12-17 2015-05-27 富士通株式会社 Speech recognition apparatus, speech recognition method, and speech recognition program
CN108364657B (en) 2013-07-16 2020-10-30 超清编解码有限公司 Method and decoder for processing lost frame
US9633669B2 (en) * 2013-09-03 2017-04-25 Amazon Technologies, Inc. Smart circular audio buffer
DE102013111784B4 (en) * 2013-10-25 2019-11-14 Intel IP Corporation AUDIOVERING DEVICES AND AUDIO PROCESSING METHODS
CN106683681B (en) 2014-06-25 2020-09-25 华为技术有限公司 Method and device for processing lost frame
US10522166B2 (en) * 2015-01-20 2019-12-31 Dolby Laboratories Licensing Corporation Modeling and reduction of drone propulsion system noise
CN105991900B (en) * 2015-02-05 2019-08-09 扬智科技股份有限公司 Noise detecting method and denoising method
CN106067847B (en) * 2016-05-25 2019-10-22 腾讯科技(深圳)有限公司 A kind of voice data transmission method and device
CN109087659A (en) * 2018-08-03 2018-12-25 三星电子(中国)研发中心 Audio optimization method and apparatus

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4630304A (en) * 1985-07-01 1986-12-16 Motorola, Inc. Automatic background noise estimator for a noise suppression system
US5029118A (en) * 1985-12-04 1991-07-02 Nissan Motor Co. Ltd. Periodic noise canceling system and method
FR2677828B1 (en) 1991-06-14 1993-08-20 Sextant Avionique METHOD FOR DETECTION OF A NOISE USEFUL SIGNAL.
FR2697101B1 (en) 1992-10-21 1994-11-25 Sextant Avionique Speech detection method.
FR2704111B1 (en) 1993-04-16 1995-05-24 Sextant Avionique Method for energetic detection of signals embedded in noise.
US5521851A (en) * 1993-04-26 1996-05-28 Nihon Kohden Corporation Noise reduction method and apparatus
JP3626492B2 (en) * 1993-07-07 2005-03-09 ポリコム・インコーポレイテッド Reduce background noise to improve conversation quality
JPH07193548A (en) * 1993-12-25 1995-07-28 Sony Corp Noise reduction processing method
JP3453898B2 (en) * 1995-02-17 2003-10-06 ソニー株式会社 Method and apparatus for reducing noise of audio signal
JP2685031B2 (en) * 1995-06-30 1997-12-03 日本電気株式会社 Noise cancellation method and noise cancellation device
US5659622A (en) * 1995-11-13 1997-08-19 Motorola, Inc. Method and apparatus for suppressing noise in a communication system
FR2744871B1 (en) 1996-02-13 1998-03-06 Sextant Avionique SOUND SPATIALIZATION SYSTEM, AND PERSONALIZATION METHOD FOR IMPLEMENTING SAME
US5937381A (en) * 1996-04-10 1999-08-10 Itt Defense, Inc. System for voice verification of telephone transactions
US6144937A (en) * 1997-07-23 2000-11-07 Texas Instruments Incorporated Noise suppression of speech by signal processing including applying a transform to time domain input sequences of digital signals representing audio information
TW333610B (en) * 1997-10-16 1998-06-11 Winbond Electronics Corp The phonetic detecting apparatus and its detecting method
US6216103B1 (en) * 1997-10-20 2001-04-10 Sony Corporation Method for implementing a speech recognition system to determine speech endpoints during conditions with background noise
US6182018B1 (en) * 1998-08-25 2001-01-30 Ford Global Technologies, Inc. Method and apparatus for identifying sound in a composite sound signal
US6188981B1 (en) * 1998-09-18 2001-02-13 Conexant Systems, Inc. Method and apparatus for detecting voice activity in a speech signal
US6108610A (en) * 1998-10-13 2000-08-22 Noise Cancellation Technologies, Inc. Method and system for updating noise estimates during pauses in an information signal
US6289309B1 (en) * 1998-12-16 2001-09-11 Sarnoff Corporation Noise spectrum tracking for speech enhancement

Also Published As

Publication number Publication date
US6438513B1 (en) 2002-08-20
FR2765715B1 (en) 1999-09-17
FR2765715A1 (en) 1999-01-08
EP0993671A1 (en) 2000-04-19
WO1999001862A1 (en) 1999-01-14
JP4338226B2 (en) 2009-10-07
JP2002513479A (en) 2002-05-08
DE69806006D1 (en) 2002-07-18
DE69806006T2 (en) 2002-12-19

Similar Documents

Publication Publication Date Title
EP0993671B1 (en) Method for searching a noise model in noisy sound signals
EP0918317B1 (en) Frequency filtering method using a Wiener filter applied to noise reduction of audio signals
EP1789956B1 (en) Method of processing a noisy sound signal and device for implementing said method
EP0594480B1 (en) Speech detection method
EP1154405B1 (en) Method and device for speech recognition in surroundings with varying noise levels
EP2057835B1 (en) Method of reducing the residual acoustic echo after echo removal in a hands-free device
EP1830349B1 (en) Method of noise reduction of an audio signal
EP2772916B1 (en) Method for suppressing noise in an audio signal by an algorithm with variable spectral gain with dynamically adaptive strength
WO2002061731A1 (en) Noise reduction method and device
FR2943875A1 (en) METHOD AND DEVICE FOR CLASSIFYING BACKGROUND NOISE CONTAINED IN AN AUDIO SIGNAL.
WO1999005831A1 (en) Method and device for blind equalizing of transmission channel effects on a digital speech signal
WO2003048711A2 (en) Speech detection system in an audio signal in noisy surrounding
EP1131813B1 (en) Speech recognition method in a noisy acoustic signal and implementing system
CA2404441C (en) Robust parameters for noisy speech recognition
EP0534837B1 (en) Speech processing method in presence of acoustic noise using non-linear spectral subtraction and hidden Markov models
EP3627510A1 (en) Filtering of an audio signal acquired by a voice recognition system
EP1016073A1 (en) Method for suppressing noise in a digital speech signal
EP2515300B1 (en) Method and system for noise reduction
EP1021805B1 (en) Method and apparatus for conditioning a digital speech signal
WO1999027523A1 (en) Method for reconstructing sound signals after noise abatement

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20000105

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): DE FR GB NL

17Q First examination report despatched

Effective date: 20000921

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: THALES AVIONICS S.A.

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

RIC1 Information provided on ipc code assigned before grant

Free format text: 7G 10L 21/02 A

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB NL

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REF Corresponds to:

Ref document number: 69806006

Country of ref document: DE

Date of ref document: 20020718

GBT Gb: translation of ep patent filed (gb section 77(6)(a)/1977)

Effective date: 20020813

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20030313

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20090705

Year of fee payment: 12

Ref country code: GB

Payment date: 20090701

Year of fee payment: 12

Ref country code: DE

Payment date: 20090626

Year of fee payment: 12

REG Reference to a national code

Ref country code: NL

Ref legal event code: V1

Effective date: 20110201

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20100703

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110201

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 69806006

Country of ref document: DE

Effective date: 20110201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100703

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20160628

Year of fee payment: 19

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20180330

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170731