EP2293594B1 - Verfahren zur Filterung von seitlichem nichtstationärem Rauschen für ein Multimikrofon-Audiogerät - Google Patents
Verfahren zur Filterung von seitlichem nichtstationärem Rauschen für ein Multimikrofon-Audiogerät Download PDFInfo
- Publication number
- EP2293594B1 EP2293594B1 EP10166119A EP10166119A EP2293594B1 EP 2293594 B1 EP2293594 B1 EP 2293594B1 EP 10166119 A EP10166119 A EP 10166119A EP 10166119 A EP10166119 A EP 10166119A EP 2293594 B1 EP2293594 B1 EP 2293594B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- noise
- transients
- probability
- speech
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02087—Noise filtering the noise being separate speech, e.g. cocktail party
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
- H04R2201/10—Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups
- H04R2201/107—Monophonic and stereophonic headphones with microphone for two-way hands free communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/03—Synergistic effects of band splitting and sub-band processing
Definitions
- the invention relates to the treatment of speech in a noisy environment.
- microphone microphone
- noise that is a disruptive element that can go, in some cases, to make incomprehensible the speaker's words. It is the same if one wants to implement speech recognition techniques, because it is very difficult to perform a form recognition on words embedded in a high noise level.
- Some of these devices provide for the use of several microphones, usually two microphones, and use the average of the signals picked up, or other more complex operations, to obtain a signal with a lower level of interference.
- a so-called beamforming technique makes it possible to create, by software means, a directivity that improves the signal-to-noise ratio, but the performances of this technique are very limited when only two microphones are used.
- conventional techniques are especially adapted to the filtering of diffuse noise, stationary, coming from the surroundings of the device and found at comparable levels in the signals picked up by the two microphones.
- One of the aims of the invention is to take advantage of the multi-microphone structure of the device to operate a spatial detection of these nonstationary noises, then to discriminate, among all the nonstationary components (hereinafter "transients") those which are nonstationary noise components from those which are speech components, and finally to process the captured signal to effectively denoise it while minimizing the distortions introduced by this processing.
- transients those which are nonstationary noise components from those which are speech components
- lateral noise a directional non-stationary noise whose direction of arrival is far from that of the useful signal
- privileged cone the direction or angular sector of the space where the source is located of useful signal (the speech of the speaker) compared to the network of microphones.
- the starting point of the invention consists in associating the properties of temporal and frequency non-stationarity, on the one hand, and spatial directivity, on the other hand, to detect a type of noise that is usually difficult. to discriminate from the speech, then to deduce a probability of presence of the speech which will serve to attenuate this noise.
- the invention relates to a method of denoising a noisy acoustic signal picked up by a plurality of microphones of a multi-microphone audio device operating in a noisy environment.
- the noisy acoustic signal includes a speech component derived from a directional speech source and a noise noise component, said noise component itself including a directional non-stationary side noise component.
- the Figure 1 is a block diagram showing the different modules and functions implemented by the method of the invention as well as their interactions.
- the method of the invention is implemented by software means, which can be broken down and schematized by a number of modules 10 to 24 illustrated Figure 1 .
- the signal which one wishes to denoise comes from a plurality of signals picked up by a network of microphones (which, in the minimum configuration, can be simply a network of two microphones) arranged in a predetermined configuration.
- the microphone array captures the signal transmitted by the useful signal source (speech signal), and the difference in position between the microphones induces a set of phase shifts and amplitude variations in the recording of the signals emitted by the signal source. useful.
- n is the amplitude attenuation due to the energy loss between the position of the sound source s and the microphone
- ⁇ n is the phase shift between the signal transmitted and received by the microphone
- v n represents the value of the diffuse noise field at the microphone position.
- the delays ⁇ n can then be calculated from the angle ⁇ s , defined as the angle between the mediators of the pairs of microphones (n, m) and the reference direction corresponding to the source s of useful signal.
- the angle ⁇ s is zero.
- the signal in the time domain x n (t) coming from each of the N micros is digitized, cut into frames of T time points, temporally windowed by a Hanning type window, then the fast Fourier transform FFT (short-term transform) X n ( k, l ) is calculated for each of these signals:
- X not k l at not .
- d not k e - i ⁇ 2 ⁇ ⁇ ⁇ f k ⁇ ⁇ not 1 being the index of the time frame, k being the index of the frequency band, and f k being the center frequency of the frequency band indexed by k.
- the signals X n ( k, l ) can be combined with each other by a simple beamforming pre- filtering technique of the Delay and Sum type which is applied to obtain a partially denoised combined signal X ( k, I ):
- X k l 1 NOT ⁇ not ⁇ 1 NOT d not k ⁇ .
- X not k l 1 NOT ⁇ not ⁇ 1 NOT d not k ⁇ .
- this treatment provides only a slight improvement in the signal / noise ratio, of the order of 1 dB only.
- the angle ⁇ s is zero and it is a simple average that is made on both microphones.
- the purpose of this step is to calculate an estimate of the pseudo-stationary noise component V ( k, l ) present on the signal X ( k, l ).
- V ( k, l ) V ( k, l )
- MCRA pseudo-stationary minimum recursive averaging noise component
- Transients refers to all non-stationary signals, including both useful speech and sporadic non-stationary noises, which may have energy equivalent to or sometimes greater than useful speech (passing a vehicle, siren, horn, other people's words etc.).
- the processing performed by the block 16 consists only in calculating a probability p Trausient ( k, l ) of presence of transient signals, without distinction between useful speech and non-stationary noise noises.
- the algorithm is as follows:
- TSR min and TSR max are chosen so as to correspond to typical situations, close to reality.
- This calculation takes advantage of the fact that, unlike the pseudo-stationary component of the noise that is diffuse, the transients are often directional, that is to say from a point sound source (such as the mouth of the speaker for useful speech, or the engine of a motorcycle for a lateral noise). It is therefore advisable to calculate the direction of arrival of these signals, which will be generally well defined, and to compare this direction of arrival at the angle ⁇ s corresponding to the direction of origin (useful speech), so as to determine whether the non-stationary signal considered is useful or parasitic, and thus to discriminate between useful speech and non-stationary noise.
- the first step is to estimate the direction of arrival of the transient.
- the method used here is based on the use of the probability of transient ( k, 1 ) transient p- transients determined by block 18 as discussed above.
- Each angle ⁇ i is tested to determine the one that is closest to the direction of arrival of the non-stationary signal studied. To do this, we consider each pair of microphones ( n, m ) and we calculate an estimator corresponding direction of arrival P n, m ( ⁇ i , k , l ), whose module will be maximum when the angle ⁇ i tested is closest to the direction of arrival of the transient.
- Another method used here in a preferential way, consists in weighting the estimator P n, m ( ⁇ i , k, l ) by the probability of presence of transients p Transient ( k, l ) , and defining a new decision strategy.
- the estimate of angle ⁇ max is not made on each frequency band, but on each packet K j of frequency bands.
- the following step which is characteristic of the method of the invention, consists in calculating a probability of presence of speech based on the arrival direction estimation ⁇ ( k, l ) obtained in the manner indicated above.
- the probability p spa ( k, l ) can be calculated in different ways, giving a binary value or multiple values. Two examples of calculation p spa ( k, l ) are given below , given that other laws can be used to express p spa ( k, l ) from ⁇ ( k, l ) .
- the probability p spa ( k, l ) of the presence of speech calculated in block 20, itself dependent on the probability p Transient ( k, l ) of the presence of transients computed at block 16, will be used as input parameter in a classic technique of denoising.
- LSA Log-Spectral Amplitude
- the "OM-LSA” Optimally-Modified Log-Spectral Amplitude ) algorithm improves the calculation of the LSA gain to be applied by weighting it by the conditional probability of presence of speech.
- the probability of presence of speech occurs at two important moments, for the estimation of the noise energy and for the calculation of the final gain, and the probability p spa ( k, l ) will be used at these two levels. .
- the probability p spa ( k, l ) modulates the forgetting factor in the noise estimate, which is updated more rapidly on the noisy signal X ( k, l ) when the probability of speech is weak, this mechanism completely conditioning the quality of ⁇ Noise ( k, l ) .
- G H 1 ( k, l ) being a denoising gain (whose calculation depends on the noise estimate ⁇ Noise ) described in the aforementioned article by Cohen, and G min being a constant corresponding to the denoising applied when speech is considered absent.
- the probability p spa ( k, l ) plays a large role in the determination of G OM-LSA gain (k, l).
- the gain is equal to G min and a maximum noise reduction is applied: if, for example, a value of 20 dB is chosen for G min , the non-stationary noises previously detected are attenuated by 20 dB.
- This hybrid probability makes it possible to benefit from the identification of non-stationary noise associated with small values of p spa ( k, l ) , and to complete the estimation of the probability p hybrid ( k, l ) on parts ( k, l ).
- the direction of arrival estimate ⁇ ( k, l ) has not been defined (producing a probability p spa ( k, l ) forced to the value 1 for safety).
- the hybrid p hybrid probability ( k, l ) thus integrates both the non-stationary noises detected by p spa ( k, l ) and the other noises (for example pseudo-stationary) detected by p ( k, l ) .
- the last step consists in applying to the signal ⁇ ( k, l ) a fast inverse Fourier transform iFFT to obtain in the time domain the denoised speech signal ⁇ ( t ) .
Claims (10)
- Verfahren zum Entfernen des Rauschens aus einem verrauschten akustischen Signal, das von mehreren Mikrophonen einer Mehrfachmikrophon-Audiovorrichtung aufgenommen wird, die in einem verrauschten Milieu arbeitet, insbesondere eine "Freisprech"-Telephonvorrichtung für Kraftfahrzeuge,
wobei das verrauschte akustische Signal eine nutzbare Sprachkomponente, die von einer gerichteten Sprachquelle ausgeht, und eine parasitäre Rauschkomponente umfasst, wobei diese Rauschkomponente ihrerseits eine gerichtete, nicht stationäre Lateralrauschkomponente enthält,
wobei das Verfahren dadurch gekennzeichnet ist, dass es im Frequenzbereich für mehrere Frequenzbänder, die für aufeinander folgende Zeitrahmen des Signals definiert sind, die folgenden Signalverarbeitungsschritte umfasst:a) Kombinieren (12) der mehreren Signale, die von der entsprechenden Mehrzahl von Mikrophonen aufgenommen werden, zu einem verrauschten kombinierten Signal (X(k, l));b) anhand des verrauschten kombinierten Signals Schätzen (14) einer pseudostationären Rauschkomponente (V̂(k, l)), die in diesem verrauschten kombinierten Signal enthalten ist;c) anhand der im Schritt b) geschätzten pseudostationären Rauschkomponente und des verrauschten kombinierten Signals Berechnen (16) einer Wahrscheinlichkeit (pTransient (k, l)) für das Vorhandensein von Übergängen in dem verrauschten kombinierten Signal;d) anhand der mehreren Signale, die von der entsprechenden Mehrzahl von Mikrophonen aufgenommen werden, und der Wahrscheinlichkeit für das Vorhandensein von Übergängen, die im Schritt c) berechnet wird, Schätzen (18) einer Hauptankunftsrichtung (θ́(k, l)) der Übergänge;e) anhand der Hauptankunftsrichtung der Übergänge, die im Schritt d) geschätzt wird, Berechnen (20) einer Wahrscheinlichkeit (pspa(k, l)) für das Vorhandensein von Sprache anhand eines räumlichen Kriteriums, die die Unterscheidung zwischen nutzbarer Sprache und lateralem Rauschen unter den Übergängen ermöglicht;f) anhand der Wahrscheinlichkeit für das Vorhandensein von Sprache, die im Schritt e) berechnet wird, und des verrauschten kombinierten Signals selektives Reduzieren (22) des Rauschens durch Anwenden einer variablen Verstärkung, die jedem Frequenzband und jedem zeitlichen Rahmen eigentümlich ist. - Verfahren nach Anspruch 1, wobei die Verarbeitung des Schrittes a) eine Vorfilterungsverarbeitung des Typs Fixed Beamforming ist.
- Verfahren nach Anspruch 1, wobei die Verarbeitung im Schritt d) die folgenden aufeinander folgenden Unterschritte umfasst:d1) Aufteilen des Raums in mehrere Winkelsektoren;d2) für jeden Sektor Bewerten einer Schätzung der Ankunftsrichtung anhand der mehreren Signale, die durch die entsprechende Mehrzahl von Mikrophonen aufgenommen werden;d3) Gewichten jeder Schätzung mit der Wahrscheinlichkeit für das Vorhandensein von Übergängen, die im Schritt c) berechnet wird;d4) anhand der gewichteten Schätzungswerte, die im Schritt d3) berechnet werden, Schätzen einer Hauptankunftsrichtung der Übergänge;d5) Erklären der Schätzung der Hauptankunftsrichtung der Übergänge, die im Schritt d4) ausgeführt wird, für gültig oder ungültig.
- Verfahren nach Anspruch 3, wobei im Schritt d5) die Schätzung nur für gültig erklärt wird, falls der Wert der gewichteten Schätzung, der der geschätzten Richtung entspricht, größer als ein vorgegebener Schwellenwert ist.
- Verfahren nach Anspruch 3, wobei im Schritt d5) die Schätzung nur für gültig erklärt wird, wenn kein lokales Maximum der gewichteten Schätzung in dem Ausgangswinkelsektor des Sprach-Nutzsignals vorhanden ist.
- Verfahren nach Anspruch 3, wobei im Schritt d5) die Schätzung nur für gültig erklärt wird, falls der Wert der Schätzung über mehrere aufeinander folgende zeitliche Rahmen monoton zunimmt.
- Verfahren nach Anspruch 3, das außerdem einen Schritt des Haltens der Schätzung der Hauptankunftsrichtung während einer vorgegebenen minimalen Zeitdauer umfasst.
- Verfahren nach Anspruch 1, wobei die Wahrscheinlichkeit für das Vorhandensein von Sprache, die im Schritt e) berechnet wird, eine binäre Wahrscheinlichkeit ist, die einen Wert 1 oder 0 annimmt, je nachdem, ob die Hauptankunftsrichtung der Übergänge, die im Schritt d) geschätzt wird, in dem Ausgangswinkelsektor des Sprach-Nutzsignals vorhanden ist oder nicht.
- Verfahren nach Anspruch 1, wobei die Wahrscheinlichkeit für das Vorhandensein von Sprache, die im Schritt e) berechnet wird, eine Wahrscheinlichkeit mit mehreren Werten ist, die vom Winkelabstand zwischen der Hauptankunftsrichtung der Übergänge, die im Schritt d) geschätzt wird, und der Ausgangsrichtung des Nutz-Sprachsignals abhängt.
- Verfahren nach Anspruch 1, wobei die Verarbeitung des Schrittes f) eine Verarbeitung der selektiven Verringerung des Rauschens durch Anwenden einer Verstärkung mit optimierter, modifizierter logarithmischer Spektralamplitude (OM-LSA) ist.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0955133A FR2948484B1 (fr) | 2009-07-23 | 2009-07-23 | Procede de filtrage des bruits lateraux non-stationnaires pour un dispositif audio multi-microphone, notamment un dispositif telephonique "mains libres" pour vehicule automobile |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2293594A1 EP2293594A1 (de) | 2011-03-09 |
EP2293594B1 true EP2293594B1 (de) | 2011-11-02 |
Family
ID=41683233
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10166119A Active EP2293594B1 (de) | 2009-07-23 | 2010-06-16 | Verfahren zur Filterung von seitlichem nichtstationärem Rauschen für ein Multimikrofon-Audiogerät |
Country Status (5)
Country | Link |
---|---|
US (1) | US8370140B2 (de) |
EP (1) | EP2293594B1 (de) |
AT (1) | ATE532345T1 (de) |
ES (1) | ES2377056T3 (de) |
FR (1) | FR2948484B1 (de) |
Families Citing this family (43)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2948484B1 (fr) * | 2009-07-23 | 2011-07-29 | Parrot | Procede de filtrage des bruits lateraux non-stationnaires pour un dispositif audio multi-microphone, notamment un dispositif telephonique "mains libres" pour vehicule automobile |
TWI459828B (zh) * | 2010-03-08 | 2014-11-01 | Dolby Lab Licensing Corp | 在多頻道音訊中決定語音相關頻道的音量降低比例的方法及系統 |
WO2012105385A1 (ja) * | 2011-02-01 | 2012-08-09 | 日本電気株式会社 | 有音区間分類装置、有音区間分類方法、及び有音区間分類プログラム |
US9626982B2 (en) * | 2011-02-15 | 2017-04-18 | Voiceage Corporation | Device and method for quantizing the gains of the adaptive and fixed contributions of the excitation in a CELP codec |
GB2491173A (en) * | 2011-05-26 | 2012-11-28 | Skype | Setting gain applied to an audio signal based on direction of arrival (DOA) information |
FR2976710B1 (fr) | 2011-06-20 | 2013-07-05 | Parrot | Procede de debruitage pour equipement audio multi-microphones, notamment pour un systeme de telephonie "mains libres" |
GB2493327B (en) | 2011-07-05 | 2018-06-06 | Skype | Processing audio signals |
GB2495128B (en) | 2011-09-30 | 2018-04-04 | Skype | Processing signals |
GB2495130B (en) | 2011-09-30 | 2018-10-24 | Skype | Processing audio signals |
GB2495131A (en) | 2011-09-30 | 2013-04-03 | Skype | A mobile device includes a received-signal beamformer that adapts to motion of the mobile device |
GB2495278A (en) | 2011-09-30 | 2013-04-10 | Skype | Processing received signals from a range of receiving angles to reduce interference |
GB2495129B (en) | 2011-09-30 | 2017-07-19 | Skype | Processing signals |
GB2495472B (en) | 2011-09-30 | 2019-07-03 | Skype | Processing audio signals |
GB2496660B (en) | 2011-11-18 | 2014-06-04 | Skype | Processing audio signals |
GB201120392D0 (en) | 2011-11-25 | 2012-01-11 | Skype Ltd | Processing signals |
GB2497343B (en) | 2011-12-08 | 2014-11-26 | Skype | Processing audio signals |
US9360546B2 (en) | 2012-04-13 | 2016-06-07 | Qualcomm Incorporated | Systems, methods, and apparatus for indicating direction of arrival |
US8676579B2 (en) * | 2012-04-30 | 2014-03-18 | Blackberry Limited | Dual microphone voice authentication for mobile device |
JP6114915B2 (ja) * | 2013-03-25 | 2017-04-19 | パナソニックIpマネジメント株式会社 | 音声入力選択装置及び音声入力選択方法 |
US9449610B2 (en) * | 2013-11-07 | 2016-09-20 | Continental Automotive Systems, Inc. | Speech probability presence modifier improving log-MMSE based noise suppression performance |
CN105899965B (zh) * | 2014-08-29 | 2018-10-02 | 深圳市大疆创新科技有限公司 | 用于采集音频数据的无人飞行器 |
US9979724B2 (en) | 2015-02-06 | 2018-05-22 | NXT-ID, Inc. | Distributed method and system to improve collaborative services across multiple devices |
US9554207B2 (en) | 2015-04-30 | 2017-01-24 | Shure Acquisition Holdings, Inc. | Offset cartridge microphones |
US9565493B2 (en) | 2015-04-30 | 2017-02-07 | Shure Acquisition Holdings, Inc. | Array microphone system and method of assembling the same |
US10419428B2 (en) | 2015-07-05 | 2019-09-17 | NXT-ID, Inc. | System and method to authenticate electronics using electronic-metrics |
JP6501259B2 (ja) * | 2015-08-04 | 2019-04-17 | 本田技研工業株式会社 | 音声処理装置及び音声処理方法 |
US10367948B2 (en) | 2017-01-13 | 2019-07-30 | Shure Acquisition Holdings, Inc. | Post-mixing acoustic echo cancellation systems and methods |
JP7312180B2 (ja) * | 2017-12-29 | 2023-07-20 | ハーマン インターナショナル インダストリーズ, インコーポレイテッド | 遠端電気通信のための車室内音響雑音消去システム |
US11523212B2 (en) | 2018-06-01 | 2022-12-06 | Shure Acquisition Holdings, Inc. | Pattern-forming microphone array |
US11297423B2 (en) | 2018-06-15 | 2022-04-05 | Shure Acquisition Holdings, Inc. | Endfire linear array microphone |
US10699727B2 (en) | 2018-07-03 | 2020-06-30 | International Business Machines Corporation | Signal adaptive noise filter |
CN108985234B (zh) * | 2018-07-19 | 2021-08-31 | 沈阳建筑大学 | 一种适用于非高斯信号的贝叶斯小波包降噪方法 |
CN112889296A (zh) | 2018-09-20 | 2021-06-01 | 舒尔获得控股公司 | 用于阵列麦克风的可调整的波瓣形状 |
EP3942842A1 (de) | 2019-03-21 | 2022-01-26 | Shure Acquisition Holdings, Inc. | Gehäuse und zugehörige konstruktionsmerkmale für mikrofone einer deckenanordnung |
US11558693B2 (en) | 2019-03-21 | 2023-01-17 | Shure Acquisition Holdings, Inc. | Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition and voice activity detection functionality |
EP3942845A1 (de) | 2019-03-21 | 2022-01-26 | Shure Acquisition Holdings, Inc. | Autofokus, autofokus in regionen und autoplatzierung von strahlgeformten mikrofonkeulen mit hemmfunktion |
EP3973716A1 (de) | 2019-05-23 | 2022-03-30 | Shure Acquisition Holdings, Inc. | Steuerbare lautsprecheranordnung, system und verfahren dafür |
JP2022535229A (ja) | 2019-05-31 | 2022-08-05 | シュアー アクイジッション ホールディングス インコーポレイテッド | 音声およびノイズアクティビティ検出と統合された低レイテンシオートミキサー |
CN114467312A (zh) | 2019-08-23 | 2022-05-10 | 舒尔获得控股公司 | 具有改进方向性的二维麦克风阵列 |
US11552611B2 (en) | 2020-02-07 | 2023-01-10 | Shure Acquisition Holdings, Inc. | System and method for automatic adjustment of reference gain |
CN111564161B (zh) * | 2020-04-28 | 2023-07-07 | 世邦通信股份有限公司 | 智能抑制噪音的声音处理装置、方法、终端设备及可读介质 |
WO2021243368A2 (en) | 2020-05-29 | 2021-12-02 | Shure Acquisition Holdings, Inc. | Transducer steering and configuration systems and methods using a local positioning system |
EP4285605A1 (de) | 2021-01-28 | 2023-12-06 | Shure Acquisition Holdings, Inc. | Hybrides audiostrahlformungssystem |
Family Cites Families (56)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2687496B1 (fr) * | 1992-02-18 | 1994-04-01 | Alcatel Radiotelephone | Procede de reduction de bruit acoustique dans un signal de parole. |
JP3453898B2 (ja) * | 1995-02-17 | 2003-10-06 | ソニー株式会社 | 音声信号の雑音低減方法及び装置 |
US6535666B1 (en) * | 1995-06-02 | 2003-03-18 | Trw Inc. | Method and apparatus for separating signals transmitted over a waveguide |
JP3591068B2 (ja) * | 1995-06-30 | 2004-11-17 | ソニー株式会社 | 音声信号の雑音低減方法 |
US6130949A (en) * | 1996-09-18 | 2000-10-10 | Nippon Telegraph And Telephone Corporation | Method and apparatus for separation of source, program recorded medium therefor, method and apparatus for detection of sound source zone, and program recorded medium therefor |
US6167375A (en) * | 1997-03-17 | 2000-12-26 | Kabushiki Kaisha Toshiba | Method for encoding and decoding a speech signal including background noise |
FI114422B (fi) * | 1997-09-04 | 2004-10-15 | Nokia Corp | Lähteen puheaktiviteetin tunnistus |
US6192134B1 (en) * | 1997-11-20 | 2001-02-20 | Conexant Systems, Inc. | System and method for a monolithic directional microphone array |
SE515674C2 (sv) * | 1997-12-05 | 2001-09-24 | Ericsson Telefon Ab L M | Apparat och metod för brusreducering |
DE19812697A1 (de) * | 1998-03-23 | 1999-09-30 | Volkswagen Ag | Verfahren und Einrichtung zum Betrieb einer Mikrofonanordnung, insbesondere in einem Kraftfahrzeug |
US7072831B1 (en) * | 1998-06-30 | 2006-07-04 | Lucent Technologies Inc. | Estimating the noise components of a signal |
JP4163294B2 (ja) * | 1998-07-31 | 2008-10-08 | 株式会社東芝 | 雑音抑圧処理装置および雑音抑圧処理方法 |
US6453285B1 (en) * | 1998-08-21 | 2002-09-17 | Polycom, Inc. | Speech activity detector for use in noise reduction system, and methods therefor |
US6289309B1 (en) * | 1998-12-16 | 2001-09-11 | Sarnoff Corporation | Noise spectrum tracking for speech enhancement |
US7062049B1 (en) * | 1999-03-09 | 2006-06-13 | Honda Giken Kogyo Kabushiki Kaisha | Active noise control system |
US6910011B1 (en) * | 1999-08-16 | 2005-06-21 | Haman Becker Automotive Systems - Wavemakers, Inc. | Noisy acoustic signal enhancement |
US7117149B1 (en) * | 1999-08-30 | 2006-10-03 | Harman Becker Automotive Systems-Wavemakers, Inc. | Sound source classification |
US6243322B1 (en) * | 1999-11-05 | 2001-06-05 | Wavemakers Research, Inc. | Method for estimating the distance of an acoustic signal |
US7072833B2 (en) * | 2000-06-02 | 2006-07-04 | Canon Kabushiki Kaisha | Speech processing system |
ATE308858T1 (de) * | 2000-08-16 | 2005-11-15 | Dolby Lab Licensing Corp | Modulation eines oder mehrerer parameter in einem wahrnehmungsgebundenen audio- oder video- kodiersystem in antwort auf zusätzliche information |
AU2002224413A1 (en) * | 2000-10-19 | 2002-04-29 | Lear Corporation | Transient processing for communication system |
US7117145B1 (en) * | 2000-10-19 | 2006-10-03 | Lear Corporation | Adaptive filter for speech enhancement in a noisy environment |
US7617099B2 (en) * | 2001-02-12 | 2009-11-10 | FortMedia Inc. | Noise suppression by two-channel tandem spectrum modification for speech signal in an automobile |
DE10118653C2 (de) * | 2001-04-14 | 2003-03-27 | Daimler Chrysler Ag | Verfahren zur Geräuschreduktion |
US6959276B2 (en) * | 2001-09-27 | 2005-10-25 | Microsoft Corporation | Including the category of environmental noise when processing speech signals |
US6937980B2 (en) * | 2001-10-02 | 2005-08-30 | Telefonaktiebolaget Lm Ericsson (Publ) | Speech recognition using microphone antenna array |
US7171008B2 (en) * | 2002-02-05 | 2007-01-30 | Mh Acoustics, Llc | Reducing noise in audio systems |
JP4195267B2 (ja) * | 2002-03-14 | 2008-12-10 | インターナショナル・ビジネス・マシーンズ・コーポレーション | 音声認識装置、その音声認識方法及びプログラム |
US7398209B2 (en) * | 2002-06-03 | 2008-07-08 | Voicebox Technologies, Inc. | Systems and methods for responding to natural language speech utterance |
US7084801B2 (en) * | 2002-06-05 | 2006-08-01 | Siemens Corporate Research, Inc. | Apparatus and method for estimating the direction of arrival of a source signal using a microphone array |
US8073157B2 (en) * | 2003-08-27 | 2011-12-06 | Sony Computer Entertainment Inc. | Methods and apparatus for targeted sound detection and characterization |
JP4352790B2 (ja) * | 2002-10-31 | 2009-10-28 | セイコーエプソン株式会社 | 音響モデル作成方法および音声認識装置ならびに音声認識装置を有する乗り物 |
US8073689B2 (en) * | 2003-02-21 | 2011-12-06 | Qnx Software Systems Co. | Repetitive transient noise removal |
US7725315B2 (en) * | 2003-02-21 | 2010-05-25 | Qnx Software Systems (Wavemakers), Inc. | Minimization of transient noises in a voice signal |
US7949522B2 (en) * | 2003-02-21 | 2011-05-24 | Qnx Software Systems Co. | System for suppressing rain noise |
EP1473964A3 (de) * | 2003-05-02 | 2006-08-09 | Samsung Electronics Co., Ltd. | Mikrofonvorrichtung, Verfahren zur Verarbeitung von Signalen von dieser Mikrofonvorrichtung und dieses benutzende Spracherkennungsverfahren und Spracherkennungssystem |
DE102004005998B3 (de) * | 2004-02-06 | 2005-05-25 | Ruwisch, Dietmar, Dr. | Verfahren und Vorrichtung zur Separierung von Schallsignalen |
JP2005249816A (ja) * | 2004-03-01 | 2005-09-15 | Internatl Business Mach Corp <Ibm> | 信号強調装置、方法及びプログラム、並びに音声認識装置、方法及びプログラム |
WO2006027707A1 (en) * | 2004-09-07 | 2006-03-16 | Koninklijke Philips Electronics N.V. | Telephony device with improved noise suppression |
US7949520B2 (en) * | 2004-10-26 | 2011-05-24 | QNX Software Sytems Co. | Adaptive filter pitch extraction |
US8139787B2 (en) * | 2005-09-09 | 2012-03-20 | Simon Haykin | Method and device for binaural signal enhancement |
FR2898209B1 (fr) * | 2006-03-01 | 2008-12-12 | Parrot Sa | Procede de debruitage d'un signal audio |
JP5070873B2 (ja) * | 2006-08-09 | 2012-11-14 | 富士通株式会社 | 音源方向推定装置、音源方向推定方法、及びコンピュータプログラム |
EP1912472A1 (de) * | 2006-10-10 | 2008-04-16 | Siemens Audiologische Technik GmbH | Verfahren zum Betreiben einer Hörhilfe, sowie Hörhilfe |
FR2908003B1 (fr) * | 2006-10-26 | 2009-04-03 | Parrot Sa | Procede de reduction de l'echo acoustique residuel apres supression d'echo dans un dispositif"mains libres" |
US8098842B2 (en) * | 2007-03-29 | 2012-01-17 | Microsoft Corp. | Enhanced beamforming for arrays of directional microphones |
US8005237B2 (en) * | 2007-05-17 | 2011-08-23 | Microsoft Corp. | Sensor array beamformer post-processor |
GB0720473D0 (en) * | 2007-10-19 | 2007-11-28 | Univ Surrey | Accoustic source separation |
US8175291B2 (en) * | 2007-12-19 | 2012-05-08 | Qualcomm Incorporated | Systems, methods, and apparatus for multi-microphone based speech enhancement |
US8189807B2 (en) * | 2008-06-27 | 2012-05-29 | Microsoft Corporation | Satellite microphone array for video conferencing |
US8577677B2 (en) * | 2008-07-21 | 2013-11-05 | Samsung Electronics Co., Ltd. | Sound source separation method and system using beamforming technique |
US8392185B2 (en) * | 2008-08-20 | 2013-03-05 | Honda Motor Co., Ltd. | Speech recognition system and method for generating a mask of the system |
US8081772B2 (en) * | 2008-11-20 | 2011-12-20 | Gentex Corporation | Vehicular microphone assembly using fractional power phase normalization |
WO2010091077A1 (en) * | 2009-02-03 | 2010-08-12 | University Of Ottawa | Method and system for a multi-microphone noise reduction |
FR2948484B1 (fr) * | 2009-07-23 | 2011-07-29 | Parrot | Procede de filtrage des bruits lateraux non-stationnaires pour un dispositif audio multi-microphone, notamment un dispositif telephonique "mains libres" pour vehicule automobile |
FR2950461B1 (fr) * | 2009-09-22 | 2011-10-21 | Parrot | Procede de filtrage optimise des bruits non stationnaires captes par un dispositif audio multi-microphone, notamment un dispositif telephonique "mains libres" pour vehicule automobile |
-
2009
- 2009-07-23 FR FR0955133A patent/FR2948484B1/fr not_active Expired - Fee Related
-
2010
- 2010-06-16 EP EP10166119A patent/EP2293594B1/de active Active
- 2010-06-16 AT AT10166119T patent/ATE532345T1/de active
- 2010-06-16 ES ES10166119T patent/ES2377056T3/es active Active
- 2010-07-01 US US12/829,115 patent/US8370140B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US20110054891A1 (en) | 2011-03-03 |
FR2948484B1 (fr) | 2011-07-29 |
ES2377056T3 (es) | 2012-03-22 |
ATE532345T1 (de) | 2011-11-15 |
US8370140B2 (en) | 2013-02-05 |
EP2293594A1 (de) | 2011-03-09 |
FR2948484A1 (fr) | 2011-01-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2293594B1 (de) | Verfahren zur Filterung von seitlichem nichtstationärem Rauschen für ein Multimikrofon-Audiogerät | |
EP2309499B1 (de) | Verfahren zur optimierten Filterung nicht stationärer Geräusche, die von einem Audiogerät mit mehreren Mikrophonen eingefangen werden, insbesondere eine Freisprechtelefonanlage für Kraftfahrzeuge | |
EP2430825B1 (de) | Verfahren zum auswählen eines von zwei oder mehr mikrofonen für ein sprachverarbeitungssystem, wie etwa eine freihand-telefoneinrichtung, die in einer geräuschbehafteten umgebung operiert | |
EP2680262B1 (de) | Verfahren zur Geräuschdämpfung eines Audiosignals für eine Multimikrofon-Audiovorrichtung, die in lauten Umgebungen eingesetzt wird | |
EP1830349B1 (de) | Verfahren zur Geräuschdämpfung eines Audiosignals | |
EP2538409B1 (de) | Verfahren zur Geräuschdämpfung für Audio-Gerät mit mehreren Mikrofonen, insbesondere für eine telefonische Freisprechanlage | |
EP2772916B1 (de) | Verfahren zur Geräuschdämpfung eines Audiosignals mit Hilfe eines Algorithmus mit variabler Spektralverstärkung mit dynamisch modulierbarer Härte | |
EP1356461B1 (de) | Rauschverminderungsverfahren und -einrichtung | |
EP2057835B1 (de) | Verfahren zur unterdrückung akustischer restechos nach echounterdrückung bei einer freisprecheinrichtung | |
US9666183B2 (en) | Deep neural net based filter prediction for audio event classification and extraction | |
EP2530673B1 (de) | Audiogerät mit Rauschunterdrückung in einem Sprachsignal unter Verwendung von einem Filter mit fraktionaler Verzögerung | |
EP1789956B1 (de) | Verfahren zum verarbeiten eines rauschbehafteten tonsignals und einrichtung zur implementierung des verfahrens | |
EP2262216B1 (de) | Verfahren zur Erkennung einer Doppelsprech-Situation für Telefonfreisprechgerät | |
FR2906070A1 (fr) | Reduction de bruit multi-reference pour des applications vocales en environnement automobile | |
EP2515300B1 (de) | Verfahren und System für die Geräuschunterdrückung | |
US20200184994A1 (en) | System and method for acoustic localization of multiple sources using spatial pre-filtering | |
FR2906071A1 (fr) | Reduction de bruit multibande avec une reference de bruit non acoustique | |
WO2017207286A1 (fr) | Combine audio micro/casque comprenant des moyens de detection d'activite vocale multiples a classifieur supervise | |
JP2020533619A (ja) | 有音音声検出の複雑性低減およびピッチ推定 | |
FR3113537A1 (fr) | Procédé et dispositif électronique de réduction du bruit multicanale dans un signal audio comprenant une partie vocale, produit programme d’ordinateur associé | |
FR3106691A1 (fr) | Conversion de la parole par apprentissage statistique avec modélisation complexe des modifications temporelles | |
FR2878399A1 (fr) | Dispositif et procede de debruitage a deux voies mettant en oeuvre une fonction de coherence associee a une utilisation de proprietes psychoacoustiques, et programme d'ordinateur correspondant |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20100616 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME RS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 3/00 20060101AFI20110429BHEP Ipc: G10L 21/02 20060101ALI20110429BHEP Ipc: H04R 1/40 20060101ALI20110429BHEP |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602010000359 Country of ref document: DE Effective date: 20111229 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: T3 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2377056 Country of ref document: ES Kind code of ref document: T3 Effective date: 20120322 |
|
LTIE | Lt: invalidation of european patent or patent extension |
Effective date: 20111102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120302 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120203 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120302 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FD4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120202 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: IE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 532345 Country of ref document: AT Kind code of ref document: T Effective date: 20111102 |
|
26N | No opposition filed |
Effective date: 20120803 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602010000359 Country of ref document: DE Effective date: 20120803 |
|
BERE | Be: lapsed |
Owner name: PARROT Effective date: 20120630 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20120628 Year of fee payment: 3 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120616 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20111102 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20140707 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100616 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130617 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140630 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140630 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602010000359 Country of ref document: DE Owner name: PARROT AUTOMOTIVE, FR Free format text: FORMER OWNER: PARROT, PARIS, FR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20151029 AND 20151104 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP Owner name: PARROT AUTOMOTIVE, FR Effective date: 20151201 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: PD Owner name: PARROT AUTOMOTIVE; FR Free format text: DETAILS ASSIGNMENT: VERANDERING VAN EIGENAAR(S), OVERDRACHT; FORMER OWNER NAME: PARROT Effective date: 20151102 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 7 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20180625 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20180716 Year of fee payment: 15 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MM Effective date: 20190701 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190701 Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190616 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230523 Year of fee payment: 14 Ref country code: DE Payment date: 20230523 Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230523 Year of fee payment: 14 |