EP0669606A2 - Procédé de réduction de bruit pour canaux de parole perturbés - Google Patents
Procédé de réduction de bruit pour canaux de parole perturbés Download PDFInfo
- Publication number
- EP0669606A2 EP0669606A2 EP95101977A EP95101977A EP0669606A2 EP 0669606 A2 EP0669606 A2 EP 0669606A2 EP 95101977 A EP95101977 A EP 95101977A EP 95101977 A EP95101977 A EP 95101977A EP 0669606 A2 EP0669606 A2 EP 0669606A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- speech
- median
- median filtering
- signal
- filtering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000009467 reduction Effects 0.000 title claims description 10
- 238000001914 filtration Methods 0.000 claims abstract description 44
- 230000003595 spectral effect Effects 0.000 claims abstract description 35
- 238000001228 spectrum Methods 0.000 claims abstract description 19
- 238000012546 transfer Methods 0.000 claims abstract description 17
- 230000000694 effects Effects 0.000 claims description 12
- 230000002123 temporal effect Effects 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 7
- 230000006870 function Effects 0.000 description 12
- 238000012545 processing Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 238000013016 damping Methods 0.000 description 3
- 238000009499 grossing Methods 0.000 description 3
- 230000001629 suppression Effects 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 238000011410 subtraction method Methods 0.000 description 2
- 230000008033 biological extinction Effects 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000010561 standard procedure Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
Definitions
- the invention relates to a method for noise reduction of a disturbed speech signal with the aid of spectral subtraction.
- the noise reduction using the spectral subtraction method is used in automatic speech recognition or in hands-free systems to improve speech quality, e.g. when calling from the motor vehicle.
- the noise reduction by spectral subtraction is characterized in that relatively stationary interference can typically be reduced by approximately 10 dB without additional information about the interference being required. Only the disturbed voice channel is required.
- the speech signal is divided into short overlapping time segments and processed segment by segment.
- an estimate of the interference is determined in the speech pauses, and this estimate is subtracted in terms of amount in the spectral range.
- the spectral subtraction can be implemented in different ways, but is usually implemented as a multiplicative filter in the frequency domain. This spectral subtraction shows the undesirable side effect of a residual musical noise, the "musical tones" and a speech distortion.
- “Musical tones” are usually suppressed by excessive damping.
- the excessive damping can be done by overestimating the interference with an overestimating factor or by choosing a special transmission characteristic.
- the values of the current transfer function are determined for each frequency from the transfer characteristic. It is common to implement a magnitude characteristic in the spectral subtraction filter that has a higher attenuation than e.g. a characteristic curve based on the quadratic error criterion. Specially designed characteristic curves are also possible. Depending on the characteristic used, an overestimation of the disturbance by a factor of 1 to 3 is common.
- the excessive damping due to the characteristic curve and the overestimation factor gives the desired effect of suppressing "musical tones", but it also has the side effect of a partly. considerable language distortion.
- Median filtering has proven to be an advantageous method for further substantially improving the spectral subtraction method for reducing the noise of a disturbed speech signal.
- the median filtering can be applied both to the magnitude spectrum of the disturbed input signal or the noise-reduced output signal after spectral subtraction and to the transfer function determined from the application of a transfer characteristic and can be carried out in the time direction or in the frequency direction.
- the magnitude spectrum of the speech signal is composed of a sequence of segment spectra in accordance with the segmentation of the speech time signal.
- the transfer function is represented by the time and frequency discrete values K i , 1 (eg equation (3)). A combination of different of these procedures can also be advantageous.
- a preferred method provides, in speech pauses by using median filtering, preferably in the temporal direction, to preserve the natural impression of a weak background noise on the transmission function, and during speech activity by applying median filtering to the spectrum of magnitude of the speech signal to strongly suppress the "musical tones" to reach.
- the separate detection of speech pauses and speech activity is provided and known in any case for determining an average noise signal during speech pauses, so that no special effort is required for this.
- the methods according to the invention are easy to implement.
- Median filtering is also already known for processing speech signals.
- a median filter for successive short-term mean values which represent a measure of the average power of speech signal sections, is used as a smoothing filter. Speech pauses are recognized by comparing the smoothed sequence of values with a threshold value. A This does not result in interference-free speech signals.
- FIG. 1 shows an example of an input signal E and an output signal A filtered with a median filter of length 3.
- the median filter first sorts the values within the data window F and then outputs the mean value med.
- the median filter hides short signal peaks, but receives the remaining signal edges.
- the following noise example was used: vehicle interior noise at 140 km / h, 12 kHz sampling frequency, segment length 512 values, the last 256 values of each segment are set to zero, the first 256 values of each segment are multiplied by the Hanning window, segments are half overlapped, i.e. a new segment every 10.67ms.
- FIG. 2 shows first the frequency (linear 0 to 6 kHz) the spectrum for 4 successive segments (time interval 10.67 ms, index I) and then the time (0 to 2.5 seconds) the signal curve for 4 successive discrete frequencies (index i ), representative of all 256 frequencies. It is shown as a typical property of the "musical tones" that the course over the frequency has relatively extensive disturbances (broad impulses), whereas the course over time has a strong impulsive character (narrow impulses). It is precisely the pulse-like character in the temporal direction that makes median filtering particularly effective. A pulse-like fault is deleted. A longer window length of the median filter is required for pulse-like disturbances with wider pulses.
- the median filter can also be carried out on the input signal before the spectral subtraction. Ideally, this does not result in the creation of "musical tones" that would otherwise be solved by post-filtering with the median filter.
- the median filtering on the input signal can then be advantageous if "musical tones” influence the various processing steps implemented in the spectral subtraction filter (apart from the characteristic function). It shouldn't go on possible advantages or disadvantages of median filtering on the input or output signal are discussed. In principle, both options are available and, apart from special cases of implementation, are equivalent.
- the median filter can also be carried out on the transfer function K instead of on the magnitude spectrum of a speech signal.
- FIG. 4 shows the transfer function K over time and over frequency. The same section is shown as in FIG. 2.
- the transfer function shows a similar behavior as the output signal in FIG. 2nd
- FIG. 5 shows the transfer function filtered in time with the 3-fold median. The same section is shown as in FIG. 3.
- the median filtering in the temporal direction is extremely effective for the same reasons as for the output signal.
- the pulse-suppressing property of median filtering has a particularly significant effect on the increased impulse disturbance and thus on the "musical tones".
- Median filtering has a repairing effect on the pulse-like disturbance.
- the median filtering on the magnitude spectrum of the input or output signal results in the higher gain in the suppression of impulse-like disturbances, but can also lead to changes which are particularly noticeable during speech pauses, while the median filtering of the transmission values in speech pauses essentially increases a pure attenuation of the signal, which makes it sound quieter but natural. Ideally, there are no "musical tones".
- a preferred embodiment of the invention takes advantage of this by performing the median filtering in the case of speech activity on the magnitude spectrum and in speech pauses on the transmission values. The required speech-pause decision is available anyway with the spectral subtraction, since the formation of the noise estimate is only carried out during the speech pauses.
- a median filtering in the frequency direction can also be carried out in accordance with equation (6).
- the detailed explanations given apply analogously to filtering in the frequency direction. It can be seen that as the number of samples within a time segment decreases, the median filtering in the frequency direction gains advantages over the filtering in the time direction and vice versa.
- the window length is equal to the minimum median window length 3.
- larger window lengths lead to a further suppression of the "musical tones", but under certain circumstances also to a leveling of the speech signal which is perceived as unnatural.
- the preferred window length is therefore 3 as indicated by way of example.
- a larger window length can be appropriate for median filtering.
- the time interval covered by the median temporal filtering window should not exceed 50 ms ten.
- the window length of the median filter is based on the data segment length.
- the data segment length should be less than 64, the median filter not greater than 5.
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Noise Elimination (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Reduction Or Emphasis Of Bandwidth Of Signals (AREA)
- Interconnected Communication Systems, Intercoms, And Interphones (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE4405723A DE4405723A1 (de) | 1994-02-23 | 1994-02-23 | Verfahren zur Geräuschreduktion eines gestörten Sprachsignals |
DE4405723 | 1994-02-23 |
Publications (3)
Publication Number | Publication Date |
---|---|
EP0669606A2 true EP0669606A2 (fr) | 1995-08-30 |
EP0669606A3 EP0669606A3 (fr) | 1995-10-25 |
EP0669606B1 EP0669606B1 (fr) | 1999-09-22 |
Family
ID=6510930
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP95101977A Expired - Lifetime EP0669606B1 (fr) | 1994-02-23 | 1995-02-14 | Procédé de réduction de bruit d'un signal vocal perturbé |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP0669606B1 (fr) |
AT (1) | ATE185014T1 (fr) |
DE (2) | DE4405723A1 (fr) |
ES (1) | ES2138669T3 (fr) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1998003965A1 (fr) * | 1996-07-19 | 1998-01-29 | Daimler-Benz Ag | Procede pour reduire les parasites dans un signal vocal |
EP1065656A2 (fr) * | 1994-05-13 | 2001-01-03 | Sony Corporation | Procédé et dispositif pour la réduction du bruit dans des signaux de paroles |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7450693B2 (en) | 2001-03-07 | 2008-11-11 | T-Mobile Deutschland Gmbh | Method and device for improving voice quality on transparent telecommunication-transmission paths |
DE10136491B4 (de) * | 2001-03-07 | 2004-11-25 | T-Mobile Deutschland Gmbh | Verfahren und Vorrichtung zur Verbesserung der Sprachqualität auf transparenten Telekommunikations-Übertragungswegen |
DE10311587A1 (de) * | 2003-03-14 | 2004-09-23 | Volkswagen Ag | Verfahren und Vorrichtung zum Freisprechen in einem Kraftfahrzeug |
DE102011002976A1 (de) | 2011-01-21 | 2012-07-26 | Behr Gmbh & Co. Kg | Kältemittelkondensatorbaugruppe |
EP2673777B1 (fr) * | 2011-02-10 | 2018-12-26 | Dolby Laboratories Licensing Corporation | Suppression de bruit combinée et signaux hors emplacement |
US9173025B2 (en) | 2012-02-08 | 2015-10-27 | Dolby Laboratories Licensing Corporation | Combined suppression of noise, echo, and out-of-location signals |
US8712076B2 (en) | 2012-02-08 | 2014-04-29 | Dolby Laboratories Licensing Corporation | Post-processing including median filtering of noise suppression gains |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0110467A1 (fr) * | 1982-11-23 | 1984-06-13 | Philips Kommunikations Industrie AG | Dispositif pour la détection des silences dans les signaux de paroles |
US4837828A (en) * | 1982-05-12 | 1989-06-06 | Nec Corporation | Pattern feature extracting system |
DE4229577A1 (de) * | 1992-09-04 | 1994-03-10 | Daimler Benz Ag | Verfahren zur Spracherkennung mit dem eine Anpassung von Mikrofon- und Sprachcharakteristiken erreicht wird |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3243232A1 (de) * | 1982-11-23 | 1984-05-24 | Philips Kommunikations Industrie AG, 8500 Nürnberg | Verfahren zur erkennung von sprachpausen |
US4682230A (en) * | 1986-03-21 | 1987-07-21 | Rca Corporation | Adaptive median filter system |
-
1994
- 1994-02-23 DE DE4405723A patent/DE4405723A1/de not_active Withdrawn
-
1995
- 1995-02-14 DE DE59506864T patent/DE59506864D1/de not_active Expired - Lifetime
- 1995-02-14 AT AT95101977T patent/ATE185014T1/de active
- 1995-02-14 ES ES95101977T patent/ES2138669T3/es not_active Expired - Lifetime
- 1995-02-14 EP EP95101977A patent/EP0669606B1/fr not_active Expired - Lifetime
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4837828A (en) * | 1982-05-12 | 1989-06-06 | Nec Corporation | Pattern feature extracting system |
EP0110467A1 (fr) * | 1982-11-23 | 1984-06-13 | Philips Kommunikations Industrie AG | Dispositif pour la détection des silences dans les signaux de paroles |
DE4229577A1 (de) * | 1992-09-04 | 1994-03-10 | Daimler Benz Ag | Verfahren zur Spracherkennung mit dem eine Anpassung von Mikrofon- und Sprachcharakteristiken erreicht wird |
Non-Patent Citations (1)
Title |
---|
ICASSP 81, Bd.1, 30. M{rz 1981, ATLANTA Seiten 1086 - 1088 T.L.PETERSEN ET AL. 'Acoustic suppression in the context of a perceptual model' * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1065656A2 (fr) * | 1994-05-13 | 2001-01-03 | Sony Corporation | Procédé et dispositif pour la réduction du bruit dans des signaux de paroles |
EP1065656A3 (fr) * | 1994-05-13 | 2001-01-10 | Sony Corporation | Procédé et dispositif pour la réduction du bruit dans des signaux de paroles |
WO1998003965A1 (fr) * | 1996-07-19 | 1998-01-29 | Daimler-Benz Ag | Procede pour reduire les parasites dans un signal vocal |
US6687669B1 (en) | 1996-07-19 | 2004-02-03 | Schroegmeier Peter | Method of reducing voice signal interference |
Also Published As
Publication number | Publication date |
---|---|
DE59506864D1 (de) | 1999-10-28 |
ATE185014T1 (de) | 1999-10-15 |
ES2138669T3 (es) | 2000-01-16 |
EP0669606B1 (fr) | 1999-09-22 |
DE4405723A1 (de) | 1995-08-24 |
EP0669606A3 (fr) | 1995-10-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE19747885B4 (de) | Verfahren zur Reduktion von Störungen akustischer Signale mittels der adaptiven Filter-Methode der spektralen Subtraktion | |
EP0912974B1 (fr) | Procede pour reduire les parasites dans un signal vocal | |
DE60131639T2 (de) | Vorrichtungen und Verfahren zur Bestimmung von Leistungswerten für die Geräuschunterdrückung für ein Sprachkommunikationssystem | |
DE69627580T2 (de) | Verfahren zur Rauschverminderung in einem Sprachsignal | |
DE69420027T2 (de) | Rauschverminderung | |
DE602005000539T2 (de) | Verstärkungsgesteuerte Geräuschunterdrückung | |
DE69428119T2 (de) | Verringerung des hintergrundrauschens zur sprachverbesserung | |
DE69131739T2 (de) | Einrichtung zur Sprachsignalverarbeitung für die Bestimmung eines Sprachsignals in einem verrauschten Sprachsignal | |
DE3689035T2 (de) | Rauschminderungssystem. | |
DE112011104737B4 (de) | Geräuschunterdrückungsvorrichtung | |
DE69124005T2 (de) | Sprachsignalverarbeitungsvorrichtung | |
EP1386307B1 (fr) | Procede et dispositif pour determiner un niveau de qualite d'un signal audio | |
DE112017007005B4 (de) | Akustiksignal-verarbeitungsvorrichtung, akustiksignalverarbeitungsverfahren und freisprech-kommunikationsvorrichtung | |
DE69616724T2 (de) | Verfahren und System für die Spracherkennung | |
DE4243831A1 (de) | Verfahren zur Laufzeitschätzung an gestörten Sprachkanälen | |
EP0668007A1 (fr) | Appareil radiotelephonique mobile a dispositif mains libres | |
DE112007003625T5 (de) | Echounterdrückungsvorrichtung, echounterdrückungssystem, Echounterdrückungsverfahren und Computerprogramm | |
DE112011106045B4 (de) | Audiosignal-Wiederherstellungsvorrichtung und Audiosignal-Wiederherstellungsverfahren | |
DE69130687T2 (de) | Sprachsignalverarbeitungsvorrichtung zum Herausschneiden von einem Sprachsignal aus einem verrauschten Sprachsignal | |
EP0669606B1 (fr) | Procédé de réduction de bruit d'un signal vocal perturbé | |
DE102013011761A1 (de) | Kraftfahrzeug mit einer Freisprecheinrichtung und Verfahren zur Erzeugung eines Frequenzganges für Freisprecheinrichtungen | |
EP0623995A1 (fr) | Dispositif de réglage en fonction du bruit du volume d'un autoradio | |
EP2080197B1 (fr) | Dispositif d'élimination du bruit dans un signal audio | |
DE10157535B4 (de) | Verfahren und Vorrichtung zur Reduzierung zufälliger, kontinuierlicher, instationärer Störungen in Audiosignalen | |
DE3733983A1 (de) | Verfahren zum daempfen von stoerschall in von hoergeraeten uebertragenen schallsignalen |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT CH DE ES FR GB IT LI NL |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AT CH DE ES FR GB IT LI NL |
|
17P | Request for examination filed |
Effective date: 19951117 |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
17Q | First examination report despatched |
Effective date: 19981112 |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: DAIMLERCHRYSLER AG |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT CH DE ES FR GB IT LI NL |
|
REF | Corresponds to: |
Ref document number: 185014 Country of ref document: AT Date of ref document: 19991015 Kind code of ref document: T |
|
ITF | It: translation for a ep patent filed | ||
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: KIRKER & CIE SA Ref country code: CH Ref legal event code: EP |
|
REF | Corresponds to: |
Ref document number: 59506864 Country of ref document: DE Date of ref document: 19991028 |
|
ET | Fr: translation filed | ||
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2138669 Country of ref document: ES Kind code of ref document: T3 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed | ||
REG | Reference to a national code |
Ref country code: GB Ref legal event code: IF02 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PUE Owner name: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH Free format text: DAIMLERCHRYSLER AG#EPPLESTRASSE 225#70567 STUTTGART (DE) -TRANSFER TO- HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH#BECKER-GOERING-STRASSE 16#76307 KARLSBAD (DE) |
|
NLS | Nl: assignments of ep-patents |
Owner name: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH Effective date: 20050630 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20110228 Year of fee payment: 17 Ref country code: CH Payment date: 20110223 Year of fee payment: 17 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 59506864 Country of ref document: DE Representative=s name: GRUENECKER, KINKELDEY, STOCKMAIR & SCHWANHAEUS, DE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 59506864 Country of ref document: DE Representative=s name: GRUENECKER, KINKELDEY, STOCKMAIR & SCHWANHAEUS, DE Effective date: 20120411 Ref country code: DE Ref legal event code: R081 Ref document number: 59506864 Country of ref document: DE Owner name: NUANCE COMMUNICATIONS, INC. (N.D.GES.D. STAATE, US Free format text: FORMER OWNER: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH, 76307 KARLSBAD, DE Effective date: 20120411 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: V1 Effective date: 20120901 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP Owner name: NUANCE COMMUNICATIONS, INC., US Effective date: 20120924 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120229 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120229 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120901 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20140113 Year of fee payment: 20 Ref country code: IT Payment date: 20140213 Year of fee payment: 20 Ref country code: FR Payment date: 20140211 Year of fee payment: 20 Ref country code: AT Payment date: 20140128 Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20140212 Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20140417 Year of fee payment: 20 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R071 Ref document number: 59506864 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: PE20 Expiry date: 20150213 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK07 Ref document number: 185014 Country of ref document: AT Kind code of ref document: T Effective date: 20150214 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20150213 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20150826 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20150215 |