EP1064822A1 - Method and device for operating a microphone system, especially in a motor vehicle - Google Patents
Method and device for operating a microphone system, especially in a motor vehicleInfo
- Publication number
- EP1064822A1 EP1064822A1 EP99910231A EP99910231A EP1064822A1 EP 1064822 A1 EP1064822 A1 EP 1064822A1 EP 99910231 A EP99910231 A EP 99910231A EP 99910231 A EP99910231 A EP 99910231A EP 1064822 A1 EP1064822 A1 EP 1064822A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- microphone
- operating
- evaluation
- microphones
- signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 18
- 238000011156 evaluation Methods 0.000 claims abstract description 24
- 230000005236 sound signal Effects 0.000 claims abstract description 4
- 238000004364 calculation method Methods 0.000 claims description 6
- 101100495769 Caenorhabditis elegans che-1 gene Proteins 0.000 claims 1
- 230000000903 blocking effect Effects 0.000 claims 1
- 230000011664 signaling Effects 0.000 claims 1
- 230000005540 biological transmission Effects 0.000 description 5
- 238000005259 measurement Methods 0.000 description 5
- 230000000875 corresponding effect Effects 0.000 description 3
- 230000002596 correlated effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
Definitions
- the invention relates to a method and a device for operating a microphone arrangement, in particular in a motor vehicle, according to the preamble of claims 1 and 6.
- Microphones or microphone arrangements are required in motor vehicles, in particular for operating the so-called hands-free system, but moreover also in speech amplification and transmission systems and in systems for active noise suppression.
- microphones are usually arranged in the area of the dashboard or in the area of the roof fitting or on the inside mirror.
- simple microphones or microphone arrangements are often a problem.
- the voice messages are overlaid by driving noises, which is problematic not only for hands-free telephone systems but also for voice-controlled input units.
- a voice control device for components in motor vehicles in which the actuation of the control device by the voice generates a feedback with which it can be ensured whether the control device has correctly accepted the voice-controlled command.
- a voice control device of this type also concentrates only on a conventional microphone training or microphone arrangement with regard to its microphone design.
- a voice-controlled operating method of a similar type is known from DE 19533541 C1.
- voice control is treated as such.
- a very complex speech recognition process is used at which the aspects of noise reduction, echo compensation, feature extraction, syntax and semantics checking are dealt with separately. It's just about the
- a multi-channel communication system with several microphones and several loudspeakers is known from EP 0721178 A 2.
- the entire system is designed for at least two speaking people who are connected to each other in the transmit / receive mode.
- the transmission means select the voice message from an overall background noise.
- a so-called error or comparison microphone is brought very close to the speaking person via the seat belt.
- the microphone location is also determined here. Otherwise, the design according to this document is designed for the transmission / reception operation of two or more people.
- EP 0773531 A a frequency-selective control system for acoustic systems.
- Prevention of overdrive is the focus here.
- An improvement in the reception quality of the voice message is neglected.
- a system of a similar type is also known from EP 0721179 A 2.
- the adaptive tonal control system disclosed there for eliminating stability problems also treats the prevention of the oversteer mentioned above.
- this cross-section from the prior art shows that one is fundamentally concerned with improving the voice signal already received.
- an improvement in the recording quality at the location of the speech production is neglected in many cases, if not in principle.
- the invention is therefore based on the object of further developing a method and a device of the generic type in such a way that the recording quality of the voice signal input into the system is fundamentally improved.
- the stated object is achieved according to the invention in a method of the generic type by the characterizing features of patent claim 1.
- the central point of the invention is the definition of a virtual, optimized microphone location. As intended, this is defined virtually where the language source is, i.e. at the location of the speaker's head.
- This so-called spatial noise or speech source recognition can e.g. be carried out by means of transit time measurement. In the case of a multiple arrangement of microphones, this means that the speech source can be recognized in its spatial position by means of a transit time measurement during the speech process.
- the amount and phase of the microphones are added in such a way that the useful signals are added and amplified, but the interference signals which are not correlated with the useful signal are optimally masked out. This means that all microphones have a supporting function and are included in the evaluation. It is not a question of post-processing the microphone signal, but rather an improvement of the speech signal fed into the transmission chain.
- the principle of the invention is particularly advantageous in that a microphone which has been selected in this way or the transit time measurement on which it is based can be combined with a position determination of the head of the speaking person.
- the head position data can be generated in this way via the speech source recognition or the so-called virtual microphone location determination, via which the security systems can be controlled in a qualified manner.
- the head position is also determined in parallel to the normal speech mode for car telephones or voice input units, without having to provide any additional means.
- the safety system can be controlled if necessary so that the airbag is not triggered.
- the system is thus multifunctional overall, although there is essentially an increase in the voice quality at the point of detection. This leads to a more understandable transmission during speech operation in a car telephone system.
- the voice commands are recognized and implemented more reliably in voice input-controlled units in the motor vehicle.
- Figure 1 Basic structure in system overview.
- Figure 2 embodiment of an electronic structure according to the invention.
- FIG. 1 shows the structure of the basic elements as well as the functional connection between them. There are no detailed descriptions and only a system overview is shown.
- a plurality of microphones 1, 2, 3 is arranged spatially distributed within the motor vehicle.
- an arrangement with two microphones can suffice with a correspondingly favorably chosen positioning.
- the choice of microphone locations is arbitrary and can either be permanently installed in fittings or be spatially distributed in the motor vehicle by means of further fastening elements. Basically, however, the fact remains that several microphones are required per seat. However, 3 microphones are required for exact 3-D localization. The microphone locations must span a 3-dimensional space and must not be on one level. If, on the other hand, the microphones are too far apart, the transit time or correlation measurement is not sufficiently accurate.
- All microphones deliver a corresponding signal, which is combined to form a signal evaluation 10. If a voice message is now given in the vehicle, it is received by all microphones. However, since these are spatially distributed, on the one hand the quality of the received signal is different, and on the other hand, with the most precise evaluation, runtime differences arise which are generated by the limited speed of sound. A runtime determination is then carried out within the signal evaluation 10, and the location of the noise or speech generation is determined from the correlation of all microphone signals. The spatial coordinates for the speech source determined in this way then permit electronic determination of the so-called virtual microphone location.
- a further procedure can, however, also consist in the fact that basically all microphone signals are always evaluated, and the voice message can be continuously verified by means of a plausibility check by comparing the individual microphone signals.
- the signal evaluation 10 is connected bidirectionally in terms of signal technology to a subsequent microphone location determination unit 20.
- a reception lobe determination and a corresponding calculation can then be carried out or the selection of the current main microphone can be determined.
- the microphone location determination unit 20 is in turn connected in terms of signal technology to a calculation unit 30, with the aid of which a determination of the position of the head is carried out from the determined data or signals.
- the further calculation for example in a comparison with samples, can now lie here.
- the comparison with samples can shorten the computing time considerably, because then you do not have to calculate every time from initio.
- the so-called "out of position" positions of the head of the speaking person with regard to an airbag deployment can be recognized immediately.
- the calculation unit 30 is subsequently connected to the signal generation for the safety systems 40 such as airbag, belt tensioners and the like .
- the bidirectional connection SB between the signal evaluation 10 and the microphone location determination unit 20 enables the control of the microphones, which is the focus here, depending on the position of the head of the speaking person.
- the invention If the head of the corresponding person now moves during speech operation, the invention, so to speak, tracks a virtual microphone location.
- the speech mode starts with a positionally optimized microphone X 1 and the position changes during the speech mode, the optimum microphone location is tracked during the speech mode, for example by shifting to the microphone X 2 as a quasi-dominant microphone.
- the virtual microphone location once determined as optimal, naturally changes when the position of the head of the speaking person changes. This is captured in the essence of the invention and solved here in an advantageously simple manner. It is a special case if the virtual microphone location coincides with one of the actual microphones. In the main, however, a collective microphone signal evaluation takes place, in which the directional characteristic is adapted to the changed position of the head by correspondingly shifting the quasi-ranking in the evaluation of the individual microphone signals.
- FIG. 2 shows a simple basic circuit arrangement for realizing the mode of operation shown only systematically in FIG. 1.
- the microphones 1,2,3 are each connected to an adjustable amplifier 4,5,6. These adjustable amplifiers are controlled via the evaluation device 7. Two of the adjustable amplifiers can also be coupled or correlated on the control side. Furthermore, the individual amplifier output signals are also sent to said evaluation device 7. At the same time, the amplified microphone signals are connected to an adder 8, which is connected on the output side to the device 9 for transmitting the audio signals.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Circuit For Audible Band Transducer (AREA)
- Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE19812697 | 1998-03-23 | ||
DE19812697A DE19812697A1 (en) | 1998-03-23 | 1998-03-23 | Method and device for operating a microphone arrangement, in particular in a motor vehicle |
PCT/EP1999/001037 WO1999049698A1 (en) | 1998-03-23 | 1999-02-17 | Method and device for operating a microphone system, especially in a motor vehicle |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1064822A1 true EP1064822A1 (en) | 2001-01-03 |
EP1064822B1 EP1064822B1 (en) | 2002-01-16 |
Family
ID=7861976
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP99910231A Expired - Lifetime EP1064822B1 (en) | 1998-03-23 | 1999-02-17 | Method and device for operating a microphone system, especially in a motor vehicle |
Country Status (5)
Country | Link |
---|---|
US (1) | US6748088B1 (en) |
EP (1) | EP1064822B1 (en) |
JP (1) | JP4226214B2 (en) |
DE (2) | DE19812697A1 (en) |
WO (1) | WO1999049698A1 (en) |
Families Citing this family (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10217778A1 (en) * | 2002-04-18 | 2003-11-06 | Volkswagen Ag | Communication device for the transmission of acoustic signals in a motor vehicle |
US8189825B2 (en) * | 1994-05-09 | 2012-05-29 | Breed David S | Sound management techniques for vehicles |
DE19843109C2 (en) * | 1998-09-21 | 2000-11-09 | Hcd Gmbh | Process for the production of a surface-structured, film-like semi-finished product with pressure application |
DE19942868A1 (en) | 1999-09-08 | 2001-03-15 | Volkswagen Ag | Method for operating a multiple microphone arrangement in a motor vehicle and a multiple microphone arrangement itself |
DE19943875A1 (en) | 1999-09-14 | 2001-03-15 | Thomson Brandt Gmbh | Voice control system with a microphone array |
DE19943872A1 (en) * | 1999-09-14 | 2001-03-15 | Thomson Brandt Gmbh | Device for adjusting the directional characteristic of microphones for voice control |
DE19958836A1 (en) * | 1999-11-29 | 2001-05-31 | Deutsche Telekom Ag | In car communication system has individual microphones and loudspeakers allows easy conversation |
DE10035222A1 (en) * | 2000-07-20 | 2002-02-07 | Bosch Gmbh Robert | Acoustic location of persons in detection area, involves deriving signal source position from received signal time displacements and sound detection element positions |
US7130705B2 (en) * | 2001-01-08 | 2006-10-31 | International Business Machines Corporation | System and method for microphone gain adjust based on speaker orientation |
US20030125959A1 (en) * | 2001-12-31 | 2003-07-03 | Palmquist Robert D. | Translation device with planar microphone array |
DE10217822C1 (en) * | 2002-04-17 | 2003-09-25 | Daimler Chrysler Ag | Viewing direction identification method for vehicle driver using evaluation of speech signals for determining speaking direction |
JP3910898B2 (en) * | 2002-09-17 | 2007-04-25 | 株式会社東芝 | Directivity setting device, directivity setting method, and directivity setting program |
DE10308414B4 (en) * | 2003-02-27 | 2007-10-04 | Bayerische Motoren Werke Ag | Method for controlling an acoustic system in the vehicle |
EP1524879B1 (en) * | 2003-06-30 | 2014-05-07 | Nuance Communications, Inc. | Handsfree system for use in a vehicle |
DE10337852A1 (en) * | 2003-08-18 | 2005-03-17 | Robert Bosch Gmbh | vehicle system |
DE10339973A1 (en) * | 2003-08-29 | 2005-03-17 | Daimlerchrysler Ag | Intelligent acoustic microphone frontend with voice recognition feedback |
US20090136049A1 (en) * | 2004-10-04 | 2009-05-28 | Volkswagen Ag | Device and method for acoustic communication and/or perception in a motor vehicle |
DE102007002905A1 (en) * | 2007-01-19 | 2008-07-24 | Siemens Ag | Method and device for recording a speech signal |
JP2010010749A (en) * | 2008-06-24 | 2010-01-14 | Panasonic Corp | Microphone device |
FR2948484B1 (en) * | 2009-07-23 | 2011-07-29 | Parrot | METHOD FOR FILTERING NON-STATIONARY SIDE NOISES FOR A MULTI-MICROPHONE AUDIO DEVICE, IN PARTICULAR A "HANDS-FREE" TELEPHONE DEVICE FOR A MOTOR VEHICLE |
DE102011012573B4 (en) * | 2011-02-26 | 2021-09-16 | Paragon Ag | Voice control device for motor vehicles and method for selecting a microphone for operating a voice control device |
US9984675B2 (en) * | 2013-05-24 | 2018-05-29 | Google Technology Holdings LLC | Voice controlled audio recording system with adjustable beamforming |
EP3029563B1 (en) * | 2013-08-30 | 2018-06-27 | Huawei Technologies Co., Ltd. | Stereophonic sound recording method, apparatus, and terminal |
US11514789B2 (en) | 2018-01-05 | 2022-11-29 | Arriver Software Llc | Illumination-based object tracking within a vehicle |
WO2019136383A1 (en) | 2018-01-05 | 2019-07-11 | Veoneer Us, Inc. | Vehicle microphone activation and/or control systems |
US10410516B1 (en) | 2018-05-24 | 2019-09-10 | Veoneer Us, Inc. | Systems and methods for vehicle geofencing management |
CN108882094B (en) * | 2018-07-27 | 2020-03-13 | 歌尔科技有限公司 | Feedback noise reduction earphone and feedback circuit thereof |
DE102019209941B4 (en) * | 2019-07-05 | 2021-12-16 | Zf Friedrichshafen Ag | Determination of deployment characteristics of an airbag |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5829782A (en) * | 1993-03-31 | 1998-11-03 | Automotive Technologies International, Inc. | Vehicle interior identification and monitoring system |
US5267323A (en) * | 1989-12-29 | 1993-11-30 | Pioneer Electronic Corporation | Voice-operated remote control system |
CA2049173C (en) * | 1990-08-16 | 1996-06-25 | Shoji Fujimoto | Speech recognition apparatus |
FR2687496B1 (en) * | 1992-02-18 | 1994-04-01 | Alcatel Radiotelephone | METHOD FOR REDUCING ACOUSTIC NOISE IN A SPEAKING SIGNAL. |
GB9314822D0 (en) * | 1993-07-17 | 1993-09-01 | Central Research Lab Ltd | Determination of position |
DE4330243A1 (en) * | 1993-09-07 | 1995-03-09 | Philips Patentverwaltung | Speech processing facility |
US5366241A (en) * | 1993-09-30 | 1994-11-22 | Kithil Philip W | Automobile air bag system |
US5664021A (en) * | 1993-10-05 | 1997-09-02 | Picturetel Corporation | Microphone system for teleconferencing system |
SE502888C2 (en) | 1994-06-14 | 1996-02-12 | Volvo Ab | Adaptive microphone device and method for adapting to an incoming target noise signal |
US5602928A (en) * | 1995-01-05 | 1997-02-11 | Digisonix, Inc. | Multi-channel communication system |
US5828997A (en) | 1995-06-07 | 1998-10-27 | Sensimetrics Corporation | Content analyzer mixing inverse-direction-probability-weighted noise to input signal |
DE19531402C2 (en) * | 1995-08-26 | 1999-04-01 | Mannesmann Sachs Ag | Device and method for influencing vibrations in a passenger compartment of a motor vehicle and device and method for detecting defects in a motor vehicle |
US5710822A (en) * | 1995-11-07 | 1998-01-20 | Digisonix, Inc. | Frequency selective active adaptive control system |
DE19608869C2 (en) | 1996-03-07 | 1998-03-26 | Daimler Benz Ag | Operating system, in particular for components in a motor vehicle |
JP3522954B2 (en) * | 1996-03-15 | 2004-04-26 | 株式会社東芝 | Microphone array input type speech recognition apparatus and method |
US5715319A (en) * | 1996-05-30 | 1998-02-03 | Picturetel Corporation | Method and apparatus for steerable and endfire superdirective microphone arrays with reduced analog-to-digital converter and computational requirements |
US6192134B1 (en) * | 1997-11-20 | 2001-02-20 | Conexant Systems, Inc. | System and method for a monolithic directional microphone array |
JP3344647B2 (en) * | 1998-02-18 | 2002-11-11 | 富士通株式会社 | Microphone array device |
JP3863323B2 (en) * | 1999-08-03 | 2006-12-27 | 富士通株式会社 | Microphone array device |
US6529608B2 (en) * | 2001-01-26 | 2003-03-04 | Ford Global Technologies, Inc. | Speech recognition system |
-
1998
- 1998-03-23 DE DE19812697A patent/DE19812697A1/en not_active Ceased
-
1999
- 1999-02-17 DE DE59900630T patent/DE59900630D1/en not_active Expired - Lifetime
- 1999-02-17 US US09/646,826 patent/US6748088B1/en not_active Expired - Lifetime
- 1999-02-17 EP EP99910231A patent/EP1064822B1/en not_active Expired - Lifetime
- 1999-02-17 WO PCT/EP1999/001037 patent/WO1999049698A1/en active IP Right Grant
- 1999-02-17 JP JP2000538539A patent/JP4226214B2/en not_active Expired - Lifetime
Non-Patent Citations (1)
Title |
---|
See references of WO9949698A1 * |
Also Published As
Publication number | Publication date |
---|---|
EP1064822B1 (en) | 2002-01-16 |
US6748088B1 (en) | 2004-06-08 |
JP4226214B2 (en) | 2009-02-18 |
JP2002508642A (en) | 2002-03-19 |
DE59900630D1 (en) | 2002-02-21 |
DE19812697A1 (en) | 1999-09-30 |
WO1999049698A1 (en) | 1999-09-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1064822B1 (en) | Method and device for operating a microphone system, especially in a motor vehicle | |
DE102009051508B4 (en) | Device, system and method for voice dialog activation and guidance | |
EP1511010B1 (en) | Control of a microphone array using feedback of a speech recognition system, and speech recognizion using said array | |
DE102014201228B4 (en) | System and method for active noise control | |
DE19938171C2 (en) | Process for processing acoustic signals and communication system for occupants in a vehicle | |
EP0747880B1 (en) | System for speech recognition | |
EP3375204B1 (en) | Audio signal processing in a vehicle | |
DE10308414A1 (en) | Method for controlling an acoustic system in the vehicle | |
DE10156954B9 (en) | Image-based adaptive acoustics | |
EP1739654B1 (en) | Method for operating a multiple microphone system in a motor vehicle and multiple microphone system | |
EP3576431A1 (en) | Method for operating a loudspeaker unit and a loudspeaker unit | |
DE102013007141A1 (en) | Speech input system for motor car, has control unit arranged such that change of current speech input on safety belt is exposed to microphone when signal from microphone selected for speech inputs is actually detected at seat | |
DE102010005802A1 (en) | Device for compensation of wind noise in inner space of motor car, has local microprocessor computing adapted characteristic of regulation and/or transfer function from parameters and carrying out control function at feedback stage | |
DE102015014916A1 (en) | Method for outputting audio signals | |
WO2014138758A2 (en) | Method for increasing the comprehensibility of speech | |
DE102006009568A1 (en) | Acoustic system for vehicle, has acoustic units coupled with each other by level balancers and echo compensators so that passengers communicate with each other, and activation and deactivation unit for activation and deactivation of units | |
DE10013432C1 (en) | Microphone device installed in automobile positioned in front of driver facing towards front windscreen for reception of speech signals reflected from windscreen surface | |
EP3639525B1 (en) | Microphone system for a motor vehicle having a directivity pattern and signal improvement | |
DE102016005904A1 (en) | Instantaneous noise suppression in a motor vehicle | |
DE102006040651A1 (en) | Vehicle collision detection device, has evaluation circuit detecting collision using signals from impact and non-directional airborne sound sensor systems arranged in housing and characterizing collision object using airborne sound signal | |
DE102004035988A1 (en) | Emergency call system for a passenger transport system, in particular for a motor vehicle, and method for the automatic transmission of an emergency call | |
EP2996313B1 (en) | Communication system for motor vehicles | |
WO2007009505A1 (en) | Ensuring privacy during public announcements | |
DE102017003567A1 (en) | Method for determining a position of an occupant | |
DE102015010723B3 (en) | Selective sound signal acquisition in the motor vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20001023 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): DE ES FR GB IT |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
17Q | First examination report despatched |
Effective date: 20010509 |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: IF02 |
|
RIC1 | Information provided on ipc code assigned before grant |
Free format text: 7H 04R 3/00 A, 7H 04R 1/40 B, 7B 60R 16/02 B, 7G 10L 21/00 B |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE ES FR GB IT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED. Effective date: 20020116 |
|
REF | Corresponds to: |
Ref document number: 59900630 Country of ref document: DE Date of ref document: 20020221 |
|
GBT | Gb: translation of ep patent filed (gb section 77(6)(a)/1977) |
Effective date: 20020417 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20020730 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed | ||
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R084 Ref document number: 59900630 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R084 Ref document number: 59900630 Country of ref document: DE Effective date: 20110702 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 18 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 19 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20180227 Year of fee payment: 20 Ref country code: DE Payment date: 20180228 Year of fee payment: 20 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20180227 Year of fee payment: 20 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R071 Ref document number: 59900630 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: PE20 Expiry date: 20190216 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20190216 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230523 |