EP1657960A1 - Method for detection of ultrasound in a listening device with two or more microphones, and listening device with two or more microphones - Google Patents

Method for detection of ultrasound in a listening device with two or more microphones, and listening device with two or more microphones Download PDF

Info

Publication number
EP1657960A1
EP1657960A1 EP04388075A EP04388075A EP1657960A1 EP 1657960 A1 EP1657960 A1 EP 1657960A1 EP 04388075 A EP04388075 A EP 04388075A EP 04388075 A EP04388075 A EP 04388075A EP 1657960 A1 EP1657960 A1 EP 1657960A1
Authority
EP
European Patent Office
Prior art keywords
microphone
ultrasound
signal
microphones
listening device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP04388075A
Other languages
German (de)
French (fr)
Other versions
EP1657960B1 (en
Inventor
Kim Spetzler Petersen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oticon AS
Original Assignee
Oticon AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oticon AS filed Critical Oticon AS
Priority to EP04388075.6A priority Critical patent/EP1657960B1/en
Priority to DK04388075T priority patent/DK1657960T3/en
Publication of EP1657960A1 publication Critical patent/EP1657960A1/en
Application granted granted Critical
Publication of EP1657960B1 publication Critical patent/EP1657960B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/43Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40Arrangements for obtaining a desired directivity characteristic
    • H04R25/407Circuits for combining signals of a plurality of transducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/005Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

  • the invention concerns a method for detection of ultra sound in a listening device and a listening device with a plurality of microphones wherein means are provided for detection of the presence of ultrasound.
  • the invention concerns a method for detecting ultrasound and eliminating the harmful influence of ultra sound in a listening device having two or more microphones, whereby firstly the energy contents in the microphone signals is determined, and whereby time related changes in energy contents of the microphone signals is analysed to determine whether any of the microphones is subjected to an ultrasound sound-field, and whereby the signal from the microphone signal with the lowest content of ultrasound is routed through a signal processing device to an output unit.
  • the two microphone are often influenced quite differently by the ultra sound. Due to the very short wavelength of the ultrasound, one microphone port may be strongly influenced while the other port is hardly effected at all. This is used by the method in that the influence on the microphones of the ultrasound is monitored continuously and the signal from the microphone channel which is the least influenced by the ultra sound is routed to an output unit.
  • the signal processing device is preferably a digital signal processing device and the output unit could be a receiver or other device externally or implanted into the ear or brain for providing a sensation of sound corresponding to the audio sounds in the environment.
  • At least one microphone sound inlet is protected with an ultrasound protection device and at least one inlet is un-protected against ultrasound and further means are provided for detecting the presence of ultra sound.
  • the detection means detects the presence of ultrasound, and if ultrasound is present, then the signal from the protected microphone is routed to the output devcie.
  • the power in the two channels will be different since the protected channel will attenuate the signal and the unprotected will not.
  • the power in the two channels it is possible to detect the ultrasound signal, since we know which channel is protected. The energy in the protected channel will be lower than the energy in the unprotected channel. We also know that the energy in the signal is very powerful since the signal results in saturation of the microphones and/or the A/D converters. If the ultrasounds energy is lower than the saturation limit the sound will not result in any problems for the device. If ultrasound is measured the system automatically shifts to the signal from the channel with the protection.
  • the invention also comprises a listening device with two or more microphones whereby the listening device has means for detecting the presence of ultrasound in at least one microphone channel.
  • the microphones and the A/D converters delivers the input to the system.
  • the following signal processing calculates a mean value of the energy in each microphone channel.
  • the energy of each channel is forwarded into the analyse block. This block decides if the signal picked up by the microphones is ultra sound or not.
  • the analyse block looks at the energy contents in the signal from the microphone channels, and when the energy in one or more channels rises very fast above a given limit and reaches a value close to or at the saturation limit, the signal from another microphone is routed to the hearing aid user. In this event any on-going directional- or other multi microphone algorithm must be terminated, and to this end a status value is routed from the analyse block to an overall control block of the listening device. Tests have shown that when a hearing aid or other listening device with microphones provided close to each other is moved about in an ultrasound sound field, at least one of the microphones will at most times be relatively un-affected by the ultra sound.
  • the user of the listening device to have at least one microphone functioning at most times also when the user is in a sound field of a ultrasound generator. Since the person is moving in the ultra sound field, and thereby changing the situation, the device must react fast.
  • the purpose of the device is to use the microphone with the least amount of energy, when ultra sound is detected.
  • Ad. 1 The limit value depends on the limit of saturation in a microphone. For a hearing aid microphone this limit is around 115-120 dB spl.
  • Ad. 2 The given number of times X depends on the efficiency of the ultrasound attenuation device provided at the at least one microphone.
  • Ad. 1 The limit value depends on the limit of saturation in a microphone. For hearing a aid microphone is this limit around 115-120 dB spl.
  • Ad. 2 The given number of times X depends on the efficiency of the ultrasound attenuation device provided at the at least one microphone.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The invention concerns a method for detecting and minimizing the harmful influence of ultra sound in a listening device having two or more microphones. The energy contents in the microphone signals is determined, and time related changes in energy contents of the microphone signals is analysed to determine whether any of the microphones is subjected to an ultrasound sound-field, and the signal from the microphone with the lowest content of ultrasound is routed through a signal processing device to an output unit. The invention further concerns a listening device having means for choosing the microphone channel with the lowest level of ultrasound.

Description

    AREA OF THE INVENTION
  • The invention concerns a method for detection of ultra sound in a listening device and a listening device with a plurality of microphones wherein means are provided for detection of the presence of ultrasound.
  • BACKGROUND OF THE INVENTION
  • When a hearing aid is subject to an ultrasound field in the environment very annoying side effects may be experienced by the hearing aid user even if the ultrasound is at a frequency far above audio range of the human ear. One side effect is possible saturation of microphones and the analogue to digital converter of the apparatus. The saturation is a result of the very powerful sound pressures which are not un-common in connection with ultrasound devices like automatic dor-openers or alarm systems. Another side effect is caused by the nonlinearity whereby the sound waves will often convolve down and result in the generation of sound in the audio frequency range, where people can hear it as noise. Also headsets or other listening devices having microphones may be adversely effected by the presence of ultrasound in the environment.
  • One way to reduce this effect is to use a ¼ wave resonator or other filter in the inlets before the microphones which reduces or removes the ultrasound before it reaches the microphone. This arrangement can be very costly because each microphone inlet must be modified to accommodate either the filter or the ¼ wave resonator, and further this complicates the production. Also filters may not in all instances be sufficient, in order to remove all harmful effects of the ultrasound sound field.
  • SUMMARY OF THE INVENTION
  • The invention concerns a method for detecting ultrasound and eliminating the harmful influence of ultra sound in a listening device having two or more microphones, whereby firstly the energy contents in the microphone signals is determined, and whereby time related changes in energy contents of the microphone signals is analysed to determine whether any of the microphones is subjected to an ultrasound sound-field, and whereby the signal from the microphone signal with the lowest content of ultrasound is routed through a signal processing device to an output unit.
  • When a listening device as a hearing aid with two or more microphones is placed in a ultrasound sound-field, the two microphone are often influenced quite differently by the ultra sound. Due to the very short wavelength of the ultrasound, one microphone port may be strongly influenced while the other port is hardly effected at all. This is used by the method in that the influence on the microphones of the ultrasound is monitored continuously and the signal from the microphone channel which is the least influenced by the ultra sound is routed to an output unit. The signal processing device is preferably a digital signal processing device and the output unit could be a receiver or other device externally or implanted into the ear or brain for providing a sensation of sound corresponding to the audio sounds in the environment.
  • In a further embodiment of the invention at least one microphone sound inlet is protected with an ultrasound protection device and at least one inlet is un-protected against ultrasound and further means are provided for detecting the presence of ultra sound. According to the invention the detection means detects the presence of ultrasound, and if ultrasound is present, then the signal from the protected microphone is routed to the output devcie.
  • If ultrasound is present, the power in the two channels will be different since the protected channel will attenuate the signal and the unprotected will not. By measuring the power in the two channels it is possible to detect the ultrasound signal, since we know which channel is protected. The energy in the protected channel will be lower than the energy in the unprotected channel. We also know that the energy in the signal is very powerful since the signal results in saturation of the microphones and/or the A/D converters. If the ultrasounds energy is lower than the saturation limit the sound will not result in any problems for the device. If ultrasound is measured the system automatically shifts to the signal from the channel with the protection.
  • In situations with no ultrasound the power in the two channels will be almost equal because the ultrasound protection only influence the high frequency area with ultrasound.
  • The invention also comprises a listening device with two or more microphones whereby the listening device has means for detecting the presence of ultrasound in at least one microphone channel.
  • BRIEF DESCRIPTION OF THE DRAWINGS
    • Fig. 1 shows the device to detect the ultrasound according to the invention
    DESCRIPTION OF A PREFERRED EMBODIMENT
  • the microphones and the A/D converters delivers the input to the system. The following signal processing calculates a mean value of the energy in each microphone channel. The energy of each channel is forwarded into the analyse block. This block decides if the signal picked up by the microphones is ultra sound or not.
  • The analyse block looks at the energy contents in the signal from the microphone channels, and when the energy in one or more channels rises very fast above a given limit and reaches a value close to or at the saturation limit, the signal from another microphone is routed to the hearing aid user. In this event any on-going directional- or other multi microphone algorithm must be terminated, and to this end a status value is routed from the analyse block to an overall control block of the listening device. Tests have shown that when a hearing aid or other listening device with microphones provided close to each other is moved about in an ultrasound sound field, at least one of the microphones will at most times be relatively un-affected by the ultra sound. This is quite un-expected, but as shown it is very useful, as it allows the user of the listening device to have at least one microphone functioning at most times also when the user is in a sound field of a ultrasound generator. Since the person is moving in the ultra sound field, and thereby changing the situation, the device must react fast. The purpose of the device is to use the microphone with the least amount of energy, when ultra sound is detected.
  • When a microphone with an ultrasound attenuation device is used the analyse block works in the following way:
    1. 1) detect if the energy in the unprotected microphone is above a given limit,
    2. 2) compare the energy from the two channels. If the energy in the unprotected channel is a given number of times X larger than the energy in the protected channel, then the output should be "ultrasound detected", and a corresponding status value routed to the digital signal processing unit.
  • Ad. 1) The limit value depends on the limit of saturation in a microphone. For a hearing aid microphone this limit is around 115-120 dB spl.
    Ad. 2) The given number of times X depends on the efficiency of the ultrasound attenuation device provided at the at least one microphone.
  • When a microphone without an ultrasound attenuation device is used the analyse block works in the following way:
    1. 1) detect if the energy in one of the microphones is above a given limit,
    2. 2) compare the energy from the two channels. If the energy in the channel with the highest energy is a given number of times X larger than the energy in the other channel, the output should be "ultrasound detected", and a corresponding status value is routed to the digital signal processing unit.
  • Ad. 1) The limit value depends on the limit of saturation in a microphone. For hearing a aid microphone is this limit around 115-120 dB spl.
    Ad. 2) The given number of times X depends on the efficiency of the ultrasound attenuation device provided at the at least one microphone.
  • The above example regards a device having two microphones, but the inventive concept is easily extended to devices having three or more microphones.

Claims (6)

  1. Method for detecting and minimizing the harmful influence of ultra sound in a listening device having two or more microphones, whereby the energy contents in the microphone signals is determined, and whereby time related changes in energy contents of the microphone signals is analysed to determine whether any of the microphones is subjected to an ultrasound sound-field, and whereby the signal from the microphone signal with the lowest content of ultrasound is routed through a signal processing device to an output unit.
  2. Method as claimed in claim 1, whereby at least one signal from a microphone without an ultrasound attenuation device is provided and whereby further at least one signal from a microphone with an ultrasound attenuation device is provided and whereby the signal energy content in the signals from the different microphones is analysed to determine whether the device is in a ultrasound soundfield, and whereby the signals from the microphone or microphones with the ultrasound attenuation devices is/are routed through a signal processing device to an output unit.
  3. Listening device with two or more microphones each providing an electrical signal, a signal processing device and a receiver for delivering a signal to the user in order to provide a sensation of sound, whereby the signal processing device comprises means for calculating the energy content in the signal from each microphone and means for detecting the situation whereby the electrical signal from at least one of the microphones reaches an energy content close to or at the saturation point, whereby further the signal processing comprises means for routing the signal from a microphone channel with a lower energy content to the receiver.
  4. Listening device as claimed in claim 3 whereby the microphones comprises inlet canals and whereby at least one of the microphone inlet canals comprises mechanical means for attenuating the ultrasound passing from the surrounding to the hearing aid and whereby further at least one microphone inlet canal is un-protected from the ultrasound energy, and whereby the means for routing the signal from a microphone channel is adapted to rout the signal from the channel comprising the mechanical attenuation means to the receiver.
  5. Listening device as claimed in claim 4 whereby the mechanical means comprises a ¼ band resonator.
  6. Listening device as claimed in claim 4 whereby the mechanical means comprises ultrasound attenuating filter material.
EP04388075.6A 2004-11-16 2004-11-16 Method for detection of ultrasound in a listening device with two or more microphones, and listening device with two or more microphones Not-in-force EP1657960B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP04388075.6A EP1657960B1 (en) 2004-11-16 2004-11-16 Method for detection of ultrasound in a listening device with two or more microphones, and listening device with two or more microphones
DK04388075T DK1657960T3 (en) 2004-11-16 2004-11-16 Method for detecting ultrasound in a listening device with two or more microphones, and listening device with two or more microphones

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP04388075.6A EP1657960B1 (en) 2004-11-16 2004-11-16 Method for detection of ultrasound in a listening device with two or more microphones, and listening device with two or more microphones

Publications (2)

Publication Number Publication Date
EP1657960A1 true EP1657960A1 (en) 2006-05-17
EP1657960B1 EP1657960B1 (en) 2013-06-26

Family

ID=34931967

Family Applications (1)

Application Number Title Priority Date Filing Date
EP04388075.6A Not-in-force EP1657960B1 (en) 2004-11-16 2004-11-16 Method for detection of ultrasound in a listening device with two or more microphones, and listening device with two or more microphones

Country Status (2)

Country Link
EP (1) EP1657960B1 (en)
DK (1) DK1657960T3 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5775100A (en) * 1980-10-28 1982-05-11 Yasuo Sato Heaing aid
JPH07240990A (en) 1994-02-28 1995-09-12 Sony Corp Microphone device
JPH07240991A (en) 1994-02-28 1995-09-12 Sony Corp Microphone device
WO2004098232A1 (en) * 2003-04-28 2004-11-11 Oticon A/S Microphone, hearing aid with a microphone and inlet structure for a microphone

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0772375A3 (en) * 1995-10-31 1998-06-24 Lux-Wellenhof, Gabriele Hearing aid and supplementary apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5775100A (en) * 1980-10-28 1982-05-11 Yasuo Sato Heaing aid
JPH07240990A (en) 1994-02-28 1995-09-12 Sony Corp Microphone device
JPH07240991A (en) 1994-02-28 1995-09-12 Sony Corp Microphone device
WO2004098232A1 (en) * 2003-04-28 2004-11-11 Oticon A/S Microphone, hearing aid with a microphone and inlet structure for a microphone

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 006, no. 151 (E - 124) 11 August 1982 (1982-08-11) *
PATENT ABSTRACTS OF JAPAN vol. 1996, no. 01 31 January 1996 (1996-01-31) *

Also Published As

Publication number Publication date
DK1657960T3 (en) 2013-09-30
EP1657960B1 (en) 2013-06-26

Similar Documents

Publication Publication Date Title
US10327071B2 (en) Head-wearable hearing device
US8649539B2 (en) Method for processing the signals from two or more microphones in a listening device and listening device with plural microphones
JP3165044B2 (en) Digital hearing aid
US20110135106A1 (en) Method and a system for processing signals
US8737630B2 (en) Acoustical measuring/estimation device
AU2005276428A1 (en) Low frequency phase matching for microphones
CN102246541A (en) System, method and hearing aids for in situ occlusion effect measurement
WO2016153149A2 (en) Auditory information security system
WO2016069615A1 (en) Self-voice occlusion mitigation in headsets
US10341760B2 (en) Electronic ear protection devices
CN108429996A (en) Active noise control method, circuit and relevant device
EP1629691A1 (en) Oscillation suppression
CN109788420B (en) Hearing protection system with self-speech estimation and related methods
EP2592605A1 (en) Methods and systems to support auditory signal detection
CN217064005U (en) Hearing device
EP1657960A1 (en) Method for detection of ultrasound in a listening device with two or more microphones, and listening device with two or more microphones
US20060104465A1 (en) Method for detection of ultrasound in a listening device with two or more microphones, and listening device with two or more microphones
WO2003015460A3 (en) Sound processing system including wave generator that exhibits arbitrary directivity and gradient response
DK176182B1 (en) Method is for detection of and minimizing harmful effects of ultra-sound in listening installation with two or more microphones
JPH10126896A (en) Inspecting device for hearing aid
KR101022312B1 (en) Earmicrophone
KR101071066B1 (en) Noise measurement device for electrical equipment
EP2835983A1 (en) Hearing instrument presenting environmental sounds
CA2526786A1 (en) Oscillation detection
WO2006125679A2 (en) Hearing device and method for supplying audio signals to a user wearing such hearing device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LU MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL HR LT LV MK YU

17P Request for examination filed

Effective date: 20061117

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LU MC NL PL PT RO SE SI SK TR

17Q First examination report despatched

Effective date: 20071031

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602004042530

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04R0029000000

Ipc: H04R0025000000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 25/00 20060101AFI20130109BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LU MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 619141

Country of ref document: AT

Kind code of ref document: T

Effective date: 20130715

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602004042530

Country of ref document: DE

Effective date: 20130822

REG Reference to a national code

Effective date: 20130926

Ref country code: DK

Ref legal event code: T3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130927

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 619141

Country of ref document: AT

Kind code of ref document: T

Effective date: 20130626

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130926

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20130626

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20131125

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131026

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131028

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130710

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20131125

Year of fee payment: 10

Ref country code: DE

Payment date: 20131122

Year of fee payment: 10

Ref country code: CH

Payment date: 20131115

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131007

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20131202

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

26N No opposition filed

Effective date: 20140327

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602004042530

Country of ref document: DE

Effective date: 20140327

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20131116

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602004042530

Country of ref document: DE

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20141130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20130626

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20141116

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20041116

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20131116

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141130

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141130

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20150731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141130

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150602

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141116

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141201