EP3275211B1 - Procédé de fonctionnement d'un système électroacoustique et un système électroacoustique - Google Patents

Procédé de fonctionnement d'un système électroacoustique et un système électroacoustique Download PDF

Info

Publication number
EP3275211B1
EP3275211B1 EP16712305.8A EP16712305A EP3275211B1 EP 3275211 B1 EP3275211 B1 EP 3275211B1 EP 16712305 A EP16712305 A EP 16712305A EP 3275211 B1 EP3275211 B1 EP 3275211B1
Authority
EP
European Patent Office
Prior art keywords
signal
pressure
correction filter
eardrum
ear
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP16712305.8A
Other languages
German (de)
English (en)
Other versions
EP3275211A1 (fr
Inventor
Stephan Ernst
Marko HIIPAKKA
Birger Kollmeier
Florian DENK
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Carl Von Ossietzky Universitaet Oldenburg
Original Assignee
Carl Von Ossietzky Universitaet Oldenburg
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Carl Von Ossietzky Universitaet Oldenburg filed Critical Carl Von Ossietzky Universitaet Oldenburg
Publication of EP3275211A1 publication Critical patent/EP3275211A1/fr
Application granted granted Critical
Publication of EP3275211B1 publication Critical patent/EP3275211B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041—Mechanical or electronic switches, or control elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1016—Earpieces of the intra-aural type
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/05—Electronic compensation of the occlusion effect
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception

Definitions

  • the invention relates to a method for operating an electroacoustic system in which an electroacoustic device for at least partially occluding an auditory canal is arranged at least partially on an ear.
  • the invention also relates to an electroacoustic system which is operated according to such a method.
  • a transparent hearing aid is out of the document WO 2014/070825 A1 known.
  • the hearing system has a signal processing device. Filters are used to correct and modify the transmission characteristics in order to achieve acoustic transparency.
  • the document US 2006/0002574 A1 describes a canal hearing device that is implemented with a functionality that offers acoustic transparency as well as an energy-saving function so that a user can wear the device during the sleep phase or during inactivity without significant loss of the normal unsupported reaction in the ear canal.
  • the transparent mode has an in-situ acoustic transmission function that compensates for the insertion loss caused by the presence of a hearing aid in the ear canal.
  • the object on which the invention is based is achieved by means of a method and an electroacoustic system of the type mentioned at the beginning, with a signal processing device being used to process a signal arriving at the device, and in which at least one correction unit of the signal processing device is used to modify the signal arriving at the device is used, and by means of the at least one correction unit, an outgoing signal from the device is generated to achieve acoustic transparency, in which a received signal is generated based on the outgoing signal on the eardrum, which corresponds to a free-ear received signal on the eardrum with a free ear canal is adapted without the device, wherein the at least one correction unit has a first correction filter (A) and a second correction filter (B), and the first correction filter (A) of the at least one correction unit has the second correction turfilter (B) is connected upstream of the at least one correction unit, wherein the incoming signal is first modified by means of the first correction filter (A) to achieve the acoustic transparency, a total pressure (
  • the advantage here is that ambient noises can be perceived in sufficient quality despite an at least partially occluded ear canal.
  • the method and / or the electroacoustic system make it possible to monitor, control and / or manipulate the received signals, preferably a frequency response, on the eardrum.
  • This allows the electroacoustic system to be operated in an acoustic transparency mode.
  • the perception of ambient noise by a person using the electroacoustic system is preferably not, at most slightly and / or to a non-disruptive extent, or is not disturbed or changed due to the acoustic transparency.
  • the person using the electroacoustic system preferably experiences a sound perception, in particular approximately as if with a free auditory canal.
  • the method and / or the electroacoustic system enables a more pleasant, in particular natural, perception of ambient noises in the case of a partially and / or completely occluded ear canal.
  • the electroacoustic system can enable a large number of additional functions, for example in connection with entertainment electronics, with hearing protection, with a hearing aid and / or with a communication device, in particular a mobile phone and / or a smartphone.
  • a hearing aid can additionally be provided, preferably if required.
  • the received signal generated on the eardrum can be amplified and / or attenuated in comparison to the signal arriving at the device.
  • the acoustic transparency is preferably designed as a perceptual acoustic transparency.
  • perceptual and / or acoustic transparency means that there is no audible difference to a free-ear signal or a free-ear reception signal.
  • perceptual and / or acoustic transparency can be achieved without an absolute physical match between the received signal generated on the eardrum and a free-ear received signal in the case of a free auditory canal without having to reach the device. It is preferably sufficient if a person using the device has the perception that the received signal generated with the device corresponds in perceptual terms to the free-ear received signal in the case of a free auditory canal without the device.
  • the correction unit has a first correction filter and a second correction filter.
  • the first correction filter of the signal processing device is used to achieve the acoustic transparency.
  • the second correction filter of the signal processing device is used to modify the Device outgoing, in particular acoustic, signal used.
  • the first correction filter and / or the second correction filter can be designed as, in particular digital, electrical circuits.
  • the correction unit, the first correction filter and / or the second correction filter can have at least one analog-to-digital converter and / or at least one digital-to-analog converter.
  • the first correction filter of the correction unit is connected upstream of the second correction filter of the correction unit.
  • the incoming signal is first modified by means of the first correction filter to achieve acoustic transparency.
  • the changed incoming and / or incoming signal is then modified by means of the second correction filter to filter out transmission effects in the area from the device to the eardrum due to the at least partial occlusion of the auditory canal by means of the device.
  • a received signal is generated which corresponds to the free-ear received signal with a free auditory canal without the device.
  • a disruptive influence of the device at least partially occluding the auditory canal on the perception of ambient noises can thus be reduced and / or compensated for.
  • a received signal is generated which is adapted to and / or corresponds to a free-ear received signal in this area of the auditory canal section with a free auditory canal without the device .
  • the incoming, in particular acoustic, signal is fed to the signal processing device as an incoming electrical signal by means of an external sound receiver assigned to the device and directed away from the eardrum and outward.
  • At least one additional external acoustic and / or electrical signal is preferably fed to the signal processing device, in particular by means of an additional external sound receiver and / or a direct line connection to an additional external signal source.
  • the outer sound receiver and / or the additional outer sound receiver are each designed as a microphone.
  • the additional external acoustic and / or electrical signal can also be modified by means of the correction unit.
  • a negative feedback loop can be implemented by means of the electroacoustic system.
  • the external sound receiver and the additional external sound receiver are preferably used to implement the negative feedback loop.
  • a calibration is carried out before the electroacoustic system is used.
  • a first correction filter and / or a second correction filter is determined as part of the calibration.
  • the calibration preferably takes place after each insertion of the device for at least partially occluding the auditory canal.
  • the calibration is particularly preferably carried out by means of an external sound source and / or a calibration control.
  • a start calibration for determining the first correction filter and the second correction filter, in particular by means of an external sound source can first be carried out.
  • a single correction filter in particular the first correction filter or the second correction filter, is recalibrated as part of a partial calibration.
  • Headphones which are placed on an auricle with an inserted electroacoustic device, can serve as an external sound source for calibration.
  • the use of a signal that hits the ear from the outside is particularly advantageous for detecting the spatial resolution of an incoming signal.
  • the calibration control can be in the device, an earpiece, a computer and / or a smartphone.
  • the calibration control has a processor.
  • the calibration controller can be connected to the electroacoustic device by means of a cable, a wireless connection, a near field communication and / or Bluetooth.
  • An individual calibration is preferably carried out for the respective person using the device and / or after each insertion of the device into the auditory canal.
  • a calibration and / or setting of the first and / or second correction filter is carried out during ongoing operation. This enables readjustment to be carried out.
  • a readjustment is preferably carried out if at least one predetermined triggering parameter is given. For example, readjustment can take place at specified times or at specified time intervals. Alternatively or additionally, a readjustment can be initialized if at least one predetermined and monitored trigger parameter is reached, undershot or exceeded.
  • the correction unit, the first correction filter and / or the second correction filter is recalibrated and / or adjusted during operation.
  • a continuous and / or discontinuous calibration, in particular in connection with a start and / or initial calibration, can thus take place.
  • a first correction filter of the correction unit is preferably determined on the basis of a first model and / or a second correction filter of the correction unit on the basis of a second model.
  • the first model and / or the second model is preferably based on the Thévenin equivalent and / or the Norton equivalent. These models are tried and tested and enable a sufficiently precise estimate of the relevant parameters.
  • the total pressure P tot of an external acoustic signal within the auditory canal is made up of two parts for determining a first correction filter A of the correction unit.
  • a first part of the total pressure P tot is preferably a passage pressure P HT measured by means of an internal sound receiver assigned to the device and facing an eardrum of the ear.
  • the inner sound receiver can be designed as a microphone.
  • the passage pressure P HT is a sound pressure of an external acoustic signal after passage through the auditory canal at least partially occluded with the device.
  • a second part of the total pressure P tot is preferably a pressure P EP emitted by means of a sound generator assigned to the device and facing the eardrum.
  • the sound generator can be designed as a loudspeaker and / or receiver.
  • At least one further and / or additional sound generator can be provided.
  • the at least one additional sound generator can be arranged at an end facing the eardrum or an end of the device facing away from the eardrum.
  • a pressure is preferably to be understood as a pressure frequency.
  • a pressure frequency response at a sound receiver and / or an eardrum results from a pressure frequency of a signal source, a noise source and / or a sound generator.
  • a total pressure P tot of an external acoustic signal within the auditory canal, which is at least partially occluded with the device is equated with an expected target pressure P T, E, taking into account the first correction filter (A).
  • a fine adjustment of the first correction filter A is carried out.
  • At least one predetermined calibration signal and / or a predetermined noise is preferably used.
  • the calibration signal can be in the form of white noise.
  • a pressure P E measured by means of an inner sound receiver assigned to the device and facing an eardrum of the ear is compared with a target pressure P T, E at the position of the inner sound receiver.
  • the first correction filter A can be iteratively adapted in the event of a deviation of the measured pressure P E from the target pressure P T, E until a predetermined convergence criterion is reached.
  • a pressure P E measured by means of an inner sound receiver assigned to the device and facing an ear drum is equated with an expected target pressure P T, E at the inner sound receiver, the expected target pressure P T, E at the inner sound receiver is estimated as a pressure at the location of the inner sound receiver with a free ear canal without the device.
  • the target pressure P T, E to be expected at the inner sound receiver with a free auditory canal can be estimated by means of an electroacoustic model, in particular with a Thevenin pressure source model and / or a source impedance model.
  • an estimation of the acoustic received signal is carried out on the eardrum.
  • a pressure on the eardrum P D is preferably estimated by means of a pressure P E measured on the inner sound receiver using an electroacoustic model of the auditory canal.
  • the second correction filter B can be determined with knowledge of the pressure at the eardrum P D and the pressure P E measured at the inner sound receiver.
  • the electroacoustic system with the electroacoustic device for at least partially occluding an auditory canal has a signal processing device for processing a signal arriving at the device.
  • the signal processing device has at least one correction unit for modifying the signal arriving at the device.
  • the correction unit is used to provide and / or generate an outgoing signal from the device, which serves to achieve acoustic transparency, in which a received signal can be generated on the basis of the outgoing signal on the eardrum that corresponds to a free-ear received signal on the eardrum adapted to a free ear canal without the device is.
  • the correction unit has a first correction filter and a second correction filter.
  • the first correction filter (A) of the correction unit is connected upstream of the second correction filter (B) of the correction unit, the incoming signal first being modified by means of the first correction filter (A) to achieve acoustic transparency.
  • the changed incoming signal is then modified by means of the second correction filter (B) to filter out transmission effects in the area from the device (10) to the eardrum due to the at least partial occlusion of the auditory canal by means of the device (10).
  • the use of a method according to the invention and / or an electroacoustic system according to the invention in connection with hearing protection, in-ear headphones and / or a hearing aid is particularly advantageous.
  • the method according to the invention and / or the electroacoustic system can be used in connection with entertainment electronics and / or with a communication device, in particular a mobile phone and / or a smartphone.
  • the method and / or the electroacoustic system is integrated in an existing system and / or an existing device, such as, for example, in a hearing aid, an in-ear headphone, an in-the-ear hearing aid , a hearing aid, a behind-the-ear device and / or a communication device.
  • An external and / or additional, in particular acoustic, signal can be mixed with an ambient signal of an ambient noise. In particular, the mixing takes place after the first correction filter has been applied to the incoming signal and / or the ambient signal.
  • the signal processing device can be integrated in an in-the-ear device, a behind-the-ear device, a computer and / or a communication device, in particular in a mobile phone and / or smartphone.
  • the inner sound receiver, the outer sound receiver and / or the sound generator are preferably connected by means of a line to an in-the-ear device, a behind-the-ear device, a computer and / or a communication device, in particular in a mobile phone and / or smartphone , connected.
  • the acoustic transparency can enable a perception of ambient noises that is at least largely familiar to a person and / or spatial hearing in the case of a partially occluded ear canal.
  • the electroacoustic system, the correction unit, the first correction filter and / or the second correction filter are designed to attenuate and / or suppress sound radiation to the outside, in particular away from the person using the device and / or the eardrum.
  • the electroacoustic device can have a ventilation device.
  • the ventilation device can be designed as a ventilation channel in order to enable pressure equalization in the case of a device inserted into an auditory canal. In this way, the wearing comfort can be further improved.
  • the device and / or an earpiece can comprise an air-permeable material.
  • An inner sound receiver, an outer sound receiver and / or a sound generator can be arranged at least partially or completely within the ventilation device.
  • FIG. 1 shows a schematic representation of an electroacoustic device 10 for an electroacoustic system 11 according to the invention.
  • the device 10 has an ear piece 12.
  • the shape of the ear piece 12 is adapted to an individual auditory canal of a person not shown here.
  • at least one outer coating of the earpiece 12 can be designed to be elastic, as a result of which at least a partial adaptation of the surface of the earpiece 12 to the shape of an auditory canal is made possible.
  • the earpiece 12 can be arranged in an inner auricle shell and / or an auditory canal entrance.
  • the ear canal is at least partially, that is to say partially or completely, occluded by means of the earpiece 12.
  • the device 10 has an external sound receiver 13.
  • the external sound receiver 13 is designed as an external microphone.
  • the outer sound receiver 13 is directed away from an eardrum not shown here.
  • the outer sound receiver 13 is directed outwards to receive an incoming signal, namely acoustic ambient noise.
  • the outer sound receiver 13 is arranged, for example, in the surface of the earpiece 12. The location of the outer sound receiver 13 enables the incoming signal to be all spatial contains monaural information.
  • incoming acoustic signals are converted into electrical signals.
  • the device 10 has an internal sound receiver 14.
  • the internal sound receiver 14 is designed as an internal microphone.
  • the inner sound receiver 14 faces an eardrum, not shown in detail here.
  • the inner sound receiver 14 is directed inwards to detect a sound field in an auditory canal section from the device 10 or the earpiece 12 to the eardrum.
  • the inner sound receiver 14 is arranged, for example, in the surface of the earpiece 12. By means of the inner sound receiver 14, incoming acoustic signals are converted into electrical signals.
  • the device 10 has a sound generator 15.
  • the sound generator 15 is arranged in the area of the inner sound receiver 14. Furthermore, the sound generator 15 faces an eardrum (not shown in detail here) when the earpiece 12 is inserted in an ear and / or an auditory canal.
  • the sound generator 15 is arranged, for example, on the surface of the earpiece 12.
  • the sound generator 15 is directed inwards to emit the outgoing signal into the auditory canal section between the device 10 or the earpiece 12 and the eardrum.
  • the sound generator 15 is designed to convert an electrical signal into an acoustic signal.
  • the device 10 has a signal processing device 16.
  • the outer sound receiver 13, the inner sound receiver 14 and the sound transducer 15 are each connected to the signal processing device 16 by means of a line.
  • the signal processing device 16 is integrated into the earpiece 12 in this exemplary embodiment.
  • the signal processing device 16 can also be arranged outside the earpiece 12, for example in a housing for arrangement behind an ear or in an auricle.
  • the signal processing device 16 is designed, for example, as a digital signal processing device 16.
  • the signal processing device 16 has analog-to-digital converters and digital-to-analog converters which are connected to electroacoustic sound transducers, in particular to the outer sound receiver 13, the inner sound receiver 14 and the sound transducer 15. or corrections are carried out with respect to an incoming signal at the external sound receiver 13 and an outgoing signal from the sound generator 15.
  • the signal processing device 16 has a correction unit 17.
  • the correction unit 17 By means of the correction unit 17, an on the device 10 or the external sound receiver 13 incoming signal is corrected and / or modified in order to generate a signal outgoing from the device 10 or from the sound generator 15.
  • the correction unit 17 has a first correction filter A and a second correction filter B.
  • the signal processing device 16 is connected to an additional external signal source 18 by means of a line.
  • an additional external, in particular acoustic, signal can be fed to the signal processing device 16.
  • the additional signal source can be designed as entertainment electronics, a music source and / or a communication device.
  • the device 10 or the earpiece 12 has a ventilation device 19.
  • the ventilation device 19 is designed as a ventilation channel.
  • the ventilation device 19 enables a pressure equalization with a device 10 inserted into an auditory canal.
  • An air volume of an auditory canal section between the earpiece 12 and the eardrum is connected to the environment outside the auditory canal or the ear by means of the ventilation device 19.
  • the inner sound receiver 14 With an auditory canal at least partially occluded by means of the device 10 or the earpiece 12, the inner sound receiver 14 enables an estimation of a received signal and / or an acoustic signal on the eardrum, in particular a frequency response on the eardrum due to any noise source. This estimation can be made by assuming the mechanical-acoustic properties of the device 10 in such a way that the frequency response at the position of the inner sound receiver 14 and the eardrum are the same.
  • the pressure on the eardrum is estimated by means of the pressure measured at the position of the inner sound receiver 14 using an electroacoustic model of the auditory canal P.
  • FIG. 11 shows a schematic representation of an electroacoustic model 20 of the electroacoustic device 10 according to FIG Fig. 1 .
  • the device 10 or the earpiece 12 according to FIG Fig. 1 is modeled as a Norton and / or Thevenin equivalent electroacoustic velocity and / or pressure model, which is compared with the ear canal impedance as shown in FIG Figure 2 connected is.
  • the source parameters are applied to an electroacoustic circuit model that has a voltage source for pressure or a current source for speed, an internal source impedance, the ear canal as the two-port and the eardrum as the terminating impedance of the circuit.
  • the source terms P S for the pressure, Qs for the speed and Z S for the impedance are by means of measurements the impulse responses induced by the sources when connected to various loads of known theoretical impedances. These are therefore assumed to be known and are part of the electroacoustic auditory canal model P, which is dependent on the individual design of the device 10.
  • the abbreviation P L in the Figure 2 stands for the load pressure and the abbreviation Z L for the load impedance.
  • p is the air density and c is the speed of sound.
  • the acoustic properties of the auditory canal are taken into account in the modification or correction by means of the signal processing device 16 or the correction unit 17 .
  • Figure 3 shows a schematic representation of a logic circuit 21 of a signal processing with the electroacoustic device 10 according to Fig. 1 during a calibration.
  • the electroacoustic system 11, the device 10 or the earpiece 12 can be calibrated in situ, that is to say with an at least partially occluded ear canal.
  • the aim of the calibration is to obtain a predetermined pressure and / or a predetermined frequency response on the eardrum using a calibration routine.
  • filter A is determined.
  • an outgoing signal from the device 10 or the sound generator 15 can be generated by modifying the incoming signal, which signal generates a target pressure and / or a target frequency response at the position of the inner sound receiver 14.
  • the pressure P E or the target pressure P T, E at the position of the inner sound receiver 14 results on the basis of an ambient noise signal from a noise source 22.
  • the noise source 22 is outside the ear and causes usual ambient noise.
  • the acoustic signal emanating from the noise source 22 is divided into two partial signals 23, 24 within the auditory canal and in the case of an auditory canal that is at least partially occluded by means of the device 10 or the earpiece 12.
  • the first partial signal 23 is a through signal.
  • a pressure frequency response and / or a passage pressure P HT which is measured at the position of the inner sound receiver 14, is assigned to the first partial signal 23.
  • the second sub-signal 24 is a device output signal.
  • the second partial signal 24 is generated and emitted by the earpiece 12 in the direction of the eardrum by means of the sound generator 15.
  • the second partial signal 24 results from the signal arriving at the external sound receiver 13, which is modified by means of filtering by means of the first filter A and the second filter B and is then output by means of the sound generator 15.
  • An outgoing pressure frequency and / or an outgoing pressure P EP is assigned to the second partial signal 24.
  • the through pressure P HT and the outgoing pressure P EP are measured by means of the sound receivers 13, 14 using the noise source 22, which is designed as headphones in this exemplary embodiment, when the filters A and B are not used.
  • This first correction filter A is determined in the course of an initial calibration.
  • a fine adjustment of the correction filter A can then be carried out.
  • a predetermined calibration signal is used.
  • the calibration signal is designed as white noise.
  • the calibration signal is emitted by the noise source 22.
  • the frequency response and / or the pressure P E is measured by means of the internal sound receiver 14.
  • the correction filter A is adapted accordingly. If the measured pressure P E deviates from the target pressure P T, E, the first correction filter A is iteratively adapted until a predetermined convergence criterion is reached.
  • a target model T is introduced in order to provide the frequency response and / or the pressure on the eardrum as an individual estimate for each person using the device 10.
  • the frequency response and / or the target pressure P T, D on the eardrum is not determined or estimated. Instead, the target frequency response and / or the target pressure P T, E is estimated at the position of the inner sound receiver 14 with a free auditory canal.
  • An electroacoustic circuit model is used for this, which has a Thevenin pressure source model P S and a source impedance model Z S.
  • the source pressure P S is estimated by means of the frequency response measured at the external sound receiver 13 and / or the pressure measured there when an incoming signal is generated by the noise source 22.
  • the radiation of the source pressure P S into the auditory canal in the case of a free auditory canal is estimated by means of the radiation impedance Z RAD and the auditory canal impedance Z L.
  • the individual auditory canal impedance Z L which is dependent on the respective person, is determined by means of the measurements and calculations mentioned above. However, no individual measurements and / or determinations for the radiation impedance Z RAD are possible. Therefore, an estimated value is used that is is based on a theoretical model and measurements with test subjects, as described, for example, in the following document: M. Hiipakka, T. Kinnari, and V. Pulkki; "Estimating head-related transfer functions of human subjects from pressure-velocity measurements," The Journal of the Acoustical Society of America, 2012 .
  • the calibration described above for determining the first correction filter A and the second correction filter B is carried out after each insertion of the device 10 or the earpiece 12 into the ear or the auditory canal. In this way, changes due to a different position of the device 10 or of the earpiece 12 in the auditory canal or on the ear are taken into account. In this way, acoustic transparency with a particularly high quality can be achieved.
  • the correction filters A and B remain unchanged according to this exemplary embodiment.
  • adaptive tracking and / or recalibration of the correction filter A and / or B can take place, in particular during normal operation.
  • the first correction filter A is used to modify the incoming signal, as a result of which the outgoing signal or the outgoing pressure P EP is modified.
  • the second correction filter B information about the transmission path from the position of the inner sound receiver to the eardrum is taken into account when modifying the incoming signal at device 10 or when generating the outgoing signal.
  • Figure 4 shows a schematic representation of a logic circuit 25 with a signal processing device 16 of the electroacoustic device 10 according to FIG Fig. 1 .
  • an ambient noise is picked up as an incoming acoustic signal by the external sound receiver 13, converted into an incoming electrical signal and sent to the signal processing device 16.
  • the signal processing device 16 corrects and modifies the signal by means of the two correction filters A and B in order to match the frequency response and / or the pressure on the eardrum to the frequency response and / or the pressure on the eardrum in one case adapt to the free ear canal.
  • the two correction filters A and B due to the two correction filters A and B, the same frequency response and / or the same pressure is generated on the eardrum as with a free auditory canal.
  • Such acoustic transparency is made possible because the incoming signal at the external sound receiver 13 contains all directional information.
  • the transmission path from the inner auricle to the eardrum for both the free and the at least partially occluded ear canal is independent of the incoming signal direction or sound direction.
  • Fig. 1 and Fig. 4 becomes an to the ambient noise, for example from the noise source 22 according to FIG Fig. 3 , additional signal is supplied to an additional signal source 18 of the device 10.
  • the additional signal source 18 is designed as entertainment electronics and / or as an additional sound receiver for the device 10.
  • the additional signal is used to transmit information and / or to supplement the signal arriving at device 10.
  • the frequency response and / or the pressure on the eardrum due to the additional signal or the additional signal source 18 is modified in this exemplary embodiment by means of the previously determined correction filters A and / or B.
  • the additional signal is modified in such a way that undesired transmission effects of the auditory canal in an area between an end of the device 10 or the earpiece 12 facing the eardrum and the eardrum are weakened and / or avoided.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Headphones And Earphones (AREA)

Claims (13)

  1. Procédé de fonctionnement d'un système électroacoustique (11), dans lequel un dispositif électroacoustique (10) est disposé au moins partiellement dans une oreille afin d'obstruer au moins partiellement un conduit auditif, dans lequel un dispositif de traitement de signaux (16) est utilisé pour traiter un signal entrant dans le dispositif (10), et dans lequel au moins une unité de correction (17) du dispositif de traitement de signaux (16) est utilisée pour modifier le signal entrant dans le dispositif (10), et, au moyen de la ou des unités de correction (17), un signal sortant du dispositif (10) est généré pour atteindre une transparence acoustique de telle sorte que, à partir du signal sortant, un signal de réception est généré au niveau du tympan, lequel signal est ajusté de manière à correspondre à un signal de réception au niveau du tympan lorsque le conduit auditif est dégagé et n'est pas équipé du dispositif (10), dans lequel la ou les unités de correction (17) comprennent un premier filtre de correction (A) et un second filtre de correction (B), et le premier filtre de correction (A) de la ou des unités de correction (17) est connecté en amont du second filtre de correction (B) de la ou des unités de correction (17), dans lequel le signal entrant est en premier lieu modifié par le premier filtre de correction (A) pour atteindre la transparence acoustique, dans lequel, afin de déterminer le premier filtre de correction (A) de la ou des unités de correction (17), une pression totale (Ptot) d'un signal acoustique externe à l'intérieur du conduit auditif au moins partiellement obstrué par le dispositif (10) est mise en équation avec une pression cible attendue (PT,E) compte tenu du premier filtre de correction (A), dans lequel le premier filtre de correction (A) est déterminé en tenant compte d'une pression de passage (PHT) mesurée au moyen d'un récepteur acoustique interne (14) associé au dispositif (10) et tourné vers un tympan de l'oreille selon l'équation suivante : A = P T , E − P HT P tot − P HT
    Figure imgb0025
     puis le signal entrant transformé est modifié par le second filtre de correction (B) de manière à éliminer les effets de transmission dans la zone comprise entre l'appareil (10) et le tympan causés par l'obstruction au moins partielle du conduit auditif par le dispositif (10).
  2. Procédé selon la revendication 1, caractérisé en ce que le signal entrant, en particulier acoustique, est transmis au dispositif de traitement de signaux (16) sous forme de signal électrique entrant au moyen d'un récepteur acoustique externe (13) associé au dispositif (10) et dirigé à l'opposé du tympan vers l'extérieur, au moins un signal acoustique et/ou électrique externe supplémentaire est de préférence transmis au dispositif de traitement de signaux (16), en particulier au moyen d'un récepteur acoustique externe supplémentaire et/ou d'une liaison conductrice directe avec une source de signaux externe supplémentaire (18), et le signal acoustique et/ou électrique externe supplémentaire est tout particulièrement modifié au moyen de l'unité de correction (17).
  3. Procédé selon l'une des revendications précédentes, caractérisé en ce qu'un étalonnage est réalisé avant l'utilisation du système électroacoustique (11), le premier filtre de correction (A) et/ou le second filtre de correction (B) sont déterminés en particulier dans le cadre de l'étalonnage, l'étalonnage est réalisé de préférence après chaque insertion du dispositif (10) obstruant au moins partiellement le conduit auditif, l'étalonnage est réalisé tout particulièrement au moyen d'une source sonore externe (22) et/ou d'un dispositif de commande d'étalonnage.
  4. Procédé selon l'une des revendications précédentes, caractérisé en ce que le premier filtre de correction (A) de l'unité de correction (17) est déterminé sur la base d'un premier modèle et/ou le second filtre de correction (B) de l'unité de correction (17) est déterminé sur la base d'un second modèle, le premier modèle et/ou le second modèle étant de préférence basés sur l'équivalent de Thévenin et/ou l'équivalent de Norton.
  5. Procédé selon l'une des revendications précédentes, caractérisé en ce que la pression totale (Ptot) d'un signal acoustique externe à l'intérieur du conduit auditif au moins partiellement obstrué par le dispositif (10), permettant de déterminer le premier filtre de correction (A) de l'unité de correction (17), est composée de deux parties, une première partie de la pression totale (Ptot) est de préférence une pression de passage (PHT) mesurée au moyen d'un récepteur acoustique interne (14) associé au dispositif (10) et tourné vers un tympan de l'oreille et/ou une deuxième partie de la pression totale (Ptot) est de préférence une pression de sortie (PEP) issue d'un générateur acoustique (15) associé au dispositif (10) et tourné vers le tympan.
  6. Procédé selon l'une des revendications précédentes, caractérisé en ce que, après une première détermination du premier filtre de correction (A) de l'unité de correction (17), en particulier dans le cadre d'un étalonnage, un réglage de précision du premier filtre de correction (A) est réalisé, au moins un signal d'étalonnage prédéterminé et/ou un bruit prédéterminé sont de préférence utilisés, une pression (PE) mesurée au moyen d'un récepteur acoustique interne (14) associé au dispositif (10) et tourné vers un tympan de l'oreille est en particulier comparée à une pression cible (PT,E) lors du réglage de précision, dans lequel, dans le cas d'un écart entre la pression mesurée (PE) et la pression cible (PT,E), le premier filtre de correction (A) est ajusté de manière itérative jusqu'à ce qu'un critère de convergence prédéterminé soit atteint.
  7. Procédé selon l'une des revendications précédentes, caractérisé en ce que, pour déterminer le premier filtre de correction (A) de l'unité de correction (17), une pression (PE) mesurée au moyen d'un récepteur acoustique interne (14) associé au dispositif (10) et tourné vers un tympan de l'oreille est mise en équation avec une pression cible attendue (PT,E) au niveau du récepteur acoustique interne (14), dans lequel la pression cible attendue (PT,E) au niveau du récepteur acoustique interne (14) est évaluée en tant que pression à l'emplacement du récepteur acoustique interne (14) dans un conduit auditif dégagé non équipé du dispositif (10).
  8. Procédé selon la revendication 7, caractérisé en ce que la pression cible attendue (PT,E) au niveau du récepteur acoustique interne (14) est évaluée au moyen d'un modèle électroacoustique, en particulier avec un modèle de source de pression de Thévenin et/ou un modèle d'impédance de source, la pression cible attendue (PT,E) au niveau du récepteur acoustique interne (14) est de préférence évaluée à partir d'une pression de source (Ps), d'une impédance de conduit auditif (ZL) et d'une impédance de rayonnement (ZRAD), en particulier selon l'équation suivante : P T , E = P S Z L Z L + Z RAD
    Figure imgb0026
  9. Procédé selon l'une des revendications précédentes, caractérisé en ce que, pour déterminer le second filtre de correction (B) de l'unité de correction (17), une évaluation du signal de réception acoustique au niveau du tympan est réalisée au moyen d'un récepteur acoustique interne (14) associé au dispositif (10) et tourné vers un tympan de l'oreille, une pression au niveau du tympan (PD) est de préférence évaluée à partir d'une pression (PE) mesurée au niveau du récepteur acoustique interne (14) en utilisant un modèle électroacoustique du conduit auditif.
  10. Procédé selon l'une des revendications précédentes, caractérisé en ce qu'une pression au niveau du tympan (PD) est déterminée à partir d'une pression (PE) mesurée au niveau du récepteur acoustique interne (14) et au moyen du second filtre de correction (B) selon l'équation suivante : P D = P E B
    Figure imgb0027
  11. Système électroacoustique comprenant un dispositif électroacoustique (10) destiné à obstruer au moins partiellement un conduit auditif, et un dispositif de traitement de signaux (16) destiné à traiter un signal entrant dans le dispositif (10), dans lequel le dispositif de traitement de signaux (16) comprend au moins une unité de correction (17) pour modifier le signal entrant dans le dispositif (10) et pour délivrer un signal sortant du dispositif (10) servant à atteindre une transparence acoustique de telle sorte que, à partir du signal sortant, un signal de réception peut être généré au niveau du tympan, lequel signal est ajusté de manière à correspondre à un signal de réception au niveau du tympan lorsque le conduit auditif est dégagé et n'est pas équipé du dispositif (10), dans lequel la ou les unités de correction (17) comprennent un premier filtre de correction (A) et un second filtre de correction (B), et le premier filtre de correction (A) de la ou des unités de correction (17) est connecté en amont du second filtre de correction (B) de la ou des unités de correction (17), dans lequel le signal entrant est en premier lieu modifié par le premier filtre de correction (A) pour atteindre la transparence acoustique, dans lequel, afin de déterminer le premier filtre de correction (A) de la ou des unités de correction (17), une pression totale (Ptot) d'un signal acoustique externe à l'intérieur du conduit auditif au moins partiellement obstrué par le dispositif (10) est mise en équation avec une pression cible attendue (PT,E) compte tenu du premier filtre de correction (A), dans lequel le premier filtre de correction (A) est déterminé en tenant compte d'une pression de passage (PHT) mesurée au moyen d'un récepteur acoustique interne (14) associé au dispositif (10) et tourné vers un tympan de l'oreille selon l'équation suivante : A = P T , E − P HT P tot − P HT
    Figure imgb0028
     puis le signal entrant transformé est modifié par le second filtre de correction (B) de manière à éliminer les effets de transmission dans la zone comprise entre l'appareil (10) et le tympan causés par l'obstruction au moins partielle du conduit auditif par le dispositif (10).
  12. Utilisation d'un procédé selon l'une des revendications 1 à 10, dans laquelle le procédé est intégré dans une protection auditive, un écouteur intra-auriculaire et/ou un appareil auditif.
  13. Utilisation d'un système électroacoustique (11) selon la revendication 11, dans laquelle le système électroacoustique (11) est intégré dans une protection auditive, un écouteur intra-auriculaire et/ou un appareil auditif.
EP16712305.8A 2015-03-26 2016-03-22 Procédé de fonctionnement d'un système électroacoustique et un système électroacoustique Active EP3275211B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102015003855.9A DE102015003855A1 (de) 2015-03-26 2015-03-26 Verfahren zum Betreiben eines elektroakustischen Systems und ein elektroakustisches System
PCT/EP2016/056232 WO2016150947A1 (fr) 2015-03-26 2016-03-22 Procédé de fonctionnement d'un système électroacoustique et un système électroacoustique

Publications (2)

Publication Number Publication Date
EP3275211A1 EP3275211A1 (fr) 2018-01-31
EP3275211B1 true EP3275211B1 (fr) 2021-06-30

Family

ID=55640715

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16712305.8A Active EP3275211B1 (fr) 2015-03-26 2016-03-22 Procédé de fonctionnement d'un système électroacoustique et un système électroacoustique

Country Status (5)

Country Link
US (1) US10313778B2 (fr)
EP (1) EP3275211B1 (fr)
DE (1) DE102015003855A1 (fr)
DK (1) DK3275211T3 (fr)
WO (1) WO2016150947A1 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3917155B1 (fr) 2020-05-26 2023-11-08 Harman International Industries, Incorporated Écouteur intra-auriculaire auto-calibrant
DK202070493A1 (en) * 2020-07-17 2022-01-20 Gn Hearing As Method at an electronic device involving a hearing device
EP4124060A1 (fr) * 2021-07-19 2023-01-25 Sonova AG Instrument auditif
EP4344403A1 (fr) * 2022-06-10 2024-04-03 Google Technology Holdings LLC Détection de fréquence respiratoire

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69837725T2 (de) * 1998-11-09 2008-01-31 Widex A/S Verfahren zum in-situ messen und korrigieren oder anpassen eines ausgangssignals eines hörgerätes mit hilfe eines modelprozessors und hörgerät zur durchführung des verfahrens
US6914994B1 (en) * 2001-09-07 2005-07-05 Insound Medical, Inc. Canal hearing device with transparent mode
EP2208367B1 (fr) * 2007-10-12 2017-09-27 Earlens Corporation Système et procédé multifonction pour une audition et une communication intégrées avec gestion de l'annulation du bruit et de la contre-réaction
US8477957B2 (en) * 2009-04-15 2013-07-02 Nokia Corporation Apparatus, method and computer program
JP4686622B2 (ja) * 2009-06-30 2011-05-25 株式会社東芝 音響補正装置、及び音響補正方法
WO2013075255A1 (fr) 2011-11-22 2013-05-30 Phonak Ag Procédé pour traiter un signal dans un appareil auditif et appareil auditif
US8798283B2 (en) * 2012-11-02 2014-08-05 Bose Corporation Providing ambient naturalness in ANR headphones

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
US20180084328A1 (en) 2018-03-22
DK3275211T3 (da) 2021-10-11
DE102015003855A1 (de) 2016-09-29
US10313778B2 (en) 2019-06-04
WO2016150947A1 (fr) 2016-09-29
EP3275211A1 (fr) 2018-01-31

Similar Documents

Publication Publication Date Title
EP3222057B1 (fr) Procédé et dispositif de détection rapide de la voix naturelle
US7650005B2 (en) Automatic gain adjustment for a hearing aid device
EP3275211B1 (fr) Procédé de fonctionnement d'un système électroacoustique et un système électroacoustique
EP2172063B1 (fr) Appareil auditif à module d'initialisation et adaptation à l'utilisateur
EP2224752B1 (fr) Dispositif et procédé de réduction d'effets de bruit de pas dans des dispositifs auditifs dotés d'une réduction d'occlusion active
DE102006047965A1 (de) Hörhilfsgerät mit einer Okklusionsreduktionseinrichtung und Verfahren zur Okklusionsreduktion
EP1239700B1 (fr) Prothèse auditive ou un système de prothèses audives et ainsi que leur méthode d'utilitsation
EP3104627B1 (fr) Procédé d'amélioration d'un signal d'enregistrement dans un système auditif
EP1931172A1 (fr) Prothèse auditive avec suppression du bruit et procédé correspondant
EP2782260A1 (fr) Procédé et dispositif de commande d'une communication vocale et utilisation de ceux-ci
DE102011006129B4 (de) Hörvorrichtung mit Rückkopplungsunterdrückungseinrichtung und Verfahren zum Betreiben der Hörvorrichtung
DE102008021613A1 (de) Verfahren und Vorrichtung zur Bestimmung eines Verschlussgrads bei Hörgeräten
EP2595414A1 (fr) Dispositif auditif avec un système pour réduire un bruit de microphone et procédé de réduction d'un bruit de microphone
EP3355592A1 (fr) Procédé de fonctionnement d'un système pour appareils de correction auditive binaural
EP2373063B1 (fr) Dispositif auditif et procédé de réglage de celui-ci pour un fonctionnement sans contre-réaction
EP2822300A1 (fr) Reconnaissance de situations d'écoute à l'aide de différentes sources de signal
EP3413588B1 (fr) Procédé de caractérisation d'une haut-parleur dans un dispositif auditif, dispositif auditif et dispositif d'essai pour un dispositif auditif
EP4158901A1 (fr) Procédé, dispositif, casque d'écoute et programme informatique pour supprimer activement l'effet d'occlusion pendant la lecture de signaux audio
EP3913618A1 (fr) Procédé de fonctionnement d'un appareil auditif et appareil auditif
DE102022202713B3 (de) Verfahren zum Betrieb eines Hörgerätes und Hörgerät
EP0723381B2 (fr) Dispositif d'assistance auditive
DE8905756U1 (de) Hinter dem Ohr zu tragendes Hörgerät mit einer Belüftung zum Gehörgang
CH720180A2 (de) Verfahren und System zum Anpassen eines Hörgerätes in einer schallbehafteten Umgebung
EP4134002A1 (fr) Procédé de génération d'un audiogramme d'une personne soumise à l'essai au moyen d'un instrument auditif
WO2023104865A1 (fr) Dispositif de suppression de bruit et/ou de suppression d'occlusion actives, procédé correspondant, et programme informatique

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20171026

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20190515

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 502016013310

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04R0025000000

Ipc: H04R0001100000

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 5/12 20060101ALI20201209BHEP

Ipc: H04R 25/00 20060101ALI20201209BHEP

Ipc: H04R 1/10 20060101AFI20201209BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210121

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502016013310

Country of ref document: DE

Ref country code: AT

Ref legal event code: REF

Ref document number: 1407510

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210715

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20211004

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210930

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20210630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211001

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210930

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211102

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502016013310

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

26N No opposition filed

Effective date: 20220331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220322

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220322

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 1407510

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220322

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230515

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220322

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20230402

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20160322

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210630

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240321

Year of fee payment: 9

Ref country code: GB

Payment date: 20240322

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240320

Year of fee payment: 9

Ref country code: DK

Payment date: 20240321

Year of fee payment: 9