EP2974380B1 - Filtrage d'une rétroaction bien définie à partir d'un transducteur vibrant à couplage physique - Google Patents

Filtrage d'une rétroaction bien définie à partir d'un transducteur vibrant à couplage physique Download PDF

Info

Publication number
EP2974380B1
EP2974380B1 EP14764706.9A EP14764706A EP2974380B1 EP 2974380 B1 EP2974380 B1 EP 2974380B1 EP 14764706 A EP14764706 A EP 14764706A EP 2974380 B1 EP2974380 B1 EP 2974380B1
Authority
EP
European Patent Office
Prior art keywords
feedback
transducer
input device
sound input
management system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14764706.9A
Other languages
German (de)
English (en)
Other versions
EP2974380A4 (fr
EP2974380A1 (fr
Inventor
Martin HILLBRATT
Marcus Andersson
Kristian Asnes
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cochlear Ltd
Original Assignee
Cochlear Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cochlear Ltd filed Critical Cochlear Ltd
Priority claimed from PCT/IB2014/059843 external-priority patent/WO2014141205A1/fr
Publication of EP2974380A1 publication Critical patent/EP2974380A1/fr
Publication of EP2974380A4 publication Critical patent/EP2974380A4/fr
Application granted granted Critical
Publication of EP2974380B1 publication Critical patent/EP2974380B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/60—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles
    • H04R25/604—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles of acoustic or vibrational transducers
    • H04R25/606—Mounting or interconnection of hearing aid parts, e.g. inside tips, housings or to ossicles of acoustic or vibrational transducers acting directly on the eardrum, the ossicles or the skull, e.g. mastoid, tooth, maxillary or mandibular bone, or mechanically stimulating the cochlea, e.g. at the oval window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
    • H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/13—Hearing devices using bone conduction transducers

Definitions

  • the present technology relates generally to hearing prostheses, and more particularly, to filtering feedback from a hard-coupled vibrating transducer.
  • Hearing loss which may be due to many different causes, is generally of two types, conductive and sensorineural.
  • Sensorineural hearing loss occurs when there is damage to the inner ear, or to the nerve pathways from the inner ear to the brain.
  • Individuals suffering from conductive hearing loss typically have some form of residual hearing because the hair cells in the cochlea are undamaged.
  • individuals suffering from conductive hearing loss typically receive a prosthetic hearing device that generates mechanical motion of the cochlea fluid.
  • acoustic energy may be delivered through a column of air to the tympanic membrane (eardrum) via a hearing aid residing in the ear canal.
  • Mechanical energy may be delivered via the physical coupling of a mechanical transducer (i.e.
  • a transducer that converts electrical signals to mechanical motion) to the tympanic membrane, the skull, the ossicular chain, the round or oval window of the cochlea or other structure that will result in the delivery of mechanical energy to the hydro - mechanical system of the cochlea.
  • hearing aid Individuals suffering from conductive hearing loss typically receive an acoustic hearing aid, referred to as a hearing aid herein.
  • a hearing aid typically receives an acoustic hearing aid, referred to as a hearing aid herein.
  • a hearing aid typically receives an acoustic hearing aid, referred to as a hearing aid herein.
  • hearing aids are typically unsuitable for individuals who suffer from single-sided deafness (total hearing loss only in one ear).
  • Hearing aids commonly referred to as "cross aids" have been developed for single sided deaf individuals.
  • hearing aids receive the sound from the deaf side with one hearing aid and present this signal (either via a direct electrical connection or wirelessly) to a hearing aid which is worn on the opposite side. Unfortunately, this requires the recipient to wear two hearing aids. Additionally, in order to prevent acoustic feedback problems, hearing aids generally require that the ear canal be plugged, resulting in unnecessary pressure, discomfort, or other problems such as eczema.
  • hearing aids rely primarily on the principles of air conduction.
  • other types of devices commonly referred to as bone conducting hearing aids or bone conduction devices, function by converting a received sound into a mechanical force. This force is transferred through the bones of the skull to the cochlea and causes motion of the cochlea fluid. Hair cells inside the cochlea are responsive to this motion of the cochlea fluid and generate nerve impulses which result in the perception of the received sound.
  • Bone conduction devices have been found suitable to treat a variety of types of hearing loss and may be suitable for individuals who cannot derive sufficient benefit from acoustic hearing aids, cochlear implants, etc., or for individuals who suffer from stuttering problems.
  • US 2002/0122563 A1 relates to a bone conduction hearing aid and discloses all of the features in the preamble of claim 1.
  • a hearing aid with feedback cancellation is disclosed in US 2008/0212816 A1
  • the present invention provides a hearing prosthesis as claimed in claim 1 and a method of operating the hearing prosthesis as claimed in claim 1.0.
  • Preferred embodiments are defined in the dependent claims.
  • a stimulating hearing prosthesis comprising: at least one sound input device configured to sense a sound signal; and a transducer configured to generate a vibration based on the sound signal; wherein the sound input device is substantially rigidly coupled or hard coupled to the transducer.
  • a hearing prosthesis comprising: at least one sound input device configured to sense a sound signal; a transducer configured to generate a vibration based on the sound signal; and a signal processor connected to the sound input device and configured to filter well-defined mechanical feedback from the vibration received by the sound input device.
  • a method comprising: receiving an acoustic signal with acoustic feedback and mechanical feedback; applying a first modification of the signal to reduce well-defined mechanical feedback from signal; generating a stimulation information based on the modified signal; and generating a mechanical force based on the stimulation information.
  • an adaptation of the first part of the two part feedback management system by the second part is configured to update less than about once every 160 milliseconds or less than about one every 180 milliseconds.
  • a hearing prosthesis as detailed herein, further comprising a two part feedback management system, wherein a first part of the two part feedback management system is optimized to reduce low frequency feedback.
  • aspects and embodiments of the present technology are directed to a mechanical stimulating hearing prosthesis in which the sound input component and vibrating transducer are rigidly or hard coupled, directly or indirectly.
  • the mechanical connection can be any mechanical connection such as a direct connection where the sound input device and transducer are coupled without an intervening element, or an indirect connection using a metal shaft, bolt, threaded connection or adhesive connection, or any other coupling mechanism that will produce a mechanical connection. Examples of these connections are detailed further in this specification. Other mechanical connections, not herein disclosed, are also contemplated providing they provide a rigid connection between sound input device and the transducer.
  • the prosthesis also includes a filter configured to substantially remove or compensate for this well-defined vibration feedback.
  • Hearing prostheses that generate mechanical stimulation include, for example, a bone conduction device and a middle ear implant. Aspects of the present technology are described next below with reference to one type of mechanical stimulating hearing prosthesis, namely a bone conduction device. It should be appreciated, however, that embodiments of the present technology may be implemented in other mechanical stimulating hearing prostheses now or later developed.
  • the hearing prosthesis generally comprises a sound input device to receive sound waves and a vibrating transducer (e.g. actuator) hard-coupled to the sound input device and configured to vibrate in response to sound signals received by the sound input device.
  • a housing is configured to house one or more operational components, such as a vibrating transducer and a sound input device, of the hearing prosthesis.
  • the outer shell of the vibrator itself may also act as the housing such that the vibrator and housing are one and the same structure. Since the vibrating transducer is hard-coupled to the sound input device, feedback from the vibrating transducer received by the sound input device is more well-defined or accurate, and therefore easier to cancel out using filters or other techniques, than if the vibrating transducer was not hard-coupled to the sound input device.
  • FIG. 1A is a perspective view of a percutaneous bone conduction device 100A in which embodiments of the present technology may be advantageously implemented. As shown, the recipient has an outer ear 101, a middle ear 102 and an inner ear 103. Elements of outer ear 101, middle ear 102 and inner ear 103 are described below, followed by a description of bone conduction device 100A.
  • outer ear 101 comprises an auricle 109 and an ear canal 106.
  • a sound wave 107 is collected by auricle 109 and channeled into and through ear canal 106.
  • a tympanic membrane 104 Disposed across the distal end of ear canal 106 is a tympanic membrane 104 which vibrates in response to sound wave 107. This vibration is coupled to oval window or fenestra ovalis 110 through three bones of middle ear 102, collectively referred to as the ossicles 111 and comprising the malleus 112, the incus 113 and the stapes 114.
  • Bones 112, 113 and 114 of middle ear 102 serve to filter and amplify sound wave 107, causing oval window 110 to articulate, or vibrate. Such vibration sets up waves of fluid motion within cochlea 115. Such fluid motion, in turn, activates tiny hair cells (not shown) that line the inside of cochlea 115. Activation of the hair cells causes appropriate nerve impulses to be transferred through the spiral ganglion cells and auditory nerve 116 to the brain (not shown), where they are perceived as sound.
  • FIG. 1A also illustrates the positioning of bone conduction device 100A relative to outer ear 101, middle ear 102 and inner ear 103 of a recipient of device 100A.
  • bone conduction device 100A includes external component 145 which may be positioned behind outer ear 101 of the recipient and comprises a sound input device 126 to receive sound signals.
  • Sound input device may comprise, for example, a microphone, telecoil, etc.
  • Sound input device 126 may also be a component that receives an electronic signal indicative of sound, such as, for example, from an external audio device.
  • sound input device 126 may receive a sound signal in the form of an electrical signal from an MP3 player electronically connected to sound input device 126.
  • sound input device may be located, for example, on the device, in the device, or on a cable extending from the device.
  • bone conduction device 100A may comprise a sound processor, a vibrating transducer and/or various other operational components which facilitate operation of the device. More particularly, bone conduction device 100A operates by converting the sound received by sound input device 126 into electrical signals. These electrical signals are utilized by the sound processor to generate control signals that cause the transducer (located in housing 124) to vibrate. These control signals are provided to the vibrating transducer. As described below, the vibrating transducer converts the signals into mechanical vibrations used to output a force for delivery to the recipient's skull.
  • bone conduction device 100A further includes a housing 124, a coupling 140 and an implanted anchor 162 configured to attach the device to the recipient.
  • coupling 140 is attached to implanted anchor 162, which is implanted in the recipient.
  • implanted anchor 162 is fixed to the recipient's skull bone 136.
  • Coupling 140 extends from implanted anchor 162 and bone 136 through muscle 134, fat 128 and skin 132 so that housing 124, or a component within housing 124, may be attached thereto.
  • Implanted anchor 162 facilitates efficient transmission of mechanical force to the recipient. It would be appreciated that embodiments of the present technology may be implemented with other types of couplings and anchor systems.
  • FIG. 1B is a perspective view of a transcutaneous bone conduction device 100B in which embodiments of the present technology may be implemented.
  • bone conduction device 100B is positioned behind outer ear 101 of the recipient.
  • Bone conduction device 100B comprises an external component 145 and an implantable component 150.
  • Bone conduction device 100B includes a sound input device 126 which is hard-coupled to the vibrating transducer (not shown), as described further below.
  • fixation system 162 may be used to secure implantable component 150 to skull 136. As described below, fixation system 162 may be a bone screw fixed to skull 136, and also attached to implantable component 150.
  • bone conduction device 100B is a passive transcutaneous bone conduction device. That is, no active components, such as the transducer, are implanted beneath the recipient's skin 132. In such an arrangement, the active transducer is located in external component 145. External component 145 also includes a magnetic pressure or magnetic plate 151. Implantable component 150 includes a magnetic plate 152. Magnetic plate 152 of the implantable component 150 vibrates in response to vibration transmitted through the skin from external component 145, mechanically and/or via a magnetic field, that are generated by external magnetic plate 151.
  • FIG. 1C is a perspective view of a Behind-the-Ear (BTE) transcutaneous bone conduction hearing prosthesis in which embodiments of the present technology may be implemented.
  • bone conduction device 100C is positioned behind outer ear 101 of a recipient
  • Bone conduction device 100C comprises a BTE 125, but no implantable component.
  • Bone conduction device 100C includes a sound input device 126 to receive sound waves.
  • sound input device 126 may be located, for example, on or in bone conduction device 100B, or otherwise hard-coupled to the bone conduction device, as described further below.
  • BTE 125 is affixed to skin 132 via an adhesive (not shown).
  • BTE 125 is affixed to skin 132 at a location in which there is minimal subcutaneous fat or muscle.
  • a vibrating transducer in the BTE generates vibrations which are transcutaneously transferred to skull bone 136, resulting in a hearing percept as described above.
  • FIGS. 2A-2G are cross-sectional diagrams of embodiments of external components 200A-200G, respectively, of a bone conduction device.
  • External Components 200 have a housing 124 in which a vibrating transducer 206 is suspended.
  • vibrating transducer 206 is mechanically coupled to components that facilitate the percutaneous or transcuateous transfer of vibrations to the skull.
  • External component 200A is a passive device because vibrating transducer 206 is located external to the recipient's body. Component 200A may also be implemented as an active device, for example implanted in a recipient's skull or within a middle ear implant. External component 200 includes housing 124. Vibrating transducer 206 is located inside housing 124. External component 200A may include a flat spring (not shown) between transducer 206 and housing 124.
  • Sound input device 126 is located within housing 124, and more specifically at least partially within a wall of housing 124 so that sound input device 126 may have access to the air outside housing 124 to receive sound waves. Sound input device 126, however, may be located fully within housing 124 or may be located fully outside of housing 124 and connected to the outside of the housing. Vibrating transducer 206 is hard-coupled or rigidly-coupled to sound input device 126. More specifically, transducer 206 and sound input device 126 are physically and firmly connected to each other so as to allow for the direct transmission of mechanical power between transducer 206 and input device 126.
  • transducer 206 may be rigidly and directly coupled to sound input device 126 without any physical elements between transducer 206 and sound input device 126.
  • transducer 206 is directly hard-coupled to sound input device 126 because it is directly connected to it, or in other words there is no other structure separating transducer 206 and sound input device 126.
  • a directly hard-coupled transducer and sound input device, such as transducer 206 and sound input device 126 in FIG. 2A may be beneficial because of the direct contact between the two elements without any interference elements in between.
  • a directly hard-coupled transducer and sound input device may yield a slightly more well-defined feedback path than a device that includes intermediate elements in between hard-coupled transducer and sound input element. Since hard-coupled transducer and sound input device are directly connected, the transducer will directly transfer any present mechanical feedback directly to the sound input device. Similar benefits apply to other directly hard-coupled systems, including those described in FIGS. 2C , 2E and 2G .
  • FIG. 2B is a cross sectional view of external component 200B with an indirectly hard-coupled transducer and sound input device, not covered by the claims.
  • transducer 206 may be indirectly, but still rigidly, coupled to sound input device 126. More specifically, transducer 206 is coupled to sound input device 126 via rigid shaft 207. Rigid shaft 207 may be a metal post, or any other coupling mechanism that will produce a rigid connection between transducer 206 and sound input device 126.
  • transducer 206 may be placed at various places within housing 124 while still maintaining a hard-coupled connection between the transducer and sound input device. Similar benefits apply to other indirect hard-coupled systems, including that described in FIG. 2D .
  • vibrations generated by transducer 206 travel through the rigid coupling to transducer 206 and input device 126. More specifically, vibrations produced by vibrating transducer 206 may be picked up by sound input device 126 as mechanical (or acoustical) feedback. Acoustic feedback heard by sound input element 126 may come from background noise, noise from the transducer movement, noise from the housing, or noise from the rigid connection between the transducer and either the sound input element or the housing due to the movement of the transducer.
  • sound input device 126 may still pick up mechanical vibrations (and/or acoustic signals) as feedback from transducer 206.
  • mechanical feedback may be unpredictable and/or varying because of the physical and electrical space separation between transducer 206 and sound input device 126.
  • Rigid coupling between transducer 206 and sound input device 126 causes the mechanical feedback received by sound input device 126 from transducer 206 to be well-defined. While the mechanical feedback received by sound input device 126 from transducer 206 may be stronger or of a higher magnitude, the feedback is more predictable and substantially constant. In one form the feedback is easily determinable or calculable based on one or more factors such as voltage applied to the transducer or other known measurable factors.
  • Mechanical feedback as described, is well-defined or well known when it is set or measured during development of the hearing prosthesis or during the fitting process of the hearing process to the recipient.
  • the mechanical feedback path is determinable and the feedback will not vary far from that determined feedback because the mechanics of the system, due to the rigid connection, will not vary over time.
  • the mechanics of the system, including the rigid coupling should not change over time even if the transducer and/or other components of the system are shaken, dropped, or normal use events.
  • the set/measured feedback data taken during manufacture or fitting will remain consistent.
  • This concept may be most reliable for lower frequencies, e.g. frequencies below 1 kHz, which are the most common frequencies for the mechanical feedback discussed herein, but may also apply to higher frequencies.
  • prior art systems describe the opposite principle. More specifically, prior art describes systems that isolate the sound input device and insulate the sound input device from the actuator to try to reduce the feedback reaching the sound input device as low as possible.
  • a well-defined feedback path such as the feedback from a transducer rigidly coupled to a sound input device, is more easily canceled by a filter or set of filters or other noise cancelling technique because the mechanical feedback is not random and can be accurately defined/predicted, as described.
  • feedback may be canceled by the use of a static or slow moving filter, such as, for example, an all pass filter.
  • a static or slow moving filter such as, for example, an all pass filter.
  • various other techniques for canceling such feedback may be used, such as other types of filters and anti-feedback algorithms.
  • Vibrating transducer 206 is also coupled to shaft or post 210.
  • Shaft 210 may be connected to an anchor or abutment to be implanted in the skull of a recipient as part of a percutaneous bone conduction device, as shown in FIG. 1A .
  • Shaft 210 may be connected to a plate as part of a transcutaneous bone conduction device, as shown in FIG. 1B .
  • the plate may be in the form of a permanent magnet and/or in another form that generates and/or is reactive to a magnetic field, or otherwise permits the establishment of magnetic attraction between the external device 200 and an implantable component in the recipient's skull sufficient to hold the external device 200 against the skin of the recipient. If vibrating transducer 206 were mechanically coupled to such a plate, the vibrations from transducer 206 are transferred from the actuator to the plate and to the recipient's skull.
  • FIG. 2C is a cross sectional view of an external component 200C with a hard-coupled transducer and two sound input devices, in which embodiments of the present technology may be implemented.
  • a second input device may be added to the embodiments illustrated in FIGS. 2A and 2B , such as sound input device 209.
  • Sound input device 209 is located within housing 124, and more specifically at least partially within a wall of housing 124 so that sound input device 209 may have access to the air outside housing 124 to receive sound waves. Sound input device 209, however, may be located fully within housing 124 or may be located fully outside of housing 124 and connected to the outside of the housing.
  • FIG. 2D is a cross sectional view of an external component 200D with a hard-coupled transducer and sound input device coupled via a connector, not covered by the claims.
  • transducer 206 may be indirectly, but still rigidly, coupled to sound input device 126. More specifically, transducer 206 is coupled to sound input device 126 via connector 230.
  • Connector 230 may be glue, solder, a printed circuit board (PCB), or any other layer or component that will produce a rigid connection between transducer 206 and sound input device 126. It is appreciated that while connector 230 is shown in FIG. 2D as spanning the width of sound input device 126, it may also extend to other portions of transducer 206.
  • FIG. 2E is a cross sectional view of external component 200E with a directly hard- coupled transducer and sound input device where the outer shell of the vibrating transducer itself acts as the housing (such that the vibrating transducer and housing are one and the same structure), in which embodiments of the present technology may be implemented.
  • Device 200E is a passive transcutaneous bone conduction device because vibrating transducer 206 is located external to the recipient's body.
  • External device 200E includes vibrating transducer 206 and sound input device 126. Vibrating transducer 206 is hard or rigidly coupled to sound input device 126.
  • transducer 206 and sound input device 126 are physically and firmly connected to each other so as to allow for the direct transmission of mechanical power between transducer 206 and input device 126.
  • transducer 206 may be rigidly and directly coupled to sound input device 126 without any physical elements between transducer 206 and sound input device 126.
  • a rigid shaft or other connector may physically connect transducer 206 to sound input device 126, which may be integrated into FIG. 2E .
  • additional sound input devices may be utilized.
  • FIG. 2F is a cross sectional view of external component 200F with an indirectly hard-coupled transducer and sound input device, not covered by the claims.
  • transducer 206 may be indirectly, but still rigidly, coupled to sound input device 126. More specifically, transducer 206 is coupled to sound input device 126 via housing 124. Gap 246, which is a gap between transducer 206 and sound input device 126, shows that transducer is not directly coupled to sound input device 126. Gap 246 should be large enough such that transducer 206 and sound input device 126 do not touch while transducer 206 is vibrating.
  • Rigid coupling between transducer 206 and sound input device 126 may cause the mechanical feedback received by sound input device 126 from transducer 206 to be well-defined.
  • An indirect hard-coupled transducer and sound input device such as transducer 206 and sound input device 126 in FIG. 2F , may be beneficial because, in addition to those benefits described with respect to FIG. 2B , no additional components are required to hard-couple transducer 206 to sound input device 126 besides housing 206. A system that does not use such extra components helps to conserve resources and manufacturing complexity.
  • FIG. 2G is a cross sectional view of external component 200G with a directly hard-coupled transducer and sound input device, in which embodiments of the present technology may be implemented.
  • External component 200G is similar to external component 200A in that vibrating transducer 206 is directly hard-coupled or rigidly-coupled to sound input device 126.
  • housing 124 is secured around each edge of transducer 206 such that there is no space between housing 124 and transducer 206.
  • Embodiments of the present technology may also be implemented in a middle ear implant, or direct mechanical stimulation system. Such an embodiment may be implemented with similar features as explained in FIG. 2 , but implanted deeper into a recipient's auditory pathways.
  • FIG. 3A is an audio processing pipeline 300 which may be implemented in a bone conduction device having a rigidly coupled microphone and transducer, as described above. Audio processing pipeline 300 receives analog audio signals 312 generated by sound input device 126, and generates control signals 320 for controlling the operation of the vibrating transducer 206.
  • analog-to-digital conversion operations are performed on analog audio signal 312 at block 302.
  • the A/D conversion encodes analog audio signal 312 at a specified sample rate, then further scales the encoded signal, prior to generating a digital audio signal 314 representative of the received sound 107.
  • Pre-processing block 304 receives digital audio signal 314 and generates one or more pre-processed digital signals to provide to vibration feedback manager 306. Examples of operations that can be performed by pre-processing block 304 include various types of signal conditioning, multi-channel compression, dynamic range expansion, noise reduction and/or amplitude scaling.
  • Pre-processed digital audio signal 316 may contain noise from any one of a variety of sources.
  • the feedback of transducer vibrations through sound input device 126 will result in signal 316 having noise which could interfere with the fidelity of the hearing percept invoked by the hearing prosthesis.
  • a Vibration Feedback Manager 306 filters such noise from digital audio signal 316.
  • the mechanical feedback received by sound input device 126 from transducer 306 is predictable and substantially constant, a condition referred to herein as being well-defined. Such feedback is effectively canceled by Vibration Feedback Manager 306.
  • Filter bank 308 separates pre-processed digital signals 317 into a plurality of frequency bands for processing by sound processing block 310.
  • Filtered digital signals 318 are provided from filter bank 308 to sound processing block 310.
  • Sound processing 310 may include applying digital signal processing algorithms to generate transducer control signals 320. Therefore, control signals 320 will be a signal capable of being understood by transducer 206 to drive the transducer to generate a mechanical force representative of the received sound.
  • the output signal of sound processing block 310 will represent generated stimulation information based on the processed signals.
  • FIG. 3B is a functional block diagram of vibration feedback manager 306 illustrated in FIG. 3A .
  • Vibration Feedback Manager 306 has two filters that sequentially process digital audio signal 316: a static all-pass filter 372 that processes digital audio signal 316, followed by an adaptive feedback reduction algorithm 374 that further processes the signal.
  • Static filter 372 may be, for example, a wholly static or slow moving all-pass filter, such as an all pass filter with a static phase shift. However, a variety of other filters may be used, including but not limited to an IIR filter, an all-pass phase equalizer filter or an FIR filter. Filter 372 is used to cancel out at least the mechanical feedback received by sound input device 126 (and other sound input devices, such as sound input device 309, if present) picked up from vibrations by transducer 206. Such mechanical feedback is generally at relatively lower frequencies, for example frequencies less than 1 kHz, but may also have higher frequency components. Furthermore, the feedback received by vibration feedback manager 306 generally comprises mechanical feedback, but may also comprise acoustical feedback received from transducer 206 or from other sources.
  • vibration feedback manager 306 also includes an adaptive feedback reduction algorithm 374.
  • Filtered signal(s) from filter 372 are passed to filter(s) 374, which applies an adaptive feedback reduction algorithm to remove changes in the feedback path as well as any acoustical feedback (generally at higher frequencies) that filter 372 did not cancel out.
  • Filter 374 may be implemented into the system using software, a digital circuit, an analog circuit, or other implementations not described herein.
  • vibration feedback manager 306 may include a microprocessor or other signal processor device that executes filter 374. After adaptive feedback reduction algorithm 374 is applied to the signal(s), signal 317 is sent out of the vibration feedback manager 306 and to the next step in processing pipeline 300.
  • filter 372 may be static. Alternatively, filter 372 may be slow-moving and therefore not completely static. Because the mechanical feedback received by a microphone from the transducer is relatively consistent, and therefore, predictable, filter 372 may be selected in production based on measurements of the feedback.
  • adaptive feedback reduction algorithm 374 may dynamically adjust the filter system based on changes in the feedback over time. Adaptive feedback reduction algorithm 374 may compare the signal(s) received by the sound input devices with the feedback signals that are being transmitted by the vibrating transducer to determine any changes in the feedback. Vibration feedback manager 306 and, more specifically, filter 374 may use this feedback information to adjust itself over time.
  • system adaptation may be set to occur at a rate as low as 160 milliseconds, or even slower.
  • the speed of system adaptation may be set to directly correlate to frequency of the feedback, i.e. the lower the frequency, the lower the adaptation time of the system.
  • Vibration feedback manager 306 may dynamically adjust the filtering system dynamically, as described above, or feedback changes may also be noted and accounted for by an audiologist fitting a recipient.
  • filter 372 generally cancels feedback at lower frequencies. However, filter 372 may cancel some feedback at higher frequencies. Furthermore, as noted, adaptive feedback reduction algorithm 374 generally cancels feedback at higher frequencies. However, adaptive feedback reduction algorithm 374 may also cancel other feedback that was not canceled at filter 372, such as, for example, some lower frequency feedback.
  • FIGS. 4A and 4B are flow charts showing methods by which embodiments of the present technology may be implemented. More specifically, FIGS. 4A and 4B illustrate the general procedure by which one or more sound signals are treated when received by sound input device 126.
  • sound is received by the system at sound input device 126 (or other sound input devices, such as sound input device 209, if present).
  • the inputted sound signals are then processed to, for example, filter out any feedback or noise present in the signals.
  • this feedback may include well-defined feedback from vibrations of transducer 206.
  • this feedback is well-defined because sound input device 126 is hard-coupled to transducer 206.
  • the processed and filtered signals are then passed to the transducer as control/driver signals.
  • the signals passed to the transducer are used to generate a mechanical force to illicit a hearing perception by the recipient.
  • the mechanical force generated by transducer 206 will be transmitted to the skull bone of the recipient by one or more of several methods of bone conduction.
  • mechanical force may be transferred to the skull bone of the recipient via percutaneous bone conduction or transcutaneous bond conduction.
  • Transcutaneous bond conduction may utilize magnetic plates (one implantable and one external) or may adhere the bone conduction device to the side of the recipient's head near the skull bone of the recipient.
  • FIG. 4B is a more detailed flow chart showing a method by which embodiments of the present technology may be implemented.
  • signals received by the bone conduction devices may be in the form of, for example, acoustic sound, which may include acoustic feedback, or mechanical feedback.
  • the source of the acoustic feedback heard the sound input element may be from background noise, noise from the transducer movement, noise from the housing, or the rigid connection.
  • whichever signals are received by the system at sound input device 126 (or other input devices, if present) are pre-processed to generate electrical signals based on the information received by the sound input device(s). The signals are processed to, for example, turn the analog signals received by the microphone(s) into digital signals.
  • the digital signals received from pre-processing are then modified to, for example, cancel the well-defined mechanical feedback received as a result of the transducer's vibrations.
  • this well-defined feedback may be canceled using a static or slow-moving all-pass filter or other canceling devices.
  • other noise signals or feedback may be canceled due to this static or slow-moving filter other than the feedback received from the vibrating transducer. If feedback is left over (likely mostly acoustic feedback) after such a filter is applied, that feedback will be canceled by an adaptive feedback reduction algorithm, as noted in block 414.
  • the system After the digital signals are filtered, the system generates stimulation information based on the processed and filtered signals to generate a mechanical force based on that stimulation information, as noted in blocks 415 and 416, respectively.
  • stimulation information based on a processed audio signal is sent to the transducer, the transducer generates a mechanical force based on that information and the mechanical force is delivered to the recipient to illicit a hearing perception, as noted in block 417.
  • the mechanical force may be transferred to the skull bone of the recipient via different types of bone conduction hearing prostheses.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Neurosurgery (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Prostheses (AREA)

Claims (11)

  1. Prothèse auditive (100A, 100B, 100C), comprenant :
    au moins un dispositif d'entrée sonore (126) configuré pour détecter un signal sonore; et
    un transducteur (206) configuré pour générer une vibration fondée sur le signal sonore;
    caractérisé par
    le dispositif d'entrée sonore (126) étant directement couplé au transducteur (206) pour fournir un chemin de rétroaction mécanique défini, et
    un processeur de signal (300) configuré pour filtrer la rétroaction mécanique des vibrations reçues par le dispositif d'entrée sonore (126) par le biais du chemin de rétroaction mécanique défini.
  2. Prothèse auditive (100A, 100B, 100C) selon la revendication 1, dans laquelle le processeur de signal (300) filtre le feedback mécanique en utilisant un filtre passe-tout et le filtre passe-tout est statique ou se déplace lentement.
  3. Prothèse auditive (100A, 100B, 100C) selon la revendication 1, comprenant en outre l'un des éléments suivants:
    un système de gestion du Larsen en deux parties, dans lequel une première partie du système de gestion du Larsen en deux parties est configurée pour réduire le Larsen à basse fréquence;
    un second dispositif d'entrée sonore (209);
    un boîtier, dans lequel le transducteur et le boîtier sont une seule et même chose.
  4. Prothèse auditive (100A, 100B, 100C) selon la revendication 1, comprenant en outre un système de gestion de la rétroaction en deux parties, dans lequel une première partie du système de gestion de la rétroaction en deux parties est configurée pour réduire la rétroaction à basse fréquence et
    dans lequel la rétroaction basse fréquence comprend la rétroaction mécanique du transducteur (206) reçue par le dispositif d'entrée sonore (126), ou dans lequel une seconde partie du système de gestion de la rétroaction en deux parties est configurée pour réduire la rétroaction haute fréquence.
  5. Prothèse auditive (100A, 100B, 100C) selon la revendication 1, comprenant en outre un système de gestion de rétroaction en deux parties, dans laquelle une seconde partie du système de gestion de rétroaction en deux parties est configurée pour réduire la rétroaction haute fréquence et dans laquelle la rétroaction haute fréquence est une rétroaction audible provenant de la vibration et est reçue par le dispositif d'entrée sonore.
  6. Prothèse auditive (100A, 100B, 100C) selon la revendication 1, comprenant en outre un système de gestion de la rétroaction en deux parties, dans lequel une seconde partie du système de gestion de la rétroaction en deux parties est configurée pour réduire la rétroaction haute fréquence et dans lequel la seconde partie du système de gestion de la rétroaction en deux parties est configurée pour utiliser un algorithme adaptatif de réduction de la rétroaction.
  7. Prothèse auditive (100A, 100B, 100C) de la demande 1, comprenant en outre un système de gestion de rétroaction en deux parties, dans lequel une première partie du système de gestion de rétroaction en deux parties est configurée pour réduire la rétroaction à basse fréquence et dans lequel une adaptation de la première partie du système de gestion de rétroaction en deux parties est configurée pour se mettre à jour moins d'une fois toutes les 160, 180 ou 200 millisecondes.
  8. Prothèse auditive (100A, 100B, 100C) selon la revendication 1, comprenant en outre un second dispositif d'entrée sonore (209), dans laquelle le second dispositif d'entrée sonore (209) est couplé de manière rigide au transducteur (206).
  9. Prothèse auditive (100A, 100B, 100C) selon l'une quelconque des revendications 2 à 8, dans laquelle le processeur de signal (300) est configuré pour filtrer le retour mécanique à des fréquences inférieures à 1 kHz.
  10. Procédé de fonctionnement d'une prothèse auditive selon l'une quelconque des revendications 1-9, comprenant:
    la réception d'un signal acoustique avec une rétroaction acoustique et une rétroaction mécanique;
    l'application d'une première modification du signal pour réduire la rétroaction mécanique dans le signal;
    la génération d'une information de stimulation fondée sur le signal modifié;
    et
    la génération d'une force mécanique fondée sur les informations de stimulation.
  11. Procédé selon la revendication 10, comprenant en outre:
    l'application d'une seconde modification du signal pour réduire toute rétroaction restant dans le signal après l'application de la première modification,
    dans lequel l'application de la première modification est optimisée pour réduire la rétroaction à basse fréquence,
    dans lequel l'application de la seconde modification est optimisée pour réduire la rétroaction à haute fréquence.
EP14764706.9A 2013-03-15 2014-03-14 Filtrage d'une rétroaction bien définie à partir d'un transducteur vibrant à couplage physique Active EP2974380B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201361788558P 2013-03-15 2013-03-15
PCT/IB2014/059843 WO2014141205A1 (fr) 2013-03-15 2014-03-14 Filtrage d'une rétroaction bien définie à partir d'un transducteur vibrant à couplage physique

Publications (3)

Publication Number Publication Date
EP2974380A1 EP2974380A1 (fr) 2016-01-20
EP2974380A4 EP2974380A4 (fr) 2016-11-09
EP2974380B1 true EP2974380B1 (fr) 2020-05-13

Family

ID=54842946

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14764706.9A Active EP2974380B1 (fr) 2013-03-15 2014-03-14 Filtrage d'une rétroaction bien définie à partir d'un transducteur vibrant à couplage physique

Country Status (1)

Country Link
EP (1) EP2974380B1 (fr)

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6643378B2 (en) * 2001-03-02 2003-11-04 Daniel R. Schumaier Bone conduction hearing aid
CN1939092B (zh) * 2004-02-20 2015-09-16 Gn瑞声达A/S 消除反馈的方法及助听器

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
EP2974380A4 (fr) 2016-11-09
EP2974380A1 (fr) 2016-01-20

Similar Documents

Publication Publication Date Title
US6010532A (en) Dual path implantable hearing assistance device
US10321247B2 (en) External component with inductance and mechanical vibratory functionality
US8594356B2 (en) Bone conduction device having limited range of travel
AU2015200232B2 (en) Hearing Aid Device Using Dual Electromechanical Vibrator
US10142746B2 (en) Hearing prosthesis with a piezoelectric actuator
US6264603B1 (en) Middle ear vibration sensor using multiple transducers
US11412334B2 (en) Contralateral sound capture with respect to stimulation energy source
US20090247814A1 (en) Bone conduction hearing device having acoustic feedback reduction system
US10129665B2 (en) Distributed resonator
US8620015B2 (en) Vibrator for bone conducting hearing devices
US20090292161A1 (en) Multi-mode hearing prosthesis
US20070016267A1 (en) Directional sound processing in a cochlear implant
CA2343690A1 (fr) Systeme au moins partiellement implantable pour la readaptation de personnes souffrant de troubles auditifs
US20090259090A1 (en) Bone conduction hearing device having acoustic feedback reduction system
US9949042B2 (en) Audio processing pipeline for auditory prosthesis having a common, and two or more stimulator-specific, frequency-analysis stages
US9191759B2 (en) Data transmission through a recipient's skull bone
US20130172662A1 (en) Partially implantable hearing assistance system
US9955271B2 (en) Suspended components in auditory prostheses
US10812919B2 (en) Filtering well-defined feedback from a hard-coupled vibrating transducer
EP2974380B1 (fr) Filtrage d'une rétroaction bien définie à partir d'un transducteur vibrant à couplage physique
WO2024052753A1 (fr) Appareil auditif à actionneur externe vibrant compatible avec une opération bilatérale

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150929

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20161007

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 3/00 20060101ALI20161003BHEP

Ipc: H04R 25/00 20060101AFI20161003BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180103

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200110

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014065444

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1271806

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200615

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200914

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200913

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200814

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200813

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200813

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: AT

Ref legal event code: UEP

Ref document number: 1271806

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014065444

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20210216

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210331

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210314

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210331

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210314

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20140314

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230505

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: AT

Payment date: 20240226

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240227

Year of fee payment: 11

Ref country code: GB

Payment date: 20240229

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513