EP3371981B1 - Rückkopplungsheulverwaltung in einem adaptiven rauschunterdrückungssystem - Google Patents

Rückkopplungsheulverwaltung in einem adaptiven rauschunterdrückungssystem Download PDF

Info

Publication number
EP3371981B1
EP3371981B1 EP16794161.6A EP16794161A EP3371981B1 EP 3371981 B1 EP3371981 B1 EP 3371981B1 EP 16794161 A EP16794161 A EP 16794161A EP 3371981 B1 EP3371981 B1 EP 3371981B1
Authority
EP
European Patent Office
Prior art keywords
ambient
signal
threshold
response
feedback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP16794161.6A
Other languages
English (en)
French (fr)
Other versions
EP3371981A1 (de
Inventor
Jon D. Hendrix
Jeffrey D. Alderson
Chin Huang Yong
Ryan A. HELLMAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cirrus Logic International Semiconductor Ltd
Original Assignee
Cirrus Logic International Semiconductor Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cirrus Logic International Semiconductor Ltd filed Critical Cirrus Logic International Semiconductor Ltd
Priority claimed from PCT/US2016/059339 external-priority patent/WO2017079053A1/en
Publication of EP3371981A1 publication Critical patent/EP3371981A1/de
Application granted granted Critical
Publication of EP3371981B1 publication Critical patent/EP3371981B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1783—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase handling or detecting of non-standard events or conditions, e.g. changing operating modes under specific operating conditions
    • G10K11/17833—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase handling or detecting of non-standard events or conditions, e.g. changing operating modes under specific operating conditions by using a self-diagnostic function or a malfunction prevention function, e.g. detecting abnormal output levels
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17879—General system configurations using both a reference signal and an error signal
    • G10K11/17881—General system configurations using both a reference signal and an error signal the reference signal being an acoustic signal, e.g. recorded with a microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083—Reduction of ambient noise
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10—Applications
    • G10K2210/108—Communication systems, e.g. where useful sound is kept and noise is cancelled
    • G10K2210/1081—Earphones, e.g. for telephones, ear protectors or headsets
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30—Means
    • G10K2210/301—Computational
    • G10K2210/3028—Filtering, e.g. Kalman filters or special analogue or digital filters
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30—Means
    • G10K2210/301—Computational
    • G10K2210/3056—Variable gain
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/50—Miscellaneous
    • G10K2210/506—Feedback, e.g. howling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2410/00—Microphones
    • H04R2410/05—Noise reduction with a separate noise microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01—Hearing devices using active noise cancellation

Definitions

  • the present disclosure relates in general to adaptive noise cancellation in connection with an acoustic transducer, and more particularly, elimination or reduction of feedback howling in an adaptive noise cancellation system.
  • Wireless telephones such as mobile/cellular telephones, cordless telephones, and other consumer audio devices, such as mp3 players, are in widespread use. Performance of such devices with respect to intelligibility can be improved by providing noise cancelling using a microphone to measure ambient acoustic events and then using signal processing to insert an anti-noise signal into the output of the device to cancel the ambient acoustic events.
  • a noise cancellation system that uses feedback noise cancellation may suffer from an effect known as "howling.” Howling often occurs when a user of a device having noise cancellation places an earbud in such user's ear and adjusts the earbud against the pinna of the ear. Howling often manifests itself audibly as a narrowband sound that continues to grow quickly over a short time.
  • a howl may often occur when the earbud is pressed so tightly against the user's pinna with such a large pressure that the response of the speaker of the earbud becomes stronger in a particular frequency band than was anticipated when the device's feedback noise cancellation system was designed. The howl may go away once the user reduces pressure of the earbud against the pinna. Because howling leads to poor customer experience, systems and methods to reduce or eliminate howling are desired.
  • an integrated circuit for implementing at least a portion of a personal audio device may include an output for providing an output signal to a transducer including both a source audio signal for playback to a listener and an anti-noise signal for countering the effect of ambient audio sounds in an acoustic output of the transducer, an ambient microphone input for receiving an ambient microphone signal indicative of the ambient audio sounds; an error microphone input for receiving an error microphone signal indicative of the output of the transducer and the ambient audio sounds at the transducer; and a processing circuit that implements a feedback path having a feedback response that generates a feedback anti-noise signal from the error microphone signal, wherein a signal gain of the feedback path is a function of the ambient microphone signal, and wherein the anti-noise signal comprises at least the feedback anti-noise signal.
  • a method for cancelling ambient audio sounds in the proximity of a transducer may include receiving an ambient microphone signal indicative of the ambient audio sounds, receiving an error microphone signal indicative of the output of the transducer and ambient audio sounds at the transducer, generating an anti-noise signal for countering the effects of ambient audio sounds at an acoustic output of the transducer, wherein generating the anti-noise signal comprises generating a feedback anti-noise signal from the error microphone signal with a feedback path having a feedback response, wherein a signal gain of the feedback path is a function of the ambient microphone signal, and wherein the anti-noise signal comprises at least the feedback anti-noise signal, and combining the anti-noise signal with a source audio signal to generate an audio signal provided to the transducer.
  • the present disclosure encompasses noise cancelling techniques and circuits that can be implemented in a personal audio device, such as a wireless telephone.
  • the personal audio device includes an ANC circuit that may measure the ambient acoustic environment and generate a signal that is injected in the speaker (or other transducer) output to cancel ambient acoustic events.
  • a reference microphone may be provided to measure the ambient acoustic environment, and an error microphone may be included for controlling the adaptation of the anti-noise signal to cancel the ambient audio sounds and for correcting for the electro-acoustic path from the output of the processing circuit through the transducer.
  • Wireless telephone 10 is an example of a device in which techniques in accordance with embodiments of this disclosure may be employed, but it is understood that not all of the elements or configurations embodied in illustrated wireless telephone 10, or in the circuits depicted in subsequent illustrations, are required in order to practice the inventions recited in the claims.
  • Wireless telephone 10 may include a transducer, such as speaker SPKR that reproduces distant speech received by wireless telephone 10, along with other local audio events such as ringtones, stored audio program material, injection of near-end speech (i.e., the speech of the user of wireless telephone 10) to provide a balanced conversational perception, and other audio that requires reproduction by wireless telephone 10, such as sources from webpages or other network communications received by wireless telephone 10 and audio indications such as a low battery indication and other system event notifications.
  • a near-speech microphone NS may be provided to capture near-end speech, which is transmitted from wireless telephone 10 to the other conversation participant(s).
  • Wireless telephone 10 may include ANC circuits and features that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR.
  • a reference microphone R may be provided for measuring the ambient acoustic environment, and may be positioned away from the typical position of a user's mouth, so that the near-end speech may be minimized in the signal produced by reference microphone R.
  • Another microphone, error microphone E may be provided in order to further improve the ANC operation by providing a measure of the ambient audio combined with the audio reproduced by speaker SPKR close to ear 5, when wireless telephone 10 is in close proximity to ear 5.
  • additional reference and/or error microphones may be employed.
  • Circuit 14 within wireless telephone 10 may include an audio CODEC integrated circuit (IC) 20 that receives the signals from reference microphone R, near-speech microphone NS, and error microphone E and interfaces with other integrated circuits, such as a radio-frequency (RF) integrated circuit 12 having a wireless telephone transceiver.
  • IC audio CODEC integrated circuit
  • RF radio-frequency
  • the circuits and techniques disclosed herein may be incorporated in a single integrated circuit that includes control circuits and other functionality for implementing the entirety of the personal audio device, such as an MP3 player-on-a-chip integrated circuit.
  • the circuits and techniques disclosed herein may be implemented partially or fully in software and/or firmware embodied in computer-readable media and executable by a controller or other processing device.
  • ANC techniques of the present disclosure measure ambient acoustic events (as opposed to the output of speaker SPKR and/or the near-end speech) impinging on reference microphone R, and by also measuring the same ambient acoustic events impinging on error microphone E, ANC processing circuits of wireless telephone 10 adapt an anti-noise signal generated from the output of reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events at error microphone E.
  • ANC circuits are effectively estimating acoustic path P(z) while removing effects of an electro-acoustic path S(z) that represents the response of the audio output circuits of CODEC IC 20 and the acoustic/electric transfer function of speaker SPKR including the coupling between speaker SPKR and error microphone E in the particular acoustic environment, which may be affected by the proximity and structure of ear 5 and other physical objects and human head structures that may be in proximity to wireless telephone 10, when wireless telephone 10 is not firmly pressed to ear 5.
  • wireless telephone 10 includes a two-microphone ANC system with a third near-speech microphone NS
  • some aspects of the present invention may be practiced in a system that does not include separate error and reference microphones, or a wireless telephone that uses near-speech microphone NS to perform the function of the reference microphone R.
  • near-speech microphone NS will generally not be included, and the near-speech signal paths in the circuits described in further detail below may be omitted, without changing the scope of the disclosure, other than to limit the options provided for input to the microphone.
  • wireless telephone 10 is depicted having a headphone assembly 13 coupled to it via audio port 15.
  • Audio port 15 may be communicatively coupled to RF integrated circuit 12 and/or CODEC IC 20, thus permitting communication between components of headphone assembly 13 and one or more of RF integrated circuit 12 and/or CODEC IC 20.
  • headphone assembly 13 may include a combox 16, a left headphone 18A, and a right headphone 18B.
  • headphone assembly 13 may comprise a wireless headphone assembly, in which case all or some portions of CODEC IC 20 may be present in headphone assembly 13, and headphone assembly 13 may include a wireless communication interface (e.g., BLUETOOTH) in order to communicate between headphone assembly 13 and wireless telephone 10.
  • a wireless communication interface e.g., BLUETOOTH
  • headphone broadly includes any loudspeaker and structure associated therewith that is intended to be mechanically held in place proximate to a listener's ear canal, and includes without limitation earphones, earbuds, and other similar devices.
  • headphone may refer to intra-concha earphones, supra-concha earphones, and supra-aural earphones.
  • Combox 16 or another portion of headphone assembly 13 may have a near-speech microphone NS to capture near-end speech in addition to or in lieu of near-speech microphone NS of wireless telephone 10.
  • each headphone 18A, 18B may include a transducer such as speaker SPKR that reproduces distant speech received by wireless telephone 10, along with other local audio events such as ringtones, stored audio program material, injection of near-end speech (i.e., the speech of the user of wireless telephone 10) to provide a balanced conversational perception, and other audio that requires reproduction by wireless telephone 10, such as sources from webpages or other network communications received by wireless telephone 10 and audio indications such as a low battery indication and other system event notifications.
  • a transducer such as speaker SPKR that reproduces distant speech received by wireless telephone 10, along with other local audio events such as ringtones, stored audio program material, injection of near-end speech (i.e., the speech of the user of wireless telephone 10) to provide a balanced conversational perception, and other audio that requires reproduction by wireless telephone 10,
  • Each headphone 18A, 18B may include a reference microphone R for measuring the ambient acoustic environment and an error microphone E for measuring of the ambient audio combined with the audio reproduced by speaker SPKR close to a listener's ear when such headphone 18A, 18B is engaged with the listener's ear.
  • CODEC IC 20 may receive the signals from reference microphone R and error microphone E of each headphone and near-speech microphone NS, and perform adaptive noise cancellation for each headphone as described herein.
  • a CODEC IC or another circuit may be present within headphone assembly 13, communicatively coupled to reference microphone R, near-speech microphone NS, and error microphone E, and configured to perform adaptive noise cancellation as described herein.
  • CODEC IC 20 may include an analog-to-digital converter (ADC) 21A for receiving the reference microphone signal from microphone R and generating a digital representation ref of the reference microphone signal, an ADC 21B for receiving the error microphone signal from error microphone E and generating a digital representation err of the error microphone signal, and an ADC 21C for receiving the near speech microphone signal from near speech microphone NS and generating a digital representation ns of the near speech microphone signal.
  • ADC analog-to-digital converter
  • CODEC IC 20 may generate an output for driving speaker SPKR from an amplifier A1, which may amplify the output of a digital-to-analog converter (DAC) 23 that receives the output of a combiner 26.
  • Combiner 26 may combine audio signals ia from internal audio sources 24, the anti-noise signal generated by ANC circuit 30, which by convention has the same polarity as the noise in reference microphone signal ref and is therefore subtracted by combiner 26, and a portion of near speech microphone signal ns so that the user of wireless telephone 10 may hear his or her own voice in proper relation to downlink speech ds, which may be received from radio frequency (RF) integrated circuit 22 and may also be combined by combiner 26.
  • RF radio frequency
  • Near speech microphone signal ns may also be provided to RF integrated circuit 22 and may be transmitted as uplink speech to the service provider via antenna ANT.
  • Adaptive filter 32 may receive reference microphone signal ref and under ideal circumstances, may adapt its transfer function W(z) to be P(z)/S(z) to generate a feedforward anti-noise component of the anti-noise signal, which may be combined by combiner 50 with a feedback anti-noise component of the anti-noise signal (described in greater detail below) to generate an anti-noise signal which in turn may be provided to an output combiner that combines the anti-noise signal with the source audio signal to be reproduced by the transducer, as exemplified by combiner 26 of FIGURE 2 .
  • the coefficients of adaptive filter 32 may be controlled by a W coefficient control block 31 that uses a correlation of signals to determine the response of adaptive filter 32, which generally minimizes the error, in a least-mean squares sense, between those components of reference microphone signal ref present in error microphone signal err.
  • the signals compared by W coefficient control block 31 may be the reference microphone signal ref as shaped by a copy of an estimate of the response of path S(z) provided by filter 34B and another signal that includes error microphone signal err.
  • adaptive filter 32 may adapt to the desired response of P(z)/S(z).
  • the signal compared to the output of filter 34B by W coefficient control block 31 may include an inverted amount of downlink audio signal ds and/or internal audio signal ia that has been processed by filter response SE(z), of which response SE COPY (Z) is a copy.
  • adaptive filter 32 may be prevented from adapting to the relatively large amount of downlink audio and/or internal audio signal present in error microphone signal err.
  • Filter 34B may not be an adaptive filter, per se, but may have an adjustable response that is tuned to match the response of adaptive filter 34A, so that the response of filter 34B tracks the adapting of adaptive filter 34A.
  • adaptive filter 34A may have coefficients controlled by SE coefficient control block 33, which may compare downlink audio signal ds and/or internal audio signal ia and error microphone signal err after removal of the above-described filtered downlink audio signal ds and/or internal audio signal ia, that has been filtered by adaptive filter 34A to represent the expected downlink audio delivered to error microphone E, and which is removed from the output of adaptive filter 34A by a combiner 36 to generate a playback-corrected error, shown as PBCE in FIGURE 3 .
  • SE coefficient control block 33 may compare downlink audio signal ds and/or internal audio signal ia and error microphone signal err after removal of the above-described filtered downlink audio signal ds and/or internal audio signal ia, that has been filtered by adaptive filter 34A to represent the expected downlink audio delivered to error microphone E, and which is removed from the output of adaptive filter 34A by a combiner 36 to generate a playback-corrected error, shown as PBCE in FIGURE 3
  • SE coefficient control block 33 may correlate the actual downlink speech signal ds and/or internal audio signal ia with the components of downlink audio signal ds and/or internal audio signal ia that are present in error microphone signal err.
  • Adaptive filter 34A may thereby be adapted to generate a signal from downlink audio signal ds and/or internal audio signal ia, that when subtracted from error microphone signal err, contains the content of error microphone signal err that is not due to downlink audio signal ds and/or internal audio signal ia.
  • ANC circuit 30 may also comprise feedback filter 44.
  • Feedback filter 44 may receive the playback corrected error signal PBCE and may apply a filter response FB(z) to generate a feedback signal based on the playback corrected error.
  • a feedback path of the feedback anti-noise component may have a compressor 46 in series with feedback filter 44 such that the product of filter response FB(z) and a compressor response of compressor 46 (described in greater detail below) is applied to playback corrected error signal PBCE in order to generate the feedback anti-noise component of the anti-noise signal.
  • feedback filter 44 and compressor 46 form a feedback path having a feedback response (e.g., product of filter response FB(z) and the compressor response of compressor 46) that generates a feedback anti-noise signal based on the error microphone signal (e.g., playback corrected error signal PBCE).
  • feedback filter 44 generates an uncompressed feedback anti-noise signal from the error microphone signal and compressor 46 generates a feedback anti-noise signal from the uncompressed feedback anti-noise signal in accordance with the compressor response of compressor 46.
  • the feedback anti-noise component of the anti-noise signal may be combined by combiner 50 with the feedforward anti-noise component of the anti-noise signal to generate the anti-noise signal which in turn may be provided to an output combiner that combines the anti-noise signal with the source audio signal to be reproduced by the transducer, as exemplified by combiner 26 of FIGURE 2 .
  • a response of compressor 46 may generally be represented by the curve depicted in FIGURE 4 .
  • compressor 46 may attenuate a gain of compressor 46 and/or may limit the compressed feedback anti-noise signal generated by compressor 46.
  • compressor 46 may operate in three regions.
  • Compressor 46 may operate in a first region when the magnitude of the uncompressed feedback anti-noise signal is below a first threshold as shown in FIGURE 4 , a second region when the magnitude of the uncompressed feedback anti-noise signal is between the first threshold and a second threshold as shown in FIGURE 4 , and a third region when the magnitude of the uncompressed feedback anti-noise signal is above the second threshold as shown in FIGURE 4 .
  • compressor 46 may not apply any attenuation to the uncompressed feedback anti-noise signal such that for magnitudes of the uncompressed feedback anti-noise signal below the first threshold, the compressor 46 generates a compressed feedback anti-noise signal approximately equal to that of the uncompressed feedback anti-noise signal.
  • compressor 46 may apply a unity gain to the uncompressed feedback anti-noise signal.
  • compressor 46 may apply a finite attenuation to uncompressed feedback anti-noise signal, such that for magnitudes of the uncompressed feedback anti-noise signal between the first threshold and the second threshold, the corresponding magnitude of the compressed feedback anti-noise signal generated by compressor 46 is substantially smaller than that of the uncompressed feedback anti-noise signal.
  • compressor 46 may apply a level of attenuation (e.g. up to and including infinite attenuation) so as to apply a limit to the compressed feedback anti-noise signal.
  • compressor 46 will attenuate the uncompressed feedback anti-noise signal so as to limit compressed feedback anti-noise signal to a maximum magnitude.
  • compressor 46 may reduce or eliminate howling, as when howling occurs, high magnitudes associated with the howling may be attenuated or limited by compressor 46.
  • the first threshold and second threshold shown in FIGURE 4 were fixed, the feedback path of ANC circuit 30 may not adequately provide feedback-based noise cancellation when in the presence of ambient noise with high magnitudes, as compressor 46 may attenuate or limit the feedback anti-noise needed to effectively cancel ambient noise.
  • the first threshold and second threshold of the compressor response of compressor 46 may be variable and controllable based on reference microphone signal ref or another microphone signal indicative of ambient audio sounds.
  • the compressor response is not only a function of the uncompressed anti-noise signal (and thus a function of the error microphone signal from which playback corrected error signal PBCE and the uncompressed anti-noise signal are generated), but also a function of an ambient microphone signal (e.g., reference microphone signal ref) indicative of ambient audio sounds.
  • an ambient microphone signal e.g., reference microphone signal ref
  • FIGURE 5 is a block diagram depicting selected components of compressor 46, in accordance with embodiments of the present disclosure.
  • compressor 46 may comprise an ambient threshold comparator 60 which may compare a magnitude of reference microphone signal ref to a predetermined ambient threshold level, output the difference between the magnitude of reference microphone signal ref to the predetermined ambient threshold level if the magnitude of reference microphone signal ref exceeds the predetermined ambient threshold level, and output zero otherwise.
  • Compressor 46 may, as exemplified by combiner 62, add the output of ambient threshold comparator 60 to a default value of the first threshold to set the first threshold of the compressor 46 as shown in FIGURE 4 .
  • Compressor 46 may also, as exemplified by combiner 64, add the output of ambient threshold comparator 60 to a default value of the second threshold to set the second threshold of the compressor 46 as shown in FIGURE 4 .
  • the first threshold and the second threshold increase based on an amount of increase of the ambient magnitude above the ambient threshold.
  • the first threshold and the second threshold may increase at an approximately equal amount for a given amount of increase of the magnitude of reference microphone signal ref above the ambient threshold.
  • ANC circuit 30 may include wind/scratch detector 38.
  • Wind/scratch detector 38 may comprise any suitable system, device, or apparatus configured to detect when wind or other mechanical noise (as opposed to acoustic ambient noise) is present at reference microphone R.
  • wind/scratch detector 38 may, as described in U.S. Pat. No.
  • Wind/scratch detector 38 may compare a time derivative of sum ⁇
  • feedback filter 44 and compressor 46 are shown as separate components of ANC circuit 30, in some examples some structure and/or function of feedback filter 44 and compressor 46 may be combined.

Claims (15)

  1. Integrierte Schaltung (30), um zumindest einen Teil eines persönlichen Audiogeräts umzusetzen, umfassend:
    einen Ausgang, um einem Wandler ein Ausgangssignal bereitzustellen, das sowohl ein Quell-Audiosignal zur Wiedergabe an einen Hörer enthält als auch ein Rauschunterdrückungssignal, um der Wirkung von Umgebungsgeräuschen im akustischen Ausgang des Wandlers entgegenzuwirken;
    einen Mikrofonumgebungseingang, um ein die Umgebungsgeräusche anzeigendes Mikrofonumgebungssignal (ref) zu empfangen;
    einen Mikrofonfehlereingang, um ein Mikrofonfehlersignal (err) zu empfangen, das den Ausgang des Wandlers und die Umgebungsgeräusche am Wandler anzeigt; und
    eine eine Rückkopplungsstrecke implementierende Verarbeitungsschaltung, welche einen Kompressor (46) mit einer Kompressorantwort aufweist, der mit einem Rückkopplungsfilter (44) in Reihe geschaltet ist und einen solchen Filterfrequenzgang aufweist, dass die Rückkopplungsstrecke eine Rückkopplungsantwort aufweist, die ein Produkt aus Kompressorantwort und Filterfrequenzgang ist und aus dem Mikrofonfehlersignal ein Rauschunterdrückungs-Rückkopplungssignal erzeugt, wobei die Kompressorantwort eine Funktion des Mikrofonumgebungssignals ist und wobei das Rauschunterdrückungssignal mindestens das Rauschunterdrückungs-Rückkopplungssignal umfasst.
  2. Integrierte Schaltung gemäß Anspruch 1, wobei der Filterfrequenzgang aus dem Mikrofonfehlersignal ein unkomprimiertes Rauschunterdrückungs-Rückkopplungssignal erzeugt; und
    die Kompressorantwort das Rauschunterdrückungs-Rückkopplungssignal aus dem unkomprimierten Rauschunterdrückungs-Rückkopplungssignal erzeugt, wobei die Kompressorantwort eine Funktion des Mikrofonumgebungssignals ist.
  3. Integrierte Schaltung gemäß Anspruch 2, wobei die Kompressorantwort mindestens einen Schwellenwert für die Verstärkungsdämpfung umfasst, die eine Funktion des Mikrofonumgebungssignals ist.
  4. Integrierte Schaltung gemäß Anspruch 3, wobei der mindestens eine Schwellenwert der Verstärkungsdämpfung eine erste Schwellenamplitude des unkomprimierten Rauschunterdrückungs-Rückkopplungssignals umfasst, über der eine erste Verstärkungsdämpfung angelegt wird sowie eine zweite Schwellenamplitude des unkomprimierten Rauschunterdrückungs-Rückkopplungssignals umfasst, über der eine zweite Verstärkungsdämpfung angelegt wird und wobei der erste Schwellenwert und der zweite Schwellenwert Funktionen des Mikrofonumgebungssignals sind.
  5. Integrierte Schaltung gemäß Anspruch 4, wobei der erste Schwellenwert und der zweite Schwellenwert basierend auf einem Erhöhungsbetrag der Umgebungsgröße über den Umgebungs-Schwellenwert ansteigt, wenn das Mikrofonumgebungssignal eine Umgebungsgröße über dem Umgebungsschwellenwert aufweist.
  6. Integrierte Schaltung gemäß Anspruch 5, wobei der erste Schwellenwert und der zweite Schwellenwert bei einem bestimmten Erhöhungsbetrag über den Umgebungsschwellenwert etwa um einen gleichen Betrag ansteigen.
  7. Integrierte Schaltung gemäß Anspruch 3, wobei der Kompressor (46) den zumindest einen Schwellenwert der Verstärkungsdämpfung nicht mehr aktualisiert, wenn ein mechanisches Geräusch im Mikrofonumgebungssignal enthalten ist.
  8. Integrierte Schaltung gemäß Anspruch 1, wobei die Verarbeitungsschaltung (30) ferner einen Vorwärtskopplungsfilter (32) mit einer Vorwärtskopplungsantwort implementiert, die aus dem Mikrofonumgebungssignal zumindest einen Teil des Rauschunterdrückungssignals erzeugt.
  9. Integrierte Schaltung gemäß Anspruch 8, wobei die Verarbeitungsschaltung ferner einen Vorwärtskopplungs-Steuerblock-Koeffizienten (31) implementiert, der die Vorwärtskopplungsantwort des Vorwärtskopplungsfilters (32) formt, indem die Vorwärtskopplungsantwort des Vorwärtskopplungsfilters so verändert wird, dass die Umgebungsgeräusche im Mikrofonfehlersignal minimiert werden.
  10. Integrierte Schaltung gemäß Anspruch 1, wobei die Verarbeitungsschaltung ferner implementiert:
    einen sekundären Pfadschätzfilter (34A), dafür ausgelegt, einen elektroakustischen Pfad des Quell-Audiosignals zu modellieren und eine sekundäre Antwort aufweist, die aus dem Quell-Audiosignal eine sekundäre Pfadschätzung erzeugt; und
    einen sekundären Pfadschätz-Koeffizienten-Steuerblock (33), der die sekundäre Antwort des sekundären Pfadschätzfilters entsprechend dem Quell-Audiosignal und einem wiedergabekorrigierten Fehler formt, indem die sekundäre Antwort des sekundären Pfadschätzfilters so verändert wird, dass ein wiedergabekorrigierter Fehler minimiert wird, wobei der wiedergabekorrigierte Fehler auf der Differenz zwischen dem Mikrofonfehlersignal und der sekundären Pfadschätzung basiert.
  11. Verfahren zur Unterdrückung von Umgebungsgeräuschen in der Nähe eines Wandlers, umfassend:
    ein die Umgebungsgeräusche anzeigendes Mikrofonumgebungssignal (ref) empfangen;
    ein Mikrofonfehlersignal (err) empfangen, das den Ausgang des Wandlers und die Umgebungsgeräusche am Wandler anzeigt;
    ein Rauschunterdrückungssignal erzeugen, um den Auswirkungen der Umgebungsgeräusche am akustischen Ausgang des Wandlers entgegenzuwirken, wobei die Erzeugung des Rauschunterdrückungssignals umfasst, aus dem Mikrofonfehlersignal ein Rauschunterdrückungs-Rückkopplungssignal mit einer Rückkopplungsstrecke erzeugen, die einen Kompressor (46) mit einer Kompressorantwort umfasst, der mit einem Rückkopplungsfilter (44) in Reihe geschaltet ist und einen solchen Filterfrequenzgang aufweist, dass die Rückkopplungsstrecke eine Rückkopplungsantwort aufweist, die ein Produkt aus Kompressorantwort und Filterfrequenzgang ist, wobei die Kompressorantwort eine Funktion des Mikrofonumgebungssignals ist und wobei das Rauschunterdrückungssignal mindestens das Rauschunterdrückungs-Rückkopplungssignal umfasst; und
    das Rauschunterdrückungssignal mit einem Quell-Audiosignal kombinieren, um ein dem Wandler zugeführtes Audiosignal zu erzeugen.
  12. Verfahren gemäß Anspruch 11, wobei die Erzeugung des Rauschunterdrückungs-Rückkopplungssignals umfasst:
    aus dem Mikrofonfehlersignal mit Hilfe des Rückkopplungsfilters mit der Filterantwort ein unkomprimiertes Rauschunterdrückungs-Rückkopplungssignal erzeugen; und
    mit dem Kompressor das Rauschunterdrückungs-Rückkopplungssignal aus dem unkomprimierten Rauschunterdrückungs-Rückkopplungssignal erzeugen.
  13. Verfahren gemäß Anspruch 12, wobei die Kompressorantwort mindestens einen Schwellenwert für die Verstärkungsdämpfung umfasst, die eine Funktion des Mikrofonumgebungssignals ist.
  14. Verfahren gemäß Anspruch 13, wobei der mindestens eine Schwellenwert der Verstärkungsdämpfung eine erste Schwellenamplitude des unkomprimierten Rauschunterdrückungs-Rückkopplungssignals umfasst, über der eine erste Verstärkungsdämpfung angelegt wird sowie eine zweite Schwellenamplitude des unkomprimierten Rauschunterdrückungs-Rückkopplungssignals umfasst, über der eine zweite Verstärkungsdämpfung angelegt wird und wobei der erste Schwellenwert und der zweite Schwellenwert Funktionen des Mikrofonumgebungssignals sind.
  15. Verfahren gemäß Anspruch 14, wobei der erste Schwellenwert und der zweite Schwellenwert basierend auf einem Erhöhungsbetrag der Umgebungsgröße über den Umgebungs-Schwellenwert ansteigt, wenn das Mikrofonumgebungssignal eine Umgebungsgröße über einem Umgebungsschwellenwert aufweist.
EP16794161.6A 2015-11-06 2016-10-28 Rückkopplungsheulverwaltung in einem adaptiven rauschunterdrückungssystem Active EP3371981B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562252058P 2015-11-06 2015-11-06
PCT/US2016/059339 WO2017079053A1 (en) 2015-11-06 2016-10-28 Feedback howl management in adaptive noise cancellation system

Publications (2)

Publication Number Publication Date
EP3371981A1 EP3371981A1 (de) 2018-09-12
EP3371981B1 true EP3371981B1 (de) 2020-05-06

Family

ID=63077611

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16794161.6A Active EP3371981B1 (de) 2015-11-06 2016-10-28 Rückkopplungsheulverwaltung in einem adaptiven rauschunterdrückungssystem

Country Status (2)

Country Link
EP (1) EP3371981B1 (de)
CN (1) CN108781318B (de)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109841223B (zh) * 2019-03-06 2020-11-24 深圳大学 一种音频信号处理方法、智能终端及存储介质
CN110225429B (zh) * 2019-06-12 2020-12-04 会听声学科技（北京）有限公司 主动降噪方法、装置及耳机
US11468874B2 (en) * 2020-11-13 2022-10-11 Google Llc Noise control system
CN116208879A (zh) * 2021-11-30 2023-06-02 华为技术有限公司 具有主动降噪功能的耳机及主动降噪方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060262938A1 (en) * 2005-05-18 2006-11-23 Gauger Daniel M Jr Adapted audio response
GB2441835B (en) * 2007-02-07 2008-08-20 Sonaptic Ltd Ambient noise reduction system
CN103270552B (zh) * 2010-12-03 2016-06-22 美国思睿逻辑有限公司 在个人语音装置中的适应性噪音消除器的监督控制
US8908877B2 (en) * 2010-12-03 2014-12-09 Cirrus Logic, Inc. Ear-coupling detection and adjustment of adaptive response in noise-canceling in personal audio devices
US9318094B2 (en) * 2011-06-03 2016-04-19 Cirrus Logic, Inc. Adaptive noise canceling architecture for a personal audio device
US9106989B2 (en) * 2013-03-13 2015-08-11 Cirrus Logic, Inc. Adaptive-noise canceling (ANC) effectiveness estimation and correction in a personal audio device
US9462376B2 (en) * 2013-04-16 2016-10-04 Cirrus Logic, Inc. Systems and methods for hybrid adaptive noise cancellation

Also Published As

Publication number Publication date
CN108781318B (zh) 2020-07-17
EP3371981A1 (de) 2018-09-12
CN108781318A (zh) 2018-11-09

Similar Documents

Publication Publication Date Title
US10290296B2 (en) Feedback howl management in adaptive noise cancellation system
EP2987337B1 (de) Systeme und verfahren zur adaptiven rauschunterdrückung mit dynamischer vorspannung der koeffizienten eines adaptives rauschunterdrückungssystems
US9552805B2 (en) Systems and methods for performance and stability control for feedback adaptive noise cancellation
EP3081006B1 (de) Systeme und verfahren zur bereitstellung von adaptiver wiedergabeentzerrung in einer audiovorrichtung
US9704472B2 (en) Systems and methods for sharing secondary path information between audio channels in an adaptive noise cancellation system
CN108140381B (zh) 具有滤波误差麦克风信号的混合自适应噪声消除系统
US9807503B1 (en) Systems and methods for use of adaptive secondary path estimate to control equalization in an audio device
EP3044780B1 (de) Systeme und verfahren zur adaptiven rauschunterdrückung mittels adaptiver innerer formung von weissem rauschen zum trainieren eines sekundärpfades
US10181315B2 (en) Systems and methods for selectively enabling and disabling adaptation of an adaptive noise cancellation system
EP2847760B1 (de) Durch fehlersignalinhalte gesteuerte anpassung von sekundären leckagepfadmodellen in personalisierten audiovorrichtungen mit rauschunterdrückung
US9812114B2 (en) Systems and methods for controlling adaptive noise control gain
EP3371981B1 (de) Rückkopplungsheulverwaltung in einem adaptiven rauschunterdrückungssystem
US11664000B1 (en) Systems and methods for modifying biquad filters of a feedback filter in feedback active noise cancellation

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180514

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20191211

RIN1 Information on inventor provided before grant (corrected)

Inventor name: ALDERSON, JEFFREY D.

Inventor name: YONG, CHIN HUANG

Inventor name: HENDRIX, JON D.

Inventor name: HELLMAN, RYAN A.

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAL Information related to payment of fee for publishing/printing deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR3

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1268763

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200515

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016035987

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200506

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200906

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200907

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200807

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200806

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200806

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1268763

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200506

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 602016035987

Country of ref document: DE

Representative=s name: HL KEMPNER PATENTANWAELTE, SOLICITORS (ENGLAND, DE

Ref country code: DE

Ref legal event code: R082

Ref document number: 602016035987

Country of ref document: DE

Representative=s name: HL KEMPNER PATENTANWALT, RECHTSANWALT, SOLICIT, DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016035987

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20210209

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201028

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20201031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201031

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201031

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201028

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200506

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20221025

Year of fee payment: 7

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230321

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231027

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231027

Year of fee payment: 8