EP3618058A1 - Compensation et commande automatique de gain dans de dispositifs de réduction active du bruit - Google Patents

Compensation et commande automatique de gain dans de dispositifs de réduction active du bruit Download PDF

Info

Publication number
EP3618058A1
EP3618058A1 EP19201934.7A EP19201934A EP3618058A1 EP 3618058 A1 EP3618058 A1 EP 3618058A1 EP 19201934 A EP19201934 A EP 19201934A EP 3618058 A1 EP3618058 A1 EP 3618058A1
Authority
EP
European Patent Office
Prior art keywords
anr
signal
input signal
vga
gain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP19201934.7A
Other languages
German (de)
English (en)
Other versions
EP3618058B1 (fr
Inventor
Joseph H. CATTELL
Michael O'connell
Ricardo F. Carreras
David WARKENTIN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bose Corp
Original Assignee
Bose Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/473,926 external-priority patent/US10580398B2/en
Priority claimed from US15/473,939 external-priority patent/US10614790B2/en
Priority claimed from US15/473,889 external-priority patent/US10553195B2/en
Application filed by Bose Corp filed Critical Bose Corp
Publication of EP3618058A1 publication Critical patent/EP3618058A1/fr
Application granted granted Critical
Publication of EP3618058B1 publication Critical patent/EP3618058B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • G10K11/17821—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
    • G10K11/17827—Desired external signals, e.g. pass-through audio such as music or speech
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17879—General system configurations using both a reference signal and an error signal
    • G10K11/17881—General system configurations using both a reference signal and an error signal the reference signal being an acoustic signal, e.g. recorded with a microphone
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17885—General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083—Reduction of ambient noise
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10—Applications
    • G10K2210/108—Communication systems, e.g. where useful sound is kept and noise is cancelled
    • G10K2210/1081—Earphones, e.g. for telephones, ear protectors or headsets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041—Mechanical or electronic switches, or control elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2410/00—Microphones
    • H04R2410/05—Noise reduction with a separate noise microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01—Hearing devices using active noise cancellation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

  • This disclosure generally relates to technology for controlling overload conditions in active noise reducing (ANR) devices.
  • ANR active noise reducing
  • ANR devices can utilize one or more digital signal processors (DSPs) for implementing various signal flow topologies. Examples of such DSPs are described in U.S. Patents 8,073,150 and 8,073,151 , which are incorporated herein by reference in their entirety.
  • DSPs digital signal processors
  • this document features a method that includes receiving an input signal representing audio captured by a microphone of an active noise reduction (ANR) headphone, and processing, by a first compensator, a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone.
  • the method also includes processing, by a second compensator disposed in parallel to the first compensator, a second frequency range of the input signal to generate a second signal for the acoustic transducer.
  • the first frequency range includes frequencies higher than the frequencies in the second frequency range.
  • the method also includes detecting, by one or more processing devices, that the second signal satisfies a threshold condition, and attenuating the second signal responsive to determining that the second signal satisfies the threshold condition.
  • this document features an active noise reduction (ANR) device that includes one or more sensors configured to generate an input signal indicative of an external environment of the ANR device.
  • the device also includes a first compensator configured to process a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone, and a second compensator disposed in parallel to the first compensator.
  • the second compensator filter is configured to process a second frequency range of the input signal to generate a second signal for the acoustic transducer, wherein the first frequency range includes frequencies higher than the frequencies in the second frequency range.
  • the device further includes one or more processing devices configured to detect that the second signal satisfies a threshold condition, and attenuate the second signal responsive to determining that the second signal satisfies the threshold condition.
  • this document features one or more machine-readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations.
  • the operations include receiving an input signal representing audio captured by a microphone of an active noise reduction (ANR) headphone, causing a first compensator to process a first frequency range of the input signal to generate a first signal for an acoustic transducer of the ANR headphone, and causing a second compensator to process a second frequency range of the input signal to generate a second signal for the acoustic transducer.
  • the second compensator is disposed in parallel to the first compensator, and the first frequency range includes frequencies higher than the frequencies in the second frequency range.
  • the operations further include detecting that the second signal satisfies a threshold condition, and responsive to determining that the second signal satisfies the threshold condition, attenuating the second signal.
  • Implementations of the above aspects may include one or more of the following features.
  • a combined signal for the acoustic transducer can be generated by summing the second signal and the first signal, or by summing the attenuated second signal and the first signal.
  • the acoustic transducer can be driven using the combined signal.
  • An upper limit of the second frequency range can be substantially equal to 100 Hz.
  • the first frequency range can include at least a portion of the second frequency range. Detecting that the second signal satisfies the threshold condition can include determining that a voltage level representing the second signal reaches or exceeds a threshold to indicate an overload condition. Detecting that the second signal satisfies the threshold condition can include filtering the second signal using a digital filter, and comparing the filtered second signal to a value associated with the threshold condition.
  • a set of coefficients of the digital filter can be selectable based on a mode of operation of the ANR headphone.
  • Attenuating the second signal can include adjusting a variable gain amplifier (VGA) that processes the second signal.
  • Processing the first frequency range of the input signal to generate the first signal can include processing the input signal by a first filter to generate a first filtered signal, and processing the first filtered signal by the first compensator to generate the first signal.
  • the first filter can have a passband that includes the first frequency range, and the first signal can represent an anti-noise signal configured to reduce a noise signal in the first filtered signal.
  • Processing the second frequency range of the input signal to generate the second signal can include processing the input signal by a second filter to generate a second filtered signal, and processing the second filtered signal by the second compensator to generate the second signal.
  • the second filter can have a passband that includes the second frequency range, and the second signal can represent an anti-noise signal configured to reduce a noise signal in the second filtered signal.
  • the input signal can represent audio captured by a feedforward microphone of the ANR headphone.
  • Each of the first compensator and the second compensator can be a feedforward compensator disposed in a feedforward signal flow path of the ANR headphone.
  • Each of the first compensator and the second compensator can be a feedback compensator disposed in a feedback signal flow path of the ANR headphone.
  • this document features a method that includes receiving an input signal representing audio captured by one or more sensors of an active noise reduction (ANR) headphone, and generating, based on the input signal, a first signal by a compensator disposed in an ANR signal flow path of the ANR headphone.
  • the method also includes determining one or more characteristics of the first signal, and selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the compensator in the ANR signal flow path. The filter coefficients are selected in accordance with a target frequency response of the digital filter.
  • the method further includes generating, by processing the input signal using the plurality of filter coefficients of the digital filter, a feedback control signal for an electroacoustic transducer of the ANR headphone.
  • this document features an active noise reduction (ANR) device that includes one or more sensors configured to generate an input signal indicative of an external environment of the ANR device, and a compensator disposed in an ANR signal flow path of the ANR device.
  • the compensator is configured to generate a first signal based on the input signal.
  • the ANR device also includes a tunable digital filter disposed in series with the compensator in the ANR signal flow path, wherein the tunable digital filter is configured to generate a control signal for an electroacoustic transducer of the ANR device.
  • the ANR device further includes one or more processing devices that are configured to determine one or more characteristics of the first signal, and select, based on the one or more characteristics of the first signal, a plurality of filter coefficients for the tunable digital filter in accordance with a target frequency response of the tunable digital filter.
  • this document features one or more machine-readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations.
  • the operations include receiving an input signal representing audio captured by one or more sensors of an active noise reduction (ANR) headphone, and causing a compensator disposed in an ANR signal flow path of the ANR headphone to generate a first signal based on the input signal.
  • the operations also include determining one or more characteristics of the first signal, and selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the compensator in the ANR signal flow path. The filter coefficients are selected in accordance with a target frequency response of the digital filter.
  • the operations further include generating a feedback control signal for an electroacoustic transducer of the ANR headphone by causing the digital filter to process the input signal using the plurality of filter coefficients.
  • Implementations of the above aspects may include one or more of the following features.
  • the digital filter can be disposed before or after the compensator in a signal flow path.
  • a determination can be made, based on the one or more characteristics, that a portion of the input signal in a particular frequency range is causing the first signal to trigger an overload condition in the acoustic transducer, and the plurality of filter coefficients can be selected such that the selected filter coefficients configure the digital filter to attenuate the portion of the input signal in the particular frequency range.
  • the one or more characteristics can include a voltage level.
  • the electroacoustic transducer can be driven using the feedback control signal.
  • the digital filter can be a high-pass filter or a notch filter.
  • the digital filter can be an infinite impulse response (IIR) filter.
  • the ANR signal flow path can include a feedforward path disposed between a feedforward microphone of the ANR headphone and the electroacoustic transducer.
  • the ANR signal flow path can include a feedback path disposed between a feedback microphone of the ANR headphone and the electroacoustic transducer.
  • this document features a method that includes receiving an input signal captured by one or more sensors associated with an ANR headphone, and determining, by one or more processing devices in an ANR signal flow path, one or more characteristics of a first portion of the input signal.
  • the method also includes automatically adjusting, by the one or more processing devices based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path, and selecting, by the one or more processing devices, a set of coefficients for a tunable digital filter disposed in the ANR signal flow path.
  • the set of coefficients are selected in accordance with the gain of the VGA.
  • the method further includes processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone.
  • this document features an active noise reduction (ANR) device.
  • the device includes one or more sensors configured to generate an input signal indicative of an external environment of the ANR device, and a variable gain amplifier (VGA) and a tunable digital filter disposed in an ANR signal flow path of the ANR device.
  • the ANR signal flow path is connected to an electroacoustic transducer of the ANR device.
  • the device further includes one or more processing devices configured to determine one or more characteristics of a first portion of the input signal, automatically adjust, based on the one or more characteristics of the first portion of the input signal, a gain of the VGA, and select a set of coefficients for the tunable digital filter, wherein the set of coefficients are selected in accordance with the gain of the VGA.
  • this document features one or more machine-readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform various operations.
  • the operations include receiving an input signal captured by one or more sensors associated with an ANR headphone, and determining one or more characteristics of a first portion of the input signal.
  • the operations further include automatically adjusting, based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path, and selecting, a set of coefficients for a tunable digital filter disposed in the ANR signal flow path.
  • the set of coefficients are selected in accordance with the gain of the VGA.
  • the operations also include processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone.
  • Determining the one or more characteristics of the first portion of the input signal can include processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR device, and determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal.
  • the one or more sensors can include one of: a feedforward microphone of the ANR device, a feedback microphone of the ANR device, a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer.
  • the ANR signal flow path can include a feedforward path disposed between a feedforward microphone of the ANR device and the electroacoustic transducer.
  • the ANR signal flow path can include a feedback path disposed between a feedback microphone of the ANR headphone and the electroacoustic transducer.
  • the VGA gain adjustments may be deactivated responsive to a first user-input received by an input-device of the ANR device.
  • the VGA gain adjustments may also be reactivated responsive to a second user-input received by the input-device of the ANR headphone.
  • the gain of the VGA can be adjusted periodically during an operation of the ANR headphone.
  • the gain of the VGA can be adjusted responsive to determining that the one or more characteristics of the first portion of the input signal satisfies a threshold condition.
  • the one or more characteristics of the first portion of the input signal can be indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped.
  • Various implementations described herein may provide one or more of the following advantages.
  • throttling compensation under overload conditions only in a selected portion of the frequency range the performance of small form-factor ANR devices (e.g., in-ear headsets) may be improved.
  • selective throttling in the low frequency range may allow for mitigating overload conditions while avoiding potentially objectionable noise modulations that may occur due to turning off the entire feedforward compensation.
  • throttling the compensation at such low frequencies upon detection of an overload condition may have an insignificant effect on the psychoacoustic experience of the user, and therefore may improve the overall user experience as compared to a device that completely shuts off the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) upon detection of overload.
  • an ANR signal flow path e.g., a feedforward path or a feedback path
  • a tunable filter may be disposed in the same or another ANR signal flow path (e.g., a feedback path) to mitigate overload conditions due to low frequency stimuli detected by a corresponding microphone (e.g., a feedback microphone in this particular example).
  • the tunable filter (which may be implemented, for example, as a high-pass or notch filter) may improve user experience and driver-life by reducing low frequency displacement of the driver resulting from, for example, jaw motion or walking.
  • VGA variable gain amplifier
  • SNR signal-to-noise ratio
  • An active noise reduction (ANR) device can include a configurable digital signal processor (DSP), which can be used for implementing various signal flow topologies and filter configurations. Examples of such DSPs are described in U.S. Patents 8,073,150 and 8,073,151 , which are incorporated herein by reference in their entirety. U.S. Patent 9,082,388 , also incorporated herein by reference in its entirety, describes an acoustic implementation of an in-ear active noise reducing (ANR) headphone, as shown in FIG. 1 .
  • DSP digital signal processor
  • This headphone 100 includes a feedforward microphone 102, a feedback microphone 104, an output transducer 106 (which may also be referred to as an electroacoustic transducer or acoustic transducer), and a noise reduction circuit (not shown) coupled to both microphones and the output transducer to provide anti-noise signals to the output transducer based on the signals detected at both microphones.
  • An additional input (not shown in FIG. 1 ) to the circuit provides additional audio signals, such as music or communication signals, for playback over the output transducer 106 independently of the noise reduction signals.
  • headphone which is interchangeably used herein with the term headset, includes various types of personal acoustic devices such as in-ear, around-ear or over-the-ear headsets, earphones, and hearing aids.
  • the headsets or headphones can include an earbud or ear cup for each ear.
  • the earbuds or ear cups may be physically tethered to each other, for example, by a cord, an over-the-head bridge or headband, or a behind-the-head retaining structure.
  • the earbuds or ear cups of a headphone may be connected to one another via a wireless link.
  • the signal flow topologies can be implemented in an ANR device to enable functionalities such as audio equalization, feedback noise cancellation, feedforward noise cancellation, etc.
  • the signal flow topologies can include a feedforward noise reduction path 110 that drives the output transducer 106 to generate an anti-noise signal (using, for example, a feedforward compensator 112) to reduce the effects of a noise signal picked up by the feedforward microphone 102.
  • the signal flow topologies can include a feedback noise reduction path 114 that drives the output transducer 106 to generate an anti-noise signal (using, for example, a feedback compensator 116) to reduce the effects of a noise signal picked up by the feedback microphone 104.
  • the signal flow topologies can also include an audio path 118 that includes circuitry (e.g., equalizer 120) for processing input audio signals 108 such as music or communication signals, for playback over the output transducer 106.
  • the acoustic noise energy that the ANR device attempts to reduce is small enough to keep the system hardware within capacity.
  • discrete acoustic signals or low frequency pressure disturbances e.g., loud pops, bangs, door slams, etc.
  • picked up by the feedforward or feedback microphones can cause the noise reduction circuitry to overrun the capacity of the electronics or the output transducer 106 in trying to reduce the resulting noise, thereby creating audible artifacts which may be deemed objectionable by some users.
  • overload conditions can be manifested by, for example, clipping of amplifiers, hard excursion limits of acoustic drivers or transducers, or levels of excursion that cause sufficient change in the acoustics response so as to cause oscillation.
  • the problem of overload conditions can be particularly significant in small form-factor ANR devices such as in-ear headphones.
  • the feedforward compensator may generate a signal that would require the acoustic transducer to exceed the corresponding physical excursion limit.
  • a particular acoustic transducer may need to be displaced 1 mm to generate an anti-noise signal for a 100 Hz noise, 2 mm to generate an anti-noise signal for a 50 Hz noise, and so on.
  • Many acoustic transducers, particularly small transducers used in small form-factor ANR devices are physically incapable of producing such large displacements.
  • the demand of the high displacement by a compensator can cause the transducer to generate sounds that cause audible artifacts, which may contribute to an objectionable user experience.
  • the audible artifacts can include oscillations, potentially objectionable transient sounds (e.g., "thuds,” “cracks,” “pops,” or “clicks”), or crackling/buzzing sounds.
  • the feedforward path 110 can include a variable gain amplifier (VGA) 125, the gain of which can be reduced (throttled) upon detection of a signal that can potentially overload the output transducer 106.
  • VGA variable gain amplifier
  • a sidechain filter 128, which is a filter that is applied to a signal sampled from the main signal flow to generate a test signal for determining whether or not to throttle the gain of the VGA 125.
  • the output of the VGA 125 can be passed through the sidechain filter 128 (the transfer function of which is denoted as K sc_ff ) connected to the feedforward path 110, and the output of the sidechain filter is compared (using, for example, a comparator 130) to a pre-determined threshold, T ff 132 to decide whether an overload condition exists.
  • the output of the comparator 130 is provided to the variable gain amplifier (VGA) 125.
  • the gain of the VGA 125 is adjusted to throttle the signal in the feedforward path 110 to mitigate the overload condition.
  • FIG. 3A shows a sidechain filter only for the feedforward path, a similar sidechain filter may also be implemented in the feedback path. Also, the sidechain filters may be disposed in the feedforward or feedback paths before or after the corresponding main compensators 112 or 116, respectively.
  • reducing the gain of the entire feedforward or feedback path may also generate some undesirable audible artifacts and/or noise modulations. For example, if the noise that causes an overload condition has significant energy at low and high frequencies, turning off or significantly reducing the gain of the feedforward compensator may allow the noise to pass through un-attenuated and may create an uncomfortable or objectionable experience for some users.
  • the technology described herein may improve user experience in such cases by allowing gain adjustments in only selected frequency ranges upon detection of an overload condition, while allowing compensation signals to be generated at frequencies outside of the selected range.
  • the feedforward compensation may be throttled only in the low frequency portion of the spectrum, while allowing feedforward compensation to continue for other frequencies. This may provide an improved psychoacoustic experience for users because upon detection of a low frequency disturbance, the feedforward compensation is temporarily suspended only in a selected portion of the frequency range. If the selected frequency range is in the sub-100 Hz region, the user experience is not significantly degraded for most users because human ears are typically not very sensitive to noise in that frequency range.
  • FIG. 3B is a block diagram of an example of an ANR device 350 with parallel feedforward compression, in which feedforward compensation is throttled in only a portion of the operating frequency range upon detection of an overload condition in that frequency range.
  • the device 350 includes, in the feedforward path 110, at least two parallel paths each processing a different portion of the operating frequency range.
  • the feedforward path 110 can include a main feedforward compensator 133 (denoted by the transfer function K ffM ) which processes a frequency range that substantially excludes frequencies where overload conditions are expected to occur.
  • the feedforward path 110 also includes an auxiliary feedforward compensator 134 (denoted by the transfer function K ffP ) connected in parallel to the main feedforward compensator 133.
  • the auxiliary feedforward compensator 134 processes the frequency range in which overload conditions are expected to occur.
  • a VGA 125, sidechain filter 128, and comparator 130 are connected to the output of the auxiliary compensator 134 to throttle the compensation in the corresponding frequency range upon detection of an overload condition.
  • the main feedforward compensator 133 continues to provide compensation in the corresponding frequency range.
  • the auxiliary compensator can be configured to process signals only in the sub-100 Hz range, such that feedforward compensation due to low frequency pressure disturbances are throttled using the VGA 125.
  • the main feedforward compensator 133 (which can be configured to process signals above 100 Hz) continues to provide feedforward compensation to reduce noise in the corresponding frequency range. In some implementations, this improves the overall noise reduction performance of the corresponding ANR device, while limiting audible artifacts that could be caused by low frequency pressure disturbances.
  • the threshold 132 associated with the comparator 130 may be determined in various ways. In some implementations, the threshold 132 may be determined based on the characteristics of the output transducer. For example, the threshold 132 might be set as a voltage reference point to prevent the drive voltage output by the VGA 125 from causing the output transducer 106 to hit a mechanical limit, or reaching a drive level where the acoustic distortion due to mechanical, magnetic or electrical characteristics is deemed undesirable. In some cases, these limits may be related to equivalent pressure levels in the ear canal. For example, as the size of the output transducer gets smaller, these limits may occur at lower equivalent pressure levels in the ear canal.
  • the main feedforward compensator 133 and auxiliary feedforward compensator 134 can include filters for isolating corresponding operating frequency ranges.
  • the auxiliary compensator 134 can include a low-pass filter with a passband cut-off frequency substantially equal to 100 Hz.
  • the main feedforward compensator 133 can include, for example, a high pass filter with a stopband cut-off frequency substantially equal to 100 Hz.
  • Other configurations may also be used depending, for example, on the corresponding applications.
  • the main feedforward compensator 133 can include a band-pass filter to isolate a frequency range that excludes frequencies where overload conditions are expected to occur.
  • the passbands of the main and auxiliary feedforward compensators may overlap partially. While FIG. 3B describes the filter topologies only in the feedforward path 110, a similar parallel topology may also be used in the feedback path.
  • the sidechain filter can be implemented as a filter bank, where a particular sidechain filter is selected based on a mode of operation of the ANR device. For example, if the ANR device is being used in mode where some ambient sounds (e.g., human voice) are allowed to pass through, the sidechain filter selected can be different from one that is selected in a mode in which feedforward compensation is performed for the entire operating frequency range.
  • the filter bank can be implemented using a DSP where a different set of filter coefficients and/or threshold value are selected for the sidechain filter based on an identified operating mode.
  • the main feedforward compensator 133 can be configured to provide noise attenuation in the corresponding frequency range as long as the signal from the feedforward microphone 102 is not clipped.
  • the sidechain filter can be operated based on input from one or more additional sensors. For example, an accelerometer may be used to identify movements by a user (e.g., running, jogging etc.) that may cause an overload condition. In some implementations, historical information on user-behavior may be used to anticipate events that may cause an overload condition.
  • this information may be used in enabling a proactive throttling of the low frequency portion of the feedforward signal path.
  • the compensation in an ANR signal flow path (e.g., a feedforward path or a feedback path) corresponding to the acoustic transducer for one ear may be coordinated with the compensation in the corresponding signal flow path of the acoustic transducer for the other ear. For example, if a user is wearing both earbuds of a headphone, such coordination between the corresponding signal flow paths may ensure that the ANR performance in the two ears are substantially similar.
  • the sidechain filters of a signal flow path may be adjusted based on determining whether both earbuds of a headphone are being worn by a user. Sensors that can be used for this purpose include, for example, capacitive sensors or infrared sensors disposed on earbuds or ear cups to determine whether an earbud or ear cup is being worn by a user.
  • the above discussions describe the overloading problem of the acoustic transducer primarily with respect to the feedforward path 110.
  • the electroacoustic transducer 106 may also be driven to an overload condition due to stimuli picked up by the feedback microphone 104.
  • stimuli picked up by the feedback microphone 104 For example, in the case of in-ear ANR headphones that are tightly sealed in the ear canal, low frequency stimuli like jaw motion can create large pressure variations that are picked up by the feedback microphone 104.
  • FIG. 4 is a plot showing the pressure variations in the ear canal over a two second time period, which are detected by a feedback microphone. In some cases, for tightly sealed in-ear headphones, low frequency pressure variations (at approximately 15 Hz) may be generated when the user walks on a firm surface.
  • Such low frequency pressure variations of high magnitude upon being detected by a feedback microphone 104, may cause the feedback compensator 116 to generate a feedback compensation signal that drives the acoustic transducer to an overload condition. This in turn may cause the acoustic transducer 106 to generate audible artifacts and degrade the performance of the ANR device. While the example of a user walking on a firm surface, which generates low frequency variations at approximately 15 Hz, is used herein as one example, other events may cause low frequency variations at different frequencies. The techniques described herein are generally applicable to events that cause low frequency variations that may lead to an overdrive condition, regardless of the particular frequency.
  • FIG. 5A is a block diagram of an example of such a feedback compensator 500, which includes a tunable filter 502 configured to mitigate overload conditions due to low frequency stimuli picked up by the feedback microphone 104.
  • the feedback compensator 500 also includes a fixed filter 504 configured to generate the feedback compensation signal for the transducer 106.
  • the tunable filter 502 upon detection of high-magnitude low-frequency stimuli (resulting, for example, from jaw motion or walking), the tunable filter 502 can be configured to filter out such stimuli from the input signal provided to the fixed filter 504 to generate the feedback compensation signal. Under such a signal flow scheme, the feedback compensator can continue to generate feedback compensation signals for noise reduction even in the presence of high-magnitude low-frequency stimuli without being driven to an overload condition.
  • the parameters for the tunable filter can be selected, for example, by a parameter selector module 508 that determines an appropriate set of parameters based on the output of an estimator 506.
  • the estimator 506 determines, from the feedback compensation signal generated by the fixed filter 504, whether the feedback compensation signal could potentially drive the acoustic transducer 106 into an overload condition.
  • the parameter selector module 508 can be configured to select one or more parameters (or a set of filter coefficients) for the tunable filter 502, such that the tunable filter 502 filters out the stimuli that is causing the generation of the large feedback compensation signal.
  • the parameter selector module 508 can be configured to access a look-up table to select the one or more parameters (or set of filter coefficients) for the tunable filter 502, based on the extent of driver displacement reported by the estimator 506.
  • the estimator can be configured to monitor the output of the fixed filter 504 to reduce the chances of the output voltage exceeding a threshold condition associated with, for example, driving the output transducer 106 to an unacceptably high displacement, or clipping the electrical output.
  • the parameter selector module 508 can be configured to select the one or more parameters or coefficients of the tunable filter 502 such that the tunable filter 502 acts as a high-pass filter.
  • FIGs. 6A-6C show magnitude responses of different tunable high-pass filters parameterized by a parameter a.
  • H z a 1 ⁇ a z ⁇ 1 1 ⁇ a 2 z ⁇ 1
  • the parameter selector module 508 can be configured to select the one or more parameters or filter coefficients of the tunable filter 502 such that the tunable filter 502 acts as a notch filter. This can be useful, for example, when the pressure variations causing an overload condition is in a narrow frequency range. For example, when a user walks on a firm surface wearing tightly-sealed in-ear headphones, high-magnitude pressure variations can occur at about 15 Hz. In such cases, a notch filter can be used to prevent such pressure variations from generating feedback signals that could drive the acoustic transducer to an overload. Because only a narrow range of frequencies are suppressed using notch filter, such a filter may only insignificantly degrade the feedback compensation performance of the ANR device.
  • FIG. 5A shows a block diagram of another system that may be used in either of a feedforward or a feedback ANR signal flow path. Specifically, FIG.
  • FIG. 5B is a block diagram of an example system 550 that uses a combination of a variable gain amplifier (VGA) 552 and a tunable filter 554 disposed in a signal flow path of an ANR device.
  • the signal flow path which includes a sensor (e.g., a microphone 557 and/or a non-microphone sensor 555) at one end and an acoustic transducer 106 at the other end, can include, for example, a feedback path or a feedforward path of the ANR device. If the signal flow path in which the system 550 is disposed is a feedforward path, the tunable filter 554 may be referred to as a feedforward compensator. If the signal flow path in which the system 550 is disposed is a feedback path, the tunable filter 554 may be referred to as a feedback compensator.
  • the noise reduction performance of the ANR device may be balanced against its overload performance by adaptively adjusting the VGA 552 and the tunable filter 554 based on the environment of the ANR device.
  • the noise reduction performance may be improved by increasing the gain of the VGA 552.
  • the ANR device may introduce system-generated noise (e.g., noise generated by the electronics disposed in the signal flow path), which may be manifested as a substantially constant audible "hiss" generated by the acoustic transducer 106.
  • increasing the gain of the VGA 552 may in some cases improve the signal-to-noise ratio (SNR), and decrease the undesirable hissing audio generated by the acoustic transducer 106.
  • SNR signal-to-noise ratio
  • pre-amplifying the gain of the VGA 552 boosts any signals captured using the microphones 557 (e.g., feedback and/or feedforward microphones), which in some cases may result in clipping of the incoming signal.
  • the dynamic range of the system may also be reduced, causing the system (e.g., the electronics of the signal flow path and/or the acoustic transducer 106) to overload more easily.
  • the system e.g., the electronics of the signal flow path and/or the acoustic transducer 106
  • such overload conditions may cause the acoustic transducer 106 to produce audible pops and clicks, which in turn may detract from the improved user-experience resulting from the lowered noise floor.
  • the signal flow path illustrated in FIG. 5B is an example of a system that can be used to balance the noise reduction performance with the overload performance of an ANR device.
  • the gain of the VGA can be adjusted to a relatively high value that reduces the audible noise floor. This in turn may expose the ANR device to a higher likelihood of being driven to overload conditions.
  • the parameter selector 558 may be configured to adjust the gain of the VGA to a lower value to reduce the chances of the system being driven to an overload condition.
  • the VGA gain is reduced in a noisier environment, a psychoacoustic effect of the increased noise floor may not be significantly noticeable to a user.
  • the adaptive reducing of the gain of the VGA 552 may result in mitigating audible pops and clicks that may otherwise have degraded the user experience due to the occurrence of overload conditions.
  • the filter coefficients of the tunable filter 554 are also adjusted accordingly to compensate for the change in gain of the VGA 552. For example, if the parameter selector 558 increases the gain of the VGA 552 by 6 dB, the parameter selector 558 may also be configured to select an appropriate set of filter coefficients for the tunable filter 554, such that the magnitude response of the tunable filter is reduced by about 6 dB to compensate for the increased gain of the VGA 552. In some cases, such simultaneous adjustment of the VGA and the tunable filter ensures that the overall gain of the signal flow path is substantially constant, and the user experience is substantially uniform.
  • the VGA 552 is configured to process signals captured by one or more sensors such as microphones 557 and/or non-microphone sensors 555.
  • the microphones 557 can be of various types, possibly depending on, for example, the signal flow path in which the system 550 is disposed. For example, if the system 550 is disposed in a feedforward ANR path, the microphone 557 can include the feedforward microphone of the ANR device, such as the microphone 102 described above. In another example, if the system 550 is disposed in a feedback ANR path, the microphone 557 can include a feedback microphone such as the microphone 104 described above.
  • the sensors 555 can also be of various types.
  • the non-microphone sensors 555 can include, for example, a pressure sensor, an accelerometer, or a gyroscope. Such non-microphone sensors 555 may be used, for example, to detect pressure changes or activities that may prompt a change in the settings of the VGA 552 and/or the tunable filter 554. For example, based on the output of an accelerometer disposed in an ANR headphone, a determination may be made that the user is running or jogging, which in turn may produce low frequency pressure variations at a particular frequency. Based on such a determination, the parameter selector 558 may be configured to adjust the gain associated with the VGA and the filter coefficients of the tunable filter 554. While the system 550 illustrated in FIG. 5B includes both non-microphone sensors 555 and microphones 557, systems that include only microphones 557 or only non-microphone sensors 555 are also possible.
  • the adjustments to the gain of the VGA 552 and the filter coefficients of the tunable filter 554 may be made based on predicting the onset of a particular event.
  • the environment of a user may be determined based on the output of a global positioning system (GPS) (e.g., one disposed either in the ANR device or in a mobile phone connected to the ANR device), and the settings of the VGA 552 and the tunable filter 554 may be adjusted in accordance with the determination.
  • GPS global positioning system
  • the parameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in quiet environments.
  • the parameter selector 558 can be configured to adjust the settings of the ANR device in accordance with that typically used in noisy environments.
  • the user's environment may be detected based on one or more applications executing on the ANR device and/or a mobile device connected to the ANR device. For example, upon determining that the user has just started an application that tracks the user's running steps, an inference may be made that the user is about to start a run.
  • the parameter selector 558 can be configured to adjust the VGA 552 and the tunable filter 554 to account for the corresponding expected low-pressure variations in the ANR device.
  • information about both the environment and the activity of the user may be used in determining that operating parameters of the VGA 552 and the filter coefficients of the tunable filter.
  • the parameter selector 558 can be configured to select the operating parameters of the VGA 552 and the tunable filter 554 in various ways.
  • the parameter selector may be configured to access a computer-readable storage device that stores a representation of a look-up table that stores different sets of filter coefficients of the tunable filter 554 linked to different gain values of the VGA 552.
  • the parameter selector can be configured to calculate the filter coefficients of the tunable filter 554 based on a pre-defined relationship with the selected gain values.
  • the gain values to be used in different environments may be empirically determined or calculated as a function of the outputs of one or more sensors such as a pressure sensor or microphone.
  • the gain level of the VGA 552 may also be changed based on user-input received via a user interface.
  • the user interface can be a control such as a switch, knob, or dial disposed on the ANR device, or a software-based graphical user interface displayed on a display device such as one displayed on a connected mobile device.
  • the estimator 556 can be configured to determine whether any adjustments to the VGA 552 and/or the tunable filter 554 are needed. Accordingly, the estimator 556 can be configured to signal the parameter selector 558 to adjust one or both of the VGA 552 and the tunable filter 554. In some implementations, the estimator 556 is substantially similar to the estimator 506 described above with reference to FIG. 5A . In some implementations, the estimator 556 can be a displacement estimator configured to estimate whether the drive signal for the acoustic transducer can potentially cause the transducer to exceed its excursion limit. In some implementations, the estimator 556 can include a pressure estimator configured to detect the occurrence of pressure disturbances in the environment.
  • the system 550 may be operated in various modes.
  • the system 550 can be configured to run substantially continuously upon initialization. For example, if the system 550 is disposed in a feedforward or feedback path of an ANR headphone, the system may be initialized when the ANR functionality of the headphone is activated, and then allowed to run during the operating period of the headphone. In some cases though, such a mode of operation may cause multiple pops and clicks, which could degrade the user experience to some extent.
  • the system 550 can include a control (e.g., a button) to deactivate/activate the system 550 based on user-input.
  • the system 550 could be configured such that the parameter selector 558 adjusts the VGA 552 and the tunable filter 554 in accordance with the current environment, and then either shuts off or goes into standby mode.
  • the system may be reactivated based on a user-input which indicates that the environment has changed, or that a readjustment is otherwise desired.
  • the system 550 or the ANR device in which it is deployed may include one or more controls (e.g., hardware buttons and/or software controls presented on a user interface) for selecting the mode of operation of the system 550.
  • the adjustments may be performed in various ways.
  • the adjustments are performed substantially periodically.
  • the adjustments may be performed with a time period of about 100 ms or more.
  • the frequency of adjustments may be selected empirically, for example, to allow the system 550 to adequately adjust to changing environments.
  • the adjustments can be performed upon detection of a change in the environment.
  • the estimator 556 may signal the parameter selector 558 to adjust the VGA 552 and the tunable filter 554 accordingly.
  • a decision threshold may be associated with the adjustments.
  • an adjustment may be made only if the amount of required change in the gain of the VGA 552 exceeds a threshold amount. For example, an adjustment may be made only if the gain adjustment is 2.25 dB or higher.
  • the threshold amount may be determined empirically, for example, to prevent overly frequent adjustments.
  • the adjustments to the gain level of the VGA 552 can be performed in various ways.
  • the adjustments may be made in a single step.
  • the adjustments may be made as a series of multiple steps. For example, if an adjustment of 6 dB needs to be made, the adjustments may be made as a single step change of 6 dB, or a series of six steps each implementing a 1 dB change, or another combination of steps.
  • the step sizes may be determined empirically, for example, based on the tolerance for any associated audible artifacts generated by the step changes.
  • the time gap between the steps may also be adjusted, for example, to reduce the possibility of multiple audible artifacts to be merged into a single louder artifact. However, increasing the gap between the steps also increases the total adjustment time.
  • the spacing between the steps can therefore be selected empirically in accordance with a target tradeoff between the adjustment time and the tolerable audible artifacts.
  • FIG. 7 is a block diagram of an example bi-quad notch filter that can be used as a tunable filter in an ANR signal flow path.
  • FIG. 8A shows magnitude and phase responses of a single bi-quad notch filter (as shown in FIG. 7 ) for different combinations of filter coefficients.
  • the filter coefficients are parameterized by the parameter n .
  • FIG. 8A shows magnitude and phase responses of a single bi-quad notch filter (as shown in FIG. 7 ) for different combinations of filter coefficients.
  • the filter coefficients are parameterized by the parameter n .
  • the curves 810, 812, 814, and 816 represent the phase responses
  • FIG. 8B shows the variation of poles and zeros of the bi-quad notch filter with respect to a tuning parameter n in terms of frequency and bi-quad singularities Q.
  • the Q is also known as the quality factor.
  • the curves describing the pole and zero frequency and Qs as a function of tuning variation show that the notch sharpness and notch center frequency are coupled.
  • the notch depth increases with increasing frequency.
  • FIGs. 8C and 8D show the variations in filter coefficient values of the bi-quad notch filter with respect to the tuning parameter n .
  • the values of the coefficients b1 and a1 are in the vicinity of 2, and the values of the coefficients b2 and a2 are in the vicinity of unity.
  • the filter coefficient values e.g., b1, b2, a1 and a2, in the present example
  • FIGs. 9A-9B , and FIGs. 10A-10B illustrate the performance of a tunable filter in the feedback path.
  • FIGs. 9A and 9B show magnitude and phase responses of the loop gain (provided as a product of the driver-voltage-to-feedback-microphone-voltage transfer function and the feedback compensator transfer function K fb ) of the feedback path without a tunable filter and with a tunable filter, respectively.
  • the particular tunable filter used in this example included twelve cascaded bi-quad notch filters, each of which were substantially similar to the bi-quad notch filter illustrated in FIG. 7 .
  • the tunable filter remains stable and exhibits consistent loop gain behavior for the various values of the tuning parameter n.
  • FIGs. 10A and 10B which show the sensitivity of a feedback path of the example ANR device without a tunable filter ( FIG. 10A ), and with a tunable filter ( FIG. 10B ), the sensitivity of the filters also remains consistent for the various values of the tuning parameter.
  • FIG. 11 shows the variation in output voltage of the feedback compensator 116 for the various values of the tuning parameter n .
  • the parameter value can be adjusted to get different levels of suppression at around the desired 15 Hz frequency, without significantly affecting the feedback compensator output at other frequencies.
  • FIG. 12A shows the magnitude response of another example of a notch filter that can be used as a tunable filter in the feedback path.
  • This notch filter is another single bi-quad notch filter such as the one illustrated in FIG. 7 , but with the coefficients a1 and a2 held to be constants.
  • the frequency of the complex poles and zeros were equal and the Q of the zeros was varied to change the depth of the notch, which resulted in changes to the coefficients b1 and b2 only.
  • Such variations of the coefficients are illustrated in FIG. 12B .
  • FIG. 13 is a flowchart of an example process 1300 for implementing parallel feedforward compression in accordance with technology described above. At least a portion of the process 1300 can be implemented using one or more processing devices such as DSPs described in U.S. Patents 8,073,150 and 8,073,151 , incorporated herein by reference in their entirety. Operations of the process 1300 include receiving an input signal representing audio captured by a feedforward microphone of an ANR device such as an ANR headphone (1302). In some implementations, the ANR device can be an in-ear headphone such as the one described with reference to FIG. 1 .
  • the ANR device can include, for example, around-the-ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices.
  • the feedforward microphone can be a part of an array of microphones.
  • Operations of the process 1300 also include processing a first frequency range of the input signal to generate a first feedforward signal for an acoustic transducer of the ANR headphone (1304). This can be done using a first feedforward compensator disposed in the ANR device to generate anti-noise signals to reduce or cancel noise signals picked up by the feedforward microphone.
  • generating the first feedforward signal includes processing the input signal by a first filter to generate a first filtered signal, and processing the first filtered signal by the first feedforward compensator to generate the first feedforward signal.
  • the first filter can be a high-pass or band-pass filter having a passband that includes the first frequency range.
  • the first feedforward signal represents an anti-noise signal configured to reduce a noise signal in the first filtered signal.
  • the process 1300 also includes processing a second frequency range of the input signal to generate a second feedforward signal for the acoustic transducer (1306). This can be done, for example, by a second feedforward compensator disposed in parallel to the first feedforward compensator.
  • the first frequency range includes frequencies higher than the frequencies in the second frequency range. For example, an upper limit of the second frequency range can be substantially equal to 100 Hz, whereas the lower limit of the first frequency range can be greater than or substantially equal to 100 Hz.
  • the first frequency range can include at least a portion of the second frequency range.
  • generating the second feedforward signal includes processing the input signal by a second filter to generate a second filtered signal, and processing the second filtered signal by the second feedforward compensator to generate the second feedforward signal.
  • the second filter can have a passband that includes the second frequency range, and the second feedforward signal can represent an anti-noise signal configured to reduce a noise signal in the second filtered signal.
  • Operations of the process 1300 further include detecting that the second feedforward signal satisfies a threshold condition (1308).
  • a threshold condition can include, for example, determining that a voltage level representing the second feedforward signal reaches or exceeds a threshold to indicate an overdrive condition of the electroacoustic transducer.
  • This can also include, for example, filtering the second feedforward signal using a digital filter, and comparing the filtered second feedforward signal to a value associated with the threshold condition.
  • the set of coefficients of the digital filter can be selected based on a mode of operation of the ANR headphone.
  • Operations of the process 1300 also include attenuating the second feedforward signal responsive to determining that the second feedforward signal satisfies the threshold condition (1310). For example, if the second feedforward signal satisfies the threshold condition, a determination is made that the second feedforward signal would drive the acoustic transducer, or other portions of the associated electronics, to overload, and accordingly, a variable gain amplifier in the signal path of the second feedforward signal is adjusted to attenuate the second feedforward signal.
  • Operations of the process can also include, for example, generating a combined feedforward signal for the acoustic transducer by summing the second feedforward signal and the first feedforward signal, or by summing the attenuated second feedforward signal and the first feedforward signal.
  • the acoustic transducer can then be driven using, in part, the combined feedforward signal.
  • FIG. 14 is a flowchart of an example process 1400 for implementing a tunable filter in a feedback path of an ANR device in accordance with technology described above. At least a portion of the process 1400 can be implemented using one or more processing devices such as DSPs described in U.S. Patents 8,073,150 and 8,073,151 , incorporated herein by reference in their entirety. Operations of the process 1400 include receiving an input signal representing audio captured by a feedback microphone of an ANR device such as an ANR headphone (1402). In some implementations, the ANR device can be an in-ear headphone such as one described with reference to FIG. 1 .
  • the ANR device can include, for example, around-the-ear headphones, over-the-ear headphones, open headphones, hearing aids, or other personal acoustic devices.
  • the feedback microphone can be a part of an array of microphones.
  • Operations of the process 1400 also include generating, by a feedback compensator and based on the input signal, a first signal (1404).
  • the feedback compensator can be substantially similar to the fixed filter 504 described above with reference to FIG. 5A .
  • the first signal can include an anti-noise signal generated in response to a noise detected by a feedback microphone, wherein the anti-noise signal is configured to cancel or at least reduce the effect of the noise.
  • the operations of the process 1400 include determining one or more characteristics of the first signal (1406). This can be done, for example, using a module substantially similar to the estimator 506 described above with reference to FIG. 5A .
  • the one or more characteristics can include a voltage level of the first signal, the voltage level being indicative of an amount of excursion or driver displacement of the corresponding acoustic transducer 106.
  • the one or more characteristics can be indicative of a frequency or frequency range of the input signal where the underlying noise is detected.
  • the operations of the process 1400 further include selecting, based on the one or more characteristics of the first signal, a plurality of filter coefficients for a digital filter disposed in series with the feedback compensator (1408).
  • the plurality of filter coefficients can be selected, for example, in accordance with a target frequency response of the digital filter. For example, if the one or more characteristics of the first signal indicate that the voltage level of the first signal can potentially drive the corresponding acoustic transducer to an overload condition, and that the underlying noise in the input signal is in the vicinity of 15 Hz, the plurality of coefficients can be chosen to configure the digital filter as a high-pass or notch filter to suppress or attenuate components of the input signal around 15 Hz.
  • selecting the plurality of coefficients can be done by accessing a pre-stored look-up table that includes parameter or coefficient values for the digital filter for various combinations of the one or more characteristics determined for the first signal.
  • the digital filter is substantially similar to the tunable filter described above with reference to FIGs. 5A and 5B .
  • the digital filter may be disposed in the feedback path of an ANR device in series with a feedback compensator, and either before or after the feedback compensator.
  • the digital filter may be integrated together with the feedback compensator in the form of a combined set of coefficients.
  • the tunable filter 502 and the fixed filter 504 may be combined in the form of a unified filter providing feedback compensation.
  • the digital filter may be implemented in various forms, including for example, as an infinite impulse response (IIR) filter or a finite impulse response (FIR filter).
  • Operations of the process 1400 also include generating, by processing the input signal using the plurality of filter coefficients of the digital filter, a feedback compensation signal for an acoustic transducer of the ANR headphone (1410).
  • a portion of the input signal causing the generation of out-of-range feedback compensation signals may be attenuated, thereby preventing any potential overload conditions in the acoustic transducer. In some implementations, this may improve user experience by avoiding audible artifacts that are otherwise generated by such overload conditions.
  • FIG. 15 is a flowchart of an example process 1500 for implementing a combination of a variable gain amplifier (VGA) in combination with a tunable filter in a signal flow path of an ANR device in accordance with technology described above.
  • VGA variable gain amplifier
  • At least a portion of the process 1500 can be implemented using one or more processing devices such as DSPs described in U.S. Patents 8,073,150 and 8,073,151 , incorporated herein by reference in their entirety.
  • Operations of the process 1500 include receiving an input signal captured by one or more sensors associated with an ANR device such as an ANR headphone (1502).
  • the one or more sensors can include one or more of a feedforward microphone and feedback microphone of the ANR headphone.
  • the one or more sensors include one or more of a pressure sensor, an accelerometer, and a displacement sensor configured to sense an amount of excursion of the electroacoustic transducer.
  • Operations of the process 1500 also include determining one or more characteristics of the first portion of the input signal (1506).
  • the one or more characteristics of the first portion of the input signal is indicative of a noise floor associated with the external environment of the ANR headphone.
  • determining the one or more characteristics of the first portion of the input signal includes processing the first portion of the input signal to generate a first output signal for an electroacoustic transducer of the ANR headphone, and determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal.
  • determining the one or more characteristics of the first portion of the input signal based on one or more characteristics of the first output signal can include determining that the first output signal is clipped.
  • the one or more characteristics of the first portion of the input signal is indicative of a likelihood that an output signal resulting from processing of the first portion of the input signal by the ANR signal flow path would be clipped.
  • determining the one or more characteristics of the first portion of the input signal includes determining a non-linear relationship between the first portion of the input signal and the first output signal. For example, a non-linear relationship may be manifested by an output signal that causes an acoustic transducer to generate an audible artifact such as a pop or click.
  • Operations of the process 1500 also include automatically adjusting based on the one or more characteristics of the first portion of the input signal, a gain of a variable gain amplifier (VGA) disposed in the ANR signal flow path (1508).
  • VGA variable gain amplifier
  • the gain of the VGA is adjusted periodically during an operation of the ANR headphone. The time period of the adjustments may be determined empirically, and can be, for example, at least about 100 ms.
  • the gain of the VGA is adjusted responsive to determining that the one or more characteristics of the first portion of the input signal or the first output signal satisfies a threshold condition.
  • the threshold condition can include, for example, an amount of required gain adjustment.
  • the gain of the VGA may be adjusted only if the required adjustment is at least 2.25 dB.
  • Operations of the process 1500 also include selecting a set of coefficients for a tunable digital filter disposed in the ANR signal flow path in accordance with the gain of the VGA (1510). For example, if the gain of the VGA is adjusted by a particular amount (e.g., 5 dB), the set of coefficients for the tunable digital filter may be selected such that the magnitude response of the filter due to the selected coefficients compensates for the gain adjustment of the VGA. This may be done, for example, to keep the overall gain of the signal flow path substantially unchanged.
  • a particular amount e.g., 5 dB
  • Operations of the process 1500 further include processing a second portion of the input signal in the ANR signal flow path using the adjusted gain and selected set of coefficients to generate a second output signal for the electroacoustic transducer of the ANR headphone (1512).
  • the second output signal reduces the chances of the system 550 being driven to an overload condition, as compared to the first output signal.
  • the process 1500 may therefore be used for mitigating overload conditions in a feedforward or feedback path of the ANR headphone.
  • the functionality described herein, or portions thereof, and its various modifications can be implemented, at least in part, via a computer program product, e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine-readable media or storage device, for execution by, or to control the operation of, one or more data processing apparatus, e.g., a programmable processor, a computer, multiple computers, and/or programmable logic components.
  • a computer program product e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine-readable media or storage device, for execution by, or to control the operation of, one or more data processing apparatus, e.g., a programmable processor, a computer, multiple computers, and/or programmable logic components.
  • a computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
  • a computer program can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a network.
  • Actions associated with implementing all or part of the functions can be performed by one or more programmable processors executing one or more computer programs to perform the functions of the calibration process. All or part of the functions can be implemented as, special purpose logic circuitry, e.g., an FPGA and/or an ASIC (application-specific integrated circuit). In some implementations, at least a portion of the functions may also be executed on a floating point or fixed point digital signal processor (DSP) such as the Super Harvard Architecture Single-Chip Computer (SHARC) developed by Analog Devices Inc.
  • DSP floating point or fixed point digital signal processor
  • SHARC Super Harvard Architecture Single-Chip Computer
  • processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer.
  • a processor will receive instructions and data from a read-only memory or a random access memory or both.
  • Components of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.
  • the parallel feedforward compensation may be combined with a tunable digital filter in the feedback path.
  • a tunable digital filter in the feedforward path may be combined with a parallel compensation scheme in the feedback path.
  • various combinations of the parallel compensation technique, tunable filter technique, and the VGA technique may be used in the ANR signal flow paths (e.g., a feedback path or a feedforward path) of an ANR device.
  • an ANR signal flow path can include a tunable digital filter as well as a parallel compensation scheme to attenuate generated control signal in a specific portion of the frequency range.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Headphones And Earphones (AREA)
  • Circuit For Audible Band Transducer (AREA)
EP19201934.7A 2017-03-30 2018-03-29 Compensation et commande automatique de gain dans des dispositifs de réduction active du bruit Active EP3618058B1 (fr)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US15/473,926 US10580398B2 (en) 2017-03-30 2017-03-30 Parallel compensation in active noise reduction devices
US15/473,939 US10614790B2 (en) 2017-03-30 2017-03-30 Automatic gain control in an active noise reduction (ANR) signal flow path
US15/473,889 US10553195B2 (en) 2017-03-30 2017-03-30 Dynamic compensation in active noise reduction devices
EP18718353.8A EP3602538B1 (fr) 2017-03-30 2018-03-29 Commande automatique de compensation et de gain de dispositifs de réduction active de bruit
PCT/US2018/025196 WO2018183714A2 (fr) 2017-03-30 2018-03-29 Commande automatique de compensation et de gain de dispositifs de réduction active de bruit

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
EP18718353.8A Division-Into EP3602538B1 (fr) 2017-03-30 2018-03-29 Commande automatique de compensation et de gain de dispositifs de réduction active de bruit
EP18718353.8A Division EP3602538B1 (fr) 2017-03-30 2018-03-29 Commande automatique de compensation et de gain de dispositifs de réduction active de bruit

Publications (2)

Publication Number Publication Date
EP3618058A1 true EP3618058A1 (fr) 2020-03-04
EP3618058B1 EP3618058B1 (fr) 2022-08-17

Family

ID=62002483

Family Applications (3)

Application Number Title Priority Date Filing Date
EP19201902.4A Active EP3627493B1 (fr) 2017-03-30 2018-03-29 Compensation et commande automatique de gain dans de dispositifs de réduction active du bruit
EP19201934.7A Active EP3618058B1 (fr) 2017-03-30 2018-03-29 Compensation et commande automatique de gain dans des dispositifs de réduction active du bruit
EP18718353.8A Active EP3602538B1 (fr) 2017-03-30 2018-03-29 Commande automatique de compensation et de gain de dispositifs de réduction active de bruit

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP19201902.4A Active EP3627493B1 (fr) 2017-03-30 2018-03-29 Compensation et commande automatique de gain dans de dispositifs de réduction active du bruit

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP18718353.8A Active EP3602538B1 (fr) 2017-03-30 2018-03-29 Commande automatique de compensation et de gain de dispositifs de réduction active de bruit

Country Status (3)

Country Link
EP (3) EP3627493B1 (fr)
CN (2) CN110720121B (fr)
WO (1) WO2018183714A2 (fr)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10741164B1 (en) * 2019-05-28 2020-08-11 Bose Corporation Multipurpose microphone in acoustic devices
US11651759B2 (en) * 2019-05-28 2023-05-16 Bose Corporation Gain adjustment in ANR system with multiple feedforward microphones
US10748521B1 (en) * 2019-06-19 2020-08-18 Bose Corporation Real-time detection of conditions in acoustic devices
US10937410B1 (en) * 2020-04-24 2021-03-02 Bose Corporation Managing characteristics of active noise reduction
CN111741407B (zh) * 2020-06-12 2021-08-10 瑞声科技(新加坡)有限公司 一种扬声器补偿方法、装置、存储介质及设备
US11564035B1 (en) * 2021-09-08 2023-01-24 Cirrus Logic, Inc. Active noise cancellation system using infinite impulse response filtering
CN113794965B (zh) * 2021-10-28 2022-11-01 歌尔科技有限公司 耳机频响校准方法、装置、耳机设备及存储介质
CN115278438B (zh) * 2022-07-27 2024-08-27 北京爱德发科技有限公司 降噪耳机、降噪方法和装置、存储介质及处理器
CN116908886B (zh) * 2023-09-13 2023-12-26 北京凯芯微科技有限公司 一种自动检测gnss模组增益范围的系统及方法
CN116994545B (zh) * 2023-09-25 2023-12-08 苏州至盛半导体科技有限公司 K歌系统原音动态调节方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100260345A1 (en) * 2009-04-09 2010-10-14 Harman International Industries, Incorporated System for active noise control based on audio system output
US20110243343A1 (en) * 2010-03-30 2011-10-06 Gauger Jr Daniel M Frequency-dependent anr reference sound compression
US8073151B2 (en) 2009-04-28 2011-12-06 Bose Corporation Dynamically configurable ANR filter block topology
US8073150B2 (en) 2009-04-28 2011-12-06 Bose Corporation Dynamically configurable ANR signal processing topology
US9082388B2 (en) 2012-05-25 2015-07-14 Bose Corporation In-ear active noise reduction earphone

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006157130A (ja) * 2004-11-25 2006-06-15 Globo Technology:Kk 正１２面体拡声装置
TW200627999A (en) * 2005-01-05 2006-08-01 Srs Labs Inc Phase compensation techniques to adjust for speaker deficiencies
TWI310177B (en) * 2006-12-29 2009-05-21 Ind Tech Res Inst Noise canceling device and method thereof
JP5082517B2 (ja) * 2007-03-12 2012-11-28 ヤマハ株式会社 スピーカアレイ装置および信号処理方法
US8699719B2 (en) * 2009-03-30 2014-04-15 Bose Corporation Personal acoustic device position determination
US8737636B2 (en) * 2009-07-10 2014-05-27 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for adaptive active noise cancellation
US8494185B2 (en) * 2010-07-18 2013-07-23 Bose Corporation Electro-acoustic transducer tuning and data storage
CN102932710B (zh) * 2012-10-10 2015-06-03 广州创维平面显示科技有限公司 一种低音补偿的方法及装置
US9445184B2 (en) * 2013-12-03 2016-09-13 Bose Corporation Active noise reduction headphone
CN105025418B (zh) * 2014-04-17 2018-10-09 山东共达电声股份有限公司 一种主动降噪控制器
JP2017530413A (ja) * 2014-09-30 2017-10-12 アバネラ コーポレイションＡｖｎｅｒａ Ｃｏｒｐｏｒａｔｉｏｎ 低レイテンシを有する音響処理装置
JP6611512B2 (ja) * 2015-08-07 2019-11-27 株式会社オーディオテクニカ ノイズキャンセルヘッドホン

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100260345A1 (en) * 2009-04-09 2010-10-14 Harman International Industries, Incorporated System for active noise control based on audio system output
US8073151B2 (en) 2009-04-28 2011-12-06 Bose Corporation Dynamically configurable ANR filter block topology
US8073150B2 (en) 2009-04-28 2011-12-06 Bose Corporation Dynamically configurable ANR signal processing topology
US20110243343A1 (en) * 2010-03-30 2011-10-06 Gauger Jr Daniel M Frequency-dependent anr reference sound compression
US9082388B2 (en) 2012-05-25 2015-07-14 Bose Corporation In-ear active noise reduction earphone

Also Published As

Publication number Publication date
CN110720121B (zh) 2024-04-30
EP3627493B1 (fr) 2024-05-15
CN110720121A (zh) 2020-01-21
CN116741138A (zh) 2023-09-12
WO2018183714A2 (fr) 2018-10-04
EP3602538B1 (fr) 2024-06-05
EP3602538A2 (fr) 2020-02-05
WO2018183714A3 (fr) 2018-11-22
EP3618058B1 (fr) 2022-08-17
EP3627493A1 (fr) 2020-03-25

Similar Documents

Publication Publication Date Title
US11636841B2 (en) Automatic gain control in an active noise reduction (ANR) signal flow path
US10580398B2 (en) Parallel compensation in active noise reduction devices
US10553195B2 (en) Dynamic compensation in active noise reduction devices
EP3627493B1 (fr) Compensation et commande automatique de gain dans de dispositifs de réduction active du bruit
EP3704688B1 (fr) Écoute par compression dans des dispositifs acoustiques personnels
AU2020203567B2 (en) Ambient sound enhancement and acoustic noise cancellation based on context
EP3008724B1 (fr) Commande de stabilité dans des dispositifs anr
US11785382B2 (en) Gain-adaptive active noise reduction (ANR) device
US11651759B2 (en) Gain adjustment in ANR system with multiple feedforward microphones
US11961502B1 (en) Wearable audio device with feedback instability control
US20240303031A1 (en) Ambient sound level control
US20230087943A1 (en) Active noise control method and system for headphone
CN118632162A (zh) 环境声音水平控制
CN118476243A (zh) 具有感知模式自动调平器的音频设备

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AC Divisional application: reference to earlier application

Ref document number: 3602538

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200903

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20220506

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AC Divisional application: reference to earlier application

Ref document number: 3602538

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018039565

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1512689

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220915

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20220817

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221219

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221117

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1512689

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221217

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018039565

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

26N No opposition filed

Effective date: 20230519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230329

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230329

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240220

Year of fee payment: 7

Ref country code: GB

Payment date: 20240220

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220817

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240220

Year of fee payment: 7