EP3899926A1 - Robust adaptive noise cancelling systems and methods - Google Patents

Robust adaptive noise cancelling systems and methods

Info

Publication number
EP3899926A1
EP3899926A1 EP19900182.7A EP19900182A EP3899926A1 EP 3899926 A1 EP3899926 A1 EP 3899926A1 EP 19900182 A EP19900182 A EP 19900182A EP 3899926 A1 EP3899926 A1 EP 3899926A1
Authority
EP
European Patent Office
Prior art keywords
noise
signal
cancellation
adaptive
operable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP19900182.7A
Other languages
German (de)
French (fr)
Other versions
EP3899926B1 (en
EP3899926A4 (en
Inventor
Ali Abdollahzadeh MILANI
Govind Kannan
Trausti Thormundsson
Hari Hariharan
Mark Miller
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Publication of EP3899926A1 publication Critical patent/EP3899926A1/en
Publication of EP3899926A4 publication Critical patent/EP3899926A4/en
Application granted granted Critical
Publication of EP3899926B1 publication Critical patent/EP3899926B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • G10K11/17879General system configurations using both a reference signal and an error signal
    • G10K11/17881General system configurations using both a reference signal and an error signal the reference signal being an acoustic signal, e.g. recorded with a microphone
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • G10K11/17821Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
    • G10K11/17823Reference signals, e.g. ambient acoustic environment
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1783Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase handling or detecting of non-standard events or conditions, e.g. changing operating modes under specific operating conditions
    • G10K11/17833Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase handling or detecting of non-standard events or conditions, e.g. changing operating modes under specific operating conditions by using a self-diagnostic function or a malfunction prevention function, e.g. detecting abnormal output levels
    • G10K11/17835Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase handling or detecting of non-standard events or conditions, e.g. changing operating modes under specific operating conditions by using a self-diagnostic function or a malfunction prevention function, e.g. detecting abnormal output levels using detection of abnormal input signals
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1785Methods, e.g. algorithms; Devices
    • G10K11/17853Methods, e.g. algorithms; Devices of the filter
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083Reduction of ambient noise
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10Applications
    • G10K2210/108Communication systems, e.g. where useful sound is kept and noise is cancelled
    • G10K2210/1081Earphones, e.g. for telephones, ear protectors or headsets
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3026Feedback
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3028Filtering, e.g. Kalman filters or special analogue or digital filters
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3035Models, e.g. of the acoustic system
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3045Multiple acoustic inputs, single acoustic output
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3056Variable gain
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/50Miscellaneous
    • G10K2210/504Calibration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01Hearing devices using active noise cancellation

Definitions

  • the present application relates generally to noise cancelling systems and methods, and more specifically, for example, to adaptive noise cancelling systems and methods for use in headphones (e.g., circum-aural, supra-aural and in-ear types), earbuds, hearing aids, and other personal listening devices.
  • headphones e.g., circum-aural, supra-aural and in-ear types
  • earbuds e.g., earbuds
  • hearing aids e.g., hearing aids, and other personal listening devices.
  • Adaptive noise cancellation (ANC) systems commonly operate by sensing noise through a reference microphone and generating a corresponding anti-noise signal that is approximately equal in magnitude, but opposite in phase, to the sensed noise.
  • the noise and anti-noise signal cancel each other acoustically, allowing the user to hear only a desired audio signal.
  • a low-latency, programmable filter path from the reference microphone to a loud-speaker that outputs the anti-noise signal may be implemented.
  • conventional anti-noise filtering systems do not completely cancel all noise, leaving residual noise and/or generating audible artefacts that may be distracting to the user. There is therefore a continued need for improved adaptive noise cancellation systems and methods for headphones, earbuds and other personal listening devices.
  • adaptive noise cancellation systems and methods include improved transient active noise detection.
  • an adaptive noise cancellation system includes a reference sensor operable to sense environmental noise and generate a corresponding reference signal, an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal, a noise cancellation filter operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise in the cancellation zone, an adaptation module operable to receive the reference signal and the error signal and adaptively adjust the anti-noise signal, and a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.
  • the adaptation module comprises an adaptive gain control block operable to update the variable gain component.
  • Inputs to the adaptive gain control block may be conditioned using programmable filters operable to protect against low frequency transients and/or high frequency distractors in the environmental noise.
  • the programmable filters may include a low pass filter that filters out high frequencies determined to be in a range that creates constructive interference between the cancellation zone and the eardrum reference point, and/or a high pass filter that filters out low frequencies determined to be in a range that cannot be heard by a user of the noise cancellation system.
  • the adaptation module may be tuned to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone.
  • a method includes receiving a reference signal from a first sensor, the reference signal representing external noise, processing the reference signal through a noise cancellation path comprising a noise cancellation filter and a variable gain component, to generate an anti-noise signal, receiving an error signal from a second sensor, the error signal representing noise in a noise cancellation zone and adaptively adjusting the noise cancellation filter in response to the reference signal, the error signal and an adaptive gain control process to cancel the external noise at an eardrum reference point.
  • the method may further include conditioning inputs to the adaptive gain control process using programmable filters to protect against low frequency transients and/or high frequency distractors in the external noise.
  • the conditioning may further include low pass filtering out high frequencies determined to be in a range that (i) creates constructive interference between the cancellation zone and the eardrum reference point and (ii) differs in noise cancellation performance between the cancellation zone and the eardrum reference point , and/or high pass filtering out low frequencies determined to be in a range that cannot be heard by a user.
  • the method may further include tuning the noise cancellation path to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone.
  • FIG. 1 illustrates an adaptive noise cancellation headset in accordance with one or more embodiments of the present disclosure.
  • FIG. 2 illustrates an adaptive noise cancellation system in accordance with one or more embodiments of the present disclosure.
  • FIG. 3 illustrates an adaptive noise cancellation system, including a noise amplification control subsystem, in accordance with one or more embodiments of the present disclosure.
  • FIGs. 4A-B illustrate an adaptive noise cancellation system, including an adaptive gain control subsystem, in accordance with one or more embodiments of the present disclosure.
  • FIG. 5 illustrates a transient activity detector for an adaptive noise cancellation system in accordance with one or more embodiments of the present disclosure.
  • An ANC system for a headset or other personal listening device may include a noise sensing reference microphone for sensing environmental noise, an error microphone for sensing an acoustic mixture of the noise and anti-noise generated by the ANC device, and a signal processing sub-system that generates the anti noise to cancel the environmental noise.
  • the signal processing sub-system may be configured to continually adjust the anti-noise signal to achieve consistent cancellation performance across users, environmental noise conditions, and device units.
  • the adaptation systems and methods disclosed herein improve cancellation of environmental noise and reduce perceptible adaptation artefacts.
  • the present disclosure addresses numerous challenges associated with general purpose adaptive noise cancellation systems, including unwanted noise amplification (e.g., due to constructive interference between the environmental noise and the anti-noise signal), noise cancellation performance during transient noise events, and reduction of audible artefacts produced during adaptation.
  • unwanted noise amplification e.g., due to constructive interference between the environmental noise and the anti-noise signal
  • noise cancellation performance during transient noise events
  • reduction of audible artefacts produced during adaptation e.g., due to constructive interference between the environmental noise and the anti-noise signal
  • the systems and methods disclosed herein provide robust, practical ANC solutions that generalize well to various listening devices and form- factors.
  • systems and methods are disclosed to reduce noise amplification that occurs when there is constructive interference between noise and anti-noise within a frequency range.
  • Adaptive methods are disclosed which include defining a composite error signal that incorporates a noise shaping filter and deriving a new weight update rule for controlling the adaptation.
  • the solutions disclosed herein are adaptive, computationally inexpensive, and may be implemented as an improvement to conventional adaptive frameworks.
  • systems and methods disclosed herein reduce adaptation artefacts that may be perceived by a listener.
  • low sound pressure level (SPL) artefacts may be present due to the proximity of the anti-noise source to the listener’s ear drum. It is further recognized that some artefacts are caused by wideband fluctuations in the magnitude and phase response of the anti-noise path.
  • Improved adaptive systems and methods disclosed herein include an adaptive gain element in the anti-noise signal path to generate a robust error correcting signal.
  • systems and methods disclosed herein provide improved robustness to transient noise events.
  • Many intermittent and unexpected noise events e.g., head/jaw movement that moves the microphones relative to the noise, closing a door, turbulence during air travel, etc.
  • TAD transient activity detector
  • an adaptive noise cancelling system 100 includes an audio device, such as headphone 110, and audio processing circuitry, such as digital signal processor (DSP) 120, a digital to analog converter (DAC) 130, an amplifier 132, a reference microphone 140, a loudspeaker 150, an error microphone 162, and other components.
  • DSP digital signal processor
  • DAC digital to analog converter
  • a listener may hear external noise d(n) through the housing and components of the headphone 110.
  • the reference microphone 140 senses the external noise, producing a reference signal x(n) which is fed through an analog- to-digital converter (ADC) 142 to the DSP 120.
  • the DSP 120 generates an anti-noise signal y(n), which is fed through the DAC 130 and the amplifier 132 to the loudspeaker 150 to generate anti-noise in a noise cancellation zone 160.
  • the noise d(n ) will be cancelled in the noise cancellation zone 160 when the anti-noise is equal in magnitude and opposite in phase to the noise d(ri) in the noise cancellation zone 160.
  • the resulting mixture of noise and anti noise is captured by the error microphone 162 which generates an error signal e(n) to measure the effectiveness of the noise cancellation.
  • the error signal e(n) is fed through ADC 164 to the DSP 120, which adjusts the magnitude and phase of the anti-noise signal y(n) to minimize the error signal e(n ) within the cancellation zone 162 (e.g., drive the error signal e(n) to zero).
  • the loudspeaker 150 may also generate desired audio (e.g., music) which is received by the error microphone 162 and removed from the error signal e(n ) during processing.
  • desired audio e.g., music
  • FIG. 2 illustrates a robust, configurable adaptive noise cancelling system 200 that achieves improved noise cancellation performance, substantially free of audio artefacts.
  • the system 200 senses environmental noise at an external microphone (e.g., microphone 140 of FIG. 1) which produces an external noise signal, x(n).
  • the environmental noise also passes through a noise path P(z), including the housing and components of the listening device, where it is received as din ) at an error microphone (e.g., error microphone 162).
  • An adaptive filter 202 receives the external noise signal x(n) and estimates the noise path P(z) to produce an anti-noise signal yin) for cancelling the noise signal din).
  • the anti-noise signal yin) is gain adjusted by adaptive gain control 204 and further modified by system 206 to account for the secondary path S(z) between the adaptive filter 202 and the error microphone.
  • the system 200 further includes an adaptation block 220, which includes a noise amplification control (NAC) block 222 and an adaptive gain control block (ADG) 224.
  • NAC noise amplification control
  • ADG adaptive gain control block
  • the NAC 222 is operable to minimize frequency dependent
  • the system 200 further includes a transient activity detector (TAD)
  • the filters 208, 210, 212,228, 230, 232 provide additional filtering as described further herein with reference to FIGs. 3-5.
  • a goal of many adaptive noise cancellation systems is to estimate the noise at the ear drum of the listener. This is often accomplished by using the noise measurements from the reference and error microphones, which are located a small distance from the ear drum. The estimated noise is then inverted into an anti-noise signal that destructively interferes with the actual noise leading to cancellation of the noise.
  • the anti noise signal is produced using a filter that adapts to estimate the amplitude and phase shift for each frequency to align the anti-noise with the noise.
  • the destructive interference may be maintained in certain bandwidths, while constructive interference may be experienced beyond these bandwidths.
  • This constructive interference may be perceived by the listener as a narrowband amplification of the ambient noise (e.g., a“hiss” sound). Reducing or eliminating the“hiss” sound without sacrificing the depth and bandwidth of cancellation is a challenge in many ANC product designs. In conventional, low power embedded systems (e.g., consumer headphones) reduction of hiss may be computationally prohibitive and hard to control and tune.
  • the NAC sub-system 300 of FIG. 3 provides an approach for controlling hiss and related sound artefacts that adaptively controls the noise amplification in hiss regions, while efficiently achieving cancellation in non-hiss regions.
  • An NAC block 320 is configured to define a composite error signal that incorporates a noise-shaping filter C(z) (e.g., noise shaping block 308 and noise shaping block 310) and derive new weight update rules for the adaptive filter 302.
  • a least mean squares (LMS) framework may be used, including a composite error signal that incorporates the noise-shaping filter that is used to derive a new weight update rule.
  • LMS least mean squares
  • the NAC block 320 updates the adaptive filter 302, W(z), based on the error signal e(n ) and a filtered version of the reference signal, x(n).
  • the NAC block 320 receives a signal x x ( n ) from filter 312, S(z), and signal x 2 (n) from filter 308, C(z).
  • the cost function minimizes the mean square error: Minimize E ⁇ e 2 (n ) + yE ⁇ e 2 (n) ⁇ .
  • the anti-noise signal is filtered using a noise-shaping filter C ⁇ z ) (such as noise-shaping filter 308 and noise-shaping filter 310) which may be configured to enhance signals in the hiss region.
  • a noise-shaping filter C ⁇ z such as noise-shaping filter 308 and noise-shaping filter 310) which may be configured to enhance signals in the hiss region.
  • the hiss region for a particular headset may be detected, and the noise-shaping filter C(z) may be tuned, in a test environment prior to distribution.
  • the hiss level may be detected during operation and the noise-shaping filter C(z) may be adaptively tuned during operation. The hiss level may be determined, for example, by comparing the error signal, e(ri), to the noise signal to determine regions of constructive interference.
  • the cost function is adapted to minimize E ⁇ e 2 (n) + gE ⁇ b 2 (h) ⁇ where E ⁇ . ⁇ is the expectation operator, y is a constant that controls the aggressiveness, and e 1 (n) is noise-shaped anti-noise signal, ’(n).
  • a weight update rule is derived by the NAC 320 based on gradient methods. Embodiments of the method can be applied to filtered least mean squared approaches, adaptive feedback, adaptive hybrid approaches and other noise cancellation approaches. In various embodiments, the adaptation is controlled in a way that minimizes noise amplification by defining a cost function optimization and deriving an adaptive algorithm that can achieve it.
  • an adaptive gain control block 420 continuously updates a gain element 404 to adjust for variations in the various coupling paths.
  • the inputs to the ADG are conditioned using a programmable filter BQ(Z) (e.g., programmable filter 408 and programmable filter 410), which is designed to protect against low frequency transients and high frequencies distractors in the environment.
  • the filter BG(Z) may comprise a low pass filter and/or a band pass filter that further filters out very low frequencies (e.g., ⁇ 20 Hz that cannot be heard out of a
  • an ANC system in a headphone or other personal listening device uses a noise sensing reference microphone, an error microphone, and a DSP sub-system that generates the appropriate anti noise to cancel the noise field as measured by the error microphone. This results in a cancellation zone where the degree of cancellation is maximized at the error microphone location and degrades inversely proportional to the wavelength.
  • FIGs. 4A-B address these and other issues by maximizing the cancellation bandwidth at the eardrum during the tuning stage and formulating an adaptive approach that uses the error microphone to adapt to user specific characteristics during operation.
  • the error microphone location be termed as ERP (Error Reference Point) and the ear-drum location be termed as DRP (Drum Reference Point).
  • ERP Error Reference Point
  • DRP Drum Reference Point
  • the error microphone is a good indicator of low frequency cancellation at DRP and hence a robust error correcting signal can be derived from a low-passed version of the error microphone signal. This correcting signal may then be used to adapt a gain in the anti-noise signal path.
  • the ERP is used to provide a practical signal that is roughly indicative of the cancellation performance at the DRP.
  • the adaptive algorithm attempts to minimize the ERP signal which results in (i) diminished cancellation at high frequency signals at the DRP, and (ii) higher possibility of hiss sounding artefacts due to constructive interference of high frequencies at the DRP.
  • adaptive algorithms are employed that use the transfer function from ERP to DRP.
  • FIG 4A illustrates a calibration and tuning arrangement for the adaptive gain subsystem.
  • the ANC filter 402 is optimized to cancel noise at the DRP during an initial tuning stage.
  • the device is placed on a head and torso simulator which has a second error microphone at the DRP.
  • P E2D (Z), S E2D (Z) model the ERP to DRP transfer functions in the denoted acoustic paths.
  • the system can then be optimized using least mean squares block 422 to perform ANC tuning to derive an optimum W DRP (z), based on the error signal, e'(n). Tuning in this manner helps achieve extended cancellation bandwidth and better performance in high frequency bands.
  • the adaptive algorithm is set-up to continuously update a gain element 404, G, that empowers the proposed approach to adjust for variations in the various coupling paths.
  • the signal is low pass filtered and gain adjusted for good low frequency cancellation.
  • the inputs to the adaptive algorithms are conditioned using a
  • B G (Z) which is programmed such that the ERP signal can mimic the cancellation performance at DRP. Additionally, B G (z ), can be programmed to optimize performance during low frequency transients and high frequency distractors in the environment.
  • FIGs. 4A-B are example implementations, and that the approaches disclosed therein can be modified for adaptive versions of feedback, feedforward and hybrid ANC solutions.
  • a purposefully constrained filter element instead of adapting a gain element, can be adapted.
  • the computed gain can have an additional non-linear processing to further increase the robustness.
  • a transient activity detector (TAD) 500 are illustrated.
  • the TAD 500 detects changes in the sound environment and causes an update process to be temporarily halted when sudden/intermittent noise activity is detected.
  • the unwanted adaptation artefacts in the anti-noise signal e.g., artefacts that might result from rapid adaptation
  • transient events might include talking by the headset wearer, honking car horns, head movements, and other similar sound events.
  • a separate set of TAD calculations may be performed on the inputs from each microphone in an ANC system (e.g., a total of 4 microphones in a headset including left error microphone, left outside microphone, right error microphone, right outside microphone).
  • a detection state machine 514 is used to assert and de-assert the“detect” output.
  • the detect output will be asserted when the smoothed instantaneous magnitude (output A from the LPF 506) is greater than the scaled average noise magnitude (C in disclosure).
  • a release delay counter will cause the detect output to persist for a programmable period of time before being de-asserted.
  • audio samples 502 from a microphone are received and fed through an absolute value block 504 followed by a low pass filter 506 to generate the smoothed instantaneous magnitude A.
  • the output A comprises an average magnitude of the audio samples 502 over a certain period of time and is representative of an instantaneous noise value.
  • the value A is provided to a detect state machine 514, and to a low pass filter 508 with saturation which has an output B representing an average of the A values over a second period of time (i.e., average noise magnitude).
  • a programmable scale factor defines a threshold for detecting transients (e.g., 5 times the average noise magnitude) and is multiplied at component 516 by the average noise magnitude to produce a second input C to the detect state machine 514.
  • the detect state machine 514 is operable to instruct the adaptation processing (e.g., adaptation block 220 of FIG. 2) to stop.
  • the adaptation will freeze until the instantaneous noise magnitude A is below the scaled average noise magnitude C.
  • filter 202 and adaptive gain control 204 will continue to modify the noise input x(n) using the most recent weights and gain values.
  • a programmable release delay counter is operable to maintain the detect output for a programmable period of time before being de-asserted.
  • attack and release component 512 is operable to control how quickly the low pass filter 508 rises and falls in response to the instantaneous noise magnitude A.
  • a programmable attack time constant defines a time it takes for the average noise magnitude to rise when the instantaneous noise is greater than the average noise magnitude B.
  • a programmable release time constant defines a time it takes for the average noise magnitude B to fall when the instantaneous noise magnitude A is lower than the average noise magnitude B.
  • a robust adaptive noise cancellation system comprises a reference sensor operable to sense environmental noise and generate a corresponding reference signal, an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal, a noise cancellation filter operable to receive the reference signal and generate an anti noise signal to cancel the environmental noise in the cancellation zone, an adaptation module operable to receive the reference signal and the error signal and adaptively adjust the antinoise signal, and a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.
  • the transient noise event may include talking by an operator of the adaptive noise cancellation system
  • the transient activity detection module may comprise a state machine operable to detect the transient noise event and transmit a state command to the adaptation module.
  • the adaptation module is operable to receive the state command and enable and/or disable the adaptation in accordance therewith.
  • the transient noise event is detected if a smoothed instantaneous magnitude of a received signal is greater than a scaled average noise magnitude of the received signal, and after an end of the transient noise event is detected, a delay is applied before enabling adaptation.
  • the end of the transient noise event may be detected when the smoothed instantaneous magnitude falls below the scaled average noise magnitude.
  • the scaled average noise magnitude may be derived by applying a programmable scale factor to the average noise magnitude.
  • the noise cancellation filter is further operable to generate the anti-noise signal in accordance with stored filter coefficients
  • the adaptation module is further operable to modify the stored filter coefficients.
  • the adaptive noise cancellation system further includes a loudspeaker operable to receive the anti-noise signal and generate anti-noise to cancel the noise in a cancellation zone.
  • the adaptation module further comprises a noise amplification control subsystem, and/or an adaptive gain control subsystem.
  • a robust active noise cancellation method includes receiving a reference signal from a first sensor, the reference signal representing external noise, processing the reference signal through a noise cancellation filter to generate an anti- noise signal, outputting the anti-noise signal to a loudspeaker, receiving an error signal from a second sensor, the error signal representing noise in a noise cancellation zone, adaptively adjusting the noise cancellation filter in response to the reference signal the, the error signal and a transient noise detection state, and detecting a transient noise event and selectively setting the transient noise detection state to enable and disable, respectively, the adaptively adjusting the noise cancellation.
  • setting the transient noise detection state comprises transmitting a state command, wherein the adaptively adjusting the noise cancellation filter further comprises receiving the state command and enabling and disabling, respectively, the adaptation in accordance therewith.
  • Detecting the transient noise event may comprise comparing a smoothed instantaneous magnitude of the received signal to a scaled average noise magnitude of the received signal.
  • a delay is applied before enabling adaptation.
  • the transient noise event is detected when the smoothed instantaneous magnitude falls below the scaled average noise magnitude.
  • the scaled average noise magnitude may be derived by applying a programmable scale factor to the average noise magnitude.
  • Adaptively adjusting the noise cancellation filter comprises a noise amplification control process and/or an adaptive gain control process.
  • an adaptive noise cancelling system with noise amplification control comprises a reference sensor operable to sense environmental noise and generate a corresponding reference signal, an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal, a noise cancellation filter operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise in the cancellation zone, and an adaptation module operable to receive the reference signal and the error signal and adaptively adjust the anti-noise signal.
  • the adaptation module comprises a noise amplification control module operable to adaptively control noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal.
  • the hiss region of the anti-noise signal includes frequency bandwidths in which constructive interference between the environmental noise and the anti-noise signal is detected.
  • the noise amplification control module is operable to define a composite error signal that incorporates a noise-shaping filter and derives new weight update rules for the noise cancellation filter, and/or derive new weight update rules using a least mean squared algorithm.
  • the noise-shaping filter may be adaptively timed during operation, and/or the weight update rules are derived using gradients.
  • the noise amplification control adapts a cost function to minimize E ⁇ e 2 (n ) + gE ⁇ b ⁇ ) ⁇ where E ⁇ . ⁇ is the expectation operator, y is a constant that controls the aggressiveness, and e t (n) is noise-shaped anti-noise signal, ’(n).
  • a transient activity detection module may be provided to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.
  • the noise cancellation filter may be further operable to generate the anti-noise signal in accordance with stored filter coefficients; and wherein the adaptation module is further operable to modify the stored filter coefficients.
  • the system may further comprise a loudspeaker operable to receive the anti-noise signal and generate anti-noise to cancel the noise in a cancellation zone.
  • a method for adaptive noise cancelling with noise amplification control comprises receiving a reference signal from a first sensor, the reference signal representing external noise, processing the reference signal through a noise
  • the noise amplification control process comprises adaptively controlling noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal.
  • the hiss region of the anti-noise signal includes frequency bandwidths in which constructive interference between the environmental noise and the anti-noise signal is detected.
  • the noise amplification control process may further comprise defining a composite error signal that incorporates a noise-shaping filter and deriving new weight update rules for the noise cancellation filter, deriving new weight update rules using a least mean squared algorithm, adaptively tuning the noise-shaping filter during operation, and/or adapting a cost function to minimize E ⁇ e 2 (n ) + gE ⁇ b (n) ⁇ where E ⁇ . ⁇ is the expectation operator, y is a constant that controls the aggressiveness, and b (n) is noise-shaped anti-noise signal, y’ ( n ).
  • the weight update rules may be derived using gradients.
  • the method further comprises detecting a transient noise event and selectively setting a transient noise detection state to enable and disable, respectively, the adaptively adjusting the noise cancellation filter, and/or generating the anti-noise signal in accordance with stored filter coefficients.
  • an extended bandwidth adaptive noise cancelling system comprises a reference sensor operable to sense environmental noise and generate a corresponding reference signal, an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal, a noise cancellation path comprising a noise cancellation filter and a variable gain component, the noise cancellation path operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise at an eardrum reference point, and an adaptation module operable to receive the reference signal and the error signal and adaptively adjust weights of the noise cancellation filter and/or the variable gain component.
  • the adaptation module may comprise an adaptive gain control block operable to update the variable gain component.
  • inputs to the adaptive gain control block are conditioned using programmable filters operable to protect against low frequency transients and/or high frequency distractors in the environmental noise, and/or the programmable filters comprise a low pass filter that filters out high frequencies determined to be in a range that creates constructive interference between the cancellation zone and the eardrum reference point.
  • the programmable filters may comprise a high pass filter that filters out low frequencies determined to be in a range that cannot be heard by a user of the noise cancellation system.
  • the adaptation module is tuned to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone.
  • the adaptation module may further comprise a noise amplification control module operable to adaptively control noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal.
  • the hiss region of the anti-noise signal may include frequency bandwidths in which constructive interference between the environmental noise and the anti-noise signal is detected.
  • the extended bandwidth adaptive noise cancelling system further comprises a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.
  • the noise cancellation filter may be further operable to generate the anti-noise signal in accordance with stored filter coefficients; and wherein the adaptation module is further operable to modify the stored filter coefficients.
  • the extended bandwidth adaptive noise cancelling system may further comprise a loudspeaker operable to receive the anti-noise signal and generate anti-noise to cancel the noise in a cancellation zone.
  • a method of operating an extended bandwidth adaptive noise cancelling system comprises receiving a reference signal from a first sensor, the reference signal representing external noise, processing the reference signal through a noise cancellation path comprising a noise cancellation filter and a variable gain component, to generate an anti-noise signal, receiving an error signal from a second sensor, the error signal representing noise in a noise cancellation zone, and adaptively adjusting the noise cancellation filter in response to the reference signal the, the error signal and an adaptive gain control process to cancel the external noise at an eardrum reference point.
  • the method of operating an extended bandwidth adaptive noise cancelling system further comprises conditioning inputs to the adaptive gain control process using programmable filters to protect against low frequency transients and/or high frequency distractors in the external noise, wherein the conditioning further comprises low pass filtering out high frequencies determined to be in a range that creates constructive interference between the cancellation zone and the eardrum reference point, and/or wherein the conditioning further comprises high pass filtering out low frequencies determined to be in a range that cannot be heard by a user.
  • the method of operating an extended bandwidth adaptive noise cancelling system further comprises tuning the noise cancellation path to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone, and/or through a noise amplification control process, adaptively
  • the hiss region of the antinoise signal may include frequency bandwidths in which constructive interference between the external noise and the anti-noise signal is detected.
  • the method of operating an extended bandwidth adaptive noise cancelling system further comprises, through a transient activity detection process, receiving the reference signal, detecting a transient noise event and selectively disabling adaptively adjusting the noise cancellation filter during the detected transient noise event.
  • the method may further comprise generating the anti-noise signal in accordance with stored filter coefficients; and adaptively modifying the stored filter coefficients during operation, and/or outputting the anti-noise signal to a loudspeaker to generate anti-noise to cancel the noise in a cancellation zone.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

Adaptive noise cancellation systems and methods comprise a reference sensor operable to sense environmental noise and generate a corresponding reference signal, an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal, a noise cancellation filter operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise in the cancellation zone, an adaptation module operable to receive the reference signal and the error signal and adaptively adjust the anti-noise signal, and a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.

Description

ROBUST ADAPTIVE NOISE CANCELLING SYSTEMS AND METHODS Ali Abdollahzadeh Milani, Govind Kannan, Trausti Thormundsson, Hari Hariharan, Mark
Miller
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] The present application claims priority to and the benefit of U.S. Provisional Application No. 62/782,299, titled“ROBUST ADAPTIVE NOISE CANCELLING
SYSTEMS AND METHODS,” filed December 19, 2019; U.S. Provisional Application No. 62/782,305, titled“NOISE AMPLIFICATION CONTROL IN ADAPTIVE NOISE
CANCELLING SYSTEMS,” filed December 19, 2019; and U.S. Provisional Application No. 62/782,312, titled“EXTENDED BANDWIDTH ADAPTIVE NOISE CANCELLING SYSTEM AND METHODS” filed December 19, 2019; each of which is hereby incorporated by reference in its entirety.
TECHNICAL FIELD
[0002] The present application relates generally to noise cancelling systems and methods, and more specifically, for example, to adaptive noise cancelling systems and methods for use in headphones (e.g., circum-aural, supra-aural and in-ear types), earbuds, hearing aids, and other personal listening devices.
BACKGROUND
[0003] Adaptive noise cancellation (ANC) systems commonly operate by sensing noise through a reference microphone and generating a corresponding anti-noise signal that is approximately equal in magnitude, but opposite in phase, to the sensed noise. The noise and anti-noise signal cancel each other acoustically, allowing the user to hear only a desired audio signal. To achieve this effect, a low-latency, programmable filter path from the reference microphone to a loud-speaker that outputs the anti-noise signal may be implemented. In operation, conventional anti-noise filtering systems do not completely cancel all noise, leaving residual noise and/or generating audible artefacts that may be distracting to the user. There is therefore a continued need for improved adaptive noise cancellation systems and methods for headphones, earbuds and other personal listening devices.
SUMMARY [0004] Systems and methods are disclosed for providing adaptive noise cancellation in audio listening devices. In various embodiments, adaptive noise cancellation systems and methods include improved transient active noise detection.
[0005] In one or more embodiments, an adaptive noise cancellation system includes a reference sensor operable to sense environmental noise and generate a corresponding reference signal, an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal, a noise cancellation filter operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise in the cancellation zone, an adaptation module operable to receive the reference signal and the error signal and adaptively adjust the anti-noise signal, and a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.
[0006] In some embodiments, the adaptation module comprises an adaptive gain control block operable to update the variable gain component. Inputs to the adaptive gain control block may be conditioned using programmable filters operable to protect against low frequency transients and/or high frequency distractors in the environmental noise. The programmable filters may include a low pass filter that filters out high frequencies determined to be in a range that creates constructive interference between the cancellation zone and the eardrum reference point, and/or a high pass filter that filters out low frequencies determined to be in a range that cannot be heard by a user of the noise cancellation system. The adaptation module may be tuned to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone.
[0007] In one or more embodiments, a method includes receiving a reference signal from a first sensor, the reference signal representing external noise, processing the reference signal through a noise cancellation path comprising a noise cancellation filter and a variable gain component, to generate an anti-noise signal, receiving an error signal from a second sensor, the error signal representing noise in a noise cancellation zone and adaptively adjusting the noise cancellation filter in response to the reference signal, the error signal and an adaptive gain control process to cancel the external noise at an eardrum reference point.
[0008] The method may further include conditioning inputs to the adaptive gain control process using programmable filters to protect against low frequency transients and/or high frequency distractors in the external noise. The conditioning may further include low pass filtering out high frequencies determined to be in a range that (i) creates constructive interference between the cancellation zone and the eardrum reference point and (ii) differs in noise cancellation performance between the cancellation zone and the eardrum reference point , and/or high pass filtering out low frequencies determined to be in a range that cannot be heard by a user. The method may further include tuning the noise cancellation path to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone.
[0009] The scope of the invention is defined by the claims, which are incorporated into this section by reference. A more complete understanding of embodiments of the invention will be afforded to those skilled in the art, as well as a realization of additional advantages thereof, by a consideration of the following detailed description of one or more embodiments. Reference will be made to the appended sheets of drawings that will first be described briefly.
BRIEF DESCRIPTION OF THE DRAWINGS
[00010] Aspects of the disclosure and their advantages can be better understood with reference to the following drawings and the detailed description that follows. It should be appreciated that like reference numerals are used to identify like elements illustrated in one or more of the figures, wherein showings therein are for purposes of illustrating embodiments of the present disclosure and not for purposes of limiting the same. The components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present disclosure.
[00011] FIG. 1 illustrates an adaptive noise cancellation headset in accordance with one or more embodiments of the present disclosure.
[00012] FIG. 2 illustrates an adaptive noise cancellation system in accordance with one or more embodiments of the present disclosure.
[00013] FIG. 3 illustrates an adaptive noise cancellation system, including a noise amplification control subsystem, in accordance with one or more embodiments of the present disclosure.
[00014] FIGs. 4A-B illustrate an adaptive noise cancellation system, including an adaptive gain control subsystem, in accordance with one or more embodiments of the present disclosure.
[00015] FIG. 5 illustrates a transient activity detector for an adaptive noise cancellation system in accordance with one or more embodiments of the present disclosure.
DETAILED DESCRIPTION [00016] In accordance with various embodiments, improved adaptive noise cancellation (ANC) systems and methods are disclosed. An ANC system for a headset or other personal listening device may include a noise sensing reference microphone for sensing environmental noise, an error microphone for sensing an acoustic mixture of the noise and anti-noise generated by the ANC device, and a signal processing sub-system that generates the anti noise to cancel the environmental noise. The signal processing sub-system may be configured to continually adjust the anti-noise signal to achieve consistent cancellation performance across users, environmental noise conditions, and device units. In various embodiments, the adaptation systems and methods disclosed herein improve cancellation of environmental noise and reduce perceptible adaptation artefacts.
[00017] The present disclosure addresses numerous challenges associated with general purpose adaptive noise cancellation systems, including unwanted noise amplification (e.g., due to constructive interference between the environmental noise and the anti-noise signal), noise cancellation performance during transient noise events, and reduction of audible artefacts produced during adaptation. The systems and methods disclosed herein provide robust, practical ANC solutions that generalize well to various listening devices and form- factors.
[00018] In various embodiments, systems and methods are disclosed to reduce noise amplification that occurs when there is constructive interference between noise and anti-noise within a frequency range. Adaptive methods are disclosed which include defining a composite error signal that incorporates a noise shaping filter and deriving a new weight update rule for controlling the adaptation. The solutions disclosed herein are adaptive, computationally inexpensive, and may be implemented as an improvement to conventional adaptive frameworks.
[00019] In various embodiments, systems and methods disclosed herein reduce adaptation artefacts that may be perceived by a listener. For example, low sound pressure level (SPL) artefacts may be present due to the proximity of the anti-noise source to the listener’s ear drum. It is further recognized that some artefacts are caused by wideband fluctuations in the magnitude and phase response of the anti-noise path. Improved adaptive systems and methods disclosed herein include an adaptive gain element in the anti-noise signal path to generate a robust error correcting signal.
[00020] In various embodiments, systems and methods disclosed herein provide improved robustness to transient noise events. Many intermittent and unexpected noise events (e.g., head/jaw movement that moves the microphones relative to the noise, closing a door, turbulence during air travel, etc.) produce low frequency transients that can potentially disrupt the adaptation loop, leaving unwanted residual noise or producing noise artefacts. In various embodiments, a transient activity detector (TAD) tracks transient behavior and controls adaptation during transient activity.
[00021] Example embodiments of adaptive noise cancelling systems of the present disclosure will now be described with reference to the figures. Referring to FIG. 1, an adaptive noise cancelling system 100 includes an audio device, such as headphone 110, and audio processing circuitry, such as digital signal processor (DSP) 120, a digital to analog converter (DAC) 130, an amplifier 132, a reference microphone 140, a loudspeaker 150, an error microphone 162, and other components.
[00022] In operation, a listener may hear external noise d(n) through the housing and components of the headphone 110. To cancel the noise d(n ), the reference microphone 140 senses the external noise, producing a reference signal x(n) which is fed through an analog- to-digital converter (ADC) 142 to the DSP 120. The DSP 120 generates an anti-noise signal y(n), which is fed through the DAC 130 and the amplifier 132 to the loudspeaker 150 to generate anti-noise in a noise cancellation zone 160. The noise d(n ) will be cancelled in the noise cancellation zone 160 when the anti-noise is equal in magnitude and opposite in phase to the noise d(ri) in the noise cancellation zone 160. The resulting mixture of noise and anti noise is captured by the error microphone 162 which generates an error signal e(n) to measure the effectiveness of the noise cancellation. The error signal e(n) is fed through ADC 164 to the DSP 120, which adjusts the magnitude and phase of the anti-noise signal y(n) to minimize the error signal e(n ) within the cancellation zone 162 (e.g., drive the error signal e(n) to zero). In some embodiments, the loudspeaker 150 may also generate desired audio (e.g., music) which is received by the error microphone 162 and removed from the error signal e(n ) during processing. It will be appreciated that the embodiment of FIG. 1 is one example of an adaptive noise cancellation system and that the systems and methods disclosed herein may be implemented with other adaptive noise cancelling implementations that include a reference microphone and an error microphone.
[00023] FIG. 2 illustrates a robust, configurable adaptive noise cancelling system 200 that achieves improved noise cancellation performance, substantially free of audio artefacts. The system 200 senses environmental noise at an external microphone (e.g., microphone 140 of FIG. 1) which produces an external noise signal, x(n). The environmental noise also passes through a noise path P(z), including the housing and components of the listening device, where it is received as din ) at an error microphone (e.g., error microphone 162). An adaptive filter 202 receives the external noise signal x(n) and estimates the noise path P(z) to produce an anti-noise signal yin) for cancelling the noise signal din). The anti-noise signal yin) is gain adjusted by adaptive gain control 204 and further modified by system 206 to account for the secondary path S(z) between the adaptive filter 202 and the error microphone.
[00024] The system 200 further includes an adaptation block 220, which includes a noise amplification control (NAC) block 222 and an adaptive gain control block (ADG) 224. In various embodiments, the NAC 222 is operable to minimize frequency dependent
constructive interference, and the ADG 224 is operable to minimize wide-band fluctuations in the anti-noise path. The system 200 further includes a transient activity detector (TAD)
226, which is operable to control the system 200 in response to sudden noise fluctuations and impulsive environmental events. The filters 208, 210, 212,228, 230, 232 provide additional filtering as described further herein with reference to FIGs. 3-5.
[00025] Referring to FIG. 3, embodiments of a noise amplification control (NAC) sub system 300 will now be described. A goal of many adaptive noise cancellation systems is to estimate the noise at the ear drum of the listener. This is often accomplished by using the noise measurements from the reference and error microphones, which are located a small distance from the ear drum. The estimated noise is then inverted into an anti-noise signal that destructively interferes with the actual noise leading to cancellation of the noise. The anti noise signal is produced using a filter that adapts to estimate the amplitude and phase shift for each frequency to align the anti-noise with the noise. Depending on the latency and the physical transfer functions at issue, the destructive interference may be maintained in certain bandwidths, while constructive interference may be experienced beyond these bandwidths. This constructive interference may be perceived by the listener as a narrowband amplification of the ambient noise (e.g., a“hiss” sound). Reducing or eliminating the“hiss” sound without sacrificing the depth and bandwidth of cancellation is a challenge in many ANC product designs. In conventional, low power embedded systems (e.g., consumer headphones) reduction of hiss may be computationally prohibitive and hard to control and tune.
[00026] The NAC sub-system 300 of FIG. 3 provides an approach for controlling hiss and related sound artefacts that adaptively controls the noise amplification in hiss regions, while efficiently achieving cancellation in non-hiss regions. An NAC block 320 is configured to define a composite error signal that incorporates a noise-shaping filter C(z) (e.g., noise shaping block 308 and noise shaping block 310) and derive new weight update rules for the adaptive filter 302. In some embodiments, a least mean squares (LMS) framework may be used, including a composite error signal that incorporates the noise-shaping filter that is used to derive a new weight update rule.
[00027] In operation, the NAC block 320 updates the adaptive filter 302, W(z), based on the error signal e(n ) and a filtered version of the reference signal, x(n). In the illustrated embodiment, the NAC block 320 receives a signal xx ( n ) from filter 312, S(z), and signal x2 (n) from filter 308, C(z). The cost function minimizes the mean square error: Minimize E{e2(n ) + yE{e2 (n)}. In various embodiments, the anti-noise signal is filtered using a noise-shaping filter C{z ) (such as noise-shaping filter 308 and noise-shaping filter 310) which may be configured to enhance signals in the hiss region. In some embodiments, the hiss region for a particular headset may be detected, and the noise-shaping filter C(z) may be tuned, in a test environment prior to distribution. In some embodiments, the hiss level may be detected during operation and the noise-shaping filter C(z) may be adaptively tuned during operation. The hiss level may be determined, for example, by comparing the error signal, e(ri), to the noise signal to determine regions of constructive interference.
[00028] The cost function is adapted to minimize E{e2(n) + gE{b2(h)} where E{.} is the expectation operator, y is a constant that controls the aggressiveness, and e1 (n) is noise-shaped anti-noise signal, ’(n). In some embodiments, a weight update rule is derived by the NAC 320 based on gradient methods. Embodiments of the method can be applied to filtered least mean squared approaches, adaptive feedback, adaptive hybrid approaches and other noise cancellation approaches. In various embodiments, the adaptation is controlled in a way that minimizes noise amplification by defining a cost function optimization and deriving an adaptive algorithm that can achieve it.
[00029] Referring to FIGs. 4A and 4B, embodiments of an adaptive gain (ADG) subsystem 400 are disclosed. In various embodiments, an adaptive gain control block 420 continuously updates a gain element 404 to adjust for variations in the various coupling paths. The inputs to the ADG are conditioned using a programmable filter BQ(Z) (e.g., programmable filter 408 and programmable filter 410), which is designed to protect against low frequency transients and high frequencies distractors in the environment. In some embodiments, the filter BG(Z) may comprise a low pass filter and/or a band pass filter that further filters out very low frequencies (e.g., < 20 Hz that cannot be heard out of a
loudspeaker).
[00030] It will be appreciated that the physical geometries and person-to-person fit variations of the headphone can affect noise cancellation performance. For example, the shape of the outer ear and length of the ear canal can alter the acoustic transfer functions of interest in an ANC application. In some embodiments, an ANC system in a headphone or other personal listening device (e.g., the system of FIG. 1) uses a noise sensing reference microphone, an error microphone, and a DSP sub-system that generates the appropriate anti noise to cancel the noise field as measured by the error microphone. This results in a cancellation zone where the degree of cancellation is maximized at the error microphone location and degrades inversely proportional to the wavelength. As a result, the cancellation performance at the eardrum (which is roughly 25 mm away from the error microphone) drops significantly for higher frequencies (lower wavelengths) leading to loss of cancellation bandwidth as perceived by the user of the noise cancelling system. The embodiments of FIGs. 4A-B address these and other issues by maximizing the cancellation bandwidth at the eardrum during the tuning stage and formulating an adaptive approach that uses the error microphone to adapt to user specific characteristics during operation.
[00031] For the purposes of this disclosure, let the error microphone location be termed as ERP (Error Reference Point) and the ear-drum location be termed as DRP (Drum Reference Point). For ANC systems tuned at the DRP, the error microphone is a good indicator of low frequency cancellation at DRP and hence a robust error correcting signal can be derived from a low-passed version of the error microphone signal. This correcting signal may then be used to adapt a gain in the anti-noise signal path.
[00032] cancellation, an ideal placement of an error microphone would be at
the eardrum, but that location is not practical for many consumer devices. Thus, the ERP is used to provide a practical signal that is roughly indicative of the cancellation performance at the DRP. The adaptive algorithm attempts to minimize the ERP signal which results in (i) diminished cancellation at high frequency signals at the DRP, and (ii) higher possibility of hiss sounding artefacts due to constructive interference of high frequencies at the DRP. In conventional approaches, adaptive algorithms are employed that use the transfer function from ERP to DRP. These approaches have many drawbacks including that the transfer function estimation is inaccurate at high frequencies, low estimation accuracy can affect the broad band cancellation performance and cause transitory hiss levels, high computational costs, and difficulty to tune and calibrate for all use conditions making deployment impractical for many devices. The embodiments of FIGs. 4A-B provide a computationally inexpensive approach that overcomes many of the drawbacks of conventional systems, is easy to tune, for example by measuring certain transfer functions during system design, and is self-calibrating. [00033] FIG 4A illustrates a calibration and tuning arrangement for the adaptive gain subsystem. In this arrangement, the ANC filter 402 is optimized to cancel noise at the DRP during an initial tuning stage. In one embodiment, the device is placed on a head and torso simulator which has a second error microphone at the DRP. PE2D (Z), SE2D (Z) model the ERP to DRP transfer functions in the denoted acoustic paths. The system can then be optimized using least mean squares block 422 to perform ANC tuning to derive an optimum WDRP(z), based on the error signal, e'(n). Tuning in this manner helps achieve extended cancellation bandwidth and better performance in high frequency bands. Second, as illustrated in FIG 4B, the adaptive algorithm is set-up to continuously update a gain element 404, G, that empowers the proposed approach to adjust for variations in the various coupling paths. In some embodiments, the signal is low pass filtered and gain adjusted for good low frequency cancellation. Third, the inputs to the adaptive algorithms are conditioned using a
programmable filter, BG (Z), which is programmed such that the ERP signal can mimic the cancellation performance at DRP. Additionally, BG(z ), can be programmed to optimize performance during low frequency transients and high frequency distractors in the environment.
[00034] It will be appreciated that the embodiments of FIGs. 4A-B are example implementations, and that the approaches disclosed therein can be modified for adaptive versions of feedback, feedforward and hybrid ANC solutions. In some embodiments, instead of adapting a gain element, a purposefully constrained filter element can be adapted. The computed gain can have an additional non-linear processing to further increase the robustness.
[00035] Referring to FIG. 5, embodiments of a transient activity detector (TAD) 500 are illustrated. In operation, the TAD 500 detects changes in the sound environment and causes an update process to be temporarily halted when sudden/intermittent noise activity is detected. As a result, the unwanted adaptation artefacts in the anti-noise signal (e.g., artefacts that might result from rapid adaptation) are minimized. Examples of transient events might include talking by the headset wearer, honking car horns, head movements, and other similar sound events. A separate set of TAD calculations may be performed on the inputs from each microphone in an ANC system (e.g., a total of 4 microphones in a headset including left error microphone, left outside microphone, right error microphone, right outside microphone). Each of the four microphones may be enabled or disabled independently. [00036] An embodiment of transient activity detection processing for a microphone is illustrated in FIG. 5. A detection state machine 514 is used to assert and de-assert the“detect” output. In various embodiments, the detect output will be asserted when the smoothed instantaneous magnitude (output A from the LPF 506) is greater than the scaled average noise magnitude (C in disclosure). After the smoothed instantaneous magnitude A falls below the scaled average noise magnitude C, a release delay counter will cause the detect output to persist for a programmable period of time before being de-asserted.
[00037] In the illustrated embodiment, audio samples 502 from a microphone (e.g., reference microphone or error microphone) are received and fed through an absolute value block 504 followed by a low pass filter 506 to generate the smoothed instantaneous magnitude A. In one embodiment, the output A comprises an average magnitude of the audio samples 502 over a certain period of time and is representative of an instantaneous noise value. The value A is provided to a detect state machine 514, and to a low pass filter 508 with saturation which has an output B representing an average of the A values over a second period of time (i.e., average noise magnitude). A programmable scale factor defines a threshold for detecting transients (e.g., 5 times the average noise magnitude) and is multiplied at component 516 by the average noise magnitude to produce a second input C to the detect state machine 514.
[00038] In one embodiment, if the smoothed instantaneous noise magnitude A is greater than the scaled average noise magnitude C, then the detect state machine 514 is operable to instruct the adaptation processing (e.g., adaptation block 220 of FIG. 2) to stop. In various embodiments, the adaptation will freeze until the instantaneous noise magnitude A is below the scaled average noise magnitude C. Referring to FIG. 2, when the adaptation is stopped, filter 202 and adaptive gain control 204 will continue to modify the noise input x(n) using the most recent weights and gain values. In some embodiments, a programmable release delay counter is operable to maintain the detect output for a programmable period of time before being de-asserted. Further, attack and release component 512 is operable to control how quickly the low pass filter 508 rises and falls in response to the instantaneous noise magnitude A. A programmable attack time constant defines a time it takes for the average noise magnitude to rise when the instantaneous noise is greater than the average noise magnitude B. A programmable release time constant defines a time it takes for the average noise magnitude B to fall when the instantaneous noise magnitude A is lower than the average noise magnitude B. Example Embodiments
[00039] Various embodiments of the present disclosure will now be described. In one or more embodiments, a robust adaptive noise cancellation system comprises a reference sensor operable to sense environmental noise and generate a corresponding reference signal, an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal, a noise cancellation filter operable to receive the reference signal and generate an anti noise signal to cancel the environmental noise in the cancellation zone, an adaptation module operable to receive the reference signal and the error signal and adaptively adjust the antinoise signal, and a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.
[00040] In the robust adaptive noise cancellation system, the transient noise event may include talking by an operator of the adaptive noise cancellation system, and the transient activity detection module may comprise a state machine operable to detect the transient noise event and transmit a state command to the adaptation module. The adaptation module is operable to receive the state command and enable and/or disable the adaptation in accordance therewith.
[00041] In some embodiments of the robust adaptive noise cancellation system, the transient noise event is detected if a smoothed instantaneous magnitude of a received signal is greater than a scaled average noise magnitude of the received signal, and after an end of the transient noise event is detected, a delay is applied before enabling adaptation. The end of the transient noise event may be detected when the smoothed instantaneous magnitude falls below the scaled average noise magnitude. The scaled average noise magnitude may be derived by applying a programmable scale factor to the average noise magnitude.
[00042] In some embodiments of the robust adaptive noise cancellation system, the noise cancellation filter is further operable to generate the anti-noise signal in accordance with stored filter coefficients, and the adaptation module is further operable to modify the stored filter coefficients. The adaptive noise cancellation system further includes a loudspeaker operable to receive the anti-noise signal and generate anti-noise to cancel the noise in a cancellation zone. The adaptation module further comprises a noise amplification control subsystem, and/or an adaptive gain control subsystem.
[00043] In one or more embodiments, a robust active noise cancellation method includes receiving a reference signal from a first sensor, the reference signal representing external noise, processing the reference signal through a noise cancellation filter to generate an anti- noise signal, outputting the anti-noise signal to a loudspeaker, receiving an error signal from a second sensor, the error signal representing noise in a noise cancellation zone, adaptively adjusting the noise cancellation filter in response to the reference signal the, the error signal and a transient noise detection state, and detecting a transient noise event and selectively setting the transient noise detection state to enable and disable, respectively, the adaptively adjusting the noise cancellation.
[00044] In some embodiments of the active noise cancellation method, setting the transient noise detection state comprises transmitting a state command, wherein the adaptively adjusting the noise cancellation filter further comprises receiving the state command and enabling and disabling, respectively, the adaptation in accordance therewith. Detecting the transient noise event may comprise comparing a smoothed instantaneous magnitude of the received signal to a scaled average noise magnitude of the received signal. In some embodiments, after an end of the transient noise event is detected, a delay is applied before enabling adaptation.
[00045] In some embodiments, the transient noise event is detected when the smoothed instantaneous magnitude falls below the scaled average noise magnitude. The scaled average noise magnitude may be derived by applying a programmable scale factor to the average noise magnitude. Adaptively adjusting the noise cancellation filter comprises a noise amplification control process and/or an adaptive gain control process.
[00046] In one or more embodiments, an adaptive noise cancelling system with noise amplification control comprises a reference sensor operable to sense environmental noise and generate a corresponding reference signal, an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal, a noise cancellation filter operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise in the cancellation zone, and an adaptation module operable to receive the reference signal and the error signal and adaptively adjust the anti-noise signal. The adaptation module comprises a noise amplification control module operable to adaptively control noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal.
[00047] In some embodiments of the adaptive noise cancellation system with noise amplification control, the hiss region of the anti-noise signal includes frequency bandwidths in which constructive interference between the environmental noise and the anti-noise signal is detected. The noise amplification control module is operable to define a composite error signal that incorporates a noise-shaping filter and derives new weight update rules for the noise cancellation filter, and/or derive new weight update rules using a least mean squared algorithm. The noise-shaping filter may be adaptively timed during operation, and/or the weight update rules are derived using gradients.
[00048] In some embodiments of the adaptive noise cancellation system with noise amplification control, the noise amplification control adapts a cost function to minimize E{e2(n ) + gE{b ή)} where E{.} is the expectation operator, y is a constant that controls the aggressiveness, and et(n) is noise-shaped anti-noise signal, ’(n). A transient activity detection module may be provided to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event. The noise cancellation filter may be further operable to generate the anti-noise signal in accordance with stored filter coefficients; and wherein the adaptation module is further operable to modify the stored filter coefficients. The system may further comprise a loudspeaker operable to receive the anti-noise signal and generate anti-noise to cancel the noise in a cancellation zone.
[00049] In one or more embodiments, a method for adaptive noise cancelling with noise amplification control comprises receiving a reference signal from a first sensor, the reference signal representing external noise, processing the reference signal through a noise
cancellation filter to generate an anti-noise signal, outputting the anti-noise signal to a loudspeaker, receiving an error signal from an error sensor, the error signal representing noise in a noise cancellation zone, and adaptively adjusting the noise cancellation filter in response to the reference signal, the error signal and a noise amplification control process. The noise amplification control process comprises adaptively controlling noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal.
[00050] In some embodiments of the method for adaptive noise cancelling with noise amplification control the hiss region of the anti-noise signal includes frequency bandwidths in which constructive interference between the environmental noise and the anti-noise signal is detected. The noise amplification control process may further comprise defining a composite error signal that incorporates a noise-shaping filter and deriving new weight update rules for the noise cancellation filter, deriving new weight update rules using a least mean squared algorithm, adaptively tuning the noise-shaping filter during operation, and/or adapting a cost function to minimize E{e2(n ) + gE{b (n)} where E{.} is the expectation operator, y is a constant that controls the aggressiveness, and b (n) is noise-shaped anti-noise signal, y’ ( n ). The weight update rules may be derived using gradients.
[00051] In some embodiments of the method for adaptive noise cancelling with noise amplification control, the method further comprises detecting a transient noise event and selectively setting a transient noise detection state to enable and disable, respectively, the adaptively adjusting the noise cancellation filter, and/or generating the anti-noise signal in accordance with stored filter coefficients.
[00052] In one or more embodiments, an extended bandwidth adaptive noise cancelling system comprises a reference sensor operable to sense environmental noise and generate a corresponding reference signal, an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal, a noise cancellation path comprising a noise cancellation filter and a variable gain component, the noise cancellation path operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise at an eardrum reference point, and an adaptation module operable to receive the reference signal and the error signal and adaptively adjust weights of the noise cancellation filter and/or the variable gain component. The adaptation module may comprise an adaptive gain control block operable to update the variable gain component.
[00053] In some embodiments of the extended bandwidth adaptive noise cancelling system, inputs to the adaptive gain control block are conditioned using programmable filters operable to protect against low frequency transients and/or high frequency distractors in the environmental noise, and/or the programmable filters comprise a low pass filter that filters out high frequencies determined to be in a range that creates constructive interference between the cancellation zone and the eardrum reference point. The programmable filters may comprise a high pass filter that filters out low frequencies determined to be in a range that cannot be heard by a user of the noise cancellation system.
[00054] In some embodiments of the extended bandwidth adaptive noise cancelling system, the adaptation module is tuned to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone. The adaptation module may further comprise a noise amplification control module operable to adaptively control noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal. The hiss region of the anti-noise signal may include frequency bandwidths in which constructive interference between the environmental noise and the anti-noise signal is detected. [00055] In some embodiments, the extended bandwidth adaptive noise cancelling system further comprises a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event. The noise cancellation filter may be further operable to generate the anti-noise signal in accordance with stored filter coefficients; and wherein the adaptation module is further operable to modify the stored filter coefficients. The extended bandwidth adaptive noise cancelling system may further comprise a loudspeaker operable to receive the anti-noise signal and generate anti-noise to cancel the noise in a cancellation zone.
[00056] In one or more embodiments, a method of operating an extended bandwidth adaptive noise cancelling system comprises receiving a reference signal from a first sensor, the reference signal representing external noise, processing the reference signal through a noise cancellation path comprising a noise cancellation filter and a variable gain component, to generate an anti-noise signal, receiving an error signal from a second sensor, the error signal representing noise in a noise cancellation zone, and adaptively adjusting the noise cancellation filter in response to the reference signal the, the error signal and an adaptive gain control process to cancel the external noise at an eardrum reference point.
[00057] In some embodiments, the method of operating an extended bandwidth adaptive noise cancelling system further comprises conditioning inputs to the adaptive gain control process using programmable filters to protect against low frequency transients and/or high frequency distractors in the external noise, wherein the conditioning further comprises low pass filtering out high frequencies determined to be in a range that creates constructive interference between the cancellation zone and the eardrum reference point, and/or wherein the conditioning further comprises high pass filtering out low frequencies determined to be in a range that cannot be heard by a user.
[00058] In one or more embodiments, the method of operating an extended bandwidth adaptive noise cancelling system further comprises tuning the noise cancellation path to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone, and/or through a noise amplification control process, adaptively
controlling noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal. The hiss region of the antinoise signal may include frequency bandwidths in which constructive interference between the external noise and the anti-noise signal is detected.
[00059] In one or more embodiments, the method of operating an extended bandwidth adaptive noise cancelling system further comprises, through a transient activity detection process, receiving the reference signal, detecting a transient noise event and selectively disabling adaptively adjusting the noise cancellation filter during the detected transient noise event. The method may further comprise generating the anti-noise signal in accordance with stored filter coefficients; and adaptively modifying the stored filter coefficients during operation, and/or outputting the anti-noise signal to a loudspeaker to generate anti-noise to cancel the noise in a cancellation zone.
[00060] The foregoing disclosure is not intended to limit the present disclosure to the precise forms or particular fields of use disclosed. As such, it is contemplated that various alternate embodiments and/or modifications to the present disclosure, whether explicitly described or implied herein, are possible in light of the disclosure. Having thus described embodiments of the present disclosure, persons of ordinary skill in the art will recognize that changes may be made in form and detail without departing from the scope of the present disclosure. Thus, the present disclosure is limited only by the claims.

Claims

CLAIMS WHAT IS CLAIMED IS:
1. An adaptive noise cancellation system comprising:
a reference sensor operable to sense environmental noise and generate a
corresponding reference signal;
an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal;
a noise cancellation filter operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise in the cancellation zone;
an adaptation module operable to receive the reference signal and the error signal and adaptively adjust the anti-noise signal; and
a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.
2. The adaptive noise cancellation system of claim 1 wherein the transient noise event includes talking by an operator of the adaptive noise cancellation system.
3. The adaptive noise cancellation system of claim 1 wherein the transient activity detection module comprises a state machine operable to detect the transient noise event and transmit a state command to the adaptation module; and wherein the adaptation module is operable to receive the state command and enable and/or disable the adaptation in accordance therewith.
4. The adaptive noise cancellation system of claim 3 wherein the transient noise event is detected if a smoothed instantaneous magnitude of a received signal is greater than a scaled average noise magnitude of the received signal.
5. The adaptive noise cancellation system of claim 4, wherein after an end of the transient noise event is detected, a delay is applied before enabling adaptation.
6. The adaptive noise cancellation system of claim 5, wherein the end of the transient noise event is detected when the smoothed instantaneous magnitude falls below the scaled average noise magnitude.
7. The adaptive noise cancellation system of claim 6 wherein the scaled average noise magnitude is derived by applying a programmable scale factor to the average noise magnitude.
8. The adaptive noise cancellation system of claim 1 wherein the noise cancellation filter is further operable to generate the anti-noise signal in accordance with stored filter coefficients; and wherein the adaptation module is further operable to modify the stored filter coefficients.
9. The adaptive noise cancellation system of claim 1 further comprising a loudspeaker operable to receive the anti-noise signal and generate anti-noise to cancel the noise in a cancellation zone.
10. The adaptive noise cancellation system of claim 1 wherein the adaptation module further comprises a noise amplification control subsystem.
11. The adaptive noise cancellation system of claim 1 wherein the adaptation module further comprises an adaptive gain control subsystem.
12. A method for active noise cancellation comprising:
receiving a reference signal from a first sensor, the reference signal representing external noise;
processing the reference signal through a noise cancellation filter to generate an antinoise signal;
outputting the anti-noise signal to a loudspeaker;
receiving an error signal from a second sensor, the error signal representing noise in a noise cancellation zone;
adaptively adjusting the noise cancellation filter in response to the reference signal the, the error signal and a transient noise detection state; and
detecting a transient noise event and selectively setting the transient noise detection state to enable and disable, respectively, the adaptively adjusting the noise cancellation.
13. The method of claim 12 wherein the transient noise event includes talking by a user.
14. The method of claim 12 wherein selectively setting the transient noise detection state comprises transmitting a state command; and wherein the adaptively adjusting the noise cancellation filter further comprises receiving the state command and enabling and disabling, respectively, the adaptation in accordance therewith.
15. The method of claim 14 wherein detecting the transient noise event comprises comparing a smoothed instantaneous magnitude of the received signal to a scaled average noise magnitude of the received signal.
16. The method of claim 15, wherein after an end of the transient noise event is detected, a delay is applied before enabling adaptation.
17. The method of claim 16, wherein the transient noise event is detected when the smoothed instantaneous magnitude falls below the scaled average noise magnitude.
18. The method of claim 17 wherein the scaled average noise magnitude is derived by applying a programmable scale factor to the average noise magnitude.
19. The method of claim 12 wherein the adaptively adjusting the noise
cancellation filter comprises a noise amplification control process.
20. The method of claim 12 wherein the adaptively adjusting the noise
cancellation filter comprises an adaptive gain control process.
21. An adaptive noise cancellation system comprising:
a reference sensor operable to sense environmental noise and generate a
corresponding reference signal;
an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal;
a noise cancellation filter operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise in the cancellation zone; and
an adaptation module operable to receive the reference signal and the error signal and adaptively adjust the anti-noise signal;
wherein the adaptation module comprises a noise amplification control module operable to adaptively control noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal.
22. The adaptive noise cancellation system of claim 21, wherein the hiss region of the anti-noise signal includes frequency bandwidths in which constructive interference between the environmental noise and the anti-noise signal is detected.
23. The adaptive noise cancellation system of claim 21, wherein the noise amplification control module is operable to define a composite error signal that incorporates a noise-shaping filter and derives new weight update rules for the noise cancellation filter.
24. The adaptive noise cancellation system of claim 23, wherein the noise amplification control module is operable to derive new weight update rules using a least mean squared algorithm.
25. The adaptive noise cancellation system of claim 23, wherein the noise-shaping filter is adaptively tuned during operation.
26. The adaptive noise cancellation system of claim 23, wherein the weight update rules are derived using gradients.
27. The adaptive noise cancellation system of claim 21 , wherein the noise amplification control adapts a cost function to minimize E{e2(n ) + yE{e2(n)} where E{.} is the expectation operator, y is a constant that controls the aggressiveness, and (n) is noiseshaped anti-noise signal, y’(n).
28. The adaptive noise cancellation system of claim 21 , further comprising a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.
29. The adaptive noise cancellation system of claim 21, wherein the noise cancellation filter is further operable to generate the anti-noise signal in accordance with stored filter coefficients; and wherein the adaptation module is further operable to modify the stored filter coefficients.
30. The adaptive noise cancellation system of claim 21, further comprising a loudspeaker operable to receive the anti-noise signal and generate anti-noise to cancel the noise in a cancellation zone.
31. A method comprising:
receiving a reference signal from a first sensor, the reference signal representing external noise;
processing the reference signal through a noise cancellation filter to generate an antinoise signal;
outputting the anti-noise signal to a loudspeaker;
receiving an error signal from an error sensor, the error signal representing noise in a noise cancellation zone; and
adaptively adjusting the noise cancellation filter in response to the reference signal, the error signal and a noise amplification control process; wherein the noise amplification control process comprises adaptively controlling noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal.
32. The method of claim 31 , wherein the hiss region of the anti-noise signal includes frequency bandwidths in which constructive interference between the environmental noise and the anti-noise signal is detected.
33. The method of claim 31 , wherein the noise amplification control process further comprises defining a composite error signal that incorporates a noise-shaping filter and deriving new weight update rules for the noise cancellation filter.
34. The method of claim 33, wherein the noise amplification control process further comprises deriving new weight update rules using a least mean squared algorithm.
35. The method of claim 33, wherein the noise amplification control process further comprises adaptively tuning the noise-shaping filter during operation.
36. The method of claim 33, wherein the weight update rules are derived using gradients.
37. The method of claim 31 , wherein the noise amplification control process further comprises adapting a cost function to minimize E{e2 n) + yE{e2 (n)} where E{.} is the expectation operator, y is a constant that controls the aggressiveness, and ex{n) is noiseshaped anti-noise signal, g (n).
38. The method of claim 31 , further comprising detecting a transient noise event and selectively setting a transient noise detection state to enable and disable, respectively, the adaptively adjusting the noise cancellation filter.
39. The method of claim 31, further comprising generating the anti-noise signal in accordance with stored filter coefficients.
40. An adaptive noise cancellation system comprising:
a reference sensor operable to sense environmental noise and generate a
corresponding reference signal;
an error sensor operable to sense noise in a noise cancellation zone and generate a corresponding error signal;
a noise cancellation path comprising a noise cancellation filter and a variable gain component, the noise cancellation path operable to receive the reference signal and generate an anti-noise signal to cancel the environmental noise at an eardrum reference point;
an adaptation module operable to receive the reference signal and the error signal and adaptively adjust weights of the noise cancellation filter and/or the variable gain component; wherein the adaptation module comprises an adaptive gain control block operable to update the variable gain component.
41. The adaptive noise cancellation system of claim 40, wherein inputs to the adaptive gain control block are conditioned using programmable filters operable to protect against low frequency transients and/or high frequency distractors in the environmental noise.
42. The adaptive noise cancellation system of claim 41, wherein the
programmable filters comprise a low pass filter that filters out high frequencies determined to be in a range that creates constructive interference between the cancellation zone and the eardrum reference point.
43. The adaptive noise cancellation system of claim 41, wherein the
programmable filters comprise a high pass filter that filters out low frequencies determined to be in a range that cannot be heard by a user of the noise cancellation system.
44. The adaptive noise cancellation system of claim 40, wherein the adaptation module is tuned to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone.
45. The adaptive noise cancellation of claim 40, wherein the adaptation module further comprises a noise amplification control module operable to adaptively control noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal.
46. The adaptive noise cancellation system of claim 45, wherein the hiss region of the anti-noise signal includes frequency bandwidths in which constructive interference between the environmental noise and the anti-noise signal is detected.
47. The adaptive noise cancellation system of claim 40, further comprising a transient activity detection module operable to receive the reference signal, detect a transient noise event and selectively disable the adaptation module during the detected transient noise event.
48. The adaptive noise cancellation system of claim 40, wherein the noise cancellation filter is further operable to generate the anti-noise signal in accordance with stored filter coefficients; and wherein the adaptation module is further operable to modify the stored filter coefficients.
49. The adaptive noise cancellation system of claim 40, further comprising a loudspeaker operable to receive the anti-noise signal and generate anti-noise to cancel the noise in a cancellation zone.
50. A method comprising:
receiving a reference signal from a first sensor, the reference signal representing external noise;
processing the reference signal through a noise cancellation path comprising a noise cancellation filter and a variable gain component, to generate an anti-noise signal;
receiving an error signal from a second sensor, the error signal representing noise in a noise cancellation zone; and
adaptively adjusting the noise cancellation filter in response to the reference signal the, the error signal and an adaptive gain control process to cancel the external noise at an eardrum reference point.
51. The method of claim 50, further comprising conditioning inputs to the adaptive gain control process using programmable filters to protect against low frequency transients and/or high frequency distractors in the external noise.
52. The method of claim 51 , wherein the conditioning further comprises low pass filtering out high frequencies determined to be in a range that creates constructive
interference between the cancellation zone and the eardrum reference point.
53. The method of claim 52, wherein the conditioning further comprises high pass filtering out low frequencies determined to be in a range that cannot be heard by a user.
54. The method of claim 50, further comprising tuning the noise cancellation path to cancel noise at the eardrum reference point, using the error signal sensed in the noise cancellation zone.
55. The method of claim 50, further comprising a noise amplification control process comprising adaptively controlling noise amplification in at least one hiss region of the anti-noise signal, while achieving cancellation in non-hiss regions of the anti-noise signal.
56. The method of claim 55, wherein the hiss region of the anti-noise signal includes frequency bandwidths in which constructive interference between the external noise and the anti-noise signal is detected.
57. The method of claim 50, further comprising a transient activity detection process comprising receiving the reference signal, detecting a transient noise event and selectively disabling adaptively adjusting the noise cancellation filter during the detected transient noise event.
58. The method of claim 50, further comprising generating the anti-noise signal in accordance with stored filter coefficients; and adaptively modifying the stored filter coefficients during operation.
59. The method of claim 50, further comprising outputting the anti-noise signal to a loudspeaker to generate anti-noise to cancel the noise in a cancellation zone.
EP19900182.7A 2018-12-19 2019-12-19 Robust adaptive noise cancelling systems and methods Active EP3899926B1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201862782312P 2018-12-19 2018-12-19
US201862782305P 2018-12-19 2018-12-19
US201862782299P 2018-12-19 2018-12-19
PCT/US2019/067644 WO2020132347A1 (en) 2018-12-19 2019-12-19 Robust adaptive noise cancelling systems and methods

Publications (3)

Publication Number Publication Date
EP3899926A1 true EP3899926A1 (en) 2021-10-27
EP3899926A4 EP3899926A4 (en) 2022-08-24
EP3899926B1 EP3899926B1 (en) 2025-09-10

Family

ID=71101618

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19900182.7A Active EP3899926B1 (en) 2018-12-19 2019-12-19 Robust adaptive noise cancelling systems and methods

Country Status (5)

Country Link
EP (1) EP3899926B1 (en)
JP (4) JP7254935B2 (en)
KR (1) KR102697308B1 (en)
CN (1) CN113196382B (en)
WO (1) WO2020132347A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11917368B2 (en) * 2022-03-11 2024-02-27 Sony Group Corporation Hearing aids providing protection against sudden loud sounds
US12190855B2 (en) * 2022-09-06 2025-01-07 Bose Corporation Active noise reduction with impulse detection and suppression
CN116312545B (en) * 2023-05-26 2023-07-21 北京道大丰长科技有限公司 Speech recognition system and method in noisy environment

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5251262A (en) * 1990-06-29 1993-10-05 Kabushiki Kaisha Toshiba Adaptive active noise cancellation apparatus
US5307405A (en) 1992-09-25 1994-04-26 Qualcomm Incorporated Network echo canceller
JP2929875B2 (en) * 1992-12-21 1999-08-03 日産自動車株式会社 Active noise control device
JP3685503B2 (en) * 1994-03-30 2005-08-17 三洋電機株式会社 Electronic silencer
JPH10294989A (en) * 1997-04-18 1998-11-04 Matsushita Electric Ind Co Ltd Noise control headset
JP2000089770A (en) * 1998-07-16 2000-03-31 Matsushita Electric Ind Co Ltd Noise control device
JP2001142469A (en) * 1999-11-15 2001-05-25 Yanmar Diesel Engine Co Ltd Active muffler
JP2008060759A (en) 2006-08-30 2008-03-13 Audio Technica Corp Noise canceling headphones and their noise canceling method
WO2008029336A1 (en) * 2006-09-06 2008-03-13 Koninklijke Philips Electronics N.V. Active noise reduction system and method using a virtual microphone
JP2008300894A (en) * 2007-05-29 2008-12-11 Smk Corp External specific sound recognition method for headset with microphone and headset with microphone
JP5214340B2 (en) * 2008-06-13 2013-06-19 本田技研工業株式会社 Active vibration and noise control system for vehicles
US8737636B2 (en) 2009-07-10 2014-05-27 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for adaptive active noise cancellation
US8385559B2 (en) * 2009-12-30 2013-02-26 Robert Bosch Gmbh Adaptive digital noise canceller
US8515089B2 (en) * 2010-06-04 2013-08-20 Apple Inc. Active noise cancellation decisions in a portable audio device
EP2395501B1 (en) * 2010-06-14 2015-08-12 Harman Becker Automotive Systems GmbH Adaptive noise control
US9318094B2 (en) * 2011-06-03 2016-04-19 Cirrus Logic, Inc. Adaptive noise canceling architecture for a personal audio device
US8909524B2 (en) 2011-06-07 2014-12-09 Analog Devices, Inc. Adaptive active noise canceling for handset
US9058801B2 (en) 2012-09-09 2015-06-16 Apple Inc. Robust process for managing filter coefficients in adaptive noise canceling systems
JP6413083B2 (en) 2013-01-28 2018-10-31 パナソニックIpマネジメント株式会社 Active noise reduction apparatus, equipment using the same, and active noise reduction method
US9106989B2 (en) * 2013-03-13 2015-08-11 Cirrus Logic, Inc. Adaptive-noise canceling (ANC) effectiveness estimation and correction in a personal audio device
US9578432B1 (en) * 2013-04-24 2017-02-21 Cirrus Logic, Inc. Metric and tool to evaluate secondary path design in adaptive noise cancellation systems
JP6343970B2 (en) 2014-03-07 2018-06-20 パナソニックIpマネジメント株式会社 Signal processing device, program, range hood device
US9319784B2 (en) * 2014-04-14 2016-04-19 Cirrus Logic, Inc. Frequency-shaped noise-based adaptation of secondary path adaptive response in noise-canceling personal audio devices
CN104616667B (en) * 2014-12-02 2017-10-03 清华大学 A kind of active denoising method in automobile
KR102245065B1 (en) * 2015-02-16 2021-04-28 삼성전자주식회사 Active Noise Cancellation in Audio Output Device
US9706288B2 (en) * 2015-03-12 2017-07-11 Apple Inc. Apparatus and method of active noise cancellation in a personal listening device
US9812114B2 (en) * 2016-03-02 2017-11-07 Cirrus Logic, Inc. Systems and methods for controlling adaptive noise control gain
JP6623408B2 (en) 2016-11-04 2019-12-25 株式会社ヤクルト本社 Active silencer and silencing system

Also Published As

Publication number Publication date
JP7282842B2 (en) 2023-05-29
EP3899926B1 (en) 2025-09-10
JP7167273B2 (en) 2022-11-08
JP2022514895A (en) 2022-02-16
WO2020132347A1 (en) 2020-06-25
KR20210092845A (en) 2021-07-26
JP7254935B2 (en) 2023-04-10
EP3899926A4 (en) 2022-08-24
JP2023116465A (en) 2023-08-22
JP2022048107A (en) 2022-03-25
CN113196382A (en) 2021-07-30
JP2022029451A (en) 2022-02-17
CN113196382B (en) 2025-04-22
KR102697308B1 (en) 2024-08-23
JP7539524B2 (en) 2024-08-23

Similar Documents

Publication Publication Date Title
US11887576B2 (en) Ambient detector for dual mode ANC
US11386881B2 (en) Active noise cancelling based on leakage profile
CN111133505B (en) Parallel Active Noise Reduction (ANR) and Cross Listening Signal Flow Path in Acoustic Devices
EP2692145B1 (en) Adaptive feed-forward noise reduction
US20100061564A1 (en) Ambient noise reduction system
JP7539524B2 (en) ROBUST ADAPTIVE NOISE CANCELLING SYSTEM AND METHOD - Patent application
JP2019519819A (en) Mitigation of instability in active noise control systems
CN113728378A (en) Wind noise suppression and method for active noise cancellation systems
CN114450745B (en) Audio system and signal processing method for ear-worn playback device
US11049487B2 (en) Robust adaptive noise cancelling systems and methods
US11039247B2 (en) Extended bandwidth adaptive noise cancelling system and methods
US11763791B2 (en) Noise amplification control in adaptive noise cancelling systems

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210618

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20220726

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 1/10 20060101ALI20220720BHEP

Ipc: G10K 11/178 20060101AFI20220720BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20231222

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20250401

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602019075670

Country of ref document: DE

P01 Opt-out of the competence of the unified patent court (upc) registered

Free format text: CASE NUMBER: UPC_APP_5034_3899926/2025

Effective date: 20250828

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20251229

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251210

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20251226

Year of fee payment: 7

Ref country code: FR

Payment date: 20251226

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251211

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20251210

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1836793

Country of ref document: AT

Kind code of ref document: T

Effective date: 20250910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20251229

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20260110

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20260112

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20250910