WO2010014663A2 - Method for adaptive control and equalization of electroacoustic channels - Google Patents

Method for adaptive control and equalization of electroacoustic channels Download PDF

Info

Publication number
WO2010014663A2
WO2010014663A2 PCT/US2009/052042 US2009052042W WO2010014663A2 WO 2010014663 A2 WO2010014663 A2 WO 2010014663A2 US 2009052042 W US2009052042 W US 2009052042W WO 2010014663 A2 WO2010014663 A2 WO 2010014663A2
Authority
WO
WIPO (PCT)
Prior art keywords
transfer function
filter
filters
audio signal
response
Prior art date
Application number
PCT/US2009/052042
Other languages
French (fr)
Other versions
WO2010014663A9 (en
WO2010014663A3 (en
WO2010014663A8 (en
Inventor
Matthew C. Fellers
Grant A. Davidson
Rongshan Yu
Eric M. Benjamin
Kenneth J. Gundry
Original Assignee
Dolby Laboratories Licensing Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dolby Laboratories Licensing Corporation filed Critical Dolby Laboratories Licensing Corporation
Priority to CN200980130274XA priority Critical patent/CN102113346B/en
Priority to JP2011521265A priority patent/JP5241921B2/en
Priority to EP09790907.1A priority patent/EP2311271B1/en
Priority to US13/056,251 priority patent/US8693699B2/en
Publication of WO2010014663A2 publication Critical patent/WO2010014663A2/en
Publication of WO2010014663A8 publication Critical patent/WO2010014663A8/en
Publication of WO2010014663A3 publication Critical patent/WO2010014663A3/en
Publication of WO2010014663A9 publication Critical patent/WO2010014663A9/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/04Circuits for transducers, loudspeakers or microphones for correcting frequency response
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • G10K11/17813Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the acoustic paths, e.g. estimating, calibrating or testing of transfer functions or cross-terms
    • G10K11/17817Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the acoustic paths, e.g. estimating, calibrating or testing of transfer functions or cross-terms between the output signals and the error signals, i.e. secondary path
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • G10K11/17821Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
    • G10K11/17827Desired external signals, e.g. pass-through audio such as music or speech
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1785Methods, e.g. algorithms; Devices
    • G10K11/17853Methods, e.g. algorithms; Devices of the filter
    • G10K11/17854Methods, e.g. algorithms; Devices of the filter the filter being an adaptive filter
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1785Methods, e.g. algorithms; Devices
    • G10K11/17855Methods, e.g. algorithms; Devices for improving speed or power requirements
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • G10K11/17875General system configurations using an error signal without a reference signal, e.g. pure feedback
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • G10K11/17885General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10Applications
    • G10K2210/108Communication systems, e.g. where useful sound is kept and noise is cancelled
    • G10K2210/1081Earphones, e.g. for telephones, ear protectors or headsets
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3023Estimation of noise, e.g. on error signals
    • G10K2210/30232Transfer functions, e.g. impulse response
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083Reduction of ambient noise
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00Signal processing covered by H04R, not provided for in its groups
    • H04R2430/03Synergistic effects of band splitting and sub-band processing

Definitions

  • aspects of the invention relate to audio signal processing Aspects of the invention include methods for alte ⁇ ng the soundfield in an electroacoustic channel and methods for obtaining a set of filters whose linear combination estimates the impulse response of a time- varying transmission channel Aspects of the invention also include apparatus for performing such methods and computer programs, stored on a computer- medium, for causing a computer to perfo ⁇ n such methods In particular, aspects of the invention are particularly useful for improving the audibility of portable multimedia and communication devices, particularly by reducing the effect of external environmental noise and/or by improving the understandabihty of speech in noisy environments Aspects of the invention are useful generally in any environment for active noise control (ANC) and va ⁇ ous types of equalization (including line enhancement and acoustic echo cancellation)
  • ANC active noise control
  • va ⁇ ous types of equalization including line enhancement and acoustic echo cancellation
  • ANC Active noise control
  • adaptive equalization may be used to reduce the effect of external environmental noise and/or to improve the understandabihty of speech m noisy environments
  • ANC systems detect the disturbing noise signal and then generate a sound wave of equal amplitude and opposite phase, thereby reducing the perceived disturbance level Summary of the Invention
  • a method for alte ⁇ ng the soundfield in an electroacoustic channel in which a first audio signal is applied by a first electromechanical transducer to an acoustic space, causing changes in air pressure in the acoustic space, and a second audio signal is obtained by a second electromechanical transducer in response to changes in air pressure in the acoustic space, comp ⁇ ses (a) establishing, m response to the second audio signal and at least a portion of the first audio signal, a transfer function estimate of the electroacoustic channel, the transfer function estimate being de ⁇ ved from one or a combination of transfer functions selected from a group of transfer functions, the transfer function estimate being adaptive m response to temporal
  • DQ7044WO01 1 variations in the transfer function of the electroacoustic channel and (b) obtaining one or more filters whose transfer function is based on the transfer function estimate and filtering with the one or more filters at least a portion of the first audio signal, which portion of the first audio signal may or may not be the same portion as the first recited portion of the first audio signal
  • the method may further comp ⁇ se implementing the transfer function estimate with one or more of a plurality of time-invariant filters
  • the one or more filters whose transfer function is based on the transfer function estimate may have a transfer function that is an inverted version of the transfer function estimate
  • the transfer function estimate may be adaptive in response to a time average of temporal variations in the transfer function of the electroacoustic channel
  • the one or more of a plurality of time-inva ⁇ ant filters may be HR filters
  • the one or more of a plurality of time-invariant filters may be two filters in cascade, the first filter being an HR filter and the second filter being an FIR filter
  • the one or more filters whose transfer function is based on the transfer function estimate may be HR filters
  • the one or more filters whose transfer function is based on the transfer function estimate may be two filters in cascade, the first filter being an IIR filter and the second filter being an FIR filter
  • the transfer function estimate may be de ⁇ ved from one or a combination of transfer functions selected from a group of transfer functions by employing an error minimization technique
  • the transfer function estimate may be established by cross fading from one to another of the one or combination transfer functions selected from a group of transfer functions by employing an error minimization technique
  • the transfer function may be established by selecting two or more of the transfer functions from the group of transfer functions and forming a weighted linear combination of them based on an error minimization technique
  • the characte ⁇ stics of one or more of the group of transfer functions may include the impulse responses of the electroacoustic channel across a range of va ⁇ ations in impulse responses with time.
  • the impulse responses may be measured impulse responses of real and/or simulated transmission channels
  • the characte ⁇ stics of the group of transfer functions may obtained according to an eigenvector method
  • the group of transfer functions may be obtained by deriving the eigenvectors of the autocorrelation mat ⁇ x of the time-mva ⁇ ant filter characte ⁇ stics.
  • the defined group of time-inva ⁇ ant filter characte ⁇ stics may be obtained by de ⁇ vmg the eigenvectors resulting from performing a singular value
  • D07044WO01 2 decomposition of a rectangular matrix in which the rows of the matrix are a larger group of time-invariant filter characteristics.
  • the first electromechanical transducer may be one of a loudspeaker, an earspeaker, a headphone ear piece, and an ear bud.
  • the second electromechanical transducer is a microphone.
  • the acoustic space may be a small acoustic space at least partially bounded by an over-the-ear or an around-the-ear cup, the degree to which the small acoustic space is enclosed being dependant on the closeness and centering of the ear cup with respect to the ear. Variations in the transfer function of the electroacoustic channel may result from changes in the location of the small acoustical space with respect to the ear.
  • Each estimate of the transfer function of the electroacoustic channel may be an estimate of the channel's magnitude response within a range of frequencies.
  • the acoustic space may also receive an audio disturbance signal.
  • the acoustic space may also receive an audio disturbance and the first audio signal may include (1) an error feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying the first audio signal to the filter based on the estimate of the transfer function of the electroacoustic channel, the difference being filtered by the one or more filters whose transfer function is an inverted version of the transfer function estimate, and (2) a speech and/or music audio signal.
  • aspects of the invention may provide an active noise canceller in which the perceived audio response of the electroacoustic channel reduces or cancels the audio disturbance.
  • the first audio signal may include an audio input signal filtered by a target response filter and by the one or more filters.
  • aspects of the invention may provide an equalizer in which the perceived audio response of the electroacoustic channel emulates the response of the target response filter.
  • the acoustic space may also receive an audio disturbance and the first audio signal may include (1) an error feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying the first audio signal to the estimate of the transfer function of the electroacoustic channel, the difference being filtered by the one or more filters whose transfer function is an inverted version of the transfer function estimate, and (2) a speech and/or music audio signal filtered by a target response filter and also filtered by the one or more filters whose transfer function is an inverted version of the transfer function estimate.
  • aspects of the mvention may provide an active noise canceller in which the perceived audio response of the electroacoustic channel reduces or cancels the audio disturbance and also provides an equalizer in which the perceived audio response of the electroacoustic channel emulates the response of a target response filter
  • the target response filter may have a flat response, in which case the filter may be omitted
  • the target response filter has a diffuse field response or the target response filter characte ⁇ stic may be user- specified
  • the one or more filters whose tiansfer function is an inverted version of the transfer function estimate may comprise a lower-frequency HR filter and an uppei frequency FIR filter in cascade
  • the first audio signal comprises an artificial signal selected to be inaudible
  • the establishing may respond to the second audio signal and at least a portion of the second audio signal as digital audio signals in the frequency domain
  • a method for altering the soundfield in an electroacoustic channel in which a first audio signal is applied by a first electromechanical transducer to an acoustic space, causing changes in air pressure in the acoustic space, and a second audio signal is obtained by a second electromechanical transducer in response to changes in air pressure in the acoustic space compnses (a) establishing, in response to the second audio signal and at least a portion of the first audio signal, a transfer function estimate of the electroacoustic channel for a range of audio frequencies lower than an upper range of audio frequencies, the transfer function estimate being derived from one or a combination of transfer functions selected from a group of transfer functions, the transfer function estimate being adaptive in response to temporal variations m the transfer function of the electroacoustic channel, (b) obtaining one or more filters whose transfer function for the range of audio frequencies lower than an upper range of audio frequencies is based on the transfer function estimate and filtering with the one or more filters at least
  • This aspect of the invention may further comp ⁇ se implementing the transfer function estimate for the range of audio frequencies lower than an upper range of audio frequencies with one or more of a plurality of time-mva ⁇ ant filters
  • the one or more filters whose transfer function for the range of audio frequencies lower than an upper range of audio frequencies may be based on the transfer function estimate have a transfer function that is an inverted version of the transfer function estimate for the range of frequencies
  • the gradient descent minimization process may be responsive to the difference between the second audio signal and an audio signal obtained by applying at least a portion of the first audio signal to the se ⁇ es arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for the range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters having a time-invariant transfer response for a range of frequencies higher than the lower range of frequencies
  • the filter or filters estimating the electroacoustic channel transfer function for the range of audio frequencies lower than an upper range of audio frequencies may be one or more HR filters and the filter or filters having a time-invariant transfer response for a range of frequencies higher than the lower range of frequencies may be one or more FIR filters
  • the acoustic space may also receive an audio disturbance and the first audio signal may include (1) an error feedback signal de ⁇ ved from the difference between the second audio signal and an audio signal obtained by applying the first audio signal to the se ⁇ es arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for the range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters having a time-mva ⁇ ant transfer response for a range of frequencies higher than the lower range of frequencies, the difference being filtered by a series arrangement of (a) the one or more filters whose transfer function for the range of audio frequencies lower than an upper range of audio frequencies is an inverted version of the transfer function estimate and (b) one or more filters whose
  • the acoustic space also receives an audio disturbance and the first audio signal may include (1) an error feedback signal de ⁇ ved from the difference between the second audio signal and an audio signal obtained by applying the first audio signal to the se ⁇ es arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for the range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters .having a time-mva ⁇ ant transfer response for a range of frequencies higher than the lower range of frequencies, the difference being filtered by a se ⁇ es arrangement of (a) the one or more filters whose transfer function for the range of audio
  • DQ7044WO01 5 frequencies lower than an upper range of audio frequencies is an inverted version of the transfer function estimate and (b) one or more filters whose transfer function for a range of frequencies higher than the lower range of frequencies is variably controlled by a gradient descent minimization process, and (2) a speech and/or music audio signal filtered by a target response filter and also filtered by the series arrangement of filters.
  • a method for obtaining a set of filters whose linear combination estimates the impulse response of a time-varying transmission channel comprises (a) obtaining M filter observations, the observations including the impulse responses of the transmission channel across its range of possible variations with time, (b) selecting N of M filters according to an eigenvector method, and (c) determining, in real-time, a linear combination of the N filters that forms an optimal estimate of the transmission channel.
  • the N selected filters may be determined by deriving the eigenvectors of the autocorrelation matrix of the M observations.
  • the N selected filters may be dete ⁇ nined by deriving the eigenvectors resulting from performing a Singular Value Decomposition of a rectangular matrix in which the rows of the matrix are the M observations.
  • a scaling factor for each of the N eigenvector filters may be obtained using a gradient-descent optimization.
  • the gradient-descent optimization may employ an LMS algorithm.
  • the M observations may be measured impulse responses of real or simulated transmission channels.
  • An “electroacoustic channel” may be defined as an acoustic space relative to an ear in which an electromechanical transducer, such as a loudspeaker or earspeaker, causes changes in air pressure in the acoustic space, the electroacoustic channel thus including the electromechanical transducer and the acoustic space between that transducer and a listener's ear drum.
  • an electroacoustic channel may be bounded at least in part by a flexible or rigid ear cup.
  • a further electromechanical transducer such as a microphone, is suitably located within the acoustic space in order to sense changes in air pressure in the acoustic space, thereby allowing the derivation of an estimate of the electroacoustic channel response.
  • an ANC and/or equalizer may adapt itself in response to short-time va ⁇ ations in the transfer function of the electroacoustic channel
  • the effect of this adaptation is to expand the listening "sweet spot"
  • a sweet spot is the region in which the playback device may be physically located while still achieving effective results
  • Example embodiments of the invention provide both ANC and equalization separately or together — equalization may be added to ANC with negligible increase in implementation cost
  • aspects of the invention are applicable, for example, at least to acoustic env ⁇ onments characterized by high compliance transducers and relatively few, widely spaced transducer resonances
  • the transducer when modeled as a linear filter, should result in the model being or approximating a minimum-phase filter
  • the requirement for minimum-phase transducers may be applied to a limited frequency range because ANC is generally most effective for noise signals below 1 5 kHz ANC is particularly well suited for deployment m portable multimedia devices such as earbuds, Bluetooth headsets, portable headphones, and mobile phones, where voice communication and music playback commonly occur under conditions of highly dynamic environmental noise
  • the electroacoustic channels involved may be small (for example, mobile phone pressed against the pinna, earbuds inserted directly into the ear canal, and partially or fully-sealed headphones), implying that the acoustic resonant frequencies are further apart and variable channel resonances can be more readily accounted for m the system Such properties may be exploited in aspects
  • aspects of the invention address a leading cause of low performance in earspeakers ⁇ variability m the transfer function of the electroacoustic channel from the loudspeaker to the ear canal
  • Mobile phone users experience this phenomenon while listening to a far-end talker and, often unconsciously, "optimize” the channel by making mmute adjustments to the position and angle of the phone relative to the ear
  • the transfer function vanes depending on the quality of the acoustic seal between the earcup and the head, the position of the earcup, and specific att ⁇ butes of the listener such as pmna size and shape and whether the listener is wearing eyeglasses
  • an air gap as small as 1 mm may result in a reduction of up to 1 1 dB of low- frequency cancellation of aircraft engine noise
  • D07044WO01 7 Some digital implementations of aspects of the present invention employ, adaptively, one or a linear combination of a plurality of time-mva ⁇ ant IIR (infinite impulse response) filters Such an arrangement is useful, for example, in rapidly tracking changes in the electroacoustic channel Brief Description of the Drawings
  • FIG 1 is a functional block diagram of an example of a feedback-based active noise control processor or processing method according to aspects of the present invention
  • FIG 2 is a functional block diagram of an example of an earspeaker equalizing processor or processing method according to aspects of the present invention
  • FIG 3 is a functional block diagram of an example of a combination feedback-based active noise control and earspeakei equalizing processor or processing method according to aspects of the piesent invention
  • FIG 4 is a hypothetical magnitude versus frequency response showing an example of an injection of a narrowband pilot noise signal in the presence of a wideband disturbance signal
  • FIG 5 is a functional block diagram of an example of a feedback-based active noise control processor or processing method according to aspects of the present invention in which the adaptive analysis operates in the frequency domain rather than the time domain
  • FIG 6 is a functional block diagram of an example of a processor or processing method according to aspects of the present invention m which either or both of the control filtering and plant estimate filtering are factored into two or more filters or filtering functions arranged m cascade
  • FIG 7 is a functional block diagram of an example of an active noise control processor or processing method according to aspects of the present invention in which adaptation based on temporal va ⁇ ations of the plant is combined with a supplemental adaptive filtering designed to optimize the control filter based on characte ⁇ stics of the disturbance signal
  • FIG 8 is a functional block diagram of an example of an active noise control and equalization processor or processing method according to aspects of the present invention m which adaptation based on temporal va ⁇ ations of the plant is combined with a supplemental adaptive filtering designed to optimize the control filter based on characteristics of the disturbance signal
  • FIG 9 is a functional block diagram of an example of an adaptive analysis device or process according to aspects of the present invention m which parameters for a single filter or filtering function are obtained
  • FIG 10 is a functional block diagram of an example of an adaptive analysis device or process according to aspects of the present invention in which parameters for multiple filters or filtering functions are obtained
  • FIG 11 is a functional block diagram of a feedback gradient-descent arrangement for denving an inverted filtering iesponse in response to a filtering response
  • FIG 12 is a functional block diagram of an example of a substantially analog example embodiment of a portion of an active noise control processor (or processor function) and/or equalization processor (or processor function) according to aspects of the pi esent invention
  • FIG 13 is a functional block diagram of a gradient-descent minimization anangement for determining the optimal weighting of a set of set of filters or filtering functions
  • an earspeaker such as a headphone
  • an air gap acoustic leakage
  • the low frequency response may also lowered by an amount proportional to the degree of acoustic leakage
  • This change in the frequency response as a function of acoustic leakage is limited to frequencies below a particular frequency value, wherein this value may be different for different earspeakers
  • the va ⁇ ation in magnitude frequency response above this frequency value may be assumed to vary less as a function of headphone leakage
  • the va ⁇ ation of the magnitude frequency response may be as much as about 15 dB at very low frequencies (about 100 Hz)
  • D07044WO01 yields minimal or shallow notches m the magnitude response so as to prevent resonant peaks that is annoying to the listener or would create potential instabilities m operation
  • Frequencies below about 1 5 kHz may be ideal for electroacoustic channel system identification
  • the frequency range that benefits the greatest from ANC are those frequencies below 1 5 kHz This is because the passive isolation on typical earspeakers are less effective at isolating frequencies with wavelengths longer than 1/3' of a meter, than they are for shorter wavelengths
  • waveforms with wavelengths greater than l/3 ld of a meter are less affected by system latencies m the hardware, it is desirable that one should focus system identification over the range of frequencies that are most important to relevant and effective noise cancellation Because it vanes continuously across a range of magnitude responses, an electroacoustic channel may be modeled as a linear, continuously time-varying filter
  • FIG 1 shows an example of a feedback-based active noise control processor or processing method, with an audio ("speech/music") input, employing aspects of the present invention
  • solid lines indicate audio paths and dotted lines indicate the conveyance of filter defining information, including for example, parameters, to one or more filters
  • Certain components not necessary to the understanding of the example are not shown explicitly in FIG 1, nor are they shown in other exemplary embodiments of aspects of the invention
  • a digital-to-analog converter and suitable amplification is required in order to d ⁇ ve the earspeaker 2 and suitable amplification along with an analog-to-digital converter is required at the output of the microphone 4
  • a like or corresponding device or function is assigned the same reference numeral
  • An ANC processor or processing method seeks to alter the perceived audio output of an electroacoustic channel G m such a way as to reduce the audibility of an environmental disturbance sound
  • Such sounds may be any of a variety of sources including, for example, human speakers, airplane engines, room noise, street noise, acoustic echoes, etc
  • a first audio signal is applied to a first electromechanical transducer, such as an earspeaker 2 (shown symbolically), that causes changes in air pressure in an acoustic space, for example, a small acoustic space close to an ear (ear not shown)
  • the acoustic space also has a second electromechanical transducer, such as a microphone 4 (shown symbolically), that responds to changes in air pressure in the acoustic space and
  • DQ7Q44WO01 10 produces a microphone signal e
  • the acoustic space also undergoes changes in air pressure resulting from an environmental sound disturbance d
  • the electroacoustic response between the earspeaker 2 and the microphone 4 may be represented as an electromechanical filter G, which mathematically models the ratio of the microphone output to the earspeaker input This model is known m the art as the ' plant "
  • an estimate of the plant model G may be implemented as one or more filters or filter functions, and is shown as a plant estimating function or device ("Plant Estimate Filtering, G' ")
  • a path containing Plant Estimate Filtering G' is often referred to in the literature as the secondary path
  • the feedback path signal x is applied to one or more filters or filtering functions ("Control Filtering, W"), the filtering characteristics of which, in one exemplary embodiment of the invention, are substantially the inverse of the Plant Estimate Filtering G', to produce a disturbance- canceling antiphase signal x' that is summed in an
  • An adaptive analyzer or adaptive analysis function (“Adaptive Analysis") 12 receives the speech and/or music audio signal directly as one input and the microphone 4 signal as another input Ideally, one would like for the right-hand (“Microphone”) input to the
  • Adaptive Analysis 12 to be an acoustic-space-processed version of its left-hand (“Signal") input so that the Adaptive Analysis 12 input signals differ only by the condition of the plant G (this avoids a bias in obtaining the plant estimate G' filtering)
  • that may be accomplished by providing a path parallel to Adaptive Analysis 12 having another instance, a copy, of the plant estimating function or device ("Copy of Plant Estimate Filtering, G'") and adding its output "V” in an additive combiner 14 to the output of combiner 6
  • the secondary path G' output subtracts from the V path G' output, effectively leaving the microphone output of the acoustic space as the input to the ⁇ ght hand side of the Analysis
  • the left-hand Signal Input of the Adaptive Analysis 12 represents a known signal, while the right-hand Microphone Input ideally contains only the known signal processed by the plant
  • the Microphone signal e contains the music signal filtered by the unknown plant G
  • environmental noise is acquired by the microphone in addition to sound from the earspeaker
  • the environmental noise is considered to be measurement noise from the point of view of performing system identification on the plant
  • the Adaptive Analysis 12 selects a filter that best models the current state of the plant Because the measurement noise is typically uncorrelated with the speech/music signal in Adaptive Analysis 12, it does not effect the optimal filter selection Alternate means for generating the left-hand and ⁇ ght-hand inputs of Adaptive
  • the left-hand input signal can be derived from the plant input signal
  • the ⁇ ght-hand signal can be derived from an estimate of the acoustic-space-processed music signal (the Microphone signal e)
  • the Adaptive Analysis 12 generates filtering parameters that, when applied to the Plant Estimate Filtering, G' and the Copy of Plant Estimate Filtering, G' , result in one or more filters, respectively, that estimate the transfer function of the electro acoustic channel G
  • the transfer function estimate G' may be implemented by one or more of a plurality of time-invariant filters, the transfer function estimate G' being adaptive in response to va ⁇ ations in the transfer function G of the electroacoustic channel
  • Adaptive Analysis 12 may have one of several modes of operation There is a mapping from the filter characteristics determined by Adaptive Analysis 12 and the filterings G' and W
  • the arrangement of the FIG 1 ANC example is intended to provide a perceived audio response of the electroacoustic channel G such that the speech and/or music is heard while minimizing the audibility of the disturbance Ideally, the antiphase signal x' acoustically cancels the disturbance signal d while not affecting the speech and/or music signal This may be accomplished by minimizing the gam H from the disturbance D to the microphone 4 Minimizing the gain H from the disturbance D to the microphone 4 minimizes the energy transfer from the disturbance D to the error output E
  • the plant estimate G' may be modeled as a minimum phase filtei in cascade with a delay In piactice, the delay is approximately 3 to 4 samples at a sampling fiequency of 48 kHz due to acoustic and speaker excitation latencies associated with G But this delay may be factored out when measuring G and the resultant filter, by design, iepiesents a transducer that is minimum phase
  • W is optimal with respect to plant variation
  • Inverse filtering characte ⁇ stics are obtained in any suitable way by a filter inverting device or function (“Inversion") 16
  • Inversion 16 may calculate the inversion (particularly if the filtering is a single filter), employ a lookup table, or determine the inversion in a side process or off-line by, for example, a gradient-descent method
  • a gradient-descent method An example of such an out-of-circuit method is described below in connection with the example of FIG 11
  • a music or speech signal is summed with the antiphase signal at the output of Control Filtering, W
  • the speech/music signal is removed from the feedback path by the G' path, leaving only the disturbance as a component in the antiphase signal
  • the effectiveness of such signal removal is dependent on the closeness of the match between G and G'
  • aspects of the present invention also envision the adaptive pre-filtermg of audio signals to compensate for physical att ⁇ butes of an electroacoustic channel - m other words, to provide equalization
  • a p ⁇ mary cont ⁇ butor to the magnitude response of the electroacoustic channel is imparted by the earspeaker
  • the electroacoustic channel d ⁇ ver affects the magnitude response of the electroacoustic channel
  • a pre-fllter allows the desired audio signal to compensate, within reasonable distortion limits, characte ⁇ stics of the electroacoustic channel
  • a desired magnitude response may be imparted upon the resultant acoustic presentation at the ear based on, for example: (1) simulation of the diffuse field response such as that described in ISO
  • DQ7044WO01 13 454 (see reference 13, above), (2) user-specified equalization settings, or (3) a flat magnitude response
  • a diffuse field response imparts a head shadowing effect to coarsely simulate the experience of listening to music in a room
  • a flat response may be desirable for certain types of recordings such as binaural recordings where the spatial presentation has a prion been applied to the content under audition
  • the desired response of the electroacoustic channel may be specified according to a usage model, and need not have a flat magnitude response
  • the desired response may be static (time-mvariant) or dynamic (time-va ⁇ ant)
  • FIG 2 shows an example of an earspeaker equalizing processoi oi piocessing method with an audio ("speech/music") input employing aspects of the present invention
  • the audio input is applied to a target response filter or filtering process ("Target Response Filtering, S")
  • the target response filtering characteristic S may be static or dynamic
  • In se ⁇ es with filtering S is an inverse plant filter or filtering process (Inverse Plant Filtering, W”) so as to apply a version of the audio input filtered by the series combination of filtering chaiacte ⁇ sites S and W to the earspeaker 2
  • an electroacoustic channel G receives an input from earspeaker 2 and provides an output from microphone 4
  • the earspeaker 2 input and the microphone 4 output are each applied as respective inputs to Adaptive Analysis 12 that generates parameters for one or more filters or filtering functions that estimate the plant response G
  • An inverter or inversion process (“Inversion") 16 inverts the Plant Estimate Filtering G' characteristics in
  • the optimal equalizer may be characte ⁇ zed as the ratio of the desired response to that of the electroacoustic channel response
  • the perceived output heard through the se ⁇ es combination of the S, W and G transfer characteristics is the S characte ⁇ stic S should be limited according to the capabilities of the audio playback system to avoid distortion and non-lmea ⁇ ties when the earspeaker is m a non-optimal position (which may require an alteration in bass response)
  • FIG 3 shows an example of a combination feedback-based ANC and earspeaker equalizing processor or processing method employing aspects of the invention
  • the example of FIG 3 adds equalization to the ANC example of FIG 1
  • m order to provide equalization in addition to ANC the S-filtered speech/music signal is applied to the Control Filtering W
  • the Control Filtering W This requires inserting a copy of the control filtering W in the left-hand input path to Adaptive Analysis 12 and in the "V" path
  • the control filtering W ideally is the inverse of the electro acoustic channel (up to a reasonable working frequency, and withm the constraints of the audio playback system), there is no need for a filter W nor for a filter G' in the secondary path, because the convolution of the control filter W with respect to the estimate of the electroacoustic channel results in a uniform delay ("N-sample delay”) 18
  • the ANC/EQ example of FIG 3 provides for applying the speech/music signal through a desired target response filtering S ("Target Response Filtering, S"), which may be a flat response, in which case the target response filtering is unity If S is unity, W m cascade with the plant G, theoretically results in a flat response Inversion 16 in FIG 3 inverts the Plant Estimate Filtering G' m any suitable manner, such as the alternatives mentioned in connection with the description of the FIG 1 example
  • the Adaptive Analysis 12 may be implemented as desc ⁇ bed below, by taking its inputs from the speech/music signal and the microphone signal
  • the additive combiner 10 is located before rather than after the Control Filtering W in order that it affects the S filtered speech/music signal (as in the FIG 2 example)
  • a requirement of processors or processing methods in accordance with the examples of FIGS 1 and 3 is that in order to adapt the secondary path filter G', a speech or music signal needs to be present
  • a speech or music signal needs to be present
  • the threshold for example, being chosen such that the signal -to-noise ratio (SNR) permits the Adaptive Analysis 12 to make a sufficiently accurate identification of the plant
  • SNR signal -to-noise ratio
  • An alternate solution is to inject a signal at the Adaptive Analysis 12 Input Signal that is inaudible to the listener but is recognizable by the system, even when the injected signal is below the level of the environmental noise (disturbance)
  • Such a pilot narrowband noise may be varied m bandwidth, center frequency, and/or intensity
  • Such parameters may be va ⁇ able over time and be selected so as to optimize the masking of this signal according to psychoacoustic principles For example, such parameters may be selected on-line in order to keep the level
  • Adaptive Analysis 12 has a prion information of the injected pilot tone (the Input Signal)
  • the Microphone Signal may be narrowband filtered to consider only frequencies coincident with the frequencies of the pilot narrowband noise
  • the pilot noise may be injected even when speech or music is present This may improve the accuracy of the Adaptive Analysis 12 for instances when the log SNR between the music and the disturbance is negative
  • the processor or processing method examples of FIGS 1, 2 and 3 may be implemented principally in the digital or analog domains
  • the processor or processing method example of FIG 5 operates principally in the digital domain It differs from the example of FIG 1 mamly m that in a digital implementation of FIG 1, the Adaptive Analysis 12 operates in the frequency domain rather than the time domain Forward transforms 18 and 20, respectively, such as Discrete Fou ⁇ er Transforms (DFT) or other suitable transforms, are applied to the Adaptive Analysis 12 inputs
  • DFT Discrete Fou ⁇ er Transforms
  • the magnitude of the complex coefficients over the frequencies of most interest (10 Hz to 500 Hz, for example) are used by the Adaptive Analysis 12 to compute the error energy
  • the Forward transform may be eliminated if the source audio is already in a frequency-domain representation and if the ANC system is implemented m conjunction with an upstream frequency-domam processor
  • Such upstream frequency-domam processors may be an audio coding system decoder (which include, but is not limited to MPEG-4 A
  • FIG 6 shows aspects of the present invention in which either or both of the control filtering and plant estimate filtering are factored into two or more filters or filtering functions arranged in cascade Depending on the particular electroacoustic channel in use, it may be that within a certain frequency range, the magnitude and phase response va ⁇ ations are small so that a single filter models the earspeaker response with sufficient accuracy For example, frequencies above 1 5 kHz may vary by less than 6 dB in the worst case, and by less than 3 dB in the average case If the
  • Inversion 16 may implement the Low-Order IIR Control filter by swapping the feedforward coefficients (the zeros) with the feedback coefficients (the poles) The equation for the upper frequency control filter may then be derived from the target control filtering and the lower- frequency IIR filter as follows
  • the lower-frequency filter may be a low-order IIR filter
  • the upper frequency may be implemented as either an FIR or IIR filter of appropriate length to model the higher-frequency features of the earspeaker
  • Other exemplary embodiments are possible with varying combinations of filter-types (FIR or IIR), adaptive versus static, number of filter stages, or even parallel rather than series configurations
  • FIR or IIR filter-types
  • the product of W G may be constrained to be open-loop stable through an offline design of W, then the product of Wii R W UF G is also stable
  • the length of the adaptive filter N for WU F may be reduced because W LF IS canceling frequencies with wavelengths longer than N
  • a short N improves the response of the system because the N is directly proportional to the convergence time
  • the upper- frequency filters G UF and W UF may be static or adaptive If adaptive, they may switch between optimal filter coefficients based on the system identification from the Adaptive Analysis 12 Alternatively, they may be independently adaptive, entirely separate from the Adaptive Analysis, whereby a gradient-descent algorithm such as the LMS may be employed to converge to optimal upper- frequency filter coefficients Either or both the control and the secondary path upper-frequency filters, G UF and/or WU F , may be adaptive.
  • a gradient-descent algorithm such as the LMS may be employed to converge to optimal upper- frequency filter coefficients
  • G UF and/or WU F may be adaptive
  • the employment of Factored filters is also applicable to the frequency-domam example of FIG 5
  • FIG 7 shows another example of a processor or processing method in accordance with aspects of the present invention
  • This example combines adaptation based on temporal va ⁇ ations of the plant with a supplemental adaptive filtering designed to optimize the control filter based on characte ⁇ stics of the disturbance signal
  • a supplemental adaptive filtering may be based on the well-known FX-LMS algo ⁇ thm
  • a controller may implement an LMS algorithm or a va ⁇ ant of the LMS algo ⁇ thm, such as the Normalized LMS, in order
  • w is the FIR filter coefficient vector
  • N is the length of the control filter WU F
  • x is a vectorized input array read from the feedback path and filtered by the plant model G'
  • is the step size that is chosen to best balance stability against convergence speed
  • the Upper Frequency Control Filter which is static, is replaced by an adaptive Upper Frequency Control filter WU F in which the filter coefficients are w, and an LMS Updating device or function 20 implements the LMS update equation
  • the x input to the LMS update Module is derived from the feedback path, which, in accordance with the FX-LMS algorithm, is filtered by the plant model G'
  • the LMS Updating 20 also needs access to the microphone signal
  • This microphone signal contains the speech/music signal filtered by the plant, which would bias the convergence of w to a suboptimal filter Therefore, it is necessary to remove the speech/music signal from the error update path e, which is shown as the additive combination 22 into e before it enters the LMS Updating 20
  • speech/music signal must be filtered by the plant estimate G' because the speech/signal in the error signal has been filtered by the plant G
  • the example of FIG 7 employs 1) the combination of the well known FX-LMS system to optimize the control filter based on characte ⁇ stics of the distuibance with Adaptive Analysis 12 to optimize the system based on changes in the plant, and 2) the Upper Frequency Control Filter W UF m se ⁇ es with the Lower Frequency Control Filter W LF , which uses coefficients de ⁇ ved from the Adaptive Analysis 12
  • the lower frequency control filter when implemented by an HR filter, is most effective at modeling the plant at low frequencies (below 1 5 kHz) due to the long time response of an HR filter This improves the degree of noise reduction at low frequencies, which dominate most environmental signal disturbances
  • the upper frequency control filter is also capable of correcting mismatches between the plant and plant model This form of dual-adaptation is advantageous
  • D07044WO01 18 compared to a single-adaptation method based solely on FX-LMS To compensate for plant response changes at very low frequencies (100 Hz), a single-adaptation system would require a larger number of adaptive filter taps than a dual-adaptation system This leads to higher computational complexity and longer adaptive filter convergence times compared to a system based on a combination of switched-adaptive filters (such as HR filters) and FX-LMS filters
  • FIG 8 shows a hybrid processor or processing method arrangement similar to the example of FIG 7, but also piovidmg adaptive equalization, although with differences from the equalizer examples of FIGS 3 and 6
  • a suitable method for applying the equalizing filter W LF to the speech/music signal is to present a new copy of W LF m cascade with the Target Response filter Variations on where W LF IS positioned m the system are possible, such as commuting the filter to locations after either the first or second speech/music branches
  • FIGS 9 and 10 show two examples of an Adaptive Analysis 12 such as that which may be employed in the processor or processing method examples of FIGS 1 -3 and 5-8
  • the Adaptive Analysis 12 is effectively in parallel with the electroacoustic channel (plant) G
  • the optimal filter or filters are selected by computing a measure of similarity between the filter transfer function and that of the electroacoustic channel, at least at low frequencies (for example, below about 1 5 kHz)
  • any constrained frequency range may be employed provided that it yields accurate system identification
  • the Adaptive Analysis 12 may operate by reference to a bank of parallel filters that represent G' for different va ⁇ ations of the plant Each of these filters may represent, for example, a unique positioning of a headphone earpiece on a dummy head that may be used for measuring the impulse response of G in a particular position Because the parallel filters only need to modify the signal at low frequencies, and because the response of electroacoustic channels varies relatively slowly across frequency, they may be implemented at very low computational cost using low to moderate-order filters For a digital implementation, the mean-squared error between the output of each of the filters and the microphone error signal may be used to identify which of the filters best matches the plant G For an analog implementation, comparators and logic circuitry may be used to select an optimal filter, as is descnbed further below in connection with FIG 12
  • DQ7044WO01 19 In the course of implementing an ANC system such as in any of the examples above, a designer may quantify the impulse response of the acoustic path at different headphone positions in order to determine limits imposable upon the adaptive algorithm during real-time operation. Because this quantification may be conducted for a known earspeaker electroacoustic path, the electroacoustic parameters of the path may be fully specified before measurement.
  • the Adaptive Analysis 12 chooses N filters. From these N filters, one filter K is chosen and its index may be provided as the Analysis output.
  • one filter out of a possible N is selected based on a minimum mean- square error criterion.
  • the N filters are connected in a parallel arrangement, producing in a bank of filters or filtering functions ("N Parallel Filters") 24 in which each filter processes the same bandpassed version of the Input Signal.
  • a controller or controlling function (“Control") 26 selects the k th filter, depending on which of the N filters returns the minimum time- averaged mean-squared error.
  • Adaptive Analysis 12 receives an Input Signal (corresponding to the left-hand input to Analysis 12 in FIGS. 1-3 and 5-8) and a Microphone Signal (corresponding to the right-hand input to Analysis 12 in FIGS. 1-3 and 5-8).
  • the Input Signal and Microphone Signal are applied via substantially identical bandpass filters 24 and 30. Their passbands include the largest variation across the different observations M. Both the Input Signal and the Microphone Signal are digital audio samples in this example.
  • Control 2626 selects one optimal filter and produces as its output the Kth index for identifying the selected filter K.
  • a mapper or mapping function (“Mapping") 34 may map the index to a corresponding set of filter parameters.
  • the inputs to Control 26 are the outputs of subtractive combiners 32-0 through 32-(N-I) that subtract the bandpass-filtered Microphone Signal from each of the N- filtered bandpass-filtered Input Signals, each producing an error signal, the magnitude of which is smallest for the filter N that most closely approximates the response of the plant G (see FIGS. 1-3 and 5-8).
  • Control 26 selects the filter having the closest approximation to the plant G and outputs the index K of that filter.
  • Averaging may be implemented using a simple pole-zero smoothing filter.
  • f s 50 kHz
  • Inversion 16 may be applied by pre-computing and storing an inverse filter corresponding to each of the N filters. It is possible to crossfade from one set of filter coefficients for G' to another nearby set (in te ⁇ ns of the relative distance between the poles and zeros).
  • the Adaptive Analysis 12 chooses N filters. From these N filters, a smaller set of K filters and their relative weights may be identified so that K filter parameters and K weighting parameters may be provided as the Analysis output.
  • Each filter, of the set of N filters is implemented in a parallel configuration in a bank of filters or filtering functions ("N Parallel Filters") 24, in which each filter operates on the same bandpassed version of the Input Signal.
  • N Parallel Filters filtering functions
  • Adaptive Analysis 12 receives an Input Signal (corresponding to the left-hand input to Analysis 12 in FIGS. 1-3 and 5-8) and a Microphone Signal (corresponding to the right-hand input to Analysis 12 in FIGS. 1-3 and 5-8).
  • the Input Signal and Microphone Signal are applied via substantially identical bandpass filters 24 and 30. Their passbands may include the largest variation across the different observations M. Both the Input Signal and the Microphone Signal are digital audio samples.
  • K is the set of all possible filters
  • N is the subset of filters to test m parallel to determine the K filters
  • K is the bank of parallel filters for which K sets of filter coefficients and K weighting parameters are passed to Plant Estimate Filtering and, after inversion, to Control Filtering (or Inverse Plant Filtering), as desc ⁇ bed above in connection with the examples of FIGS 1-3 and 5-8
  • the inputs to Control 26 are the outputs of subtractive combiners 32-0 through 32-(N-I ) that subtract the bandpass-filtered Microphone Signal from each of the N-filtered bandpass-filtered Input Signal, each producing an error signal
  • Control 26 selects weightings of the filteis having the closest appi oximation to the plant G and outputs the filter parameters of that filter
  • Various ways of choosing a plurality of weighted filters are described below When K> 1 , the Plant Estimate Filtering in the various exemplary embodiments may be implemented by a bank of K parallel filters or filtering functions, each having a weighting coefficient In accordance with aspects of the pies
  • a computationally-efficient variation on the multiple-filter method is to restrict the search to a subset of the total number of filters M This is accomplished by assigning filter indices so that filters with similar transfer functions have indices that are adjacent to each other, and then rest ⁇ cting the search to the N filters neighboring the current filter having minimum mean-square error Tracking is enabled in the Control 26 by monitoring the averaged relative mean-square error of the filter with the middle index compared to its neighbors If, over time, the minimum error begins to move toward one of the endpomts of the set of N filters until finally a new minimum is detected, the indices of all N filters are adjusted so that the filter with the middle index continues to have the minimum mean-square error out of the set of N filters.
  • Adaptive Analysis 12 Another alternative of the Adaptive Analysis 12 is for it to operate in the frequency domain rather than the time domain as m the example of FIG 5 In that case, a mean-square error analysis may be applied to the power spectral density (PSD) coefficients of both inputs to the Adaptive Analysis 12 Any time-to-frequency transform or subband filterbank may be
  • DQ7Q44WO01 22 used to perform the transformation. This would allow a large number of spectral estimation techniques to be used to improve separation of the signal (the music or speech signal played through the transducer) from the noise (the disturbance).
  • One useful technique is to smooth the PSD coefficients over time, in the manner of a standard periodogram analysis, to assure that any bias in the power approaches zero over time.
  • other spectrum estimation techniques such as the "multitaper" method may be used. This approach would also result in no significant increase in computational complexity because time-domain FIR bandpass filters (described below) in the Adaptive Analysis 12 are eliminated. Instead, the same result may be obtained by limiting the range over which the least-squares calculation is performed on the PSD coefficients.
  • the actual forward transform has complexity on the order of Mlog(M) (where M is the number of frequency-domain coefficients) operations but this is still less than the order (N 2 ) complexity of the time-domain bandlimiting filters.
  • the N selected filters are computed offline for a given set of M observations.
  • the N-of-M Selection is not implemented in real-time because the N filters have already been computed off-line.
  • the N selected filters are the eigenvectors of the autocorrelation matrix of the M observations.
  • the M observations form the rows of a rectangular matrix and a Singular Value Decomposition of this rectangular matrix yield the eigenvector filters.
  • Such an eigenvector filter method has the advantage that for a large value of M, (i.e., a large number of observations), a smaller number of fixed filters N may be linearly combined to form an optimal energy-minimizing filter.
  • the Inversion device or function 16 in the examples of FIGS 1-3 and 5-8 aims to derive a spectral inverse filter that, when applied to the control filter and analyzed m se ⁇ es with the plant response, results in a flat frequency response with no spectial components greater than 0 dB
  • a spectral inverse filter that, when applied to the control filter and analyzed m se ⁇ es with the plant response, results in a flat frequency response with no spectial components greater than 0 dB
  • the Switched Minimum Error method if the filter selected m the Adaptive Analysis 12 is minimum phase (excluding any delay) then there is a 1 -to-l mapping of each filter m M to a corresponding spectral inverse filter, which may be read from a table, or computed directly as the inverse of G'
  • the inverse filter coefficients is computed other than by filter inversion
  • the out- of-cncuit network of FIG 11 may be employed as the Inversion 16
  • a disadvantage of this method is
  • a feedback LMS arrangement for deriving the inverted response W based on the plant estimate response G'
  • a noise signal d(n) is applied to the input
  • a first path sums the input at a subtractive combiner 60 with the output of a feedback arrangement
  • the feedback arrangement compares the overall output from combiner 36 with a G' Copy filtered version of the noise signal d(n), and applies a suitable gradient-descent type algorithm, such as an LMS algorithm, in order to control filtering W such that it is an inversion of G' Copy
  • a delayed version of W convolved with G' Copy is unity, which results in the error output e(n) of combiner 60 being zero
  • FIG 12 presents an example of aspects of the invention based on analog technology
  • a microphone 4 gives a single-frequency estimate of the low- frequency response of the electroacoustic channel G, and a filter is selected from a filter bank 38 that gives the closest response to a desired response
  • the output of microphone 4 is applied to a bandpass filter 30, followed, in series, by an averager or averaging function ("Mic Avg") 40
  • the Mic Avg 24 output is applied to an input of each of three comparators or comparator functions Cl, C2 and C3
  • the speech/music input audio signal is applied to a static filter or filtering function ("Static Filter”) 42, followed, in se ⁇ es, by a bandpass filter 24 and an averager or averaging function
  • Audio Avg 44 The Audio Avg 44 output is applied to an input of each of three comparators or comparator functions Cl, C2 and C3.
  • the Bandpass Filters 24 and 30 isolate a narrow band of frequencies at which the average reproduced level at low frequencies is compared with the average level in the audio program.
  • Comparators Cl, C2, and C3 have different offsets in order to give different thresholds for the decision as to which filter (1, 2, 3, 4) should be selected.
  • the comparators may be implemented with hysteresis in order to eliminate jittering between the outputs of the various filters.
  • Control 26 selects the filter 20 having the least squared error.
  • Another way to reduce latency is to implement the feedback path in the example of FIG. 3 with a 1-bit delta- sigma-sampled digital signal processing arrangement.
  • Such 1-bit delta-sigma-modulated sampling system may sample audio at a sampling frequency as high as 64 times the base audio sampling rate. Doing so provides an updating of the anti-phase signal at a very high rate, which reduces system latency incurred by sampling the signal using traditional multi-bit sampling methods, sampled at the standard audio sample rate.
  • a 1 -bit delta-sigma A/D converter at combiner 6 in FIG. 3 and a 1 -bit delta-sigma D/A converter at the loudspeaker 2 in FIG. 3 would be required.
  • control filter W and secondary path filter G' would apply multi-bit filter coefficients to the 1-bit intermediate-filter-state values, which would result in a multi-bit output at the filter outputs.
  • the multi-bit output values from each filter would then be transformed back to 1 -bit values through the incorporation of a delta- sigma modulator.
  • Other combinations of filters and delta-sigma modulators are possible, such as performing a single multi-bit to delta-sigma modulator conversion immediately before the 1-bit delta-sigma D/A converter.
  • the speech and/or music audio signal may need to be modulated from a multi-bit to a 1-bit delta- sigma representation at the summation 10.
  • measuring the change in electroacoustic channel response at a single frequency has a problem in that the variation in the range of sensitivities of an earspeaker and of a microphone is each almost as great as the variation in response associated with changes in the acoustical loading conditions.
  • the assumption is that the gain in the middle of the band defined by the bandpass filters should be substantially equal in both the 'mic AVG' and 'audio AVG' signal paths.
  • a way to compensate variations in the sensitivities of the microphone and earspeaker should be provided.
  • D07044WO01 25 Another alternative example that embodies aspects of the present invention is a hybrid digital/analog exemplary embodiment in which the Adaptive Analysis 12 operates on digital samples of both the speech/music signal and the microphone signal, but then applies analog filter parameters (shown as Filter 1 through Filter 4 in the example of FIG. 12) to analog implementations of the control filtering W and the plant estimate filtering G'.
  • analog filter parameters shown as Filter 1 through Filter 4 in the example of FIG. 12
  • the eigenvector filter coefficients may be stored in a suitable non-volatile computer memory.
  • w D (w i , ..., w N ) is a real vector that minimizes p — C r w for given p and C .
  • c are orthonormal vectors, i.e.,
  • X 1 , i- ⁇ ,...,N are the N largest scalars that satisfy the above equations.
  • the actual number of the base filter N can be decided either by complexity constraints, or quality constraints, e.g., the sum of the remaining eigenvalues
  • the HR base filters can be designed from C 1 (z) , .. . , C N (Z) by using, e.g., a suitable error minimizing process such as a least-square-fit algorithm.
  • the optimal weighting W that provides the least square fit for a given unknown electroacoustic channel may be obtained by using a gradient-descent minimization process such as an LMS algorithm.
  • a gradient-descent minimization process such as an LMS algorithm.
  • the invention may be implemented in hardware or software, or a combination of both (e g , programmable logic arrays). Unless otherwise specified, algorithms and processes included as part of the invention are not inherently related to any particular computer or other apparatus. In particular, various general-purpose machines may be used with programs written in accordance with the teachings herein, or it may be more convenient to construct more specialized apparatus (e g , integrated circuits) to perform the required method steps. Thus, the invention may be implemented m one or more computer programs executing on one or more programmable computer systems each comprising at least one processor, at least one data storage system (including volatile and non-volatile memory and/or storage elements), at least one input device or port, and at least one output device or port.
  • Program code is applied to input data to perform the functions described herein and generate output information.
  • the output information is applied to one or more output devices, in known fashion.
  • Each such program may be implemented in any desired computer language (including machine, assembly, or high level procedural, logical, or object oriented programming
  • D07044WO01 28 languages to communicate with a computer system.
  • the language may be a compiled or interpreted language.
  • Each such computer program may be stored on or downloaded to a storage media or device (e.g., solid state memory or media, or magnetic or optical media) readable by a general or special purpose programmable computer, for configuring and operating the computer when the storage media or device is read by the computer system to perform the procedures described herein.
  • a storage media or device e.g., solid state memory or media, or magnetic or optical media
  • the inventive system may also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer system to operate in a specific and predefined manner to perform the functions described herein.
  • An embodiment of the present invention may relate to one or more of the example embodiments enumerated below.
  • a method for altering the soundfield in an electroacoustic channel in which a first audio signal is applied by a first electromechanical transducer to an acoustic space, causing changes in air pressure in the acoustic space, and a second audio signal is obtained by a second electromechanical transducer in response to changes in air pressure in the acoustic space comprising: establishing, in response to the second audio signal and at least a portion of the first audio signal, a transfer function estimate of the electroacoustic channel, said transfer function estimate being derived from one or a combination of transfer functions selected from a group of transfer functions, said transfer function estimate being adaptive in response to temporal variations in the transfer function of the electroacoustic channel, and obtaining one or more filters whose transfer function is based on the transfer function estimate and filtering with the one or more filters at least a portion of the first audio signal, which portion of the first audio signal may or may not be the same portion as said first recited portion of the first audio signal.
  • a method according to enumerated example embodiment 1 further comprising implementing said transfer function estimate with one or more of a plurality of time-invariant filters.
  • D07044WO01 29 4.
  • the transfer function estimate is adaptive in response to a time average of temporal variations in the transfer function of the electroacoustic channel.
  • impulse responses are measured impulse responses of real and/or simulated transmission channels.
  • D07044WO01 30 14 A method according to enumerated example embodiment 12 wherein the characte ⁇ stics of said group of transfer functions are obtained according to an eigenvector method
  • said first electromechanical transducer is one of a loudspeaker, an earspeaker, a headphone ear piece, and an ear bud
  • acoustic space is a small acoustic space at least partially bounded by an over- the-ear or an around-the-ear cup, the degree to which the small acoustic space is enclosed being dependant on the closeness and centering of the ear cup with respect to the ear 20
  • said variations in the transfer function of the electroacoustic channel result from changes in the location of the small acoustical space with respect to said ear
  • each estimate of the transfer function of the electroacoustic channel is an estimate of the channel's magnitude response within a range of frequencies
  • said acoustic space also receives an audio disturbance and said first audio signal includes (1) an error feedback signal de ⁇ ved from the difference between the second audio signal and an audio signal obtained by applying said first audio signal to the filter based on the estimate of the transfer function of the electroacoustic channel, said difference being filtered by said one or more filters whose transfer function is an inverted version of the transfer function estimate, and (2) a speech and/or music audio signal
  • D07044WO01 31 24 A method according to enumerated example embodiment 23 wherein the method provides an active noise canceller in which the perceived audio response of the electroacoustic channel reduces or cancels the audio disturbance.
  • 27. A method according to any one of enumerated example embodiments 1-21 wherein said acoustic space also receives an audio disturbance and said first audio signal includes (1) an error feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying said first audio signal to the estimate of the transfer function of the electroacoustic channel, said difference being filtered by said one or more filters whose transfer function is an inverted version of the transfer function estimate, and (2) a speech and/or music audio signal filtered by a target response filter and also filtered by said one or more filters whose transfer function is an inverted version of the transfer function estimate.
  • a method according to enumerated example embodiment 23 or enumerated example embodiment 27 wherein said one or more filters whose transfer function is an inverted version of the transfer function estimate comprise a lower- frequency HR filter and an upper- frequency FIR filter in cascade.
  • a method for altering the soundfield in an electroacoustic channel m which a first audio signal is applied by a first electromechanical transducei to an acoustic space, causing changes in air pressure in the acoustic space, and a second audio signal is obtained by a second electromechanical transducer in response to changes in air pressure in the acoustic space comprising establishing, in response to the second audio signal and at least a portion of the fust audio signal, a transfer function estimate of the electroacoustic channel for a range of audio frequencies lower than an upper iange of audio frequencies, said transfer function estimate being derived from one or a combination of transfer functions selected from a group of transfer functions, said transfer function estimate being adaptive in response to temporal variations in the transfer function of the electroacoustic channel, obtaining one or more filters whose transfer function for said range of audio frequencies lower than an upper range of audio frequencies is based on the transfer function estimate and filtering with the one or more filters at least a portion of the first audio signal, which portion of
  • a method according to enumerated example embodiment 38 wheiein the filter or filters estimating the electroacoustic channel transfer function for said range of audio frequencies lower than an upper range of audio frequencies is or are HR filters and the filter or filters having a time-mva ⁇ ant transfer response for a range of frequencies higher than said lower range of frequencies is or aie FIR filteis
  • said acoustic space also receives an audio disturbance and said first audio signal includes (1) an error feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying said first audio signal to the series arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for said range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters having a time-invariant transfer response for a range of frequencies higher than said lower range of frequencies, said difference being filtered by a se ⁇ es arrangement of (a) said one or more filters whose transfer function for said range of audio frequencies lower than an upper range of audio frequencies is an inverted version of the transfer function estimate and (b) one or more filters whose transfer function for a range of frequencies higher than said lower range of frequencies is variably controlled by a gradient descent minimization process, and (2) a speech and/or music audio signal
  • said acoustic space also receives an audio disturbance and said first audio signal includes (1) an en or feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying said first audio signal to the se ⁇ es arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for said range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters having a time-mva ⁇ ant transfer response for a range of frequencies higher than said lower range of frequencies, said difference being filtered by a se ⁇ es arrangement of (a) said one or more filters whose transfer function for said range of audio frequencies lower than an upper range of audio frequencies is an inverted version of the transfer function estimate and (b) one or more filters whose transfer function for a range of frequencies higher
  • D07044WO01 34 than said lower range of frequencies is va ⁇ ably controlled by a gradient descent minimization process, and (2) a speech and/or music audio signal filtered by a target response filter and also filtered by said series arrangement of filters
  • a method for obtaining a set of filters whose linear combination estimates the impulse response of a time-varying transmission channel comprising obtaining M filter observations, the observations including the impulse responses of the transmission channel across its range of possible variations with time, selecting N of M filters according to an eigenvector method, determining, in leal-time, a linear combination of the N filters that forms an optimal estimate of the transmission channel 43
  • Apparatus comprising means adapted to perform each step of the method of any one of enumerated example embodiments 1 -47

Abstract

An electroacoustic channel soundfield is altered. An audio signal is applied by an electromechanical transducer to an acoustic space, causing air pressure changes therein. Another audio signal is obtained by a second electromechanical transducer, responsive to air pressure changes in the acoustic space. A transfer function estimate of the electroacoustic channel is established, responsive to the second audio signal and part of the first audio signal. The transfer function estimate is derived to be adaptive to temporal variations in the electroacoustic channel transfer function. Filters are obtained with transfer functions based on the transfer function estimate. Part of the first audio signal is filtered therewith.

Description

METHOD FOR ADAPTIVE CONTROL AND EQUALIZATION OF ELECTROACOUSTIC CHANNELS
Cross-Reference to Related Applications This application claims pπoπty to U S Patent Provisional Application No
61/137,377, filed 29 July 2008, hereby incorporated by reference in its entirety
Field of the Invention
Various aspects of the invention relate to audio signal processing Aspects of the invention include methods for alteπng the soundfield in an electroacoustic channel and methods for obtaining a set of filters whose linear combination estimates the impulse response of a time- varying transmission channel Aspects of the invention also include apparatus for performing such methods and computer programs, stored on a computer- medium, for causing a computer to perfoπn such methods In particular, aspects of the invention are particularly useful for improving the audibility of portable multimedia and communication devices, particularly by reducing the effect of external environmental noise and/or by improving the understandabihty of speech in noisy environments Aspects of the invention are useful generally in any environment for active noise control (ANC) and vaπous types of equalization (including line enhancement and acoustic echo cancellation)
Background of the Invention Active noise control (ANC) and adaptive equalization may be used to reduce the effect of external environmental noise and/or to improve the understandabihty of speech m noisy environments For example, ANC systems detect the disturbing noise signal and then generate a sound wave of equal amplitude and opposite phase, thereby reducing the perceived disturbance level Summary of the Invention
According to a first aspect of the present invention, a method for alteπng the soundfield in an electroacoustic channel in which a first audio signal is applied by a first electromechanical transducer to an acoustic space, causing changes in air pressure in the acoustic space, and a second audio signal is obtained by a second electromechanical transducer in response to changes in air pressure in the acoustic space, compπses (a) establishing, m response to the second audio signal and at least a portion of the first audio signal, a transfer function estimate of the electroacoustic channel, the transfer function estimate being deπved from one or a combination of transfer functions selected from a group of transfer functions, the transfer function estimate being adaptive m response to temporal
DQ7044WO01 1 variations in the transfer function of the electroacoustic channel, and (b) obtaining one or more filters whose transfer function is based on the transfer function estimate and filtering with the one or more filters at least a portion of the first audio signal, which portion of the first audio signal may or may not be the same portion as the first recited portion of the first audio signal
The method may further compπse implementing the transfer function estimate with one or more of a plurality of time-invariant filters The one or more filters whose transfer function is based on the transfer function estimate may have a transfer function that is an inverted version of the transfer function estimate The transfer function estimate may be adaptive in response to a time average of temporal variations in the transfer function of the electroacoustic channel The one or more of a plurality of time-invaπant filters may be HR filters Alternatively, the one or more of a plurality of time-invariant filters may be two filters in cascade, the first filter being an HR filter and the second filter being an FIR filter In addition, the one or more filters whose transfer function is based on the transfer function estimate may be HR filters Alternatively, the one or more filters whose transfer function is based on the transfer function estimate may be two filters in cascade, the first filter being an IIR filter and the second filter being an FIR filter
The transfer function estimate may be deπved from one or a combination of transfer functions selected from a group of transfer functions by employing an error minimization technique Alternatively, the transfer function estimate may be established by cross fading from one to another of the one or combination transfer functions selected from a group of transfer functions by employing an error minimization technique Yet as a further alternative, the transfer function may be established by selecting two or more of the transfer functions from the group of transfer functions and forming a weighted linear combination of them based on an error minimization technique
The characteπstics of one or more of the group of transfer functions may include the impulse responses of the electroacoustic channel across a range of vaπations in impulse responses with time. The impulse responses may be measured impulse responses of real and/or simulated transmission channels The characteπstics of the group of transfer functions may obtained according to an eigenvector method For example, the group of transfer functions may be obtained by deriving the eigenvectors of the autocorrelation matπx of the time-mvaπant filter characteπstics. Alternatively, the defined group of time-invaπant filter characteπstics may be obtained by deπvmg the eigenvectors resulting from performing a singular value
D07044WO01 2 decomposition of a rectangular matrix in which the rows of the matrix are a larger group of time-invariant filter characteristics.
The first electromechanical transducer may be one of a loudspeaker, an earspeaker, a headphone ear piece, and an ear bud. The second electromechanical transducer is a microphone.
The acoustic space may be a small acoustic space at least partially bounded by an over-the-ear or an around-the-ear cup, the degree to which the small acoustic space is enclosed being dependant on the closeness and centering of the ear cup with respect to the ear. Variations in the transfer function of the electroacoustic channel may result from changes in the location of the small acoustical space with respect to the ear.
Each estimate of the transfer function of the electroacoustic channel may be an estimate of the channel's magnitude response within a range of frequencies. The acoustic space may also receive an audio disturbance signal. The acoustic space may also receive an audio disturbance and the first audio signal may include (1) an error feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying the first audio signal to the filter based on the estimate of the transfer function of the electroacoustic channel, the difference being filtered by the one or more filters whose transfer function is an inverted version of the transfer function estimate, and (2) a speech and/or music audio signal. Aspects of the invention may provide an active noise canceller in which the perceived audio response of the electroacoustic channel reduces or cancels the audio disturbance.
The first audio signal may include an audio input signal filtered by a target response filter and by the one or more filters.
Aspects of the invention may provide an equalizer in which the perceived audio response of the electroacoustic channel emulates the response of the target response filter. The acoustic space may also receive an audio disturbance and the first audio signal may include (1) an error feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying the first audio signal to the estimate of the transfer function of the electroacoustic channel, the difference being filtered by the one or more filters whose transfer function is an inverted version of the transfer function estimate, and (2) a speech and/or music audio signal filtered by a target response filter and also filtered by the one or more filters whose transfer function is an inverted version of the transfer function estimate.
DQ7044WO01 Aspects of the mvention may provide an active noise canceller in which the perceived audio response of the electroacoustic channel reduces or cancels the audio disturbance and also provides an equalizer in which the perceived audio response of the electroacoustic channel emulates the response of a target response filter The target response filter may have a flat response, in which case the filter may be omitted Alternatively, the target response filter has a diffuse field response or the target response filter characteπstic may be user- specified
The one or more filters whose tiansfer function is an inverted version of the transfer function estimate may comprise a lower-frequency HR filter and an uppei frequency FIR filter in cascade
The first audio signal comprises an artificial signal selected to be inaudible The establishing may respond to the second audio signal and at least a portion of the second audio signal as digital audio signals in the frequency domain
According to another aspect of the invention, a method for altering the soundfield in an electroacoustic channel in which a first audio signal is applied by a first electromechanical transducer to an acoustic space, causing changes in air pressure in the acoustic space, and a second audio signal is obtained by a second electromechanical transducer in response to changes in air pressure in the acoustic space, compnses (a) establishing, in response to the second audio signal and at least a portion of the first audio signal, a transfer function estimate of the electroacoustic channel for a range of audio frequencies lower than an upper range of audio frequencies, the transfer function estimate being derived from one or a combination of transfer functions selected from a group of transfer functions, the transfer function estimate being adaptive in response to temporal variations m the transfer function of the electroacoustic channel, (b) obtaining one or more filters whose transfer function for the range of audio frequencies lower than an upper range of audio frequencies is based on the transfer function estimate and filtering with the one or more filters at least a portion of the first audio signal, which portion of the first audio signal may or may not be the same portion as the first recited portion of the first audio signal, and (c) obtaining one or more filters whose transfer function for a range of frequencies higher than the lower range of frequencies is variably controlled by a gradient descent minimization process
This aspect of the invention may further compπse implementing the transfer function estimate for the range of audio frequencies lower than an upper range of audio frequencies with one or more of a plurality of time-mvaπant filters
DQ7044WO01 4 The one or more filters whose transfer function for the range of audio frequencies lower than an upper range of audio frequencies may be based on the transfer function estimate have a transfer function that is an inverted version of the transfer function estimate for the range of frequencies The gradient descent minimization process may be responsive to the difference between the second audio signal and an audio signal obtained by applying at least a portion of the first audio signal to the seπes arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for the range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters having a time-invariant transfer response for a range of frequencies higher than the lower range of frequencies
The filter or filters estimating the electroacoustic channel transfer function for the range of audio frequencies lower than an upper range of audio frequencies may be one or more HR filters and the filter or filters having a time-invariant transfer response for a range of frequencies higher than the lower range of frequencies may be one or more FIR filters The acoustic space may also receive an audio disturbance and the first audio signal may include (1) an error feedback signal deπved from the difference between the second audio signal and an audio signal obtained by applying the first audio signal to the seπes arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for the range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters having a time-mvaπant transfer response for a range of frequencies higher than the lower range of frequencies, the difference being filtered by a series arrangement of (a) the one or more filters whose transfer function for the range of audio frequencies lower than an upper range of audio frequencies is an inverted version of the transfer function estimate and (b) one or more filters whose transfer function for a range of frequencies higher than the lower range of frequencies is variably controlled by a gradient descent minimization process, and (2) a speech and/or music audio signal
Alternatively, the acoustic space also receives an audio disturbance and the first audio signal may include (1) an error feedback signal deπved from the difference between the second audio signal and an audio signal obtained by applying the first audio signal to the seπes arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for the range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters .having a time-mvaπant transfer response for a range of frequencies higher than the lower range of frequencies, the difference being filtered by a seπes arrangement of (a) the one or more filters whose transfer function for the range of audio
DQ7044WO01 5 frequencies lower than an upper range of audio frequencies is an inverted version of the transfer function estimate and (b) one or more filters whose transfer function for a range of frequencies higher than the lower range of frequencies is variably controlled by a gradient descent minimization process, and (2) a speech and/or music audio signal filtered by a target response filter and also filtered by the series arrangement of filters.
According to a further aspect of the invention, a method for obtaining a set of filters whose linear combination estimates the impulse response of a time-varying transmission channel, comprises (a) obtaining M filter observations, the observations including the impulse responses of the transmission channel across its range of possible variations with time, (b) selecting N of M filters according to an eigenvector method, and (c) determining, in real-time, a linear combination of the N filters that forms an optimal estimate of the transmission channel.
The N selected filters may be determined by deriving the eigenvectors of the autocorrelation matrix of the M observations. Alternatively, the N selected filters may be deteπnined by deriving the eigenvectors resulting from performing a Singular Value Decomposition of a rectangular matrix in which the rows of the matrix are the M observations.
A scaling factor for each of the N eigenvector filters may be obtained using a gradient-descent optimization. The gradient-descent optimization may employ an LMS algorithm.
The M observations may be measured impulse responses of real or simulated transmission channels.
Aspects of the invention may improve the listening experience under typical (non- ideal) conditions of electroacoustic channels and their environment. An "electroacoustic channel" may be defined as an acoustic space relative to an ear in which an electromechanical transducer, such as a loudspeaker or earspeaker, causes changes in air pressure in the acoustic space, the electroacoustic channel thus including the electromechanical transducer and the acoustic space between that transducer and a listener's ear drum. In some applications such an electroacoustic channel may be bounded at least in part by a flexible or rigid ear cup. In various exemplary embodiments of the invention, a further electromechanical transducer, such as a microphone, is suitably located within the acoustic space in order to sense changes in air pressure in the acoustic space, thereby allowing the derivation of an estimate of the electroacoustic channel response.
D07Q44WO01 According to aspects of the invention, an ANC and/or equalizer may adapt itself in response to short-time vaπations in the transfer function of the electroacoustic channel The effect of this adaptation is to expand the listening "sweet spot" A sweet spot is the region in which the playback device may be physically located while still achieving effective results Example embodiments of the invention provide both ANC and equalization separately or together — equalization may be added to ANC with negligible increase in implementation cost
Aspects of the invention are applicable, for example, at least to acoustic envπonments characterized by high compliance transducers and relatively few, widely spaced transducer resonances The transducer, when modeled as a linear filter, should result in the model being or approximating a minimum-phase filter The requirement for minimum-phase transducers may be applied to a limited frequency range because ANC is generally most effective for noise signals below 1 5 kHz ANC is particularly well suited for deployment m portable multimedia devices such as earbuds, Bluetooth headsets, portable headphones, and mobile phones, where voice communication and music playback commonly occur under conditions of highly dynamic environmental noise Furthermore, the electroacoustic channels involved may be small (for example, mobile phone pressed against the pinna, earbuds inserted directly into the ear canal, and partially or fully-sealed headphones), implying that the acoustic resonant frequencies are further apart and variable channel resonances can be more readily accounted for m the system Such properties may be exploited in aspects of the present invention to simplify the design of adaptive "earspeaker" systems (sound reproduction devices that are located m close proximity to a listener's ears)
Aspects of the invention address a leading cause of low performance in earspeakers ~ variability m the transfer function of the electroacoustic channel from the loudspeaker to the ear canal Mobile phone users experience this phenomenon while listening to a far-end talker and, often unconsciously, "optimize" the channel by making mmute adjustments to the position and angle of the phone relative to the ear Even when sealed headphones are used, the transfer function vanes depending on the quality of the acoustic seal between the earcup and the head, the position of the earcup, and specific attπbutes of the listener such as pmna size and shape and whether the listener is wearing eyeglasses In an aircraft passenger environment, in which the listener is using a non-adaptive, sealed headphone, an air gap as small as 1 mm may result in a reduction of up to 1 1 dB of low- frequency cancellation of aircraft engine noise
D07044WO01 7 Some digital implementations of aspects of the present invention employ, adaptively, one or a linear combination of a plurality of time-mvaπant IIR (infinite impulse response) filters Such an arrangement is useful, for example, in rapidly tracking changes in the electroacoustic channel Brief Description of the Drawings
FIG 1 is a functional block diagram of an example of a feedback-based active noise control processor or processing method according to aspects of the present invention
FIG 2 is a functional block diagram of an example of an earspeaker equalizing processor or processing method according to aspects of the present invention FIG 3 is a functional block diagram of an example of a combination feedback-based active noise control and earspeakei equalizing processor or processing method according to aspects of the piesent invention
FIG 4 is a hypothetical magnitude versus frequency response showing an example of an injection of a narrowband pilot noise signal in the presence of a wideband disturbance signal
FIG 5 is a functional block diagram of an example of a feedback-based active noise control processor or processing method according to aspects of the present invention in which the adaptive analysis operates in the frequency domain rather than the time domain
FIG 6 is a functional block diagram of an example of a processor or processing method according to aspects of the present invention m which either or both of the control filtering and plant estimate filtering are factored into two or more filters or filtering functions arranged m cascade
FIG 7 is a functional block diagram of an example of an active noise control processor or processing method according to aspects of the present invention in which adaptation based on temporal vaπations of the plant is combined with a supplemental adaptive filtering designed to optimize the control filter based on characteπstics of the disturbance signal
FIG 8 is a functional block diagram of an example of an active noise control and equalization processor or processing method according to aspects of the present invention m which adaptation based on temporal vaπations of the plant is combined with a supplemental adaptive filtering designed to optimize the control filter based on characteristics of the disturbance signal
D07044WO01 FIG 9 is a functional block diagram of an example of an adaptive analysis device or process according to aspects of the present invention m which parameters for a single filter or filtering function are obtained
FIG 10 is a functional block diagram of an example of an adaptive analysis device or process according to aspects of the present invention in which parameters for multiple filters or filtering functions are obtained
FIG 11 is a functional block diagram of a feedback gradient-descent arrangement for denving an inverted filtering iesponse in response to a filtering response
FIG 12 is a functional block diagram of an example of a substantially analog example embodiment of a portion of an active noise control processor (or processor function) and/or equalization processor (or processor function) according to aspects of the pi esent invention
FIG 13 is a functional block diagram of a gradient-descent minimization anangement for determining the optimal weighting of a set of set of filters or filtering functions
Description of Example Embodiments The present invention and its various aspects may involve analog or digital signals, as noted In the digital domain, devices and processes operate on digital signal streams in which audio signals are represented by samples
It is well known that the low frequency response of an earspeaker, such as a headphone, is attenuated as it is pulled away from the ear Likewise, if the headphone is not in the optimal position, an air gap (acoustic leakage) may form around the headphone, and thus the low frequency response may also lowered by an amount proportional to the degree of acoustic leakage The inventors have observed that this change in the frequency response as a function of acoustic leakage is limited to frequencies below a particular frequency value, wherein this value may be different for different earspeakers The vaπation in magnitude frequency response above this frequency value may be assumed to vary less as a function of headphone leakage The vaπation of the magnitude frequency response may be as much as about 15 dB at very low frequencies (about 100 Hz)
When there is a small acoustic space between an earspeaker and the ear canal, typical room reflections are not a factor m the measurements One may assume that room acoustics do not affect such an electroacoustic channel This simplification yields a channel that is, over a nominal frequency range, substantially minimum phase with the exception of a delay, and that has a magnitude frequency response that is mvertible over a bandlimited range The last simplification band limits the range of the electroacoustic model to a frequency range that
D07044WO01 yields minimal or shallow notches m the magnitude response so as to prevent resonant peaks that is annoying to the listener or would create potential instabilities m operation
Frequencies below about 1 5 kHz may be ideal for electroacoustic channel system identification One reason is that m modern analog or digital broadband noise-cancelmg systems (as opposed to systems that cancel periodic disturbances), the frequency range that benefits the greatest from ANC are those frequencies below 1 5 kHz This is because the passive isolation on typical earspeakers are less effective at isolating frequencies with wavelengths longer than 1/3' of a meter, than they are for shorter wavelengths Also, because waveforms with wavelengths greater than l/3ld of a meter are less affected by system latencies m the hardware, it is desirable that one should focus system identification over the range of frequencies that are most important to relevant and effective noise cancellation Because it vanes continuously across a range of magnitude responses, an electroacoustic channel may be modeled as a linear, continuously time-varying filter
FIG 1 shows an example of a feedback-based active noise control processor or processing method, with an audio ("speech/music") input, employing aspects of the present invention In FIG 1 and other figures herein, solid lines indicate audio paths and dotted lines indicate the conveyance of filter defining information, including for example, parameters, to one or more filters Certain components not necessary to the understanding of the example are not shown explicitly in FIG 1, nor are they shown in other exemplary embodiments of aspects of the invention For example, when the processors or processing methods of the examples of FIGS 1-3 and 5-8 operate principally in the digital domain, a digital-to-analog converter and suitable amplification is required in order to dπve the earspeaker 2 and suitable amplification along with an analog-to-digital converter is required at the output of the microphone 4 In the various figures, a like or corresponding device or function is assigned the same reference numeral
An ANC processor or processing method, such as shown m the example of FIG 1 , seeks to alter the perceived audio output of an electroacoustic channel G m such a way as to reduce the audibility of an environmental disturbance sound Such sounds may be any of a variety of sources including, for example, human speakers, airplane engines, room noise, street noise, acoustic echoes, etc A first audio signal is applied to a first electromechanical transducer, such as an earspeaker 2 (shown symbolically), that causes changes in air pressure in an acoustic space, for example, a small acoustic space close to an ear (ear not shown) The acoustic space also has a second electromechanical transducer, such as a microphone 4 (shown symbolically), that responds to changes in air pressure in the acoustic space and
DQ7Q44WO01 10 produces a microphone signal e The acoustic space also undergoes changes in air pressure resulting from an environmental sound disturbance d The electroacoustic response between the earspeaker 2 and the microphone 4 may be represented as an electromechanical filter G, which mathematically models the ratio of the microphone output to the earspeaker input This model is known m the art as the ' plant "
In accordance with aspects of the invention, an estimate of the plant model G may be implemented as one or more filters or filter functions, and is shown as a plant estimating function or device ("Plant Estimate Filtering, G' ") A feedback signal is obtained by subtracting the output g of the plant model estimate G' fiom the output e of the plant model G m a subtractive combiner or combining function 6 If the Plant Estimate Filtering G' is ideal in its estimation of the model of the electroacoustic channel, i e G' = G, then the feedback path signal x from subtracter 6 is equal to the disturbance signal d A path containing Plant Estimate Filtering G' is often referred to in the literature as the secondary path The feedback path signal x is applied to one or more filters or filtering functions ("Control Filtering, W"), the filtering characteristics of which, in one exemplary embodiment of the invention, are substantially the inverse of the Plant Estimate Filtering G', to produce a disturbance- canceling antiphase signal x' that is summed in an additive combiner or combining function 10 with an input speech and/or music audio signal for application to the earspeaker 2 Regarding notation, G, G' and W are the z-domam transfer functions for digital systems, or the S-domain transfer function for analog systems The disturbance signal d and microphone signal e are equivalent time domain representations of D (see below) and E (see below), respectively
An adaptive analyzer or adaptive analysis function ("Adaptive Analysis") 12 receives the speech and/or music audio signal directly as one input and the microphone 4 signal as another input Ideally, one would like for the right-hand ("Microphone") input to the
Adaptive Analysis 12 to be an acoustic-space-processed version of its left-hand ("Signal") input so that the Adaptive Analysis 12 input signals differ only by the condition of the plant G (this avoids a bias in obtaining the plant estimate G' filtering) For example, that may be accomplished by providing a path parallel to Adaptive Analysis 12 having another instance, a copy, of the plant estimating function or device ("Copy of Plant Estimate Filtering, G'") and adding its output "V" in an additive combiner 14 to the output of combiner 6 Thus, the secondary path G' output subtracts from the V path G' output, effectively leaving the microphone output of the acoustic space as the input to the πght hand side of the Analysis
DQ7044WO01 1 1 In one exemplary embodiment of the invention, the left-hand Signal Input of the Adaptive Analysis 12 represents a known signal, while the right-hand Microphone Input ideally contains only the known signal processed by the plant The Microphone signal e contains the music signal filtered by the unknown plant G However, environmental noise is acquired by the microphone in addition to sound from the earspeaker The environmental noise is considered to be measurement noise from the point of view of performing system identification on the plant The Adaptive Analysis 12 selects a filter that best models the current state of the plant Because the measurement noise is typically uncorrelated with the speech/music signal in Adaptive Analysis 12, it does not effect the optimal filter selection Alternate means for generating the left-hand and πght-hand inputs of Adaptive
Analysis 12 aie possible without departing fiom the spirit of the invention For example, the left-hand input signal can be derived from the plant input signal, and the πght-hand signal can be derived from an estimate of the acoustic-space-processed music signal (the Microphone signal e) As descπbed further below, the Adaptive Analysis 12 generates filtering parameters that, when applied to the Plant Estimate Filtering, G' and the Copy of Plant Estimate Filtering, G' , result in one or more filters, respectively, that estimate the transfer function of the electro acoustic channel G The transfer function estimate G' may be implemented by one or more of a plurality of time-invariant filters, the transfer function estimate G' being adaptive in response to vaπations in the transfer function G of the electroacoustic channel As explained below, Adaptive Analysis 12 may have one of several modes of operation There is a mapping from the filter characteristics determined by Adaptive Analysis 12 and the filterings G' and W
The arrangement of the FIG 1 ANC example is intended to provide a perceived audio response of the electroacoustic channel G such that the speech and/or music is heard while minimizing the audibility of the disturbance Ideally, the antiphase signal x' acoustically cancels the disturbance signal d while not affecting the speech and/or music signal This may be accomplished by minimizing the gam H from the disturbance D to the microphone 4 Minimizing the gain H from the disturbance D to the microphone 4 minimizes the energy transfer from the disturbance D to the error output E
Figure imgf000013_0001
(1)
D07044WO01 12 From the above equation, one may observe that if G' ≠G (indicating that the estimate of the plant G is imperfect), then the denominator is less than one and H is larger than for an ideal plant estimate For the ideal case in which H is set to zero, one may solve for W (assuming that G' = G), and obtain an optimal control filter W
W = - G (2)
The plant estimate G' may be modeled as a minimum phase filtei in cascade with a delay In piactice, the delay is approximately 3 to 4 samples at a sampling fiequency of 48 kHz due to acoustic and speaker excitation latencies associated with G But this delay may be factored out when measuring G and the resultant filter, by design, iepiesents a transducer that is minimum phase The above also demonstrates that adapting the system based on changes in the plant also optimizes the control filter W In this case, W is optimal with respect to plant variation
Inverse filtering characteπstics are obtained in any suitable way by a filter inverting device or function ("Inversion") 16 For example, Inversion 16 may calculate the inversion (particularly if the filtering is a single filter), employ a lookup table, or determine the inversion in a side process or off-line by, for example, a gradient-descent method An example of such an out-of-circuit method is described below in connection with the example of FIG 11
As noted above, a music or speech signal is summed with the antiphase signal at the output of Control Filtering, W The speech/music signal is removed from the feedback path by the G' path, leaving only the disturbance as a component in the antiphase signal The effectiveness of such signal removal is dependent on the closeness of the match between G and G'
Aspects of the present invention also envision the adaptive pre-filtermg of audio signals to compensate for physical attπbutes of an electroacoustic channel - m other words, to provide equalization As with ANC, a pπmary contπbutor to the magnitude response of the electroacoustic channel is imparted by the earspeaker Because the electroacoustic channel dπver affects the magnitude response of the electroacoustic channel, a pre-fllter allows the desired audio signal to compensate, within reasonable distortion limits, characteπstics of the electroacoustic channel Also, in an equalizer configuration, a desired magnitude response may be imparted upon the resultant acoustic presentation at the ear based on, for example: (1) simulation of the diffuse field response such as that described in ISO
DQ7044WO01 13 454 (see reference 13, above), (2) user-specified equalization settings, or (3) a flat magnitude response A diffuse field response imparts a head shadowing effect to coarsely simulate the experience of listening to music in a room A flat response may be desirable for certain types of recordings such as binaural recordings where the spatial presentation has a prion been applied to the content under audition The desired response of the electroacoustic channel may be specified according to a usage model, and need not have a flat magnitude response The desired response may be static (time-mvariant) or dynamic (time-vaπant)
FIG 2 shows an example of an earspeaker equalizing processoi oi piocessing method with an audio ("speech/music") input employing aspects of the present invention The audio input is applied to a target response filter or filtering process ("Target Response Filtering, S") The target response filtering characteristic S may be static or dynamic In seπes with filtering S is an inverse plant filter or filtering process (Inverse Plant Filtering, W") so as to apply a version of the audio input filtered by the series combination of filtering chaiacteπ sties S and W to the earspeaker 2 As in the FIG 1 ANC exemplaiy embodiment, an electroacoustic channel G receives an input from earspeaker 2 and provides an output from microphone 4 The earspeaker 2 input and the microphone 4 output are each applied as respective inputs to Adaptive Analysis 12 that generates parameters for one or more filters or filtering functions that estimate the plant response G An inverter or inversion process ("Inversion") 16 inverts the Plant Estimate Filtering G' characteristics in any suitable manner, such as the alternatives mentioned m connection with the descπption of the FIG 1 example The inverted filtering characteristics control the Inverse Plant Filtering W
It is desired that the perceived audio response of the electroacoustic channel G approximate as closely as possible the response of the target response filter S The optimal equalizer may be characteπzed as the ratio of the desired response to that of the electroacoustic channel response
E a = SW = — " G (4)
Thus, if W is the inverse of G, the perceived output heard through the seπes combination of the S, W and G transfer characteristics is the S characteπstic S should be limited according to the capabilities of the audio playback system to avoid distortion and non-lmeaπties when the earspeaker is m a non-optimal position (which may require an alteration in bass response)
D07044WO01 14 FIG 3 shows an example of a combination feedback-based ANC and earspeaker equalizing processor or processing method employing aspects of the invention The example of FIG 3 adds equalization to the ANC example of FIG 1 In the FIG 3 example, m order to provide equalization in addition to ANC, the S-filtered speech/music signal is applied to the Control Filtering W This requires inserting a copy of the control filtering W in the left-hand input path to Adaptive Analysis 12 and in the "V" path Because the control filtering W ideally is the inverse of the electro acoustic channel (up to a reasonable working frequency, and withm the constraints of the audio playback system), there is no need for a filter W nor for a filter G' in the secondary path, because the convolution of the control filter W with respect to the estimate of the electroacoustic channel results in a uniform delay ("N-sample delay") 18
The ANC/EQ example of FIG 3 provides for applying the speech/music signal through a desired target response filtering S ("Target Response Filtering, S"), which may be a flat response, in which case the target response filtering is unity If S is unity, W m cascade with the plant G, theoretically results in a flat response Inversion 16 in FIG 3 inverts the Plant Estimate Filtering G' m any suitable manner, such as the alternatives mentioned in connection with the description of the FIG 1 example The Adaptive Analysis 12 may be implemented as descπbed below, by taking its inputs from the speech/music signal and the microphone signal In the FIG 3 example, the additive combiner 10 is located before rather than after the Control Filtering W in order that it affects the S filtered speech/music signal (as in the FIG 2 example)
A requirement of processors or processing methods in accordance with the examples of FIGS 1 and 3 is that in order to adapt the secondary path filter G', a speech or music signal needs to be present In order to ameliorate this problem, one may freeze the adaptation when the level of the speech or music drops below a threshold, the threshold, for example, being chosen such that the signal -to-noise ratio (SNR) permits the Adaptive Analysis 12 to make a sufficiently accurate identification of the plant An alternate solution is to inject a signal at the Adaptive Analysis 12 Input Signal that is inaudible to the listener but is recognizable by the system, even when the injected signal is below the level of the environmental noise (disturbance) Such a pilot narrowband noise may be varied m bandwidth, center frequency, and/or intensity Such parameters may be vaπable over time and be selected so as to optimize the masking of this signal according to psychoacoustic principles For example, such parameters may be selected on-line in order to keep the level
DQ7044WO01 1 5 of the signal at the just-noticeable-difference (JND) boundary between audibility and inaudibility
An example of an injection of a signal is shown with respect to an arbitrary magnitude versus frequency response m FIG 4 Because Adaptive Analysis 12 has a prion information of the injected pilot tone (the Input Signal), the Microphone Signal may be narrowband filtered to consider only frequencies coincident with the frequencies of the pilot narrowband noise Also, if the system has optimized the selection of parameters of the pilot noise to result m inaudibility, the pilot noise may be injected even when speech or music is present This may improve the accuracy of the Adaptive Analysis 12 for instances when the log SNR between the music and the disturbance is negative
The processor or processing method examples of FIGS 1, 2 and 3 may be implemented principally in the digital or analog domains The processor or processing method example of FIG 5 operates principally in the digital domain It differs from the example of FIG 1 mamly m that in a digital implementation of FIG 1, the Adaptive Analysis 12 operates in the frequency domain rather than the time domain Forward transforms 18 and 20, respectively, such as Discrete Fouπer Transforms (DFT) or other suitable transforms, are applied to the Adaptive Analysis 12 inputs As is further descπbed below, the magnitude of the complex coefficients over the frequencies of most interest (10 Hz to 500 Hz, for example) are used by the Adaptive Analysis 12 to compute the error energy The Forward transform may be eliminated if the source audio is already in a frequency-domain representation and if the ANC system is implemented m conjunction with an upstream frequency-domam processor Such upstream frequency-domam processors may be an audio coding system decoder (which include, but is not limited to MPEG-4 AAC, Dolby Digital, etc ) In this case, the particular selection of the frequency-domam transform may be selected to match the coded audio transform Other frequency-domam processing algonthms may be used, and as long as the ANC system can coordinate with such processes, the forward transform on the microphone path may be eliminated
The processor or processing method example of FIG 6 shows aspects of the present invention in which either or both of the control filtering and plant estimate filtering are factored into two or more filters or filtering functions arranged in cascade Depending on the particular electroacoustic channel in use, it may be that within a certain frequency range, the magnitude and phase response vaπations are small so that a single filter models the earspeaker response with sufficient accuracy For example, frequencies above 1 5 kHz may vary by less than 6 dB in the worst case, and by less than 3 dB in the average case If the
D07044WO01 16 Adaptive Analysis 12 filters and the Low Order Filters are each single IIR digital filters, Inversion 16 may implement the Low-Order IIR Control filter by swapping the feedforward coefficients (the zeros) with the feedback coefficients (the poles) The equation for the upper frequency control filter may then be derived from the target control filtering and the lower- frequency IIR filter as follows
W
W1J F =
W I1IR (5)
Likewise, for the secondary path filter σ
G1UF -
G' ΠR (6)
In this example, the lower-frequency filter may be a low-order IIR filter, while the upper frequency may be implemented as either an FIR or IIR filter of appropriate length to model the higher-frequency features of the earspeaker Other exemplary embodiments are possible with varying combinations of filter-types (FIR or IIR), adaptive versus static, number of filter stages, or even parallel rather than series configurations Because the product of W G may be constrained to be open-loop stable through an offline design of W, then the product of WiiR WUF G is also stable The length of the adaptive filter N for WUF may be reduced because WLF IS canceling frequencies with wavelengths longer than N A short N improves the response of the system because the N is directly proportional to the convergence time
The upper- frequency filters GUF and WUF may be static or adaptive If adaptive, they may switch between optimal filter coefficients based on the system identification from the Adaptive Analysis 12 Alternatively, they may be independently adaptive, entirely separate from the Adaptive Analysis, whereby a gradient-descent algorithm such as the LMS may be employed to converge to optimal upper- frequency filter coefficients Either or both the control and the secondary path upper-frequency filters, GUF and/or WUF, may be adaptive The employment of Factored filters is also applicable to the frequency-domam example of FIG 5
FIG 7 shows another example of a processor or processing method in accordance with aspects of the present invention This example combines adaptation based on temporal vaπations of the plant with a supplemental adaptive filtering designed to optimize the control filter based on characteπstics of the disturbance signal Such a supplemental adaptive filtering may be based on the well-known FX-LMS algoπthm A controller may implement an LMS algorithm or a vaπant of the LMS algoπthm, such as the Normalized LMS, in order
DQ7044WO01 17 to attenuate narrowband sound disturbances such as from certain types of machinery and tonal disturbances such as speech harmonics In this case, the upper-frequency control filter WUF, of section 4 3 is replaced by an adaptive FIR filter with coefficients deπved from the classic LMS update equation w(n + l) = w(n) + μx(n)e(n) n = 0 N - I (7) where w is the FIR filter coefficient vector, N is the length of the control filter WUF, and x is a vectorized input array read from the feedback path and filtered by the plant model G' The x vector is updated by first shifting all stored values one index value back m time, and then storing the new x sample at index = 0 e is the current (scalar) sample read from the microphone μ is the step size that is chosen to best balance stability against convergence speed
Comparing the example of FIG 7 to the example of FIG 6, the Upper Frequency Control Filter, which is static, is replaced by an adaptive Upper Frequency Control filter WUF in which the filter coefficients are w, and an LMS Updating device or function 20 implements the LMS update equation Because the example is a feedback-based system, the x input to the LMS update Module is derived from the feedback path, which, in accordance with the FX-LMS algorithm, is filtered by the plant model G' The LMS Updating 20 also needs access to the microphone signal This microphone signal contains the speech/music signal filtered by the plant, which would bias the convergence of w to a suboptimal filter Therefore, it is necessary to remove the speech/music signal from the error update path e, which is shown as the additive combination 22 into e before it enters the LMS Updating 20 In this case, speech/music signal must be filtered by the plant estimate G' because the speech/signal in the error signal has been filtered by the plant G
Thus, the example of FIG 7 employs 1) the combination of the well known FX-LMS system to optimize the control filter based on characteπstics of the distuibance with Adaptive Analysis 12 to optimize the system based on changes in the plant, and 2) the Upper Frequency Control Filter WUF m seπes with the Lower Frequency Control Filter WLF, which uses coefficients deπved from the Adaptive Analysis 12 The lower frequency control filter, when implemented by an HR filter, is most effective at modeling the plant at low frequencies (below 1 5 kHz) due to the long time response of an HR filter This improves the degree of noise reduction at low frequencies, which dominate most environmental signal disturbances To a certain extent, the upper frequency control filter is also capable of correcting mismatches between the plant and plant model This form of dual-adaptation is advantageous
D07044WO01 18 compared to a single-adaptation method based solely on FX-LMS To compensate for plant response changes at very low frequencies (100 Hz), a single-adaptation system would require a larger number of adaptive filter taps than a dual-adaptation system This leads to higher computational complexity and longer adaptive filter convergence times compared to a system based on a combination of switched-adaptive filters (such as HR filters) and FX-LMS filters
FIG 8 shows a hybrid processor or processing method arrangement similar to the example of FIG 7, but also piovidmg adaptive equalization, although with differences from the equalizer examples of FIGS 3 and 6 In the FIG 8 example, it is not possible to apply the response of the WUF filter to the speech/music signal because this filter is solely determined by characteπstics of the disturbance Characteristics of the disturbance are in no way related to the speech/music signal, and so the application of WUF should be applied only to the antiphase canceling signal Then, a suitable method for applying the equalizing filter WLF to the speech/music signal is to present a new copy of WLF m cascade with the Target Response filter Variations on where WLF IS positioned m the system are possible, such as commuting the filter to locations after either the first or second speech/music branches
FIGS 9 and 10 show two examples of an Adaptive Analysis 12 such as that which may be employed in the processor or processing method examples of FIGS 1 -3 and 5-8 In each of those examples, the Adaptive Analysis 12 is effectively in parallel with the electroacoustic channel (plant) G For example, the optimal filter or filters are selected by computing a measure of similarity between the filter transfer function and that of the electroacoustic channel, at least at low frequencies (for example, below about 1 5 kHz) However, any constrained frequency range may be employed provided that it yields accurate system identification
The Adaptive Analysis 12 may operate by reference to a bank of parallel filters that represent G' for different vaπations of the plant Each of these filters may represent, for example, a unique positioning of a headphone earpiece on a dummy head that may be used for measuring the impulse response of G in a particular position Because the parallel filters only need to modify the signal at low frequencies, and because the response of electroacoustic channels varies relatively slowly across frequency, they may be implemented at very low computational cost using low to moderate-order filters For a digital implementation, the mean-squared error between the output of each of the filters and the microphone error signal may be used to identify which of the filters best matches the plant G For an analog implementation, comparators and logic circuitry may be used to select an optimal filter, as is descnbed further below in connection with FIG 12
DQ7044WO01 19 In the course of implementing an ANC system such as in any of the examples above, a designer may quantify the impulse response of the acoustic path at different headphone positions in order to determine limits imposable upon the adaptive algorithm during real-time operation. Because this quantification may be conducted for a known earspeaker electroacoustic path, the electroacoustic parameters of the path may be fully specified before measurement.
FIG. 9 shows an example of an Adaptive Analysis 12 for the case in which only one filter is chosen (K=I). Generally, from a set of M filters, which one may refer to as observations, the Adaptive Analysis 12 chooses N filters. From these N filters, one filter K is chosen and its index may be provided as the Analysis output.
In this example, one filter out of a possible N is selected based on a minimum mean- square error criterion. The N filters are connected in a parallel arrangement, producing in a bank of filters or filtering functions ("N Parallel Filters") 24 in which each filter processes the same bandpassed version of the Input Signal. A controller or controlling function ("Control") 26 selects the kth filter, depending on which of the N filters returns the minimum time- averaged mean-squared error. Adaptive Analysis 12 receives an Input Signal (corresponding to the left-hand input to Analysis 12 in FIGS. 1-3 and 5-8) and a Microphone Signal (corresponding to the right-hand input to Analysis 12 in FIGS. 1-3 and 5-8). The Input Signal and Microphone Signal, respectively, are applied via substantially identical bandpass filters 24 and 30. Their passbands include the largest variation across the different observations M. Both the Input Signal and the Microphone Signal are digital audio samples in this example. In response to those input signals, Control 2626 selects one optimal filter and produces as its output the Kth index for identifying the selected filter K. A mapper or mapping function ("Mapping") 34 may map the index to a corresponding set of filter parameters. The inputs to Control 26 are the outputs of subtractive combiners 32-0 through 32-(N-I) that subtract the bandpass-filtered Microphone Signal from each of the N- filtered bandpass-filtered Input Signals, each producing an error signal, the magnitude of which is smallest for the filter N that most closely approximates the response of the plant G (see FIGS. 1-3 and 5-8). Subject to averaging, Control 26 selects the filter having the closest approximation to the plant G and outputs the index K of that filter.
Averaging may be implemented using a simple pole-zero smoothing filter. A 3 dB time constant of 70 msec (milliseconds) (fs=50 kHz) has been found useful. To change from one filter selection to another, only the filter coefficients and not the filter states need to be changed. The change may be applied as an instantaneous switch from one set of coefficients
D07044WO01 20 to the next. In order to minimize audible artifacts incurred during the switching, the change, with respect to pole and zero values, should be small. For the K=I case, as in this FIG. 9 example, Inversion 16 (see FIGS. 1-3 and 5-8) may be applied by pre-computing and storing an inverse filter corresponding to each of the N filters. It is possible to crossfade from one set of filter coefficients for G' to another nearby set (in teπns of the relative distance between the poles and zeros). This can be accomplished by replacing the old coefficients with new ones incrementally over time, or by allowing K=2 for an interval of time and computing the overall output as the time-varying weighted sum of both (one filter having the old set of coefficients and the other having the new set). Provided the cross-fade time is reasonably short (less than 100 msec, for example), in practice it is still possible to achieve reasonably correct system identification during such crossfading. In this case, when crossfading G' from a first set of coefficients to a nearby second set of filter coefficients, the corresponding coefficients for W may either be read from memory if the coefficients were computed offline, or computed directly as the inverse of G'. FIG. 10 shows an example of an Adaptive Analysis 12 in which the device or process selects a linear combination of multiple filters. Generally, the Adaptive Analysis 12 chooses N filters. From these N filters, a smaller set of K filters and their relative weights may be identified so that K filter parameters and K weighting parameters may be provided as the Analysis output. Each filter, of the set of N filters, is implemented in a parallel configuration in a bank of filters or filtering functions ("N Parallel Filters") 24, in which each filter operates on the same bandpassed version of the Input Signal. In variations of the FIG. 10 example, described below, limits are placed upon N and K. In all such variations, the range of frequencies over which the Analysis performs its error analysis may be limited, for example, to the range of frequencies with the largest differences across all observations. Adaptive Analysis 12 receives an Input Signal (corresponding to the left-hand input to Analysis 12 in FIGS. 1-3 and 5-8) and a Microphone Signal (corresponding to the right-hand input to Analysis 12 in FIGS. 1-3 and 5-8). The Input Signal and Microphone Signal, respectively, are applied via substantially identical bandpass filters 24 and 30. Their passbands may include the largest variation across the different observations M. Both the Input Signal and the Microphone Signal are digital audio samples. In response to those bandpass-filtered input signals, Control 26 selects N out of M candidate filters and, as its outputs, provides K sets of filter coefficients and K weighting parameters in order to provide information for providing a linear combination of K filters (K <N ≤M), the case of K=I being handled by an Analysis such as described above in connection with FIG. 9. Thus, M is the set of all possible filters,
DQ7044WO01 21 N is the subset of filters to test m parallel to determine the K filters, and K is the bank of parallel filters for which K sets of filter coefficients and K weighting parameters are passed to Plant Estimate Filtering and, after inversion, to Control Filtering (or Inverse Plant Filtering), as descπbed above in connection with the examples of FIGS 1-3 and 5-8 The inputs to Control 26 are the outputs of subtractive combiners 32-0 through 32-(N-I ) that subtract the bandpass-filtered Microphone Signal from each of the N-filtered bandpass-filtered Input Signal, each producing an error signal, Control 26 selects weightings of the filteis having the closest appi oximation to the plant G and outputs the filter parameters of that filter Various ways of choosing a plurality of weighted filters are described below When K> 1 , the Plant Estimate Filtering in the various exemplary embodiments may be implemented by a bank of K parallel filters or filtering functions, each having a weighting coefficient In accordance with aspects of the piesent invention, the filters or filtering functions controlled by the K filter parameters and K weighting parameters provided by the Analysis 12 may be HR, FIR, or a combination of HR and FIR filters One possible application of multiple filters K is to enhance crossfading from one filter to an adjacent filter (m terms of poles and zeros) As mentioned above, outputs of the K filters are mixed together using weighting coefficients produced by the Control 26 During the time interval of a crossfade, K=2, otherwise, K=I This method may reduce audible artifacts caused by switching between two different filters in the method described earlier (when K=I)
A computationally-efficient variation on the multiple-filter method is to restrict the search to a subset of the total number of filters M This is accomplished by assigning filter indices so that filters with similar transfer functions have indices that are adjacent to each other, and then restπcting the search to the N filters neighboring the current filter having minimum mean-square error Tracking is enabled in the Control 26 by monitoring the averaged relative mean-square error of the filter with the middle index compared to its neighbors If, over time, the minimum error begins to move toward one of the endpomts of the set of N filters until finally a new minimum is detected, the indices of all N filters are adjusted so that the filter with the middle index continues to have the minimum mean-square error out of the set of N filters.
Another alternative of the Adaptive Analysis 12 is for it to operate in the frequency domain rather than the time domain as m the example of FIG 5 In that case, a mean-square error analysis may be applied to the power spectral density (PSD) coefficients of both inputs to the Adaptive Analysis 12 Any time-to-frequency transform or subband filterbank may be
DQ7Q44WO01 22 used to perform the transformation. This would allow a large number of spectral estimation techniques to be used to improve separation of the signal (the music or speech signal played through the transducer) from the noise (the disturbance). One useful technique is to smooth the PSD coefficients over time, in the manner of a standard periodogram analysis, to assure that any bias in the power approaches zero over time. Alternatively, other spectrum estimation techniques such as the "multitaper" method may be used. This approach would also result in no significant increase in computational complexity because time-domain FIR bandpass filters (described below) in the Adaptive Analysis 12 are eliminated. Instead, the same result may be obtained by limiting the range over which the least-squares calculation is performed on the PSD coefficients. The actual forward transform has complexity on the order of Mlog(M) (where M is the number of frequency-domain coefficients) operations but this is still less than the order (N2) complexity of the time-domain bandlimiting filters. Once the best filter or filters is (are) selected in the frequency-domain, its (their) time-domain equivalent filter or filters is (are) conveyed to the time-domain filter or filters. Thus, there is no online inverse-transformation of filter coefficients nor need there be an audio signal outputted by the Adaptive Analysis 12. Filter coefficients may be selected from a table of precomputed filter coefficients. The selection of time-domain coefficients is conducted through the analysis of frequency-domain coefficients.
Another variation on the multiple-filter linear-combination method, is for K=N and to select the N out of M filters according to an eigenvector method such that a linear combination of the N filters forms an optimal energy-minimizing filter. According to such an eigenvector filter method, the N selected filters are computed offline for a given set of M observations. The N-of-M Selection is not implemented in real-time because the N filters have already been computed off-line. The N selected filters are the eigenvectors of the autocorrelation matrix of the M observations. Alternatively, the M observations form the rows of a rectangular matrix and a Singular Value Decomposition of this rectangular matrix yield the eigenvector filters. The Control 26 then computes weighting coefficients for each of the N eigenvector filters, for example, using a gradient-descent minimization process, such as an LMS algorithm. Because all N filters are used to compute the optimal filtered output, K=N. Thus for any given electroacoustic channel impulse response, the response may be mapped to nearest principal components constructed from the N eigenvectors. Such an eigenvector filter method has the advantage that for a large value of M, (i.e., a large number of observations), a smaller number of fixed filters N may be linearly combined to form an optimal energy-minimizing filter. A derivation of the method for generating the eigenvector
DQ7044WO01 23 filters is presented below under the heading "Derivation of the Eigenvector Filter Design Process "
The Inversion device or function 16 in the examples of FIGS 1-3 and 5-8 aims to derive a spectral inverse filter that, when applied to the control filter and analyzed m seπes with the plant response, results in a flat frequency response with no spectial components greater than 0 dB For the Switched Minimum Error method, if the filter selected m the Adaptive Analysis 12 is minimum phase (excluding any delay) then there is a 1 -to-l mapping of each filter m M to a corresponding spectral inverse filter, which may be read from a table, or computed directly as the inverse of G' For any Adaptive Analysis methods where K > 1 , the inverse filter coefficients is computed other than by filter inversion For instance, the out- of-cncuit network of FIG 11 may be employed as the Inversion 16 A disadvantage of this method is that adaptation may only occur when there is signal present at the speech/music input source In the absence of a speech/music source, the adaptation should be frozen An alternate method that injects an inaudible probe signal during periods of no speech or music is discussed above in connection with the example of FIG 4
Referring to the example of FIG 11, a feedback LMS arrangement is provided for deriving the inverted response W based on the plant estimate response G' A noise signal d(n) is applied to the input A first path sums the input at a subtractive combiner 60 with the output of a feedback arrangement The feedback arrangement compares the overall output from combiner 36 with a G' Copy filtered version of the noise signal d(n), and applies a suitable gradient-descent type algorithm, such as an LMS algorithm, in order to control filtering W such that it is an inversion of G' Copy When optimized, a delayed version of W convolved with G' Copy is unity, which results in the error output e(n) of combiner 60 being zero FIG 12 presents an example of aspects of the invention based on analog technology
An advantage of an analog over a digital implementation is that system latencies are shorter because A/D and D/A converters are unnecessary A microphone 4 gives a single-frequency estimate of the low- frequency response of the electroacoustic channel G, and a filter is selected from a filter bank 38 that gives the closest response to a desired response The output of microphone 4 is applied to a bandpass filter 30, followed, in series, by an averager or averaging function ("Mic Avg") 40 The Mic Avg 24 output is applied to an input of each of three comparators or comparator functions Cl, C2 and C3 The speech/music input audio signal is applied to a static filter or filtering function ("Static Filter") 42, followed, in seπes, by a bandpass filter 24 and an averager or averaging function
DQ7Q44WO01 24 ("Audio Avg") 44. The Audio Avg 44 output is applied to an input of each of three comparators or comparator functions Cl, C2 and C3. The Bandpass Filters 24 and 30 isolate a narrow band of frequencies at which the average reproduced level at low frequencies is compared with the average level in the audio program. Comparators Cl, C2, and C3 have different offsets in order to give different thresholds for the decision as to which filter (1, 2, 3, 4) should be selected. The comparators may be implemented with hysteresis in order to eliminate jittering between the outputs of the various filters. Control 26 selects the filter 20 having the least squared error.
Other than employing an analog or partially analog implementation, another way to reduce latency is to implement the feedback path in the example of FIG. 3 with a 1-bit delta- sigma-sampled digital signal processing arrangement. Such 1-bit delta-sigma-modulated sampling system may sample audio at a sampling frequency as high as 64 times the base audio sampling rate. Doing so provides an updating of the anti-phase signal at a very high rate, which reduces system latency incurred by sampling the signal using traditional multi-bit sampling methods, sampled at the standard audio sample rate. A 1 -bit delta-sigma A/D converter at combiner 6 in FIG. 3 and a 1 -bit delta-sigma D/A converter at the loudspeaker 2 in FIG. 3 would be required. In addition, the control filter W and secondary path filter G' would apply multi-bit filter coefficients to the 1-bit intermediate-filter-state values, which would result in a multi-bit output at the filter outputs. The multi-bit output values from each filter would then be transformed back to 1 -bit values through the incorporation of a delta- sigma modulator. Other combinations of filters and delta-sigma modulators are possible, such as performing a single multi-bit to delta-sigma modulator conversion immediately before the 1-bit delta-sigma D/A converter. Depending on the specific implementation, the speech and/or music audio signal may need to be modulated from a multi-bit to a 1-bit delta- sigma representation at the summation 10.
In the analog example of FIG. 12, including digital variations thereof, measuring the change in electroacoustic channel response at a single frequency has a problem in that the variation in the range of sensitivities of an earspeaker and of a microphone is each almost as great as the variation in response associated with changes in the acoustical loading conditions. The assumption is that the gain in the middle of the band defined by the bandpass filters should be substantially equal in both the 'mic AVG' and 'audio AVG' signal paths. Thus, a way to compensate variations in the sensitivities of the microphone and earspeaker should be provided.
D07044WO01 25 Another alternative example that embodies aspects of the present invention is a hybrid digital/analog exemplary embodiment in which the Adaptive Analysis 12 operates on digital samples of both the speech/music signal and the microphone signal, but then applies analog filter parameters (shown as Filter 1 through Filter 4 in the example of FIG. 12) to analog implementations of the control filtering W and the plant estimate filtering G'.
Derivation of the Eigenvector Filter Design Process
In order to derive a set of eigenvector filters for use in the eigenvector alternative mentioned above, one needs to compute K (or N, K=N) eigenvector filters based on a set of M observations. Calculation of eigenvector filters C may occur off-line. The eigenvector filter coefficients may be stored in a suitable non-volatile computer memory.
Selection of N Base Filters One may start from a general case in which the filter to be modeled is characterized i-l by a random filter P{z) — 2 ,P1Z ' having random real coefficients p = (p0,.. - ,pL.\ ) • The
L-I objective is to find a set of Nbase filters C1 (Z) = ^c1 /z' 1 , i = \,... , N , N < L , with real
coefficients C1 = (c; 0,. .. , c; i_, ) , such that
J(C)
Figure imgf000027_0001
= 2?{]|p-C'w|} is minimized. In equation 8, Zs {Dj is the statistical expectation with respect to the distribution of the random coefficients of p ,
Figure imgf000027_0002
U
and w D (wi , ..., wN ) is a real vector that minimizes p — Crw for given p and C . Without lost of generality one may further assume c, are orthonormal vectors, i.e.,
1 J I O else
Because
||p - Crw| = P7P + W7CC7^w - 2P7C7-W .
D07Q44WO01 26 Recognizing that CCr = I , partially differentiating the above expression with respect to w , and setting the derivative to zero, one has w = Cp . Replace the above into (1 ) one has
J(C) = £{prp-prCrCp}
Figure imgf000028_0001
where
RDE{ppT}.
Clearly, the coefficient vectors c, , i = l,...,N that minimizes J also maximizes
N
^c,rRc; , which turn out to be the N eigenvectors corresponding to the N largest eigenvalues
1=1 of the covariance matrix R . That is: Rc, = λ,c,, i = l,...,N, and X1, i-\,...,N are the N largest scalars that satisfy the above equations.
A more generalized solution can be obtained by adding a frequency weighting function W(ύ)) to the cost function J(C), which can be quite useful in practical applications.
J(C) = E U P(eJ'°)-∑w,C,(eη W(ω)dω)
Consider a more specific case in which the filter to be modeled is from M observed
plant filters G1 (z) = ^g1 (j) z~' , i = 1,2,...,M . Noting that in this case one is trying to
Figure imgf000028_0002
model a random filter of M equally probable filters G1 (z) for which the covariance matrix is given by:
Figure imgf000028_0003
where g( =(g( (0),g, (l),...,g( (Z-I)) , the coefficients of the N base filters C1(Z),...,CN (Z) are thus given by the eigenvector c; corresponding to the TVlargest eigenvalues X1 of the covariance matrix R.
DQ7044WO01 27 The actual number of the base filter N can be decided either by complexity constraints, or quality constraints, e.g., the sum of the remaining eigenvalues
satisfies ∑ λ, < ε where ε is a pre-determined maximum design tolerance
In practice, it is also possible to use HR filters that have frequency responses that approximate those of the Eigenvector filters as the N base filters for further complexity reduction. The HR base filters can be designed from C1 (z) , .. . , CN (Z) by using, e.g., a suitable error minimizing process such as a least-square-fit algorithm.
LMS Adaptation of Weighting Coefficients
Once the N base filters have been computed, the optimal weighting W that provides the least square fit for a given unknown electroacoustic channel may be obtained by using a gradient-descent minimization process such as an LMS algorithm. An example is shown in FIG. 13. In the FIG. 13 example, the error signal e{n) is given by e («) = x (ft) - w7" (ft) u(n) ,
where u («) D (ω, [n),...,uN («)) are the respective outputs of the N base filters. The filter
weightings W( nj are updated as: w (» + l) = yv {n) + μw(n) e(n) .
Implementation
The invention may be implemented in hardware or software, or a combination of both (e g , programmable logic arrays). Unless otherwise specified, algorithms and processes included as part of the invention are not inherently related to any particular computer or other apparatus. In particular, various general-purpose machines may be used with programs written in accordance with the teachings herein, or it may be more convenient to construct more specialized apparatus (e g , integrated circuits) to perform the required method steps. Thus, the invention may be implemented m one or more computer programs executing on one or more programmable computer systems each comprising at least one processor, at least one data storage system (including volatile and non-volatile memory and/or storage elements), at least one input device or port, and at least one output device or port. Program code is applied to input data to perform the functions described herein and generate output information. The output information is applied to one or more output devices, in known fashion. Each such program may be implemented in any desired computer language (including machine, assembly, or high level procedural, logical, or object oriented programming
D07044WO01 28 languages) to communicate with a computer system. In any case, the language may be a compiled or interpreted language.
Each such computer program may be stored on or downloaded to a storage media or device (e.g., solid state memory or media, or magnetic or optical media) readable by a general or special purpose programmable computer, for configuring and operating the computer when the storage media or device is read by the computer system to perform the procedures described herein. The inventive system may also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer system to operate in a specific and predefined manner to perform the functions described herein.
An embodiment of the present invention may relate to one or more of the example embodiments enumerated below.
1. A method for altering the soundfield in an electroacoustic channel in which a first audio signal is applied by a first electromechanical transducer to an acoustic space, causing changes in air pressure in the acoustic space, and a second audio signal is obtained by a second electromechanical transducer in response to changes in air pressure in the acoustic space, comprising: establishing, in response to the second audio signal and at least a portion of the first audio signal, a transfer function estimate of the electroacoustic channel, said transfer function estimate being derived from one or a combination of transfer functions selected from a group of transfer functions, said transfer function estimate being adaptive in response to temporal variations in the transfer function of the electroacoustic channel, and obtaining one or more filters whose transfer function is based on the transfer function estimate and filtering with the one or more filters at least a portion of the first audio signal, which portion of the first audio signal may or may not be the same portion as said first recited portion of the first audio signal.
2. A method according to enumerated example embodiment 1 further comprising implementing said transfer function estimate with one or more of a plurality of time-invariant filters.
3. A method according to enumerated example embodiment 1 or enumerated example embodiment 2 wherein said one or more filters whose transfer function is based on the transfer function estimate have a transfer function that is an inverted version of the transfer function estimate.
D07044WO01 29 4. A method according to any one of enumerated example embodiments 1-3 wherein the transfer function estimate is adaptive in response to a time average of temporal variations in the transfer function of the electroacoustic channel.
5. A method according to enumerated example embodiment 3 or enumerated example embodiment 4 as dependent on enumerated example embodiment 2 wherein said one or more of a plurality of time-invariant filters are HR filters.
6 A method according to enumerated example embodiment 3 or enumerated example embodiment 4 as dependent on enumerated example embodiment 2 wherein said one or more of a plurality of time-invariant filters are two filters in cascade, the first filter being an HR filter and the second filter being an FIR filter
7. A method according to any one of enumerated example embodiments 1-6 wherein said one or more filters whose transfer function is based on the transfer function estimate are IIR filters
8. A method according to any of enumerated example embodiments 1-6 wherein said one or more filters whose transfer function is based on the transfer function estimate are two filters in cascade, the first filter being an IIR filter and the second filter being an FIR filter.
9. A method according to any one of enumerated example embodiments 1-8 wherein said transfer function estimate is derived from one or a combination of transfer functions selected from a group of transfer functions by employing an error minimization technique. 10. A method according to any one of enumerated example embodiments 1-8 wherein said transfer function estimate is established by cross fading from one to another of said one or combination transfer functions selected from a group of transfer functions by employing an error minimization technique
11. A method according to any one of enumerated example embodiments 1-8 wherein said transfer function is established by selecting two or more of said transfer functions from said group of transfer functions and forming a weighted linear combination of them based on an error minimization technique.
12. A method according to any one of enumerated example embodiments 1-11 wherein the characteristics of one or more of the group of transfer functions includes the impulse responses of the electroacoustic channel across a range of variations in impulse responses with time.
13. A method according to enumerated example embodiment 12 wherein the impulse responses are measured impulse responses of real and/or simulated transmission channels.
D07044WO01 30 14 A method according to enumerated example embodiment 12 wherein the characteπstics of said group of transfer functions are obtained according to an eigenvector method
15 A method according to enumerated example embodiment 14 wherein the group of transfer functions are obtained by deriving the eigenvectors of the autocorrelation matrix of the time invariant filter characteπstics
16 A method according to enumerated example embodiment 14 wherein the defined group of time-invaπant filter characteristics are obtained by deriving the eigenvectors resulting from pei forming a singular value decomposition of a rectangulai matnx in which the rows of the matrix are a larger group of time-invariant filter characteristics
17 A method according to any one of enumerated example embodiments 1-16 wheiein said first electromechanical transducer is one of a loudspeaker, an earspeaker, a headphone ear piece, and an ear bud
18 A method according to any one of enumerated example embodiments 1-17 wherein said second electromechanical transducer is a microphone
19 A method according to any one of enumerated example embodiments 1-18 wherein said acoustic space is a small acoustic space at least partially bounded by an over- the-ear or an around-the-ear cup, the degree to which the small acoustic space is enclosed being dependant on the closeness and centering of the ear cup with respect to the ear 20 A method according to enumerated example embodiment 19 wherein said variations in the transfer function of the electroacoustic channel result from changes in the location of the small acoustical space with respect to said ear
21 A method according to any one of enumerated example embodiments 1-20 wherein each estimate of the transfer function of the electroacoustic channel is an estimate of the channel's magnitude response within a range of frequencies
22 A method according to any one of enumerated example embodiments 1-21 wherein said acoustic space also receives an audio disturbance signal
23 A method according to any one of enumerated example embodiments 1-21 wherein said acoustic space also receives an audio disturbance and said first audio signal includes (1) an error feedback signal deπved from the difference between the second audio signal and an audio signal obtained by applying said first audio signal to the filter based on the estimate of the transfer function of the electroacoustic channel, said difference being filtered by said one or more filters whose transfer function is an inverted version of the transfer function estimate, and (2) a speech and/or music audio signal
D07044WO01 31 24. A method according to enumerated example embodiment 23 wherein the method provides an active noise canceller in which the perceived audio response of the electroacoustic channel reduces or cancels the audio disturbance.
25. A method according to any one of enumerated example embodiments 1-21 wherein said first audio signal includes an audio input signal filtered by a target response filter and by said one or more filters.
26. A method according to enumerated example embodiment 25 wherein the method provides an equalizer in which the perceived audio response of the electroacoustic channel emulates the response of the target response filter. 27. A method according to any one of enumerated example embodiments 1-21 wherein said acoustic space also receives an audio disturbance and said first audio signal includes (1) an error feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying said first audio signal to the estimate of the transfer function of the electroacoustic channel, said difference being filtered by said one or more filters whose transfer function is an inverted version of the transfer function estimate, and (2) a speech and/or music audio signal filtered by a target response filter and also filtered by said one or more filters whose transfer function is an inverted version of the transfer function estimate.
28. A method according to enumerated example embodiment 27 wherein the method provides an active noise canceller in which the perceived audio response of the electroacoustic channel reduces or cancels the audio disturbance and also provides an equalizer in which the perceived audio response of the electroacoustic channel emulates the response of the target response filter.
29. A method according to enumerated example embodiment 26 or enumerated example embodiment 28 in which the target response filter has a flat response, whereby the filter may be omitted.
30. A method according to enumerated example embodiment 26 or enumerated example embodiment 28 in which the target response filter has a diffuse field response.
31. A method according to enumerated example embodiment 26 or enumerated example embodiment 28 in which the target response filter characteristic is user-specified.
32. A method according to enumerated example embodiment 23 or enumerated example embodiment 27 wherein said one or more filters whose transfer function is an inverted version of the transfer function estimate comprise a lower- frequency HR filter and an upper- frequency FIR filter in cascade.
DQ7Q44WO01 . 32 33 A method according to any one of enumerated example embodiments 1-21 wherein said first audio signal comprises an artificial signal selected to be inaudible
34 A method according to any one of enumerated example embodiments 1 -32 wherein said establishing responds to the second audio signal and at least a portion of the second audio signal as digital audio signals in the frequency domain
35 A method for altering the soundfield in an electroacoustic channel m which a first audio signal is applied by a first electromechanical transducei to an acoustic space, causing changes in air pressure in the acoustic space, and a second audio signal is obtained by a second electromechanical transducer in response to changes in air pressure in the acoustic space, comprising establishing, in response to the second audio signal and at least a portion of the fust audio signal, a transfer function estimate of the electroacoustic channel for a range of audio frequencies lower than an upper iange of audio frequencies, said transfer function estimate being derived from one or a combination of transfer functions selected from a group of transfer functions, said transfer function estimate being adaptive in response to temporal variations in the transfer function of the electroacoustic channel, obtaining one or more filters whose transfer function for said range of audio frequencies lower than an upper range of audio frequencies is based on the transfer function estimate and filtering with the one or more filters at least a portion of the first audio signal, which portion of the first audio signal may or may not be the same portion as said first recited portion of the first audio signal, and obtaining one or more filters whose transfer function for a range of frequencies higher than said lower range of frequencies is vaπably controlled by a gradient descent minimization process 36 A method according to enumerated example embodiment 35 furthei comprising implementing said transfer function estimate for said range of audio frequencies lower than an upper range of audio frequencies with one or more of a plurality of time-mvaπant filters
37 A method according to enumerated example embodiment 35 or 36 wherein said one or more filters whose transfer function for said range of audio frequencies lower than an upper range of audio frequencies is based on the transfer function estimate have a transfer function that is an inverted version of the transfer function estimate for said range of frequencies
38 A method according to enumerated example embodiment 35 wherein the gradient descent minimization process is responsive to the difference between said second audio
D07044WO01 33 signal and an audio signal obtained by applying at least a portion of said first audio signal to the seπes arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for said range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters having a time-mvaπant transfer response for a range of frequencies higher than said lower range of frequencies
39 A method according to enumerated example embodiment 38 wheiein the filter or filters estimating the electroacoustic channel transfer function for said range of audio frequencies lower than an upper range of audio frequencies is or are HR filters and the filter or filters having a time-mvaπant transfer response for a range of frequencies higher than said lower range of frequencies is or aie FIR filteis
40 A method according to any one of enumerated example embodiments 1-3 wherein said acoustic space also receives an audio disturbance and said first audio signal includes (1) an error feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying said first audio signal to the series arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for said range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters having a time-invariant transfer response for a range of frequencies higher than said lower range of frequencies, said difference being filtered by a seπes arrangement of (a) said one or more filters whose transfer function for said range of audio frequencies lower than an upper range of audio frequencies is an inverted version of the transfer function estimate and (b) one or more filters whose transfer function for a range of frequencies higher than said lower range of frequencies is variably controlled by a gradient descent minimization process, and (2) a speech and/or music audio signal
41 A method according to any one of enumerated example embodiments 35-39 wherein said acoustic space also receives an audio disturbance and said first audio signal includes (1) an en or feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying said first audio signal to the seπes arrangement of (a) a filter or filters estimating the electroacoustic channel transfer function for said range of audio frequencies lower than an upper range of audio frequencies and (b) a filter or filters having a time-mvaπant transfer response for a range of frequencies higher than said lower range of frequencies, said difference being filtered by a seπes arrangement of (a) said one or more filters whose transfer function for said range of audio frequencies lower than an upper range of audio frequencies is an inverted version of the transfer function estimate and (b) one or more filters whose transfer function for a range of frequencies higher
D07044WO01 34 than said lower range of frequencies is vaπably controlled by a gradient descent minimization process, and (2) a speech and/or music audio signal filtered by a target response filter and also filtered by said series arrangement of filters
42 A method for obtaining a set of filters whose linear combination estimates the impulse response of a time-varying transmission channel, comprising obtaining M filter observations, the observations including the impulse responses of the transmission channel across its range of possible variations with time, selecting N of M filters according to an eigenvector method, determining, in leal-time, a linear combination of the N filters that forms an optimal estimate of the transmission channel 43 The method of enumerated example embodiment 42 wherein the N selected filters are determined by deriving the eigenvectois of the autocorrelation matrix of the M observations
44 The method of enumerated example embodiment 42 wheiein the N selected filters aie determined by deriving the eigenvectors resulting from performing a Singular Value Decomposition of a rectangular matrix in which the rows of the matrix are said M observations
45 The method of any one of enumerated example embodiments 42-44 wherein a scaling factor for each of the N eigenvector filters is obtained using a gradient-descent optimization 46 The method of enumerated example embodiment 45 wherein said gradient- descent optimization employs an LMS algoπthm
47 The method of any one of enumerated example embodiments 42-46 wherein said M observations are measured impulse responses of real or simulated transmission channels 48 Apparatus adapted to perform the methods of any one of enumerated example embodiments 1-47
49 Apparatus comprising means adapted to perform each step of the method of any one of enumerated example embodiments 1 -47
50 A computer program, stored on a computer-readable medium, for causing a computer to perform the methods of any one of enumerated example embodiments 1-47. A number of example embodiments of the invention have been descπbed in the specifiation Nevertheless, it will be understood that vaπous modifications may be made without departing from the spiπt and scope of the invention For example, some of the steps descπbed herein may be order independent, and thus can be performed in an order different from that descπbed
D07044WO01 35

Claims

ClaimsWe claim:
1. A method for altenng the soundfϊeld m an electroacoustic channel in which a first audio signal is applied by a first electromechanical transducer to an acoustic space, causing changes in air pressure in the acoustic space, and a second audio signal is obtained by a second electromechanical transducer in response to changes in air pressure in the acoustic space, comprising. establishing, in response to the second audio signal and at least a portion of the first audio signal, a transfer function estimate of the electroacoustic channel, said transfer function estimate being derived from one or a combination of transfer functions selected from a group of transfer functions, said transfer function estimate being adaptive in response to temporal variations in the transfer function of the electroacoustic channel; and obtaining one or more filters whose transfer function is based on the transfer function estimate and filtering with the one or more filters at least a portion of the first audio signal, which portion of the first audio signal may or may not be the same portion as said first recited portion of the first audio signal.
2. A method according to claim 1 further comprising implementing said transfer function estimate with one or more of a plurality of time- invariant filters.
3. A method according to any one of claims 1-3 wherein the transfer function estimate is adaptive in response to a time average of temporal vaπations in the transfer function of the electroacoustic channel.
4. A method according to claim 3 wherein said one or more of a plurality of time- mvaπant filters compπse: one or more infinite impulse response (HR) filters; or at least two filters in cascade, the first filter being an HR filter and the second filter being an finite impulse response (FIR) filter.
5. A method according to any one of claims 1-4 wherein: said transfer function estimate is derived from one or a combination of transfer functions selected from a group of transfer functions by employing an error minimization technique;
D07044WO01 36 said transfer function estimate is established by cross fading from one to another of said one or combination transfer functions selected from a group of transfer functions by employing an error minimization technique; or said transfer function is established by selecting two or more of said transfer functions from said group of transfer functions and forming a weighted linear combination of them based on an error minimization technique.
6. A method according to any one of claims 1-5 wherein the characteristics of one or more of the group of transfer functions includes the impulse responses of the electroacoustic channel across a range of variations in impulse responses with time.
7. A method according to claim 6 wherein the characteristics of said group of transfer functions are obtained according to an eigenvector method.
8. A method according to any one of claims 1 -16 wherein: said first electromechanical transducer comprises at least one of a loudspeaker, an earspeaker, a headphone ear piece, or an ear bud; or said second electromechanical transducer comprises a microphone.
9. A method according to any one of claims 1-8 wherein said acoustic space comprises a small acoustic space at least partially bounded by an over-the-ear or an around- the-ear cup, the degree to which the small acoustic space is enclosed being dependant on the closeness and centering of the ear cup with respect to the ear.
10. A method according to claim 9 wherein said variations in the transfer function of the electroacoustic channel result from changes in the location of the small acoustical space with respect to said ear.
11. A method according to any one of claims 1-10 wherein each estimate of the transfer function of the electroacoustic channel comprises an estimate of the channel's magnitude response within a range of frequencies.
12. A method according to any one of claims 1-11 wherein also receives an audio disturbance signal and said first audio signal includes one or more of: an error feedback signal derived from the difference between the second audio signal and an audio signal obtained by applying said first audio signal to the filter based on the
D07044WO01 37 estimate of the transfer function of the electro acoustic channel, said difference being filtered by said one or more filters whose transfer function is an inverted version of the transfer function estimate, or a speech and/or music audio signal
13 A method according to claim 12 wherein the method includes actively cancelling noise, wherein the perceived audio response of the electroacoustic channel reduces or cancels the audio disturbance
14 An apparatus compπsmg means for performing method steps as recited in one or more of Claims 1-13
15 A computer readable storage medium product comprising encoded instructions which, when executing with one or more processors, controls the processors to perfoπn process steps as recited in one or more of Claims 1 -13
16 A use for a pi ocessor based system, compπsmg performing method steps as recited in one or more of Claims 1-13
D07Q44WO01 38
PCT/US2009/052042 2008-07-29 2009-07-29 Method for adaptive control and equalization of electroacoustic channels WO2010014663A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN200980130274XA CN102113346B (en) 2008-07-29 2009-07-29 Method for adaptive control and equalization of electroacoustic channels
JP2011521265A JP5241921B2 (en) 2008-07-29 2009-07-29 Methods for adaptive control and equalization of electroacoustic channels.
EP09790907.1A EP2311271B1 (en) 2008-07-29 2009-07-29 Method for adaptive control and equalization of electroacoustic channels
US13/056,251 US8693699B2 (en) 2008-07-29 2009-07-29 Method for adaptive control and equalization of electroacoustic channels

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13737708P 2008-07-29 2008-07-29
US61/137,377 2008-07-29

Publications (4)

Publication Number Publication Date
WO2010014663A2 true WO2010014663A2 (en) 2010-02-04
WO2010014663A8 WO2010014663A8 (en) 2010-05-27
WO2010014663A3 WO2010014663A3 (en) 2010-07-15
WO2010014663A9 WO2010014663A9 (en) 2010-11-25

Family

ID=41137825

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2009/052042 WO2010014663A2 (en) 2008-07-29 2009-07-29 Method for adaptive control and equalization of electroacoustic channels

Country Status (5)

Country Link
US (1) US8693699B2 (en)
EP (1) EP2311271B1 (en)
JP (1) JP5241921B2 (en)
CN (1) CN102113346B (en)
WO (1) WO2010014663A2 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010145723A1 (en) * 2009-06-17 2010-12-23 Sony Ericsson Mobile Communications Ab Portable communication device and a method of processing signals therein
CN102149035A (en) * 2010-02-10 2011-08-10 Nxp股份有限公司 System and method for adapting a loudspeaker signal
WO2012050705A1 (en) 2010-10-14 2012-04-19 Dolby Laboratories Licensing Corporation Automatic equalization using adaptive frequency-domain filtering and dynamic fast convolution
CN102903367A (en) * 2012-10-15 2013-01-30 苏州上声电子有限公司 Method and device for balancing frequency response of off-line iterative sound playback system
US8718291B2 (en) 2011-01-05 2014-05-06 Cambridge Silicon Radio Limited ANC for BT headphones
WO2015128390A1 (en) * 2014-02-27 2015-09-03 Sonarworks Sia Method of and apparatus for determining an equalization filter
US10038961B2 (en) 2014-06-09 2018-07-31 Dolby Laboratories Licensing Corporation Modeling a frequency response characteristic of an electro-acoustic transducer

Families Citing this family (115)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2356492T3 (en) * 2005-07-22 2011-04-08 France Telecom METHOD OF SWITCHING TRANSMISSION RATE IN SCALABLE AUDIO DECODING IN TRANSMISSION RATE AND BANDWIDTH.
GB2446966B (en) 2006-04-12 2010-07-07 Wolfson Microelectronics Plc Digital circuit arrangements for ambient noise-reduction
JP2010259008A (en) * 2009-04-28 2010-11-11 Toshiba Corp Signal processing apparatus, sound apparatus, and signal processing method
WO2010004056A2 (en) * 2009-10-27 2010-01-14 Phonak Ag Method and system for speech enhancement in a room
US9135907B2 (en) 2010-06-17 2015-09-15 Dolby Laboratories Licensing Corporation Method and apparatus for reducing the effect of environmental noise on listeners
US9142207B2 (en) 2010-12-03 2015-09-22 Cirrus Logic, Inc. Oversight control of an adaptive noise canceler in a personal audio device
US8908877B2 (en) 2010-12-03 2014-12-09 Cirrus Logic, Inc. Ear-coupling detection and adjustment of adaptive response in noise-canceling in personal audio devices
US8948407B2 (en) 2011-06-03 2015-02-03 Cirrus Logic, Inc. Bandlimiting anti-noise in personal audio devices having adaptive noise cancellation (ANC)
US8958571B2 (en) 2011-06-03 2015-02-17 Cirrus Logic, Inc. MIC covering detection in personal audio devices
US9318094B2 (en) 2011-06-03 2016-04-19 Cirrus Logic, Inc. Adaptive noise canceling architecture for a personal audio device
US9214150B2 (en) 2011-06-03 2015-12-15 Cirrus Logic, Inc. Continuous adaptation of secondary path adaptive response in noise-canceling personal audio devices
US9076431B2 (en) 2011-06-03 2015-07-07 Cirrus Logic, Inc. Filter architecture for an adaptive noise canceler in a personal audio device
US8848936B2 (en) 2011-06-03 2014-09-30 Cirrus Logic, Inc. Speaker damage prevention in adaptive noise-canceling personal audio devices
US9824677B2 (en) 2011-06-03 2017-11-21 Cirrus Logic, Inc. Bandlimiting anti-noise in personal audio devices having adaptive noise cancellation (ANC)
US9325821B1 (en) * 2011-09-30 2016-04-26 Cirrus Logic, Inc. Sidetone management in an adaptive noise canceling (ANC) system including secondary path modeling
EP2584558B1 (en) * 2011-10-21 2022-06-15 Harman Becker Automotive Systems GmbH Active noise reduction
US9184791B2 (en) 2012-03-15 2015-11-10 Blackberry Limited Selective adaptive audio cancellation algorithm configuration
US9082389B2 (en) * 2012-03-30 2015-07-14 Apple Inc. Pre-shaping series filter for active noise cancellation adaptive filter
US9014387B2 (en) 2012-04-26 2015-04-21 Cirrus Logic, Inc. Coordinated control of adaptive noise cancellation (ANC) among earspeaker channels
US9142205B2 (en) 2012-04-26 2015-09-22 Cirrus Logic, Inc. Leakage-modeling adaptive noise canceling for earspeakers
US9123321B2 (en) 2012-05-10 2015-09-01 Cirrus Logic, Inc. Sequenced adaptation of anti-noise generator response and secondary path response in an adaptive noise canceling system
US9076427B2 (en) * 2012-05-10 2015-07-07 Cirrus Logic, Inc. Error-signal content controlled adaptation of secondary and leakage path models in noise-canceling personal audio devices
US9318090B2 (en) 2012-05-10 2016-04-19 Cirrus Logic, Inc. Downlink tone detection and adaptation of a secondary path response model in an adaptive noise canceling system
US9319781B2 (en) 2012-05-10 2016-04-19 Cirrus Logic, Inc. Frequency and direction-dependent ambient sound handling in personal audio devices having adaptive noise cancellation (ANC)
US9082387B2 (en) 2012-05-10 2015-07-14 Cirrus Logic, Inc. Noise burst adaptation of secondary path adaptive response in noise-canceling personal audio devices
EP2667379B1 (en) 2012-05-21 2018-07-25 Harman Becker Automotive Systems GmbH Active noise reduction
US9532139B1 (en) 2012-09-14 2016-12-27 Cirrus Logic, Inc. Dual-microphone frequency amplitude response self-calibration
US9264823B2 (en) 2012-09-28 2016-02-16 Apple Inc. Audio headset with automatic equalization
JP6173484B2 (en) * 2013-01-08 2017-08-02 ドルビー・インターナショナル・アーベー Model-based prediction in critically sampled filter banks
US9107010B2 (en) 2013-02-08 2015-08-11 Cirrus Logic, Inc. Ambient noise root mean square (RMS) detector
EP2768208B1 (en) * 2013-02-19 2018-09-19 BlackBerry Limited Methods and apparatus for improving audio quality using an acoustic leak compensation system in a mobile device
US9148725B2 (en) 2013-02-19 2015-09-29 Blackberry Limited Methods and apparatus for improving audio quality using an acoustic leak compensation system in a mobile device
EP2770635A1 (en) * 2013-02-25 2014-08-27 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Equalization filter coefficient determinator, apparatus, equalization filter coefficient processor, system and methods
JP6100562B2 (en) * 2013-02-28 2017-03-22 リオン株式会社 Hearing aid and booming noise suppression device
US9369798B1 (en) 2013-03-12 2016-06-14 Cirrus Logic, Inc. Internal dynamic range control in an adaptive noise cancellation (ANC) system
US9106989B2 (en) 2013-03-13 2015-08-11 Cirrus Logic, Inc. Adaptive-noise canceling (ANC) effectiveness estimation and correction in a personal audio device
US9414150B2 (en) 2013-03-14 2016-08-09 Cirrus Logic, Inc. Low-latency multi-driver adaptive noise canceling (ANC) system for a personal audio device
US9743201B1 (en) * 2013-03-14 2017-08-22 Apple Inc. Loudspeaker array protection management
US9215749B2 (en) 2013-03-14 2015-12-15 Cirrus Logic, Inc. Reducing an acoustic intensity vector with adaptive noise cancellation with two error microphones
US9635480B2 (en) 2013-03-15 2017-04-25 Cirrus Logic, Inc. Speaker impedance monitoring
US9208771B2 (en) 2013-03-15 2015-12-08 Cirrus Logic, Inc. Ambient noise-based adaptation of secondary path adaptive response in noise-canceling personal audio devices
US9467776B2 (en) 2013-03-15 2016-10-11 Cirrus Logic, Inc. Monitoring of speaker impedance to detect pressure applied between mobile device and ear
US9324311B1 (en) 2013-03-15 2016-04-26 Cirrus Logic, Inc. Robust adaptive noise canceling (ANC) in a personal audio device
US10206032B2 (en) 2013-04-10 2019-02-12 Cirrus Logic, Inc. Systems and methods for multi-mode adaptive noise cancellation for audio headsets
US9066176B2 (en) 2013-04-15 2015-06-23 Cirrus Logic, Inc. Systems and methods for adaptive noise cancellation including dynamic bias of coefficients of an adaptive noise cancellation system
US9462376B2 (en) 2013-04-16 2016-10-04 Cirrus Logic, Inc. Systems and methods for hybrid adaptive noise cancellation
US9478210B2 (en) 2013-04-17 2016-10-25 Cirrus Logic, Inc. Systems and methods for hybrid adaptive noise cancellation
US9460701B2 (en) 2013-04-17 2016-10-04 Cirrus Logic, Inc. Systems and methods for adaptive noise cancellation by biasing anti-noise level
US9578432B1 (en) 2013-04-24 2017-02-21 Cirrus Logic, Inc. Metric and tool to evaluate secondary path design in adaptive noise cancellation systems
US9083782B2 (en) 2013-05-08 2015-07-14 Blackberry Limited Dual beamform audio echo reduction
US9515629B2 (en) * 2013-05-16 2016-12-06 Apple Inc. Adaptive audio equalization for personal listening devices
JP6196070B2 (en) * 2013-05-21 2017-09-13 リオン株式会社 Muffled sound reduction device, hearing aid equipped with the same, earphone for audio, earplug
US9264808B2 (en) 2013-06-14 2016-02-16 Cirrus Logic, Inc. Systems and methods for detection and cancellation of narrow-band noise
US9666176B2 (en) 2013-09-13 2017-05-30 Cirrus Logic, Inc. Systems and methods for adaptive noise cancellation by adaptively shaping internal white noise to train a secondary path
US9620101B1 (en) 2013-10-08 2017-04-11 Cirrus Logic, Inc. Systems and methods for maintaining playback fidelity in an audio system with adaptive noise cancellation
US10382864B2 (en) 2013-12-10 2019-08-13 Cirrus Logic, Inc. Systems and methods for providing adaptive playback equalization in an audio device
US9704472B2 (en) 2013-12-10 2017-07-11 Cirrus Logic, Inc. Systems and methods for sharing secondary path information between audio channels in an adaptive noise cancellation system
US9531433B2 (en) * 2014-02-07 2016-12-27 Analog Devices Global Echo cancellation methodology and assembly for electroacoustic communication apparatuses
US9293128B2 (en) * 2014-02-22 2016-03-22 Apple Inc. Active noise control with compensation for acoustic leak in personal listening devices
US9369557B2 (en) 2014-03-05 2016-06-14 Cirrus Logic, Inc. Frequency-dependent sidetone calibration
US9479860B2 (en) 2014-03-07 2016-10-25 Cirrus Logic, Inc. Systems and methods for enhancing performance of audio transducer based on detection of transducer status
US9648410B1 (en) 2014-03-12 2017-05-09 Cirrus Logic, Inc. Control of audio output of headphone earbuds based on the environment around the headphone earbuds
US9319784B2 (en) 2014-04-14 2016-04-19 Cirrus Logic, Inc. Frequency-shaped noise-based adaptation of secondary path adaptive response in noise-canceling personal audio devices
US9486823B2 (en) * 2014-04-23 2016-11-08 Apple Inc. Off-ear detector for personal listening device with active noise control
US9609416B2 (en) 2014-06-09 2017-03-28 Cirrus Logic, Inc. Headphone responsive to optical signaling
US10181315B2 (en) 2014-06-13 2019-01-15 Cirrus Logic, Inc. Systems and methods for selectively enabling and disabling adaptation of an adaptive noise cancellation system
WO2016002358A1 (en) * 2014-06-30 2016-01-07 ソニー株式会社 Information-processing device, information processing method, and program
US9478212B1 (en) 2014-09-03 2016-10-25 Cirrus Logic, Inc. Systems and methods for use of adaptive secondary path estimate to control equalization in an audio device
US9552805B2 (en) 2014-12-19 2017-01-24 Cirrus Logic, Inc. Systems and methods for performance and stability control for feedback adaptive noise cancellation
CN104661153B (en) * 2014-12-31 2018-02-02 歌尔股份有限公司 A kind of compensation method of earphone audio, device and earphone
US9736614B2 (en) * 2015-03-23 2017-08-15 Bose Corporation Augmenting existing acoustic profiles
US9788114B2 (en) 2015-03-23 2017-10-10 Bose Corporation Acoustic device for streaming audio data
CN108140380B (en) * 2015-08-20 2022-05-27 思睿逻辑国际半导体有限公司 Adaptive noise cancellation feedback controller and method with feedback response provided in part by fixed response filter
US10026388B2 (en) 2015-08-20 2018-07-17 Cirrus Logic, Inc. Feedback adaptive noise cancellation (ANC) controller and method having a feedback response partially provided by a fixed-response filter
US9578415B1 (en) 2015-08-21 2017-02-21 Cirrus Logic, Inc. Hybrid adaptive noise cancellation system with filtered error microphone signal
US9607603B1 (en) * 2015-09-30 2017-03-28 Cirrus Logic, Inc. Adaptive block matrix using pre-whitening for adaptive beam forming
CN105246000A (en) * 2015-10-28 2016-01-13 维沃移动通信有限公司 Method for improving sound quality of headset and mobile terminal
WO2017088166A1 (en) * 2015-11-27 2017-06-01 深圳市柔宇科技有限公司 Control method for head-mounted playing device and head-mounted playing device
AU2017231808B2 (en) * 2016-03-09 2021-08-12 Peerbridge Health, Inc. System and method for monitoring conditions of a subject based on wireless sensor data
US10013966B2 (en) 2016-03-15 2018-07-03 Cirrus Logic, Inc. Systems and methods for adaptive active noise cancellation for multiple-driver personal audio device
US9881600B1 (en) * 2016-07-29 2018-01-30 Bose Corporation Acoustically open headphone with active noise reduction
US10034092B1 (en) 2016-09-22 2018-07-24 Apple Inc. Spatial headphone transparency
JP6790654B2 (en) * 2016-09-23 2020-11-25 株式会社Jvcケンウッド Filter generator, filter generator, and program
US10170095B2 (en) 2017-04-20 2019-01-01 Bose Corporation Pressure adaptive active noise cancelling headphone system and method
US10276145B2 (en) * 2017-04-24 2019-04-30 Cirrus Logic, Inc. Frequency-domain adaptive noise cancellation system
US11468873B2 (en) * 2017-09-29 2022-10-11 Cirrus Logic, Inc. Gradual reset of filter coefficients in an adaptive noise cancellation system
CN107731217B (en) * 2017-10-18 2020-09-25 恒玄科技(上海)股份有限公司 Active noise reduction system and method for realizing fitting of different frequency responses
US10827265B2 (en) * 2018-01-25 2020-11-03 Cirrus Logic, Inc. Psychoacoustics for improved audio reproduction, power reduction, and speaker protection
FR3079051B1 (en) * 2018-03-13 2022-01-28 Airbus Operations Sas METHOD FOR ADJUSTING AN ELECTRICAL SIGNAL FROM A MICROPHONE
CN108828422B (en) * 2018-05-30 2021-08-13 西安易恩电气科技有限公司 Avalanche tolerance test circuit
CN108810746A (en) * 2018-07-27 2018-11-13 歌尔科技有限公司 A kind of sound quality optimization method, feedback noise reduction system, earphone and storage medium
JP6730384B2 (en) * 2018-08-23 2020-07-29 Ttr株式会社 Electro-acoustic transducer
CN115190389A (en) 2018-12-24 2022-10-14 华为技术有限公司 Audio data transmission method and equipment applied to TWS earphone single-ear and double-ear switching
US11387790B2 (en) 2019-01-24 2022-07-12 Analog Devices International Unlimited Company Power semiconductor device with charge trapping compensation
US11166099B2 (en) 2019-09-27 2021-11-02 Apple Inc. Headphone acoustic noise cancellation and speaker protection or dynamic user experience processing
US11361745B2 (en) 2019-09-27 2022-06-14 Apple Inc. Headphone acoustic noise cancellation and speaker protection
US11709244B2 (en) * 2019-10-21 2023-07-25 Banner Engineering Corp. Near range radar
CN110933554B (en) * 2019-12-13 2022-02-15 恒玄科技(上海)股份有限公司 Active noise reduction method and system and earphone
CN110996209B (en) * 2019-12-13 2022-02-15 恒玄科技(上海)股份有限公司 Active noise reduction method and system and earphone
CN110996210B (en) * 2019-12-13 2021-11-23 恒玄科技(上海)股份有限公司 Method for sound field equalization and earphone
US11533070B2 (en) 2019-12-23 2022-12-20 Analog Devices International Unlimited Company Systems and methods of compensating for narrowband distortion in power semiconductor devices
JP2022013116A (en) * 2020-07-03 2022-01-18 アルプスアルパイン株式会社 Active noise control system
EP3944237A1 (en) * 2020-07-21 2022-01-26 EPOS Group A/S A loudspeaker system provided with dynamic speech equalization
US11206004B1 (en) * 2020-09-16 2021-12-21 Apple Inc. Automatic equalization for consistent headphone playback
US11153682B1 (en) 2020-09-18 2021-10-19 Cirrus Logic, Inc. Micro-speaker audio power reproduction system and method with reduced energy use and thermal protection using micro-speaker electro-acoustic response and human hearing thresholds
US11159888B1 (en) 2020-09-18 2021-10-26 Cirrus Logic, Inc. Transducer cooling by introduction of a cooling component in the transducer input signal
CN112233642B (en) * 2020-10-14 2022-07-08 中车青岛四方机车车辆股份有限公司 Method and device for signal noise reduction in active noise reduction system and train
US11563409B2 (en) 2020-10-26 2023-01-24 Analog Devices International Unlimited Company Configurable non-linear filter for digital pre-distortion
CN112468918A (en) * 2020-11-13 2021-03-09 北京安声浩朗科技有限公司 Active noise reduction method and device, electronic equipment and active noise reduction earphone
CN112562624B (en) * 2020-11-30 2021-08-17 深圳百灵声学有限公司 Active noise reduction filter design method, noise reduction method, system and electronic equipment
TWI778525B (en) * 2021-02-24 2022-09-21 中原大學 Design method for feedforward active noise control system
CN113595527B (en) * 2021-07-30 2023-10-20 国光电器股份有限公司 Filtering parameter determining method, filtering method and related device
US11688383B2 (en) 2021-08-27 2023-06-27 Apple Inc. Context aware compressor for headphone audio feedback path
CN113938787B (en) * 2021-12-16 2022-03-15 深圳市鑫正宇科技有限公司 Bone conduction earphone based on digital equalization technology
US11790882B2 (en) * 2022-03-15 2023-10-17 Shenzhen GOODIX Technology Co., Ltd. Active noise cancellation filter adaptation with ear cavity frequency response compensation

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2441835A (en) 2007-02-07 2008-03-19 Sonaptic Ltd Ambient noise reduction system with a limited family of responses

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4677677A (en) 1985-09-19 1987-06-30 Nelson Industries Inc. Active sound attenuation system with on-line adaptive feedback cancellation
US4677676A (en) 1986-02-11 1987-06-30 Nelson Industries, Inc. Active attenuation system with on-line modeling of speaker, error path and feedback pack
US5481615A (en) 1993-04-01 1996-01-02 Noise Cancellation Technologies, Inc. Audio reproduction system
JPH06332474A (en) 1993-05-25 1994-12-02 Matsushita Electric Ind Co Ltd Noise silencer
JP2872547B2 (en) 1993-10-13 1999-03-17 シャープ株式会社 Active control method and apparatus using lattice filter
US5602929A (en) 1995-01-30 1997-02-11 Digisonix, Inc. Fast adapting control system and method
JPH08251082A (en) * 1995-03-13 1996-09-27 Sony Corp Echo removing device
FI108909B (en) * 1996-08-13 2002-04-15 Nokia Corp Earphone element and terminal
US5692055A (en) * 1996-09-24 1997-11-25 Honda Giken Kogyo Kabushiki Kaisha Active noise-suppressive control method and apparatus
US7031460B1 (en) 1998-10-13 2006-04-18 Lucent Technologies Inc. Telephonic handset employing feed-forward noise cancellation
GB2360165A (en) 2000-03-07 2001-09-12 Central Research Lab Ltd A method of improving the audibility of sound from a loudspeaker located close to an ear
US6996241B2 (en) 2001-06-22 2006-02-07 Trustees Of Dartmouth College Tuned feedforward LMS filter with feedback control
CA2354755A1 (en) * 2001-08-07 2003-02-07 Dspfactory Ltd. Sound intelligibilty enhancement using a psychoacoustic model and an oversampled filterbank
US20040109570A1 (en) * 2002-06-21 2004-06-10 Sunil Bharitkar System and method for selective signal cancellation for multiple-listener audio applications
US6917688B2 (en) 2002-09-11 2005-07-12 Nanyang Technological University Adaptive noise cancelling microphone system
ATE402468T1 (en) 2004-03-17 2008-08-15 Harman Becker Automotive Sys SOUND TUNING DEVICE, USE THEREOF AND SOUND TUNING METHOD
US7433463B2 (en) * 2004-08-10 2008-10-07 Clarity Technologies, Inc. Echo cancellation and noise reduction method
EP1720249B1 (en) * 2005-05-04 2009-07-15 Harman Becker Automotive Systems GmbH Audio enhancement system and method
US20080273716A1 (en) 2005-09-27 2008-11-06 Kosuke Saito Feedback Sound Eliminating Apparatus
US8270625B2 (en) * 2006-12-06 2012-09-18 Brigham Young University Secondary path modeling for active noise control

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2441835A (en) 2007-02-07 2008-03-19 Sonaptic Ltd Ambient noise reduction system with a limited family of responses

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8218779B2 (en) 2009-06-17 2012-07-10 Sony Ericsson Mobile Communications Ab Portable communication device and a method of processing signals therein
WO2010145723A1 (en) * 2009-06-17 2010-12-23 Sony Ericsson Mobile Communications Ab Portable communication device and a method of processing signals therein
EP3076545A1 (en) * 2010-02-10 2016-10-05 Nxp B.V. System and method for adapting a loudspeaker signal
CN102149035A (en) * 2010-02-10 2011-08-10 Nxp股份有限公司 System and method for adapting a loudspeaker signal
EP2357726A1 (en) * 2010-02-10 2011-08-17 Nxp B.V. System and method for adapting a loudspeaker signal
US9538303B2 (en) 2010-02-10 2017-01-03 Nxp B.V. System and method for adapting a loudspeaker signal
US9014384B2 (en) 2010-02-10 2015-04-21 Nxp B.V. System and method for adapting a loudspeaker signal
WO2012050705A1 (en) 2010-10-14 2012-04-19 Dolby Laboratories Licensing Corporation Automatic equalization using adaptive frequency-domain filtering and dynamic fast convolution
US9084049B2 (en) 2010-10-14 2015-07-14 Dolby Laboratories Licensing Corporation Automatic equalization using adaptive frequency-domain filtering and dynamic fast convolution
US8718291B2 (en) 2011-01-05 2014-05-06 Cambridge Silicon Radio Limited ANC for BT headphones
CN102903367A (en) * 2012-10-15 2013-01-30 苏州上声电子有限公司 Method and device for balancing frequency response of off-line iterative sound playback system
WO2015128390A1 (en) * 2014-02-27 2015-09-03 Sonarworks Sia Method of and apparatus for determining an equalization filter
US10021484B2 (en) 2014-02-27 2018-07-10 Sonarworks Sia Method of and apparatus for determining an equalization filter
US10038961B2 (en) 2014-06-09 2018-07-31 Dolby Laboratories Licensing Corporation Modeling a frequency response characteristic of an electro-acoustic transducer

Also Published As

Publication number Publication date
JP2011530218A (en) 2011-12-15
EP2311271A2 (en) 2011-04-20
CN102113346A (en) 2011-06-29
WO2010014663A9 (en) 2010-11-25
EP2311271B1 (en) 2014-09-03
WO2010014663A3 (en) 2010-07-15
CN102113346B (en) 2013-10-30
JP5241921B2 (en) 2013-07-17
US20110142247A1 (en) 2011-06-16
WO2010014663A8 (en) 2010-05-27
US8693699B2 (en) 2014-04-08

Similar Documents

Publication Publication Date Title
US8693699B2 (en) Method for adaptive control and equalization of electroacoustic channels
US9633645B2 (en) Adaptive noise control system with improved robustness
US9053697B2 (en) Systems, methods, devices, apparatus, and computer program products for audio equalization
EP2284831B1 (en) Method and device for active noise reduction using perceptual masking
KR102245356B1 (en) Frequency-shaped noise-based adaptation of secondary path adaptive response in noise-canceling personal audio devices
US9293128B2 (en) Active noise control with compensation for acoustic leak in personal listening devices
Liebich et al. Signal processing challenges for active noise cancellation headphones
US11468875B2 (en) Ambient detector for dual mode ANC
EP2380163A1 (en) Active audio noise cancelling
CN113711303B (en) Method for tuning an audio system supporting noise cancellation and audio system supporting noise cancellation
CN113450754A (en) Active noise cancellation system and method
Fabry et al. Acoustic equalization for headphones using a fixed feed-forward filter
Schepker et al. A semidefinite programming approach to min-max estimation of the common part of acoustic feedback paths in hearing aids
US11206004B1 (en) Automatic equalization for consistent headphone playback
US11948546B2 (en) Feed-forward adaptive noise-canceling with dynamic filter selection based on classifying acoustic environment
Weyer et al. Feedback-Aware Design of an Occlusion Effect Reduction System Using an Earbud-Mounted Vibration Sensor
Zorzo et al. Design and analysis of a digital active noise control system for headphones implemented in an Arduino compatible microcontroller
Guldenschuh Noise Cancellation for Headphones
Laska et al. Subband adaptive filtering for acoustic feedback compensation in hearing aids

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980130274.X

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09790907

Country of ref document: EP

Kind code of ref document: A2

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 13056251

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2011521265

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2009790907

Country of ref document: EP