WO2013106370A1 - Multi-rate filter system - Google Patents

Multi-rate filter system Download PDF

Info

Publication number
WO2013106370A1
WO2013106370A1 PCT/US2013/020740 US2013020740W WO2013106370A1 WO 2013106370 A1 WO2013106370 A1 WO 2013106370A1 US 2013020740 W US2013020740 W US 2013020740W WO 2013106370 A1 WO2013106370 A1 WO 2013106370A1
Authority
WO
WIPO (PCT)
Prior art keywords
filter
rate
accordance
signal
rate filter
Prior art date
Application number
PCT/US2013/020740
Other languages
French (fr)
Inventor
Erik Lindahl
Ludvig LINDBLOM
Pär Gunnars RISBERG
Landy Toth
Original Assignee
Actiwave Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Actiwave Ab filed Critical Actiwave Ab
Priority to EP13735847.9A priority Critical patent/EP2803137B1/en
Priority to CN201380005196.7A priority patent/CN104040888B/en
Priority to US14/371,020 priority patent/US20150010170A1/en
Publication of WO2013106370A1 publication Critical patent/WO2013106370A1/en
Priority to US15/411,466 priority patent/US20170134854A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/04Circuits for transducers, loudspeakers or microphones for correcting frequency response
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03HIMPEDANCE NETWORKS, e.g. RESONANT CIRCUITS; RESONATORS
    • H03H17/00Networks using digital techniques
    • H03H17/02Frequency selective networks
    • H03H17/0248Filters characterised by a particular frequency response or filtering method
    • H03H17/0261Non linear filters
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03HIMPEDANCE NETWORKS, e.g. RESONANT CIRCUITS; RESONATORS
    • H03H17/00Networks using digital techniques
    • H03H17/02Frequency selective networks
    • H03H17/0283Filters characterised by the filter structure
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03HIMPEDANCE NETWORKS, e.g. RESONANT CIRCUITS; RESONATORS
    • H03H17/00Networks using digital techniques
    • H03H17/02Frequency selective networks
    • H03H17/0294Variable filters; Programmable filters
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03HIMPEDANCE NETWORKS, e.g. RESONANT CIRCUITS; RESONATORS
    • H03H17/00Networks using digital techniques
    • H03H17/02Frequency selective networks
    • H03H17/06Non-recursive filters
    • H03H17/0621Non-recursive filters with input-sampling frequency and output-delivery frequency which differ, e.g. extrapolation; Anti-aliasing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00Signal processing covered by H04R, not provided for in its groups
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00Signal processing covered by H04R, not provided for in its groups
    • H04R2430/03Synergistic effects of band splitting and sub-band processing

Definitions

  • the present disclosure is directed to digital filters and particularly to multi- rate digital filters for audio signal processing.
  • a feed forward or a feedback digital filter typically includes a number of equally spaced taps with each tap separated by a delay line and multiplied by a filter coefficient.
  • the filter coefficients determine the impulse response of the filter.
  • a feed forward digital filter for use on a signal with broad spectral content may often require excessive sampling of the signal, particularly as related to the low frequency content thereof.
  • the resulting complexity of the filter may be challenging to implement in resource constrained devices, as it may consume additional hardware and software resources with increased bandwidth coverage and complexity.
  • One objective of the present disclosure is to provide a filter system.
  • Another objective is to provide a filter system for enhancing audio output from a consumer electronics device.
  • a multi-rate filter system including an input channel configured to receive an input signal, an output channel configured to output a filtered signal, a cascade of multi-rate filter blocks coupled between the input channel and the output channel.
  • At least one of the multi-rate filter blocks includes a bandselector comprising a bandselector input, a highpass bandselector output, a lowpass bandselector output connected to a subsequent multi- rate filter block, and a downsampler connected between the bandselector input and the lowpass bandselector output, a signal processing block coupled to the highpass bandselector output, the signal processing block comprising a linear filter component, and a bandcombiner connected to the signal processing block, the bandcombiner comprising two bandcombiner inputs, a bandcombiner output, and an upsampler, the first bandcombiner input connected to the signal processing block, the second bandcombiner input connected to a subsequent multi-rate filter block, and the bandcombiner output connected to a prior multi-rate filter block, the upsampler connected between the bandcombiner inputs and the bandcombiner output.
  • the linear filter component may be selected from a group including a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Kalman filter, a neural network, a fuzzy logic filter, a lattice wave filter, a linear phase filter, a near linear phase filter, and combinations thereof.
  • the linear filter component may include reconfigurable filter parameters in accordance with the present disclosure.
  • the signal processing block may include a nonlinear filter component in accordance with the present disclosure connected to the linear filter component.
  • a nonlinear filter component include a compressor, a polynomial, a limiter, and combinations thereof.
  • one or more multi-rate filter blocks may include an observer in accordance with the present disclosure configured to output an observer signal, the observer connected to the signal processing block between the highpass bandselector output and the first bandcombiner input.
  • the observer may include a power monitor.
  • One or more filter components e.g the nonlinear filter component, the linear filter component
  • may be configured to respond to the observer signal e.g. by changing a filter gain, alter a parameter, attack, release, etc.).
  • the multi-rate filter system may include a nonlinear functional block (NLFB) including an NLFB input and an NLFB output.
  • the NLFB input may be connected to the bandcombiner output of a first multi-rate filter block and the NLFB output may be connected to the bandcombiner input of a second second multi- rate filter block.
  • the nonlinear function block may include a psychoacoustic function.
  • the downsampler may be an m: l downsampler, where m is a sample rate
  • the upsampler may be a 1 :k upsampler, where k is a sample rate.
  • the sample rates m and k may be equal.
  • the sample rates m and/or k may be less than or equal to 2, less than or equal to 1.5, less than or equal to 1.33, or less than or equal to 1.25.
  • the multi-rate filter blocks may span an audio signal bandwidth.
  • the bandselector may include a low pass filter connected between the bandselector input and the bandselector lowpass output, and a high pass filter connected between the bandselector input and the bandselector highpass output.
  • a complimentary filter pair may be formed by the low pass filter and high pass filter.
  • the bandcombiner may include a summer connected to the bandcombiner inputs and the upsampler and/or a low pass filter connected between the upsampler and the bandcombiner output.
  • the multi-rate filter system may include a control channel configured to receive a control signal, with at least one multi-rate filter block being connected to the control channel.
  • the linear filter component and/or the nonlinear filter component may be configured to respond to the control signal.
  • a method for filtering a signal including, processing an input signal with a plurality of multi-rate filter blocks, the processing of at least one multi-rate filter block including, downsampling to produce a downsampled signal, providing the downsampled signal to a subsequent multi-rate filter block, processing with a linear filter component to form a linear filtered signal, processing with a nonlinear filter component to form a nonlinear filtered signal, combining or selecting the linear filtered signal and/or the nonlinear filtered signal to form a filtered output signal, and upsampling the filtered output signal to form an increased rate signal.
  • the method may include processing at least one increased rate signal with a nonlinear functional block (NLFB) to form a nonlinear processed signal, providing the nonlinear processed signal to a prior multi-rate filter block, and/or providing the increased rate signal to a prior multi-rate filter block.
  • NLFB nonlinear functional block
  • linear filter component examples include a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Kalman filter, a neural network, a fuzzy logic filter, and combinations thereof.
  • FIR finite impulse response
  • IIR infinite impulse response
  • Kalman filter a Kalman filter
  • neural network a neural network
  • fuzzy logic filter a fuzzy logic filter
  • Suitable non-limiting examples of the nonlinear filter component include a compressor, a polynomial, a limiter, and combination thereof.
  • a method for matching a multi-rate filter system in accordance with the present disclosure to a predetermined wideband filter including, assigning the number of multi-rate filter blocks in the multi-rate filter system, calculating an initial guess for one or more of the multi-rate filter blocks, optimizing the multi-rate filter blocks towards the wideband filter to form one or more updated multi-rate filter blocks; and constructing a matched multi- rate filter system from the updated multi-rate filter blocks.
  • the step of calculating may be performed via any method in accordance with the present disclosure.
  • the step of calculating may be performed using a Parks-McClellan algorithm.
  • the step of optimizing may be performed on one or more bandselectors and one or more bandcombiners included in the multi-rate filter system, and separately on one or more of the signal processing blocks included in the multi-rate filter system.
  • the method may include adding a nonlinear function block to one or more of the multi-rate filter blocks and optionally configuring the nonlinear function block to match a psychoacoustic function, a compressor, a limiter, or the like.
  • Fig. la shows a schematic of a multi-rate filter system in accordance with the present disclosure.
  • FIGs. 2a-e show diagrams of processing blocks associated with a multi-rate filter system in accordance with the present disclosure.
  • FIG. 3 shows a nonlinear functional block for implementing an audio enhancement algorithm with a multi-rate filter system in accordance with the present disclosure.
  • Fig. 4 shows a feedback system for use with a multi-rate filter system in accordance with the present disclosure.
  • Fig. 5 shows an example of a multi-rate filter system including a nonlinear functional block in accordance with the present disclosure.
  • Fig. 6a-b show examples of frequency bands associated with a multi-rate filter system in accordance with the present disclosure.
  • Fig. 7a-b show a method for optimizing a multi-rate filter in accordance with the present disclosure and a resulting error spectral response.
  • consumer electronic device a cellular phone (e.g. a smartphone), a tablet computer, a laptop computer, a portable media player, a television, a portable gaming device, a gaming console, a gaming controller, a remote control, an appliance (e.g. a toaster, a refrigerator, a bread maker, a microwave, a vacuum cleaner, etc.) a power tool (a drill, a blender, etc.), a robot (e.g. an autonomous cleaning robot, a care giving robot, etc.), a toy (e.g. a doll, a figurine, a construction set, a tractor, etc.), a greeting card, a home entertainment system, an active loudspeaker, a sound bar, etc.
  • a cellular phone e.g. a smartphone
  • a tablet computer e.g. a tablet computer
  • a laptop computer e.g. a portable media player
  • television e.g. a portable gaming device
  • a gaming console e.g.
  • Fig. 1 shows a multi-rate filter system in accordance with the present disclosure.
  • the filter system includes an input channel 1 configured to accept an input signal Si n from an external source (e.g. a processor, an signal streaming device, an audio feedback device, a wireless transceiver, an ADC, an audio decoder circuit, a DSP, etc.), and an output channel 2 for outputting a filtered signal S ou t, and a plurality of multi-rate filter blocks 10.
  • an external source e.g. a processor, an signal streaming device, an audio feedback device, a wireless transceiver, an ADC, an audio decoder circuit, a DSP, etc.
  • At least one of the multi-rate filter blocks 10 includes a bandselector BSi configured to accept a signal from the input channel 1 or a previous multi-rate filter block 10 and to produce a highpass bandselector output signal HPi, and a lowpass bandselector output signal LP; to be delivered to a subsequent multi-rate filter block or to a subband processing block (e.g. a signal processing block covering the lowest signal band of interest).
  • the multi-rate filter block 10 may also include a signal processing block APi connected to the bandselector BSi.
  • the signal processing block APi may include a linear filter component (e.g.
  • the multi-rate filter block 10 may also include a bandcombiner connected to the signal processing block APi.
  • the bandcombiner US may include two bandcombiner inputs, a bandcombiner output, and an upsampler.
  • the first bandcombiner input FSi may be connected to the signal processing block APi, the second bandcombiner input SPi + i may be connected to a subsequent multi-rate filter block, and the bandcombiner output SP; connected to a prior multi-rate filter block.
  • the upsampler may be connected between the bandcombiner inputs FSi, SPi +1 and the bandcombiner output SP;.
  • the bandselector BSi may be configured to isolate a signal band to produce the bandselector highpass output HP;. This function may be achieved with a high pass filter.
  • the band selector may also be configured to produce a lowpass bandselector output LP; at a resampled rate. This function may be achieved using a downsampler (e.g. an m: l downsampler where m is a sample rate, a 8: 1 , 6: 1 , 4: 1 , 3 : 1 , 2: 1 , 1.5 : 1 , 1.25 : 1 , downsampler, an adaptive sampling unit, an asynchronous sample rate converter, etc.), optionally in conjunction with a low pass filter.
  • a downsampler e.g. an m: l downsampler where m is a sample rate, a 8: 1 , 6: 1 , 4: 1 , 3 : 1 , 2: 1 , 1.5 : 1 , 1.25 : 1
  • the highpass filter and the lowpass filter included in the bandselector BSi may be complimentary filter pairs (i.e. so as to provide perfectly matched filters and to simplify the filter design).
  • the downsampler associated with each bandselector BSi may be configured to perform a different change in sampling rate, from the other downsamplers in the system, it may be similar, etc. (i.e. each downsampler may have a unique value m, m may be the same for a plurality or all of the downsamplers, etc.).
  • Each signal processing block APi may be configured so as to operate at an associated sample rate.
  • the sample rate may be determined by the associated downsampler or a filter block controller (not explicitly shown).
  • a filter block controller may be configured to set filter parameters for each of the components of the filter system upon startup, upon firmware update, etc.
  • Each signal processing block APi may be configured to process the associated highpass bandselector output signal HP; with a predetermined degree of precision (i.e. bit count).
  • signal processing blocks APi associated with progressively lower frequency bands may be configured to analyze the associated signals with increasing degree of precision.
  • the associated downsampler may be configured to increase the precision of the output generated therefrom by an amount related to the downsampling parameter. Such changes in precision may be advantageous to compromise between delay and the number of filter blocks 10 in the filter system.
  • the signal processing block APi may include a linear filter component (e.g. a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Kalman filter, a neural network, a fuzzy logic filter, a butterworth filter, etc.), for modifying the signal content in the selected band.
  • the signal processing block APi may include a nonlinear filter component nLBi (a clipper, a compressor, a limiter, an integrator, a multiplier, a convolution, a rectifier, a piecewise linear shaping function, a nonlinear transfer function, and/or an asymmetric polynomial function to calculate at least a portion of the second enhanced signal, etc.).
  • nLBi a nonlinear filter component
  • the linear and/or nonlinear filter components may be configured to process the signal content within the selected band.
  • the nonlinear filter may be configured to generate signal content out of band.
  • the acceptable out of band range may be determined by the bandwidth associated with the band and the sample rate associated with the band.
  • the bandcombiner US may be connected to the signal processing block APi and the bandcombiner output SPi + i from a subsequent multi-rate filter block.
  • the bandcombiner US may include a summer to combine the inputs signals thereto, an upsampler (e.g. an l :k upsampler where k is a sample rate, a 1 :1, 1 : 1.5, 1 : 1.2, 1 :8, 1 :6, 1 :4 upsampler, an adaptive sampling unit, an asynchronous sample rate converter, etc.), to upsample the combined signals to form the bandcombiner output signal SP;.
  • the bandcombiner USi may include a low pass filter connected to the upsampler, to prevent imaging of the bandcombiner output signal SP;.
  • the band limits and the sample rates associated with each multi-rate filter block may be configured based upon the desired processing characteristics thereof.
  • the sample rate need only be 2x the associated upper limit of the associated band. Additional headroom may be provided by adjusting the cutoff frequency of the low pass filter in the associated bandselector BS;.
  • the ratio of the sample rate to the upper limit of the associated band may be greater than 2x, may be adaptively changed during processing, etc.
  • the multi-rate filter block 10 may include a look ahead buffer suitable for predicting changes in the signal and adaptively compensating the gain of a nonlinear filter block (e.g. attack and release of a compressor, a limiter, etc.), altering the relationships between the upper limit of the associated band and the sample rate, combinations thereof, or the like.
  • a nonlinear filter block e.g. attack and release of a compressor, a limiter, etc.
  • the downsample rates m and the upsample rates k of the multi- rate filter blocks 10 may be equal to each other.
  • the downsample and upsample rates are equal to 2 (e.g. thus segmenting the signal spectrum into octave bands).
  • the multi-rate filter may include an output stage (e.g. just prior to the output channel 2, connected to the output channel 2, included in the bandcombiner US 0 ).
  • the output stage may include an audio amplifier (e.g. a class AB, class D amplifier, etc.), a crossover (e.g. a digital cross over, an active cross over, a passive crossover, etc.), and/or an audio enhancement system (AES) including a psychoacoustic function each in accordance with the present disclosure.
  • an audio amplifier e.g. a class AB, class D amplifier, etc.
  • a crossover e.g. a digital cross over, an active cross over, a passive crossover, etc.
  • AES audio enhancement system
  • the multi-rate filter system or portion thereof may be configured with an overall signal delay (i.e. the delay between the input signal 1 and the output signal 2).
  • the multi-rate filter system may be configured to provide an overall linear phase relationship between the input signal 1 and the output signal 2.
  • the multi-rate filter system may include one or more linear phase filters to provide the associated relationship.
  • the multi-rate filter system may include one or more near linear phase filters, configured in order to provide a nearly linear phase relationship between the input thereto and the output therefrom.
  • the multi-rate filter system may be configured with a maximal delay below a predetermined value (e.g.
  • the multi-rate filter may be included in a consumer electronics device.
  • the multi-rate filter may be configured to compensate for one or more acoustic characteristics of the consumer electronics device.
  • Some non-limiting examples of acoustic characteristics which may be compensated for by the multi-rate filter factors such as the loudspeaker design (speaker size, internal speaker elements, material selection, placement, mounting, covers, available back volume, etc.), device form factor, internal component placement, screen real-estate and material makeup, case material selection, hardware layout, and assembly considerations amongst others.
  • the multi-rate filter system may be configured to compensate for one or more properties of a sound producing device such a film speaker.
  • speaker properties to be compensated for include nonlinear transduction effects, memory effects, rate dependent hysteresis, mode breakup, large signal nonlinearities, limited bass response, environmental dependence (e.g. temperature, humidity, pressure differences, etc.), combinations thereof, and the like.
  • the signal processing block APi may include such functionality as FIR filtering, IIR filtering, warped FIR filtering, transducer artifact removal, disturbance rejection, user specific acoustic enhancements, user safety functions, emotive algorithms, psychoacoustic enhancement, signal shaping, single or multi- band compression, expanders or limiters, watermark superposition, spectral contrast enhancement, spectral widening, frequency masking, quantization noise removal, power supply rejection, crossovers, equalization, amplification, driver range extenders, power optimization, linear or non-linear feedback or feed-forward control systems, and the like.
  • the signal processing block APi may include one or more of the above functions, either independently or in combination. One or more of the included functions may be configured to depend on one or more pre-configurable and/or reconfigurable parameters. The functions may be combined to form an equivalent linear filter component and nonlinear filter component.
  • the multi-rate filter system (e.g. via the collective combination of the signal processing blocks AP 0 to AP n ) may be configured to provide echo cancellation, environmental artifact correction, reverb reduction, beam forming, auto calibration, stereo widening, virtual surround sound, virtual center speaker, virtual sub-woofer (by digital bass enhancement techniques), noise suppression, sound effects, or the like.
  • One or more of the included functions may be configured to depend on one or more of the parameters.
  • the multi-rate filter system (e.g. via the collective combination of the signal processing blocks AP 0 to AP n ) may be configured to impose ambient sound effects onto an audio signal 801, such as by transforming an audio input signal conveyed via the input channel 1 with an ambient environmental characteristic (e.g. adjusting reverb, echo, etc.) and/or superimposing ambient sound effects onto the audio input signal akin to an environmental setting (e.g. a live event, an outdoor setting, a concert hall, a church, a club, a jungle, a shopping mall, a conference setting, an elevator, a conflict zone, an airplane cockpit, a department store radio network, etc.).
  • an environmental setting e.g. a live event, an outdoor setting, a concert hall, a church, a club, a jungle, a shopping mall, a conference setting, an elevator, a conflict zone, an airplane cockpit, a department store radio network, etc.
  • the ambient sound effects may be configured so as to include specific information about a user, such as name, preferences, etc.
  • the ambient sound effects may be used to securely superimpose personalized information (e.g. greetings, product specific information, directions, watermarks, handshakes, etc.) into an audio stream.
  • the linear filter component may be optimized to enhanced the audio performance of a consumer electronics device into which it is implemented.
  • a non-limiting example of a method for enhancing audio performance of a consumer electronic device includes placing the consumer electronic device including an audio signal source, one or more transducers, an integrated loudspeaker assembly, and a multi-rate filter system in accordance with the present disclosure into an acoustic test chamber with a plurality of audio sensors (e.g. microphones) spatially and optionally strategically arranged within the acoustic test chamber and/or on or within the CED (e.g. a microphone on a handset CED).
  • a range of test audio signals e.g.
  • impulse signals, frequency sweeps, music clips, pseudo-random data streams, etc. may be played on the consumer electronic device and monitored with the audio sensors.
  • the multi-rate filter system may be substantially configured with one or more pass band linear filters (a null state whereby the multi-rate filter system is configured so as to not substantially affect the audio signal pathway through the CED).
  • the signal processing block APi transfer functions may be parametrically configured to compensate for the acoustic signature of the CED.
  • One, non-limiting approach for calculating the transfer function(s) from the acoustic signature of the CED is to implement a time domain inverse finite impulse response (FIR) filter based upon the estimated acoustic signature of the CED.
  • FIR time domain inverse finite impulse response
  • This may be implemented by performing one or more convolutions of the transfer functions with the acoustic responses of the CED to the audio input signals.
  • An averaging algorithm may be used to optimize the transfer function(s) from the outputs measured across multiple sources and/or multiple test audio signals.
  • the compensation transfer function may be calculated from a least squares (LS) time-domain filter design approach. If is the system response to be corrected (such as the output of an impulse response test) and a compensating filter is denoted as then one can construct C , the convolution matrix of ⁇ fc), as outlined in equation 1 :
  • the parametrically configurable transfer function(s) may be iteratively determined by subsequently running test audio signals on the CED with the updated transfer function(s) and monitoring the modified acoustic signature of the CED with the audio sensors.
  • a least squares optimization algorithm may be implemented to iteratively update the transfer function(s) between test regiments until an optimal modified acoustic signature of the CED is obtained.
  • optimization techniques include non-linear least squares, L2 norm, averaged one-dependence estimators (AODE), Kalman filters, Markov models, back propagation artificial neural networks, Baysian networks, basis functions, support vector machines, k-nearest neighbors algorithms, case-based reasoning, decision trees, Gaussian process regression, information fuzzy networks, regression analysis, self- organizing maps, logistic regression, fractional derivative based optimization, time series models such as autoregression models, moving average models, autoregressive integrated moving average models, classification and regression trees, multivariate adaptive regression splines, and the like.
  • AODE averaged one-dependence estimators
  • the optimization process may be configured so as to minimize error between an ideal system response and the actual system response as measured at several locations within the sound field of the CED.
  • the multi-channel data obtained via the audio sensors may be analyzed using sensor fusion approaches.
  • the usage case of the CED may be reasonably well defined (e.g. the location of the user with respect to the device, the placement of the device in an environment, etc.) and thus a suitable spatial weighting scheme can be devised in order to prioritize the audio response of the CED in certain regions of the sound field that correspond to the desired usage case.
  • the acoustic response within the forward facing visual range of a laptop screen may be favored over the acoustic response as measured behind the laptop screen during such tests. In this way, a more optimal multi-rate filter system may be formulated to suit a particular usage case for the CED.
  • a method for optimizing a multi-rate filter system in accordance with the present disclosure may include optimizing the HDL implementation for reduced power, reduced footprint, or for integration into a particular semiconductor manufacturing process (e.g. 13nm - 0.5 ⁇ CMOS, CMOS-Opto, HV-CMOS, SiGe BiCMOS, etc.). This may be advantageous for providing an enhanced audio experience for a consumer electronic device without significantly impacting power consumption or adding significant hardware or cost to an already constrained device.
  • a semiconductor manufacturing process e.g. 13nm - 0.5 ⁇ CMOS, CMOS-Opto, HV-CMOS, SiGe BiCMOS, etc.
  • Fig. 2a shows a bandselector BS; in accordance with the present disclosure.
  • the bandselector BSi includes a bandselector input LPi_i, a highpass bandselector output HPi, and a lowpass bandselector output LP;.
  • the bandselector BS includes a high pass filter 220 connected between the bandselector input LPu and the highpass bandselector output HPi.
  • the bandselector BS also includes a low pass filter 210 connected to the bandselector input LP;_i and an intermediate filtered signal 225.
  • the bandselector BS also includes a downsampler 230 connected to the intermediate filtered signal 225 and the lowpass bandselector output LP;.
  • the low pass and high pass filters may be selected as known to one skilled in the art.
  • the architecture herein may be advantageous in providing a simple structure to provide the low pass and high pass filters as a complimentary digital filter pair.
  • one or more of the low pass and/or high pass filters may be configured with linear phase characteristics (e.g. as linear phase FIR filters, etc.).
  • one or more of the low pass and/or high pass filters may be configured with near linear phase characteristics (i.e. with phase characteristics that deviate from a linear phase characteristic by less than a predetermined limit).
  • Such configurations may be advantageous to manage and/or reduce the overall phase distortion introduced to the signal path by the multi-rate filter system during use (e.g. as may be introduced during reconstruction of the individual bands during formation of the output signal).
  • Near linear phase filter characteristics may be advantageous for managing the relationship between the overall phase distortion and the delay associated with the multi-rate filter system.
  • Fig. 2b shows a bandcombiner USi in accordance with the present disclosure.
  • the bandcombiner US includes two bandcombiner inputs Si, SPi+i and a bandcombiner output SP;.
  • the bandcombiner US includes a summer connected to the bandcombiner inputs Si, SPi+i and an intermediate combined signal 245.
  • the bandcombiner USi further includes an upsampler 250 connected to the intermediate combined signal 245 to produce an upsampled intermediate signal 255.
  • the bandcombiner US includes a low pass filter 260 connected to the upsampled intermediate signal 255 and the bandcombiner output SP; so as to ensure the output thereof is not aliased and/or imaged.
  • the upsampler 250 may be configured with one or more interpolation filters so as to reduce imaging associated with the upsampled intermediate signal 255.
  • the bandcombiner US may include one or more filter elements (i.e. the low pass filter 260, included in the upsampler 250, etc.) configured so as to manage, reduce, and/or minimize the delay introduced into the signal during use.
  • filter elements may be configured as linear phase filters, near linear phase filters (e.g. a filter prescribed wherein the filter phase variation is within a predetermined tolerance of a linear phase variation), or the like.
  • Such filters may be optimized during an optimization method in accordance with the present disclosure.
  • Fig. 2c shows an example of a signal processing block APi in accordance with the present disclosure.
  • the signal processing block APi is connected to an associated highpass bandselector output HP; and a first bandcombiner input Si.
  • the signal processing block APi includes a linear filter component 270 and a nonlinear filter component 280 both in accordance with the present disclosure.
  • the linear filter component 270 and the nonlinear filter component 280 are shown connected in series by a linear filtered signal 255.
  • the nonlinear filter component 280 is configured to produce a nonlinear filtered signal (e.g. in this case the first bandcombiner input Si).
  • Other interconnections of the filter components may be used in practice (serial connections, parallel connections, functionally equivalent merging of components, etc.).
  • one or more of the filters 270, 280 may include a delay function and/or a phase compensation function.
  • Fig. 2d shows an alternative example of a signal processing block APi in accordance with the present disclosure.
  • the signal processing block APi is connected to an associated highpass bandselector output HP; and a first bandcombiner input Si.
  • the signal processing block APi includes a finite impulse response (FIR) filter 271 connected in series with a compressor 290 both in accordance with the present disclosure.
  • the finite impulse response (FIR) filter 271 is configured to output a linear filtered signal 276.
  • the compressor 290 is configured to accept the linear filtered signal 276 and output a nonlinear filtered signal (e.g. in this case the first bandcombiner input Si).
  • One or more of the filters 271, 290 may include a delay function and/or a phase compensation function.
  • the compressor 290 may include an observer.
  • the observer may be configured to monitor at least one signal within the signal processing block APi (e.g. the linear filtered signal 276, the first bandcombiner input Si, an intermediate signal, a representation of such signals, etc.).
  • the observer may be configured to calculate a strength signal.
  • the strength signal may be evaluated simply as being equal to a band-passed input signal.
  • Some other non-limiting examples for calculating a strength signal from an associated input signal include, a power signal, instantaneous power signal, averaged power signal, frequency band averaged signal, peak signal, an envelope, a filtered envelope, a Kalman-filtered power estimation technique, noise power spectral density, loudspeaker excursion estimators, an autocorrelation parameter, combinations thereof, or the like.
  • the compressor e.g. or equivalently a nonlinear filter component
  • the observer may be configured to respond to the observer output (e.g. an observer signal SLi).
  • the observer may be configured to output an observer signal SLi for use by another component and/or block in the multi-rate filter system.
  • Fig. 2e shows an alternative example of a signal processing block APi in accordance with the present disclosure.
  • the signal processing block APi is connected to an associated highpass bandselector output HP; and a first bandcombiner input Si.
  • the signal processing block APi includes an adaptive finite impulse response (aFIR) filter 292 connected to a feedback signal channel SF; and connected in series with a compressor 296 (in this case a limiter) both in accordance with the present disclosure.
  • the adaptive finite impulse response (FIR) filter 292 is configured to output a linear filtered signal 294.
  • the limiter 296 is configured to accept the linear filtered signal 294 and output a nonlinear filtered signal (e.g. in this case the first bandcombiner input Si).
  • the adaptation process associated with the adaptive finite impulse response (aFIR) filter 292 may be configured so as to be sufficiently slow to maintain an essentially linear behavior from the aFIR filter 292 over the signal bandwidth of interest (e.g. the audio frequency band).
  • the limiter 296 may include an observer in accordance with the present disclosure.
  • the observer may be configured to monitor at least one signal within the signal processing block APi (e.g. the linear filtered signal 294, the first bandcombiner input Si, an intermediate signal, a representation of such signals, etc.).
  • the observer may be configured to calculate a strength signal in accordance with the present disclosure.
  • Fig. 3 shows a nonlinear functional block 300 for implementing an audio enhancement algorithm in combination with a multi-rate filter system in accordance with the present disclosure.
  • the nonlinear functional block 300 shows an illustrative example of a bass enhancement system 300 in accordance with the present disclosure.
  • the bass enhancement system 200 may be configured to accept an input signal, S ou t 2 from the multi-rate filter system and a control signal 25 from an evaluation block 340, to produce an enhanced output signal, S 0 ut2 345.
  • the evaluation block 340 may be configured to accept an external control signal S ctr i, one or more feedback signals SF 0 to SF n , and one or more observer signals SLo to SL n .
  • the evaluation block 340 may combine signals operably generated by many multi-rate filter blocks 10 to form a collective strength signal, power level, etc. to optionally direct the bass enhancement system 300.
  • the bass enhancement system 300 may include a psychoacoustic bass enhancement block (PAB) 310 and a compressor 320.
  • the compressor 320 may be configured to accept the input signal 2 or a related signal thereof (e.g. filtered, resampled, clipped, input signal 2, etc.), and the control signal 25, and to produce a first enhanced signal 325 and an internal control signal 335.
  • the PAB 330 may be configured to accept the input signal 2 or a related signal therefrom (e.g. filtered, resampled, clipped, input signal 2, etc.) and the internal control signal 335, and to produce a second enhanced signal 315.
  • the first enhanced signal 325 and the second enhanced signal 315 may be combined (e.g. added, mixed, etc.) in a combination block 340 to produce the enhanced output signal, S ou t2 345.
  • the system 300, the PAB 330 and/or the compressor 320 may include one more filters (e.g band pass filters, low pass filters, high pass filters, adaptable filters, polyphase FIR filters, FIR filters, lattice wave filters, etc.) for isolating one or more frequency bands (e.g. band-1, band-2, band-3, band-m, band-n signals, etc.) from the input signal 2 for further analysis and/or enhancement.
  • the compressor 320 may include a filter for isolating a portion of the input signal content residing roughly within the bass audio range (e.g. 10-80Hz, 30 - 60Hz, 35-50Hz, 100-300Hz, 120-250Hz, etc.).
  • the compressor 320 may be configured to adjust the bandwidth limits of the filter in real-time (e.g. as directed by the external control signal S ctr i). Alternatively, additionally, or in combination the multi-rate filter system may be tapped at one or more bandcombiner outputs SPi in order to retrieve one or more band limited signals for use in the nonlinear functional block 300 (e.g. the bass enhancement system).
  • Fig. 4 shows an illustrative example of a feedback system including a controller 420 and some illustrative feedback mechanisms in accordance with the present disclosure.
  • the controller 420 may be configured to generate one or more feedback signals SF 0 to SF n (equivalently considered external control signals).
  • the control signals 495 maybe used by various blocks in multi-rate filter system to control gain adjustments, adapt filter parameters, and the like.
  • the controller 420 may be connected to the input channel 1 so as to accept the input signal Si n to contribute to the generation of the feedback signals SFo to SF n .
  • the controller 420 may be configured to accept the input signal 1 and to generate one or more feedback signals SF 0 to SF n with an entirely feed forward signal path.
  • the controller 420 may be configured to accept a system control signal V 415 so as to adjust one or more control signals 495.
  • the system control signal 415 may be a power management signal, a volume scale, a power setting (e.g. ultra-low power, low power, full power, etc.), a signal related to trade-off between audio quality and power, a user input signal, or the like.
  • the audio processing system may include a driver 430.
  • the driver 430 may be driven by an audio processing output signal 425, at least partially dependent on the output signal S out and/or the enhanced signal 355.
  • the driver 430 may generate one or more output signals 435 for driving one or more loudspeakers 460, 470, loudspeaker driver modules 440, and/or integrated circuits 450 included therein.
  • the controller 420 may be configured to accept one or more sensor signals 445, 455, 465, 475, 485 from one or more audio components within a complete audio signal processing system.
  • Some non-limiting examples include current, voltage, and/or temperature sensor signal 465 from the driver 430, a current, voltage, displacement, temperature, and/or acceleration sensor signal 455, 485 from one or more of the loudspeakers 460, 470, and a current, voltage, impedance, temperature, limiter, and/or envelop sensor signal 450 from one or more integrated circuits 450 included in the audio processing system.
  • the controller 420 may be configured to accept an audio sensor signal 445 as operably produced by one or more microphones 480 included in the audio processing system.
  • the controller 420 may be configure to accept a sensor signal (not explicitly shown) from one or more accelerometers, gyroscopes, GPS sensors, temperature sensors, humidity sensors, battery life sensors, current sensors, magnetic field sensors, or the like.
  • a range of feedback algorithms may be implemented in the controller 420 to relate the sensor signals 445, 455, 465, 475, 485 to the feedback signals SF 0 to SF n .
  • Some non-limiting examples of feedback algorithms include speaker/drive temperature overload feedback, negative feedback based on one or more aspects of the audio sensor signal 445 (e.g. an amplitude based feedback, a distortion based feedback, etc.), a distortion limiting algorithm (e.g. via measurement of the audio sensor signal 445), combinations thereof, and the like.
  • Fig. 5 shows a non-limiting example of a multi-rate filter system including a nonlinear functional block in accordance with the present disclosure.
  • the multi-rate filter system includes a plurality of multi-rate filter blocks MRFBo to MRFB 12 each in accordance with the present disclosure.
  • the multi-rate filter block MRFBo is connected to an input channel 1 , configured so as to accept an input signal Si n , and is connected to an output channel 2, configured so as to output a filtered signal S out .
  • the downsampler and upsampler in each multi-rate filter block MRFBi are configured with sampling ratios equal to "r". Such a limitation is only for illustration purposes.
  • the sampling ratios may be configured to any values and need not be equal to each other.
  • the maximum frequency associated with each signal within the multi-rate filter system is indicated as a power of r (e.g. r°).
  • r e.g. r°
  • the bands associated with this multi-rate filter are logarithmically spaced across the signal spectrum.
  • sampling ratios may be configured to any unique values and need not be equal to each other.
  • the multi-rate filter system may include a nonlinear functional block 500 in accordance with the present disclosure.
  • the nonlinear functional block 500 is connected to the bandcombiner output SP 9 of the multi-rate filter block MRFB 9 .
  • the bandcombiner output is oversampled (i.e in this case to a value corresponding to the upper band limit of r 9 ).
  • the nonlinear functional block 500 is connected to a summer 510.
  • the summer 510 may be connected to the bandcombiner output SP 4 of the multi-rate filter block MRFB 4 .
  • the sample rates of the summer 510 inputs are equivalent.
  • the summer output 515 is connected to the prior multi-rate filter block MRFB 3 so as to add the nonlinear functional block 500 enhanced signal back into the multi-rate filter block cascade.
  • the nonlinear functional block 500 may be a bass enhancement block 300 in accordance with the present disclosure.
  • the nonlinear functional block 500 may also be equivalent to any nonlinear filter component in accordance with the present disclosure.
  • the structure shown may be advantageous for effectively coupling highly nonlinear functions into the cascade structure of the multi-rate filter system.
  • the multi-rate filter block cascade may be tapped at any bandcombiner output SP;. Such taps may be used to construct wider band signals from the individual band signal of the multi-rate filter cascade.
  • the sample rates of at least one downsampler and/or upsampler in the multi-rate filter system may be adaptively configurable. At least one downsampler and/or upsampler sample rate may be configured so as to coincide with an acoustic feature (e.g. an acoustic resonance, a bass band transition, a jitter, etc.) of an associated consumer electronics device into which the multi-rate filter system is included.
  • an acoustic feature e.g. an acoustic resonance, a bass band transition, a jitter, etc.
  • Fig. 6a-b show examples of the frequency spectrum associated with the example multi-rate filter system shown in Fig. 5.
  • Fig. 6a shows a log-log relationship between frequency and frequency content of a signal 600 associated with each multi- rate filter block 10 of this specific example.
  • the signal 600 is bound by an upper limit frequency 602 and a lower limit frequency 601.
  • the bands are logarithmically spaced in frequency.
  • the bands may be arbitrarily assigned.
  • the sampling ratios may be configured to any values and need not be equal to each other.
  • the bands may be linearly spaced across the signal spectrum, nonlinearly spaced, logarithmically spaced, randomly spaced, etc.
  • Fig. 6b shows further examples of signal content associated with the example of Fig. 5.
  • Fig. 6b shows a bass band portion 605 of the overall signal, as tapped at SP 9 in the example.
  • the bass band portion 605 is passed to the nonlinear functional block 500 to produce a nonlinear filtered portion 615.
  • the nonlinear filtered portion 615 contains significant distortion, thus introducing signal content with a considerably higher frequency than could be sampled from the r 3 band.
  • the signal portion between SP6 and SP4 is shown as a midband portion 625 and is added to with the nonlinear filtered portion 615 in the summer and returned to the cascade to be integrated and upsampled with content in the upper band portion 635 of the signal.
  • the multi-rate filter system may be embedded in an application specific integrated circuit (ASIC) or be provided as a hardware descriptive language block (e.g. VHDL, Verilog, etc.) for integration into a system on chip (SoC), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or a digital signal processor (DSP) integrated circuit.
  • ASIC application specific integrated circuit
  • SoC system on chip
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • DSP digital signal processor
  • a multi-rate filter system in accordance with the present disclosure may be configured to substantially match a predetermined single rate wide band filter.
  • the wide band filter may be configured to compensate for one or more rendering characteristics of an audio rendering device (e.g. a consumer electronics device, a media rendering network, etc.).
  • the multi-rate filter system may be configured with a series of bands to collectively span the wide band spectrum associated with the wide band filter.
  • the multi-rate filter system may include N bands, the bands configured as follows: N-l bands spaced so as to fill a high frequency portion of the wide band filter spectrum (i.e.
  • Each of the bands may include a signal processing block APi connected to a bandselector BSi in accordance with the present disclosure.
  • the N-l bands may be spaced linearly, logarithmically, with individually configured bandwidth, etc. in accordance with the present disclosure.
  • the low band may be configured so as to cover a bass band of the spectrum (e.g. perhaps correlated with the bass band of the associated device, covering relevant spectrum less than 1000 Hz, less than 500 Hz, less than 300 Hz, less than 150Hz, less than 120Hz, less than 80Hz, etc.).
  • the N-l bands may be logarithmically spaced in accordance with the present disclosure (i.e. each band covering 1 :m spectrum wherein m is a real number, 1 :2, 1 : 1.5, half octave bands, quarter octave bands, etc.).
  • One or more of the low pass filters in each band may be configured to reduce cross talk, aliasing, imaging, etc. associated with the adjacent band structures, downsampling, and upsampling aspects of the multi-rate filter system.
  • one or more of the low pass filters may be formed from linear phase FIR filters.
  • One or more of the low pass filters may be configured with cutoff characteristics suitably placed to reduce aliasing and/or imaging of the signals to be processed by the associated bandselector BSi, bandcombiner US;, and/or signal processing block APi.
  • bands associated with shorter paths may include a delay element so as to maintain an equal delay between all band signals in the multi-rate filter system.
  • Fig. 7a-b show a method for optimizing a multi-rate filter to match a wide band target filter in accordance with the present disclosure and a resulting filter frequency response.
  • Fig. 7a shows a method for optimizing a multi-rate filter system to match a wide band target filter in accordance with the present disclosure.
  • the method includes defining the structure of the multi-rate filter system, defining the performance allowances (i.e. phase delay, phase distortion, and/or magnitude mismatch), providing an initial guess to match the target filter, optimizing the multi- rate filter system to match the target filter, comparing the optimized filter and the target in accordance with the performance allowances, and optionally iterating any of the above steps in order to satisfy the performance allowances.
  • the performance allowances i.e. phase delay, phase distortion, and/or magnitude mismatch
  • the step of optimizing may include optimizing the multi-rate filter system on the whole, in parts, or by fixing one or more portions of the system while optimizing one or more alternative aspects.
  • the optimization procedure may be completed using one or more known techniques (e.g. nonlinear programming solvers, minimax constraint problem solvers, etc.).
  • optimization techniques include non-linear least squares, L2 norm, averaged one- dependence estimators (AODE), Kalman filters, Markov models, back propagation artificial neural networks, Baysian networks, basis functions, support vector machines, k-nearest neighbors algorithms, case-based reasoning, decision trees, Gaussian process regression, information fuzzy networks, regression analysis, self- organizing maps, logistic regression, fractional derivative based optimization, time series models such as autoregression models, moving average models, autoregressive integrated moving average models, classification and regression trees, multivariate adaptive regression splines, and the like.
  • AODE averaged one- dependence estimators
  • one or more of the filters in the multi-rate filter system may be optimized separately from each other.
  • the filters in the bandselector BSi and the bandcombiner US may be designed (and optionally optimized) so as to define the band structures of the multi-rate filter to conform with the overall performance allowances of the filter.
  • the bandselector BSi and the bandcombiner USi filters may be matched so as to provide the same values and/or reduce complexity of the filter system (i.e. perhaps so as to provide matching filter parameters, reduce memory requirements, etc.).
  • the resulting bandselector BSi and the bandcombiner US; filters may then be held constant while the processing filters included in each of the signal processing blocks AP; are optimized in a secondary optimization procedure.
  • the filters in the multi-rate filter system may be collectively optimized with reference to the performance allowances. Such an approach may be advantageous for flexibly trading off between the performance allowances (i.e. may allow for more control over delay, phase distortion, and/or magnitude variation).
  • the predetermined wide band filter may be a FIR filter with 2048 taps (e.g. a minimum phase FIR filter, linear phase FIR filter, etc.).
  • the basic computational requirement for the wide band filter is 2048 computations per sample (i.e. 90MIPS at 44.1kHz).
  • the multi-rate filter may be structured in accordance with the method described herein, and the performance allowances may be defined a priori.
  • the allowable delay is preferably less than or equal to 10ms
  • the allowable phase distortion is zero (i.e. a linear phase configuration with associated delay elements in each band)
  • the allowable magnitude variation is set at less than or equal to 0.25dB.
  • the delay allowance is relaxed while the linear phase aspect is enforced.
  • Filters in the bandselector BSi and the bandcombiner US; are selected to have an order of 40. Initial guesses for the bandselector BSi and the bandcombiner US; filters were calculated using a Parks- McClellan algorithm and then optimized subject to weighted constraints relating to pass band flatness, stopband ripple, etc. of each of the filters.
  • Initial guesses for the processing filters were made using a Parks- McClellan algorithm.
  • the resulting optimized filters were then generated using an optimization technique in accordance with the present disclosure subject to constraints related to minimization of amplitude error under the constraints of minimum phase filter properties. Such a configuration may be advantageous for simplifying the overall optimization process.
  • Fig. 7b shows the error magnitude between the target wideband filter, the initial guess and for the post optimized multi-rate filter for the procedure described herein (shown in separate graphs). As can be seen in Fig. 7b, the magnitude error between the multi-rate filter and the target filter has been reduced by roughly a factor of 4 during the optimization procedure versus the initial guess.
  • a multi-rate filter system in accordance with the present disclosure may be soft-coded into a processor, coded in VHDL, Verilog or other hardware descriptive language, flash, EEPROM, memory location, or the like. Such a configuration may be used to implement the multi-rate filter system in software, as a routine on a DSP, an FPGA, A CPLD, a processor, and ASIC, etc.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Mathematical Physics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Nonlinear Science (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Tone Control, Compression And Expansion, Limiting Amplitude (AREA)

Abstract

A multi-rate filter system is disclosed. More particularly, a computationally efficient multi-rate filter system for processing an audio stream on a consumer electronics device is disclosed. The multi-rate filter system includes a plurality of multi-rate filtering blocks, at least one block including a linear filter component. At least one multi-rate filtering block may include a nonlinear signal processing components. The multi-rate filter system may include a nonlinear functional block. A method of filtering a signal is also disclosed.

Description

MULTI-RATE FILTER SYSTEM
CROSS-REFERENCE TO RELATED APPLICATION
[0001] The present application is an international application which claims benefit of and priority to U.S. Provisional Application Ser. No. 61/584,855 filed on January 10, 2012, entitled "Multi-rate Filter System", by Erik Lindahl et al, and U.S. Provisional Application Ser. No. 61/658,560 filed on June 12, 2012, entitled "Multi- rate Filter System", by Erik Lindahl et al, the entire contents of which are incorporated by reference herein for all purposes.
BACKGROUND
Technical Field
[0002] The present disclosure is directed to digital filters and particularly to multi- rate digital filters for audio signal processing.
Background
[0003] Mobile technologies and consumer electronic devices (CED) continue to expand in use and scope throughout the world. In parallel with continued proliferation, there is rapid technical advance of device hardware and components, leading to increased computing capability and incorporation of new peripherals onboard a device along with reductions in device size, power consumption, etc.
[0004] Many CEDs rely on signal processing with digital filters to perform a wide range of functions on the device (e.g. audio/video signal processing, sensor signal processing, voice recognition, etc.).
[0005] A feed forward or a feedback digital filter typically includes a number of equally spaced taps with each tap separated by a delay line and multiplied by a filter coefficient. The filter coefficients determine the impulse response of the filter.
[0006] A feed forward digital filter for use on a signal with broad spectral content (e.g. a signal with several orders of magnitude of bandwidth), may often require excessive sampling of the signal, particularly as related to the low frequency content thereof. In addition, the resulting complexity of the filter may be challenging to implement in resource constrained devices, as it may consume additional hardware and software resources with increased bandwidth coverage and complexity.
[0007] As the size and complexity of the filter are increased to accommodate additional signal spectrum, it becomes more challenging to tune the filter coefficients to produce the desired frequency response. In addition, applying adaptive, learning and/or optimization algorithms to the real-time adjustment of filter coefficients is much more challenging to implement as the size and complexity of the digital filter is increased.
SUMMARY
[0008] One objective of the present disclosure is to provide a filter system.
[0009] Another objective is to provide a filter system for enhancing audio output from a consumer electronics device.
[0010] The above objectives are wholly or partially met by devices, systems, and methods described herein. In particular, features and aspects of the present disclosure are set forth in the appended claims, following description, and the annexed drawings.
[0011] According to a first aspect there is provided, a multi-rate filter system including an input channel configured to receive an input signal, an output channel configured to output a filtered signal, a cascade of multi-rate filter blocks coupled between the input channel and the output channel. At least one of the multi-rate filter blocks includes a bandselector comprising a bandselector input, a highpass bandselector output, a lowpass bandselector output connected to a subsequent multi- rate filter block, and a downsampler connected between the bandselector input and the lowpass bandselector output, a signal processing block coupled to the highpass bandselector output, the signal processing block comprising a linear filter component, and a bandcombiner connected to the signal processing block, the bandcombiner comprising two bandcombiner inputs, a bandcombiner output, and an upsampler, the first bandcombiner input connected to the signal processing block, the second bandcombiner input connected to a subsequent multi-rate filter block, and the bandcombiner output connected to a prior multi-rate filter block, the upsampler connected between the bandcombiner inputs and the bandcombiner output. [0012] In aspects, the linear filter component may be selected from a group including a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Kalman filter, a neural network, a fuzzy logic filter, a lattice wave filter, a linear phase filter, a near linear phase filter, and combinations thereof. The linear filter component may include reconfigurable filter parameters in accordance with the present disclosure.
[0013] In aspects, the signal processing block may include a nonlinear filter component in accordance with the present disclosure connected to the linear filter component. Some non-limiting examples of a suitable nonlinear filter component include a compressor, a polynomial, a limiter, and combinations thereof.
[0014] In aspects, one or more multi-rate filter blocks may include an observer in accordance with the present disclosure configured to output an observer signal, the observer connected to the signal processing block between the highpass bandselector output and the first bandcombiner input. The observer may include a power monitor. One or more filter components (e.g the nonlinear filter component, the linear filter component) may be configured to respond to the observer signal (e.g. by changing a filter gain, alter a parameter, attack, release, etc.).
[0015] In aspects, the multi-rate filter system may include a nonlinear functional block (NLFB) including an NLFB input and an NLFB output. The NLFB input may be connected to the bandcombiner output of a first multi-rate filter block and the NLFB output may be connected to the bandcombiner input of a second second multi- rate filter block. The nonlinear function block may include a psychoacoustic function.
[0016] In aspects, the downsampler may be an m: l downsampler, where m is a sample rate, and the upsampler may be a 1 :k upsampler, where k is a sample rate. The sample rates m and k may be equal. The sample rates m and/or k may be less than or equal to 2, less than or equal to 1.5, less than or equal to 1.33, or less than or equal to 1.25.
[0017] In aspects, the multi-rate filter blocks may span an audio signal bandwidth.
[0018] In aspects, the bandselector may include a low pass filter connected between the bandselector input and the bandselector lowpass output, and a high pass filter connected between the bandselector input and the bandselector highpass output. A complimentary filter pair may be formed by the low pass filter and high pass filter. [0019] In aspects, the bandcombiner may include a summer connected to the bandcombiner inputs and the upsampler and/or a low pass filter connected between the upsampler and the bandcombiner output.
[0020] In aspects, the multi-rate filter system may include a control channel configured to receive a control signal, with at least one multi-rate filter block being connected to the control channel.
[0021] In aspects, the linear filter component and/or the nonlinear filter component may be configured to respond to the control signal.
[0022] According to another aspect there is provided, use of a multi-rate filter system in accordance with the present disclosure, in a consumer electronics device.
[0023] According to yet another aspect there is provided, use of a multi-rate filter system in accordance with the present disclosure, to process an audio signal.
[0024] According to aspects there is provided, a method for filtering a signal, the method including, processing an input signal with a plurality of multi-rate filter blocks, the processing of at least one multi-rate filter block including, downsampling to produce a downsampled signal, providing the downsampled signal to a subsequent multi-rate filter block, processing with a linear filter component to form a linear filtered signal, processing with a nonlinear filter component to form a nonlinear filtered signal, combining or selecting the linear filtered signal and/or the nonlinear filtered signal to form a filtered output signal, and upsampling the filtered output signal to form an increased rate signal.
[0025] In aspects, the method may include processing at least one increased rate signal with a nonlinear functional block (NLFB) to form a nonlinear processed signal, providing the nonlinear processed signal to a prior multi-rate filter block, and/or providing the increased rate signal to a prior multi-rate filter block.
[0026] Some suitable non-limiting examples of the linear filter component include a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Kalman filter, a neural network, a fuzzy logic filter, and combinations thereof.
[0027] Suitable non-limiting examples of the nonlinear filter component include a compressor, a polynomial, a limiter, and combination thereof. [0028] According to aspects there is provided a method for matching a multi-rate filter system in accordance with the present disclosure to a predetermined wideband filter, the method including, assigning the number of multi-rate filter blocks in the multi-rate filter system, calculating an initial guess for one or more of the multi-rate filter blocks, optimizing the multi-rate filter blocks towards the wideband filter to form one or more updated multi-rate filter blocks; and constructing a matched multi- rate filter system from the updated multi-rate filter blocks.
[0029] The step of calculating may be performed via any method in accordance with the present disclosure. In one aspect, the step of calculating may be performed using a Parks-McClellan algorithm.
[0030] The step of optimizing may be performed on one or more bandselectors and one or more bandcombiners included in the multi-rate filter system, and separately on one or more of the signal processing blocks included in the multi-rate filter system.
[0031] The method may include adding a nonlinear function block to one or more of the multi-rate filter blocks and optionally configuring the nonlinear function block to match a psychoacoustic function, a compressor, a limiter, or the like.
BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Fig. la shows a schematic of a multi-rate filter system in accordance with the present disclosure.
[0033] Figs. 2a-e show diagrams of processing blocks associated with a multi-rate filter system in accordance with the present disclosure.
[0034] Fig. 3 shows a nonlinear functional block for implementing an audio enhancement algorithm with a multi-rate filter system in accordance with the present disclosure.
[0035] Fig. 4 shows a feedback system for use with a multi-rate filter system in accordance with the present disclosure.
[0036] Fig. 5 shows an example of a multi-rate filter system including a nonlinear functional block in accordance with the present disclosure. [0037] Fig. 6a-b show examples of frequency bands associated with a multi-rate filter system in accordance with the present disclosure.
[0038] Fig. 7a-b show a method for optimizing a multi-rate filter in accordance with the present disclosure and a resulting error spectral response.
DETAILED DESCRIPTION
[0039] Particular embodiments of the present disclosure are described hereinbelow with reference to the accompanying drawings; however, the disclosed embodiments are merely examples of the disclosure and may be embodied in various forms. Well-known functions or constructions are not described in detail to avoid obscuring the present disclosure in unnecessary detail. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present disclosure in virtually any appropriately detailed structure. Like reference numerals may refer to similar or identical elements throughout the description of the figures.
[0040] By consumer electronic device is meant a cellular phone (e.g. a smartphone), a tablet computer, a laptop computer, a portable media player, a television, a portable gaming device, a gaming console, a gaming controller, a remote control, an appliance (e.g. a toaster, a refrigerator, a bread maker, a microwave, a vacuum cleaner, etc.) a power tool (a drill, a blender, etc.), a robot (e.g. an autonomous cleaning robot, a care giving robot, etc.), a toy (e.g. a doll, a figurine, a construction set, a tractor, etc.), a greeting card, a home entertainment system, an active loudspeaker, a sound bar, etc.
[0041] Fig. 1 shows a multi-rate filter system in accordance with the present disclosure. The filter system includes an input channel 1 configured to accept an input signal Sin from an external source (e.g. a processor, an signal streaming device, an audio feedback device, a wireless transceiver, an ADC, an audio decoder circuit, a DSP, etc.), and an output channel 2 for outputting a filtered signal Sout, and a plurality of multi-rate filter blocks 10.
[0042] At least one of the multi-rate filter blocks 10 includes a bandselector BSi configured to accept a signal from the input channel 1 or a previous multi-rate filter block 10 and to produce a highpass bandselector output signal HPi, and a lowpass bandselector output signal LP; to be delivered to a subsequent multi-rate filter block or to a subband processing block (e.g. a signal processing block covering the lowest signal band of interest). The multi-rate filter block 10 may also include a signal processing block APi connected to the bandselector BSi. The signal processing block APi may include a linear filter component (e.g. a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Kalman filter, a neural network, a fuzzy logic filter, a butterworth filter, a lattice wave filter, etc.). The multi-rate filter block 10 may also include a bandcombiner connected to the signal processing block APi. The bandcombiner US; may include two bandcombiner inputs, a bandcombiner output, and an upsampler.
[0043] The first bandcombiner input FSi may be connected to the signal processing block APi, the second bandcombiner input SPi+i may be connected to a subsequent multi-rate filter block, and the bandcombiner output SP; connected to a prior multi-rate filter block. The upsampler may be connected between the bandcombiner inputs FSi, SPi+1 and the bandcombiner output SP;.
[0044] The bandselector BSi may be configured to isolate a signal band to produce the bandselector highpass output HP;. This function may be achieved with a high pass filter. The band selector may also be configured to produce a lowpass bandselector output LP; at a resampled rate. This function may be achieved using a downsampler (e.g. an m: l downsampler where m is a sample rate, a 8: 1 , 6: 1 , 4: 1 , 3 : 1 , 2: 1 , 1.5 : 1 , 1.25 : 1 , downsampler, an adaptive sampling unit, an asynchronous sample rate converter, etc.), optionally in conjunction with a low pass filter. The highpass filter and the lowpass filter included in the bandselector BSi may be complimentary filter pairs (i.e. so as to provide perfectly matched filters and to simplify the filter design). The downsampler associated with each bandselector BSi may be configured to perform a different change in sampling rate, from the other downsamplers in the system, it may be similar, etc. (i.e. each downsampler may have a unique value m, m may be the same for a plurality or all of the downsamplers, etc.).
[0045] Each signal processing block APi may be configured so as to operate at an associated sample rate. The sample rate may be determined by the associated downsampler or a filter block controller (not explicitly shown). A filter block controller may be configured to set filter parameters for each of the components of the filter system upon startup, upon firmware update, etc. Each signal processing block APi may be configured to process the associated highpass bandselector output signal HP; with a predetermined degree of precision (i.e. bit count). In one non-limiting example, signal processing blocks APi associated with progressively lower frequency bands, may be configured to analyze the associated signals with increasing degree of precision. The associated downsampler may be configured to increase the precision of the output generated therefrom by an amount related to the downsampling parameter. Such changes in precision may be advantageous to compromise between delay and the number of filter blocks 10 in the filter system.
[0046] In aspects, the signal processing block APi may include a linear filter component (e.g. a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Kalman filter, a neural network, a fuzzy logic filter, a butterworth filter, etc.), for modifying the signal content in the selected band. In aspects, the signal processing block APi may include a nonlinear filter component nLBi (a clipper, a compressor, a limiter, an integrator, a multiplier, a convolution, a rectifier, a piecewise linear shaping function, a nonlinear transfer function, and/or an asymmetric polynomial function to calculate at least a portion of the second enhanced signal, etc.). The linear and/or nonlinear filter components may be configured to process the signal content within the selected band. The nonlinear filter may be configured to generate signal content out of band. The acceptable out of band range may be determined by the bandwidth associated with the band and the sample rate associated with the band.
[0047] In aspects, the bandcombiner US; may be connected to the signal processing block APi and the bandcombiner output SPi+i from a subsequent multi-rate filter block. The bandcombiner US; may include a summer to combine the inputs signals thereto, an upsampler (e.g. an l :k upsampler where k is a sample rate, a 1 :1, 1 : 1.5, 1 : 1.2, 1 :8, 1 :6, 1 :4 upsampler, an adaptive sampling unit, an asynchronous sample rate converter, etc.), to upsample the combined signals to form the bandcombiner output signal SP;. In aspects, the bandcombiner USi may include a low pass filter connected to the upsampler, to prevent imaging of the bandcombiner output signal SP;.
[0048] The band limits and the sample rates associated with each multi-rate filter block may be configured based upon the desired processing characteristics thereof. In a non- limiting example, wherein the multi-rate filter block 10 includes only linear signal processing components, the sample rate need only be 2x the associated upper limit of the associated band. Additional headroom may be provided by adjusting the cutoff frequency of the low pass filter in the associated bandselector BS;. In a non- limiting example where the multi-rate filter block 10 includes nonlinear processing element, the ratio of the sample rate to the upper limit of the associated band may be greater than 2x, may be adaptively changed during processing, etc. In aspects, the multi-rate filter block 10 may include a look ahead buffer suitable for predicting changes in the signal and adaptively compensating the gain of a nonlinear filter block (e.g. attack and release of a compressor, a limiter, etc.), altering the relationships between the upper limit of the associated band and the sample rate, combinations thereof, or the like.
[0049] In aspects, the downsample rates m and the upsample rates k of the multi- rate filter blocks 10 may be equal to each other. In a non- limiting example, the downsample and upsample rates are equal to 2 (e.g. thus segmenting the signal spectrum into octave bands).
[0050] In aspects, the multi-rate filter may include an output stage (e.g. just prior to the output channel 2, connected to the output channel 2, included in the bandcombiner US0). In aspects, the output stage may include an audio amplifier (e.g. a class AB, class D amplifier, etc.), a crossover (e.g. a digital cross over, an active cross over, a passive crossover, etc.), and/or an audio enhancement system (AES) including a psychoacoustic function each in accordance with the present disclosure.
[0051] In aspects, the multi-rate filter system or portion thereof (e.g. a component, a down-sampler, an up-sampler, a processing block, etc.), may be configured with an overall signal delay (i.e. the delay between the input signal 1 and the output signal 2). In aspects, the multi-rate filter system may be configured to provide an overall linear phase relationship between the input signal 1 and the output signal 2. As such, the multi-rate filter system may include one or more linear phase filters to provide the associated relationship. The multi-rate filter system may include one or more near linear phase filters, configured in order to provide a nearly linear phase relationship between the input thereto and the output therefrom. In aspects, the multi-rate filter system may be configured with a maximal delay below a predetermined value (e.g. less than 45ms, less than 22ms, less than 10ms, etc.). [0052] In aspects, the multi-rate filter may be included in a consumer electronics device. The multi-rate filter may be configured to compensate for one or more acoustic characteristics of the consumer electronics device. Some non-limiting examples of acoustic characteristics which may be compensated for by the multi-rate filter factors such as the loudspeaker design (speaker size, internal speaker elements, material selection, placement, mounting, covers, available back volume, etc.), device form factor, internal component placement, screen real-estate and material makeup, case material selection, hardware layout, and assembly considerations amongst others.
[0053] In aspects, the multi-rate filter system may be configured to compensate for one or more properties of a sound producing device such a film speaker. Some non-limiting examples of speaker properties to be compensated for include nonlinear transduction effects, memory effects, rate dependent hysteresis, mode breakup, large signal nonlinearities, limited bass response, environmental dependence (e.g. temperature, humidity, pressure differences, etc.), combinations thereof, and the like.
[0054] In aspects, the signal processing block APi may include such functionality as FIR filtering, IIR filtering, warped FIR filtering, transducer artifact removal, disturbance rejection, user specific acoustic enhancements, user safety functions, emotive algorithms, psychoacoustic enhancement, signal shaping, single or multi- band compression, expanders or limiters, watermark superposition, spectral contrast enhancement, spectral widening, frequency masking, quantization noise removal, power supply rejection, crossovers, equalization, amplification, driver range extenders, power optimization, linear or non-linear feedback or feed-forward control systems, and the like. The signal processing block APi may include one or more of the above functions, either independently or in combination. One or more of the included functions may be configured to depend on one or more pre-configurable and/or reconfigurable parameters. The functions may be combined to form an equivalent linear filter component and nonlinear filter component.
[0055] In aspects, the multi-rate filter system (e.g. via the collective combination of the signal processing blocks AP0 to APn) may be configured to provide echo cancellation, environmental artifact correction, reverb reduction, beam forming, auto calibration, stereo widening, virtual surround sound, virtual center speaker, virtual sub-woofer (by digital bass enhancement techniques), noise suppression, sound effects, or the like. One or more of the included functions may be configured to depend on one or more of the parameters.
[0056] In aspects, the multi-rate filter system (e.g. via the collective combination of the signal processing blocks AP0 to APn) may be configured to impose ambient sound effects onto an audio signal 801, such as by transforming an audio input signal conveyed via the input channel 1 with an ambient environmental characteristic (e.g. adjusting reverb, echo, etc.) and/or superimposing ambient sound effects onto the audio input signal akin to an environmental setting (e.g. a live event, an outdoor setting, a concert hall, a church, a club, a jungle, a shopping mall, a conference setting, an elevator, a conflict zone, an airplane cockpit, a department store radio network, etc.).
[0057] In aspects, the ambient sound effects may be configured so as to include specific information about a user, such as name, preferences, etc. The ambient sound effects may be used to securely superimpose personalized information (e.g. greetings, product specific information, directions, watermarks, handshakes, etc.) into an audio stream.
[0058] In aspects wherein the signal processing blocks APi include associated linear filter components, the linear filter component may be optimized to enhanced the audio performance of a consumer electronics device into which it is implemented. A non-limiting example of a method for enhancing audio performance of a consumer electronic device (CED) includes placing the consumer electronic device including an audio signal source, one or more transducers, an integrated loudspeaker assembly, and a multi-rate filter system in accordance with the present disclosure into an acoustic test chamber with a plurality of audio sensors (e.g. microphones) spatially and optionally strategically arranged within the acoustic test chamber and/or on or within the CED (e.g. a microphone on a handset CED). A range of test audio signals (e.g. impulse signals, frequency sweeps, music clips, pseudo-random data streams, etc.) may be played on the consumer electronic device and monitored with the audio sensors. In an initial test, the multi-rate filter system may be substantially configured with one or more pass band linear filters (a null state whereby the multi-rate filter system is configured so as to not substantially affect the audio signal pathway through the CED). [0059] In aspects, the signal processing block APi transfer functions may be parametrically configured to compensate for the acoustic signature of the CED. One, non-limiting approach for calculating the transfer function(s) from the acoustic signature of the CED is to implement a time domain inverse finite impulse response (FIR) filter based upon the estimated acoustic signature of the CED. This may be implemented by performing one or more convolutions of the transfer functions with the acoustic responses of the CED to the audio input signals. An averaging algorithm may be used to optimize the transfer function(s) from the outputs measured across multiple sources and/or multiple test audio signals.
[0060] In one non-limiting example, the compensation transfer function may be calculated from a least squares (LS) time-domain filter design approach. If is the system response to be corrected (such as the output of an impulse response test) and a compensating filter is denoted as then one can construct C , the convolution matrix of ^fc), as outlined in equation 1 :
[0061]
Figure imgf000014_0001
i)J [equation 1]
[0062] where ¾ is the length of the response Q. C has a number of columns equal to the length of C¾J with which the response is being convoluted. Assuming the sequence h has length denoted by ¾ then the number of rows of C is equal to C% ¾ - I). Then, using a deterministic least squares (LS) approach to compare against a desired response, (in a non-limiting example, defined as the Kronecker delta function — »)), one can express the LS optimal inverse filter as outlined in equation 2:
[0063] = [equation 2]
[0064] where is a column vector of zeroes with 1 in the m th position to create the modeling delay. The compensation filter &f ¾1 can then be computed from equation 2 using a range of computational methods.
[0065] In aspects, the parametrically configurable transfer function(s) may be iteratively determined by subsequently running test audio signals on the CED with the updated transfer function(s) and monitoring the modified acoustic signature of the CED with the audio sensors. A least squares optimization algorithm may be implemented to iteratively update the transfer function(s) between test regiments until an optimal modified acoustic signature of the CED is obtained. Other, non-limiting examples of optimization techniques include non-linear least squares, L2 norm, averaged one-dependence estimators (AODE), Kalman filters, Markov models, back propagation artificial neural networks, Baysian networks, basis functions, support vector machines, k-nearest neighbors algorithms, case-based reasoning, decision trees, Gaussian process regression, information fuzzy networks, regression analysis, self- organizing maps, logistic regression, fractional derivative based optimization, time series models such as autoregression models, moving average models, autoregressive integrated moving average models, classification and regression trees, multivariate adaptive regression splines, and the like.
[0066] Due to the spatial nature of the acoustic signature of a CED, the optimization process may be configured so as to minimize error between an ideal system response and the actual system response as measured at several locations within the sound field of the CED. The multi-channel data obtained via the audio sensors may be analyzed using sensor fusion approaches. In many practical cases, the usage case of the CED may be reasonably well defined (e.g. the location of the user with respect to the device, the placement of the device in an environment, etc.) and thus a suitable spatial weighting scheme can be devised in order to prioritize the audio response of the CED in certain regions of the sound field that correspond to the desired usage case. In one, non-limiting example, the acoustic response within the forward facing visual range of a laptop screen may be favored over the acoustic response as measured behind the laptop screen during such tests. In this way, a more optimal multi-rate filter system may be formulated to suit a particular usage case for the CED.
[0067] In aspects, a method for optimizing a multi-rate filter system in accordance with the present disclosure may include optimizing the HDL implementation for reduced power, reduced footprint, or for integration into a particular semiconductor manufacturing process (e.g. 13nm - 0.5μιη CMOS, CMOS-Opto, HV-CMOS, SiGe BiCMOS, etc.). This may be advantageous for providing an enhanced audio experience for a consumer electronic device without significantly impacting power consumption or adding significant hardware or cost to an already constrained device.
[0068] Fig. 2a shows a bandselector BS; in accordance with the present disclosure. The bandselector BSi includes a bandselector input LPi_i, a highpass bandselector output HPi, and a lowpass bandselector output LP;. The bandselector BS; includes a high pass filter 220 connected between the bandselector input LPu and the highpass bandselector output HPi. The bandselector BS; also includes a low pass filter 210 connected to the bandselector input LP;_i and an intermediate filtered signal 225. The bandselector BS; also includes a downsampler 230 connected to the intermediate filtered signal 225 and the lowpass bandselector output LP;. The low pass and high pass filters may be selected as known to one skilled in the art. The architecture herein may be advantageous in providing a simple structure to provide the low pass and high pass filters as a complimentary digital filter pair.
[0069] In aspects, one or more of the low pass and/or high pass filters may be configured with linear phase characteristics (e.g. as linear phase FIR filters, etc.). In aspects, one or more of the low pass and/or high pass filters may be configured with near linear phase characteristics (i.e. with phase characteristics that deviate from a linear phase characteristic by less than a predetermined limit). Such configurations may be advantageous to manage and/or reduce the overall phase distortion introduced to the signal path by the multi-rate filter system during use (e.g. as may be introduced during reconstruction of the individual bands during formation of the output signal). Near linear phase filter characteristics may be advantageous for managing the relationship between the overall phase distortion and the delay associated with the multi-rate filter system.
[0070] Fig. 2b shows a bandcombiner USi in accordance with the present disclosure. The bandcombiner US; includes two bandcombiner inputs Si, SPi+i and a bandcombiner output SP;. The bandcombiner US; includes a summer connected to the bandcombiner inputs Si, SPi+i and an intermediate combined signal 245. The bandcombiner USi further includes an upsampler 250 connected to the intermediate combined signal 245 to produce an upsampled intermediate signal 255. The bandcombiner US; includes a low pass filter 260 connected to the upsampled intermediate signal 255 and the bandcombiner output SP; so as to ensure the output thereof is not aliased and/or imaged. [0071] In aspects, the upsampler 250 may be configured with one or more interpolation filters so as to reduce imaging associated with the upsampled intermediate signal 255.
[0072] In aspects, the bandcombiner US; may include one or more filter elements (i.e. the low pass filter 260, included in the upsampler 250, etc.) configured so as to manage, reduce, and/or minimize the delay introduced into the signal during use. Such filter elements may be configured as linear phase filters, near linear phase filters (e.g. a filter prescribed wherein the filter phase variation is within a predetermined tolerance of a linear phase variation), or the like. Such filters may be optimized during an optimization method in accordance with the present disclosure.
[0073] Fig. 2c shows an example of a signal processing block APi in accordance with the present disclosure. The signal processing block APi is connected to an associated highpass bandselector output HP; and a first bandcombiner input Si. The signal processing block APi includes a linear filter component 270 and a nonlinear filter component 280 both in accordance with the present disclosure. The linear filter component 270 and the nonlinear filter component 280 are shown connected in series by a linear filtered signal 255. The nonlinear filter component 280 is configured to produce a nonlinear filtered signal (e.g. in this case the first bandcombiner input Si). Other interconnections of the filter components may be used in practice (serial connections, parallel connections, functionally equivalent merging of components, etc.). In aspects, one or more of the filters 270, 280 may include a delay function and/or a phase compensation function.
[0074] Fig. 2d shows an alternative example of a signal processing block APi in accordance with the present disclosure. The signal processing block APi is connected to an associated highpass bandselector output HP; and a first bandcombiner input Si. The signal processing block APi includes a finite impulse response (FIR) filter 271 connected in series with a compressor 290 both in accordance with the present disclosure. The finite impulse response (FIR) filter 271 is configured to output a linear filtered signal 276. The compressor 290 is configured to accept the linear filtered signal 276 and output a nonlinear filtered signal (e.g. in this case the first bandcombiner input Si). One or more of the filters 271, 290 may include a delay function and/or a phase compensation function. [0075] In aspects, the compressor 290 may include an observer. The observer may be configured to monitor at least one signal within the signal processing block APi (e.g. the linear filtered signal 276, the first bandcombiner input Si, an intermediate signal, a representation of such signals, etc.). In aspects, the observer may be configured to calculate a strength signal.
[0076] In aspects, the strength signal may be evaluated simply as being equal to a band-passed input signal. Some other non-limiting examples for calculating a strength signal from an associated input signal (or filtered version thereof) include, a power signal, instantaneous power signal, averaged power signal, frequency band averaged signal, peak signal, an envelope, a filtered envelope, a Kalman-filtered power estimation technique, noise power spectral density, loudspeaker excursion estimators, an autocorrelation parameter, combinations thereof, or the like.
[0077] In aspects, the compressor (e.g. or equivalently a nonlinear filter component) may be configured to respond to the observer output (e.g. an observer signal SLi). The observer may be configured to output an observer signal SLi for use by another component and/or block in the multi-rate filter system.
[0078] Fig. 2e shows an alternative example of a signal processing block APi in accordance with the present disclosure. The signal processing block APi is connected to an associated highpass bandselector output HP; and a first bandcombiner input Si. The signal processing block APi includes an adaptive finite impulse response (aFIR) filter 292 connected to a feedback signal channel SF; and connected in series with a compressor 296 (in this case a limiter) both in accordance with the present disclosure. The adaptive finite impulse response (FIR) filter 292 is configured to output a linear filtered signal 294. The limiter 296 is configured to accept the linear filtered signal 294 and output a nonlinear filtered signal (e.g. in this case the first bandcombiner input Si).
[0079] In general the adaptation process associated with the adaptive finite impulse response (aFIR) filter 292 may be configured so as to be sufficiently slow to maintain an essentially linear behavior from the aFIR filter 292 over the signal bandwidth of interest (e.g. the audio frequency band).
[0080] In aspects, the limiter 296 may include an observer in accordance with the present disclosure. The observer may be configured to monitor at least one signal within the signal processing block APi (e.g. the linear filtered signal 294, the first bandcombiner input Si, an intermediate signal, a representation of such signals, etc.). The observer may be configured to calculate a strength signal in accordance with the present disclosure.
[0081] Fig. 3 shows a nonlinear functional block 300 for implementing an audio enhancement algorithm in combination with a multi-rate filter system in accordance with the present disclosure. In the non-limiting example shown, the nonlinear functional block 300 shows an illustrative example of a bass enhancement system 300 in accordance with the present disclosure. The bass enhancement system 200 may be configured to accept an input signal, Sout 2 from the multi-rate filter system and a control signal 25 from an evaluation block 340, to produce an enhanced output signal, S0ut2 345. The evaluation block 340 may be configured to accept an external control signal Sctri, one or more feedback signals SF0 to SFn, and one or more observer signals SLo to SLn. The evaluation block 340 may combine signals operably generated by many multi-rate filter blocks 10 to form a collective strength signal, power level, etc. to optionally direct the bass enhancement system 300.
[0082] In aspects, the bass enhancement system 300 may include a psychoacoustic bass enhancement block (PAB) 310 and a compressor 320. The compressor 320 may be configured to accept the input signal 2 or a related signal thereof (e.g. filtered, resampled, clipped, input signal 2, etc.), and the control signal 25, and to produce a first enhanced signal 325 and an internal control signal 335. The PAB 330 may be configured to accept the input signal 2 or a related signal therefrom (e.g. filtered, resampled, clipped, input signal 2, etc.) and the internal control signal 335, and to produce a second enhanced signal 315. In aspects, the first enhanced signal 325 and the second enhanced signal 315 may be combined (e.g. added, mixed, etc.) in a combination block 340 to produce the enhanced output signal, Sout2 345.
[0083] The system 300, the PAB 330 and/or the compressor 320 may include one more filters (e.g band pass filters, low pass filters, high pass filters, adaptable filters, polyphase FIR filters, FIR filters, lattice wave filters, etc.) for isolating one or more frequency bands (e.g. band-1, band-2, band-3, band-m, band-n signals, etc.) from the input signal 2 for further analysis and/or enhancement. In aspects, the compressor 320 may include a filter for isolating a portion of the input signal content residing roughly within the bass audio range (e.g. 10-80Hz, 30 - 60Hz, 35-50Hz, 100-300Hz, 120-250Hz, etc.). The compressor 320 may be configured to adjust the bandwidth limits of the filter in real-time (e.g. as directed by the external control signal Sctri). Alternatively, additionally, or in combination the multi-rate filter system may be tapped at one or more bandcombiner outputs SPi in order to retrieve one or more band limited signals for use in the nonlinear functional block 300 (e.g. the bass enhancement system).
[0084] Fig. 4 shows an illustrative example of a feedback system including a controller 420 and some illustrative feedback mechanisms in accordance with the present disclosure. The controller 420 may be configured to generate one or more feedback signals SF0 to SFn (equivalently considered external control signals). The control signals 495 maybe used by various blocks in multi-rate filter system to control gain adjustments, adapt filter parameters, and the like. The controller 420 may be connected to the input channel 1 so as to accept the input signal Sin to contribute to the generation of the feedback signals SFo to SFn. In aspects, the controller 420 may be configured to accept the input signal 1 and to generate one or more feedback signals SF0 to SFn with an entirely feed forward signal path. The controller 420 may be configured to accept a system control signal V 415 so as to adjust one or more control signals 495.
[0085] In aspects, the system control signal 415 may be a power management signal, a volume scale, a power setting (e.g. ultra-low power, low power, full power, etc.), a signal related to trade-off between audio quality and power, a user input signal, or the like.
[0086] When implemented into an audio processing system, the audio processing system may include a driver 430. The driver 430 may be driven by an audio processing output signal 425, at least partially dependent on the output signal Sout and/or the enhanced signal 355. The driver 430 may generate one or more output signals 435 for driving one or more loudspeakers 460, 470, loudspeaker driver modules 440, and/or integrated circuits 450 included therein. The controller 420 may be configured to accept one or more sensor signals 445, 455, 465, 475, 485 from one or more audio components within a complete audio signal processing system. Some non-limiting examples include current, voltage, and/or temperature sensor signal 465 from the driver 430, a current, voltage, displacement, temperature, and/or acceleration sensor signal 455, 485 from one or more of the loudspeakers 460, 470, and a current, voltage, impedance, temperature, limiter, and/or envelop sensor signal 450 from one or more integrated circuits 450 included in the audio processing system.
[0087] In aspects, the controller 420 may be configured to accept an audio sensor signal 445 as operably produced by one or more microphones 480 included in the audio processing system. The controller 420 may be configure to accept a sensor signal (not explicitly shown) from one or more accelerometers, gyroscopes, GPS sensors, temperature sensors, humidity sensors, battery life sensors, current sensors, magnetic field sensors, or the like.
[0088] In aspects, a range of feedback algorithms may be implemented in the controller 420 to relate the sensor signals 445, 455, 465, 475, 485 to the feedback signals SF0 to SFn. Some non-limiting examples of feedback algorithms include speaker/drive temperature overload feedback, negative feedback based on one or more aspects of the audio sensor signal 445 (e.g. an amplitude based feedback, a distortion based feedback, etc.), a distortion limiting algorithm (e.g. via measurement of the audio sensor signal 445), combinations thereof, and the like.
[0089] Fig. 5 shows a non-limiting example of a multi-rate filter system including a nonlinear functional block in accordance with the present disclosure. The multi-rate filter system includes a plurality of multi-rate filter blocks MRFBo to MRFB12 each in accordance with the present disclosure. The multi-rate filter block MRFBo is connected to an input channel 1 , configured so as to accept an input signal Sin, and is connected to an output channel 2, configured so as to output a filtered signal Sout. The downsampler and upsampler in each multi-rate filter block MRFBi are configured with sampling ratios equal to "r". Such a limitation is only for illustration purposes. The sampling ratios may be configured to any values and need not be equal to each other.
[0090] In aspects, the maximum frequency associated with each signal within the multi-rate filter system is indicated as a power of r (e.g. r°). Thus the bands associated with this multi-rate filter are logarithmically spaced across the signal spectrum. Such limitation is shown only for illustrative purposes. The sampling ratios may be configured to any unique values and need not be equal to each other.
[0091] In aspects, the multi-rate filter system may include a nonlinear functional block 500 in accordance with the present disclosure. The nonlinear functional block 500 is connected to the bandcombiner output SP9 of the multi-rate filter block MRFB9. In the example shown, the bandcombiner output is oversampled (i.e in this case to a value corresponding to the upper band limit of r9). Thus there is sufficient headroom in SP9 to accommodate at least a portion of the distortion introduced by the nonlinear functional block 500. The nonlinear functional block 500 is connected to a summer 510. The summer 510 may be connected to the bandcombiner output SP4 of the multi-rate filter block MRFB4. In this non-limiting example, the sample rates of the summer 510 inputs are equivalent. The summer output 515 is connected to the prior multi-rate filter block MRFB3 so as to add the nonlinear functional block 500 enhanced signal back into the multi-rate filter block cascade.
[0092] In aspects, the nonlinear functional block 500 may be a bass enhancement block 300 in accordance with the present disclosure. The nonlinear functional block 500 may also be equivalent to any nonlinear filter component in accordance with the present disclosure.
[0093] The structure shown may be advantageous for effectively coupling highly nonlinear functions into the cascade structure of the multi-rate filter system.
[0094] In aspects, the multi-rate filter block cascade may be tapped at any bandcombiner output SP;. Such taps may be used to construct wider band signals from the individual band signal of the multi-rate filter cascade.
[0095] In aspects, the sample rates of at least one downsampler and/or upsampler in the multi-rate filter system may be adaptively configurable. At least one downsampler and/or upsampler sample rate may be configured so as to coincide with an acoustic feature (e.g. an acoustic resonance, a bass band transition, a jitter, etc.) of an associated consumer electronics device into which the multi-rate filter system is included.
[0096] Fig. 6a-b show examples of the frequency spectrum associated with the example multi-rate filter system shown in Fig. 5. Fig. 6a shows a log-log relationship between frequency and frequency content of a signal 600 associated with each multi- rate filter block 10 of this specific example. The signal 600 is bound by an upper limit frequency 602 and a lower limit frequency 601. As shown, the bands are logarithmically spaced in frequency. Such a limitation is only shown for illustration purposes and in aspects, the bands may be arbitrarily assigned. The sampling ratios may be configured to any values and need not be equal to each other. In aspects, the bands may be linearly spaced across the signal spectrum, nonlinearly spaced, logarithmically spaced, randomly spaced, etc.
[0097] Fig. 6b shows further examples of signal content associated with the example of Fig. 5. Fig. 6b shows a bass band portion 605 of the overall signal, as tapped at SP9 in the example. The bass band portion 605 is passed to the nonlinear functional block 500 to produce a nonlinear filtered portion 615. In the non- limiting example shown, the nonlinear filtered portion 615 contains significant distortion, thus introducing signal content with a considerably higher frequency than could be sampled from the r3 band. Thus, by upsampling the bandcombiner output SP9 to r9, the additional frequency content can be accommodated without aliasing. The signal portion between SP6 and SP4 is shown as a midband portion 625 and is added to with the nonlinear filtered portion 615 in the summer and returned to the cascade to be integrated and upsampled with content in the upper band portion 635 of the signal.
[0098] In aspects, the multi-rate filter system may be embedded in an application specific integrated circuit (ASIC) or be provided as a hardware descriptive language block (e.g. VHDL, Verilog, etc.) for integration into a system on chip (SoC), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or a digital signal processor (DSP) integrated circuit.
[0099] In aspects, a multi-rate filter system in accordance with the present disclosure may be configured to substantially match a predetermined single rate wide band filter. The wide band filter may be configured to compensate for one or more rendering characteristics of an audio rendering device (e.g. a consumer electronics device, a media rendering network, etc.). In one non-limiting example, the multi-rate filter system may be configured with a series of bands to collectively span the wide band spectrum associated with the wide band filter. The multi-rate filter system may include N bands, the bands configured as follows: N-l bands spaced so as to fill a high frequency portion of the wide band filter spectrum (i.e. configured so as to span from the upper limit of the spectrum, Fmax, down to a low to mid band frequency Fm), and an additional low band spanning from a substantially lower limit of the spectrum Fmin, up to the low to mid band frequency Fm. Each of the bands (i.e. each of the N-l bands, the low frequency band, etc.) may include a signal processing block APi connected to a bandselector BSi in accordance with the present disclosure. The N-l bands may be spaced linearly, logarithmically, with individually configured bandwidth, etc. in accordance with the present disclosure. In aspects, the low band may be configured so as to cover a bass band of the spectrum (e.g. perhaps correlated with the bass band of the associated device, covering relevant spectrum less than 1000 Hz, less than 500 Hz, less than 300 Hz, less than 150Hz, less than 120Hz, less than 80Hz, etc.).
[00100] In aspects, the N-l bands may be logarithmically spaced in accordance with the present disclosure (i.e. each band covering 1 :m spectrum wherein m is a real number, 1 :2, 1 : 1.5, half octave bands, quarter octave bands, etc.).
[00101] One or more of the low pass filters in each band may be configured to reduce cross talk, aliasing, imaging, etc. associated with the adjacent band structures, downsampling, and upsampling aspects of the multi-rate filter system. In one non- limiting example, one or more of the low pass filters may be formed from linear phase FIR filters. One or more of the low pass filters may be configured with cutoff characteristics suitably placed to reduce aliasing and/or imaging of the signals to be processed by the associated bandselector BSi, bandcombiner US;, and/or signal processing block APi. In aspects, related to the use of linear phase filters, bands associated with shorter paths may include a delay element so as to maintain an equal delay between all band signals in the multi-rate filter system.
[00102] Fig. 7a-b show a method for optimizing a multi-rate filter to match a wide band target filter in accordance with the present disclosure and a resulting filter frequency response. Fig. 7a shows a method for optimizing a multi-rate filter system to match a wide band target filter in accordance with the present disclosure. The method includes defining the structure of the multi-rate filter system, defining the performance allowances (i.e. phase delay, phase distortion, and/or magnitude mismatch), providing an initial guess to match the target filter, optimizing the multi- rate filter system to match the target filter, comparing the optimized filter and the target in accordance with the performance allowances, and optionally iterating any of the above steps in order to satisfy the performance allowances.
[00103] In aspects, the step of optimizing may include optimizing the multi-rate filter system on the whole, in parts, or by fixing one or more portions of the system while optimizing one or more alternative aspects. The optimization procedure may be completed using one or more known techniques (e.g. nonlinear programming solvers, minimax constraint problem solvers, etc.). Other, non-limiting examples of optimization techniques include non-linear least squares, L2 norm, averaged one- dependence estimators (AODE), Kalman filters, Markov models, back propagation artificial neural networks, Baysian networks, basis functions, support vector machines, k-nearest neighbors algorithms, case-based reasoning, decision trees, Gaussian process regression, information fuzzy networks, regression analysis, self- organizing maps, logistic regression, fractional derivative based optimization, time series models such as autoregression models, moving average models, autoregressive integrated moving average models, classification and regression trees, multivariate adaptive regression splines, and the like.
[00104] In aspects, one or more of the filters in the multi-rate filter system may be optimized separately from each other. The filters in the bandselector BSi and the bandcombiner US; may be designed (and optionally optimized) so as to define the band structures of the multi-rate filter to conform with the overall performance allowances of the filter. The bandselector BSi and the bandcombiner USi filters may be matched so as to provide the same values and/or reduce complexity of the filter system (i.e. perhaps so as to provide matching filter parameters, reduce memory requirements, etc.). The resulting bandselector BSi and the bandcombiner US; filters may then be held constant while the processing filters included in each of the signal processing blocks AP; are optimized in a secondary optimization procedure.
[00105] Additionally, alternatively, or in combination the filters in the multi-rate filter system may be collectively optimized with reference to the performance allowances. Such an approach may be advantageous for flexibly trading off between the performance allowances (i.e. may allow for more control over delay, phase distortion, and/or magnitude variation).
[00106] For purposes of demonstration, in one non-limiting example, the predetermined wide band filter may be a FIR filter with 2048 taps (e.g. a minimum phase FIR filter, linear phase FIR filter, etc.). The basic computational requirement for the wide band filter is 2048 computations per sample (i.e. 90MIPS at 44.1kHz). An associated multi-rate filter may be provided with N bands (e.g. N = 2, 3, 4, 5, 6, etc.) in accordance with the present disclosure. In one non-limiting example, the multi-rate filter may include logarithmically spaced bands (i.e. in a multi-rate filter with N = 3, the bands may be approximately 22kHz:44kHz, HkHz:22kHz, Fmm:l lkHz).
[00107] The multi-rate filter may be structured in accordance with the method described herein, and the performance allowances may be defined a priori. In one non- limiting example, the allowable delay is preferably less than or equal to 10ms, the allowable phase distortion is zero (i.e. a linear phase configuration with associated delay elements in each band), and the allowable magnitude variation is set at less than or equal to 0.25dB. For purposes of discussion, in this example, the delay allowance is relaxed while the linear phase aspect is enforced. Filters in the bandselector BSi and the bandcombiner US; are selected to have an order of 40. Initial guesses for the bandselector BSi and the bandcombiner US; filters were calculated using a Parks- McClellan algorithm and then optimized subject to weighted constraints relating to pass band flatness, stopband ripple, etc. of each of the filters.
[00108] Continuing with the example, processing filters associated with each signal processing block APi are of order 64, except for the lowest band filter, which is arbitrarily provided with order 1024, 512, 256, 128, or 64 for N varying between N=2 and N = 6. Initial guesses for the processing filters were made using a Parks- McClellan algorithm. The resulting optimized filters were then generated using an optimization technique in accordance with the present disclosure subject to constraints related to minimization of amplitude error under the constraints of minimum phase filter properties. Such a configuration may be advantageous for simplifying the overall optimization process.
[00109] In accordance with this example, the associated memory requirements, and computations requirements as a function of N are shown in Table 1 :
[00110] Table 1 :
Figure imgf000026_0001
4 1564 12,68
5 2098 12.43
6 3400 12.56
[00111] As can be seen from Table 1, the computational requirements for the multi-band filter system are considerably lower than those of the wideband filter for all N values studied. The memory requirements are also improved for a range of N (in this case for N values of 2 through 6).
[00112] Fig. 7b shows the error magnitude between the target wideband filter, the initial guess and for the post optimized multi-rate filter for the procedure described herein (shown in separate graphs). As can be seen in Fig. 7b, the magnitude error between the multi-rate filter and the target filter has been reduced by roughly a factor of 4 during the optimization procedure versus the initial guess.
[00113] In aspects, a multi-rate filter system in accordance with the present disclosure may be soft-coded into a processor, coded in VHDL, Verilog or other hardware descriptive language, flash, EEPROM, memory location, or the like. Such a configuration may be used to implement the multi-rate filter system in software, as a routine on a DSP, an FPGA, A CPLD, a processor, and ASIC, etc.
[00114] It will be appreciated that additional advantages and modifications will readily occur to those skilled in the art. Therefore, the disclosures presented herein and broader aspects thereof are not limited to the specific details and representative embodiments shown and described herein. Accordingly, many modifications, equivalents, and improvements may be included without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

Claims

WHAT IS CLAIMED IS:
1. A multi-rate filter system comprising:
an input channel configured to receive an input signal; an output channel configured to output a filtered signal; a cascade of multi-rate filter blocks coupled between the input channel and the output channel, at least one of the multi-rate filter blocks comprising:
a bandselector comprising a bandselector input, a highpass bandselector output, a lowpass bandselector output connected to a subsequent multi- rate filter block, and a downsampler connected between the bandselector input and the lowpass bandselector output;
a signal processing block coupled to the highpass bandselector output, the signal processing block comprising a linear filter component; and
a bandcombiner connected to the signal processing block, the bandcombiner comprising two bandcombiner inputs, a bandcombiner output, and an upsampler, the first bandcombiner input connected to the signal processing block, the second bandcombiner input connected to a subsequent multi-rate filter block, and the bandcombiner output connected to a prior multi-rate filter block, the upsampler connected between the bandcombiner inputs and the bandcombiner output.
2. The multi-rate filter system in accordance with claim 1, wherein the linear filter component is selected from a group comprising a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Kalman filter, a neural network, a fuzzy logic filter, and combinations thereof.
3. The multi-rate filter system in accordance with claim 2, wherein the linear filter component comprises reconfigurable filter parameters.
4. The multi-rate filter system in accordance with any one of claims 1 to 3, wherein at least one of the signal processing blocks comprises a nonlinear filter component connected to the linear filter component.
5. The multi-rate filter system in accordance with claim 4, wherein the nonlinear filter component is selected from a group comprising a compressor, a polynomial, a limiter, and combinations thereof.
6. The multi-rate filter system in accordance with any preceding claim, wherein at least one multi-rate filter block comprises an observer configured to output an observer signal, the observer connected to the signal processing block between the highpass bandselector output and the first bandcombiner input.
7. The multi-rate filter system in accordance with claim 6, wherein the observer comprises a power monitor.
8. The multi-rate filter system in accordance with claim 6 or 7, further in accordance with claim 4 or 5, wherein the nonlinear filter component is configured to respond to the observer signal.
9. The multi-rate filter system in accordance with any preceding claim, comprising a nonlinear functional block (NLFB) comprising an NLFB input and an NLFB output, a first multi-rate filter block comprising a bandcombiner output, and a second multi-rate filter block comprising a bandcombiner input, the NLFB input connected to the bandcombiner output of the first multi-rate filter block, and the NLFB output connected to the bandcombiner input of the second multi-rate filter block.
10. The multi-rate filter system in accordance with claim 9, wherein the nonlinear function block comprises a psychoacoustic function.
11. The multi-rate filter system in accordance with any preceding claim, wherein the downsampler is an m: 1 downsampler, and where m is a sample rate and the upsampler is a 1 :k upsampler, and where k is a sample rate.
12. The multi-rate filter system in accordance with claim 11, wherein m is equal to k.
13. The multi-rate filter system in accordance with claim 11 or 12 wherein m and/or k are less than or equal to 2, less than or equal to 1.5, less than or equal to 1.33, or less than or equal to 1.25.
14. The multi-rate filter system in accordance with any preceding claim, wherein the multi-rate filter blocks span an audio signal bandwidth.
15. The multi-rate filter system in accordance with any preceding claim, wherein the bandselector comprises a low pass filter connected between the bandselector input and the bandselector lowpass output, and a high pass filter connected between the bandselector input and the bandselector highpass output.
16. The multi-rate filter system in accordance with claim 15, wherein the bandselector comprises a complimentary filter pair formed by the low pass filter and high pass filter.
17. The multi-rate filter system in accordance with claim 15 or 16, wherein the low pass filter is selected from a group consisting of a linear phase FIR filter, a near linear phase FIR filter, a lattice wave filter, and combinations thereof.
18. The multi-rate filter system in accordance with any preceding claim, wherein the bandcombiner comprises a summer connected to the bandcombiner inputs and the upsampler.
19. The multi-rate filter system in accordance with any preceding claim, wherein the bandcombiner comprises a low pass filter connected between the upsampler and the bandcombiner output.
20. The multi-rate filter system in accordance with any preceding claim, comprising a control channel configured to receive a control signal, at least one multi- rate filter block connected to the control channel.
21. The multi-rate filter system in accordance with claim 20, the linear filter component configured to respond to the control signal.
22. The multi-rate filter system in accordance with claim 20 or 21, further in accordance with claim 4 or 5, wherein the nonlinear filter component is configured to respond to the control signal.
23. Use of a multi-rate filter system in accordance with any one of claims 1 to 22, in a consumer electronics device.
24. Use of a multi-rate filter system in accordance with any one of claims 1 to 22, to process an audio signal.
25. A method for filtering a signal, the method comprising:
processing an input signal with a plurality of multi-rate filter blocks, the processing of at least one multi-rate filter block comprising:
downsampling to produce a downsampled signal;
- providing the downsampled signal to a subsequent multi-rate filter block;
processing with a linear filter component to form a linear filtered signal;
processing with a nonlinear filter component to form a nonlinear filtered signal; combining or selecting the linear filtered signal and/or the nonlinear filtered signal to form a filtered output signal; and
upsampling the filtered output signal to form an increased rate signal.
26. The method in accordance with claim 25, comprising processing at least one increased rate signal with a nonlinear functional block (NLFB) to form a nonlinear processed signal.
27. The method in accordance with claim 26, comprising providing the nonlinear processed signal to a prior multi-rate filter block.
28. The method in accordance with claim 25, comprising providing the increased rate signal to a prior multi-rate filter block.
29. The method in accordance with any one of claims 25 to 28 wherein the linear filter component is selected from a group comprising a finite impulse response (FIR) filter, an infinite impulse response (IIR) filter, a Kalman filter, a neural network, a fuzzy logic filter, a lattice wave filter, and combinations thereof.
30. The method in accordance with any one of claims 25 to 29 wherein the nonlinear filter component is selected from a group comprising a compressor, a polynomial, a limiter, and combination thereof.
31. A method for matching a multi-rate filter system in accordance with any one of claims 1 - 22 to a predetermined wideband filter, the method comprising:
assigning the number of multi-rate filter blocks in the multi-rate filter system;
calculating an initial guess for one or more of the multi-rate filter blocks;
optimizing the multi-rate filter blocks towards the wideband filter to form one or more updated multi-rate filter blocks; and constructing a matched multi-rate filter system from the updated multi- rate filter blocks.
32. The method in accordance with claim 31, wherein the step of calculating is performed using a Parks-McClellan algorithm.
33. The method in accordance with claim 31 or 32, wherein the step of optimizing is performed on one or more bandselectors and one or more
bandcombiners included in the multi-rate filter system, and separately on one or more of the signal processing blocks included in the multi-rate filter system.
34. The method in accordance with any one of claims 31 - 33, comprising adding a nonlinear function block to one or more of the multi-rate filter blocks.
35. The method in accordance with claim 34, comprising configuring the nonlinear function block to match a psychoacoustic function.
PCT/US2013/020740 2012-01-10 2013-01-09 Multi-rate filter system WO2013106370A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP13735847.9A EP2803137B1 (en) 2012-01-10 2013-01-09 Multi-rate filter system
CN201380005196.7A CN104040888B (en) 2012-01-10 2013-01-09 Multirate filter system
US14/371,020 US20150010170A1 (en) 2012-01-10 2013-01-09 Multi-rate filter system
US15/411,466 US20170134854A1 (en) 2012-01-10 2017-01-20 Multi-rate filter system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201261584855P 2012-01-10 2012-01-10
US61/584,855 2012-01-10
US201261658560P 2012-06-12 2012-06-12
US61/658,560 2012-06-12

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US14/371,020 A-371-Of-International US20150010170A1 (en) 2012-01-10 2013-01-09 Multi-rate filter system
US15/411,466 Division US20170134854A1 (en) 2012-01-10 2017-01-20 Multi-rate filter system

Publications (1)

Publication Number Publication Date
WO2013106370A1 true WO2013106370A1 (en) 2013-07-18

Family

ID=48781847

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/020740 WO2013106370A1 (en) 2012-01-10 2013-01-09 Multi-rate filter system

Country Status (4)

Country Link
US (2) US20150010170A1 (en)
EP (1) EP2803137B1 (en)
CN (1) CN104040888B (en)
WO (1) WO2013106370A1 (en)

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104639205A (en) * 2014-12-08 2015-05-20 李青花 Signal enhancement system based on near field communication
US9462376B2 (en) 2013-04-16 2016-10-04 Cirrus Logic, Inc. Systems and methods for hybrid adaptive noise cancellation
US9478210B2 (en) 2013-04-17 2016-10-25 Cirrus Logic, Inc. Systems and methods for hybrid adaptive noise cancellation
US9502020B1 (en) 2013-03-15 2016-11-22 Cirrus Logic, Inc. Robust adaptive noise canceling (ANC) in a personal audio device
GB2539280A (en) * 2015-06-09 2016-12-14 Cirrus Logic Int Semiconductor Ltd Hybrid finite impulse response filter
US9532139B1 (en) 2012-09-14 2016-12-27 Cirrus Logic, Inc. Dual-microphone frequency amplitude response self-calibration
US9552805B2 (en) 2014-12-19 2017-01-24 Cirrus Logic, Inc. Systems and methods for performance and stability control for feedback adaptive noise cancellation
US9578432B1 (en) 2013-04-24 2017-02-21 Cirrus Logic, Inc. Metric and tool to evaluate secondary path design in adaptive noise cancellation systems
US9578415B1 (en) 2015-08-21 2017-02-21 Cirrus Logic, Inc. Hybrid adaptive noise cancellation system with filtered error microphone signal
US9620101B1 (en) 2013-10-08 2017-04-11 Cirrus Logic, Inc. Systems and methods for maintaining playback fidelity in an audio system with adaptive noise cancellation
US9633646B2 (en) 2010-12-03 2017-04-25 Cirrus Logic, Inc Oversight control of an adaptive noise canceler in a personal audio device
US9646595B2 (en) 2010-12-03 2017-05-09 Cirrus Logic, Inc. Ear-coupling detection and adjustment of adaptive response in noise-canceling in personal audio devices
US9666176B2 (en) 2013-09-13 2017-05-30 Cirrus Logic, Inc. Systems and methods for adaptive noise cancellation by adaptively shaping internal white noise to train a secondary path
US9704472B2 (en) 2013-12-10 2017-07-11 Cirrus Logic, Inc. Systems and methods for sharing secondary path information between audio channels in an adaptive noise cancellation system
US9711130B2 (en) 2011-06-03 2017-07-18 Cirrus Logic, Inc. Adaptive noise canceling architecture for a personal audio device
US9721556B2 (en) 2012-05-10 2017-08-01 Cirrus Logic, Inc. Downlink tone detection and adaptation of a secondary path response model in an adaptive noise canceling system
US9773490B2 (en) 2012-05-10 2017-09-26 Cirrus Logic, Inc. Source audio acoustic leakage detection and management in an adaptive noise canceling system
US9807503B1 (en) 2014-09-03 2017-10-31 Cirrus Logic, Inc. Systems and methods for use of adaptive secondary path estimate to control equalization in an audio device
US9824677B2 (en) 2011-06-03 2017-11-21 Cirrus Logic, Inc. Bandlimiting anti-noise in personal audio devices having adaptive noise cancellation (ANC)
US9955250B2 (en) 2013-03-14 2018-04-24 Cirrus Logic, Inc. Low-latency multi-driver adaptive noise canceling (ANC) system for a personal audio device
US10013966B2 (en) 2016-03-15 2018-07-03 Cirrus Logic, Inc. Systems and methods for adaptive active noise cancellation for multiple-driver personal audio device
US10026388B2 (en) 2015-08-20 2018-07-17 Cirrus Logic, Inc. Feedback adaptive noise cancellation (ANC) controller and method having a feedback response partially provided by a fixed-response filter
US10181315B2 (en) 2014-06-13 2019-01-15 Cirrus Logic, Inc. Systems and methods for selectively enabling and disabling adaptation of an adaptive noise cancellation system
US10206032B2 (en) 2013-04-10 2019-02-12 Cirrus Logic, Inc. Systems and methods for multi-mode adaptive noise cancellation for audio headsets
US10219071B2 (en) 2013-12-10 2019-02-26 Cirrus Logic, Inc. Systems and methods for bandlimiting anti-noise in personal audio devices having adaptive noise cancellation
US10382864B2 (en) 2013-12-10 2019-08-13 Cirrus Logic, Inc. Systems and methods for providing adaptive playback equalization in an audio device
US10468048B2 (en) 2011-06-03 2019-11-05 Cirrus Logic, Inc. Mic covering detection in personal audio devices

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9743201B1 (en) * 2013-03-14 2017-08-22 Apple Inc. Loudspeaker array protection management
JP6305694B2 (en) * 2013-05-31 2018-04-04 クラリオン株式会社 Signal processing apparatus and signal processing method
US11488574B2 (en) 2013-12-02 2022-11-01 Jonathan Stuart Abel Method and system for implementing a modal processor
US10825443B2 (en) * 2013-12-02 2020-11-03 Jonathan Stuart Abel Method and system for implementing a modal processor
US11087733B1 (en) 2013-12-02 2021-08-10 Jonathan Stuart Abel Method and system for designing a modal filter for a desired reverberation
GB2526304B (en) * 2014-05-20 2018-05-30 Jaguar Land Rover Ltd Central tyre inflation system
JP6401521B2 (en) * 2014-07-04 2018-10-10 クラリオン株式会社 Signal processing apparatus and signal processing method
WO2016081814A2 (en) * 2014-11-20 2016-05-26 Tymphany Hk Limited Method and apparatus to equalize acoustic response of a speaker system using multi-rate fir and all-pass iir filters
US9935604B2 (en) * 2015-07-06 2018-04-03 Xilinx, Inc. Variable bandwidth filtering
US10441993B2 (en) * 2015-09-11 2019-10-15 Lear Corporation Vertical twisting system and method
CN106549652B (en) * 2015-09-18 2022-01-11 杜比实验室特许公司 Filter coefficient update in time-domain filtering
EP3350805B1 (en) 2015-09-18 2019-10-02 Dolby Laboratories Licensing Corporation Filter coefficient updating in time domain filtering
US10070220B2 (en) 2015-10-30 2018-09-04 Dialog Semiconductor (Uk) Limited Method for equalization of microphone sensitivities
WO2017191097A1 (en) * 2016-05-02 2017-11-09 Purifi Aps A method of controlling loudspeaker diaphragm excursion
US10394985B2 (en) 2017-01-11 2019-08-27 Samsung Electronics Co., Ltd. Apparatus and method for modeling random process using reduced length least-squares autoregressive parameter estimation
US11206090B2 (en) * 2017-03-24 2021-12-21 Maxlinear, Inc. Error measurement method using a time-variant stopband test signal
CN109286730A (en) * 2017-07-20 2019-01-29 阿里巴巴集团控股有限公司 A kind of method, apparatus and system of detection of echoes
WO2019089845A1 (en) * 2017-10-31 2019-05-09 Synaptics Incorporated Low delay decimator and interpolator filters
US10382857B1 (en) * 2018-03-28 2019-08-13 Apple Inc. Automatic level control for psychoacoustic bass enhancement
CN109919892A (en) * 2019-03-18 2019-06-21 西安电子科技大学 The image interfusion method of the preset deep learning neural network of filter
JP7000373B2 (en) * 2019-04-15 2022-01-19 ファナック株式会社 Machine learning device, control device and machine learning method
US10755721B1 (en) 2019-04-30 2020-08-25 Synaptics Incorporated Multichannel, multirate, lattice wave filter systems and methods
US11610597B2 (en) * 2020-05-29 2023-03-21 Shure Acquisition Holdings, Inc. Anti-causal filter for audio signal processing

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060109941A1 (en) * 2004-10-29 2006-05-25 KEELE D B Jr Log-sampled filter system
US20060159283A1 (en) * 2005-01-14 2006-07-20 Samsung Electornics Co., Ltd. Method and apparatus for audio bass enhancement
US7321913B2 (en) * 2002-12-12 2008-01-22 Dolby Laboratories Licensing Corporation Digital multirate filtering
US7376688B1 (en) * 2001-01-09 2008-05-20 Urbain A. von der Embse Wavelet multi-resolution waveforms
US7757557B2 (en) * 2005-10-14 2010-07-20 Olympus Ndt Ultrasonic detection measurement system using a tunable digital filter with 4x interpolator

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB8429879D0 (en) * 1984-11-27 1985-01-03 Rca Corp Signal processing apparatus
US4843626A (en) * 1986-07-10 1989-06-27 Werrbach Donn R Multiband limiter with automatic limiting threshold (ALT) compensation
US5995539A (en) * 1993-03-17 1999-11-30 Miller; William J. Method and apparatus for signal transmission and reception
DE4328620C1 (en) * 1993-08-26 1995-01-19 Akg Akustische Kino Geraete Process for simulating a room and / or sound impression
US5841681A (en) * 1996-04-10 1998-11-24 United Microelectronics Corporation Apparatus and method of filtering a signal utilizing recursion and decimation
US5848164A (en) * 1996-04-30 1998-12-08 The Board Of Trustees Of The Leland Stanford Junior University System and method for effects processing on audio subband data
US6408269B1 (en) * 1999-03-03 2002-06-18 Industrial Technology Research Institute Frame-based subband Kalman filtering method and apparatus for speech enhancement
US6643406B1 (en) * 1999-07-28 2003-11-04 Polaroid Corporation Method and apparatus for performing linear filtering in wavelet based domain
US7039665B2 (en) * 2002-09-27 2006-05-02 Texas Instruments Incorporated Efficient reconstruction
US7373210B2 (en) * 2003-01-14 2008-05-13 Harman International Industries, Incorporated Effects and recording system
ATE459216T1 (en) * 2005-06-28 2010-03-15 Akg Acoustics Gmbh METHOD FOR SIMULATING A SPACE IMPRESSION AND/OR SOUND IMPRESSION
US7783478B2 (en) * 2007-01-03 2010-08-24 Alexander Goldin Two stage frequency subband decomposition
DE102007052991B4 (en) * 2007-11-05 2010-10-07 Schöwer, Jan Effects unit control

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7376688B1 (en) * 2001-01-09 2008-05-20 Urbain A. von der Embse Wavelet multi-resolution waveforms
US7321913B2 (en) * 2002-12-12 2008-01-22 Dolby Laboratories Licensing Corporation Digital multirate filtering
US20060109941A1 (en) * 2004-10-29 2006-05-25 KEELE D B Jr Log-sampled filter system
US20060159283A1 (en) * 2005-01-14 2006-07-20 Samsung Electornics Co., Ltd. Method and apparatus for audio bass enhancement
US7757557B2 (en) * 2005-10-14 2010-07-20 Olympus Ndt Ultrasonic detection measurement system using a tunable digital filter with 4x interpolator

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9633646B2 (en) 2010-12-03 2017-04-25 Cirrus Logic, Inc Oversight control of an adaptive noise canceler in a personal audio device
US9646595B2 (en) 2010-12-03 2017-05-09 Cirrus Logic, Inc. Ear-coupling detection and adjustment of adaptive response in noise-canceling in personal audio devices
US9824677B2 (en) 2011-06-03 2017-11-21 Cirrus Logic, Inc. Bandlimiting anti-noise in personal audio devices having adaptive noise cancellation (ANC)
US10468048B2 (en) 2011-06-03 2019-11-05 Cirrus Logic, Inc. Mic covering detection in personal audio devices
US10249284B2 (en) 2011-06-03 2019-04-02 Cirrus Logic, Inc. Bandlimiting anti-noise in personal audio devices having adaptive noise cancellation (ANC)
US9711130B2 (en) 2011-06-03 2017-07-18 Cirrus Logic, Inc. Adaptive noise canceling architecture for a personal audio device
US9721556B2 (en) 2012-05-10 2017-08-01 Cirrus Logic, Inc. Downlink tone detection and adaptation of a secondary path response model in an adaptive noise canceling system
US9773490B2 (en) 2012-05-10 2017-09-26 Cirrus Logic, Inc. Source audio acoustic leakage detection and management in an adaptive noise canceling system
US9532139B1 (en) 2012-09-14 2016-12-27 Cirrus Logic, Inc. Dual-microphone frequency amplitude response self-calibration
US9773493B1 (en) 2012-09-14 2017-09-26 Cirrus Logic, Inc. Power management of adaptive noise cancellation (ANC) in a personal audio device
US9955250B2 (en) 2013-03-14 2018-04-24 Cirrus Logic, Inc. Low-latency multi-driver adaptive noise canceling (ANC) system for a personal audio device
US9502020B1 (en) 2013-03-15 2016-11-22 Cirrus Logic, Inc. Robust adaptive noise canceling (ANC) in a personal audio device
US10206032B2 (en) 2013-04-10 2019-02-12 Cirrus Logic, Inc. Systems and methods for multi-mode adaptive noise cancellation for audio headsets
US9462376B2 (en) 2013-04-16 2016-10-04 Cirrus Logic, Inc. Systems and methods for hybrid adaptive noise cancellation
US9478210B2 (en) 2013-04-17 2016-10-25 Cirrus Logic, Inc. Systems and methods for hybrid adaptive noise cancellation
US9578432B1 (en) 2013-04-24 2017-02-21 Cirrus Logic, Inc. Metric and tool to evaluate secondary path design in adaptive noise cancellation systems
US9666176B2 (en) 2013-09-13 2017-05-30 Cirrus Logic, Inc. Systems and methods for adaptive noise cancellation by adaptively shaping internal white noise to train a secondary path
US9620101B1 (en) 2013-10-08 2017-04-11 Cirrus Logic, Inc. Systems and methods for maintaining playback fidelity in an audio system with adaptive noise cancellation
US10219071B2 (en) 2013-12-10 2019-02-26 Cirrus Logic, Inc. Systems and methods for bandlimiting anti-noise in personal audio devices having adaptive noise cancellation
US9704472B2 (en) 2013-12-10 2017-07-11 Cirrus Logic, Inc. Systems and methods for sharing secondary path information between audio channels in an adaptive noise cancellation system
US10382864B2 (en) 2013-12-10 2019-08-13 Cirrus Logic, Inc. Systems and methods for providing adaptive playback equalization in an audio device
US10181315B2 (en) 2014-06-13 2019-01-15 Cirrus Logic, Inc. Systems and methods for selectively enabling and disabling adaptation of an adaptive noise cancellation system
US9807503B1 (en) 2014-09-03 2017-10-31 Cirrus Logic, Inc. Systems and methods for use of adaptive secondary path estimate to control equalization in an audio device
CN104639205A (en) * 2014-12-08 2015-05-20 李青花 Signal enhancement system based on near field communication
US9552805B2 (en) 2014-12-19 2017-01-24 Cirrus Logic, Inc. Systems and methods for performance and stability control for feedback adaptive noise cancellation
GB2539280A (en) * 2015-06-09 2016-12-14 Cirrus Logic Int Semiconductor Ltd Hybrid finite impulse response filter
US10026388B2 (en) 2015-08-20 2018-07-17 Cirrus Logic, Inc. Feedback adaptive noise cancellation (ANC) controller and method having a feedback response partially provided by a fixed-response filter
US9578415B1 (en) 2015-08-21 2017-02-21 Cirrus Logic, Inc. Hybrid adaptive noise cancellation system with filtered error microphone signal
US10013966B2 (en) 2016-03-15 2018-07-03 Cirrus Logic, Inc. Systems and methods for adaptive active noise cancellation for multiple-driver personal audio device

Also Published As

Publication number Publication date
EP2803137B1 (en) 2016-11-23
US20150010170A1 (en) 2015-01-08
CN104040888B (en) 2018-07-10
CN104040888A (en) 2014-09-10
EP2803137A1 (en) 2014-11-19
US20170134854A1 (en) 2017-05-11
EP2803137A4 (en) 2015-05-27

Similar Documents

Publication Publication Date Title
EP2803137B1 (en) Multi-rate filter system
Välimäki et al. All about audio equalization: Solutions and frontiers
EP2783521B1 (en) System and method for bass enhancement
US20140233744A1 (en) Audio processing and enhancement system
US10778171B2 (en) Equalization filter coefficient determinator, apparatus, equalization filter coefficient processor, system and methods
US8879747B2 (en) Adaptive filtering system
KR101422368B1 (en) A method and an apparatus for processing an audio signal
CA2593183C (en) Partitioned fast convolution in the time and frequency domain
US7818079B2 (en) Equalization based on digital signal processing in downsampled domains
EP2803203A1 (en) Integrated loudspeaker assemblies
US8948424B2 (en) Hearing device and method for operating a hearing device with two-stage transformation
US9191755B2 (en) Spatial enhancement mode for hearing aids
WO2015079946A1 (en) Device, method, and program for expanding frequency band
CN110996216B (en) Method, device and system for configuring equalization filter in earphone and earphone
US20180301160A1 (en) Signal processing apparatus and method
US9099989B2 (en) Frequency reconfigurable digital filter and equalizer using the same
Torres et al. An efficient wavelet-based HRTF model for auralization
WO2017121245A1 (en) Method for achieving surround sound, electronic device, and storage medium
US9036752B2 (en) Low-delay filtering
US20230022072A1 (en) Colorless generation of elevation perceptual cues using all-pass filter networks
Shu-Nung Driver filter design for software-implemented loudspeaker crossovers
JP2011061403A (en) Equalizer and electroacoustic transducer
Jabloun et al. A fast subband room response simulator
KR20120035919A (en) Frequency reconfigurable digital filter and equalizer using the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13735847

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 14371020

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2013735847

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2013735847

Country of ref document: EP