Classifications

• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
  • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
  • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
  • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
  • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
  • G10L21/0208—Noise filtering
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
  • H04R3/00—Circuits for transducers, loudspeakers or microphones
  • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

• the stationary noise suppression system will always provide an output noise that is a fixed amount lower than the input noise.
• the stationary noise suppression is in the range of 12-13 decibels (dB).
• the noise suppression is fixed to this conservative level in order to avoid producing speech distortion, which will be apparent with higher noise suppression.
• the generalized side-lobe canceller is used to identify desired signals and interfering signals comprised by a received signal.
• the desired signals propagate from a desired location and the interfering signals propagate from other locations.
• the interfering signals are subtracted from the received signal with the intention of cancelling interference.
• a two microphone system can be used to achieve noise cancellation or source localization, but is not suitable for obtaining both.
• With two widely spaced microphones it is possible to derive level difference cues for source localization and multiplicative noise suppression.
• noise cancelation is limited to dry point sources given the lower coherence of the microphone signals.
• the two microphones can be closely spaced for improved noise cancellation due to higher coherence between the microphone signals.
• decreasing the spacing results in level cues which are too weak to be reliable for localization.
• the present technology involves the combination of two independent but complementary two-microphone signal processing methodologies, an inter-microphone level difference method and a null processing noise subtraction method, which help and complement each other to maximize noise reduction performance.
• Each two- microphone methodology or strategy may be configured to work in optimal configuration and may share one or more microphones of an audio device.
• An exemplary microphone placement may use two sets of two microphones for noise suppression, wherein the set of microphones include two or more
• a primary microphone and secondary microphone may be positioned closely spaced to each other to provide acoustic signals used to achieve noise
• a tertiary microphone may be spaced with respect to either the primary microphone or the secondary microphone (or, may be implemented as either the primary microphone or the secondary microphone rather than a third microphone) in a spread-microphone configuration for deriving level cues from audio signals provided by tertiary and primary or secondary microphone.
• the level cues are expressed via an inter-microphone level difference (ILD) which is used to determine one or more cluster tracking control signals.
• ILD inter-microphone level difference
• a noise cancelled primary acoustic signal and the ILD based cluster tracking control signals are used during post filtering to adaptively generate a mask to be applied against a speech estimate signal.
• An embodiment for noise suppression may receive two or more signals.
• the two or more signals may include a primary acoustic signal.
• a level difference may be determined from any pair of the two or more acoustic signals.
• Noise cancellation may be performed on the primary acoustic signal by subtracting a noise component from the primary acoustic signal.
• the noise component may be derived from an acoustic signal other than the primary acoustic signal.
• An embodiment of a system for noise suppression may include a frequency analysis module, an ILD module, and at least one a noise subtraction module, all of which may be stored in memory and executed by a processor.
• the frequency analysis module may be executed to receive two or more acoustic signals, wherein the two or more acoustic signals include a primary acoustic signal.
• the ILD module may be executed to determine a level difference cue from any pair of the two or more acoustic signals.
• the noise subtraction module may be executed to perform noise cancellation on the primary acoustic signal by subtracting a noise component from the primary acoustic signal.
• the noise component may be derived from an acoustic signal other than the primary acoustic signal.
• An embodiment may include a machine readable medium having embodied thereon a program.
• the program may provide instructions for a method for suppressing noise as described above.
• FIGURES 1 and 2 are illustrations of environments in which embodiments of the present technology may be used.
• FIGURE 3 is a block diagram of an exemplary audio device.
• FIGURE 4A is a block diagram of an exemplary audio processing system.
• FIGURE 4B is a block diagram of an exemplary null processing noise subtraction module.
• FIGURE 5 is a block diagram of another exemplary audio processing system.
• FIGURE 6 is a flowchart of an exemplary method for providing an audio signal with noise reduction.
• Two independent but complementary two-microphone signal processing methodologies an inter-microphone level difference method and a null processing noise subtraction method, can be combined to maximize noise reduction performance.
• Each two-microphone methodology or strategy may be configured to work in optimal configuration and may share one or more microphones of an audio device.
• An audio device may utilize two pairs of microphones for noise suppression.
• a primary and secondary microphone may be positioned closely spaced to each other and may provide audio signals utilized for achieving noise cancellation.
• a tertiary microphone may be spaced in spread-microphone configuration with either the primary or secondary microphone and may provide audio signals for deriving level cues.
• the level cues are encoded in the inter-microphone level difference (ILD) and normalized by a cluster tracker to account for distortions due to the acoustic structures and transducers involved. Cluster tracking and level difference determination are discussed in more detail below.
• ILD inter-microphone level difference
• the ILD cue from a spread-microphone pair may be normalized and used to control the adaptation of noise cancellation implemented with the primary microphone and secondary microphone.
• a postprocessing multiplicative mask may be implemented with a post-filter.
• the post-filter can be derived in several ways, one of which may involve the derivation of a noise reference by null-processing a signal received from the tertiary microphone to remove a speech component.
• Embodiments of the present technology may be practiced on any audio device that is configured to receive sound such as, but not limited to, cellular phones, phone handsets, headsets, and conferencing systems.
• exemplary embodiments are configured to provide improved noise suppression while minimizing speech distortion. While some embodiments of the present technology will be described in reference to operation on a cellular phone, the present technology may be practiced on any audio device.
• a user may act as a speech source 102 to an audio device 104.
• the exemplary audio device 104 may include a microphone array having microphones 106, 108, and 110.
• the microphone array may include a close microphone array with microphones 106 and 108 and a spread microphone array with microphones 110 and either microphone 106 or 108.
• One or more of microphones 106, 108, and 110 may be implemented as omni-directional microphones.
• Microphones Ml, M2, and M3 can be place at any distance with respect to each other, such as for example between 2 and 20cm from each other.
• Microphones 106, 108, and 110 may receive sound (i.e., acoustic signals) from the audio source 102 and noise 110.
• sound i.e., acoustic signals
• the noise 110 may comprise any sounds from one or more locations different than the audio source 102, and may include reverberations and echoes.
• the noise 110 may be stationary, non-stationary, or a combination of both stationary and non-stationary noise.
• microphones 106, 108, and 110 on audio device 104 may vary.
• microphone 110 is located on the upper backside of audio device 104 and microphones 106 and 108 are located in line on the lower front and lower back of audio device 104.
• microphone 110 is positioned on an upper side of audio device 104 and microphones 106 and 108 are located on lower sides of the audio device.
• Microphones 106, 108, and 110 are labeled as Ml, M2, and M3, respectively. Though microphones Ml and M2 may be illustrated as spaced closer to each other and microphone M3 may be spaced further apart from microphones Ml and M2, any microphone signal combination can be processed to achieve noise cancellation and determine level cues between two audio signals.
• the designations of Ml, M2, and M3 are arbitrary with microphones 106, 108 and 110 in that any of microphones 106, 108 and 110 may be Ml, M2, and M3. Processing of the microphone signals is discussed in more detail below with respect to FIGURES 4A-5.
• the three microphones illustrated in FIGURES 1 and 2 represent an exemplary embodiment.
• the present technology may be implemented using any number of microphones, such as for example two, three, four, five, six, seven, eight, nine, ten or even more microphones.
• signals can be processed as discussed in more detail below, wherein the signals can be associated with pairs of microphones, wherein each pair may have different microphones or may share one or more microphones.
• FIGURE 3 is a block diagram of an exemplary audio device.
• the audio device 104 is an audio receiving device that includes microphone 106, microphone 108, microphone 110, processor 302, audio processing system 304, and output device 306.
• the audio device 104 may include further components (not shown) necessary for audio device 104 operations, for example components such as an antenna, interfacing components, non-audio input, memory, and other components.
• Processor 302 may execute instructions and modules stored in a memory (not illustrated in FIGURE 3) of communication device 104 to perform functionality described herein, including noise suppression for an audio signal.
• Audio processing system 304 may process acoustic signals received by microphones 106, 108 and 110 (Ml, M2 and M3) to suppress noise and in the received signals and provide an audio signal to output device 306. Audio processing system 304 is discussed in more detail below with respect to FIGURE 3.
• the output device 306 is any device which provides an audio output to the user.
• the output device 306 may comprise an earpiece of a headset or handset, or a speaker on a conferencing device.
• FIGURE 4A is a block diagram of an exemplary audio processing system 304.
• the audio processing system 304 is embodied within a memory device within audio device 104.
• Audio processing system 304 may include frequency analysis modules 402 and 404, ILD module 406, NPNS module 408, cluster tracker 410, noise estimate module 412, post filter module 414, multiplier component 416 and frequency synthesis module 418.
• Audio processing system 304 may include more or fewer components than illustrated in FIGURE 4A, and the functionality of modules may be combined or expanded into fewer or additional modules. Exemplary lines of communication are illustrated between various modules of FIGURE 4A and other figures, such as FIGURES 4B and 5.
• the lines of communication of are not intended to limit which modules are communicatively coupled with others.
• the visual indication of a line e.g., dashed, doted, alternate dash and dot
• a line is not intended to indicate a particular communication, but rather to aid in visual presentation of the system.
• acoustic signals are received by microphones Ml, M2 and M3, converted to electric signals, and the electric signals are processed through frequency analysis module 402 and 404.
• the frequency analysis module 402 takes the acoustic signals and mimics the frequency analysis of the cochlea (i.e., cochlear domain) simulated by a filter bank.
• Frequency analysis module 402 may separate the acoustic signals into frequency sub-bands.
• a sub-band is the result of a filtering operation on an input signal where the bandwidth of the filter is narrower than the bandwidth of the signal received by the frequency analysis module 402.
• a sub-band analysis on the acoustic signal determines what individual frequencies are present in the complex acoustic signal during a frame (e.g., a predetermined period of time). For example, the length of a frame may be 4 ms, 8 ms, or some other length of time. In some embodiments there may be no frame at all.
• the results may comprise sub-band signals in a fast cochlea transform (FCT) domain.
• FCT fast cochlea transform
• the sub-band frame signals are provided from frequency analysis modules 402 and 404 to ILD 406 and null processing noise subtraction (NPNS) module 408.
• Null processing noise subtraction (NPNS) module 408 may adaptively subtract out a noise component from a primary acoustic signal for each sub-band.
• output of the NPNS 408 includes sub-band estimates of the noise in the primary signal and sub-band estimates of the speech (in the form of a noise-subtracted sub-band signals) or other desired audio in the in the primary signal.
• FIGURE 4B illustrates an exemplary implementation of NPNS module 408.
• NPNS module 408 may be implemented as a cascade of null processing subtraction blocks 420 and 422.
• Sub-band signals associated with two microphones are received as inputs to the first block NPNS 420.
• Sub-band signals associated with a third microphone are received as input to the second block, along with an output of the first block.
• the sub-band signals are represented in FIGURE 4B as Mp, and M Y/ such that:
• Each of Mp, and ⁇ ⁇ can be associated with any of microphones 106, 108 and 110 of FIGURES 1 and 2.
• NPNS 420 receives the sub-band signals with any two microphones, represented as M a and ⁇ .
• NPNS 420 may also receive a cluster tracker realization signal CTi from cluster tracking module 410.
• NPNS 420 performs noise cancellation and generates outputs of a speech reference output Si and noise reference output Ni at points A and B, respectively.
• NPNS 422 may receive inputs of sub-band signals of ⁇ ⁇ and the output of NPNS 420.
• NPNS 422 receives the noise reference output from NPNS 420 (point C is coupled to point A)
• NPNS 422 performs null processing noise subtraction and generates outputs of a second speech reference output S2 and second noise reference output N2.
• S2 is provided to post filter module 414 and multiplier module 416 while N2 is provided to noise estimate module 412 (or directly to post filter module 414).
• NPNS 408 may be implemented with a single NPNS module 420.
• a second implementation of NPNS 408 can be provided within audio processing system 304 wherein point C is connected to point B, such as for example the embodiment illustrated in FIGURE 5 and discussed in more detail below.
• null processing noise subtraction as performed by an NPNS module is disclosed in U.S. patent application no. 12/215,980, entitled “System and Method for Providing Noise Suppression Utilizing Null Processing Noise Subtraction", filed on June 30, 2008, the disclosure of which is incorporated herein by reference.
• FIGURE 4B a cascade of two noise subtraction modules is illustrated in FIGURE 4B, additional noise subtraction modules may be utilized to implement NPNS 408, for example in a cascaded fashion as illustrated in FIGURE 4B.
• the cascade of noise subtraction modules may include three, four, five, or some other number of noise subtraction modules. In some embodiments, the number of cascaded noise subtraction modules may be one less than the number of microphones (e.g., for eight microphones, their may be seven cascaded noise subtraction modules).
• sub-band signals from frequency analysis module 402 and 404 may be processed to determine energy level estimates during an interval of time. The energy estimate may be based on bandwidth of the cochlea channel and the acoustic signal. The energy level estimates may be determined by frequency analysis module 402 or 404, an energy estimation module (not illustrated), or another module such as ILD module 406.
• an inter-microphone level difference may be determined by an ILD module 406.
• ILD module 406 may receive calculated energy information for any of microphones Mi, M2 or M3.
• the ILD module 406 may be approximated mathematicall in one embodiment, as
• Ei is the energy level difference of two of microphones Mi
• M2 and M3 and E2 is the energy level difference of the microphone not used for Ei and one of the two microphones used for Ei. Both Ei and E2 are obtained from energy level estimates.
• This equation provides a bounded result between -1 and 1. For example, ILD goes to 1 when the £2 goes to 0, and ILD goes to -1 when Ei goes to 0.
• the ILD may be approximated by
• ILD may vary in time and frequency and may be bounded between -1 and 1.
• ILDi may be used to determine the cluster tracker realization for signals received by NPNS 420 in FIGURE 4B. ILDi may be determined as follows: Mi), where i 6 [2,3] ⁇ ,
• Mi represents a primary microphone that is closest to a desired source, such as for example a mouth reference point, and Mi represents a microphone other than the primary microphone.
• ILDi can be determined from energy estimates of the framed sub-band signals of the two microphones associated with the input to NPNS 420. In some embodiments, ILDi is determined as the higher valued ILD between the primary microphone and the other two microphones.
• ILD2 may be used to determine the cluster tracker realization for signals received by NPNS 422 in FIGIRE 4B. ILD2 may be determined from energy estimates of the framed sub-band signals of all three microphones as follows:
• ILD 2 ⁇ ILDi; ILD (Mi, Si), i € [ ⁇ , ⁇ ]; ILD (Mi, Ni), i € [ ⁇ , ⁇ ]; ILD( Si, Ni) ⁇ .
• Cluster tracking module 410 may receive level differences between energy estimates of sub-band framed signals from ILD module 406.
• ILD module 406 may generate ILD signals from energy estimates of microphone signals, speech or noise reference signals.
• the ILD signals may be used by cluster tracker 410 to control adaptation of noise cancellation as well as to create a mask by post filter 414.
• Examples of ILD signals that may be generated by ILD module 406 to control adaptation of noise suppression include ILD 1 and ILD2.
• tracking module 410 differentiates (i.e., classifies) noise and distracters from speech and provides the results to NPNS module 408 and post filter module 414.
• ILD distortion in many embodiments, may be created by either fixed (e.g., from irregular or mismatched microphone response) or slowly changing (e.g., changes in handset talker, or room geometry and position) causes. In these embodiments, the ILD distortion may be compensated for based on estimates for either build-time clarification or runtime tracking. Exemplary embodiments of the present invention enables cluster tracker 410 to dynamically calculate these estimates at runtime providing a per-frequency dynamically changing estimate for a source (e.g., speech) and a noise (e.g., background) ILDs.
• a source e.g., speech
• noise e.g., background
• Cluster tracker 410 may determine a global summary of acoustic features based, at least in part, on acoustic features derived from an acoustic signal, as well as an instantaneous global classification based on a global running estimate and the global summary of acoustic features.
• the global running estimates may be updated and an instantaneous local classification is derived based on at least the one or more acoustic features.
• Spectral energy classifications may then be determined based, at least in part, on the instantaneous local classification and the one or more acoustic features.
• cluster tracker 410 classifies points in the energy spectrum as being speech or noise based on these local clusters and observations. As such, a local binary mask for each point in the energy spectrum is identified as either speech or noise.
• Cluster tracker 410 may generate a noise/speech classification signal per subband and provide the classification to NPNS 408 to control its canceller parameters (sigma and alpha) adaptation.
• the classification is a control signal indicating the differentiation between noise and speech.
• NPNS 408 may utilize the classification signals to estimate noise in received microphone energy estimate signals, such as Ma, Mp, and My.
• the results of cluster tracker 410 may be forwarded to the noise estimate module 412.
• a current noise estimate along with locations in the energy spectrum where the noise may be located are provided for processing a noise signal within audio processing system 304.
• the cluster tracker 410 uses the normalized ILD cue from microphone M3 and either microphone Ml or M2 to control the adaptation of the NPNS implemented by microphones Ml and M2 (or Ml, M2 and M3).
• the tracked ILD is utilized to derive a sub-band decision mask in post filter module 414 (applied at mask 416) that controls the adaption of the NPNS sub-band source estimate.
• Noise estimate module 412 may receive a noise/speech classification control signal and the NPNS output to estimate the noise N(t,w).
• Cluster tracker 410 may receive a noise/speech classification control signal and the NPNS output to estimate the noise N(t,w).
• noise estimate module 412 differentiates (i.e., classifies) noise and distracters from speech and provides the results for noise processing.
• the results may be provided to noise estimate module 412 in order to derive the noise estimate.
• the noise estimate determined by noise estimate module 412 is provided to post filter module 414.
• post filter 414 receives the noise estimate output of NPNS 408 (output of the blocking matrix) and an output of cluster tracker 410, in which case a noise estimate module 412 is not utilized.
• Post filter module 414 receives a noise estimate from cluster tracking module 410 (or noise estimate module 412, if implemented) and the speech estimate output (e.g., Si or S2) from NPNS 408. Post filter module 414 derives a filter estimate based on the noise estimate and speech estimate. In one embodiment, post filter 414 implements a filter such as a Weiner filter. Alternative embodiments may contemplate other filters. Accordingly, the Weiner filter approximation may be approximated, according to one embodiment, as [0052] , where Ps is a power spectral density of speech and P legislative is a power spectral density of noise. According to one embodiment, P « is the noise estimate, N(t,co), which may be calculated by noise estimate module 412.
• Ps ⁇ -( ⁇ , ⁇ ) - 3 ⁇ 4V(t,co) , where Ei(t,a is the energy at the output of NPNS 408 and ⁇ ( ⁇ , ⁇ ) is the noise estimate provided by the noise estimate module 412. Because the noise estimate changes with each frame, the filter estimate will also change with each frame.
• ⁇ is an over-subtraction term which is a function of the ILD. ⁇ compensates bias of minimum statistics of the noise estimate module 412 and forms a perceptual weighting. Because time constants are different, the bias will be different between portions of pure noise and portions of noise and speech. Therefore, in some
• compensation for this bias may be necessary.
• ⁇ is determined empirically (e.g., 2-3 dB at a large ILD, and is 6-9 dB at a low ILD).
• a is a factor which further suppresses the estimated noise components.
• a can be any positive value.
• Nonlinear expansion may be obtained by setting a to 2.
• the Weiner filter estimation may change quickly (e.g., from one frame to the next frame) and noise and speech estimates can vary greatly between each frame, application of the Weiner filter estimate, as is, may result in artifacts (e.g., discontinuities, blips, transients, etc.). Therefore, optional filter smoothing may be performed to smooth the Wiener filter estimate applied to the acoustic signals as a function of time.
• a second instance of the cluster tracker could be used to track the NP-ILD, such as for example the ILD between the NP-NS output (and signal from the
• the ILD may provided as follows:
• ILD 3 ⁇ ILDi; ILD 2 ; ILD (S 2 . N 2 ); ILD (Mi, S 2 ), i £ [ ⁇ , ⁇ ]; ILD(Mj, N 2 ), i € [ ⁇ , ⁇ ]; ILD( S 2 Ni); ; ILD (Si , N 2 ); ILD (S 2 N 2 ) ⁇ ,
• N 2 is derived as the output of module 520 in FIGURE 5, discussed in more detail below.
• the frequency sub- bands output of NPNS module 408 are multiplied at mask 416 by the Weiner filter estimate (from post filter 414) to estimate the speech.
• the speech estimate is converted back into time domain from the cochlea domain by frequency synthesis module 418.
• the conversion may comprise taking the masked frequency sub-bands and adding together phase shifted signals of the cochlea channels in a frequency synthesis module 410.
• the conversion may comprise taking the masked frequency sub-bands and multiplying these with an inverse frequency of the cochlea channels in the frequency synthesis module 410.
• FIGURE 5 is a block diagram of another exemplary audio processing system 304.
• the system of FIGURE 5 includes frequency analysis modules 402 and 404, ILD module 406, cluster tracking module 410, NPNS modules 408 and 520, post filter modules 414, multiplier module 416 and frequency synthesis module 418.
• the audio processing system 304 of FIGURE 5 is similar to the system of FIGURE 4A except that the frequency sub-bands of the microphones Ml, M2 and M3 are each provided both NPNS 408 as well as NPNS 520, in addition to ILD 406.
• ILD output signals based on received microphone frequency sub-band energy estimates are provided to cluster tracker 410, which then provides a control signal with a
• NPNS 408 in FIGURE 5 may operate similar to NPNS 408 in FIGURE 4A.
• NPNS 520 may be implemented as NPNS 408 as illustrated in FIGURE 4B when point C is connected to point B, thereby providing a noise estimate as an input NPNS 422.
• the output of NPNS 520 is a noise estimate and provided to post filter module 414.
• Post filter module 414 receives a speech estimate from NPNS 408, a noise estimate from NPNS 520, and a speech/noise control signal from cluster tracker 410 to adaptively generate a mask to apply to the speech estimate at multiplier 416.
• the output of the multiplier is then processed by frequency synthesis module 418 and output by audio processing system 304.
• FIGURE 6 is a flowchart 600 of an exemplary method for suppressing noise in an audio device.
• audio signals are received by the audio device 104.
• a plurality of microphones e.g., microphones Ml, M2 and M3 receive the audio signals.
• the plurality of microphones may include two microphones which form a close microphone array and two microphones (one or more of which may be shared with the close microphone array microphones) which form a spread microphone array.
• step 604 the frequency analysis on the primary, secondary and tertiary acoustic signals may be performed.
• frequency analysis modules 402 and 404 utilize a filter bank to determine frequency sub-bands for the acoustic signals received by the device microphones.
• Noise subtraction and noise suppression may be performed on the sub-band signals at step 606.
• NPNS modules 408 and 520 may perform the noise subtraction and suppression processing on the frequency sub-band signals received from frequency analysis modules 402 and 404.
• NPNS modules 408 and 520 then provide frequency sub- band noise estimate and speech estimate to post filter module 414.
• Inter-microphone level differences are computed at step 608.
• Computing the ILD may involve generating energy estimates for the sub-band signals from both frequency analysis module 402 and frequency analysis module 404.
• the output of the ILD is provided to cluster tracking module 410.
• Cluster tracking is performed at step 610 by cluster tracking module 410.
• Cluster tracking module 410 receives the ILD information and outputs information indicating whether the sub-band is noise or speech.
• Cluster tracking 410 may normalize the speech signal and output decision threshold information from which a
• NPNS 408 and 520 determine whether a frequency sub-band is noise or speech. This information is passed to NPNS 408 and 520 to decide when to adapt noise cancelling parameters.
• Noise may be estimated at step 612.
• the noise estimation may performed by noise estimation module 412, and the output of cluster tracking module 410 is used to provide a noise estimate to post filter module 414.
• the noise estimate NPNS 408 and/or 520 may determine and provide the noise estimate to post filter module 414.
• a filter estimate is generated at step 614 by post filter module 414.
• post filter module 414 receives an estimated source signal comprised of masked frequency sub-band signals from NPNS module 408 and an estimation of the noise signal from either null processing module 520 or cluster tracking module 410 (or noise estimate module 412).
• the filter may be a Weiner filter or some other filter.
• a gain mask may be applied in step 616.
• the gain mask generated by post filter 414 may be applied to the speech estimate output of NPNS 408 by the multiplicative module 416 on a per sub-band signal basis.
• the cochlear domain sub-bands signals may then be synthesized in step 618 to generate an output in time domain.
• the sub-band signals may be converted back to the time domain from the frequency domain.
• the audio signal may be output to the user in step 620.
• the output may be via a speaker, earpiece, or other similar devices.
• the above-described modules may be comprised of instructions that are stored in storage media such as a machine readable medium (e.g., a computer readable medium).
• the instructions may be retrieved and executed by the processor 302.
• Some examples of instructions include software, program code, and firmware.
• Some examples of storage media comprise memory devices and integrated circuits.
• the instructions are operational when executed by the processor 302 to direct the processor 302 to operate in accordance with embodiments of the present technology. Those skilled in the art are familiar with instructions, processors, and storage media.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• Acoustics & Sound (AREA)
• Signal Processing (AREA)
• Health & Medical Sciences (AREA)
• Multimedia (AREA)
• General Health & Medical Sciences (AREA)
• Otolaryngology (AREA)
• Human Computer Interaction (AREA)
• Audiology, Speech & Language Pathology (AREA)
• Quality & Reliability (AREA)
• Computational Linguistics (AREA)
• Circuit For Audible Band Transducer (AREA)
• Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
• Soundproofing, Sound Blocking, And Sound Damping (AREA)

Priority Applications (2)

Applications Claiming Priority (2)

Publications (1)

Family

ID=44308941

Family Applications (1)

Country Status (5)

Cited By (9)

Families Citing this family (100)

Citations (4)

Family Cites Families (202)

• 2010
  • 2010-01-26 US US12/693,998 patent/US8718290B2/en active Active
• 2011
  • 2011-01-25 JP JP2012550214A patent/JP5675848B2/ja not_active Expired - Fee Related
  • 2011-01-25 WO PCT/US2011/022462 patent/WO2011094232A1/en not_active Ceased
  • 2011-01-25 KR KR1020127020105A patent/KR20120114327A/ko not_active Ceased
  • 2011-01-26 TW TW100102945A patent/TW201142829A/zh unknown
• 2014
  • 2014-03-21 US US14/222,255 patent/US9437180B2/en active Active

Patent Citations (4)

Also Published As

Similar Documents

Legal Events