US20150172807A1 - Apparatus And A Method For Audio Signal Processing - Google Patents

Apparatus And A Method For Audio Signal Processing Download PDF

Info

Publication number
US20150172807A1
US20150172807A1 US14/566,579 US201414566579A US2015172807A1 US 20150172807 A1 US20150172807 A1 US 20150172807A1 US 201414566579 A US201414566579 A US 201414566579A US 2015172807 A1 US2015172807 A1 US 2015172807A1
Authority
US
United States
Prior art keywords
signal
microphones
pair
noise
beamformer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/566,579
Other languages
English (en)
Inventor
Rasmus Kongsgaard Olsson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Audio AS
Original Assignee
GN Netcom AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GN Netcom AS filed Critical GN Netcom AS
Publication of US20150172807A1 publication Critical patent/US20150172807A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091—Details not provided for in groups H04R1/1008 - H04R1/1083
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166—Microphone arrays; Beamforming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/10—Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/10—Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups
    • H04R2201/107—Monophonic and stereophonic headphones with microphone for two-way hands free communication

Definitions

  • multiple microphones and the use of beamforming techniques provide audio signal reproduction that is superior to single microphone or non-beamforming systems.
  • the multiple microphones are located at different positions and allows so-called spatial sampling which in turn enables cancelling of noise interfering with a desired signal such as a person's voice; this is also known as beamforming, spatial filtering or noise-cancelling.
  • Subsequent time varying post-filters are often applied as a means to further discriminate the person's voice from (background) noise signals.
  • US 2012/0020485 discloses an audio signal processing method which estimates a first indication of a direction of arrival, relative to a first pair of microphones, of a first sound component received by the first pair of microphones; and estimates a second indication of a direction of arrival, relative to a second pair of microphones, of a second sound component received by the second pair of microphones.
  • the first and the second pair of microphones are arranged at respective sides of a person's head during normal operation of a device using the method.
  • the method also involves controlling gain of an audio signal to produce an output signal, based on the first and second direction indications.
  • an apparatus such as a headset, configured to process audio signals from multiple microphones, comprising: a first pair of microphones outputting a first pair of microphone signals and a second pair of microphones outputting a second pair of microphone signals; wherein the first pair of microphones are arranged with a first mutual distance and the second pair of microphones are arranged with a second mutual distance, and wherein the first pair of microphones are arranged at a distance from the second pair of microphones that is greater than the first mutual distance and the second mutual distance at least when the apparatus is in normal operation; a first beamformer and a second beamformer each configured to receive a pair of microphone signals and adapt the spatial sensitivity of a respective pair of microphones as measured in a respective beamformed signal output from a respective beamformer; wherein the spatial sensitivity is adapted to suppress noise relative to a desired signal; a third beamformer configured to dynamically combine the signals output from the first beamformer and the second beamformer into a combined signal; wherein the signals are combined such that noise energy
  • beamforming is provided in a first beamforming stage with the first beamformer and the second beamformer processing the microphone signals and in a second stage with a third beamformer processing signals output from the first stage.
  • the first beamforming stage serves to enhance or emphasize the desired signal locally with respect to the microphone pairs by adapting the spatial sensitivity of a respective microphone pair.
  • the spatial sensitivity is adapted, e.g., by adjusting beamformer coefficients to control the spatial configuration of the beamformer nulls which may comprise adjusting beamformer coefficients such that the beamformer obtains an omni-directional characteristic, which is useful to avoid amplification of uncorrelated (between microphones) noise such as wind noise.
  • the effectiveness of the first beamforming stage depends on the assumption that the microphones of each microphone pair are situated closely to one another (for reasons explained below).
  • the level of the noise component may vary considerably between the first and second beamformed signals. This may be due to different levels at the microphones, e.g., wind turbulence is a highly local phenomenon, and acoustic shadowing effects from the user's head in a head worn device. Furthermore, the first and the second beamformers may not be able to cancel the noise equally well, depending on the relative position of the microphone pair, the signal of interest and interfering noises.
  • the third beamformer is thus configured to receive signals that have already been subject to local optimization by the first stage beamformers whereby the desired signal is isolated as far as possible.
  • Processing microphone signals in this way improves the effect of noise suppression by the noise reduction unit when, as claimed, it is configured to process the combined signal from the third beamformer.
  • This is partly ascribed to the observation that desired signals stands out clearer after such a two-stage beamforming and thereby makes noise suppression more effective.
  • the two-stage beamformer approach achieves the combined benefit of beamforming on microphones that are closely spaced and microphones that are not closely spaced using well known dual-microphone beamformers.
  • the third beamformer may combine its input signals by linear or non-linear weighing of the input signals.
  • the apparatus such as a headset, a hearing aid or another apparatus picking up audio signals by means of microphones may be configured to be worn by a person with the first pair of microphones arranged on a left-hand side of a person's head and the second pair of microphones arranged on the right-hand side of the person's head.
  • the two pairs of microphones are sitting on an ear-cup of a headphone, a spectacle frame or booms or other protrusions at respective sides of a person's head.
  • the microphones are arranged, at least approximately, in a so-called end-fire configuration.
  • the microphones may alternatively or additionally be arranged in a broadside configuration.
  • the first and the second beamformer can take advantage of any near-field effect to cancel or suppress more noise at low frequencies and in addition make it possible to cancel more noise at higher frequencies, avoiding spatial aliasing.
  • the third beamformer can take advantage of the different local noise levels that the different pairs of microphones are exposed to. When the microphone pairs sit on different sides of a person's head, the head may form a wind and/or sound shadow reducing noise level on one side of the person's head. It is a major advantage of the invention that the highly complex problem of designing a single adaptive beamformer operating on all microphone inputs is decomposed into three simple, robust, well-understood dual-microphone beamformers.
  • a desired signal is a signal that typically represents voice from a speaker within proximity of the microphones or voice appearing from a certain direction relative to the orientation of the microphones.
  • a desired signal may be characterised by being emitted from one or more sound sources having predefined spatial locations with respect to the spatial location of the microphones. Since multiple microphones are used to pick up the desired signal the desired signal may be characterised by a predefined phase and/or amplitude difference among the microphone signal and/or among beamformed signals.
  • a desired signal may also be characterised by a predefined temporal characteristic and/or a predefined phase-/amplitude-frequency characteristic.
  • noise signal or simply noise may include turbulence sounds induced by wind occurring at sufficiently high wind speeds and acting on the microphone membranes.
  • Noise may also include background sounds such as tones from machines, sounds from items rattling or chinking, sounds from people talking amongst each other, etc.
  • noise is characterised by being emitted from one or more sound sources that are located at other locations than the desired signal.
  • the first beamformer and the second beamformer adapt the directional sensitivity gradually or in steps e.g. comprising sensitivities that are at least approximated from the group of the following characteristics: Omni-directional, bi-directional, cardioid, subcardioid, hypercardioid, supercardioid or shotgun.
  • the directional sensitivity may be changed gradually between an omni-directional, a bi-directional and a cardioid characteristic.
  • the first beamformer may be configured as disclosed in WO 2009/132646 which is hereby incorporated by reference for everything disclosed in connection with especially FIG. 1 thereof.
  • the third beamformer may combine the signals from the first and the second beamformer in accordance with coefficients estimated from noise powers. In case the noise power of the signal from the first beamformer is higher than the noise power of the signal from the second beamformer, the signal from the second beamformer is weighted higher than the signal from the first beamformer and vice versa.
  • the noise level of a signal may be estimated when voice is detected as not present.
  • the first mutual distance between the microphones of the first pair and the second mutual distance between the microphones of the second pair is shorter than the minimum wavelength of interest in the case of end-fire pairs, depending on the desired directional sensitivity. At and above frequencies with a shorter wavelength than the wavelength of interest, the ability to suppress or cancel noise will diminish due to the effect of spatial aliasing.
  • the distance between the microphone pairs may correspond to the straight-line distance between a person's two ears, which may be about 18-22 cm.
  • the first mutual distance and the second mutual distance may be about 10, 20, or 40 mm for a bandwidth of interest up to 4 KHz.
  • the apparatus may perform signal processing in a time-domain or in a time-frequency-domain.
  • time-to-frequency transformations are performed on signal blocks of a predefined duration on a running basis.
  • time-frequency-domain signals are represented as time-domain samples in a number of frequency bins.
  • frequency-to-time reconstruction is performed on signals processed in the time-frequency-domain.
  • the noise reduction unit is configured to perform noise suppression on the combined signal from the third beamformer in response to a noise suppression coefficient; and the noise suppression coefficient is estimated from the microphone signals and/or a beamformed signal.
  • the noise suppression coefficient may comprise a first coefficient estimated from the first set of microphone signals and from a/the beamformed signal.
  • the noise suppression coefficient may alternatively or additionally comprise a second coefficient estimated from the second set of microphone signals and from a/the beamformed signal.
  • the noise suppression coefficient may be combined from the first and the second coefficient.
  • the noise suppression coefficient may be a gain factor of a multiplier in a time-frequency domain or a filter coefficient of a time-domain filter.
  • the apparatus comprises: a first control branch synthesizing a first noise suppression gain from the first pair of microphone signals and/or the first beamformer; a second control branch synthesizing a second noise suppression gain from the second pair of microphone signals and/or the second beamformer; and a selector configured to dynamically select and/or output the first noise suppression gain or the second noise suppression gain; wherein the noise reduction unit is configured to process the combined signal from the third beamformer in response to the selected and/or output noise suppression gain from the selector.
  • the mechanism for computing the first noise suppression gain may have access to signals which lend themselves to easier discrimination of the noise and the desired signal. This condition may arise from the situation where noise is less powerful at the input to the first beamformer due to a user's head shadow causing less wind noise or background noise. The condition may also arise from the situation where the spatial cues employed by the first noise suppression computation are more discriminative.
  • a hysteresis or threshold may be applied and used as a criterion on whether to enable the selector or not. Thereby it is possible to disable switching when an estimated noise level is below a predefined hysteresis or threshold.
  • the hysteresis or threshold may be in the range of about 1 dB to about 3 dB. Thereby, it is possible to strike a trade-off between (1) achieving lowest output noise level and (2) minimize distortion of a desired signal such as a voice signal.
  • the selector is configured to operate in response to a first signal quality indicator and a second signal quality indicator; the signal quality indicators are synthesized from a respective beamformed signal processed to reduce noise in response to respective noise reduction gains.
  • signal-to-noise ratio an important aspect of signal quality is signal-to-noise ratio.
  • signal-to-noise ratio is influenced through X L and X R . For example, if the signal-to-noise ratio of X L is greater than that of X R , in cases where A L and A R reduce the noise component by the same factor, the signal-to-noise ratio of A L X L will be higher than that of A R X R .
  • the Signal Quality Evaluation is influence by the qualities of A L and A R .
  • speech is easier distinguishable from noise at one side of the head.
  • a reason is that a user's head may shield the microphones from wind on a lee side of the user's head.
  • Another reason is that the spatial cues employed by the noise suppression computation may be discriminated more clearly on the lee side of the user's head.
  • the signal quality indicators P L ; P R may be computed from the mean-squared product of the respective noise reduction gains, A L ; A R , and the respective beam-formed signals X L ; X R .
  • the signal quality indicators may be computed per frequency band or accumulated across all frequency bands.
  • a beamformed signal, processed to reduce noise in response to respective noise reduction gains is input to an evaluator that is configured to output a control signal to the selector and thereby control selection; and the evaluator evaluates the beamformed signal, processed to reduce noise in response to respective noise reduction gains, according to a criterion of least power during a time interval when voice activity is detected as not present.
  • the selection of respective noise suppression gains can be performed from an evaluation of the noise conditions (e.g. noise power) at respective sides of a person's head.
  • noise power of the left and the right beamformed, noise reduced signals used as a selection criterion combines a number of quality parameters into a simple computation.
  • noise power is a similar measure of signal-to-noise ratio when the microphone inputs are aligned through alignment filters, but it is simpler to compute.
  • the noise power measure used in the least noise power criterion, selects for higher voice quality in many cases.
  • preference is associated with signals where it is easier to detect all parts of the voice component, especially the low-level parts, which in turn leads to fewer audible instances of voice processing artifacts.
  • a voice activity detector may output a signal indicative of whether voice activity is detected or not. Voice activity may be detected when an amplitude or peak magnitude or power level of one or more microphone signals and/or a beamformed signal exceed a predefined or time-varying threshold. The level of the threshold may be adapted to an estimated noise level.
  • the noise suppression coefficient is computed to reduce noise by a predetermined, fixed factor.
  • the predetermined factor may be e.g. 13 dB, 6 dB, 10 dB, 15 dB or another factor. This may be achieved by limiting the noise suppression gain to the predetermined factor.
  • an estimated noise level at the output of the first beamformer and the second beamformer may be, say, ⁇ 30 dB and ⁇ 20 dB, respectively; the fixed factor may be say 10 dB; and consequently, the estimated noise level after noise suppression is then ⁇ 40 dB and ⁇ 30 dB, respectively.
  • the left and right signal beamformed signals may be matched in level towards the signal of interest, e.g. using alignment filters/gains on the microphones at any point in the signal chain preceding the noise suppression gain selection module.
  • noise power computations are conditioned to serve as left and right signal quality measures which reflect the signal-to-noise ratios of the left and right beamformer outputs to a higher degree.
  • At least one of the first beamformer or the second beamformer is configured to comprise: a first stage that generates a summation signal and a difference signal from the input signals, subject to at least one of the input signals being phase and/or amplitude aligned with another of the input signals with respect to a desired signal; and a second stage that filters the difference signal and generating a filtered signal; wherein the beamformed output signal is generated from the difference between the summation signal and the filtered signal; and wherein the filter is adapted using a least mean square technique to minimize the power of the beamformed output signal.
  • first and/or the second beamformer selectively and adaptively cancel out sound from certain directions.
  • the filter may have a low-pass characteristic to enhance lower frequency components relative to higher frequency components.
  • the filter may be a bass-boost filter.
  • Such a beamformer may be configured as disclosed in WO 2009/132646 which is hereby incorporated by reference for everything it discloses.
  • the third beamformer is configured with a fixed sensitivity with respect to a predefined spatial position relative to the spatial position of the microphones.
  • a fixed sensitivity means that the third beamformer applies a fixed frequency response with respect to sound emanating from an acoustic source at the predefined spatial position.
  • the predefined position is located in a predefined way with respect to the spatial position and orientation of the first set of microphones and the second set of microphones.
  • the predefined space is preferably centred about a person's mouth when the apparatus is worn by the person in a normal way.
  • Beamforming coefficients of the third beamformer may be constrained to sum to a fixed gain e.g. unity gain towards the spatial position.
  • the gain is fixed in the sense that it is not adaptive. However, the gain may be adjusted in connection with calibration or as a preference setting.
  • the third beamformer may combine the input signals by a linear combination.
  • the signals may be combined by a non-linear combination.
  • the microphones output digital signals; the apparatus performs a transformation of the digital signals to a time-frequency representation, in multiple frequency bands; and the apparatus performs an inverse transformation of at least the combined signal to a time-domain representation.
  • the transformation may be performed by means of a Fast Fourier Transformation, FFT, applied to a signal block of a predefined duration.
  • FFT Fast Fourier Transformation
  • the transformation may involve applying a Hann window or another type of window.
  • a time-domain signal may be reconstructed from the time-frequency representation via an Inverse Fast Fourier Transformation, IFFT.
  • the signal block of a predefined duration may have duration of 8 ms with 50% overlap, which means that transformations, adaptation updates, noise reduction updates and time-domain signal reconstruction are computed every 4 ms. However, other durations and/or update intervals are possible.
  • the digital signals may be one-bit signals at a many-times oversampled rate, two-bit or three-bit signals or 8 bit, 10 bit, 12 bit, 16 bit or 24 bit signals.
  • noise suppression may be applied to a time domain signal by means of FIR or IIR filtering, the noise suppression filter coefficients computed in the frequency domain.
  • the microphones output analogue signals; the apparatus performs analogue-to-digital conversion of the analogue signals to provide digital signals; the apparatus performs a transformation of the digital signals to a time-frequency representation, in multiple frequency bands; and the apparatus performs an inverse transformation of at least the combined signal to a time-domain representation.
  • the microphones of at least one pair of the set of microphones is arranged in an end-fire configuration oriented towards a position where a person's mouth is expected to be when the apparatus is used by the person.
  • Such a configuration has shown to give good noise cancelling and suppression, e.g., for headsets or hearing aids.
  • a method for processing audio signals from multiple microphones comprising: receiving a first pair and a second pair of microphone signals from a first pair of microphones and a second pair of microphones, respectively; wherein the first pair of microphones are arranged with a first mutual distance and the second pair of microphones are arranged with a second mutual distance, and wherein the first pair of microphones are arranged at a distance from the second pair of microphones that is greater than the first mutual distance and the second mutual distance at least when the apparatus is in normal operation; performing first beamforming and second beamforming on the first pair of microphone signals and the second pair of microphone signals to output respective beamformed signals; adapting the spatial sensitivity by a respective pair of microphones as measured in a respective beamformed signal such that spatial sensitivity is adapted to suppress noise relative to a desired signal; performing third beamforming to dynamically combine the signals output from the first beamforming and the second beamforming into a combined signal; wherein the signals are combined such that noise energy in the combined signal is minimized while a desired signal is preserved; and performing
  • a computer program product e.g. stored on a computer-readable medium such as a DVD, comprising program code means adapted to cause a data processing system to perform the steps of the method, when said program code means are executed on the data processing system.
  • a computer data signal e.g. a download signal, embodied in a carrier wave and representing sequences of instructions which, when executed by a processor, cause the processor to perform the steps of the method.
  • processing means and ‘processing unit’ are intended to comprise any circuit and/or device suitably adapted to perform the functions described herein.
  • the above term comprises general purpose or proprietary programmable microprocessors, Digital Signal Processors (DSP), Application Specific Integrated Circuits (ASIC), Programmable Logic Arrays (PLA), Field Programmable Gate Arrays (FPGA), special purpose electronic circuits, etc., or a combination thereof.
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuits
  • PDA Programmable Logic Arrays
  • FPGA Field Programmable Gate Arrays
  • FIG. 1 shows a block diagram of a signal processor
  • FIG. 2 shows a more detailed block diagram of the signal processor
  • FIG. 3 shows different configurations of an apparatus with multiple microphones.
  • FIG. 1 shows a block diagram of a signal processor and a first and second pair of microphones.
  • the first set of microphones, 101 and 102 , and the second set of microphones, 103 and 104 are arranged with an intra-pair distance between the microphones that is relatively short compared to the microphone pairs inter-distance, between the pairs of microphones.
  • the signal processor is designated by reference numeral 100 .
  • the first pair of microphones 101 and 102 outputs a first microphone signal pair input to a first beamformer 105 and the second pair of microphones 103 and 104 outputs a second microphone signal pair, which is input to a second beamformer 106 .
  • the first beamformer 105 and the second beamformer 106 outputs respective output signals X L and X R .
  • the first beamformer 105 and the second beamformer 106 are each configured to adapt their spatial sensitivity.
  • the spatial sensitivity is adapted to cancel or suppress noise relative to a desired signal.
  • the first beamformer and the second beamformer may be configured as disclosed in WO 2009/132646.
  • the third beamformer 107 is configured to dynamically combine the signals, X L ; X R , output from the first beamformer 105 and the second beamformer 106 into a combined signal X C .
  • the combined signal X C can be expressed by the following expression:
  • G L and G R represent transfer functions from a first input at which X L is received and from a second input at which X R is received, respectively.
  • the above expression relies on a frequency domain representation; X L and X R are complex numbers.
  • An equivalent representation exists for a time-domain representation.
  • the third beamformer is configured to adjust real or complex G L and G R dynamically to output X C with a lowest noise level while preserving a desired signal.
  • G ⁇ L ⁇ ⁇ X R ⁇ 2 ⁇ - Re ⁇ ⁇ ⁇ X L ⁇ X R * ⁇ ⁇ ⁇ X L - X R ⁇ 2 ⁇
  • G ⁇ R G ⁇ L - 1
  • Re is the real part of a complex number
  • represent complex conjugate, averaging across a time interval and absolute value, respectively.
  • the mean-squares of X C are minimized as a function of real G L , subject to a constraint.
  • the constraint ensures that the desired signal is favoured over signals from at least some other locations.
  • matching filters are inserted between the microphones and the inputs to the beamformers of the first stage i.e. in the shown embodiment the first and the second beamformer. Thereby filtering the input signals to the first and the second beamformers so that the desired signal component is sufficiently identical in all the inputs, i.e., with respect to phase and amplitude.
  • the filters compensate for variations in acoustic path of the desired signal to the microphones as well as variations in microphone sensitivities or other variations.
  • Such matching filters may also be denoted alignment filters and matching may be denoted alignment.
  • the output desired signal component of the first and second beamformers are similarly identical due to the inbuilt constraints (e.g.
  • the inputs to the third beamformer are sufficiently identical with respect to the desired signal component.
  • One of the inputs may be chosen as a reference for microphone alignment.
  • one of the alignment filters may be configured to produce an all-pass characteristic; the other alignment filters are configured accordingly.
  • the microphone alignment filters may be pre-configured by assuming and compensating for a known acoustical relation between the origin of the desired signal and the microphones and using microphones with very small variations in sensitivities.
  • the microphone sensitivities may be estimated in a calibration step at the time of production.
  • the microphone alignment filters may be estimated while the device is in operation: when activated by a voice or noise activity detector, the alignment filters are estimated by, e.g., a least squares technique.
  • Constraining the beamformer with respect to the desired signal may be equivalently achieved by integrating the microphone alignment filters directly into one or more of the beamformers' calculations, or, alternatively at the outputs of the first and second beamformers.
  • the above expression for computing G L and G R is at least to some extent resistant to the influence of the desired signal and may work sufficiently well without any voice-activity detector, VAD.
  • VAD voice-activity detector
  • X R and X L are complex representations of the respective signals. This expression is subject to similar minimization and constraint as mentioned above but assumes that noise components in X R and X L are uncorrelated. In this case the voice-activity detector is applied to discard signal portions of X R and X L wherein voice is present for the purpose of estimating G L and G R .
  • Such a weighting rule was disclosed in U.S. Pat. No. 7,206,421 B1 for a multi-microphone input.
  • G L and G R may be constrained further to an interval, say, between 0 and 1.
  • the estimated position of the source emitting the desired signal may be pre-configured and locked to an expected position relative to the positions of the microphones. This could be the case for a headset, wherein the position of a person's mouth may be sufficiently well-defined when the headset is worn in a normal position.
  • the apparatus may comprise a tracker that estimates the position of the source of the desired signal from, e.g., phase and/or amplitude differences in the signals from one, two or more microphone pairs or sets of more than two microphones. This could be the case for a speakerphone or a hands-free set for a communications device in, e.g., a car.
  • the combined signal, X C is input to a noise suppression unit 109 that computes a noise suppression gain, A S , from the beamformed signals X L and X R .
  • the noise suppression unit 109 may include the microphone signals from one or more of the microphones 101 , 102 , 103 , 104 in computing the noise suppression gain, A.
  • the signals from M 3 and M 4 and the signal X R output from the beamformer 106 are labelled ‘a’, ‘b’ and ‘c’ and are input to the noise suppression unit 109 as indicated by respective labels.
  • the noise suppression gain, A S is applied to the combined signal, X C , by a multiplier 108 .
  • a signal output from the multiplier is a reproduced audio signal comprising beamformed and noise suppressed signal components picked up by the microphones.
  • Label ‘O’ designates output from the signal processor. The output may be subject to further signal processing, amplification and/or transmission.
  • FIG. 2 shows a more detailed block diagram of the signal processor. It is shown that the noise suppression gain, A S , is selected as either a first or left noise suppression gain, A L , or a second or right noise suppression gain, A R .
  • the left noise suppression gain, A L is computed from the beamformed signal X L and/or the microphone signals xm 1 and/or xm 2 .
  • the right noise suppression gain, A R is computed from the beamformed signal X R and/or the microphone signals xm 3 and/or xm 4 .
  • a L is applied to X L via multiplier 205 and A R is applied to X R via multiplier 209 .
  • Respective outputs of the multipliers 205 and 209 are input to respective signal quality evaluators 203 and 208 .
  • the inputs may be interpreted as left and right noise-reduced, beamformed signals.
  • the signal quality evaluators 203 and 208 may evaluate the signal quality of the signals output from the multipliers 205 and 209 according to a criterion of signal-to-noise ratio. Alternatively, signal quality may be evaluated according to a criterion of noise signal power during a time interval when voice activity is detected as not present. This may be facilitated by applying the microphone alignment filters to render the desired signal component sufficiently identical at all beamformer inputs and outputs. In this case, signal-to-noise ratio and noise power are similar measures of signal quality.
  • the signal quality evaluators output signals P L and P R that selects either A L or A R via a selector 204 .
  • a S which is output from the selector represents the selected noise suppression gain and it is applied to X C via a multiplier 108 .
  • Signals P L and P R and hence the signal quality evaluators 203 and 208 may be defined as power computations on the noise component of the signals received as inputs.
  • P L may be defined as the mean square of the beamformed, noise-reduced input during noise-only intervals. Averaging may be performed across a suitable time interval, e.g., 100 ms or 1 s, and across a suitable frequency interval, e.g. 0-8000 Hz.
  • the selector 204 may be configured to select A L when P L is less than P R and conversely select A R when P L is larger than P R .
  • Voice activity detectors 202 and 207 output signals to the signal quality evaluators 203 and 208 , respectively, indicative of whether voice is detected.
  • a voice activity detector, VAD of a single-input type, may be configured to estimate a noise floor level, N, by receiving an input signal and computing a slowly varying average of the magnitude of the input signal.
  • a comparator may output a signal indicative of the presence of a voice signal when the magnitude of the signal temporarily exceeds the estimated noise floor by a predefined factor of, say, 10 dB.
  • the VAD may disable noise floor estimation when the presence of voice is detected.
  • Such a voice detector works when the noise is quasi-stationary and when the magnitude of voice exceeds the estimated noise floor sufficiently.
  • Such a voice activity detector may operate at a band-limited signal or at multiple frequency bands to generate a voice activity signal aggregated from multiple frequency bands. When the voice activity detector works at multiple frequency bands, it may output multiple voice activity signals for respective multiple frequency bands.
  • a voice activity detector, VAD of a multiple-input type, may be configured to compute a signal indicative of coherence between multiple signals. For example, the voice signal may exhibit a higher level of coherence between the microphones due to the mouth being closer to the microphones than the noise sources.
  • Other types of voice activity detectors are based on computing spatial features or cues such as directionality and proximity, and, dictionary approaches decomposing signal into codebook time/frequency profiles.
  • a noise suppression gain designated G NS or A L or A R may be computed from the following expression:
  • G NS ⁇ X ⁇ 2 ⁇ X ⁇ 2 + P N ⁇ F
  • P N is the square of the estimated noise floor level at a time instance t
  • 2 is the square of the input signal at the time instance t
  • F is a factor, e.g., a factor of 10.
  • the noise suppression gain affects an input signal via a multiplier, if applied in a frequency domain.
  • G NS becomes 1 when voice is significantly present.
  • G NS moves to values less than 1 and consequently a suppression of the input signal.
  • the factor F is selected to set how aggressively the input signal should be suppressed.
  • its input signal(s) may be any of the microphone signals and/or output from the first beamformer and/or second beamformer and/or third beamformer.
  • Noise levels may, e.g., be estimated by minimum statistics as in [R. Martin, “Noise Power Spectral Density Estimation Based on Optimal Smoothing and Minimum Statistics,” Trans. on Speech and Audio Processing, Vol. 9, No. 5, July 2001], where the minimum signal level is adaptively estimated.
  • noise suppression may be implemented as described in [Y. Ephraim and D. Malah, “Speech enhancement using optimal non-linear spectral amplitude estimation,” in Proc. IEEE Int. Conf. Acoust. Speech Signal Processing, 1983, pp. 1118-1121] or as described elsewhere in the literature on noise suppression techniques.
  • a time-varying filter is applied to the signal. Analysis and/or filtering are often implemented in a frequency transformed domain/filter bank, representing the signal in a number of frequency bands.
  • a time-varying gain is computed depending on the relation of estimated desired signal and noise components e.g. when the estimated signal-to-noise ratio exceeds a pre-determined, adaptive or fixed threshold, the gain is steered toward 1 . Conversely, when the estimated signal-to-noise ratio does not exceed the threshold, the gain is set to a value smaller than 1.
  • the labels designated ‘x’ and ‘y’ connect the respective signals: x-to-x and y-to-y.
  • FIG. 3 shows different configurations of an apparatus with multiple microphones.
  • a spectacle frame 303 with bows 306 are configured with two sets of microphones 304 and 305 .
  • a flexible neckband 307 is configured with two sets of microphones 308 and 309 .
  • Reference numeral 301 designates the head of a person wearing the spectacle frame 303 and reference numeral 302 designates the head of a person wearing the neckband 307 .
  • the microphones may be arranged in a so-called end-fire configuration wherein the microphones of a respective pair or set of microphones sit on a line that intersects with or passes close to a position of a source of a desired signal.
  • the position may be a position of the person's mouth opening or a position in proximity of the person's mouth opening.
  • an end-fire configuration the microphones of a microphone pair sit on a straight line intersecting the position of the source of the desired signal.
  • Such a configuration is found to be suitable for effectively suppressing or cancelling noise from sources located elsewhere when the apparatus is a headset, hearing aid or the like.
  • a so-called broadside configuration for the microphone positions is used.
  • the microphones of a microphone pair sit on a straight line at an equal distance to the position of the source of the desired signal.
  • the microphones of a microphone pair sit on a line inclined e.g. at 5°, 10°, 45° relative to a direction from the microphone pair to the position of the source of the desired signal, thereby providing a configuration that may be more practically suitable.
  • microphones outputting digital signals are used.
  • analogue microphones in conjunction with an analogue-to-digital converter or any other transduction from the sound field to a sampled domain could be used.
  • the microphones are typically embodied in so-called capsules with a diameter in the range of typically 3 mm to 5 mm or 6 mm.
  • a beamformer may receive signals from more than a pair of microphones.
  • a beamformer e.g., a first stage beamformer, may receive microphone signals from 3, 4 or more microphones.
  • the first stage may comprise more than the first and the second beamformer; the first stage may comprise, e.g., 3, 4 or more beamformers.

Landscapes

  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Circuit For Audible Band Transducer (AREA)
US14/566,579 2013-12-13 2014-12-10 Apparatus And A Method For Audio Signal Processing Abandoned US20150172807A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP13197139 2013-12-13
EP13197139 2013-12-13

Publications (1)

Publication Number Publication Date
US20150172807A1 true US20150172807A1 (en) 2015-06-18

Family

ID=49765885

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/566,579 Abandoned US20150172807A1 (en) 2013-12-13 2014-12-10 Apparatus And A Method For Audio Signal Processing
US14/566,959 Active 2035-02-13 US9472180B2 (en) 2013-12-13 2014-12-11 Headset and a method for audio signal processing

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/566,959 Active 2035-02-13 US9472180B2 (en) 2013-12-13 2014-12-11 Headset and a method for audio signal processing

Country Status (3)

Country Link
US (2) US20150172807A1 (fr)
EP (1) EP2884763B1 (fr)
CN (1) CN104717587B (fr)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160284334A1 (en) * 2015-03-24 2016-09-29 Bose Corporation Vehicle Engine Harmonic Sound Control
US9484043B1 (en) * 2014-03-05 2016-11-01 QoSound, Inc. Noise suppressor
US20170053667A1 (en) * 2014-05-19 2017-02-23 Nuance Communications, Inc. Methods And Apparatus For Broadened Beamwidth Beamforming And Postfiltering
US20170110142A1 (en) * 2015-10-18 2017-04-20 Kopin Corporation Apparatuses and methods for enhanced speech recognition in variable environments
CN106797508A (zh) * 2015-08-13 2017-05-31 Ibk企业银行 用于改善音质的方法及耳机
CN109087663A (zh) * 2017-06-13 2018-12-25 恩智浦有限公司 信号处理器
US10237654B1 (en) * 2017-02-09 2019-03-19 Hm Electronics, Inc. Spatial low-crosstalk headset
US10249318B2 (en) * 2016-03-21 2019-04-02 Nxp B.V. Speech signal processing circuit
US10262676B2 (en) * 2017-06-30 2019-04-16 Gn Audio A/S Multi-microphone pop noise control
US20190156848A1 (en) * 2017-11-23 2019-05-23 Ubtech Robotics Corp Noise reduction method, system and terminal device
US10306389B2 (en) 2013-03-13 2019-05-28 Kopin Corporation Head wearable acoustic system with noise canceling microphone geometry apparatuses and methods
US10341766B1 (en) * 2017-12-30 2019-07-02 Gn Audio A/S Microphone apparatus and headset
US10339952B2 (en) 2013-03-13 2019-07-02 Kopin Corporation Apparatuses and systems for acoustic channel auto-balancing during multi-channel signal extraction
US10395667B2 (en) * 2017-05-12 2019-08-27 Cirrus Logic, Inc. Correlation-based near-field detector
US20190288764A1 (en) * 2016-11-03 2019-09-19 Nokia Technologies Oy Beamforming
US20190394586A1 (en) * 2018-06-22 2019-12-26 Oticon A/S Hearing device comprising an acoustic event detector
US10522167B1 (en) * 2018-02-13 2019-12-31 Amazon Techonlogies, Inc. Multichannel noise cancellation using deep neural network masking
US20200058317A1 (en) * 2018-08-14 2020-02-20 Bose Corporation Playback enhancement in audio systems
US11463833B2 (en) * 2016-05-26 2022-10-04 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for voice or sound activity detection for spatial audio
US20220345101A1 (en) * 2019-09-27 2022-10-27 Widex A/S A method of operating an ear level audio system and an ear level audio system
US11917370B2 (en) 2018-09-27 2024-02-27 Oticon A/S Hearing device and a hearing system comprising a multitude of adaptive two channel beamformers

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10163453B2 (en) 2014-10-24 2018-12-25 Staton Techiya, Llc Robust voice activity detector system for use with an earphone
US9401158B1 (en) * 2015-09-14 2016-07-26 Knowles Electronics, Llc Microphone signal fusion
DK3148217T3 (en) * 2015-09-24 2019-04-15 Sivantos Pte Ltd Method of using a binaural hearing system
CN105260333B (zh) * 2015-09-24 2018-08-28 福州瑞芯微电子股份有限公司 音频信号的加速处理方法及装置
DK3236672T3 (da) * 2016-04-08 2019-10-28 Oticon As Høreanordning, der omfatter en stråleformerfiltreringsenhed
CN105979415B (zh) * 2016-05-30 2019-04-12 歌尔股份有限公司 一种自适应调节降噪增益的降噪方法、装置及降噪耳机
GB201615538D0 (en) * 2016-09-13 2016-10-26 Nokia Technologies Oy A method , apparatus and computer program for processing audio signals
US9930447B1 (en) * 2016-11-09 2018-03-27 Bose Corporation Dual-use bilateral microphone array
US9843861B1 (en) * 2016-11-09 2017-12-12 Bose Corporation Controlling wind noise in a bilateral microphone array
US10311889B2 (en) * 2017-03-20 2019-06-04 Bose Corporation Audio signal processing for noise reduction
US10424315B1 (en) 2017-03-20 2019-09-24 Bose Corporation Audio signal processing for noise reduction
US10499139B2 (en) 2017-03-20 2019-12-03 Bose Corporation Audio signal processing for noise reduction
US10366708B2 (en) 2017-03-20 2019-07-30 Bose Corporation Systems and methods of detecting speech activity of headphone user
US10555094B2 (en) * 2017-03-29 2020-02-04 Gn Hearing A/S Hearing device with adaptive sub-band beamforming and related method
DK3383067T3 (da) * 2017-03-29 2020-07-20 Gn Hearing As Høreapparat med adaptiv underbåndsstråledannelse og tilhørende fremgangsmåde
US10249323B2 (en) 2017-05-31 2019-04-02 Bose Corporation Voice activity detection for communication headset
CN107743279B (zh) * 2017-10-09 2019-11-19 维沃移动通信有限公司 一种耳机降噪方法、耳机及移动终端
EP3480809B1 (fr) * 2017-11-02 2021-10-13 ams AG Procédé pour déterminer une fonction de réponse d'un dispositif audio activé à annulation de bruit
DK3506658T3 (da) 2017-12-29 2020-11-30 Oticon As Høreanordning, der omfatter en mikrofon, som er tilpasset til at blive placeret ved eller i en brugers øregang
US10438605B1 (en) 2018-03-19 2019-10-08 Bose Corporation Echo control in binaural adaptive noise cancellation systems in headsets
JP2020036304A (ja) * 2018-08-29 2020-03-05 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 信号処理方法及び信号処理装置
US10567898B1 (en) * 2019-03-29 2020-02-18 Snap Inc. Head-wearable apparatus to generate binaural audio
CN114073101B (zh) * 2019-06-28 2023-08-18 斯纳普公司 用于提高使用头戴式设备采集的信号的信噪比的动态波束成形
US11295754B2 (en) 2019-07-30 2022-04-05 Apple Inc. Audio bandwidth reduction
US11043201B2 (en) * 2019-09-13 2021-06-22 Bose Corporation Synchronization of instability mitigation in audio devices
CN110830870B (zh) * 2019-11-26 2021-05-14 北京声加科技有限公司 一种基于传声器技术的耳机佩戴者语音活动检测系统
CN112669877B (zh) * 2020-09-09 2023-09-29 珠海市杰理科技股份有限公司 噪声检测及压制方法、装置、终端设备和系统、芯片
US11521633B2 (en) * 2021-03-24 2022-12-06 Bose Corporation Audio processing for wind noise reduction on wearable devices
WO2022248020A1 (fr) * 2021-05-25 2022-12-01 Sivantos Pte. Ltd. Procédé de fonctionnement d'un système auditif
EP4324223A1 (fr) * 2021-05-25 2024-02-21 Sivantos Pte. Ltd. Procédé de fonctionnement d'un système auditif
CN113823315B (zh) * 2021-09-30 2024-02-13 深圳万兴软件有限公司 降风噪方法、装置、双麦克风设备及存储介质
US20240064478A1 (en) * 2022-08-22 2024-02-22 Oticon A/S Mehod of reducing wind noise in a hearing device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070047743A1 (en) * 2005-08-26 2007-03-01 Step Communications Corporation, A Nevada Corporation Method and apparatus for improving noise discrimination using enhanced phase difference value
US20080260175A1 (en) * 2002-02-05 2008-10-23 Mh Acoustics, Llc Dual-Microphone Spatial Noise Suppression
US20120008807A1 (en) * 2009-12-29 2012-01-12 Gran Karl-Fredrik Johan Beamforming in hearing aids
US20140169570A1 (en) * 2012-12-14 2014-06-19 Sridhar Kalluri Spatial enhancement mode for hearing aids
US20150249892A1 (en) * 2012-09-28 2015-09-03 Phonak Ag Method for operating a binaural hearing system and binaural hearing system

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7206421B1 (en) 2000-07-14 2007-04-17 Gn Resound North America Corporation Hearing system beamformer
US20040175008A1 (en) 2003-03-07 2004-09-09 Hans-Ueli Roeck Method for producing control signals, method of controlling signal and a hearing device
US8755547B2 (en) 2006-06-01 2014-06-17 HEAR IP Pty Ltd. Method and system for enhancing the intelligibility of sounds
US8150054B2 (en) * 2007-12-11 2012-04-03 Andrea Electronics Corporation Adaptive filter in a sensor array system
CN101192411B (zh) * 2007-12-27 2010-06-02 北京中星微电子有限公司 大距离麦克风阵列噪声消除的方法和噪声消除系统
US8818000B2 (en) 2008-04-25 2014-08-26 Andrea Electronics Corporation System, device, and method utilizing an integrated stereo array microphone
CN102077607B (zh) 2008-05-02 2014-12-10 Gn奈康有限公司 组合至少两个音频信号的方法和包括至少两个麦克风的麦克风系统
US9820071B2 (en) 2008-08-31 2017-11-14 Blamey & Saunders Hearing Pty Ltd. System and method for binaural noise reduction in a sound processing device
CN102204281B (zh) 2008-11-05 2015-06-10 希尔Ip有限公司 用于产生定向输出信号的系统和方法
EP2537353B1 (fr) 2010-02-19 2018-03-07 Sivantos Pte. Ltd. Dispositif et procédé pour diminuer le bruit spatial en fonction de la direction
US9025782B2 (en) * 2010-07-26 2015-05-05 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for multi-microphone location-selective processing
WO2012109019A1 (fr) * 2011-02-10 2012-08-16 Dolby Laboratories Licensing Corporation Système et procédé pour la détection et la suppression de bruit du vent
CN103907152B (zh) 2011-09-02 2016-05-11 Gn奈康有限公司 用于音频信号噪声抑制的方法和系统
US9313572B2 (en) * 2012-09-28 2016-04-12 Apple Inc. System and method of detecting a user's voice activity using an accelerometer

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080260175A1 (en) * 2002-02-05 2008-10-23 Mh Acoustics, Llc Dual-Microphone Spatial Noise Suppression
US20070047743A1 (en) * 2005-08-26 2007-03-01 Step Communications Corporation, A Nevada Corporation Method and apparatus for improving noise discrimination using enhanced phase difference value
US20120008807A1 (en) * 2009-12-29 2012-01-12 Gran Karl-Fredrik Johan Beamforming in hearing aids
US20150249892A1 (en) * 2012-09-28 2015-09-03 Phonak Ag Method for operating a binaural hearing system and binaural hearing system
US20140169570A1 (en) * 2012-12-14 2014-06-19 Sridhar Kalluri Spatial enhancement mode for hearing aids

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10306389B2 (en) 2013-03-13 2019-05-28 Kopin Corporation Head wearable acoustic system with noise canceling microphone geometry apparatuses and methods
US10339952B2 (en) 2013-03-13 2019-07-02 Kopin Corporation Apparatuses and systems for acoustic channel auto-balancing during multi-channel signal extraction
US9484043B1 (en) * 2014-03-05 2016-11-01 QoSound, Inc. Noise suppressor
US20170053667A1 (en) * 2014-05-19 2017-02-23 Nuance Communications, Inc. Methods And Apparatus For Broadened Beamwidth Beamforming And Postfiltering
US9990939B2 (en) * 2014-05-19 2018-06-05 Nuance Communications, Inc. Methods and apparatus for broadened beamwidth beamforming and postfiltering
US20160284334A1 (en) * 2015-03-24 2016-09-29 Bose Corporation Vehicle Engine Harmonic Sound Control
US9812113B2 (en) * 2015-03-24 2017-11-07 Bose Corporation Vehicle engine harmonic sound control
CN106797508A (zh) * 2015-08-13 2017-05-31 Ibk企业银行 用于改善音质的方法及耳机
US11631421B2 (en) * 2015-10-18 2023-04-18 Solos Technology Limited Apparatuses and methods for enhanced speech recognition in variable environments
US20170110142A1 (en) * 2015-10-18 2017-04-20 Kopin Corporation Apparatuses and methods for enhanced speech recognition in variable environments
US10249318B2 (en) * 2016-03-21 2019-04-02 Nxp B.V. Speech signal processing circuit
US11463833B2 (en) * 2016-05-26 2022-10-04 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for voice or sound activity detection for spatial audio
US11031990B2 (en) * 2016-11-03 2021-06-08 Nokia Technologies Oy Beamforming
US20190288764A1 (en) * 2016-11-03 2019-09-19 Nokia Technologies Oy Beamforming
US10237654B1 (en) * 2017-02-09 2019-03-19 Hm Electronics, Inc. Spatial low-crosstalk headset
US11102579B2 (en) 2017-02-09 2021-08-24 H.M. Electronics, Inc. Spatial low-crosstalk headset
US10735861B2 (en) 2017-02-09 2020-08-04 Hm Electronics, Inc. Spatial low-crosstalk headset
US10395667B2 (en) * 2017-05-12 2019-08-27 Cirrus Logic, Inc. Correlation-based near-field detector
US10356515B2 (en) * 2017-06-13 2019-07-16 Nxp B.V. Signal processor
CN109087663A (zh) * 2017-06-13 2018-12-25 恩智浦有限公司 信号处理器
US10262676B2 (en) * 2017-06-30 2019-04-16 Gn Audio A/S Multi-microphone pop noise control
US10714114B2 (en) * 2017-11-23 2020-07-14 Ubtech Robotics Corp Noise reduction method, system and terminal device
US20190156848A1 (en) * 2017-11-23 2019-05-23 Ubtech Robotics Corp Noise reduction method, system and terminal device
US10341766B1 (en) * 2017-12-30 2019-07-02 Gn Audio A/S Microphone apparatus and headset
US10522167B1 (en) * 2018-02-13 2019-12-31 Amazon Techonlogies, Inc. Multichannel noise cancellation using deep neural network masking
CN110636429A (zh) * 2018-06-22 2019-12-31 奥迪康有限公司 包括声学事件检测器的听力装置
US20190394586A1 (en) * 2018-06-22 2019-12-26 Oticon A/S Hearing device comprising an acoustic event detector
US10856087B2 (en) * 2018-06-22 2020-12-01 Oticon A/S Hearing device comprising an acoustic event detector
US20200058317A1 (en) * 2018-08-14 2020-02-20 Bose Corporation Playback enhancement in audio systems
US11335357B2 (en) * 2018-08-14 2022-05-17 Bose Corporation Playback enhancement in audio systems
US11917370B2 (en) 2018-09-27 2024-02-27 Oticon A/S Hearing device and a hearing system comprising a multitude of adaptive two channel beamformers
US20220345101A1 (en) * 2019-09-27 2022-10-27 Widex A/S A method of operating an ear level audio system and an ear level audio system
US11996812B2 (en) * 2019-09-27 2024-05-28 Widex A/S Method of operating an ear level audio system and an ear level audio system

Also Published As

Publication number Publication date
US9472180B2 (en) 2016-10-18
EP2884763A1 (fr) 2015-06-17
CN104717587A (zh) 2015-06-17
CN104717587B (zh) 2019-07-12
US20150170632A1 (en) 2015-06-18
EP2884763B1 (fr) 2019-05-29

Similar Documents

Publication Publication Date Title
US9472180B2 (en) Headset and a method for audio signal processing
US10885907B2 (en) Noise reduction system and method for audio device with multiple microphones
US10079026B1 (en) Spatially-controlled noise reduction for headsets with variable microphone array orientation
US7464029B2 (en) Robust separation of speech signals in a noisy environment
CN110741434B (zh) 用于具有可变麦克风阵列定向的耳机的双麦克风语音处理
US7983907B2 (en) Headset for separation of speech signals in a noisy environment
US8861745B2 (en) Wind noise mitigation
US9224393B2 (en) Noise estimation for use with noise reduction and echo cancellation in personal communication
US7386135B2 (en) Cardioid beam with a desired null based acoustic devices, systems and methods
EP3422736B1 (fr) Reduction de bruit de type pop dans un casque-micro avec plusieurs microphones
KR20100054873A (ko) 강인한 두 마이크로폰 잡음 억제 시스템
US11373667B2 (en) Real-time single-channel speech enhancement in noisy and time-varying environments
EP3545691B1 (fr) Capture sonore en champ lointain
JP2001045592A (ja) 雑音キャンセル式マイクロホンアレイ
As’ad et al. Robust minimum variance distortionless response beamformer based on target activity detection in binaural hearing aid applications
Lotter et al. A stereo input-output superdirective beamformer for dual channel noise reduction.
Zhang et al. A frequency domain approach for speech enhancement with directionality using compact microphone array.
Li et al. A Subband Feedback Controlled Generalized Sidelobe Canceller in Frequency Domain with Multi-Channel Postfilter
Lee et al. Small-Aperture Adaptive Microphone Array System for High Quality Speech Acquisition

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION