WO2020223261A1 - Wind noise detection systems and methods - Google Patents
Wind noise detection systems and methods Download PDFInfo
- Publication number
- WO2020223261A1 WO2020223261A1 PCT/US2020/030312 US2020030312W WO2020223261A1 WO 2020223261 A1 WO2020223261 A1 WO 2020223261A1 US 2020030312 W US2020030312 W US 2020030312W WO 2020223261 A1 WO2020223261 A1 WO 2020223261A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- wind
- detection flag
- noise
- channel
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers
- H04R3/04—Circuits for transducers for correcting frequency response
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers
- H04R3/005—Circuits for transducers for combining the signals of two or more microphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0264—Noise filtering characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
- G10L25/06—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being correlation coefficients
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
- G10L25/18—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
- H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
- H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
- H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers
- H04R3/02—Circuits for transducers for preventing acoustic reaction, i.e. acoustic oscillatory feedback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2410/00—Microphones
- H04R2410/01—Noise reduction using microphones having different directional characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2410/00—Microphones
- H04R2410/07—Mechanical or electrical reduction of wind noise generated by wind passing a microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/03—Synergistic effects of band splitting and sub-band processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/01—Hearing devices using active noise cancellation
Definitions
- the present application relates generally to noise cancelling systems and methods, and more specifically, for example, to the cancellation and/or suppression of wind noise in audio processing devices such as headphones (e.g., circum-aural, supra-aural and in-ear types), earbuds, and hearing aids, and other personal listening devices.
- audio processing devices such as headphones (e.g., circum-aural, supra-aural and in-ear types), earbuds, and hearing aids, and other personal listening devices.
- Audio processing devices generally include one or more microphones to sense sounds from the environment and produce corresponding audio signals.
- An active noise cancellation (ANC) headphone for example, includes a reference microphone to generate an anti-noise signal that is approximately equal in magnitude, but opposite in phase, to the sensed ambient noise. The ambient noise and the anti-noise signal cancel each other acoustically, allowing the user to hear a desired audio signal.
- ANC active noise cancellation
- a system comprises a wind detector operable to receive a plurality of audio input signals and output a plurality of wind detection flags including a single channel wind detection flag and a cross-channel wind detection flag, each wind detection flag indicating a presence or absence of wind noise, and a fusion smoothing module operable to receive the plurality of wind detection flags and generate an output wind detection flag, the output wind detection flag.
- the system may further include a plurality of microphones operable to sense sound and generate the plurality of audio input signals, and a memory storing program instructions, and a digital signal processor operable to execute the program instructions.
- the system may include a noise suppression module operable to receive the audio input signals and the output wind detection flag and reduce wind noise detected in the audio input signals, and/or an active noise cancellation system operable to generate an anti-noise signal to cancel a portion of the audio input signals in accordance with the output wind detection flag.
- the wind detector includes a single channel detector operable to receive a single audio channel of the plurality of audio input signals and generate the single channel wind detection flag.
- the single channel detector may be operable to compare the single audio channel with a wind spectrum model that comprises a mean and a standard deviation of a power ratio of a portion of frequency components and a spectrum slope.
- the wind detector is operable to clear a flag if the mean of the power ratio is less than a threshold mean and the standard deviation is greater than a threshold standard deviation (e.g., when wind noise is determined to be absent) and set a flag if the spectrum slope is greater than a predetermined threshold spectrum slope (e.g., when wind noise is determined to be present).
- the wind detector may further include a cross-channel detector operable to compute auto correlations and a cross correlation between two or more audio channels and set a flag if the auto correlations are less than the cross correlation.
- the fusion smoothing module may be operable to set the output wind detection flag to“present” if the cross-channel wind detection flag is on and at least one single channel wind detection flag is on and set a fusion wind flag if a predetermined number of previously generated fusion wind flags are on.
- a method includes receiving a plurality of audio input signals, generating a plurality of preliminary wind detection flags including a single channel wind detection flag and a cross-channel wind detection flag, each wind detection flag indicating a presence or absence of wind noise in a portion of the audio input signals, and outputting the wind detection flag.
- the method may further include reducing wind noise in the audio input signals if the wind detection flag is active, and/or generating anti -noise signal to cancel a portion of the audio input signals in accordance with the wind detection flag.
- the method includes receiving a single audio channel of the audio input signal and generating the single channel wind detection flag, generating a wind spectrum model by calculating a mean and a standard deviation of a power ratio of certain frequency components and a spectrum slope, and comparing the single audio channel with a wind spectrum model. If the mean of the power ratio is less than a threshold mean, and the standard deviation is greater than a threshold standard deviation, the method may set the single channel wind detection flag to indicate that wind noise is absent. If the spectrum slope is greater than a predetermined threshold spectrum slope, then the method may set the single channel wind noise flag to indicate that wind noise is present.
- the method may further include computing auto correlations and a cross correlation between two or more audio channels and determining that wind noise is present if the auto correlations are less than the cross correlations.
- the final wind detection flag may be set to“present” if the cross-channel detector wind noise flag is on and at least one of the single channel audio flags is on.
- the method may further smooth the fusion wind detection flag based on a number of previously determine fusion wind detection flag values.
- FIG. 1 illustrates a wind detection system, in accordance with one or more embodiments of the present disclosure.
- FIG. 2 illustrates a flow chart of a single channel wind detector, in accordance with one or more embodiments of the present disclosure.
- FIG. 3 illustrates a flow chart of a cross-channel wind detector, in accordance with one or more embodiments of the present disclosure.
- FIG. 4 illustrates a flow chart of a fusion stage in the fusion-smoothing module, in accordance with one or more embodiments of the present disclosure.
- FIG. 5 illustrates a flow chart of the smoothing stage in a fusion-smoothing module.
- FIG. 6 illustrates an embodiment of an audio device, in accordance with one or more embodiments of the present disclosure.
- Improved wind noise detection systems and methods are disclosed that may be implemented in a variety of audio processing systems including active noise cancellation (ANC) systems, mobile phones, smart speakers, voice command and processing systems, automotive systems (e.g., handsfree voice controls) and other audio processing systems that may operate in a windy environment.
- ANC active noise cancellation
- mobile phones mobile phones
- smart speakers voice command and processing systems
- automotive systems e.g., handsfree voice controls
- other audio processing systems that may operate in a windy environment.
- a wind noise detection system includes two or more spatially separated microphones. Each microphone senses sound in the environment, which may include wind noise sensed due to air turbulence local to each microphone. As a result, the different microphones may independently sense different wind noise events.
- a wind noise detection system analyzes single channel wind features associated with each microphone and cross-channel wind features for two or more of the audio channels. In one embodiment, the single channel wind features characterize the spectrum of the wind noise, and the cross channel wind features evaluate the cross correlation between pairs of microphone signals.
- a fusion-smoothing stage operates to fuse the resulting features, filter the detection results, and improve system stability.
- the wind detection systems and methods of the present disclosure explore both single and cross-channel wind features and employ a fusion-smoothing stage to filter the detection results.
- the single channel feature detector may include a unique decision tree structure as disclosed herein, and the features may include the mean and standard deviation of a low frequency component power ratio and the spectrum slope between 500 Hz and 1000 Hz, for example.
- the calculated ratio mean and standard deviation provide good indicators for separating wind noise from speech for use in various voice applications.
- the spectrum slope allows for the discrimination of wind noise and ambient background noise (such as office and street noise).
- the cross-channel feature provides a cross correlation of the two channel signals. Unlike approaches that work in time domain, the proposed wind detection system may compute the cross correlation in frequency domain.
- the phase information may be discarded, and/or the cross correlation may be performed on the whole frequency band or using low frequency components only, for example.
- the wind detection system 100 may be implemented an audio processing system with two or more microphones to monitor the presence of wind in the environment.
- the wind detection system 100 is implemented in the audio input processing components of an audio device that may include a digital signal processor (DSP) configured to suppress noise, detect speech, separate a target signal and/or perform other multichannel audio input processing.
- DSP digital signal processor
- the wind detection system 100 may generate wind noise information that may be used to optimize the audio device’s noise suppression performance.
- a two-channel wind detection system can be used on a headphone equipped with two external microphones (e.g., on the left and right sides) to monitor environmental sound.
- the wind detection system 100 includes a plurality of microphones or other audio sensors, such as a left microphone 102 and a right microphone 104, a wind detector module 110 and a fusion-smoothing module 140.
- Each microphone (102 and 104) senses sound in the external environment, which may include sound from a desired target source 106, sounds from noise sources and sound generated locally by wind.
- Each of the microphones generates an input audio signal, which is digitally sampled and transformed to the frequency domain as a left channel, X L (/). and a right channel, X r (/) . where / is the frequency.
- the wind detector module 110 receives X L (/) and X r (/) as inputs.
- the wind detector module 110 includes a plurality of detector submodules configured to analyze features of the input signals.
- the wind detector module 110 includes a single left channel detector 112, a single right channel detector 116, and a cross-channel detector 114.
- the wind detector system 100 may include additional microphones and the wind detector module 110 may include additional single channel detectors corresponding to each microphone and additional cross channel detectors corresponding to groupings of two of more of the microphones.
- the single left channel detector 112 compares X l (f) with a wind spectrum model.
- the features to be considered in the comparison may include: (1) the mean and standard deviation of the power ratio of low frequency components and (2) the spectrum
- the power ratio of low frequency components in wind noise is less time dependent and more stable than voice signals.
- the power ratio is computed by
- f th is the low frequency threshold.
- the single left channel detector 112 compares the mean and standard deviation of to their thresholds f th and s th . If or si > s th it indicates that wind noise is absent, and voice dominates the signal.
- FIG. 2 illustrates an embodiment of a process 200 for operating the single left channel detector 112.
- the process 200 may be implemented in various combinations of hardware and software including, for example, as program instructions stored in a memory for execution by a digital processor.
- step 202 the single left channel detector computes the total signal power
- step 204 the single left channel detector computes the power of low frequency
- step 206 the power ratio
- step 208 the mean and standard deviation of . are
- step 210 if or s l > s th , the current signal is voice and wind is absent.
- the detector then clears the wind flag and provides the wind flag as an output in step 218. If , is false, then the single left channel detector computes the spectrum slope b l between 500 Hz and 1000 Hz in step 212. In step 214, if b l ⁇ b th . the current signal is background noise and wind is absent. The detector clears and outputs the wind flag in step 218. If b l ⁇ b th is false, then the current signal is neither voice nor background noise. A determination is made that wind is present and the wind flag is set and output in step 216.
- the process 200 may also be used to detect the presence or absence of noise through the single right channel detector 116.
- the single right channel detector 116 may store program instructions for causing a processor to execute the process 200, which is applied to X r (f) to set a wind flag for the right input audio channel.
- a two-level decision checking process is used to discriminate wind noise from voice and background noise.
- the process includes a cross channel detector 114 that processes both X l (f) and X r (f) ⁇
- the cross channel detector 114 is implemented as program instructions stored in memory for instructing a digital signal processor to execute the processes disclosed herein.
- the cross-channel detector 114 is configured to compute the auto-correlations and cross-correlation of the left and right channels as follows:
- the wind noise may be created by local air turbulence at each microphone, which results in differences between the wind signals observed at the left microphone and the right microphone.
- the cross-channel detector compares to .
- a is a threshold coefficient. If then it is determined that wind is present,
- FIG. 3 illustrates an embodiment of a process 300 for operating the cross-channel detector 114.
- the cross-channel detector computes the auto correlations
- step 304 the cross correlation y is
- step 306 if , then wind is determined to be present and the cross-channel detector 114 sets the wind flag in step 308. Otherwise, the cross-channel detector 114 clears the wind flag in step 310.
- the wind detector module 110 outputs the results of the single left channel detector 112, the single right channel detector 116, and the cross-channel detector 114 to the fusion-smoothing module 140.
- the results of each of the three detectors are fused by the rule that determines wind detection.
- the output of each of the three detectors may be fused by the rule that the wind is determined to be present when the wind flags of the cross-channel detector 114 and at least one of the single channel detectors 112 and 116, are set.
- the process 400 may be implemented in various hardware and/or software configuration including, for example, as program instructions stored in a memory of an audio processor for execution by a digital signal processor.
- step 402 if the wind flag of the cross channel detector 114 is off, then wind is absent then the fusion wind flag is cleared in step 410.
- step 404 if the cross-channel detector 114 wind flag is on and the single left channel detector 112 flag is on, then wind is determined to be present and the fusion wind flag is set in step 408.
- step 406 if the single left channel detector flag is not on and the wind flag of the single right channel detector 116 is on, then wind is determined to be present, and the fusion wind flag is set in step 408. Otherwise, wind is absent, and the fusion wind flag is cleared in step 410.
- the fusion wind flags are further smoothed to address missing detection and false alarm events. For example, in one embodiment the smoothing method checks the last N fusion wind flags to determine whether to change a wind detection status. If all of the last N wind flags are on, then the smoothed wind flag is on. If all of the last N wind flags are off, then the smoothed wind flag is off. Otherwise, the smoothed wind flag may be maintained in its current state. Other settings and algorithms may also be used to increase or decrease sensitivity to wind detection events, depending on the goals of the system.
- the smoothing operations 500 may be implemented in various hardware and software configurations including, for example, as program instructions stored in a memory for execution by a digital signal processor.
- step 502 if the smoothed wind flag is“on” and the fusion stage wind flag is“on” (step 504), then the fusion flag counter is reset in step 506. If the fusion stage wind flag is“off’ then the fusion flag counter is incremented by one in step 508. Referring back to step 502, if the smoothed wind flag is“off’ and the fusion stage wind flag is“off” (step 510), then fusion flag counter is reset in step 512.
- step 510 If the fusion stage wind flag is“on” (step 510), then the fusion flag counter is incremented by one in step 508. In step 514, if the fusion flag counter is greater than or equal to N (e.g., where N equals a number of successive wind flags), the smoothed wind flag is set to be equal to the fusion wind flag (step 516).
- N e.g., where N equals a number of successive wind flags
- wind detection can be implemented in various devices with two or more microphones, such as cell phone, PDA, smart speakers, smart watches, headphones, and hearing aids.
- There are many frequency domain transformation algorithms for the microphone signals such as Fourier transform, and Wavelet transform.
- the present disclosure is not limited to one specific algorithm.
- the proposed wind detector can be extended to multiple microphone case.
- the wind detector module can output the feature values of f, s, b, and g instead of the detector wind flags.
- the wind detector module can smooth the features f. s. b. and g to obtain long term feature estimates before threshold comparison.
- the features can be smoothed by FIR filters and HR filters.
- the fusion-smoothing module can employ other common machine learning algorithms to fuse the wind detector module results, such as logistic regression, naive Bayesian, and neural networks.
- the fusion-smoothing module can employ other common filtering algorithms to perform result smoothing, such as median filter, FIR filtering, and HR filtering.
- An audio device 600 includes an audio input, such as an audio sensor array 605, an audio signal processor 620 and host system components 650.
- the audio sensor array 605 comprises one or more sensors, each of which may convert sound waves into an audio signal.
- the audio sensor array 605 includes a plurality of microphones 605a-605n, each generating one audio channel of a multi channel audio signal.
- the audio signal processor 620 includes audio input circuitry 622, a digital signal processor 624 and optional audio output circuitry 626.
- the audio signal processor 620 may be implemented as an integrated circuit comprising analog circuitry, digital circuitry and the digital signal processor 624, which is operable to execute program instructions stored in memory.
- the audio input circuitry 622 may include an interface to the audio sensor array 605, anti-aliasing filters, analog-to-digital converter circuitry, echo cancellation circuitry, and other audio processing circuitry and components.
- the digital signal processor 624 may comprise one or more of a processor, a microprocessor, a single-core processor, a multi-core processor, a microcontroller, a programmable logic device (PLD) (e.g., field programmable gate array (FPGA)), a digital signal processing (DSP) device, or other logic device that may be configured, by hardwiring, executing software instructions, or a combination of both, to perform various operations discussed herein for embodiments of the disclosure.
- PLD programmable logic device
- FPGA field programmable gate array
- DSP digital signal processing
- the digital signal processor 624 is operable to process the multichannel digital audio input signal to generate an enhanced audio signal, which is output to one or more host system components 650.
- the digital signal processor 624 is operable to interface and communicate with the host system components 650, such as through a bus or other electronic communications interface.
- the multichannel audio signal includes a mixture of noise signals and at least one desired target audio signal (e.g., human speech), and the digital signal processor 624 is operable to isolate or enhance the desired target signal, while reducing or cancelling the undesired noise signals.
- the digital signal processor 624 may be operable to perform wind noise detection, speech/keyword detection and processing, echo cancellation, noise cancellation, target signal tracking and enhancement, post-filtering, and other audio signal processing.
- the digital signal processor 624 includes a wind detector 628 (e.g., wind detector module 110 of FIG. 1) and a fusion-smoothing component 630 (e.g., fusion-smoothing module 140 of FIG. 1) operable to determine whether wind noise is present in a current audio sample.
- the audio signal processor 620 may be configured to produce an enhanced target signal for further processing by the host system components (e.g., voice input for voice communications, voice command processing, etc.).
- the digital signal processor 624 may use the indication of the presence or absence of wind noise in a noise suppression process to aid in the removal of the detected wind noise.
- the audio signal processor 620 may be configured for active noise cancellation, and the indication of the presence or absence of wind noise may be used by the digital signal processor 624 to aid in the generation of an anti-noise signal.
- the digital signal processor 624 may further include other modules that utilize the final wind detection flag, such as a noise suppression/cancellation module 632.
- the noise suppression/cancellation module 632 may provide noise suppression of wind noise in the input audio signals and/or generate an anti-noise for active noise cancellation in windy conditions.
- the audio output circuitry 626 processes audio signals received from the digital signal processor 624 for output to at least one speaker, such as speakers 610a and 610b.
- the audio output circuitry 626 may include a digital-to-analog converter that converts one or more digital audio signals to corresponding analog signals and one or more amplifiers for driving the speakers 610a and 610b.
- the audio device 600 may be implemented as any device operable to receive and detect target audio data, such as, for example, a mobile phone, smart speaker, tablet, laptop computer, desktop computer, voice-controlled appliance, or automobile.
- the host system components 650 may comprise various hardware and software components for operating the audio device 600.
- the host system components 650 include a processor 652, user interface components 654, a communications interface 656 for communicating with external devices and networks, such as network 680 (e.g., the Internet, the cloud, a local area network, or a cellular network) and mobile device 684, and a memory 658.
- the processor 652 may comprise one or more of a processor, a microprocessor, a single-core processor, a multi-core processor, a microcontroller, a programmable logic device (PLD) (e.g., field programmable gate array (FPGA)), a digital signal processing (DSP) device, or other logic device that may be configured, by hardwiring, executing software instructions, or a combination of both, to perform various operations discussed herein for embodiments of the disclosure.
- PLD programmable logic device
- FPGA field programmable gate array
- DSP digital signal processing
- the host system components 650 are operable to interface and communicate with the audio signal processor 620 and the other host system components 650, such as through a bus or other electronic communications interface.
- the audio signal processor 620 and the host system components 650 are shown as incorporating a combination of hardware components, circuitry and software, in some embodiments, at least some or all of the functionalities that the hardware components and circuitries are operable to perform may be implemented as software modules being executed by the processor 652 and/or digital signal processor 624 in response to software instructions and/or configuration data, stored in the memory 658 or firmware of the digital signal processor 624.
- the memory 658 may be implemented as one or more memory devices operable to store data and information, including audio data and program instructions.
- Memory 658 may comprise one or more various types of memory devices including volatile and non-volatile memory devices, such as RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically-Erasable Read-Only Memory), flash memory, hard disk drive, and/or other types of memory.
- the processor 652 may be operable to execute software instructions stored in the memory 658.
- a speech recognition engine 660 is operable to process the enhanced audio signal received from the audio signal processor 620, including identifying and executing voice commands.
- Voice communications components 662 may be operable to facilitate voice communications with one or more external devices such as a mobile device 684 or user device 686, such as through a voice call over a mobile or cellular telephone network or a VoIP call over an IP (internet protocol) network.
- voice communications include transmission of the enhanced audio signal to an external communications device.
- the user interface components 654 may include a display, a touchpad display, a keypad, one or more buttons and/or other input/output components operable to enable a user to directly interact with the audio device 600.
- the communications interface 656 facilitates communication between the audio device 600 and external devices.
- the communications interface 656 may enable Wi-Fi (e.g., 802.11) or Bluetooth connections between the audio device 600 and one or more local devices, such as mobile device 684, or a wireless router providing network access to a remote server 682, such as through the network 680.
- the communications interface 656 may include other wired and wireless communications components facilitating direct or indirect communications between the audio device 600 and one or more other devices.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- General Health & Medical Sciences (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
Claims
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202080032497.9A CN113711308B (en) | 2019-04-30 | 2020-04-28 | Wind noise detection system and method |
| KR1020217038257A KR102942910B1 (en) | 2019-04-30 | 2020-04-28 | Wind noise detection systems and methods |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/399,961 US10721562B1 (en) | 2019-04-30 | 2019-04-30 | Wind noise detection systems and methods |
| US16/399,961 | 2019-04-30 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020223261A1 true WO2020223261A1 (en) | 2020-11-05 |
Family
ID=71611939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2020/030312 Ceased WO2020223261A1 (en) | 2019-04-30 | 2020-04-28 | Wind noise detection systems and methods |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US10721562B1 (en) |
| KR (1) | KR102942910B1 (en) |
| CN (1) | CN113711308B (en) |
| WO (1) | WO2020223261A1 (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11304001B2 (en) * | 2019-06-13 | 2022-04-12 | Apple Inc. | Speaker emulation of a microphone for wind detection |
| CN113286214B (en) * | 2020-02-20 | 2022-09-27 | 小鸟创新(北京)科技有限公司 | Earphone signal processing method and device and earphone |
| US11468875B2 (en) | 2020-12-15 | 2022-10-11 | Google Llc | Ambient detector for dual mode ANC |
| WO2022140103A1 (en) * | 2020-12-22 | 2022-06-30 | Dolby Laboratories Licensing Corporation | Perceptual enhancement for binaural audio recording |
| KR20220130446A (en) * | 2021-03-18 | 2022-09-27 | 삼성전자주식회사 | Electronic device for listening to external sound and operating method of the electronic device |
| EP4061019A1 (en) | 2021-03-18 | 2022-09-21 | Bang & Olufsen A/S | A headset capable of compensating for wind noise |
| US12126957B1 (en) | 2021-06-29 | 2024-10-22 | Amazon Technologies, Inc. | Detecting wind events in audio data |
| US12347413B1 (en) * | 2021-06-29 | 2025-07-01 | Amazon Technologies, Inc. | Mitigating effects of wind in audio data |
| US11682411B2 (en) | 2021-08-31 | 2023-06-20 | Spotify Ab | Wind noise suppresor |
| CN116095565B (en) * | 2022-09-05 | 2025-12-05 | 维沃移动通信有限公司 | Audio signal processing methods, apparatus, electronic devices and readable storage media |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100020986A1 (en) * | 2008-07-25 | 2010-01-28 | Broadcom Corporation | Single-microphone wind noise suppression |
| KR101118217B1 (en) * | 2005-04-19 | 2012-03-16 | 삼성전자주식회사 | Audio data processing apparatus and method therefor |
| US20120121100A1 (en) * | 2010-11-12 | 2012-05-17 | Broadcom Corporation | Method and Apparatus For Wind Noise Detection and Suppression Using Multiple Microphones |
| US20160155453A1 (en) * | 2013-07-12 | 2016-06-02 | Wolfson Dynamic Hearing Pty Ltd. | Wind noise reduction |
| US20170251299A1 (en) * | 2014-05-29 | 2017-08-31 | Cirrus Logic International Semiconductor Ltd. | Microphone mixing for wind noise reduction |
Family Cites Families (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7082204B2 (en) * | 2002-07-15 | 2006-07-25 | Sony Ericsson Mobile Communications Ab | Electronic devices, methods of operating the same, and computer program products for detecting noise in a signal based on a combination of spatial correlation and time correlation |
| US7340068B2 (en) * | 2003-02-19 | 2008-03-04 | Oticon A/S | Device and method for detecting wind noise |
| US7895036B2 (en) * | 2003-02-21 | 2011-02-22 | Qnx Software Systems Co. | System for suppressing wind noise |
| US8509857B2 (en) * | 2006-10-06 | 2013-08-13 | Freescale Semiconductor, Inc. | Headsets |
| US8488803B2 (en) * | 2007-05-25 | 2013-07-16 | Aliphcom | Wind suppression/replacement component for use with electronic systems |
| US8184816B2 (en) * | 2008-03-18 | 2012-05-22 | Qualcomm Incorporated | Systems and methods for detecting wind noise using multiple audio sources |
| US8433564B2 (en) * | 2009-07-02 | 2013-04-30 | Alon Konchitsky | Method for wind noise reduction |
| CA2768142C (en) * | 2009-07-15 | 2015-12-15 | Widex A/S | A method and processing unit for adaptive wind noise suppression in a hearing aid system and a hearing aid system |
| US20120163622A1 (en) * | 2010-12-28 | 2012-06-28 | Stmicroelectronics Asia Pacific Pte Ltd | Noise detection and reduction in audio devices |
| US20150058002A1 (en) * | 2012-05-03 | 2015-02-26 | Telefonaktiebolaget L M Ericsson (Publ) | Detecting Wind Noise In An Audio Signal |
| US9385780B2 (en) * | 2012-10-15 | 2016-07-05 | Ikanos Communications, Inc. | Method and apparatus for detecting and analyzing noise and other events affecting a communication system |
| CN104751853B (en) * | 2013-12-31 | 2019-01-04 | 辰芯科技有限公司 | Dual microphone noise suppressing method and system |
| EP3172906B1 (en) * | 2014-07-21 | 2019-04-03 | Cirrus Logic International Semiconductor Limited | Method and apparatus for wind noise detection |
| EP2996352B1 (en) * | 2014-09-15 | 2019-04-17 | Nxp B.V. | Audio system and method using a loudspeaker output signal for wind noise reduction |
| EP3264798A1 (en) * | 2016-06-27 | 2018-01-03 | Oticon A/s | Control of a hearing device |
| TWI823334B (en) * | 2016-10-24 | 2023-11-21 | 美商艾孚諾亞公司 | Automatic noise cancellation using multiple microphones |
| KR20180108155A (en) * | 2017-03-24 | 2018-10-04 | 삼성전자주식회사 | Method and electronic device for outputting signal with adjusted wind sound |
| US10366710B2 (en) * | 2017-06-09 | 2019-07-30 | Nxp B.V. | Acoustic meaningful signal detection in wind noise |
| US10582293B2 (en) * | 2017-08-31 | 2020-03-03 | Bose Corporation | Wind noise mitigation in active noise cancelling headphone system and method |
| US10504537B2 (en) * | 2018-02-02 | 2019-12-10 | Cirrus Logic, Inc. | Wind noise measurement |
| US11069365B2 (en) * | 2018-03-30 | 2021-07-20 | Intel Corporation | Detection and reduction of wind noise in computing environments |
-
2019
- 2019-04-30 US US16/399,961 patent/US10721562B1/en active Active
-
2020
- 2020-04-28 WO PCT/US2020/030312 patent/WO2020223261A1/en not_active Ceased
- 2020-04-28 CN CN202080032497.9A patent/CN113711308B/en active Active
- 2020-04-28 KR KR1020217038257A patent/KR102942910B1/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101118217B1 (en) * | 2005-04-19 | 2012-03-16 | 삼성전자주식회사 | Audio data processing apparatus and method therefor |
| US20100020986A1 (en) * | 2008-07-25 | 2010-01-28 | Broadcom Corporation | Single-microphone wind noise suppression |
| US20120121100A1 (en) * | 2010-11-12 | 2012-05-17 | Broadcom Corporation | Method and Apparatus For Wind Noise Detection and Suppression Using Multiple Microphones |
| US20160155453A1 (en) * | 2013-07-12 | 2016-06-02 | Wolfson Dynamic Hearing Pty Ltd. | Wind noise reduction |
| US20170251299A1 (en) * | 2014-05-29 | 2017-08-31 | Cirrus Logic International Semiconductor Ltd. | Microphone mixing for wind noise reduction |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113711308A (en) | 2021-11-26 |
| US10721562B1 (en) | 2020-07-21 |
| KR20210149858A (en) | 2021-12-09 |
| CN113711308B (en) | 2025-07-22 |
| KR102942910B1 (en) | 2026-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10721562B1 (en) | Wind noise detection systems and methods | |
| US10535362B2 (en) | Speech enhancement for an electronic device | |
| EP2863392B1 (en) | Noise reduction in multi-microphone systems | |
| US7983907B2 (en) | Headset for separation of speech signals in a noisy environment | |
| US12591407B2 (en) | Robust voice activity detector system for use with an earphone | |
| US20070021958A1 (en) | Robust separation of speech signals in a noisy environment | |
| EP4118648B1 (en) | Audio processing using distributed machine learning model | |
| US20100046770A1 (en) | Systems, methods, and apparatus for detection of uncorrelated component | |
| EP3642836A1 (en) | Audio device with wakeup word detection | |
| JP2010513987A (en) | Near-field vector signal amplification | |
| JP2014085673A (en) | Method for intelligently controlling volume of electronic equipment, and mounting equipment | |
| US20140341386A1 (en) | Noise reduction | |
| CN113132885B (en) | Method for judging wearing state of earphone based on energy difference of double microphones | |
| US20090285422A1 (en) | Method for operating a hearing device and hearing device | |
| CN111757211A (en) | Noise reduction method, terminal device and storage medium | |
| JPH04212600A (en) | Voice input device | |
| US11694708B2 (en) | Audio device and method of audio processing with improved talker discrimination | |
| US12520078B2 (en) | Wearable audio devices with enhanced voice pickup | |
| US20250088793A1 (en) | Wearable audio devices with enhanced voice pickup |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20799260 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 20217038257 Country of ref document: KR Kind code of ref document: A |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20799260 Country of ref document: EP Kind code of ref document: A1 |
|
| WWG | Wipo information: grant in national office |
Ref document number: 202080032497.9 Country of ref document: CN |
