US20130304463A1 - Noise cancellation method - Google Patents
Noise cancellation method Download PDFInfo
- Publication number
- US20130304463A1 US20130304463A1 US13/471,085 US201213471085A US2013304463A1 US 20130304463 A1 US20130304463 A1 US 20130304463A1 US 201213471085 A US201213471085 A US 201213471085A US 2013304463 A1 US2013304463 A1 US 2013304463A1
- Authority
- US
- United States
- Prior art keywords
- spectrum
- noise
- signal
- audio signal
- energy
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000001228 spectrum Methods 0.000 claims abstract description 287
- 230000005236 sound signal Effects 0.000 claims abstract description 75
- 238000001914 filtration Methods 0.000 claims abstract description 9
- 230000001629 suppression Effects 0.000 claims description 42
- 238000010586 diagram Methods 0.000 description 12
- 101100134058 Caenorhabditis elegans nth-1 gene Proteins 0.000 description 6
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0232—Processing in the frequency domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2410/00—Microphones
- H04R2410/07—Mechanical or electrical reduction of wind noise generated by wind passing a microphone
Definitions
- the present invention relates to a noise cancellation method, and more particularly to a noise cancellation method for a portable device.
- Portable devices such as a smart phone, tablet or personal digital assist (PDA) have become necessaries for consumers, personally or for business. More and more users use a portable device to shot a video or record a voice mail.
- the general portable device does not support noise cancellation for voice received by the microphone of the portable device, and wind noise may decrease the quality of the recorded voice no matter where the user is at, indoors or outdoors.
- wind noise may decrease the quality of the recorded voice no matter where the user is at, indoors or outdoors.
- the microphone When a user is outdoors, the microphone is easily affected by the wind noise.
- the microphone is easily affected by reflected voice signal.
- the noise suppression methods for the wind noise and the reflected voice signal are different and are not easily integrated in the portable device.
- An embodiment of the invention provides a noise cancellation method for an electronic device.
- the method comprises: receiving an audio signal; applying a Fast Fourier Transform operation on the audio signal to generate a sound spectrum; acquiring a first spectrum corresponding to a noise and a second spectrum corresponding to a human voice signal from the sound spectrum; estimating a center frequency according to the first spectrum and the second spectrum; and applying a high pass filtering operation to the sound spectrum according to the center frequency.
- Another embodiment of the invention provides a noise cancellation method for an electronic device.
- the method comprises the steps of: receiving an audio signal; applying a Fast Fourier Transform operation on the audio signal to generate a sound spectrum; determining whether the electronic device is outdoors according to the sound spectrum; and executing the following steps when the electronic device is outdoors: acquiring a first spectrum corresponding to a noise and a second spectrum corresponding to a human voice signal from the sound spectrum; estimating a center frequency according to the first spectrum and the second spectrum; and applying a high pass filtering operation to the sound spectrum according to the center frequency.
- FIG. 1 is a schematic diagram of a noise cancellation method for a microphone according to an embodiment of the invention.
- FIG. 2 is a flowchart of the operation method of the noise suppression device in FIG. 1 according to an embodiment of the invention.
- FIG. 3 is a schematic diagram of a portable device with a noise suppression function according to an embodiment of the invention.
- FIG. 4 is a schematic diagram of a portable device with a noise suppression function according to another embodiment of the invention.
- FIG. 5 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention.
- FIG. 6 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention.
- FIG. 7 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention.
- FIG. 8 is a schematic diagram of another embodiment of a portable device with a noise suppression function according to the invention.
- FIG. 9 is a schematic diagram of an embodiment of a noise cancellation device according to the invention.
- FIG. 10 is a schematic diagram of another embodiment of a noise cancellation device according to the invention.
- FIG. 11 is a flowchart of a noise cancellation method according to another embodiment of the invention.
- FIG. 1 is a schematic diagram of a noise cancellation method for a microphone according to an embodiment of the invention.
- the embodiment of FIG. 1 is illustrated with an outdoor situation.
- the microphone 11 receives an audio signal SS of a user
- the microphone may also receive a wind noise signal SN, wherein the signal received by the microphone can be expressed as (SS+SN).
- a noise suppression device 12 executes a noise suppression operation on the signal (SS+SN) to cancel or suppress noise and then, an audio signal SS′ is generated.
- the audio signal SS′ may still contain noise and is different from the audio signal SS.
- the noise suppression device can be implemented by hardware or by a processor or controller executing a program.
- FIG. 2 is a flowchart of the operation method of the noise suppression device in FIG. 1 according to an embodiment of the invention.
- a microphone receives a first audio signal containing a speech signal of a user and wind noise.
- a Fast Fourier Transform device applies a Fast Fourier Transform (FFT) operation on the first audio signal to generate a first spectrum.
- FFT Fast Fourier Transform
- the frequency of wind noise ranges from 0 to 100 Hz
- the frequency of human speech signals range from 300 Hz to 4K Hz.
- a first frequency range corresponding to the wind noise and a second frequency range corresponding to the speech signal are set to acquire a noise spectrum corresponding to the first frequency range and a human speech spectrum corresponding to the second frequency range.
- the noise suppression device may determine whether a user is outdoors.
- the step can be implemented by user settings or the noise suppression device may determine that according to the spectrums acquired in step S 22 .
- the noise suppression device may determine whether a user is outdoors according to energy of the noise spectrum. If the energy is larger than a predetermined value, the user is determined to be outdoors and the noise cancellation or suppression operation will be executed. If the energy is less than the predetermined value, the noise cancellation or suppression operation will not be executed.
- the noise suppression device estimates a center frequency fc according to a first energy of the noise spectrum and a second energy of a human speech spectrum. Then, a center frequency of a frequency domain high pass filter is adjusted according to the estimated center frequency. The first spectrum is then filtered by the frequency domain high pass filter to filter out the wind noise at a low frequency and a second spectrum is therefore generated. Then, in the step S 25 , the noise suppression device processes the second spectrum to enhance the human speech spectrum and suppress the noise spectrum according to the human speech spectrum and the noise spectrum, and a third spectrum is generated accordingly. An Inverse Fast Fourier Transform (IFFT) operation is then applied to the third spectrum to generate a filtered audio signal. The filtered audio signal is then stored or played by a speaker.
- IFFT Inverse Fast Fourier Transform
- the estimated center frequency fc that is generated according to the first energy of the noise spectrum and the second energy of a human speech spectrum is used for a high pass filter operation applied on the first spectrum, but the invention is not limited thereto.
- a center frequency of a time domain high pass filter that filters the first audio signal received by the microphone can be adjusted to the center frequency fc, and the time domain high pass filter filters out wind noise at low frequency from the first audio signal.
- an FFT operation is applied on the filtered first audio signal to generate a fourth spectrum.
- the noise suppression device repeats processing of the fourth spectrum to enhance the human speech spectrum and suppress the noise spectrum according to the human speech spectrum and the noise spectrum, and a fifth spectrum is generated accordingly.
- a new noise spectrum and a new human speech spectrum are generated according to the fourth spectrum, and the noise suppression device processes the fourth spectrum according to the new noise spectrum and the new human speech spectrum to enhance the human speech spectrum.
- an IFFT operation is applied to the fourth spectrum to generate a filtered audio signal.
- FIG. 3 is a schematic diagram of a portable device with a noise suppression function according to an embodiment of the invention.
- the microphone 31 of the portable device receives a speech signal and wind noise to generate a first audio signal.
- the microphone 31 may be made by a single microphone or a microphone array.
- the Fast Fourier Transform (FFT) device 32 applies an FFT operation to the first audio signal to generate a first spectrum and the first spectrum is transmitted to a processor 33 , a high pass filter (HPF) 34 and an IFFT device 35 .
- the frequency of wind noise ranges from 0 to 100 Hz
- the frequency of human speech signals range from 300 Hz to 4K Hz.
- the processor 33 When the processor 33 receives the first spectrum, the processor 33 first acquires a noise spectrum corresponding to a first frequency range corresponding to the wind noise and determines whether the energy of the noise spectrum is larger than a predetermined value. If yes, the processor 33 transmits an enable signal to the HPF 34 to apply a high pass filter operation on the first spectrum. The processor 33 also transmits a select signal to the IFFT device 35 and the IFFT device 35 applies an inverse Fast Fourier Transform operation on the output of the HPF 34 , not the first spectrum output by the FFT device 32 .
- a multiplexer can be applied and coupled to the input of the IFFT device 35 , and the multiplexer directs the output signal of HPF 34 or the first spectrum output by the FFT device 32 to the IFFT device 35 according to a select signal output by the processor 33 .
- the processor 33 does not transmit the enable signal to the HPF 34 and transmits the select signal to the IFFT device 35 and the IFFT device 35 applies an inverse Fast Fourier Transform operation on the first spectrum output by the FFT device 32 .
- the processor 33 receives a control signal indicating that the user wants to apply a noise cancellation operation or noise suppress operation, the processor 33 transmits the enable signal to the HPF 34 to apply a high pass filter operation on the first spectrum.
- the processor 33 also transmits a select signal to the IFFT device 35 and the IFFT device 35 applies an inverse Fast Fourier Transform operation on the output of the HPF 34 , not the first spectrum output by the FFT device 32 .
- the processor 33 can pass or ignore the step of determining whether the energy of the noise spectrum is larger than a predetermined value.
- the processor 33 After the processor 33 receives the first spectrum, the processor 33 first acquires a noise spectrum corresponding to a first frequency range and a human speech spectrum corresponding to a second frequency range.
- the processor 33 estimates a center frequency fc according to a first energy of the noise spectrum and a second energy of a human speech spectrum.
- the HPF device 34 applies a high pass filter operation on the first spectrum to filter out the low frequency wind noise, and a second spectrum is then generated.
- the second spectrum is transmitted to the IFFT device 35 and the IFFT device 35 executes an IFFT operation to transform the second spectrum into a second audio signal.
- the first frequency range ranges from 0 to 100 Hz
- the second frequency range ranges from 300 Hz to 4K Hz, but are not limited thereto.
- the processor 33 can set different frequency ranges according to the type of noise and the processor 33 first determines the type of noise according to the first spectrum and then when the type of noise is determined, the processor 33 determines the center frequency of the HPF device 34 accordingly. In other words, the invention not only cancels or suppresses the wind noise, but also noise at any frequency range.
- FIG. 4 is a schematic diagram of a portable device with a noise suppression function according to another embodiment of the invention.
- the microphone 41 of the portable device receives a speech signal and wind noise to generate a first audio signal.
- the microphone 41 may be made by a single microphone or a microphone array.
- the first Fast Fourier Transform (FFT) device 42 applies an FFT operation to the first audio signal to generate a first spectrum and the first spectrum is transmitted to a processor 43 and a high pass filter (HPF) 44 .
- the frequency of wind noise ranges from 0 to 100 Hz
- the frequency of human speech signals range from 300 Hz to 4K Hz.
- the processor 43 When the processor 43 receives the first spectrum, the processor 43 first acquires a noise spectrum N corresponding to a first frequency range corresponding to the wind noise and determines whether the energy of the noise spectrum PN is larger than a predetermined value PTH. If yes, the processor 43 transmits an enable signal EN 1 to the HPF 44 to apply a high pass filter operation on the first spectrum. The processor 43 also transmits a first enable signal EN 1 to the HPF 45 to execute an HPF operation. In the embodiment, the processor 43 can also transmit a second enable signal (EN 2 ) to the HPF device 46 and the HPF 46 executes an HPF operation on the first audio signal to generate a first filtered audio signal.
- EN 2 second enable signal
- the processor 43 can select only one of the frequency domain HPF 44 and time domain HPF 46 to execute the filter operation, or both the frequency domain HPF 44 and time domain HPF 46 execute the filter operation. If both the frequency domain HPF 44 and time domain HPF 46 work simultaneously, the processor 43 transmits a select signal SEL to the enhancement device 48 and the enhancement device 48 processes the output signal from the frequency domain HPF 44 or a second FFT device 47 according to the select signal SEL. In other words, a multiplexer can be applied for directing the output signal from the frequency domain HPF 44 or the output signal from the second FFT device 47 to the enhancement device 48 according to the select signal SEL.
- the enhancement device 48 can be implemented by hardware or software to enhance the human voice signal of the received signal and suppress the wind noise of the received signal.
- the processor 43 When the processor 43 receives the first spectrum, the processor 43 acquires a noise spectrum N corresponding to a first frequency range corresponding to the noise and a human speech spectrum corresponding to the second frequency range corresponding to the human speech signal.
- the processor 43 calculates a ratio (PN/PS) according to a first energy of the noise spectrum and the second energy of the human speech spectrum to estimate a center frequency fc.
- the controlled 43 then adjusts the center frequency of both the frequency domain HPF 44 and time domain HPF 46 to be fc.
- the center frequency of frequency domain HPF 44 is set, the first spectrum is filtered by the frequency domain HPF 44 , the wind noise at low frequency is filtered out from the first spectrum, and a second spectrum is generated accordingly.
- the first audio signal is filtered by the time domain HPF 46 the wind noise at low frequency is filtered out from the first spectrum, and a second audio signal is generated accordingly.
- the second audio signal is transmitted to the second FFT device 47 to generate a third spectrum.
- the processor 43 transmits the noise spectrum N and the human speech spectrum S to the enhancement device 48 .
- the enhancement device 48 receives the second spectrum or the third spectrum according to a select signal SEL, and enhances the human speech of the received spectrum and suppresses the noise of the received spectrum.
- the second spectrum can be represented as (S2+N2).
- the enhancement device 48 outputs a fourth spectrum to the IFFT device 45 and an IFFT operation is applied to the fourth spectrum to generate a third audio signal.
- the processor 43 can set different frequency ranges according to the type of noise and the processor 43 first determines the type of noise according to the first spectrum and then when the type of noise is determined, the processor 43 determines the center frequency of the frequency domain HPF 44 and the time domain HPF 46 accordingly. In other words, the invention not only cancels or suppresses the wind noise, but also the noise at any frequency range.
- the enhancement device 48 can also be applied to the embodiment in FIG. 3 for better signal quality.
- the generation of the center frequency and how the processor 43 detects noises are explained in the following.
- the signal received by the microphone 41 is first sampled by an analog to digital converter with 48K Hz sampling rate to generate a digital signal.
- the digital signal is transmitted to a 256 points Fast Fourier Transform device to generate a corresponding spectrum. Energy of a first band of the spectrum and energy of a second band of the spectrum are used to determine whether the noise exists.
- the frequency of wind noise can be acquired by the following equation:
- the processor 43 determines the center frequency fc according to a signal to noise (SNR) ratio of the noise and the human speech signal.
- SNR signal to noise
- the frequency of the center frequency fc estimated by the SNR ranges from 100 Hz to 1000 Hz.
- FIG. 5 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention.
- the embodiment in FIG. 5 is illustrated with an indoor situation.
- the noise indoors is usually generated by the echo signal.
- an audio signal received at a previous time point is applied to suppress the noise of an audio signal received at a next time point.
- a microphone receives a first audio signal containing a speech signal of a user and an echo.
- a Fast Fourier Transform device applies a Fast Fourier Transform (FFT) operation on the first audio signal to generate a first spectrum.
- FFT Fast Fourier Transform
- a processor or a controller determines whether the echo noise exists according to the energy of the first spectrum.
- step S 55 is executed. If the echo noise does not exist, the step S 54 is executed. In the step S 54 , an echo spectrum is estimated according to the spectrum generated according to a previous audio signal. Then, a noise suppression operation is applied to the first spectrum according to the echo noise spectrum to generate a second spectrum. The second spectrum is transformed into a third audio signal by an Inverse Fast Fourier Transform operation in step S 55 .
- FIG. 6 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention.
- the embodiment in FIG. 6 is illustrated with an indoor situation.
- a microphone receives a first audio signal x(t) containing a speech signal of a user and an echo.
- a Fast Fourier Transform device applies a Fast Fourier Transform (FFT) operation on the first audio signal x(t) to generate a first spectrum x(k).
- FFT Fast Fourier Transform
- a processor or a controller determines whether the echo noise exists according to the energy of the first spectrum. If the echo noise does not exist, the step S 65 is executed. If the echo noise exists, the step S 64 is executed.
- the first spectrum x(k) is multiplied by a gain function to suppress the echo noise.
- the gain function g(k) can be generated or set by a user or a processor of a portable device.
- the spectrum Y(k) generated in step S 64 is shown as following:
- the gain value of the gain function g(k) ranges from 0.1 to 1.
- the gain function g(k) comprises 256 gain values to adjust the energy of each point of the first spectrum.
- an echo spectrum n(k) is also estimated according to the first audio signal or the first spectrum.
- the echo noise spectrum n(k) is represented by the equation:
- n ( k ) (1 ⁇ g ( k ))* u ( k )
- a second spectrum is generated by subtracting n(k) from Y(k).
- the second spectrum is transformed into a third audio signal x′′(t) by an Inverse Fast Fourier Transform operation.
- FIG. 7 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention.
- a first audio signal containing a speech signal of a user and a noise is received by a microphone.
- an FFT device applies an FFT operation to the first audio signal to generate a first spectrum.
- a processor or a controller determines whether a user is outdoors.
- the frequency of wind noise ranges from 0 to 100 Hz
- the frequency of human speech signals range from 300 Hz to 4K Hz.
- the user or designer sets a first frequency range corresponding to the wind noise and a second frequency range corresponding to the speech signal and acquires a noise spectrum corresponding to the first frequency range and a human speech spectrum corresponding to the second frequency range by an application program.
- a first determination device may determine whether a user is outdoors according to the energy of the noise spectrum. If the user is determined not to be outdoors, the step S 704 is executed. If the user is determined to be outdoors, the step S 706 is executed
- the energy of the noise spectrum Nr is compared with a first predetermined value Nth 1 . If the energy of the noise spectrum Nr is larger than the first predetermined value Nth 1 , the step S 711 is executed to cancel the noise. If the energy of the noise spectrum Nr is smaller than the first predetermined value Nth 1 , the step 707 is executed.
- the noise suppression function is determined to be forcedly executed or not according to user settings. For example, when the user uses a portable device to execute a video recording program or a voice recording program, an operational menu is jumped and shown on the display of the portable device for the user to determine whether the noise cancellation or suppression operation should be executed.
- step S 707 If the answer of step S 707 is yes, wherein the noise cancellation operation or suppression operation has to be executed, step S 711 is then executed. If the answer of step S 707 is no, wherein the noise cancellation operation or suppression operation does not have be executed, step S 715 is then executed. In step S 715 , an IFFT operation is applied to the first spectrum to generate a second audio signal.
- step S 711 a signal to noise (SNR) ratio is estimated according to the energy of the noise spectrum and the energy of the human speech spectrum.
- step S 712 a center frequency fc is estimated according to the SNR ratio.
- a center frequency of a frequency domain high pass filter is adjusted according to the center frequency fc, the first spectrum is filtered by the frequency domain high pass filter to filter out the wind noise at low frequency in step S 713 , and a second spectrum is therefore generated.
- step S 714 a noise suppression operation is applied to the second spectrum again according to the noise spectrum and the human speech spectrum to enhance the human speech of the second spectrum and suppress the wind noise of the second spectrum.
- a third spectrum is generated accordingly.
- step S 714 the third spectrum is processed by the IFFT operation to generate a filtered audio signal.
- a second determination device may determine whether the user is indoors according to the first spectrum. In one embodiment, the second determination device may determine whether the echo noise exists according to two successive spectrums. If the result of step S 704 is no, step S 705 is executed. If the result of step S 704 is yes, step S 708 is executed. In step S 708 , an indoor noise, such as an echo, is estimated according to the first spectrum, and the energy of the indoor noise Nr is compared with a second predetermined value Nth 2 . If the energy of the indoor noise Nr is larger than the second predetermined value Nth 2 , the step S 716 is executed to suppress the noise. For the operation of the step S 716 , reference can be made to the description of FIG. 6 .
- step S 09 is executed.
- the noise suppression function is determined to be forcedly executed or not according to user settings. For example, when the user uses a portable device to execute a video recording program or a voice recording program, an operational menu is jumped and shown on the display of the portable device for the user to determine whether the noise cancellation or suppression operation should be executed. If the answer of step S 709 is yes, step S 716 is then executed. If the answer of step S 709 is no, step S 715 is then executed. In step S 715 , the first spectrum is processed by the IFFT operation to generate a second audio signal.
- FIG. 8 is a schematic diagram of another embodiment of a portable device with a noise suppression function according to the invention.
- the microphone 81 of the portable device receives a speech signal and wind noise to generate a first audio signal.
- the microphone 81 may be made by a single microphone or a microphone array.
- the Fast Fourier Transform (FFT) device 82 applies an FFT operation to the first audio signal to generate a first spectrum and the first spectrum is transmitted to a processor 83 , a high pass filter (HPF) 84 and an Inverse Fast Fourier Transform (IFFT) device 85 .
- the frequency of wind noise ranges from 0 to 100 Hz
- the frequency of human speech signals range from 300 Hz to 4K Hz.
- the processor 83 When the processor 83 receives the first spectrum, the processor 83 first acquires a noise spectrum corresponding to a first frequency range corresponding to the wind noise and determines whether the energy of the noise spectrum is larger than a predetermined value. If yes, the processor 83 transmits an enable signal to the HPF 84 to apply a high pass filter operation on the first spectrum. The processor 83 also transmits a select signal to the IFFT device 85 and the IFFT device 85 applies an inverse Fast Fourier Transform operation on the output signal of the HPF 84 , not the first spectrum output by the FFT device 82 or a third spectrum output by the enhancement device 86 . In other words, a multiplexer can be applied and coupled to the input of the IFFT device 85 . The multiplexer directs the output signal of HPF 84 , the first spectrum output by the FFT device 82 or the third spectrum output by the enhancement device 86 to the IFFT device 85 for further processing according to a select signal output by the processor 83 .
- the processor 83 does not transmit the enable signal to the HPF 84 and transmits the select signal to the IFFT device 85 .
- the IFFT device 85 applies an inverse Fast Fourier Transform operation on the first spectrum output by the FFT device 82 according to the select signal.
- the processor 83 receives a control signal indicating that the user wants to apply a noise cancellation operation or noise suppress operation on the audio signal received by the microphone 81 , the processor 83 directly transmits the enable signal to the HPF 84 to apply a high pass filter operation on the first spectrum.
- the processor 83 also transmits a select signal to the IFFT device 85 and the IFFT device 85 applies an inverse Fast Fourier Transform operation on the output signal of the HPF 84 , not the first spectrum output by the FFT device 82 .
- the processor 83 can pass or ignore the step of determining whether the energy of the noise spectrum is larger than a predetermined value.
- the processor 83 After the processor 83 receives the first spectrum, the processor 83 first acquires a noise spectrum corresponding to a first frequency range and a human speech spectrum corresponding to a second frequency range. The processor 83 estimates a center frequency fc according to a first energy of the noise spectrum and a second energy of a human speech spectrum. After the center frequency of the HPF device 84 is adjusted to the center frequency fc, the HPF device 84 applies a high pass filter operation on the first spectrum to filter out the low frequency wind noise, and a second spectrum is then generated. The second spectrum is transmitted to the IFFT device 85 and the IFFT device 85 executes an IFFT operation to transform the second spectrum into a second audio signal.
- the first frequency range ranges from 0 to 100 Hz
- the second frequency range ranges from 300 Hz to 4K Hz, but are not limited thereto.
- the processor 83 can set different frequency ranges according to the type of noise and the processor 83 first determines the type of noise according to the first spectrum and then when the type of noise is determined, the processor 83 determines the center frequency of the HPF device 84 accordingly. In other words, the invention not only cancels or suppresses the wind noise, but also the noise at any frequency range.
- the processor 83 When the processor 83 receives the first spectrum and determines that the portable device is indoors, the first spectrum is transmitted to the enhancement device 86 . At the same time, the processor 83 transmits the select signal SEL to the IFFT device 85 to process the output signal of the enhancement device 86 .
- the enhancement 86 estimates a noise spectrum according to a previous received audio signal, and executes a noise suppression operation on the first spectrum according to the noise spectrum to generate a third spectrum.
- the third spectrum is then transmitted to the IFFT device 85 to generate a third audio signal by applying an IFFT operation on the third spectrum.
- FIG. 9 is a schematic diagram of an embodiment of a noise cancellation device according to the invention.
- the noise cancellation device is embedded in an electronic device having a voice receiving mean.
- the noise cancellation device comprises a spectrum capture device 91 , a first determination device 92 , a second determination device 95 , an SNR estimator 93 , a center frequency generator 94 and a sharp processor 96 .
- the spectrum capture device 91 receives an audio spectrum transformed by an audio signal and acquires a noise spectrum corresponding to a first frequency range corresponding to a noise and a human speech spectrum corresponding to the second frequency range corresponding to a human speech signal.
- the first determination device 92 receives the first spectrum and determines whether the electronic device is outdoors.
- an enable signal EN is transmitted to the high pass filter. If the electronic device is not determined to be outdoors, the first spectrum is transmitted to a second determination device 95 to determine whether the first spectrum needs to be processed by a voice sharp process. If the second determination device 95 determines that the first spectrum does not need to be processed by a voice sharp process, the first spectrum is transmitted to an inverse Fast Fourier Transform device to output a first audio signal. If the second determination device 95 determines that the first spectrum does need to be processed by a voice sharp process, the first spectrum is transmitted to the sharp processor 96 for further processing. For the operation method and detailed operation of the sharp processor, reference can be made to the description of FIG. 6 .
- the SNR estimator 93 estimates an SNR ratio according to the energy of the first spectrum and the energy of the second spectrum.
- the SNR ration is transmitted to a center frequency generator 94 to estimate a center frequency fc.
- the high pass filter adjusts its center frequency according to the center frequency fc and applies a high pass filter operation to the audio spectrum. Then, the output of the high pass filter is transmitted to an IFFT device to output a second audio signal.
- FIG. 10 is a schematic diagram of another embodiment of a noise cancellation device according to the invention.
- the first microphone 101 receives a first audio signal S 1 and the second microphone 102 receives a second audio signal S 2 .
- the adder 106 adds the first audio signal S 1 to the second audio signal S 2 to generate a human speech signal S S .
- the subtractor 107 substrates the first audio signal S 1 from the second audio signal S 2 to generate a noise signal S N .
- the SNR estimator 103 estimates an SNR ratio according to the energy of the human speech signal S S and the energy of the noise signal S N .
- the SNR ration is transmitted to a center frequency generator 104 to estimate a center frequency fc.
- the high pass filter 105 adjusts its center frequency according to the center frequency fc and executes a high pass filter operation to the human speech signal S S to generate a filtered human speech signal S S ′
- FIG. 11 is a flowchart of a noise cancellation method according to another embodiment of the invention.
- a first audio signal containing a speech signal of a user and a noise is received by a microphone.
- an FFT device applies an FFT operation to the first audio signal to generate a first spectrum.
- a processor or a controller determines whether a user is outdoors or indoors.
- the frequency of wind noise ranges from 0 to 100 Hz
- the frequency of human speech signals range from 300 Hz to 4K Hz.
- the user or designer sets a first frequency range corresponding to the wind noise and a second frequency range corresponding to the speech signal and acquires a noise spectrum corresponding to the first frequency range and a human speech spectrum corresponding to the second frequency range by an application program.
- a first determination device may determine whether a user is outdoors according to the energy of the noise spectrum.
- a second determination device may determine whether the user is indoors according to the first spectrum. In one embodiment, the second determination device may determine whether the echo noise is generated according to two successive spectrums. If the user is determined to be indoors, the step S 1104 is executed. If the user is determined to be outdoors, the step S 1106 is executed
- the energy of the noise spectrum Nr is compared with a first predetermined value Nth 1 . If the energy of the noise spectrum Nr is larger than the first predetermined value Nth 1 , the step S 1111 is executed to cancel the noise. If the energy of the noise spectrum Nr is smaller than the first predetermined value Nth 1 , the step 1107 is executed.
- the noise suppression function is determined to be forcedly executed or not according to user settings. For example, when the user uses a portable device to execute a video recording program or a voice recording program, an operational menu is jumped and shown on the display of the portable device for the user to determine whether the noise cancellation or suppression operation should be executed.
- step S 1107 If the answer of step S 1107 is to execute the noise cancellation or suppression operation, step S 111 is then executed. If the answer of step S 1107 is not to execute the noise cancellation or suppression operation, step S 1115 is then executed. In step S 1115 , an IFFT operation is applied to the first spectrum to generate a second audio signal.
- step S 1111 a signal to noise (SNR) ratio is determined according to the energy of the noise spectrum and the energy of the human speech spectrum.
- step S 1112 a center frequency fc is estimated according to the SNR ratio.
- a center frequency of a frequency domain high pass filter is adjusted according to the center frequency fc, and the first spectrum is filtered by the frequency domain high pass filter to filter out the wind noise at low frequency, and a second spectrum is therefore generated.
- step S 1114 noise suppression is applied to the second spectrum according to the noise spectrum and the human speech spectrum to enhance the human speech and suppress the wind noise.
- a third spectrum is generated accordingly.
- step S 1114 the third spectrum is processed by the IFFT operation to generate a filtered audio signal.
- a second determination device may determine whether the user is indoors according to the first spectrum. In one embodiment, the second determination device may determine whether the echo noise exists according to two successive spectrums If the result of step S 1104 is no, step S 1105 is executed. If the result of step S 1104 is yes, step S 1108 is executed. In step S 1108 , indoor noise, such as an echo, is estimated according to the first spectrum, and the energy of the indoor noise Nr is compared with a second predetermined value Nth 2 . If the energy of the indoor noise Nr is larger than the second predetermined value Nth 2 , the step S 1116 is executed to suppress the noise. For the operation of the step S 1116 , reference can be made to the description of FIG. 6 . If the energy of the indoor noise Nr is smaller than the second predetermined value Nth 2 , the step S 1109 is executed.
- step S 1109 the noise suppression function is determined to be forcedly executed or not according to user settings. For example, when the user uses a portable device to execute a video recording program or a voice recording program, an operational menu is jumped and shown on the display of the portable device for the user to determine whether the noise cancellation or suppression operation should be executed. If the answer of step S 1109 is yes, step S 1116 is then executed. If the answer of step S 1109 is no, step S 1115 is then executed. In step S 1115 , the first spectrum is processed by the IFFT operation to generate a second audio signal.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Telephone Function (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
- 1. Field of the Invention
- The present invention relates to a noise cancellation method, and more particularly to a noise cancellation method for a portable device.
- 2. Description of the Related Art
- Portable devices, such as a smart phone, tablet or personal digital assist (PDA), have become necessaries for consumers, personally or for business. More and more users use a portable device to shot a video or record a voice mail. The general portable device does not support noise cancellation for voice received by the microphone of the portable device, and wind noise may decrease the quality of the recorded voice no matter where the user is at, indoors or outdoors. When a user is outdoors, the microphone is easily affected by the wind noise. When the user is indoors, the microphone is easily affected by reflected voice signal. The noise suppression methods for the wind noise and the reflected voice signal are different and are not easily integrated in the portable device.
- An embodiment of the invention provides a noise cancellation method for an electronic device. The method comprises: receiving an audio signal; applying a Fast Fourier Transform operation on the audio signal to generate a sound spectrum; acquiring a first spectrum corresponding to a noise and a second spectrum corresponding to a human voice signal from the sound spectrum; estimating a center frequency according to the first spectrum and the second spectrum; and applying a high pass filtering operation to the sound spectrum according to the center frequency.
- Another embodiment of the invention provides a noise cancellation method for an electronic device. The method comprises the steps of: receiving an audio signal; applying a Fast Fourier Transform operation on the audio signal to generate a sound spectrum; determining whether the electronic device is outdoors according to the sound spectrum; and executing the following steps when the electronic device is outdoors: acquiring a first spectrum corresponding to a noise and a second spectrum corresponding to a human voice signal from the sound spectrum; estimating a center frequency according to the first spectrum and the second spectrum; and applying a high pass filtering operation to the sound spectrum according to the center frequency.
- A detailed description is given in the following embodiments with reference to the accompanying drawings.
- The present invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
-
FIG. 1 is a schematic diagram of a noise cancellation method for a microphone according to an embodiment of the invention. -
FIG. 2 is a flowchart of the operation method of the noise suppression device inFIG. 1 according to an embodiment of the invention. -
FIG. 3 is a schematic diagram of a portable device with a noise suppression function according to an embodiment of the invention. -
FIG. 4 is a schematic diagram of a portable device with a noise suppression function according to another embodiment of the invention. -
FIG. 5 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention. -
FIG. 6 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention. -
FIG. 7 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention. -
FIG. 8 is a schematic diagram of another embodiment of a portable device with a noise suppression function according to the invention. -
FIG. 9 is a schematic diagram of an embodiment of a noise cancellation device according to the invention. -
FIG. 10 is a schematic diagram of another embodiment of a noise cancellation device according to the invention. -
FIG. 11 is a flowchart of a noise cancellation method according to another embodiment of the invention. - The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
-
FIG. 1 is a schematic diagram of a noise cancellation method for a microphone according to an embodiment of the invention. The embodiment ofFIG. 1 is illustrated with an outdoor situation. When themicrophone 11 receives an audio signal SS of a user, the microphone may also receive a wind noise signal SN, wherein the signal received by the microphone can be expressed as (SS+SN). Then, anoise suppression device 12 executes a noise suppression operation on the signal (SS+SN) to cancel or suppress noise and then, an audio signal SS′ is generated. In this embodiment, the audio signal SS′ may still contain noise and is different from the audio signal SS. In this embodiment, the noise suppression device can be implemented by hardware or by a processor or controller executing a program. -
FIG. 2 is a flowchart of the operation method of the noise suppression device inFIG. 1 according to an embodiment of the invention. In step S21, a microphone receives a first audio signal containing a speech signal of a user and wind noise. In step S22, a Fast Fourier Transform device applies a Fast Fourier Transform (FFT) operation on the first audio signal to generate a first spectrum. Generally speaking, the frequency of wind noise ranges from 0 to 100 Hz, and the frequency of human speech signals range from 300 Hz to 4K Hz. In this embodiment, a first frequency range corresponding to the wind noise and a second frequency range corresponding to the speech signal are set to acquire a noise spectrum corresponding to the first frequency range and a human speech spectrum corresponding to the second frequency range. In the step S23, the noise suppression device may determine whether a user is outdoors. The step can be implemented by user settings or the noise suppression device may determine that according to the spectrums acquired in step S22. For example, when the user uses a portable device to execute a video recording program or a voice recording program, an operational menu is jumped and shown on the display of the portable device for the user to input the user's location, being indoors or outdoors, and whether the noise cancellation or suppression operation should be executed. If the user is outdoors, the noise cancellation or suppression operation will be executed. If the user is not outdoors, the noise cancellation or suppression operation will not be executed. In another embodiment, the noise suppression device may determine whether a user is outdoors according to energy of the noise spectrum. If the energy is larger than a predetermined value, the user is determined to be outdoors and the noise cancellation or suppression operation will be executed. If the energy is less than the predetermined value, the noise cancellation or suppression operation will not be executed. - In the step S24, the noise suppression device estimates a center frequency fc according to a first energy of the noise spectrum and a second energy of a human speech spectrum. Then, a center frequency of a frequency domain high pass filter is adjusted according to the estimated center frequency. The first spectrum is then filtered by the frequency domain high pass filter to filter out the wind noise at a low frequency and a second spectrum is therefore generated. Then, in the step S25, the noise suppression device processes the second spectrum to enhance the human speech spectrum and suppress the noise spectrum according to the human speech spectrum and the noise spectrum, and a third spectrum is generated accordingly. An Inverse Fast Fourier Transform (IFFT) operation is then applied to the third spectrum to generate a filtered audio signal. The filtered audio signal is then stored or played by a speaker.
- In
FIG. 2 , the estimated center frequency fc that is generated according to the first energy of the noise spectrum and the second energy of a human speech spectrum is used for a high pass filter operation applied on the first spectrum, but the invention is not limited thereto. A center frequency of a time domain high pass filter that filters the first audio signal received by the microphone can be adjusted to the center frequency fc, and the time domain high pass filter filters out wind noise at low frequency from the first audio signal. Then, an FFT operation is applied on the filtered first audio signal to generate a fourth spectrum. The noise suppression device repeats processing of the fourth spectrum to enhance the human speech spectrum and suppress the noise spectrum according to the human speech spectrum and the noise spectrum, and a fifth spectrum is generated accordingly. In another embodiment, a new noise spectrum and a new human speech spectrum are generated according to the fourth spectrum, and the noise suppression device processes the fourth spectrum according to the new noise spectrum and the new human speech spectrum to enhance the human speech spectrum. In the end, an IFFT operation is applied to the fourth spectrum to generate a filtered audio signal. -
FIG. 3 is a schematic diagram of a portable device with a noise suppression function according to an embodiment of the invention. Themicrophone 31 of the portable device receives a speech signal and wind noise to generate a first audio signal. In this embodiment, themicrophone 31 may be made by a single microphone or a microphone array. The Fast Fourier Transform (FFT)device 32 applies an FFT operation to the first audio signal to generate a first spectrum and the first spectrum is transmitted to aprocessor 33, a high pass filter (HPF) 34 and anIFFT device 35. Generally speaking, the frequency of wind noise ranges from 0 to 100 Hz, and the frequency of human speech signals range from 300 Hz to 4K Hz. When theprocessor 33 receives the first spectrum, theprocessor 33 first acquires a noise spectrum corresponding to a first frequency range corresponding to the wind noise and determines whether the energy of the noise spectrum is larger than a predetermined value. If yes, theprocessor 33 transmits an enable signal to theHPF 34 to apply a high pass filter operation on the first spectrum. Theprocessor 33 also transmits a select signal to theIFFT device 35 and theIFFT device 35 applies an inverse Fast Fourier Transform operation on the output of theHPF 34, not the first spectrum output by theFFT device 32. In other words, a multiplexer can be applied and coupled to the input of theIFFT device 35, and the multiplexer directs the output signal ofHPF 34 or the first spectrum output by theFFT device 32 to theIFFT device 35 according to a select signal output by theprocessor 33. - If the energy of the noise spectrum is not larger than a predetermined value, the
processor 33 does not transmit the enable signal to theHPF 34 and transmits the select signal to theIFFT device 35 and theIFFT device 35 applies an inverse Fast Fourier Transform operation on the first spectrum output by theFFT device 32. In another embodiment, if the energy of the noise spectrum is not larger than a predetermined value, and theprocessor 33 receives a control signal indicating that the user wants to apply a noise cancellation operation or noise suppress operation, theprocessor 33 transmits the enable signal to theHPF 34 to apply a high pass filter operation on the first spectrum. Theprocessor 33 also transmits a select signal to theIFFT device 35 and theIFFT device 35 applies an inverse Fast Fourier Transform operation on the output of theHPF 34, not the first spectrum output by theFFT device 32. Thus, theprocessor 33 can pass or ignore the step of determining whether the energy of the noise spectrum is larger than a predetermined value. - After the
processor 33 receives the first spectrum, theprocessor 33 first acquires a noise spectrum corresponding to a first frequency range and a human speech spectrum corresponding to a second frequency range. Theprocessor 33 estimates a center frequency fc according to a first energy of the noise spectrum and a second energy of a human speech spectrum. When the center frequency of theHPF device 34 is adjusted to the center frequency fc, theHPF device 34 applies a high pass filter operation on the first spectrum to filter out the low frequency wind noise, and a second spectrum is then generated. The second spectrum is transmitted to theIFFT device 35 and theIFFT device 35 executes an IFFT operation to transform the second spectrum into a second audio signal. In this embodiment, the first frequency range ranges from 0 to 100 Hz, and the second frequency range ranges from 300 Hz to 4K Hz, but are not limited thereto. - The
processor 33 can set different frequency ranges according to the type of noise and theprocessor 33 first determines the type of noise according to the first spectrum and then when the type of noise is determined, theprocessor 33 determines the center frequency of theHPF device 34 accordingly. In other words, the invention not only cancels or suppresses the wind noise, but also noise at any frequency range. -
FIG. 4 is a schematic diagram of a portable device with a noise suppression function according to another embodiment of the invention. Themicrophone 41 of the portable device receives a speech signal and wind noise to generate a first audio signal. In this embodiment, themicrophone 41 may be made by a single microphone or a microphone array. The first Fast Fourier Transform (FFT)device 42 applies an FFT operation to the first audio signal to generate a first spectrum and the first spectrum is transmitted to aprocessor 43 and a high pass filter (HPF) 44. Generally speaking, the frequency of wind noise ranges from 0 to 100 Hz, and the frequency of human speech signals range from 300 Hz to 4K Hz. When theprocessor 43 receives the first spectrum, theprocessor 43 first acquires a noise spectrum N corresponding to a first frequency range corresponding to the wind noise and determines whether the energy of the noise spectrum PN is larger than a predetermined value PTH. If yes, theprocessor 43 transmits an enable signal EN1 to theHPF 44 to apply a high pass filter operation on the first spectrum. Theprocessor 43 also transmits a first enable signal EN1 to theHPF 45 to execute an HPF operation. In the embodiment, theprocessor 43 can also transmit a second enable signal (EN2) to theHPF device 46 and theHPF 46 executes an HPF operation on the first audio signal to generate a first filtered audio signal. - In this embodiment, the
processor 43 can select only one of thefrequency domain HPF 44 andtime domain HPF 46 to execute the filter operation, or both thefrequency domain HPF 44 andtime domain HPF 46 execute the filter operation. If both thefrequency domain HPF 44 andtime domain HPF 46 work simultaneously, theprocessor 43 transmits a select signal SEL to theenhancement device 48 and theenhancement device 48 processes the output signal from thefrequency domain HPF 44 or asecond FFT device 47 according to the select signal SEL. In other words, a multiplexer can be applied for directing the output signal from thefrequency domain HPF 44 or the output signal from thesecond FFT device 47 to theenhancement device 48 according to the select signal SEL. Theenhancement device 48 can be implemented by hardware or software to enhance the human voice signal of the received signal and suppress the wind noise of the received signal. - When the
processor 43 receives the first spectrum, theprocessor 43 acquires a noise spectrum N corresponding to a first frequency range corresponding to the noise and a human speech spectrum corresponding to the second frequency range corresponding to the human speech signal. Theprocessor 43 calculates a ratio (PN/PS) according to a first energy of the noise spectrum and the second energy of the human speech spectrum to estimate a center frequency fc. The controlled 43 then adjusts the center frequency of both thefrequency domain HPF 44 andtime domain HPF 46 to be fc. When the center frequency offrequency domain HPF 44 is set, the first spectrum is filtered by thefrequency domain HPF 44, the wind noise at low frequency is filtered out from the first spectrum, and a second spectrum is generated accordingly. When the center frequency oftime domain HPF 46 is set, the first audio signal is filtered by thetime domain HPF 46 the wind noise at low frequency is filtered out from the first spectrum, and a second audio signal is generated accordingly. The second audio signal is transmitted to thesecond FFT device 47 to generate a third spectrum. - The
processor 43 transmits the noise spectrum N and the human speech spectrum S to theenhancement device 48. Theenhancement device 48 receives the second spectrum or the third spectrum according to a select signal SEL, and enhances the human speech of the received spectrum and suppresses the noise of the received spectrum. For example, the second spectrum can be represented as (S2+N2). Theenhancement device 48 calculates an average spectrum of the second spectrum and the human speech spectrum, wherein the average spectrum can be represented as ((S+S2)/2+N2/2). Then theenhancement device 48 subtracts the noise spectrum N from the average spectrum to generate the result: ((S+S2)/2+(N2=N)/2). According to this way, a signal to noise ratio between the human speech spectrum (S+S2)/2 and the noise spectrum (N2−N)/2) becomes larger and the quality of the output audio signal becomes better accordingly. Theenhancement device 48 outputs a fourth spectrum to theIFFT device 45 and an IFFT operation is applied to the fourth spectrum to generate a third audio signal. Theprocessor 43 can set different frequency ranges according to the type of noise and theprocessor 43 first determines the type of noise according to the first spectrum and then when the type of noise is determined, theprocessor 43 determines the center frequency of thefrequency domain HPF 44 and thetime domain HPF 46 accordingly. In other words, the invention not only cancels or suppresses the wind noise, but also the noise at any frequency range. - Although the description of the embodiment in
FIG. 3 does not mention theenhancement device 48, theenhancement device 48 can also be applied to the embodiment inFIG. 3 for better signal quality. - The generation of the center frequency and how the
processor 43 detects noises are explained in the following. The signal received by themicrophone 41 is first sampled by an analog to digital converter with 48K Hz sampling rate to generate a digital signal. The digital signal is transmitted to a 256 points Fast Fourier Transform device to generate a corresponding spectrum. Energy of a first band of the spectrum and energy of a second band of the spectrum are used to determine whether the noise exists. The frequency of wind noise can be acquired by the following equation: -
2/256*48K Hz=375 Hz - The
processor 43 determines the center frequency fc according to a signal to noise (SNR) ratio of the noise and the human speech signal. The SNR ratio is determined by the following equation: -
SNR=the energy from band 3 to band 24/the energy fromband 1 to band 2=the energy from 375 Hz to 4K Hz/the energy from 0 to 375 Hz - In the present application, the frequency of the center frequency fc estimated by the SNR ranges from 100 Hz to 1000 Hz.
-
FIG. 5 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention. The embodiment inFIG. 5 is illustrated with an indoor situation. The noise indoors is usually generated by the echo signal. Thus, an audio signal received at a previous time point is applied to suppress the noise of an audio signal received at a next time point. In the step S51, a microphone receives a first audio signal containing a speech signal of a user and an echo. In step S52, a Fast Fourier Transform device applies a Fast Fourier Transform (FFT) operation on the first audio signal to generate a first spectrum. In step S53, a processor or a controller determines whether the echo noise exists according to the energy of the first spectrum. If the echo noise does not exist, the step S55 is executed. If the echo noise exists, the step S54 is executed. In the step S54, an echo spectrum is estimated according to the spectrum generated according to a previous audio signal. Then, a noise suppression operation is applied to the first spectrum according to the echo noise spectrum to generate a second spectrum. The second spectrum is transformed into a third audio signal by an Inverse Fast Fourier Transform operation in step S55. -
FIG. 6 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention. The embodiment inFIG. 6 is illustrated with an indoor situation. In the step S61, a microphone receives a first audio signal x(t) containing a speech signal of a user and an echo. In step S62, a Fast Fourier Transform device applies a Fast Fourier Transform (FFT) operation on the first audio signal x(t) to generate a first spectrum x(k). In step S63, a processor or a controller determines whether the echo noise exists according to the energy of the first spectrum. If the echo noise does not exist, the step S65 is executed. If the echo noise exists, the step S64 is executed. In the step S64, the first spectrum x(k) is multiplied by a gain function to suppress the echo noise. The gain function g(k) can be generated or set by a user or a processor of a portable device. The spectrum Y(k) generated in step S64 is shown as following: -
Y(k)=g(k)*x(k) - The gain value of the gain function g(k) ranges from 0.1 to 1. For example, if the Fast Fourier Transform executed in step S62 is a 256 points Fast Fourier Transform, the gain function g(k) comprises 256 gain values to adjust the energy of each point of the first spectrum. Furthermore, in step S64, an echo spectrum n(k) is also estimated according to the first audio signal or the first spectrum. The echo noise spectrum n(k) is represented by the equation:
-
n(k)=(1−g(k))*u(k) - , wherein u(k) is the original estimated noise.
- Then, a second spectrum is generated by subtracting n(k) from Y(k). In the step S65, the second spectrum is transformed into a third audio signal x″(t) by an Inverse Fast Fourier Transform operation.
-
FIG. 7 is a flowchart of another embodiment of a noise cancellation method for a microphone according to the invention. In step S701, a first audio signal containing a speech signal of a user and a noise is received by a microphone. In step S702, an FFT device applies an FFT operation to the first audio signal to generate a first spectrum. In step S703, a processor or a controller determines whether a user is outdoors. - Generally speaking, the frequency of wind noise ranges from 0 to 100 Hz, and the frequency of human speech signals range from 300 Hz to 4K Hz. In this embodiment, the user or designer sets a first frequency range corresponding to the wind noise and a second frequency range corresponding to the speech signal and acquires a noise spectrum corresponding to the first frequency range and a human speech spectrum corresponding to the second frequency range by an application program. Then, a first determination device may determine whether a user is outdoors according to the energy of the noise spectrum. If the user is determined not to be outdoors, the step S704 is executed. If the user is determined to be outdoors, the step S706 is executed
- In the step S706, the energy of the noise spectrum Nr is compared with a first predetermined value Nth1. If the energy of the noise spectrum Nr is larger than the first predetermined value Nth1, the step S711 is executed to cancel the noise. If the energy of the noise spectrum Nr is smaller than the first predetermined value Nth1, the
step 707 is executed. In the step S707, the noise suppression function is determined to be forcedly executed or not according to user settings. For example, when the user uses a portable device to execute a video recording program or a voice recording program, an operational menu is jumped and shown on the display of the portable device for the user to determine whether the noise cancellation or suppression operation should be executed. If the answer of step S707 is yes, wherein the noise cancellation operation or suppression operation has to be executed, step S711 is then executed. If the answer of step S707 is no, wherein the noise cancellation operation or suppression operation does not have be executed, step S715 is then executed. In step S715, an IFFT operation is applied to the first spectrum to generate a second audio signal. - In step S711, a signal to noise (SNR) ratio is estimated according to the energy of the noise spectrum and the energy of the human speech spectrum. In the step S712, a center frequency fc is estimated according to the SNR ratio. A center frequency of a frequency domain high pass filter is adjusted according to the center frequency fc, the first spectrum is filtered by the frequency domain high pass filter to filter out the wind noise at low frequency in step S713, and a second spectrum is therefore generated. In step S714, a noise suppression operation is applied to the second spectrum again according to the noise spectrum and the human speech spectrum to enhance the human speech of the second spectrum and suppress the wind noise of the second spectrum. A third spectrum is generated accordingly. In step S714, the third spectrum is processed by the IFFT operation to generate a filtered audio signal.
- In step S704, a second determination device may determine whether the user is indoors according to the first spectrum. In one embodiment, the second determination device may determine whether the echo noise exists according to two successive spectrums. If the result of step S704 is no, step S705 is executed. If the result of step S704 is yes, step S708 is executed. In step S708, an indoor noise, such as an echo, is estimated according to the first spectrum, and the energy of the indoor noise Nr is compared with a second predetermined value Nth2. If the energy of the indoor noise Nr is larger than the second predetermined value Nth2, the step S716 is executed to suppress the noise. For the operation of the step S716, reference can be made to the description of
FIG. 6 . If the energy of the indoor noise Nr is smaller than the second predetermined value Nth2, the step S09 is executed. In the step S709, the noise suppression function is determined to be forcedly executed or not according to user settings. For example, when the user uses a portable device to execute a video recording program or a voice recording program, an operational menu is jumped and shown on the display of the portable device for the user to determine whether the noise cancellation or suppression operation should be executed. If the answer of step S709 is yes, step S716 is then executed. If the answer of step S709 is no, step S715 is then executed. In step S715, the first spectrum is processed by the IFFT operation to generate a second audio signal. -
FIG. 8 is a schematic diagram of another embodiment of a portable device with a noise suppression function according to the invention. Themicrophone 81 of the portable device receives a speech signal and wind noise to generate a first audio signal. In this embodiment, themicrophone 81 may be made by a single microphone or a microphone array. The Fast Fourier Transform (FFT)device 82 applies an FFT operation to the first audio signal to generate a first spectrum and the first spectrum is transmitted to aprocessor 83, a high pass filter (HPF) 84 and an Inverse Fast Fourier Transform (IFFT)device 85. Generally speaking, the frequency of wind noise ranges from 0 to 100 Hz, and the frequency of human speech signals range from 300 Hz to 4K Hz. When theprocessor 83 receives the first spectrum, theprocessor 83 first acquires a noise spectrum corresponding to a first frequency range corresponding to the wind noise and determines whether the energy of the noise spectrum is larger than a predetermined value. If yes, theprocessor 83 transmits an enable signal to theHPF 84 to apply a high pass filter operation on the first spectrum. Theprocessor 83 also transmits a select signal to theIFFT device 85 and theIFFT device 85 applies an inverse Fast Fourier Transform operation on the output signal of theHPF 84, not the first spectrum output by theFFT device 82 or a third spectrum output by theenhancement device 86. In other words, a multiplexer can be applied and coupled to the input of theIFFT device 85. The multiplexer directs the output signal ofHPF 84, the first spectrum output by theFFT device 82 or the third spectrum output by theenhancement device 86 to theIFFT device 85 for further processing according to a select signal output by theprocessor 83. - If the energy of the noise spectrum is not larger than a predetermined value, the
processor 83 does not transmit the enable signal to theHPF 84 and transmits the select signal to theIFFT device 85. TheIFFT device 85 applies an inverse Fast Fourier Transform operation on the first spectrum output by theFFT device 82 according to the select signal. In other embodiment, if the energy of the noise spectrum is not larger than a predetermined value, and theprocessor 83 receives a control signal indicating that the user wants to apply a noise cancellation operation or noise suppress operation on the audio signal received by themicrophone 81, theprocessor 83 directly transmits the enable signal to theHPF 84 to apply a high pass filter operation on the first spectrum. Theprocessor 83 also transmits a select signal to theIFFT device 85 and theIFFT device 85 applies an inverse Fast Fourier Transform operation on the output signal of theHPF 84, not the first spectrum output by theFFT device 82. Thus, theprocessor 83 can pass or ignore the step of determining whether the energy of the noise spectrum is larger than a predetermined value. - After the
processor 83 receives the first spectrum, theprocessor 83 first acquires a noise spectrum corresponding to a first frequency range and a human speech spectrum corresponding to a second frequency range. Theprocessor 83 estimates a center frequency fc according to a first energy of the noise spectrum and a second energy of a human speech spectrum. After the center frequency of theHPF device 84 is adjusted to the center frequency fc, theHPF device 84 applies a high pass filter operation on the first spectrum to filter out the low frequency wind noise, and a second spectrum is then generated. The second spectrum is transmitted to theIFFT device 85 and theIFFT device 85 executes an IFFT operation to transform the second spectrum into a second audio signal. In this embodiment, the first frequency range ranges from 0 to 100 Hz, and the second frequency range ranges from 300 Hz to 4K Hz, but are not limited thereto. Theprocessor 83 can set different frequency ranges according to the type of noise and theprocessor 83 first determines the type of noise according to the first spectrum and then when the type of noise is determined, theprocessor 83 determines the center frequency of theHPF device 84 accordingly. In other words, the invention not only cancels or suppresses the wind noise, but also the noise at any frequency range. - When the
processor 83 receives the first spectrum and determines that the portable device is indoors, the first spectrum is transmitted to theenhancement device 86. At the same time, theprocessor 83 transmits the select signal SEL to theIFFT device 85 to process the output signal of theenhancement device 86. Theenhancement 86 estimates a noise spectrum according to a previous received audio signal, and executes a noise suppression operation on the first spectrum according to the noise spectrum to generate a third spectrum. The third spectrum is then transmitted to theIFFT device 85 to generate a third audio signal by applying an IFFT operation on the third spectrum. -
FIG. 9 is a schematic diagram of an embodiment of a noise cancellation device according to the invention. The noise cancellation device is embedded in an electronic device having a voice receiving mean. The noise cancellation device comprises aspectrum capture device 91, afirst determination device 92, asecond determination device 95, anSNR estimator 93, acenter frequency generator 94 and asharp processor 96. Thespectrum capture device 91 receives an audio spectrum transformed by an audio signal and acquires a noise spectrum corresponding to a first frequency range corresponding to a noise and a human speech spectrum corresponding to the second frequency range corresponding to a human speech signal. Thefirst determination device 92 receives the first spectrum and determines whether the electronic device is outdoors. If the electronic device is determined to be outdoors, an enable signal EN is transmitted to the high pass filter. If the electronic device is not determined to be outdoors, the first spectrum is transmitted to asecond determination device 95 to determine whether the first spectrum needs to be processed by a voice sharp process. If thesecond determination device 95 determines that the first spectrum does not need to be processed by a voice sharp process, the first spectrum is transmitted to an inverse Fast Fourier Transform device to output a first audio signal. If thesecond determination device 95 determines that the first spectrum does need to be processed by a voice sharp process, the first spectrum is transmitted to thesharp processor 96 for further processing. For the operation method and detailed operation of the sharp processor, reference can be made to the description ofFIG. 6 . - The
SNR estimator 93 estimates an SNR ratio according to the energy of the first spectrum and the energy of the second spectrum. The SNR ration is transmitted to acenter frequency generator 94 to estimate a center frequency fc. The high pass filter adjusts its center frequency according to the center frequency fc and applies a high pass filter operation to the audio spectrum. Then, the output of the high pass filter is transmitted to an IFFT device to output a second audio signal. -
FIG. 10 is a schematic diagram of another embodiment of a noise cancellation device according to the invention. Thefirst microphone 101 receives a first audio signal S1 and thesecond microphone 102 receives a second audio signal S2. Theadder 106 adds the first audio signal S1 to the second audio signal S2 to generate a human speech signal SS. Thesubtractor 107 substrates the first audio signal S1 from the second audio signal S2 to generate a noise signal SN. TheSNR estimator 103 estimates an SNR ratio according to the energy of the human speech signal SS and the energy of the noise signal SN. The SNR ration is transmitted to acenter frequency generator 104 to estimate a center frequency fc. Thehigh pass filter 105 adjusts its center frequency according to the center frequency fc and executes a high pass filter operation to the human speech signal SS to generate a filtered human speech signal SS′ -
FIG. 11 is a flowchart of a noise cancellation method according to another embodiment of the invention. In step S1101, a first audio signal containing a speech signal of a user and a noise is received by a microphone. In step S1102, an FFT device applies an FFT operation to the first audio signal to generate a first spectrum. In step S1103, a processor or a controller determines whether a user is outdoors or indoors. - Generally speaking, the frequency of wind noise ranges from 0 to 100 Hz, and the frequency of human speech signals range from 300 Hz to 4K Hz. In this embodiment, the user or designer sets a first frequency range corresponding to the wind noise and a second frequency range corresponding to the speech signal and acquires a noise spectrum corresponding to the first frequency range and a human speech spectrum corresponding to the second frequency range by an application program. Then, a first determination device may determine whether a user is outdoors according to the energy of the noise spectrum.
- In this embodiment, a second determination device may determine whether the user is indoors according to the first spectrum. In one embodiment, the second determination device may determine whether the echo noise is generated according to two successive spectrums. If the user is determined to be indoors, the step S1104 is executed. If the user is determined to be outdoors, the step S1106 is executed
- In the step S1106, the energy of the noise spectrum Nr is compared with a first predetermined value Nth1. If the energy of the noise spectrum Nr is larger than the first predetermined value Nth1, the step S1111 is executed to cancel the noise. If the energy of the noise spectrum Nr is smaller than the first predetermined value Nth1, the step 1107 is executed. In the step S1107, the noise suppression function is determined to be forcedly executed or not according to user settings. For example, when the user uses a portable device to execute a video recording program or a voice recording program, an operational menu is jumped and shown on the display of the portable device for the user to determine whether the noise cancellation or suppression operation should be executed. If the answer of step S1107 is to execute the noise cancellation or suppression operation, step S111 is then executed. If the answer of step S1107 is not to execute the noise cancellation or suppression operation, step S1115 is then executed. In step S1115, an IFFT operation is applied to the first spectrum to generate a second audio signal.
- In step S1111, a signal to noise (SNR) ratio is determined according to the energy of the noise spectrum and the energy of the human speech spectrum. In the step S1112, a center frequency fc is estimated according to the SNR ratio. A center frequency of a frequency domain high pass filter is adjusted according to the center frequency fc, and the first spectrum is filtered by the frequency domain high pass filter to filter out the wind noise at low frequency, and a second spectrum is therefore generated. In step S1114, noise suppression is applied to the second spectrum according to the noise spectrum and the human speech spectrum to enhance the human speech and suppress the wind noise. A third spectrum is generated accordingly. In step S1114, the third spectrum is processed by the IFFT operation to generate a filtered audio signal.
- In step S1104, a second determination device may determine whether the user is indoors according to the first spectrum. In one embodiment, the second determination device may determine whether the echo noise exists according to two successive spectrums If the result of step S1104 is no, step S1105 is executed. If the result of step S1104 is yes, step S1108 is executed. In step S1108, indoor noise, such as an echo, is estimated according to the first spectrum, and the energy of the indoor noise Nr is compared with a second predetermined value Nth2. If the energy of the indoor noise Nr is larger than the second predetermined value Nth2, the step S1116 is executed to suppress the noise. For the operation of the step S1116, reference can be made to the description of
FIG. 6 . If the energy of the indoor noise Nr is smaller than the second predetermined value Nth2, the step S1109 is executed. - In the step S1109, the noise suppression function is determined to be forcedly executed or not according to user settings. For example, when the user uses a portable device to execute a video recording program or a voice recording program, an operational menu is jumped and shown on the display of the portable device for the user to determine whether the noise cancellation or suppression operation should be executed. If the answer of step S1109 is yes, step S1116 is then executed. If the answer of step S1109 is no, step S1115 is then executed. In step S1115, the first spectrum is processed by the IFFT operation to generate a second audio signal.
- While the invention has been described by way of example and in terms of the preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. To the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art). Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.
Claims (16)
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/471,085 US9280984B2 (en) | 2012-05-14 | 2012-05-14 | Noise cancellation method |
TW101127134A TWI543149B (en) | 2012-05-14 | 2012-07-27 | Noise cancellation method |
CN201610194842.4A CN105741847A (en) | 2012-05-14 | 2012-08-17 | Noise cancellation method |
CN201210294872.4A CN103426433B (en) | 2012-05-14 | 2012-08-17 | Noise cancellation method |
DE102013006163A DE102013006163A1 (en) | 2012-05-14 | 2013-04-09 | Störgeräuschbeseitigungsverfahren |
US15/003,629 US9711164B2 (en) | 2012-05-14 | 2016-01-21 | Noise cancellation method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/471,085 US9280984B2 (en) | 2012-05-14 | 2012-05-14 | Noise cancellation method |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/003,629 Division US9711164B2 (en) | 2012-05-14 | 2016-01-21 | Noise cancellation method |
Publications (2)
Publication Number | Publication Date |
---|---|
US20130304463A1 true US20130304463A1 (en) | 2013-11-14 |
US9280984B2 US9280984B2 (en) | 2016-03-08 |
Family
ID=49475609
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/471,085 Expired - Fee Related US9280984B2 (en) | 2012-05-14 | 2012-05-14 | Noise cancellation method |
US15/003,629 Expired - Fee Related US9711164B2 (en) | 2012-05-14 | 2016-01-21 | Noise cancellation method |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/003,629 Expired - Fee Related US9711164B2 (en) | 2012-05-14 | 2016-01-21 | Noise cancellation method |
Country Status (4)
Country | Link |
---|---|
US (2) | US9280984B2 (en) |
CN (2) | CN103426433B (en) |
DE (1) | DE102013006163A1 (en) |
TW (1) | TWI543149B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105966339A (en) * | 2015-11-10 | 2016-09-28 | 乐卡汽车智能科技(北京)有限公司 | Method and device for vehicle alarming |
CN109905803A (en) * | 2019-03-01 | 2019-06-18 | 深圳市沃特沃德股份有限公司 | Switching method, device, storage medium and the computer equipment of microphone array |
CN110786022A (en) * | 2018-11-14 | 2020-02-11 | 深圳市大疆创新科技有限公司 | Wind noise processing method, device and system based on multiple microphones and storage medium |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104978955A (en) * | 2014-04-14 | 2015-10-14 | 美的集团股份有限公司 | Voice control method and system |
TWI569257B (en) * | 2014-07-04 | 2017-02-01 | 玄舟科技有限公司 | Audio signal processing apparatus and audio signal processing method thereof |
CN105469806B (en) * | 2014-09-12 | 2020-02-21 | 联想(北京)有限公司 | Sound processing method, device and system |
US9601131B2 (en) * | 2015-06-25 | 2017-03-21 | Htc Corporation | Sound processing device and method |
CN105590633A (en) * | 2015-11-16 | 2016-05-18 | 福建省百利亨信息科技有限公司 | Method and device for generation of labeled melody for song scoring |
CN105979438A (en) * | 2016-05-30 | 2016-09-28 | 歌尔股份有限公司 | Wind noise-prevention microphone single body and earphone |
CN106453762B (en) * | 2016-11-02 | 2019-05-07 | 上海数果科技有限公司 | The processing method and system that voice is uttered long and high-pitched sounds in audio system |
CN108305614A (en) * | 2017-01-11 | 2018-07-20 | 中兴通讯股份有限公司 | A kind of method of speech processing and device |
CN107393550B (en) * | 2017-07-14 | 2021-03-19 | 深圳永顺智信息科技有限公司 | Voice processing method and device |
CN108391190B (en) * | 2018-01-30 | 2019-09-20 | 努比亚技术有限公司 | A kind of noise-reduction method, earphone and computer readable storage medium |
CN110232905B (en) * | 2019-06-12 | 2021-08-27 | 会听声学科技(北京)有限公司 | Uplink noise reduction method and device and electronic equipment |
TWI779261B (en) * | 2020-01-22 | 2022-10-01 | 仁寶電腦工業股份有限公司 | Wind shear sound filtering device |
TWI783215B (en) * | 2020-03-05 | 2022-11-11 | 緯創資通股份有限公司 | Signal processing system and a method of determining noise reduction and compensation thereof |
Citations (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4630304A (en) * | 1985-07-01 | 1986-12-16 | Motorola, Inc. | Automatic background noise estimator for a noise suppression system |
US5012519A (en) * | 1987-12-25 | 1991-04-30 | The Dsp Group, Inc. | Noise reduction system |
US5400409A (en) * | 1992-12-23 | 1995-03-21 | Daimler-Benz Ag | Noise-reduction method for noise-affected voice channels |
US5742927A (en) * | 1993-02-12 | 1998-04-21 | British Telecommunications Public Limited Company | Noise reduction apparatus using spectral subtraction or scaling and signal attenuation between formant regions |
US5839101A (en) * | 1995-12-12 | 1998-11-17 | Nokia Mobile Phones Ltd. | Noise suppressor and method for suppressing background noise in noisy speech, and a mobile station |
US5933495A (en) * | 1997-02-07 | 1999-08-03 | Texas Instruments Incorporated | Subband acoustic noise suppression |
US6038532A (en) * | 1990-01-18 | 2000-03-14 | Matsushita Electric Industrial Co., Ltd. | Signal processing device for cancelling noise in a signal |
US6044341A (en) * | 1997-07-16 | 2000-03-28 | Olympus Optical Co., Ltd. | Noise suppression apparatus and recording medium recording processing program for performing noise removal from voice |
US6122384A (en) * | 1997-09-02 | 2000-09-19 | Qualcomm Inc. | Noise suppression system and method |
US20010016020A1 (en) * | 1999-04-12 | 2001-08-23 | Harald Gustafsson | System and method for dual microphone signal noise reduction using spectral subtraction |
US6295364B1 (en) * | 1998-03-30 | 2001-09-25 | Digisonix, Llc | Simplified communication system |
US6480823B1 (en) * | 1998-03-24 | 2002-11-12 | Matsushita Electric Industrial Co., Ltd. | Speech detection for noisy conditions |
US6510224B1 (en) * | 1999-05-20 | 2003-01-21 | Telefonaktiebolaget L M Ericsson | Enhancement of near-end voice signals in an echo suppression system |
US20030040908A1 (en) * | 2001-02-12 | 2003-02-27 | Fortemedia, Inc. | Noise suppression for speech signal in an automobile |
US20040111258A1 (en) * | 2002-12-10 | 2004-06-10 | Zangi Kambiz C. | Method and apparatus for noise reduction |
US6766292B1 (en) * | 2000-03-28 | 2004-07-20 | Tellabs Operations, Inc. | Relative noise ratio weighting techniques for adaptive noise cancellation |
US20040167777A1 (en) * | 2003-02-21 | 2004-08-26 | Hetherington Phillip A. | System for suppressing wind noise |
US20050213778A1 (en) * | 2004-03-17 | 2005-09-29 | Markus Buck | System for detecting and reducing noise via a microphone array |
US20070280472A1 (en) * | 2006-05-30 | 2007-12-06 | Microsoft Corporation | Adaptive acoustic echo cancellation |
US20080069373A1 (en) * | 2006-09-20 | 2008-03-20 | Broadcom Corporation | Low frequency noise reduction circuit architecture for communications applications |
US20080077399A1 (en) * | 2006-09-25 | 2008-03-27 | Sanyo Electric Co., Ltd. | Low-frequency-band voice reconstructing device, voice signal processor and recording apparatus |
US20090119099A1 (en) * | 2007-11-06 | 2009-05-07 | Htc Corporation | System and method for automobile noise suppression |
US20090248411A1 (en) * | 2008-03-28 | 2009-10-01 | Alon Konchitsky | Front-End Noise Reduction for Speech Recognition Engine |
US20090281805A1 (en) * | 2008-05-12 | 2009-11-12 | Broadcom Corporation | Integrated speech intelligibility enhancement system and acoustic echo canceller |
US20100082339A1 (en) * | 2008-09-30 | 2010-04-01 | Alon Konchitsky | Wind Noise Reduction |
US20110004470A1 (en) * | 2009-07-02 | 2011-01-06 | Mr. Alon Konchitsky | Method for Wind Noise Reduction |
US7885420B2 (en) * | 2003-02-21 | 2011-02-08 | Qnx Software Systems Co. | Wind noise suppression system |
US20130196715A1 (en) * | 2012-01-30 | 2013-08-01 | Research In Motion Limited | Adjusted noise suppression and voice activity detection |
US8515097B2 (en) * | 2008-07-25 | 2013-08-20 | Broadcom Corporation | Single microphone wind noise suppression |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3186892B2 (en) | 1993-03-16 | 2001-07-11 | ソニー株式会社 | Wind noise reduction device |
US20040236573A1 (en) | 2001-06-19 | 2004-11-25 | Sapeluk Andrew Thomas | Speaker recognition systems |
US7457757B1 (en) * | 2002-05-30 | 2008-11-25 | Plantronics, Inc. | Intelligibility control for speech communications systems |
EP2254349A3 (en) | 2003-03-03 | 2014-08-13 | Phonak AG | Method for manufacturing acoustical devices and for reducing wind disturbances |
CN1322488C (en) | 2004-04-14 | 2007-06-20 | 华为技术有限公司 | Method for strengthening sound |
EP1715669A1 (en) * | 2005-04-19 | 2006-10-25 | Ecole Polytechnique Federale De Lausanne (Epfl) | A method for removing echo in an audio signal |
CN101154382A (en) | 2006-09-29 | 2008-04-02 | 松下电器产业株式会社 | Method and system for detecting wind noise |
DE102007048973B4 (en) | 2007-10-12 | 2010-11-18 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for generating a multi-channel signal with voice signal processing |
JP5257366B2 (en) | 2007-12-19 | 2013-08-07 | 富士通株式会社 | Noise suppression device, noise suppression control device, noise suppression method, and noise suppression program |
JP5453740B2 (en) * | 2008-07-02 | 2014-03-26 | 富士通株式会社 | Speech enhancement device |
WO2010066008A1 (en) | 2008-12-10 | 2010-06-17 | The University Of Queensland | Multi-parametric analysis of snore sounds for the community screening of sleep apnea with non-gaussianity index |
CN101430882B (en) | 2008-12-22 | 2012-11-28 | 无锡中星微电子有限公司 | Method and apparatus for restraining wind noise |
GB2466668A (en) * | 2009-01-06 | 2010-07-07 | Skype Ltd | Speech filtering |
CN101543823A (en) * | 2009-04-27 | 2009-09-30 | 于长海 | Automatic cleaning machine of air cleaner |
CN101582264A (en) | 2009-06-12 | 2009-11-18 | 瑞声声学科技(深圳)有限公司 | Method and voice collecting system for speech enhancement |
JP5347794B2 (en) * | 2009-07-21 | 2013-11-20 | ヤマハ株式会社 | Echo suppression method and apparatus |
CA2798282A1 (en) | 2010-05-03 | 2011-11-10 | Nicolas Petit | Wind suppression/replacement component for use with electronic systems |
JP5672437B2 (en) | 2010-09-14 | 2015-02-18 | カシオ計算機株式会社 | Noise suppression device, noise suppression method and program |
-
2012
- 2012-05-14 US US13/471,085 patent/US9280984B2/en not_active Expired - Fee Related
- 2012-07-27 TW TW101127134A patent/TWI543149B/en not_active IP Right Cessation
- 2012-08-17 CN CN201210294872.4A patent/CN103426433B/en not_active Expired - Fee Related
- 2012-08-17 CN CN201610194842.4A patent/CN105741847A/en active Pending
-
2013
- 2013-04-09 DE DE102013006163A patent/DE102013006163A1/en not_active Withdrawn
-
2016
- 2016-01-21 US US15/003,629 patent/US9711164B2/en not_active Expired - Fee Related
Patent Citations (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4630304A (en) * | 1985-07-01 | 1986-12-16 | Motorola, Inc. | Automatic background noise estimator for a noise suppression system |
US5012519A (en) * | 1987-12-25 | 1991-04-30 | The Dsp Group, Inc. | Noise reduction system |
US6038532A (en) * | 1990-01-18 | 2000-03-14 | Matsushita Electric Industrial Co., Ltd. | Signal processing device for cancelling noise in a signal |
US5400409A (en) * | 1992-12-23 | 1995-03-21 | Daimler-Benz Ag | Noise-reduction method for noise-affected voice channels |
US5742927A (en) * | 1993-02-12 | 1998-04-21 | British Telecommunications Public Limited Company | Noise reduction apparatus using spectral subtraction or scaling and signal attenuation between formant regions |
US5839101A (en) * | 1995-12-12 | 1998-11-17 | Nokia Mobile Phones Ltd. | Noise suppressor and method for suppressing background noise in noisy speech, and a mobile station |
US5933495A (en) * | 1997-02-07 | 1999-08-03 | Texas Instruments Incorporated | Subband acoustic noise suppression |
US6044341A (en) * | 1997-07-16 | 2000-03-28 | Olympus Optical Co., Ltd. | Noise suppression apparatus and recording medium recording processing program for performing noise removal from voice |
US6122384A (en) * | 1997-09-02 | 2000-09-19 | Qualcomm Inc. | Noise suppression system and method |
US6480823B1 (en) * | 1998-03-24 | 2002-11-12 | Matsushita Electric Industrial Co., Ltd. | Speech detection for noisy conditions |
US6295364B1 (en) * | 1998-03-30 | 2001-09-25 | Digisonix, Llc | Simplified communication system |
US20010016020A1 (en) * | 1999-04-12 | 2001-08-23 | Harald Gustafsson | System and method for dual microphone signal noise reduction using spectral subtraction |
US6510224B1 (en) * | 1999-05-20 | 2003-01-21 | Telefonaktiebolaget L M Ericsson | Enhancement of near-end voice signals in an echo suppression system |
US6766292B1 (en) * | 2000-03-28 | 2004-07-20 | Tellabs Operations, Inc. | Relative noise ratio weighting techniques for adaptive noise cancellation |
US20030040908A1 (en) * | 2001-02-12 | 2003-02-27 | Fortemedia, Inc. | Noise suppression for speech signal in an automobile |
US20040111258A1 (en) * | 2002-12-10 | 2004-06-10 | Zangi Kambiz C. | Method and apparatus for noise reduction |
US7885420B2 (en) * | 2003-02-21 | 2011-02-08 | Qnx Software Systems Co. | Wind noise suppression system |
US20040167777A1 (en) * | 2003-02-21 | 2004-08-26 | Hetherington Phillip A. | System for suppressing wind noise |
US20050213778A1 (en) * | 2004-03-17 | 2005-09-29 | Markus Buck | System for detecting and reducing noise via a microphone array |
US20070280472A1 (en) * | 2006-05-30 | 2007-12-06 | Microsoft Corporation | Adaptive acoustic echo cancellation |
US20080069373A1 (en) * | 2006-09-20 | 2008-03-20 | Broadcom Corporation | Low frequency noise reduction circuit architecture for communications applications |
US20080077399A1 (en) * | 2006-09-25 | 2008-03-27 | Sanyo Electric Co., Ltd. | Low-frequency-band voice reconstructing device, voice signal processor and recording apparatus |
US20090119099A1 (en) * | 2007-11-06 | 2009-05-07 | Htc Corporation | System and method for automobile noise suppression |
US20090248411A1 (en) * | 2008-03-28 | 2009-10-01 | Alon Konchitsky | Front-End Noise Reduction for Speech Recognition Engine |
US20090281805A1 (en) * | 2008-05-12 | 2009-11-12 | Broadcom Corporation | Integrated speech intelligibility enhancement system and acoustic echo canceller |
US8515097B2 (en) * | 2008-07-25 | 2013-08-20 | Broadcom Corporation | Single microphone wind noise suppression |
US20100082339A1 (en) * | 2008-09-30 | 2010-04-01 | Alon Konchitsky | Wind Noise Reduction |
US20110004470A1 (en) * | 2009-07-02 | 2011-01-06 | Mr. Alon Konchitsky | Method for Wind Noise Reduction |
US20130196715A1 (en) * | 2012-01-30 | 2013-08-01 | Research In Motion Limited | Adjusted noise suppression and voice activity detection |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105966339A (en) * | 2015-11-10 | 2016-09-28 | 乐卡汽车智能科技(北京)有限公司 | Method and device for vehicle alarming |
CN110786022A (en) * | 2018-11-14 | 2020-02-11 | 深圳市大疆创新科技有限公司 | Wind noise processing method, device and system based on multiple microphones and storage medium |
CN109905803A (en) * | 2019-03-01 | 2019-06-18 | 深圳市沃特沃德股份有限公司 | Switching method, device, storage medium and the computer equipment of microphone array |
Also Published As
Publication number | Publication date |
---|---|
DE102013006163A1 (en) | 2013-11-14 |
TWI543149B (en) | 2016-07-21 |
CN105741847A (en) | 2016-07-06 |
CN103426433B (en) | 2016-05-04 |
US9280984B2 (en) | 2016-03-08 |
US20160140977A1 (en) | 2016-05-19 |
CN103426433A (en) | 2013-12-04 |
TW201346889A (en) | 2013-11-16 |
US9711164B2 (en) | 2017-07-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9711164B2 (en) | Noise cancellation method | |
US9111543B2 (en) | Processing signals | |
EP3348047B1 (en) | Audio signal processing | |
US9076456B1 (en) | System and method for providing voice equalization | |
US7930175B2 (en) | Background noise reduction system | |
US9106196B2 (en) | Sound field spatial stabilizer with echo spectral coherence compensation | |
EP2982101B1 (en) | Noise reduction | |
US11380312B1 (en) | Residual echo suppression for keyword detection | |
US8543390B2 (en) | Multi-channel periodic signal enhancement system | |
EP2449754A1 (en) | Apparatus, method and computer program for controlling an acoustic signal | |
KR20160076059A (en) | Display apparatus and method for echo cancellation thereof | |
US20160073209A1 (en) | Maintaining spatial stability utilizing common gain coefficient | |
US9099973B2 (en) | Sound field spatial stabilizer with structured noise compensation | |
US9743179B2 (en) | Sound field spatial stabilizer with structured noise compensation | |
JP5985306B2 (en) | Noise reduction apparatus and noise reduction method | |
CN102970638B (en) | Processing signals | |
EP2816818B1 (en) | Sound field spatial stabilizer with echo spectral coherence compensation | |
EP2816817B1 (en) | Sound field spatial stabilizer with spectral coherence compensation | |
US11259117B1 (en) | Dereverberation and noise reduction | |
EP2816816B1 (en) | Sound field spatial stabilizer with structured noise compensation | |
CA2835991C (en) | Sound field spatial stabilizer |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: HTC CORPORATION, TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHEN, LEI;LAI, YU-CHIEH;HU, CHUN-REN;AND OTHERS;REEL/FRAME:028207/0929 Effective date: 20120508 |
|
ZAAA | Notice of allowance and fees due |
Free format text: ORIGINAL CODE: NOA |
|
ZAAB | Notice of allowance mailed |
Free format text: ORIGINAL CODE: MN/=. |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20240308 |