CN111243611B - Microphone wind noise elimination method and device, storage medium and mobile terminal - Google Patents
Microphone wind noise elimination method and device, storage medium and mobile terminal Download PDFInfo
- Publication number
- CN111243611B CN111243611B CN201811446221.6A CN201811446221A CN111243611B CN 111243611 B CN111243611 B CN 111243611B CN 201811446221 A CN201811446221 A CN 201811446221A CN 111243611 B CN111243611 B CN 111243611B
- Authority
- CN
- China
- Prior art keywords
- sound signal
- wind noise
- microphone
- microphones
- peak
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000008030 elimination Effects 0.000 title claims abstract description 16
- 238000003379 elimination reaction Methods 0.000 title claims abstract description 16
- 230000005236 sound signal Effects 0.000 claims abstract description 224
- 238000012545 processing Methods 0.000 claims abstract description 14
- 238000010586 diagram Methods 0.000 claims description 15
- 238000001514 detection method Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 abstract description 5
- 238000004891 communication Methods 0.000 description 11
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L21/0224—Processing in the time domain
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/19—Arrangements of transmitters, receivers, or complete sets to prevent eavesdropping, to attenuate local noise or to prevent undesired transmission; Mouthpieces or receivers specially adapted therefor
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Circuit For Audible Band Transducer (AREA)
- Telephone Function (AREA)
Abstract
The present disclosure relates to a method, an apparatus, a storage medium, and a mobile terminal for eliminating wind noise of a microphone, the method comprising: when sound signals are received by the plurality of microphones, acquiring a first sound signal received by the main microphone; determining whether wind noise occurs in the primary microphone according to a peak factor of the first sound signal, wherein the peak factor is used for representing the degree of clipping distortion of the first sound signal; when wind noise occurs in the main microphone, the first sound signal of the target sound signal is switched to the second sound signal received by the auxiliary microphone, and the target sound signal is the main sound signal adopted when the noise elimination module carries out sound signal processing and outputting. When wind noise occurs in the main microphone, the sound signals collected by the auxiliary microphones arranged at different positions are used as the main sound signals for sound transmission of the mobile terminal, the influence of the wind noise on the conversation quality is reduced, and the user experience of conversation of the mobile terminal is improved.
Description
Technical Field
The present disclosure relates to the field of mobile terminal design, and in particular, to a method and an apparatus for eliminating wind noise of a microphone, a storage medium, and a mobile terminal.
Background
When a mobile terminal user holds the mobile terminal for conversation in a strong wind environment, the sound collected by the microphone is influenced by wind to generate wind noise. In the related art, in order to reduce the influence of noise on the call quality, most mobile terminals are provided with two or more microphones at different positions, and receive sound signals collected by a plurality of microphones through a noise cancellation module; and then, taking the sound signal collected by the main microphone arranged at the bottom of the mobile terminal as a main sound signal, taking the sound signal collected by the auxiliary microphones arranged at other positions as a reference signal to carry out noise reduction processing on the main sound signal, and outputting the processed main sound signal to the other party of the call. However, when the main microphone faces the direction of the wind, the sound pressure level of the wind noise collected by the main microphone is usually very high, so that the main sound signal processed by the noise cancellation module still cannot be recognized by the human ear, and thus the call quality is reduced, and the call experience of the user is affected.
Disclosure of Invention
To overcome the problems in the related art, the present disclosure provides a method and apparatus for eliminating wind noise of a microphone, a storage medium, and a mobile terminal.
According to a first aspect of the embodiments of the present disclosure, there is provided a method for eliminating wind noise of a microphone, applied to a mobile terminal, the mobile terminal including: the mobile terminal comprises a noise elimination module and a plurality of microphones arranged at different positions of the mobile terminal, wherein the microphones comprise a main microphone and one or more auxiliary microphones, and the method comprises the following steps:
acquiring a first sound signal received by the main microphone when sound signals are received by the plurality of microphones;
determining whether wind noise is present at the primary microphone according to a peak factor of the first sound signal, wherein the peak factor is used for representing the degree of clipping distortion of the first sound signal;
when wind noise occurs in the main microphone, the first sound signal of the target sound signal is switched to the second sound signal received by the auxiliary microphone, and the target sound signal is the main sound signal adopted when the noise elimination module carries out sound signal processing and outputting.
Optionally, the determining whether the main microphone generates wind noise according to the peak factor of the first sound signal includes:
determining a time domain waveform map of the first sound signal;
calculating a difference value between a peak value and an effective value of the waveform of the first sound signal in the time domain waveform diagram as the peak value factor;
and determining whether wind noise occurs in the main microphone according to the comparison result of the peak factor and a preset peak factor threshold value.
Optionally, the determining whether the main microphone generates wind noise according to the comparison result between the peak factor and a preset peak factor threshold includes:
when the peak factor is larger than a preset peak factor threshold value, determining that wind noise does not occur in the main microphone; or,
and when the peak factor is smaller than or equal to a preset peak factor threshold value, determining that wind noise occurs in the main microphone.
Optionally, the multiple microphones include a main microphone and multiple auxiliary microphones, and when wind noise occurs in the main microphone, the method switches the target sound signal from the first sound signal to a second sound signal received by the auxiliary microphone, and includes:
acquiring a plurality of peak factors corresponding to a plurality of sound signals received by the plurality of auxiliary microphones;
determining a sound signal having a largest crest factor among the plurality of sound signals as the second sound signal;
and taking the second sound signal as the target sound signal.
According to a second aspect of the embodiments of the present disclosure, there is provided a wind noise cancellation apparatus for a microphone, applied to a mobile terminal, the mobile terminal including: the device comprises a noise elimination module and a plurality of microphones arranged at different positions of the mobile terminal, wherein the microphones comprise a main microphone and one or more auxiliary microphones, and the device comprises:
a signal acquisition module, configured to acquire a first sound signal received by the main microphone when sound signals are received by the plurality of microphones;
a wind noise detection module for determining whether wind noise occurs in the primary microphone according to a peak factor of the first sound signal, wherein the peak factor is used for representing the degree of clipping distortion of the first sound signal;
and the signal switching module is used for switching the target sound signal from the first sound signal to a second sound signal received by the auxiliary microphone when wind noise occurs in the main microphone, wherein the target sound signal is the main sound signal adopted when the noise elimination module carries out sound signal processing and outputting.
Optionally, the wind noise detection module includes:
a waveform map determination submodule for determining a time domain waveform map of the first sound signal;
a difference value calculating submodule for calculating a difference value between a peak value and an effective value of the waveform of the first sound signal in the time domain waveform diagram as the peak value factor;
and the wind noise detection submodule is used for determining whether wind noise occurs in the main microphone according to the comparison result of the peak value factor and a preset peak value factor threshold value.
Optionally, the wind noise detection sub-module is configured to:
when the peak factor is larger than a preset peak factor threshold value, determining that wind noise does not occur in the main microphone; or,
and when the peak factor is smaller than or equal to a preset peak factor threshold value, determining that wind noise occurs in the main microphone.
Optionally, the microphones include a main microphone and a plurality of auxiliary microphones, and the signal switching module includes:
the peak factor acquisition submodule is used for acquiring a plurality of peak factors corresponding to a plurality of sound signals received by the plurality of auxiliary microphones;
a signal determination sub-module for determining the sound signal having the largest peaking factor among the plurality of sound signals as the second sound signal;
and the signal switching submodule is used for taking the second sound signal as the target sound signal.
According to a third aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium, having stored thereon a computer program, which when executed by a processor, performs the steps of the method as described in the first aspect of embodiments of the present disclosure.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a mobile terminal including:
the computer-readable storage medium described in the third aspect of the embodiments of the present disclosure; and
one or more processors to execute the computer program in the computer-readable storage medium.
The microphone wind noise eliminating method, device, storage medium and mobile terminal provided by the present disclosure can acquire a first sound signal received by the main microphone when sound signals are received by the plurality of microphones; determining whether wind noise occurs in the primary microphone according to a peak factor of the first sound signal, wherein the peak factor is used for representing the degree of clipping distortion of the first sound signal; when wind noise occurs in the main microphone, the first sound signal of the target sound signal is switched to the second sound signal received by the auxiliary microphone, and the target sound signal is the main sound signal adopted when the noise elimination module carries out sound signal processing and outputting. When wind noise occurs in the main microphone, the sound signals collected by the auxiliary microphones arranged at different positions are used as the main sound signals for sound transmission of the mobile terminal, the influence of the wind noise on the conversation quality is reduced, and the user experience of conversation of the mobile terminal is improved.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure without limiting the disclosure. In the drawings:
fig. 1 is a flow chart illustrating a method of wind noise cancellation for a microphone according to an exemplary embodiment;
FIG. 2 is a flow chart of a method of detecting wind noise of a microphone according to the embodiment shown in FIG. 1;
FIG. 3 is a flow chart of a method of switching sound signals according to the embodiment shown in FIG. 1;
fig. 4 is a block diagram illustrating a wind noise canceling device of a microphone according to an exemplary embodiment;
FIG. 5 is a block diagram of a wind noise detection module according to the embodiment shown in FIG. 4;
FIG. 6 is a block diagram of a signal switching module according to the embodiment shown in FIG. 4;
fig. 7 is a block diagram illustrating a mobile terminal according to an exemplary embodiment of the present application.
Detailed Description
The following detailed description of the embodiments of the disclosure refers to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating the present disclosure, are given by way of illustration and explanation only, not limitation.
The mobile terminal or called mobile communication terminal of the present disclosure refers to a computer device that can be used in mobile, including a mobile phone, a notebook, a tablet computer, a POS machine, a vehicle-mounted computer, an intelligent navigator, a wearable device, a VR device, and the like, which is not limited herein.
Fig. 1 is a flowchart illustrating a method for canceling wind noise of a microphone according to an exemplary embodiment, which is applied to a mobile terminal, as shown in fig. 1, and includes: the method comprises the following steps of eliminating noise, and arranging a plurality of microphones at different positions of the mobile terminal, wherein the plurality of microphones comprise a main microphone and one or more auxiliary microphones.
For example, the primary microphone may be disposed at the bottom of the mobile terminal, so that the primary microphone has the best sound reception effect when the user holds the mobile terminal for a call, and the one or more secondary microphones may be disposed at the top of the mobile terminal. The first sound signal is a sound signal obtained within a preset time period in the user call process, and the preset time period is very short, for example, 0.1 second. The main microphone and the auxiliary microphone may also be disposed at other positions of the mobile terminal, and the positions thereof are not particularly limited.
And 102, determining whether wind noise occurs in the main microphone according to the crest factor of the first sound signal.
Wherein the crest factor is used to represent a degree of clipping distortion of the first sound signal. When the sound pressure received by the sound signal is too high, the decibel value of the sound exceeds 0dbFS (Full decibel Scale), and the waveform of the exceeding part of the sound signal is flattened, i.e. the above-mentioned clipping distortion (or top-clipping distortion) occurs. dbFS is a method for representing the decibel value of the audio frequency, and the reference is the maximum decibel value, that is, 0dbFS is the maximum decibel value that the digital equipment can achieve, and is a negative value except the maximum decibel value. The peak factor may be used to determine the degree of clipping distortion of the first sound signal and thus whether wind noise is present at the primary microphone.
For example, when wind noise does not occur in the main microphone, the noise cancellation module receives the sound signals collected by a plurality of microphones, and then takes the sound signals collected by the main microphone arranged at the bottom of the mobile terminal as the main sound signals, and takes the sound signals collected by the auxiliary microphones arranged at other positions as reference signals to perform noise reduction processing on the main sound signals and output the main sound signals to the other party of the call. When wind noise occurs in the main microphone, the following step 103 is continued.
The target sound signal is a main sound signal adopted when the noise elimination module carries out sound signal processing and outputting.
For example, when the main microphone generates wind noise, the sound signal received by the main microphone may be considered to generate a large amount of clipping distortion, and thus the sound signal received by the main microphone may not be used as the main sound signal of the noise cancellation module. Therefore, when the mobile terminal includes only one sub microphone, the first sound signal is ignored, and the sound signal collected by the sub microphone (i.e., the second sound signal) is directly output as the main sound signal (i.e., the target sound signal) to the other party of the call. When the mobile terminal includes a plurality of auxiliary microphones, the first sound signal is ignored, an auxiliary microphone with the smallest influence of wind noise is selected from the plurality of auxiliary microphones, and the sound signal (i.e. the second sound signal) collected by the auxiliary microphone with the smallest influence of wind noise is directly output to the other party of the call as a main sound signal (i.e. the target sound signal).
In summary, the method for eliminating wind noise of a microphone according to the present disclosure can acquire a first sound signal received by the main microphone when the plurality of microphones receive sound signals; determining whether wind noise occurs in the primary microphone according to a peak factor of the first sound signal, wherein the peak factor is used for representing the degree of clipping distortion of the first sound signal; when wind noise occurs in the main microphone, the first sound signal of the target sound signal is switched to the second sound signal received by the auxiliary microphone, and the target sound signal is the main sound signal adopted when the noise elimination module carries out sound signal processing and outputting. When wind noise occurs in the main microphone, the sound signals collected by the auxiliary microphones arranged at different positions are used as the main sound signals of sound transmission of the mobile terminal, the influence of the wind noise on the conversation quality is reduced, and the user experience of conversation of the mobile terminal is improved.
Fig. 2 is a flowchart illustrating a method for detecting wind noise of a microphone according to the embodiment shown in fig. 1, where, as shown in fig. 2, the step 102 includes the following steps.
Illustratively, the time domain waveform diagram is used for displaying the waveform change of the decibel value of the first sound signal within a preset time period.
In step 1022, a difference between the peak value and the effective value of the waveform of the first sound signal in the time domain waveform diagram is calculated as the peak value factor.
This effective value is illustratively RMS (Root mean square), which is actually the square Root of the average of the squares of a set of statistics (here, the decibel values of the first sound signal at each instant). The effective value is a measure of the sinusoidal signal at the same amplitude as the peak of the sound signal, close to the average value. The Peak value (Peak) is the maximum level reached by the signal. The peak factor is equal to the peak minus the effective value. For example, the effective value of the waveform of the first sound signal is-5.45 dbFS and the peak value is-1.3 dbFS, and at this time, the crest factor = peak-effective value =4.1dbFS.
And 1023, determining whether the wind noise occurs in the main microphone according to the comparison result of the peak factor and a preset peak factor threshold.
Illustratively, this step 1023 includes: when the peak factor is larger than a preset peak factor threshold value, determining that wind noise does not occur in the main microphone; or when the peak factor is smaller than or equal to a preset peak factor threshold value, determining that the main microphone generates wind noise. The crest factor threshold may be determined by performing a corresponding debugging on a particular product. Typically, the crest factor threshold may be set to 6db.
Fig. 3 is a flowchart illustrating a method for switching sound signals according to the embodiment shown in fig. 1, where, as shown in fig. 3, the plurality of microphones include a primary microphone and a plurality of secondary microphones, and step 103 may include the following steps.
In step 1032, the audio signal having the largest crest factor among the plurality of audio signals is determined as the second audio signal.
For example, when a plurality of secondary microphones are disposed on the mobile terminal, the sound signal having the largest peak factor (i.e., the sound signal minimally affected by wind noise) may be determined according to a plurality of peak factors corresponding to a plurality of sound signals received by the plurality of secondary microphones, and the determined sound signal may be used as the main sound signal for the noise cancellation module to process and output the sound signal.
In summary, the method for eliminating wind noise of a microphone according to the present disclosure can acquire a first sound signal received by the main microphone when the plurality of microphones receive sound signals; determining whether wind noise occurs in the primary microphone according to a peak factor of the first sound signal, wherein the peak factor is used for representing the degree of clipping distortion of the first sound signal; when wind noise occurs in the main microphone, the first sound signal of the target sound signal is switched to the second sound signal received by the auxiliary microphone, and the target sound signal is the main sound signal adopted when the noise elimination module carries out sound signal processing and outputting. When wind noise occurs in the main microphone, sound signals collected by the auxiliary microphones which are arranged in the auxiliary microphones at different positions and have the minimum influence of the wind noise are used as main sound signals of sound transmission of the mobile terminal, so that the influence of the wind noise on the communication quality is reduced, and the user experience of communication of the mobile terminal is improved.
Fig. 4 is a block diagram illustrating a wind noise canceling apparatus of a microphone according to an exemplary embodiment, which is applied to a mobile terminal including: a noise cancellation module, and a plurality of microphones disposed at different positions of the mobile terminal, where the plurality of microphones includes a main microphone and one or more auxiliary microphones, and the apparatus 400 for canceling wind noise of the microphone can be used to execute the method shown in fig. 1. Referring to fig. 4, the apparatus 400 may include:
a signal acquiring module 410, configured to acquire a first sound signal received by the main microphone when sound signals are received by the plurality of microphones;
a wind noise detection module 420 for determining whether wind noise is present at the primary microphone according to a peak factor of the first sound signal, the peak factor being indicative of a degree of clipping distortion of the first sound signal;
and a signal switching module 430, configured to switch a target sound signal from the first sound signal to a second sound signal received by the auxiliary microphone, where the target sound signal is a main sound signal adopted when the noise cancellation module performs sound signal processing and outputs the main sound signal.
Fig. 5 is a block diagram of a wind noise detection module 420 that may be used to perform the method shown in fig. 2, according to the embodiment shown in fig. 4. Referring to fig. 5, the wind noise detection module 420 includes:
a waveform map determining submodule 421 for determining a time-domain waveform map of the first sound signal;
a difference value calculating submodule 422, configured to calculate a difference value between a peak value and an effective value of the waveform of the first sound signal in the time-domain waveform diagram, as the peak value factor;
and the wind noise detection submodule 423 is configured to determine whether wind noise occurs in the primary microphone according to a comparison result between the peak factor and a preset peak factor threshold.
Optionally, the wind noise detection submodule 423 is configured to:
when the peak factor is larger than a preset peak factor threshold value, determining that wind noise does not occur in the main microphone; or,
and when the peak factor is smaller than or equal to a preset peak factor threshold value, determining that the main microphone generates wind noise.
Fig. 6 is a block diagram of a signal switching module according to the embodiment shown in fig. 4, where the plurality of microphones includes a primary microphone and a plurality of secondary microphones, and the signal switching module 430 may be used to perform the method shown in fig. 3. Referring to fig. 6, the signal switching module 430 includes:
a crest factor obtaining submodule 431, configured to obtain a plurality of crest factors corresponding to a plurality of sound signals received by the plurality of secondary microphones;
a signal determining submodule 432 for determining the sound signal having the largest crest factor among the plurality of sound signals as the second sound signal;
and a signal switching submodule 433, configured to use the second sound signal as the target sound signal.
In summary, the wind noise cancellation apparatus for microphones according to the present disclosure can acquire a first sound signal received by the main microphone when the plurality of microphones receive sound signals; determining whether wind noise occurs in the primary microphone according to a peak factor of the first sound signal, wherein the peak factor is used for representing the degree of clipping distortion of the first sound signal; when wind noise occurs in the main microphone, the first sound signal of the target sound signal is switched to the second sound signal received by the auxiliary microphone, and the target sound signal is the main sound signal adopted when the noise elimination module carries out sound signal processing and outputting. When the main microphone generates wind noise, the sound signal collected by the auxiliary microphone with the minimum wind noise influence in the auxiliary microphones arranged at different positions is used as the main sound signal for sound transmission of the mobile terminal, so that the influence of the wind noise on the communication quality is reduced, and the user experience of the communication of the mobile terminal is improved.
Fig. 7 is a block diagram illustrating a mobile terminal 700 according to an exemplary embodiment of the present application, where the mobile terminal 700 may be used to execute a method for eliminating wind noise of a microphone according to any embodiment of the present application. As shown in fig. 7, the mobile terminal 700 may include: a processor 701, a memory 702, multimedia components 703, input/output (I/O) interfaces 704, and a communications component 707.
The processor 701 is configured to control the overall operation of the mobile terminal 700, so as to complete all or part of the steps in the method for eliminating the wind noise of the microphone shown in fig. 1 or fig. 2. Memory 702 is used to store various types of data to support operations at mobile terminal 700, such as instructions for any application or method operating on mobile terminal 700 and application-related data. The Memory 702 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically Erasable Programmable Read-Only Memory (EEPROM), erasable Programmable Read-Only Memory (EPROM), programmable Read-Only Memory (PROM), read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk, or optical disk. The multimedia components 703 may include screen and audio components. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may further be stored in the memory 702 or transmitted through the communication component 707. The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 704 provides an interface between the processor 701 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 707 provides for wired or wireless communication between the mobile terminal 700 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or one or a combination thereof, which is not limited herein. The corresponding communication component 707 can therefore include: wi-Fi module, bluetooth module, NFC module, etc.
In an exemplary embodiment, the mobile terminal 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components, and may be used to implement the wind noise cancellation method for microphones according to any of the embodiments of the present disclosure.
In another exemplary embodiment, there is also provided a computer-readable storage medium including program instructions, having a computer program stored thereon, which when executed by a processor, implements the method of wind noise cancellation for a microphone provided in any of the embodiments of the present application.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
The preferred embodiments of the present disclosure are described in detail with reference to the accompanying drawings, however, the present disclosure is not limited to the specific details of the above embodiments, and various simple modifications may be made to the technical solution of the present disclosure within the technical idea of the present disclosure, and these simple modifications all belong to the protection scope of the present disclosure.
It should be noted that, in the above embodiments, the various features described in the above embodiments may be combined in any suitable manner, and in order to avoid unnecessary repetition, various possible combinations will not be further described in the present disclosure.
In addition, any combination of various embodiments of the present disclosure may be made, and the same should be considered as the disclosure of the present disclosure, as long as it does not depart from the spirit of the present disclosure.
Claims (8)
1. A method for eliminating wind noise of a microphone is applied to a mobile terminal, and the mobile terminal comprises the following steps: the mobile terminal comprises a noise elimination module and a plurality of microphones arranged at different positions of the mobile terminal, wherein the microphones comprise a main microphone and one or more auxiliary microphones, and the method comprises the following steps:
acquiring a first sound signal received by the main microphone when sound signals are received by the plurality of microphones;
determining whether wind noise occurs in the primary microphone according to a peak factor of the first sound signal, wherein the peak factor is used for representing the degree of clipping distortion of the first sound signal;
when wind noise occurs in the main microphone, switching a target sound signal from the first sound signal to a second sound signal received by the auxiliary microphone, wherein the target sound signal is the main sound signal adopted when the noise elimination module carries out sound signal processing and outputting;
the determining whether wind noise occurs in the main microphone according to the peak factor of the first sound signal comprises:
determining a time domain waveform map of the first sound signal;
calculating a difference value between a peak value and an effective value of the waveform of the first sound signal in the time domain waveform diagram as the peak value factor;
and determining whether wind noise occurs in the main microphone according to the comparison result of the peak factor and a preset peak factor threshold value.
2. The method of claim 1, wherein determining whether the primary microphone has wind noise according to the comparison of the crest factor and a preset crest factor threshold comprises:
when the peak factor is larger than a preset peak factor threshold value, determining that wind noise does not occur in the main microphone; or,
and when the peak factor is smaller than or equal to a preset peak factor threshold value, determining that wind noise occurs in the main microphone.
3. The method of claim 1, wherein the plurality of microphones comprises a primary microphone and a plurality of secondary microphones, and wherein switching the target sound signal from the first sound signal to the second sound signal received by the secondary microphones when wind noise occurs in the primary microphone comprises:
acquiring a plurality of peak factors corresponding to a plurality of sound signals received by the plurality of auxiliary microphones;
determining a sound signal having a largest crest factor among the plurality of sound signals as the second sound signal;
and taking the second sound signal as the target sound signal.
4. A wind noise cancellation apparatus of a microphone, applied to a mobile terminal, the mobile terminal comprising: the device comprises a noise elimination module and a plurality of microphones arranged at different positions of the mobile terminal, wherein the microphones comprise a main microphone and one or more auxiliary microphones, and the device comprises:
a signal acquisition module, configured to acquire a first sound signal received by the main microphone when sound signals are received by the plurality of microphones;
a wind noise detection module, configured to determine whether wind noise occurs in the primary microphone according to a peak factor of the first sound signal, where the peak factor is used to indicate a degree of clipping distortion of the first sound signal;
the signal switching module is used for switching a target sound signal from the first sound signal to a second sound signal received by the auxiliary microphone when wind noise occurs in the main microphone, wherein the target sound signal is the main sound signal adopted when the noise elimination module carries out sound signal processing and outputting;
the wind noise detection module includes:
a waveform map determination submodule for determining a time domain waveform map of the first sound signal;
a difference value calculating submodule for calculating a difference value between a peak value and an effective value of the waveform of the first sound signal in the time domain waveform diagram as the peak value factor;
and the wind noise detection submodule is used for determining whether wind noise occurs in the main microphone according to the comparison result of the peak value factor and a preset peak value factor threshold value.
5. The apparatus of claim 4, wherein the wind noise detection submodule is configured to:
when the peak factor is larger than a preset peak factor threshold value, determining that wind noise does not occur in the main microphone; or,
and when the peak factor is smaller than or equal to a preset peak factor threshold value, determining that wind noise occurs in the main microphone.
6. The apparatus of claim 4, wherein the plurality of microphones comprises a primary microphone and a plurality of secondary microphones, and the signal switching module comprises:
the peak factor acquisition submodule is used for acquiring a plurality of peak factors corresponding to a plurality of sound signals received by the plurality of auxiliary microphones;
a signal determination sub-module for determining the sound signal having the largest crest factor among the plurality of sound signals as the second sound signal;
and the signal switching submodule is used for taking the second sound signal as the target sound signal.
7. A computer-readable storage medium, on which computer program instructions are stored, which program instructions, when executed by a processor, carry out the steps of the method according to any one of claims 1 to 3.
8. A mobile terminal, comprising:
the computer-readable storage medium recited in claim 7; and
one or more processors to execute the computer program in the computer-readable storage medium.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811446221.6A CN111243611B (en) | 2018-11-29 | 2018-11-29 | Microphone wind noise elimination method and device, storage medium and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811446221.6A CN111243611B (en) | 2018-11-29 | 2018-11-29 | Microphone wind noise elimination method and device, storage medium and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111243611A CN111243611A (en) | 2020-06-05 |
| CN111243611B true CN111243611B (en) | 2022-12-27 |
Family
ID=70872217
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811446221.6A Active CN111243611B (en) | 2018-11-29 | 2018-11-29 | Microphone wind noise elimination method and device, storage medium and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111243611B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101185370A (en) * | 2005-04-29 | 2008-05-21 | 哈曼贝克自动系统股份有限公司 | Detection and surpression of wind noise in microphone signals |
| US8781137B1 (en) * | 2010-04-27 | 2014-07-15 | Audience, Inc. | Wind noise detection and suppression |
| CN105049606A (en) * | 2015-06-17 | 2015-11-11 | 惠州Tcl移动通信有限公司 | Mobile terminal microphone switching method and switching system |
| CN105554202A (en) * | 2015-09-28 | 2016-05-04 | 宇龙计算机通信科技(深圳)有限公司 | Microphone control method and device |
| CN106653039A (en) * | 2016-12-02 | 2017-05-10 | 上海木爷机器人技术有限公司 | Audio signal processing system and audio signal processing method |
| CN106791095A (en) * | 2016-12-21 | 2017-05-31 | 惠州Tcl移动通信有限公司 | A kind of implementation method of automatic improvement call tone quality and realize system |
| CN107742523A (en) * | 2017-11-16 | 2018-02-27 | 广东欧珀移动通信有限公司 | Audio signal processing method, device and mobile terminal |
| WO2018073489A1 (en) * | 2016-10-21 | 2018-04-26 | Nokia Technologies Oy | Detecting the presence of wind noise |
| WO2018107665A1 (en) * | 2016-12-12 | 2018-06-21 | 青岛海尔股份有限公司 | Dual microphone switching method and apparatus |
| CN108737615A (en) * | 2018-06-27 | 2018-11-02 | 努比亚技术有限公司 | microphone reception method, mobile terminal and computer readable storage medium |
-
2018
- 2018-11-29 CN CN201811446221.6A patent/CN111243611B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101185370A (en) * | 2005-04-29 | 2008-05-21 | 哈曼贝克自动系统股份有限公司 | Detection and surpression of wind noise in microphone signals |
| US8781137B1 (en) * | 2010-04-27 | 2014-07-15 | Audience, Inc. | Wind noise detection and suppression |
| CN105049606A (en) * | 2015-06-17 | 2015-11-11 | 惠州Tcl移动通信有限公司 | Mobile terminal microphone switching method and switching system |
| CN105554202A (en) * | 2015-09-28 | 2016-05-04 | 宇龙计算机通信科技(深圳)有限公司 | Microphone control method and device |
| WO2018073489A1 (en) * | 2016-10-21 | 2018-04-26 | Nokia Technologies Oy | Detecting the presence of wind noise |
| CN106653039A (en) * | 2016-12-02 | 2017-05-10 | 上海木爷机器人技术有限公司 | Audio signal processing system and audio signal processing method |
| WO2018107665A1 (en) * | 2016-12-12 | 2018-06-21 | 青岛海尔股份有限公司 | Dual microphone switching method and apparatus |
| CN106791095A (en) * | 2016-12-21 | 2017-05-31 | 惠州Tcl移动通信有限公司 | A kind of implementation method of automatic improvement call tone quality and realize system |
| CN107742523A (en) * | 2017-11-16 | 2018-02-27 | 广东欧珀移动通信有限公司 | Audio signal processing method, device and mobile terminal |
| CN108737615A (en) * | 2018-06-27 | 2018-11-02 | 努比亚技术有限公司 | microphone reception method, mobile terminal and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111243611A (en) | 2020-06-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9432771B2 (en) | Systems and methods for protecting a speaker from overexcursion | |
| CN108076226B (en) | Method for adjusting call quality, mobile terminal and storage medium | |
| EP3048779B1 (en) | Sound volume adjusting method and device | |
| CN106791067B (en) | Call volume adjusting method and device and mobile terminal | |
| US9325286B1 (en) | Audio clipping prevention | |
| US9601128B2 (en) | Communication apparatus and voice processing method therefor | |
| US11375066B2 (en) | Echo suppression device, echo suppression method, and echo suppression program | |
| CN107277209B (en) | Call adjustment method and mobile terminal | |
| CN105245993A (en) | Automatic earphone volume adjusting method and system, and smart earphone | |
| CN105120063A (en) | Volume prompting method of input voice and electronic device | |
| CN113099352B (en) | Audio signal processing method, audio signal processing device, electronic equipment and storage medium | |
| CN105049606A (en) | Mobile terminal microphone switching method and switching system | |
| CN108766453A (en) | Voice de-noising method, device, readable storage medium storing program for executing and mobile terminal | |
| CN107276688B (en) | Radio frequency interference processing method, device, storage medium and mobile terminal | |
| CN112289336A (en) | Audio signal processing method and device | |
| US11025764B2 (en) | Method and system for reducing current noise of touch terminal | |
| CN111243611B (en) | Microphone wind noise elimination method and device, storage medium and mobile terminal | |
| CN106817324B (en) | Frequency response correction method and device | |
| CN107750038B (en) | Volume adjusting method, device, equipment and storage medium | |
| CN107332984B (en) | Voice processing method and mobile terminal | |
| CN110754097B (en) | Call control method, device, terminal equipment and storage medium | |
| CN115835094A (en) | Audio signal processing method, system, device, product and medium | |
| CN111510824B (en) | Audio processing circuit, audio processing method, electronic device, and computer-readable storage medium | |
| CN108228038B (en) | Noise canceling device, noise canceling method, computer-readable storage medium, and electronic apparatus | |
| CN109274826B (en) | Voice playing mode switching method and device, terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 100085 unit C, building C, lin66, Zhufang Road, Qinghe, Haidian District, Beijing Applicant after: Beijing Xiaomi pinecone Electronic Co.,Ltd. Address before: 100085 Beijing city Haidian District Qinghe Shun Yip things Park Building 3 unit A Applicant before: BEIJING PINECONE ELECTRONICS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |