CN115103258A - Wind noise detection method and device and earphone - Google Patents

Wind noise detection method and device and earphone Download PDF

Info

Publication number
CN115103258A
CN115103258A CN202210694065.5A CN202210694065A CN115103258A CN 115103258 A CN115103258 A CN 115103258A CN 202210694065 A CN202210694065 A CN 202210694065A CN 115103258 A CN115103258 A CN 115103258A
Authority
CN
China
Prior art keywords
audio signal
earphone
wind noise
frequency domain
coherence coefficient
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210694065.5A
Other languages
Chinese (zh)
Inventor
晏青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Anker Innovations Co Ltd
Original Assignee
Anker Innovations Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anker Innovations Co Ltd filed Critical Anker Innovations Co Ltd
Priority to CN202210694065.5A priority Critical patent/CN115103258A/en
Publication of CN115103258A publication Critical patent/CN115103258A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083Reduction of ambient noise
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787General system configurations
    • G10K11/17879General system configurations using both a reference signal and an error signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041Mechanical or electronic switches, or control elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091Details not provided for in groups H04R1/1008 - H04R1/1083
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3026Feedback
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3027Feedforward
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30Means
    • G10K2210/301Computational
    • G10K2210/3028Filtering, e.g. Kalman filters or special analogue or digital filters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/10Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)

Abstract

The embodiment of the invention relates to a wind noise detection method, a wind noise detection device and an earphone, wherein the method comprises the following steps: acquiring a first audio signal acquired by a feedforward microphone arranged on an earphone and a second audio signal acquired by a feedback microphone arranged on the earphone; when determining that a loudspeaker arranged on the earphone plays an audio signal, carrying out silencing treatment on the second audio signal to obtain a third audio signal which does not contain the audio signal played by the loudspeaker currently; determining a coherence coefficient between the first audio signal and the third audio signal; determining whether wind noise is present in the headset based on the coherence coefficient. Hereby it is achieved that wind noise detection can be achieved without the aid of other components on the headset, such as a sound receiving microphone, in case the headset is configured to switch on the hybrid ANC mode.

Description

Wind noise detection method and device and earphone
Technical Field
The embodiment of the invention relates to the field of earphones, in particular to a wind noise detection method and device and an earphone.
Background
With the progress of scientific technology and the improvement of living standard of people, earphones become more and more a necessity for mass life and travel, and further earphones with an ANC (Active Noise Cancellation) function can provide a Noise reduction effect in various noisy scenes, such as subways, shopping malls and restaurants, and relieve uncomfortable listening feelings brought to users by external environment Noise.
However, in an outdoor scene, the ANC function is seriously affected by wind noise in the outdoor scene, so that the wind noise heard by a user when wearing the earphone for turning on the ANC function is obviously higher than the actual wind noise in the outdoor scene, and the listening experience of the user is greatly affected.
Therefore, when the earphone is configured to start the ANC function, whether wind noise exists in the external environment where the earphone is located is detected, and then when the wind noise is detected, switching the ANC mode of the earphone is particularly important for improving the listening experience of a user.
Disclosure of Invention
In view of the above, embodiments of the present invention provide a wind noise detection method and apparatus, and an earphone, in order to solve the above technical problems or some technical problems.
In a first aspect, an embodiment of the present invention provides a wind noise detection method, which is applied to a headset configured to turn on a hybrid active noise reduction ANC mode, and the method includes:
acquiring a first audio signal acquired by a feedforward microphone arranged on the earphone and a second audio signal acquired by a feedback microphone arranged on the earphone;
when determining that a loudspeaker arranged on the earphone plays an audio signal, carrying out silencing treatment on the second audio signal to obtain a third audio signal which does not contain the audio signal played by the loudspeaker currently;
determining a coherence coefficient between the first audio signal and the third audio signal;
determining whether wind noise is present in the headset based on the coherence coefficient.
In one possible embodiment, the method further comprises:
determining a coherence coefficient between the first audio signal and the second audio signal when it is determined that the speaker is not playing an audio signal.
In one possible embodiment, the coherence coefficient is determined by:
determining a time-domain coherence coefficient between the first audio signal and a specified audio signal; wherein when it is determined that the speaker plays an audio signal, the designated audio signal is the third audio signal, and when it is determined that the speaker does not play an audio signal, the designated audio signal is the second audio signal;
and dividing the time domain coherence coefficient by the product between the first audio signal power spectrum and the designated audio signal power spectrum to obtain the coherence coefficient between the first audio signal and the designated audio signal.
In one possible embodiment, the coherence coefficient is determined by:
respectively performing time-frequency conversion on the first audio signal and the specified audio signal based on a set frequency domain to obtain a first frequency domain signal corresponding to the first audio signal and a specified frequency domain signal corresponding to the specified audio signal; wherein when it is determined that the speaker plays an audio signal, the designated audio signal is the third audio signal, and when it is determined that the speaker does not play an audio signal, the designated audio signal is the second audio signal;
determining a frequency domain coherence coefficient of the first frequency domain signal and the specified frequency domain signal on each frequency point in the set frequency domain;
and determining the sum value of the frequency domain coherence coefficients on each frequency point as the coherence coefficient between the first audio signal and the specified audio signal.
In a possible embodiment, the determining the frequency domain coherence coefficient of the first frequency domain signal and the specified frequency domain signal at each frequency point in the set frequency domain includes:
and executing the following processing aiming at each frequency point in the set frequency domain:
determining the cross power spectrums of the first frequency domain signal and the specified frequency domain signal on the frequency point, the first power spectrums of the first frequency domain signal on the frequency point, and the second power spectrums of the specified frequency domain signal on the frequency point;
and dividing the cross power spectrum by the square root of the product between the first power spectrum and the second power spectrum to obtain the frequency domain coherence coefficient of the first frequency domain signal and the specified frequency domain signal on the frequency point.
In one possible embodiment, the determining whether the wind noise exists in the earphone based on the coherence coefficient includes:
if the coherence coefficient is determined to be higher than a preset wind noise threshold value, determining that wind noise does not exist in the earphone;
and if the coherence coefficient is not higher than the wind noise threshold value, determining that the wind noise exists in the earphone.
In one possible embodiment, the method further comprises:
and when the wind noise of the earphone is determined, determining the wind noise level of the earphone according to the coherence coefficient, wherein the coherence coefficient is in negative correlation with the wind noise level.
In one possible embodiment, the method further comprises:
controlling the earphone to switch from the hybrid ANC mode to a wind noise ANC mode when the wind noise of the earphone is determined to exist, wherein the earphone plays audio for counteracting the wind noise of the earphone through a loudspeaker under the condition that the earphone is configured to switch on the wind noise ANC mode.
In a second aspect, an embodiment of the present invention provides a wind noise detection apparatus applied to a headset configured to turn on a hybrid active noise reduction ANC mode, the apparatus including:
the acquisition module is used for acquiring a first audio signal acquired by a feedforward microphone arranged on the earphone and a second audio signal acquired by a feedback microphone arranged on the earphone;
the noise reduction module is used for carrying out noise reduction processing on the second audio signal when the fact that the loudspeaker arranged on the earphone plays the audio signal is determined, and a third audio signal which does not contain the audio signal played by the loudspeaker currently is obtained;
a determination module for determining a coherence coefficient between the first audio signal and the third audio signal;
a detection module for determining whether wind noise exists in the earphone based on the coherence coefficient.
In a third aspect, an embodiment of the present invention provides an earphone, including:
an earphone housing;
a feedforward microphone is arranged outside the earphone shell, and a feedback microphone and a loudspeaker are arranged inside the earphone shell;
the headset, when configured to switch on a hybrid ANC mode, performs the wind noise detection method of any of claims 1-7 above.
In a fourth aspect, an embodiment of the present invention provides a storage medium, where the storage medium stores one or more programs, and the one or more programs are executable by one or more processors to implement the wind noise detection method according to any one of the first aspects.
According to the scheme provided by the embodiment of the invention, the first audio signal acquired by the feedforward microphone arranged on the earphone and the second audio signal acquired by the feedback microphone arranged on the earphone are acquired, and whether wind noise exists in the earphone is detected based on the first audio signal and the second audio signal, so that the wind noise detection can be realized without other parts on the earphone, such as a radio microphone, under the condition that the earphone is configured to start a hybrid ANC mode; furthermore, when the fact that the audio signal currently played by the loudspeaker arranged on the earphone is confirmed, the second audio signal is subjected to silencing processing to obtain a third audio signal which does not contain the audio signal currently played by the loudspeaker, the coherence coefficient between the first audio signal and the third audio signal is confirmed, whether wind noise exists in the earphone is confirmed based on the coherence coefficient, interference caused by the audio signal played by the loudspeaker on wind noise detection can be avoided, and accuracy of a wind noise detection result is improved.
Drawings
Fig. 1 is a schematic structural diagram of an earphone according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a wind noise detection method according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of another wind noise detection method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a wind noise detection device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
For the convenience of understanding the embodiments of the present invention, the following first explains the concept terms related to the embodiments of the present invention:
firstly, ANC:
the ANC principle is to generate a reverse sound wave equal to the external noise through the noise reduction system to neutralize the noise, so as to achieve the effect of noise reduction.
Secondly, ANC mode:
currently, ANC techniques are divided into three categories depending on the location of the microphone: feedforward ANC, feedback ANC, mixed ANC, that is, there are three ANC modes, which are feedforward ANC mode, feedback ANC mode, mixed ANC mode, respectively.
The feedforward ANC mode is that a microphone (hereinafter referred to as a feedforward microphone) is arranged outside a shell of the earphone, ambient noise is collected through the feedforward microphone, all noise in the external environment where the earphone is located can be collected, the collected noise is filtered through a feedforward filter, the phase of the collected noise is reversed by 180 degrees, and then the noise is played through a loudspeaker of the earphone.
The post-feed ANC mode is that a microphone (hereinafter referred to as a post-feed microphone) is arranged inside an earphone shell, ambient noise is collected through the post-feed microphone, the noise in the earphone shell can be collected, the collected noise is filtered through a post-feed filter, the phase of the collected noise is inverted by 180 degrees, and then the noise is played through a loudspeaker of an earphone.
The hybrid ANC mode means that one microphone is provided outside and inside the headphone housing, respectively, i.e., the hybrid ANC mode is a combination of the feed-forward ANC mode and the feed-back ANC mode.
Fig. 1 is a schematic structural diagram of an earphone according to an embodiment of the present invention, and as shown in fig. 1, the earphone specifically includes:
an earphone housing 1;
a feed-forward microphone 11 is provided outside the earphone housing 1, and a feed-back microphone 12 and a speaker 13 are provided inside the earphone housing 1.
Accordingly, the headset may establish a wireless connection with an external terminal device (e.g., a smartphone). For example, a bluetooth module (not shown in fig. 1) is further disposed on the headset, and the headset establishes a wireless connection with the terminal device through the bluetooth module.
Further, in the embodiment of the present invention, the earphone performs the wind noise detection method provided by the embodiment of the present invention when the earphone is configured to turn on the hybrid ANC mode.
The following description will be further explained with reference to specific embodiments, which are not intended to limit the embodiments of the present invention.
Fig. 1 is a schematic structural diagram of an earphone according to an embodiment of the present invention, and as shown in fig. 1, the earphone specifically includes:
fig. 2 is a schematic flow chart of a wind noise detection method according to an embodiment of the present invention, where the method is applicable to the earphone illustrated in fig. 1. As shown in fig. 2, the method specifically includes:
and S21, acquiring a first audio signal collected by a feedforward microphone arranged on the earphone and a second audio signal collected by a feedback microphone arranged on the earphone.
Based on the above description, the hybrid ANC mode is a combination of the feedforward ANC mode and the feedback ANC mode, and therefore, in a case where the earphone is configured to turn on the hybrid ANC mode, the feedforward microphone and the feedback microphone provided on the earphone will each collect an audio signal, and hereinafter, the audio signal collected by the feedforward microphone will be referred to as a first audio signal, and the audio signal collected by the feedback microphone will be referred to as a second audio signal.
And S22, when the fact that the audio signal is played currently by the loudspeaker arranged on the earphone is determined, carrying out silencing processing on the second audio signal to obtain a third audio signal which does not contain the audio signal played currently by the loudspeaker.
As can be seen from the earphone structure illustrated in fig. 1, both the feedback microphone and the speaker are disposed inside the earphone casing, so that the second audio signal collected by the feedback microphone includes both the ambient noise and the audio signal played by the speaker. Based on this, in order to avoid that the audio signal played by the speaker of the earphone interferes with the wind noise detection result, an embodiment of the present invention provides that, when it is determined that the audio signal currently played by the speaker disposed on the earphone is played, the second audio signal collected by the feedback microphone is subjected to a muting processing (for example, the muting processing is performed by using an adaptive filtering algorithm), so as to obtain a third audio signal that does not include the audio signal currently played by the speaker. Subsequently, wind noise detection is performed based on the first audio signal and the third audio signal.
In addition, in the embodiment of the present invention, it is considered that although the feedforward microphone is disposed outside the earphone shell, the volume of the earphone is relatively small, and thus the distance between the feedforward microphone and the speaker disposed inside the earphone shell is relatively small, and therefore, the first audio signal collected by the feedforward microphone may also include an audio signal played by the speaker. Based on this, in an alternative of the embodiment of the present invention, when it is determined that the audio signal is currently played by the speaker disposed on the earphone, the first audio signal collected by the feedforward microphone is also subjected to a silencing process, so as to obtain a fourth audio signal that does not include the audio signal currently played by the speaker. Subsequently, wind noise detection is performed based on the fourth audio signal and the third audio signal.
It can be understood that when it is determined that the audio signal is currently played by the speaker disposed on the earphone, the first audio signal collected by the feedforward microphone and the second audio signal collected by the feedback microphone are both silenced, so that interference of the audio signal played by the speaker on the wind noise detection result can be avoided as much as possible, and the accuracy of the final wind noise detection result is improved.
And S23, determining a coherence coefficient between the first audio signal and the third audio signal.
And S24, determining whether wind noise exists in the earphone or not based on the coherence coefficient.
The following description collectively describes S23 and S24:
the attribute of noise changing according to time can be classified into steady-state noise, unsteady-state noise, intermittent noise and the like, and wind noise belongs to unsteady-state noise. For stationary noise, the coherence between the audio signals collected by the two microphones at the same time is relatively high, regardless of the influence of other sounds, in the same environment, and for non-stationary noise, the coherence between the audio signals collected by the two microphones at the same time is relatively low, even if the two microphones are closely adjacent to each other. Based on this, the embodiment of the present invention proposes: whether wind noise exists in the environment where the earphones are located is determined based on coherence between the audio signals collected by the feedforward microphone and the feedback microphone respectively. Specifically, as described in S23 and S24, a coherence coefficient between the first audio signal and the third audio signal is determined, and whether wind noise is present in the headphone is determined based on the coherence coefficient.
In addition, it should be noted that, in the case that the first audio signal collected by the feedforward microphone is also subjected to the silencing processing to obtain the fourth audio signal, a coherence coefficient between the third audio signal and the fourth audio signal is determined here; when the speaker of the earphone is not playing the audio signal currently, that is, the first audio signal and the second audio signal are not required to be muted, a coherence coefficient between the first audio signal and the second audio signal is determined.
Further, as can be seen from the above description, the higher the coherence between the first audio signal and the third audio signal (or between the first audio signal and the second audio signal, or between the third audio signal and the fourth audio signal), i.e., the higher the coherence coefficient, the lower the possibility of wind noise existing in the headphone is, and the lower the coherence between the first audio signal and the third audio signal, i.e., the lower the coherence coefficient, the higher the possibility of wind noise existing in the headphone is.
Based on this, in an alternative of the present invention, the coherence coefficient calculated in S23 is compared with a set wind noise threshold, and if the coherence coefficient is higher than the wind noise threshold, it means that the coherence between the first audio signal and the third audio signal is high, and it is determined that no wind noise exists in the headset; on the contrary, if the coherence coefficient is not higher than the wind noise threshold value through comparison, the coherence between the first audio signal and the third audio signal is low, and the existence of wind noise in the earphone is further determined.
According to the scheme provided by the embodiment of the invention, the first audio signal acquired by the feedforward microphone arranged on the earphone and the second audio signal acquired by the feedback microphone arranged on the earphone are acquired, and whether wind noise exists in the earphone is detected based on the first audio signal and the second audio signal, so that the wind noise detection can be realized without other parts on the earphone, such as a radio microphone, under the condition that the earphone is configured to start a hybrid ANC mode; furthermore, when the fact that the audio signal currently played by the loudspeaker arranged on the earphone is confirmed, the second audio signal is subjected to silencing processing to obtain a third audio signal which does not contain the audio signal currently played by the loudspeaker, the coherence coefficient between the first audio signal and the third audio signal is confirmed, whether wind noise exists in the earphone is confirmed based on the coherence coefficient, interference caused by the audio signal played by the loudspeaker on wind noise detection can be avoided, and accuracy of a wind noise detection result is improved.
In an alternative of the embodiment of the present invention, a coherence coefficient between a first audio signal and a specified audio signal may be determined in the following manner, where when it is determined that a speaker plays an audio signal, the specified audio signal is a third audio signal obtained by performing a muting process on a second audio signal, and when it is determined that the speaker does not play the audio signal, the specified audio signal is the second audio signal:
the coherence factor of the first audio signal and the given audio signal in the time domain, i.e. the time-domain coherence of the first audio signal and the given audio signal, is determined.
Specifically, the time-domain coherence coefficient between the first audio signal and the designated audio signal is determined, for example, the time-domain coherence coefficient between the first audio signal and the designated audio signal is obtained by performing convolution calculation on the first audio signal and the designated audio signal, and then the time-domain coherence coefficient is divided by the product between the power spectrum of the first audio signal and the power spectrum of the designated audio signal, so as to obtain the coherence coefficient between the first audio signal and the designated audio signal.
It should be noted here that the coherence factor between the first audio signal and the designated audio signal can be normalized to be between (0, 1) by dividing the time domain coherence factor by the product between the power spectrum of the first audio signal and the power spectrum of the designated audio signal, so that the coherence factor can directly reflect the coherence between the first audio signal and the designated audio signal, and specifically, the closer the coherence factor is to 1, the higher the coherence is, the closer the coherence is to 0, the lower the coherence is.
In another alternative of the embodiments of the present invention, the coherence coefficient between the first audio signal and the specified audio signal may be determined by:
the coherence coefficient of the first audio signal and the specified audio signal in the frequency domain, i.e. the frequency domain coherence of the first audio signal and the specified audio signal, is determined.
Specifically, first, time-frequency conversion is performed on the first audio signal and the designated audio signal, respectively, to obtain a first frequency domain signal and a designated frequency domain signal. Here, the first frequency domain signal corresponds to the first audio signal, the designated frequency domain signal corresponds to the designated audio signal, and the first frequency domain signal and the designated audio signal correspond to the same frequency domain (hereinafter, referred to as a set frequency domain). And finally, determining the sum of the frequency domain coherence coefficients of the first frequency domain signal and the appointed frequency domain signal at each frequency point in the set frequency domain as the coherence coefficient between the first audio signal and the appointed audio signal.
The frequency domain coherence coefficient of the first frequency domain signal and the specified frequency domain signal on each frequency point in the set frequency domain can be determined in the following way: for each frequency point in a set frequency domain, determining a cross power spectrum of a first frequency domain signal and a specified frequency domain signal on the frequency point, a first power spectrum of the first frequency domain signal on the frequency point, and a second power spectrum of the specified frequency domain signal on the frequency point; and dividing the cross power spectrum by the square root of the product between the first power spectrum and the second power spectrum to obtain the frequency domain coherence coefficient of the first frequency domain signal and the appointed frequency domain signal on the frequency point.
The above-described manner can be described as the following formula (one):
Figure BDA0003700601190000101
wherein, k is a frequency point,
Figure BDA0003700601190000102
is the cross power spectrum of the first frequency domain signal and the third frequency domain signal at the k frequency point,
Figure BDA0003700601190000103
is a first power spectrum of the first frequency domain signal at the k frequency point,
Figure BDA0003700601190000104
to specify a second power spectrum of the frequency domain signal at the k frequency point, Coh xy (k) And the frequency domain coherence coefficients of the first frequency domain signal and the specified frequency domain signal on the k frequency point are obtained.
Then, a coherence coefficient between the first audio signal and the specified audio signal can be determined by the following formula (two):
Figure BDA0003700601190000111
where h (i) is a coherence coefficient between the first audio signal and the designated audio signal, n1 is a lower limit value of a frequency bin of the set frequency domain, and n2 is an upper limit value of the frequency bin of the set frequency domain.
In addition, in another alternative of the embodiment of the present invention, the first audio signal and the designated audio signal may be subjected to framing processing, for example, one frame every 20ms, and then the coherence coefficient is calculated for each frame of the first audio signal and the designated audio signal, and then an average value of the coherence coefficients corresponding to each frame is calculated as the coherence coefficient of the first audio signal and the designated audio signal.
In this alternative, the above formula for determining the frequency domain coherence coefficient of the subframe in the first audio signal and the subframe in the designated audio signal at each frequency point in the set frequency domain may be expressed as:
Figure BDA0003700601190000112
where l is the number of frames, Coh xy (k, l) is the frequency domain coherence coefficient of the l subframe (including the l subframe in the first audio signal and the l subframe in the designated audio signal) at the k frequency point,
Figure BDA0003700601190000113
the cross power spectrum of the frequency domain signal corresponding to the l subframe on the k frequency point,
Figure BDA0003700601190000114
the power spectrum of the frequency domain signal corresponding to the first subframe in the first audio signal at the frequency point k,
Figure BDA0003700601190000115
and the power spectrum of the frequency domain signal corresponding to the ith subframe in the designated audio signal on the k frequency point is obtained.
The first audio signal and the designated audio signal are respectively subjected to framing processing, and the coherence coefficient between the first audio signal and the third audio signal is determined according to the coherence coefficient between frames, so that the accuracy of the calculated coherence coefficient can be improved.
Fig. 3 is a schematic flow chart of another wind noise detection method according to an embodiment of the present invention, where the method specifically includes, on the basis of the flow chart shown in fig. 2:
and S31, acquiring a first audio signal collected by a feedforward microphone arranged on the earphone and a second audio signal collected by a feedback microphone arranged on the earphone.
S32, determining whether the loudspeaker arranged on the earphone plays the audio signal currently, if so, executing S33; if not, go to S35.
And S33, carrying out silencing treatment on the second audio signal to obtain a third audio signal which does not contain the audio signal currently played by the loudspeaker.
S34, determining a coherence coefficient between the first audio signal and the third audio signal, and performing S36.
And S35, determining a coherence coefficient between the first audio signal and the second audio signal.
And S36, determining whether wind noise exists in the earphone or not based on the coherence coefficient.
For the detailed description of S31-S36, reference may be made to the description in the flow shown in fig. 2, and details are not repeated here.
And S37, when the wind noise of the earphone is determined, determining the wind noise level of the earphone according to the coherence coefficient, wherein the coherence coefficient is in negative correlation with the wind noise level.
In the embodiment of the invention, a wind noise level quantization table can be preset and set, and the quantization table comprises the corresponding relation between the wind noise level and the coherent coefficient range. It should be noted that the coherence coefficient is inversely correlated with the wind noise level, that is, the larger the coherence coefficient is, the lower the corresponding wind noise level is; conversely, the smaller the coherence coefficient, the higher the corresponding wind noise level.
Based on this, in S37, the wind noise level quantization table may be searched according to the coherence coefficient between the first audio signal and the second audio signal determined in S34 or S35, and the wind noise level corresponding to the searched coherence coefficient range is determined as the wind noise level in the headphone. Here, the found coherence coefficient range refers to a coherence coefficient range to which the coherence coefficient between the first audio signal and the second audio signal determined in S34 or S35 described above belongs.
And S38, when the wind noise exists in the earphone, controlling the earphone to be switched from the mixed ANC mode to the wind noise ANC mode.
As can be seen from the above description, in an outdoor scene, the ANC function is seriously affected by wind noise in the outdoor scene, so that the wind noise heard by a user when wearing the earphone for turning on the ANC function is obviously higher than the actual wind noise in the outdoor scene, and the listening experience of the user is greatly affected. In view of this, the embodiment of the present invention proposes: and controlling the earphone to switch from the hybrid ANC mode to the wind noise ANC mode when the wind noise exists in the earphone. Here, the wind noise ANC mode may be implemented by setting respective parameters of feedforward ANC and feedback ANC, and the embodiment of the present invention is not limited thereto.
It should be noted that, in the case where the earphone is configured to turn on the wind noise ANC mode, the audio for canceling the wind noise in the earphone is played through the speaker.
It should be further noted that, in the embodiment of the present invention, the execution sequence of S37 and S38 is not limited.
According to the scheme provided by the embodiment of the invention, the first audio signal acquired by the feedforward microphone arranged on the earphone and the second audio signal acquired by the feedback microphone arranged on the earphone are acquired, and whether wind noise exists in the earphone is detected based on the first audio signal and the second audio signal, so that the wind noise detection can be realized without other parts on the earphone, such as a radio microphone, under the condition that the earphone is configured to start a hybrid ANC mode; furthermore, when the audio signal currently played by the loudspeaker arranged on the earphone is determined, the second audio signal is subjected to silencing processing to obtain a third audio signal which does not contain the audio signal currently played by the loudspeaker, a coherence coefficient between the first audio signal and the third audio signal is determined, whether wind noise exists in the earphone is determined based on the coherence coefficient, interference of the audio signal played by the loudspeaker on wind noise detection can be avoided, and accuracy of a wind noise detection result is improved;
furthermore, when the wind noise exists in the earphone, the wind noise level in the earphone is determined according to the coherence coefficient, so that the wind noise detection result can be further optimized, and the user requirements can be met. When wind noise exists in the earphone, the earphone is controlled to be switched to the wind noise ANC mode from the mixed ANC mode, the ANC mode can be automatically switched under different scenes, so that good noise reduction effects can be brought to users under different scenes, and the listening experience of the users is improved.
Fig. 4 is a schematic structural diagram of a wind noise detection device according to an embodiment of the present invention, which is applied to the earphone illustrated in fig. 1, and as shown in fig. 4, the device specifically includes:
an obtaining module 41, configured to obtain a first audio signal collected by a feedforward microphone disposed on the earphone and a second audio signal collected by a feedback microphone disposed on the earphone;
a silencing module 42, configured to perform silencing processing on the second audio signal when it is determined that the speaker disposed on the earphone plays the audio signal, so as to obtain a third audio signal that does not include the audio signal currently played by the speaker;
a determining module 43 for determining a coherence coefficient between the first audio signal and the third audio signal;
a detection module 44, configured to determine whether wind noise exists in the headset based on the coherence coefficient.
In a possible embodiment, the determining module 43 is further configured to:
determining a coherence factor between the first audio signal and the second audio signal when it is determined that the speaker is not playing an audio signal.
In a possible embodiment, said determining module 43 comprises (not shown in the figures):
a first determining submodule for determining a time-domain coherence coefficient between the first audio signal and a given audio signal; wherein when it is determined that the speaker plays an audio signal, the designated audio signal is the third audio signal, and when it is determined that the speaker does not play an audio signal, the designated audio signal is the second audio signal;
and the second determining submodule is used for dividing the time domain coherence coefficient by the product between the power spectrum of the first audio signal and the power spectrum of the appointed audio signal to obtain the coherence coefficient between the first audio signal and the appointed audio signal.
In a possible embodiment, said determining module 43 comprises (not shown in the figures):
the time-frequency conversion sub-module is used for respectively performing time-frequency conversion on the first audio signal and the specified audio signal based on a set frequency domain to obtain a first frequency domain signal corresponding to the first audio signal and a specified frequency domain signal corresponding to the specified audio signal; wherein when it is determined that the speaker plays an audio signal, the designated audio signal is the third audio signal, and when it is determined that the speaker does not play an audio signal, the designated audio signal is the second audio signal;
a third determining submodule, configured to determine a frequency domain coherence coefficient of the first frequency domain signal and the specified frequency domain signal at each frequency point in the set frequency domain;
and the fourth determining submodule is used for determining the sum value of the frequency domain coherence coefficients on each frequency point as the coherence coefficient between the first audio signal and the specified audio signal.
In a possible implementation manner, the third determining sub-module specifically includes:
and executing the following processing aiming at each frequency point in the set frequency domain:
determining the cross power spectrum of the first frequency domain signal and the specified frequency domain signal on the frequency point, the first power spectrum of the first frequency domain signal on the frequency point, and the second power spectrum of the specified frequency domain signal on the frequency point;
and dividing the cross power spectrum by the square root of the product between the first power spectrum and the second power spectrum to obtain the frequency domain coherence coefficient of the first frequency domain signal and the specified frequency domain signal on the frequency point. .
In a possible embodiment, the detecting module 44 specifically includes:
if the coherence coefficient is determined to be higher than a preset wind noise threshold value, determining that wind noise does not exist in the earphone; and if the coherence coefficient is not higher than the wind noise threshold value, determining that the wind noise exists in the earphone.
In a possible embodiment, the device further comprises (not shown in the figures):
and the level determining module is used for determining the wind noise level of the earphone according to the coherent coefficient when the wind noise of the earphone is determined to exist, and the coherent coefficient is inversely related to the wind noise level.
In a possible embodiment, the device further comprises (not shown in the figures):
a mode switching module for controlling the earphone to switch from the hybrid ANC mode to a wind noise ANC mode when it is determined that wind noise exists in the earphone, wherein the earphone plays audio for canceling the wind noise in the earphone through a speaker under the condition that the earphone is configured to switch on the wind noise ANC mode.
The wind noise detection apparatus provided in this embodiment may be an apparatus as shown in fig. 4, and may perform all the steps of the methods shown in fig. 2 and fig. 3, so as to achieve the technical effects of the methods shown in fig. 2 and fig. 3, please refer to the related descriptions of fig. 2 and fig. 3 for brevity, which is not described herein again.
The embodiment of the invention also provides a storage medium (computer readable storage medium). The storage medium herein stores one or more programs. Among others, storage media may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as read-only memory, flash memory, a hard disk, or a solid state disk; the memory may also comprise a combination of memories of the kind described above.
When one or more programs in the storage medium are executable by one or more processors to implement the above-described wind noise detection method performed on the earpiece side.
The processor is used for executing the posture correction program stored in the memory so as to realize the following steps of the wind noise detection method executed on the earphone side:
acquiring a first audio signal acquired by a feedforward microphone arranged on the earphone and a second audio signal acquired by a feedback microphone arranged on the earphone;
when determining that a loudspeaker arranged on the earphone plays an audio signal, carrying out silencing treatment on the second audio signal to obtain a third audio signal which does not contain the audio signal played by the loudspeaker currently;
determining a coherence coefficient between the first audio signal and the third audio signal;
determining whether wind noise is present in the headset based on the coherence coefficient.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (10)

1. A method of wind noise detection applied to a headset configured to turn on a hybrid active noise reduction (ANC) mode, the method comprising:
acquiring a first audio signal acquired by a feedforward microphone arranged on the earphone and a second audio signal acquired by a feedback microphone arranged on the earphone;
when determining that a loudspeaker arranged on the earphone plays an audio signal, carrying out silencing treatment on the second audio signal to obtain a third audio signal which does not contain the audio signal played by the loudspeaker currently;
determining a coherence coefficient between the first audio signal and the third audio signal;
determining whether wind noise is present in the headset based on the coherence coefficient.
2. The method of claim 1, further comprising:
determining a coherence coefficient between the first audio signal and the second audio signal when it is determined that the speaker is not playing an audio signal.
3. The method according to claim 1 or 2, characterized in that the coherence coefficient is determined by:
determining a time-domain coherence coefficient between the first audio signal and a specified audio signal; wherein when it is determined that the speaker plays an audio signal, the designated audio signal is the third audio signal, and when it is determined that the speaker does not play an audio signal, the designated audio signal is the second audio signal;
and dividing the time domain coherence coefficient by the product between the first audio signal power spectrum and the designated audio signal power spectrum to obtain the coherence coefficient between the first audio signal and the designated audio signal.
4. The method according to claim 1 or 2, characterized in that the coherence coefficient is determined by:
respectively performing time-frequency conversion on the first audio signal and the specified audio signal based on a set frequency domain to obtain a first frequency domain signal corresponding to the first audio signal and a specified frequency domain signal corresponding to the specified audio signal; wherein when it is determined that the speaker plays an audio signal, the designated audio signal is the third audio signal, and when it is determined that the speaker does not play an audio signal, the designated audio signal is the second audio signal;
determining a frequency domain coherence coefficient of the first frequency domain signal and the specified frequency domain signal on each frequency point in the set frequency domain;
and determining the sum value of the frequency domain coherence coefficients on each frequency point as the coherence coefficient between the first audio signal and the specified audio signal.
5. The method of claim 4, wherein the determining the frequency-domain coherence coefficient of the first frequency-domain signal and the designated frequency-domain signal at each frequency bin in the set frequency domain comprises:
and executing the following processing aiming at each frequency point in the set frequency domain:
determining the cross power spectrum of the first frequency domain signal and the specified frequency domain signal on the frequency point, the first power spectrum of the first frequency domain signal on the frequency point, and the second power spectrum of the specified frequency domain signal on the frequency point;
and dividing the cross power spectrum by the square root of the product between the first power spectrum and the second power spectrum to obtain the frequency domain coherence coefficient of the first frequency domain signal and the specified frequency domain signal on the frequency point.
6. The method of claim 1, wherein the determining whether wind noise is present in the headset based on the coherence coefficient comprises:
if the coherence coefficient is determined to be higher than a preset wind noise threshold value, determining that wind noise does not exist in the earphone;
and if the coherence coefficient is determined not to be higher than the wind noise threshold value, determining that wind noise exists in the earphone.
The method further comprises the following steps:
and when the wind noise of the earphone is determined, determining the wind noise level of the earphone according to the coherence coefficient, wherein the coherence coefficient is in negative correlation with the wind noise level.
7. The method of claim 1, further comprising:
controlling the earphone to switch from the hybrid ANC mode to a wind noise ANC mode when the wind noise of the earphone is determined to exist, wherein the earphone plays audio for counteracting the wind noise of the earphone through a loudspeaker under the condition that the earphone is configured to switch on the wind noise ANC mode.
8. A wind noise detection apparatus, for use with a headset configured to switch on a hybrid active noise reduction, ANC, mode, the apparatus comprising:
the acquisition module is used for acquiring a first audio signal acquired by a feedforward microphone arranged on the earphone and a second audio signal acquired by a feedback microphone arranged on the earphone;
the noise reduction module is used for carrying out noise reduction processing on the second audio signal when the fact that the loudspeaker arranged on the earphone plays the audio signal is determined, and a third audio signal which does not contain the audio signal played by the loudspeaker currently is obtained;
a determination module for determining a coherence coefficient between the first audio signal and the third audio signal;
a detection module for determining whether wind noise exists in the earphone based on the coherence coefficient.
9. An earphone, comprising
An earphone housing;
a feedforward microphone is arranged outside the earphone shell, and a feedback microphone and a loudspeaker are arranged inside the earphone shell;
the headset, when configured to switch on a hybrid ANC mode, performs the wind noise detection method of any of claims 1-7 above.
10. A storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the wind noise detection method of any one of claims 1 to 7.
CN202210694065.5A 2022-06-17 2022-06-17 Wind noise detection method and device and earphone Pending CN115103258A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210694065.5A CN115103258A (en) 2022-06-17 2022-06-17 Wind noise detection method and device and earphone

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210694065.5A CN115103258A (en) 2022-06-17 2022-06-17 Wind noise detection method and device and earphone

Publications (1)

Publication Number Publication Date
CN115103258A true CN115103258A (en) 2022-09-23

Family

ID=83291922

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210694065.5A Pending CN115103258A (en) 2022-06-17 2022-06-17 Wind noise detection method and device and earphone

Country Status (1)

Country Link
CN (1) CN115103258A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117812500A (en) * 2024-02-27 2024-04-02 深圳市美格信测控技术有限公司 Earphone wind noise prevention test method and equipment based on audio signal processing

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117812500A (en) * 2024-02-27 2024-04-02 深圳市美格信测控技术有限公司 Earphone wind noise prevention test method and equipment based on audio signal processing
CN117812500B (en) * 2024-02-27 2024-05-07 深圳市美格信测控技术有限公司 Earphone wind noise prevention test method and equipment based on audio signal processing

Similar Documents

Publication Publication Date Title
US9595252B2 (en) Noise reduction audio reproducing device and noise reduction audio reproducing method
CN106664473B (en) Information processing apparatus, information processing method, and program
US8315400B2 (en) Method and device for acoustic management control of multiple microphones
US9202456B2 (en) Systems, methods, apparatus, and computer-readable media for automatic control of active noise cancellation
KR102400710B1 (en) Noise Cancellation Systems, Noise Cancellable Audio Devices and Noise Cancellation Methods
US7889872B2 (en) Device and method for integrating sound effect processing and active noise control
US10115412B2 (en) Signal processor with side-tone noise reduction for a headset
US20090016541A1 (en) Method and Device for Acoustic Management Control of Multiple Microphones
JP2009530950A (en) Data processing for wearable devices
JPH09135194A (en) Telephone device, and method for improving quality and articulation of reproduced sound by the telephone device
CN111683319A (en) Call pickup noise reduction method, earphone and storage medium
CN110931007B (en) Voice recognition method and system
TW201346889A (en) Noise cancellation method
CN112954530A (en) Earphone noise reduction method, device and system and wireless earphone
CN111629313B (en) Hearing device comprising loop gain limiter
CN115209292A (en) Audio signal compensation method and device, earphone and storage medium
CN113630684B (en) Earphone with active noise reduction function and noise reduction method thereof
CN115103258A (en) Wind noise detection method and device and earphone
CN115250397A (en) TWS earphone and playing method and device thereof
CN114697783A (en) Earphone wind noise identification method and device
US11259117B1 (en) Dereverberation and noise reduction
US11330376B1 (en) Hearing device with multiple delay paths
CN117392994B (en) Audio signal processing method, device, equipment and storage medium
WO2023070917A1 (en) Noise reduction adjustment method, earphone, and computer-readable storage medium
CN115515041A (en) Audio playing method, device, earphone and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination