CN112019967A - Earphone noise reduction method and device, earphone equipment and storage medium - Google Patents
Earphone noise reduction method and device, earphone equipment and storage medium Download PDFInfo
- Publication number
- CN112019967A CN112019967A CN202010940245.8A CN202010940245A CN112019967A CN 112019967 A CN112019967 A CN 112019967A CN 202010940245 A CN202010940245 A CN 202010940245A CN 112019967 A CN112019967 A CN 112019967A
- Authority
- CN
- China
- Prior art keywords
- signal
- voice signal
- voice
- noise reduction
- microphone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
Abstract
The application discloses a method and a device for reducing noise of an earphone, earphone equipment and a storage medium. The method judges whether the environment of the earphone is a wind noise scene or not according to the environment sound signal of the environment of the earphone, and then under the condition of the wind noise scene, the voice signal is obtained in a mode of receiving vibration waves through the vibration sensor, so that the influence of wind noise on the finally obtained noise-reduced voice signal is reduced, under the condition of a non-wind noise scene, the frequency width of the finally obtained noise-reduced voice signal is ensured in a mode of obtaining the voice signal through the noise-reduced microphone, the voice noise-reduction effect under the conversation scene is comprehensively improved, and the overall quality of the voice signal is further improved. In addition, the application also provides an earphone noise reduction device, earphone equipment and a storage medium, and the beneficial effects are as described above.
Description
Technical Field
The present application relates to the field of noise reduction for earphones, and in particular, to an earphone noise reduction method and apparatus, an earphone device, and a storage medium.
Background
Along with people's requirement to earphone tone quality constantly improves, current earphone often integrates and has the microphone in order to realize the voice conversation function, along with the environment sound in the current earphone service environment is more and more complicated, leads to current earphone to need further to improve the pronunciation noise reduction effect under the conversation scene, and then improves speech signal's whole quality.
Therefore, the problem to be solved by technical personnel in the field is to provide an earphone noise reduction method to improve the voice noise reduction effect in a call scene and further improve the overall quality of a voice signal.
Disclosure of Invention
The application aims to provide an earphone noise reduction method and device, earphone equipment and a storage medium, so that the voice noise reduction effect in a call scene is improved, and the overall quality of a voice signal is further improved.
In order to solve the above technical problem, the present application provides a method for reducing noise of an earphone, including:
receiving an ambient sound signal;
judging whether the environmental sound signal is a sound signal generated by a wind noise scene;
if the environment sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on a vibration sensor, and receiving a second voice signal by using a voice microphone;
obtaining a noise reduction voice signal based on the first voice signal and the second voice signal;
if the environmental sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on the noise reduction microphone, and receiving a second voice signal by using the voice microphone;
and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
Preferably, the determining whether the environmental sound signal is a sound signal generated by a wind noise scene includes:
judging whether the ratio of the target frequency lower than the preset threshold value in the environmental sound signal to the environmental sound signal reaches a preset ratio threshold value or not;
if yes, executing the step that the environment sound signal is the sound signal generated by the wind noise scene;
otherwise, the step of not generating an acoustic signal for the wind noise scene by the ambient acoustic signal is performed.
Preferably, the determining whether the environmental sound signal is a sound signal generated by a wind noise scene includes:
judging whether the signal frequency spectrum of the environmental sound signal is continuous or not;
if yes, executing the step that the environment sound signal is the sound signal generated by the wind noise scene;
otherwise, the step of not generating an acoustic signal for the wind noise scene by the ambient acoustic signal is performed.
Preferably, the determining whether the environmental sound signal is a sound signal generated by a wind noise scene includes:
judging whether the ratio of the target frequency lower than the preset threshold value in the environmental sound signal reaches the preset ratio threshold value or not, wherein the signal frequency spectrum of the environmental sound signal is continuous;
if yes, executing the step that the environment sound signal is the sound signal generated by the wind noise scene;
otherwise, the step of not generating an acoustic signal for the wind noise scene by the ambient acoustic signal is performed.
Preferably, obtaining the noise-reduced speech signal based on the first speech signal and the second speech signal comprises:
filtering the first voice signal in the second voice signal to obtain a first process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the first process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
Preferably, obtaining the noise-reduced speech signal based on the third speech signal and the second speech signal includes:
filtering the third voice signal in the second voice signal to obtain a second process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the second process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
Preferably, the receiving the first voice signal based on the vibration sensor includes:
receiving a first voice signal based on a gravity sensor or a bone sensor;
receiving a third speech signal based on a noise reduction microphone, comprising:
receiving a third voice signal based on a feedback microphone;
obtaining a double-microphone noise reduction signal obtained based on the double-microphone noise reduction operation, comprising:
and acquiring a dual-microphone noise reduction signal obtained by executing dual-microphone noise reduction operation based on the voice microphone and the feedforward microphone.
In addition, this application still provides a device of making an uproar falls in earphone, includes:
the environment sound signal receiving module is used for receiving an environment sound signal;
the scene judging module is used for judging whether the environmental sound signal is the sound signal generated by the wind noise scene, if so, the first receiving module and the first noise reduction module are sequentially called, and otherwise, the second receiving module and the second noise reduction module are sequentially called;
the first receiving module is used for receiving a first voice signal based on the vibration sensor and receiving a second voice signal by using the voice microphone;
the first noise reduction module is used for obtaining a noise reduction voice signal based on the first voice signal and the second voice signal;
the second receiving module is used for receiving the third voice signal based on the noise reduction microphone and receiving the second voice signal by using the voice microphone;
and the second noise reduction module is used for obtaining a noise reduction voice signal based on the third voice signal and the second voice signal.
In addition, the present application also provides an earphone device, including:
a vibration sensor;
a noise reduction microphone;
a voice microphone;
a memory for storing a computer program;
a processor for executing a computer program to enable receiving an ambient acoustic signal; judging whether the environmental sound signal is a sound signal generated by a wind noise scene; if the environment sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on a vibration sensor, and receiving a second voice signal by using a voice microphone; obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; if the environmental sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on the noise reduction microphone, and receiving a second voice signal by using the voice microphone; and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
Furthermore, the present application also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of the above-mentioned earphone noise reduction method.
The method for reducing the noise of the earphone comprises the steps of firstly receiving an environment sound signal, then judging whether the environment sound signal is a sound signal generated by a wind noise scene, if so, further receiving a first voice signal based on a vibration sensor, receiving a second voice signal by utilizing a voice microphone, and further obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; and if the environment sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by utilizing the voice microphone, and further obtaining the noise reduction voice signal based on the third voice signal and the second voice signal. According to the method, whether the environment where the earphone is located is a wind noise scene or not is judged according to the environment sound signal of the environment where the earphone is located, the influence of wind noise on a noise-reduced voice signal which is finally obtained is reduced in a mode that the voice signal is obtained through the vibration sensor under the condition of the wind noise scene, the bandwidth of the noise-reduced voice signal which is finally obtained is ensured in a mode that the voice signal is obtained through the noise-reduced microphone under the non-wind noise scene, the voice noise reduction effect under a call scene is comprehensively improved, and the overall quality of the voice signal is further improved. In addition, the application also provides an earphone noise reduction device, earphone equipment and a storage medium, and the beneficial effects are as described above.
Drawings
In order to more clearly illustrate the embodiments of the present application, the drawings needed for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of a method for reducing noise of an earphone disclosed in an embodiment of the present application;
fig. 2 is a flowchart of a specific noise reduction method for an earphone disclosed in an embodiment of the present application;
fig. 3 is a flowchart of a specific noise reduction method for an earphone disclosed in an embodiment of the present application;
fig. 4 is a flowchart of a specific noise reduction method for an earphone disclosed in an embodiment of the present application;
fig. 5 is a schematic structural diagram of a noise reduction device for a headphone according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of a positional relationship between a microphone and a sensor of an earphone device in a specific application scenario disclosed in the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without any creative effort belong to the protection scope of the present application.
Along with people's requirement to earphone tone quality constantly improves, current earphone often integrates and has the microphone in order to realize the voice conversation function, along with the environment sound in the current earphone service environment is more and more complicated, leads to current earphone to need further to improve the pronunciation noise reduction effect under the conversation scene, and then improves speech signal's whole quality.
Therefore, the core of the application is to provide an earphone noise reduction method to improve the voice noise reduction effect in a call scene, and further improve the overall quality of voice signals.
Referring to fig. 1, an embodiment of the present application discloses a method for reducing noise of an earphone, including:
step S10: an ambient sound signal is received.
It should be noted that the ambient sound signal in this step refers to a sound signal in an environment where the earphone is located, and the manner of receiving the ambient sound signal may specifically be that the sound signal is collected by a voice microphone or a noise reduction microphone in the earphone, and preferably, the ambient sound signal is received by a voice microphone closest to a sound source when the user speaks.
Step S11: and judging whether the environmental sound signal is the sound signal generated by the wind noise scene, if so, sequentially executing the step S12 to the step S13, and otherwise, sequentially executing the step S14 to the step S15.
After the ambient sound signal is acquired, the step further determines whether the ambient sound signal is a sound signal generated by a wind noise scene, where the wind noise scene refers to a scene in which the generated sound signal includes a wind noise signal.
Step S12: the first voice signal is received based on the vibration sensor, and the second voice signal is received by the voice microphone.
Step S13: and obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
It should be noted that, when it is determined that the ambient sound signal is a sound signal generated in a wind noise scene, the embodiment further receives the first speech signal based on the vibration sensor, and receives the second speech signal by using the speech microphone, so as to obtain the noise reduction speech signal based on the first speech signal and the second speech signal. The vibration sensor is a sensor capable of generating a sound signal by collecting vibration waves, the first voice signal and the second voice signal are voice signals collected through two different ways, and the voice signals include but are not limited to voice signals generated when a user of the earphone speaks, and may also be voice signals generated under the environment where the earphone is located.
Under the scene of wind noise, the vibration sensor receives the first voice signal, the interference of the wind noise to the first voice signal can be relatively reduced, and the noise reduction accuracy of the noise reduction voice signal can be relatively improved through the first voice signal and the second voice signal.
Step S14: the noise reduction-based microphone receives the third voice signal and the voice microphone receives the second voice signal.
Step S15: and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
It should be noted that, when it is determined that the ambient sound signal is not the sound signal generated in the wind noise scene, the embodiment further receives the third speech signal based on the noise reduction microphone, and receives the second speech signal by using the speech microphone, so as to obtain the noise reduction speech signal based on the third speech signal and the second speech signal. The third speech signal and the second speech signal are speech signals collected through two different approaches.
In a scene without wind noise, the voice signal received by the noise reduction microphone has a higher voice bandwidth than the voice signal received by the vibration sensor, so that the noise reduction voice signal is obtained based on the third voice signal and the second voice signal, and the generation of voice distortion can be relatively avoided.
The method for reducing the noise of the earphone comprises the steps of firstly receiving an environment sound signal, then judging whether the environment sound signal is a sound signal generated by a wind noise scene, if so, further receiving a first voice signal based on a vibration sensor, receiving a second voice signal by utilizing a voice microphone, and further obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; and if the environment sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by utilizing the voice microphone, and further obtaining the noise reduction voice signal based on the third voice signal and the second voice signal. The method judges whether the environment of the earphone is a wind noise scene or not according to the environment sound signal of the environment of the earphone, and then under the condition of the wind noise scene, the voice signal is obtained in a mode of receiving vibration waves through the vibration sensor, so that the influence of wind noise on the finally obtained noise-reduced voice signal is reduced, under the condition of a non-wind noise scene, the frequency width of the finally obtained noise-reduced voice signal is ensured in a mode of obtaining the voice signal through the noise-reduced microphone, the voice noise-reduction effect under the conversation scene is comprehensively improved, and the overall quality of the voice signal is further improved.
In addition to the foregoing embodiments, as a preferred implementation manner, obtaining a noise-reduced speech signal based on a first speech signal and a second speech signal includes:
filtering the first voice signal in the second voice signal to obtain a first process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the first process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
In the present embodiment, in the process of obtaining the noise reduction speech signal based on the first speech signal and the second speech signal, the first speech signal received by the vibration sensor is first filtered in the second speech signal received by the speech microphone to obtain the first process speech signal, and then the dual-microphone noise reduction signal obtained based on the dual-microphone noise reduction operation is obtained, and the first process speech signal is filtered in the dual-microphone noise reduction signal to obtain the noise reduction speech signal.
In this embodiment, there is no fixed execution sequence between the step of obtaining the double-microphone noise reduction signal obtained based on the double-microphone noise reduction operation and the step of filtering the first speech signal in the second speech signal to obtain the first process speech signal, and the steps may also be executed simultaneously, which is not limited specifically herein.
In this embodiment, the expression of the process of obtaining the noise reduction voice signal based on the first voice signal and the second voice signal is as follows:
according to a first voice signal S collected by a vibration sensorGCollected by a voice microphoneOf the second speech signal StComparing the first voice signal S with the second voice signal StExtracting a clean speech signal, i.e. Sclean：
Sdv＝St–k*SG(ii) a Wherein k is a noise reduction coefficient; (S)dvIncluding wind noise and other noise signals and a portion of the speech signal that is corrupted);
the signal collected by the double-microphone noise reduction scheme is SD：
Sclean＝SD–r*Sdv(ii) a Wherein r is a noise reduction coefficient.
The present embodiment further improves the reliability of obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
In addition to the foregoing embodiments, as a preferred implementation manner, obtaining a noise-reduced speech signal based on a third speech signal and a second speech signal includes:
filtering the third voice signal in the second voice signal to obtain a second process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the second process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
It should be noted that, in the present embodiment, in the process of obtaining the noise reduction voice signal based on the third voice signal and the second voice signal, the third voice signal is first filtered in the second voice signal to obtain the second process voice signal, and then the dual-microphone noise reduction signal obtained based on the dual-microphone noise reduction operation is obtained, and the second process voice signal is filtered in the dual-microphone noise reduction signal to obtain the noise reduction voice signal.
In this embodiment, there is no fixed execution sequence between the step of obtaining the double-microphone noise reduction signal obtained based on the double-microphone noise reduction operation and the step of filtering the third speech signal in the second speech signal to obtain the second process speech signal, and the steps may also be executed simultaneously, which is not limited specifically herein.
In this embodiment, the expression of the process of obtaining the noise reduction voice signal based on the third voice signal and the second voice signal is as follows:
according to the third voice signal S collected by the noise reduction microphoneFBAnd a second voice signal S collected by the voice microphonetComparing the first voice signal S with the second voice signal StExtracting a clean speech signal Sclean：
Sdv＝St–l*SFB；(SdvContaining a small portion of the ambient noise signal);
the signal collected by the double-microphone noise reduction scheme is SD：
Sclean＝SD–n*Sdv(ii) a Wherein n is a noise reduction coefficient.
The present embodiment further improves the reliability of obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
On the basis of the above embodiment, as a preferred implementation, the receiving a first voice signal based on a vibration sensor includes:
receiving a first voice signal based on a gravity sensor or a bone sensor;
receiving a third speech signal based on a noise reduction microphone, comprising:
receiving a third voice signal based on a feedback microphone;
obtaining a double-microphone noise reduction signal obtained based on the double-microphone noise reduction operation, comprising:
and acquiring a dual-microphone noise reduction signal obtained by executing dual-microphone noise reduction operation based on the voice microphone and the feedforward microphone.
It should be noted that the present embodiment focuses on that the first voice signal is received by a gravity sensor (G-sensor) or a bone sensor, so that the accuracy of the first voice signal can be relatively ensured; on this basis, the third voice signal is received based on a feedback microphone (feedback mic), and the dual microphone noise reduction operation is performed based on the voice microphone and a feedforward microphone (feedback mic). The embodiment further improves the voice noise reduction effect of the earphone in the conversation scene, and further improves the overall quality of the voice signal.
Referring to fig. 2, an embodiment of the present application discloses a method for reducing noise of a headphone, including:
step S20: an ambient sound signal is received.
Step S21: and judging whether the ratio of the target frequency lower than the preset threshold in the environment sound signal to the environment sound signal reaches the preset ratio threshold, if so, executing the step S22 and the step S23, and otherwise, executing the step S24 and the step S25.
Step S22: the first voice signal is received based on the vibration sensor, and the second voice signal is received by the voice microphone.
Step S23: and obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
Step S24: the noise reduction-based microphone receives the third voice signal and the voice microphone receives the second voice signal.
Step S25: and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
It should be noted that, in this embodiment, the manner of determining whether the ambient sound signal is a sound signal generated in a wind noise scene is specifically determined to determine whether the ratio of the target frequency in the ambient sound signal, which is lower than a preset threshold, in the ambient sound signal reaches a preset ratio threshold, where the preset threshold may be smaller than or equal to the minimum value of the human sound frequency interval, and then when the ratio of the target frequency in the ambient sound signal, which is lower than the minimum value of the human sound frequency interval, in the ambient sound signal reaches the preset ratio threshold, the ambient sound signal is considered as the sound signal generated in the wind noise scene, otherwise, the ambient sound signal is not the sound signal generated in the wind noise scene. The method and the device further improve the accuracy of the process of judging whether the environmental sound signal is the sound signal generated by the wind noise scene, and further ensure the overall reliability of the noise reduction process of the earphone.
Referring to fig. 3, an embodiment of the present application discloses a method for reducing noise of a headphone, including:
step S30: an ambient sound signal is received.
Step S31: and judging whether the signal frequency spectrums of the environmental sound signals are continuous or not, if so, executing the step S32 and the step S33, and otherwise, executing the step S34 and the step S35.
Step S32: the first voice signal is received based on the vibration sensor, and the second voice signal is received by the voice microphone.
Step S33: and obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
Step S34: the noise reduction-based microphone receives the third voice signal and the voice microphone receives the second voice signal.
Step S35: and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
It should be noted that, in this embodiment, a manner of determining whether the ambient sound signal is a sound signal generated in a wind noise scene is specifically determined whether a signal spectrum of the ambient sound signal is continuous, and because it is considered that the frequency spectrum of the wind noise signal is often continuous in the wind noise scene and the frequency spectrum of the voice signal is often spaced, in this embodiment, by determining whether the signal spectrum of the ambient sound signal is continuous, when the signal spectrum of the ambient sound signal is continuous, the ambient sound signal is considered to be the sound signal generated in the wind noise scene, otherwise, the ambient sound signal is not considered to be the sound signal generated in the wind noise scene. The method and the device further improve the accuracy of the process of judging whether the environmental sound signal is the sound signal generated by the wind noise scene, and further ensure the overall reliability of the noise reduction process of the earphone.
Referring to fig. 4, an embodiment of the present application discloses a method for reducing noise of a headphone, including:
step S40: an ambient sound signal is received.
Step S41: whether the ratio of the target frequency lower than the preset threshold in the environmental sound signal reaches the preset ratio threshold is judged, and the signal frequency spectrum of the environmental sound signal is continuous, if yes, step S42 and step S43 are executed, otherwise, step S44 and step S45 are executed.
Step S42: the first voice signal is received based on the vibration sensor, and the second voice signal is received by the voice microphone.
Step S43: and obtaining the noise reduction voice signal based on the first voice signal and the second voice signal.
Step S44: the noise reduction-based microphone receives the third voice signal and the voice microphone receives the second voice signal.
Step S45: and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
It should be noted that, in this embodiment, the manner of determining whether the ambient sound signal is a sound signal generated in a wind noise scene is specifically determined to determine whether two conditions, that is, whether the ratio of the target frequency lower than the preset threshold in the ambient sound signal to the ambient sound signal reaches the preset ratio threshold and the signal spectrum of the ambient sound signal is continuous, are simultaneously satisfied, and then when the ratio of the target frequency lower than the preset threshold in the ambient sound signal to the ambient sound signal reaches the preset ratio threshold and the signal spectrum of the ambient sound signal is continuous, the ambient sound signal is considered as the sound signal generated in the wind noise scene, otherwise, the ambient sound signal is not the sound signal generated in the wind noise scene. The method and the device further improve the accuracy of the process of judging whether the environmental sound signal is the sound signal generated by the wind noise scene, and further ensure the overall reliability of the noise reduction process of the earphone.
Referring to fig. 5, an embodiment of the present application discloses a noise reduction device for a headphone, including:
an ambient sound signal receiving module 10, configured to receive an ambient sound signal;
the scene judging module 11 is configured to judge whether the ambient sound signal is a sound signal generated by a wind noise scene, if so, sequentially invoke the first receiving module 12 and the first noise reduction module 13, and otherwise, sequentially invoke the second receiving module 14 and the second noise reduction module 15;
a first receiving module 12, configured to receive a first voice signal based on the vibration sensor, and receive a second voice signal by using a voice microphone;
the first noise reduction module 13 is configured to obtain a noise reduction voice signal based on the first voice signal and the second voice signal;
a second receiving module 14, configured to receive the third voice signal based on the noise reduction microphone, and receive the second voice signal by using the voice microphone;
and a second noise reduction module 15, configured to obtain a noise-reduced voice signal based on the third voice signal and the second voice signal.
In a specific embodiment, the scene determining module 11 includes:
the frequency judgment module is used for judging whether the ratio of the target frequency lower than the preset threshold value in the environmental sound signal reaches the preset ratio threshold value or not; if yes, the first receiving module 12 and the first noise reduction module 13 are called in sequence; otherwise, the second receiving module 14 and the second noise reduction module 15 are called in sequence.
In a specific embodiment, the scene determining module 11 includes:
the frequency spectrum judging module is used for judging whether the signal frequency spectrum of the environmental sound signal is continuous or not; if yes, the first receiving module 12 and the first noise reduction module 13 are called in sequence; otherwise, the second receiving module 14 and the second noise reduction module 15 are called in sequence.
In a specific embodiment, the scene determining module 11 includes:
the comprehensive judgment module is used for judging whether the ratio of the target frequency lower than the preset threshold value in the environment sound signal reaches the preset ratio threshold value or not and the signal frequency spectrum of the environment sound signal is continuous; if yes, the first receiving module 12 and the first noise reduction module 13 are called in sequence; otherwise, the second receiving module 14 and the second noise reduction module 15 are called in sequence.
In one embodiment, the first noise reduction module 13 includes:
the first filtering module is used for filtering the first voice signal in the second voice signal to obtain a first process voice signal;
the noise reduction signal acquisition module is used for acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and the first double-microphone filtering module is used for filtering the first process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
In one embodiment, the second noise reduction module 15 includes:
the second filtering module is used for filtering a third voice signal in the second voice signal to obtain a second process voice signal;
the noise reduction signal acquisition module is used for acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and the second double-microphone filtering module is used for filtering the second process voice signal in the double-microphone noise reduction signal to obtain a noise reduction voice signal.
In one embodiment, the first receiving module includes:
the sensor receiving module is used for receiving a first voice signal based on a gravity sensor or a bone sensor;
a second receiving module comprising:
a feedback microphone receiving module for receiving a third voice signal based on a feedback microphone;
a noise reduction signal acquisition module comprising:
and the double-microphone noise reduction signal acquisition module is used for acquiring a double-microphone noise reduction signal obtained by executing double-microphone noise reduction operation based on the voice microphone and the feedforward microphone.
The earphone noise reduction device provided by the application firstly receives an environment sound signal, and then judges whether the environment sound signal is a sound signal generated by a wind noise scene, if so, the earphone noise reduction device further receives a first voice signal based on a vibration sensor, receives a second voice signal by using a voice microphone, and further obtains a noise reduction voice signal based on the first voice signal and the second voice signal; and if the environment sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by utilizing the voice microphone, and further obtaining the noise reduction voice signal based on the third voice signal and the second voice signal. The device judges whether the environment where the earphone is located is a wind noise scene according to the environment sound signal of the environment where the earphone is located, and then under the condition of the wind noise scene, the voice signal is obtained in a mode of receiving vibration waves through the vibration sensor, so that the influence of the wind noise on the finally obtained noise-reduction voice signal is reduced, under the non-wind noise scene, the frequency width of the finally obtained noise-reduction voice signal is ensured in a mode of obtaining the voice signal through the noise-reduction microphone, the voice noise-reduction effect under the conversation scene is comprehensively improved, and the overall quality of the voice signal is further improved.
In addition, this application embodiment also discloses an earphone device, includes:
a vibration sensor;
a noise reduction microphone;
a voice microphone;
a memory for storing a computer program;
a processor for executing a computer program to enable receiving an ambient acoustic signal; judging whether the environmental sound signal is a sound signal generated by a wind noise scene; if the environment sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on a vibration sensor, and receiving a second voice signal by using a voice microphone; obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; if the environmental sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on the noise reduction microphone, and receiving a second voice signal by using the voice microphone; and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
The earphone noise reduction device provided by the application firstly receives an environment sound signal, and then judges whether the environment sound signal is a sound signal generated by a wind noise scene, if so, the earphone noise reduction device further receives a first voice signal based on a vibration sensor, receives a second voice signal by using a voice microphone, and further obtains a noise reduction voice signal based on the first voice signal and the second voice signal; and if the environment sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by utilizing the voice microphone, and further obtaining the noise reduction voice signal based on the third voice signal and the second voice signal. The device judges whether the environment where the earphone is located is a wind noise scene according to the environment sound signal of the environment where the earphone is located, and then under the condition of the wind noise scene, the voice signal is obtained in a mode of receiving vibration waves through the vibration sensor, so that the influence of the wind noise on the finally obtained noise-reduction voice signal is reduced, under the non-wind noise scene, the frequency width of the finally obtained noise-reduction voice signal is ensured in a mode of obtaining the voice signal through the noise-reduction microphone, the voice noise reduction effect under the conversation scene is comprehensively improved, and the overall quality of the voice signal is further improved.
In a specific application scenario, the noise reduction microphones included in the headphone apparatus are specifically a feedback microphone and a feedforward microphone.
Fig. 6 is a schematic diagram showing a positional relationship between a microphone and a sensor of an earphone device in a specific application scenario.
The headphone apparatus in fig. 6 includes: a voice microphone 101; a feedforward microphone 102; a combination feedback microphone and vibration sensor 103.
In addition, the embodiment of the application also discloses a computer readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the earphone noise reduction method are realized.
The computer-readable storage medium provided by the application firstly receives an environment sound signal, and then judges whether the environment sound signal is a sound signal generated by a wind noise scene, if so, the computer-readable storage medium further receives a first voice signal based on a vibration sensor, and receives a second voice signal by using a voice microphone, and then obtains a noise reduction voice signal based on the first voice signal and the second voice signal; and if the environment sound signal is not the sound signal generated by the wind noise scene, further receiving a third voice signal based on the noise reduction microphone, receiving a second voice signal by utilizing the voice microphone, and further obtaining the noise reduction voice signal based on the third voice signal and the second voice signal. The computer readable storage medium judges whether the environment of the earphone is a wind noise scene according to the environment sound signal of the environment of the earphone, and then under the condition of the wind noise scene, the vibration sensor acquires the voice signal in a mode of receiving vibration waves, so that the influence of wind noise on the finally obtained noise-reduced voice signal is reduced.
The above details describe a method and an apparatus for reducing noise of an earphone, an earphone device, and a storage medium provided by the present application. The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A method for reducing noise in a headphone, comprising:
receiving an ambient sound signal;
judging whether the environmental sound signal is a sound signal generated by a wind noise scene;
if the environment sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on a vibration sensor, and receiving a second voice signal by using a voice microphone;
obtaining a noise reduction voice signal based on the first voice signal and the second voice signal;
if the environment sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on a noise reduction microphone, and receiving the second voice signal by using the voice microphone;
and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
2. The method of claim 1, wherein the determining whether the ambient sound signal is a sound signal generated by a wind noise scene comprises:
judging whether the ratio of the target frequency lower than a preset threshold value in the environment sound signal reaches a preset ratio threshold value or not;
if so, executing the step that the environmental sound signal is a sound signal generated by a wind noise scene;
otherwise, executing the step that the environment sound signal is not the sound signal generated by the wind noise scene.
3. The method of claim 1, wherein the determining whether the ambient sound signal is a sound signal generated by a wind noise scene comprises:
judging whether the signal frequency spectrum of the environment sound signal is continuous or not;
if so, executing the step that the environmental sound signal is a sound signal generated by a wind noise scene;
otherwise, executing the step that the environment sound signal is not the sound signal generated by the wind noise scene.
4. The method of claim 1, wherein the determining whether the ambient sound signal is a sound signal generated by a wind noise scene comprises:
judging whether the ratio of the target frequency lower than a preset threshold value in the environment sound signal reaches a preset ratio threshold value or not, wherein the signal frequency spectrum of the environment sound signal is continuous;
if so, executing the step that the environmental sound signal is a sound signal generated by a wind noise scene;
otherwise, executing the step that the environment sound signal is not the sound signal generated by the wind noise scene.
5. The method of claim 1, wherein the deriving a noise-reduced speech signal based on the first speech signal and the second speech signal comprises:
filtering the first voice signal in the second voice signal to obtain a first process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the first process voice signal in the double-microphone noise reduction signal to obtain the noise reduction voice signal.
6. The method of claim 1, wherein the deriving the noise-reduced speech signal based on the third speech signal and the second speech signal comprises:
filtering the third voice signal in the second voice signal to obtain a second process voice signal;
acquiring a double-microphone noise reduction signal obtained based on double-microphone noise reduction operation;
and filtering the second process voice signal in the double-microphone noise reduction signal to obtain the noise reduction voice signal.
7. The headphone noise reduction method according to claim 5 or 6, wherein the receiving a first voice signal based on a vibration sensor comprises:
receiving the first voice signal based on a gravity sensor or a bone sensor;
the noise reduction based microphone receiving a third speech signal comprising:
receiving the third speech signal based on a feedback microphone;
the acquiring of the double-microphone noise reduction signal obtained based on the double-microphone noise reduction operation includes:
and acquiring the double-microphone noise reduction signal obtained by executing the double-microphone noise reduction operation based on the voice microphone and the feedforward microphone.
8. An apparatus for reducing noise in a headphone, comprising:
the environment sound signal receiving module is used for receiving an environment sound signal;
the scene judging module is used for judging whether the environmental sound signal is a sound signal generated by a wind noise scene, if so, the first receiving module and the first noise reduction module are sequentially called, and otherwise, the second receiving module and the second noise reduction module are sequentially called;
the first receiving module is used for receiving a first voice signal based on the vibration sensor and receiving a second voice signal by using the voice microphone;
the first noise reduction module is configured to obtain a noise reduction voice signal based on the first voice signal and the second voice signal;
the second receiving module is configured to receive a third voice signal based on a noise reduction microphone and receive the second voice signal by using the voice microphone;
the second noise reduction module is configured to obtain the noise reduction voice signal based on the third voice signal and the second voice signal.
9. An earphone device, comprising:
a vibration sensor;
a noise reduction microphone;
a voice microphone;
a memory for storing a computer program;
a processor for executing the computer program to enable receiving an ambient acoustic signal; judging whether the environmental sound signal is a sound signal generated by a wind noise scene; if the environment sound signal is a sound signal generated by a wind noise scene, receiving a first voice signal based on the vibration sensor, and receiving a second voice signal by using the voice microphone; obtaining a noise reduction voice signal based on the first voice signal and the second voice signal; if the environment sound signal is not the sound signal generated by the wind noise scene, receiving a third voice signal based on the noise reduction microphone, and receiving the second voice signal by using the voice microphone; and obtaining the noise reduction voice signal based on the third voice signal and the second voice signal.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the headphone noise reduction method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010940245.8A CN112019967B (en) | 2020-09-09 | 2020-09-09 | Earphone noise reduction method and device, earphone equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010940245.8A CN112019967B (en) | 2020-09-09 | 2020-09-09 | Earphone noise reduction method and device, earphone equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112019967A true CN112019967A (en) | 2020-12-01 |
| CN112019967B CN112019967B (en) | 2022-07-22 |
Family
ID=73522504
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010940245.8A Active CN112019967B (en) | 2020-09-09 | 2020-09-09 | Earphone noise reduction method and device, earphone equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112019967B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113362845A (en) * | 2021-05-28 | 2021-09-07 | 阿波罗智联(北京)科技有限公司 | Method, apparatus, device, storage medium and program product for noise reduction of sound data |
| CN113490093A (en) * | 2021-06-28 | 2021-10-08 | 北京安声浩朗科技有限公司 | TWS earphone |
| CN114264365A (en) * | 2021-12-14 | 2022-04-01 | 歌尔科技有限公司 | Wind noise detection method and device, terminal equipment and storage medium |
| CN114264365B (en) * | 2021-12-14 | 2024-04-30 | 歌尔科技有限公司 | Wind noise detection method, device, terminal equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4380004A (en) * | 1981-03-19 | 1983-04-12 | Coats Montgomery R | Emergency sound detector device |
| US20110004470A1 (en) * | 2009-07-02 | 2011-01-06 | Mr. Alon Konchitsky | Method for Wind Noise Reduction |
| CN110012378A (en) * | 2019-04-08 | 2019-07-12 | 深圳市九音科技有限公司 | A kind of method of voice de-noising, earplug and computer storage medium |
| CN110931031A (en) * | 2019-10-09 | 2020-03-27 | 大象声科（深圳）科技有限公司 | Deep learning voice extraction and noise reduction method fusing bone vibration sensor and microphone signals |
| CN111327985A (en) * | 2020-03-06 | 2020-06-23 | 华勤通讯技术有限公司 | Earphone noise reduction method and device |
| CN111405406A (en) * | 2020-03-27 | 2020-07-10 | 歌尔股份有限公司 | Noise reduction method and device for hybrid noise reduction earphone, wireless earphone and storage medium |
-
2020
- 2020-09-09 CN CN202010940245.8A patent/CN112019967B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4380004A (en) * | 1981-03-19 | 1983-04-12 | Coats Montgomery R | Emergency sound detector device |
| US20110004470A1 (en) * | 2009-07-02 | 2011-01-06 | Mr. Alon Konchitsky | Method for Wind Noise Reduction |
| CN110012378A (en) * | 2019-04-08 | 2019-07-12 | 深圳市九音科技有限公司 | A kind of method of voice de-noising, earplug and computer storage medium |
| CN110931031A (en) * | 2019-10-09 | 2020-03-27 | 大象声科（深圳）科技有限公司 | Deep learning voice extraction and noise reduction method fusing bone vibration sensor and microphone signals |
| CN111327985A (en) * | 2020-03-06 | 2020-06-23 | 华勤通讯技术有限公司 | Earphone noise reduction method and device |
| CN111405406A (en) * | 2020-03-27 | 2020-07-10 | 歌尔股份有限公司 | Noise reduction method and device for hybrid noise reduction earphone, wireless earphone and storage medium |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113362845A (en) * | 2021-05-28 | 2021-09-07 | 阿波罗智联(北京)科技有限公司 | Method, apparatus, device, storage medium and program product for noise reduction of sound data |
| US11798573B2 (en) | 2021-05-28 | 2023-10-24 | Apollo Intelligent Connectivity (Beijing) Technology Co., Ltd. | Method for denoising voice data, device, and storage medium |
| CN113490093A (en) * | 2021-06-28 | 2021-10-08 | 北京安声浩朗科技有限公司 | TWS earphone |
| CN113490093B (en) * | 2021-06-28 | 2023-11-07 | 北京安声浩朗科技有限公司 | TWS earphone |
| CN114264365A (en) * | 2021-12-14 | 2022-04-01 | 歌尔科技有限公司 | Wind noise detection method and device, terminal equipment and storage medium |
| CN114264365B (en) * | 2021-12-14 | 2024-04-30 | 歌尔科技有限公司 | Wind noise detection method, device, terminal equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112019967B (en) | 2022-07-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6034793B2 (en) | Audio signal generation system and method | |
| JP5293817B2 (en) | Audio signal processing apparatus and audio signal processing method | |
| KR102456125B1 (en) | Speech noise cancellation method and device, server and storage medium | |
| US9343056B1 (en) | Wind noise detection and suppression | |
| KR101444100B1 (en) | Noise cancelling method and apparatus from the mixed sound | |
| CN109195042B (en) | Low-power-consumption efficient noise reduction earphone and noise reduction system | |
| CN112767963B (en) | Voice enhancement method, device and system and computer readable storage medium | |
| US20110046948A1 (en) | Automatic sound recognition based on binary time frequency units | |
| JP6545419B2 (en) | Acoustic signal processing device, acoustic signal processing method, and hands-free communication device | |
| JP5649488B2 (en) | Voice discrimination device, voice discrimination method, and voice discrimination program | |
| CN110782912A (en) | Sound source control method and speaker device | |
| CN112019967B (en) | Earphone noise reduction method and device, earphone equipment and storage medium | |
| CN103426433A (en) | Noise cancellation method | |
| US20170365249A1 (en) | System and method of performing automatic speech recognition using end-pointing markers generated using accelerometer-based voice activity detector | |
| CN109040500B (en) | Echo cancellation method, echo cancellation device, earphone device and computer-readable storage medium | |
| US20160267925A1 (en) | Audio processing apparatus that outputs, among sounds surrounding user, sound to be provided to user | |
| KR101961998B1 (en) | Reducing instantaneous wind noise | |
| JP2022505997A (en) | Deep learning voice extraction and noise reduction method that fuses bone vibration sensor and microphone signal | |
| CN110931027A (en) | Audio processing method and device, electronic equipment and computer readable storage medium | |
| EP2482566B1 (en) | Method for generating an audio signal | |
| CN107452398B (en) | Echo acquisition method, electronic device and computer readable storage medium | |
| JP6179081B2 (en) | Noise reduction device, voice input device, wireless communication device, and noise reduction method | |
| JP2013168856A (en) | Noise reduction device, audio input device, radio communication device, noise reduction method and noise reduction program | |
| JP3434215B2 (en) | Sound pickup device, speech recognition device, these methods, and program recording medium | |
| WO2018167960A1 (en) | Speech processing device, speech processing system, speech processing method, and speech processing program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |