CN114257908A - Method and device for reducing noise of earphone during conversation, computer readable storage medium and earphone - Google Patents
Method and device for reducing noise of earphone during conversation, computer readable storage medium and earphone Download PDFInfo
- Publication number
- CN114257908A CN114257908A CN202110369227.3A CN202110369227A CN114257908A CN 114257908 A CN114257908 A CN 114257908A CN 202110369227 A CN202110369227 A CN 202110369227A CN 114257908 A CN114257908 A CN 114257908A
- Authority
- CN
- China
- Prior art keywords
- signal
- microphone
- voice signal
- voice
- delay
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 230000005236 sound signal Effects 0.000 claims abstract description 93
- 230000009467 reduction Effects 0.000 claims abstract description 39
- 230000006870 function Effects 0.000 claims description 51
- 238000012546 transfer Methods 0.000 claims description 44
- 238000001914 filtration Methods 0.000 claims description 26
- 230000002452 interceptive effect Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 2
- 238000012545 processing Methods 0.000 abstract description 5
- 230000005540 biological transmission Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 8
- 230000003044 adaptive effect Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000002238 attenuated effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2420/00—Details of connection covered by H04R, not provided for in its groups
- H04R2420/07—Applications of wireless loudspeakers or wireless microphones
Abstract
The application provides a conversation noise reduction method and device of an earphone, a computer readable storage medium and the earphone, and relates to the technical field of signal processing. The conversation noise reduction method of the earphone comprises the following steps: acquiring a first sound signal acquired by a first microphone and a second sound signal acquired by a second microphone; and performing first delay compensation operation on the first sound signal and/or the second sound signal to obtain a first voice signal corresponding to the first microphone and the second microphone, wherein the first delay compensation operation is used for improving the signal-to-noise ratio of the signal collected by the microphone array. The signal-to-noise ratio of signals collected by the microphone array of the earphone is effectively improved, and high-quality precondition is provided for realizing high-definition voice transmission function.
Description
Technical Field
The present application relates to the field of signal processing technologies, and in particular, to a method and an apparatus for reducing noise in a call of an earphone, a computer-readable storage medium, and an earphone.
Background
In recent years, bluetooth headsets have evolved rapidly, especially True Wireless Stereo (TWS) headsets. In general, a bluetooth headset has a voice call function in addition to a function of playing media audio.
However, there is no noise everywhere in a real environment. When the earphone user speaks the voice content, the microphone array arranged on the Bluetooth earphone collects the voice signals of the earphone user and also collects noise signals sent by various background noise sources. The mixed signal has low signal-to-noise ratio, which causes physiological discomfort to both parties in a call and even directly causes the content of the voice of the other party to be unclear. Therefore, how to improve the signal-to-noise ratio of the signal collected by the microphone array of the earphone becomes an urgent problem to be solved.
Disclosure of Invention
The present application is proposed to solve the above-mentioned technical problems. The embodiment of the application provides a method and a device for reducing the noise of a conversation of an earphone, a computer readable storage medium and the earphone.
In a first aspect, an embodiment of the present application provides a method for reducing noise in a call of an earphone, where the method for reducing noise in a call includes: acquiring a first sound signal acquired by a first microphone and a second sound signal acquired by a second microphone; and performing first delay compensation operation on the first sound signal and/or the second sound signal to obtain a first voice signal corresponding to the first microphone and the second microphone, wherein the first delay compensation operation is used for improving the signal-to-noise ratio of the signal collected by the microphone array.
With reference to the first aspect, in an embodiment of the present application, performing a first delay compensation operation on a first acoustic signal and/or a second acoustic signal to obtain a first speech signal corresponding to a first microphone and a second microphone includes: determining a first delay signal corresponding to the first acoustic signal based on a first transfer function, wherein the first transfer function is a transfer function of a space between a mouth of a user of the earphone and the second microphone; determining a second delay signal corresponding to the second sound signal based on a second transfer function, wherein the second transfer function is a transfer function of a space between the mouth of the earphone user and the first microphone; and carrying out summation operation based on the first delay signal and the second delay signal to obtain a first voice signal.
With reference to the first aspect, in an embodiment of the present application, the method for reducing noise in a call further includes: performing second delay compensation operation on the first sound signal and/or the second sound signal to obtain a second voice signal corresponding to the first microphone and the second microphone, wherein the second delay compensation operation is used for reducing the signal-to-noise ratio of the signal acquired by the microphone array; and eliminating the interference sound signal in the first voice signal based on the second voice signal to obtain a third voice signal.
With reference to the first aspect, in an embodiment of the present application, performing a second delay compensation operation on the first acoustic signal and/or the second acoustic signal to obtain a second speech signal corresponding to the first microphone and the second microphone includes: determining a first delay signal corresponding to the first acoustic signal based on a first transfer function, wherein the first transfer function is a transfer function of a space between a mouth of a user of the earphone and the second microphone; determining a second delay signal corresponding to the second sound signal based on a second transfer function, wherein the second transfer function is a transfer function of a space between the mouth of the earphone user and the first microphone; and performing difference operation based on the first delay signal and the second delay signal to obtain a second voice signal.
With reference to the first aspect, in an embodiment of the present application, before canceling the interfering sound signal in the first voice signal based on the second voice signal to obtain a third voice signal, the call noise reduction method further includes: and performing filtering operation on the second voice signal to minimize the signal-to-noise ratio of the second voice signal to obtain a fourth voice signal. Wherein, eliminate the interference sound signal in the first speech signal based on the second speech signal, obtain the third speech signal, include: and eliminating the interference sound signal in the first voice signal based on the fourth voice signal to obtain a third voice signal.
With reference to the first aspect, in an embodiment of the present application, before performing a filtering operation on the second voice signal to minimize a signal-to-noise ratio of the second voice signal, the call noise reduction method further includes: and determining a filtering parameter corresponding to the filtering operation based on the second voice signal and the deviation signal corresponding to the first voice signal and the second voice signal. Wherein, filtering the second voice signal to minimize the signal-to-noise ratio of the second voice signal, and obtaining a fourth voice signal, includes: and carrying out filtering operation on the second voice signal based on the filtering parameters to obtain a fourth voice signal.
In a second aspect, an embodiment of the present application provides a device for reducing noise in a call of a headset, including: the acquisition module is used for acquiring a first acoustic signal acquired by the first microphone and a second acoustic signal acquired by the second microphone; and the delay compensation module is used for performing first delay compensation operation on the first sound signal and/or the second sound signal to obtain a first voice signal corresponding to the first microphone and the second microphone, wherein the first delay compensation operation is used for improving the signal-to-noise ratio of the signal collected by the microphone array.
In a third aspect, an embodiment of the present application provides a computer-readable storage medium, where the storage medium stores a computer program for executing the call noise reduction method for a headset according to any of the above embodiments.
In a fourth aspect, an embodiment of the present application provides a computer device, including: a processor; a memory for storing processor-executable instructions; and the processor is used for executing the call noise reduction method of the earphone mentioned in any embodiment.
In a fifth aspect, an embodiment of the present application provides a headset, including: a microphone array comprising a first microphone for acquiring a first acoustic signal and a second microphone for acquiring a second acoustic signal; the voice noise reduction module is connected with the microphone array and used for carrying out first delay compensation operation on the first sound signal and/or the second sound signal to obtain a first voice signal corresponding to the first microphone and the second microphone, wherein the first delay compensation operation is used for improving the signal-to-noise ratio of the signals collected by the microphone array.
According to the conversation noise reduction method of the earphone, the first sound signal collected by the first microphone and the second sound signal collected by the second microphone are obtained, then the first time delay compensation operation is carried out on the first sound signal and/or the second sound signal, the first voice signal corresponding to the first microphone and the second microphone is obtained, and the signal to noise ratio of the signals collected by the microphone array of the earphone is effectively improved. When the method provided by the embodiment of the application is applied to the Bluetooth headset to reduce the noise of the call, a high-quality precondition is provided for realizing the high-definition voice transmission function of the Bluetooth headset.
Drawings
The above and other objects, features and advantages of the present application will become more apparent by describing in more detail embodiments of the present application with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application. In the drawings, like reference numbers generally represent like parts or steps.
Fig. 1 is a schematic flow chart of a call noise reduction method for an earphone according to an embodiment of the present application.
Fig. 2 is a schematic flow chart illustrating a process of performing a first delay compensation operation on a first acoustic signal and/or a second acoustic signal to obtain a first speech signal corresponding to a first microphone and a second microphone according to an embodiment of the present application.
Fig. 3 is a schematic flow chart of a call noise reduction method for an earphone according to another embodiment of the present application.
Fig. 4 is a schematic flow chart illustrating a process of performing a second delay compensation operation on a first acoustic signal and/or a second acoustic signal to obtain a second speech signal corresponding to a first microphone and a second microphone according to an embodiment of the present application.
Fig. 5 is a schematic flow chart of a call noise reduction method for an earphone according to another embodiment of the present application.
Fig. 6 is a schematic flow chart of a call noise reduction method for an earphone according to still another embodiment of the present application.
Fig. 7 is a schematic structural diagram of a call noise reduction device of an earphone according to an embodiment of the present application.
Fig. 8 is a schematic structural diagram of an earphone according to an embodiment of the present application.
Fig. 9 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a schematic flow chart of a call noise reduction method for an earphone according to an embodiment of the present application. As shown in fig. 1, a method for reducing noise of a call of a headset according to an embodiment of the present application includes the following steps.
And step 10, acquiring a first sound signal acquired by the first microphone and a second sound signal acquired by the second microphone.
And 20, performing a first delay compensation operation on the first sound signal and/or the second sound signal to obtain a first voice signal corresponding to the first microphone and the second microphone.
Illustratively, the first delay compensation operation is used to improve the signal-to-noise ratio of the signals collected by the microphone array. Wherein the microphone array comprises the first microphone and the second microphone mentioned in step 10.
Illustratively, the first delay compensation operation is to time "align" the first acoustic signal and the speech signal sent out from the mouth of the user of the earphone included in the second acoustic signal on two channels, and then superimpose the "aligned" signals, so as to achieve the purpose of improving the signal-to-noise ratio of the signals collected by the microphone array. The specific manner of the superposition includes, but is not limited to, direct superposition, arithmetic mean superposition, weighted superposition, and the like.
It should be noted that, since the interfering sound signal such as the ambient noise signal is usually non-directional or non-directional with respect to the user voice, the time difference between the arrival of the interfering sound signal at the first microphone and the arrival of the interfering sound signal at the second microphone is different from the time difference between the arrival of the voice signal at the first microphone and the arrival of the voice signal at the second microphone, and thus, it is known that the interfering sound signal is not "aligned" by the delay compensation operation for the voice signal. Taking direct superposition as an example, the interfering sound signal is not enhanced and the voice signal is enhanced, so that the signal-to-noise ratio of the signals collected by the microphone array is remarkably improved.
According to the conversation noise reduction method of the earphone, the first sound signal collected by the first microphone and the second sound signal collected by the second microphone are obtained, then the first time delay compensation operation is carried out on the first sound signal and/or the second sound signal, the first voice signal corresponding to the first microphone and the second microphone is obtained, and the signal to noise ratio of the signals collected by the microphone array is effectively improved. Especially, when the method provided by the embodiment of the application is applied to the Bluetooth headset for call noise reduction, a precondition is provided for realizing the high-definition voice transmission function of the Bluetooth headset.
It should be noted that the first microphone and the second microphone mentioned in the above embodiments of the present application may be an independent microphone, that is, a plurality of independent microphones form a microphone array. In addition, the first microphone and the second microphone mentioned in the embodiments of the present application may also be an independent microphone sub-array, that is, a plurality of independent microphone sub-arrays form a microphone array.
Fig. 2 is a schematic flow chart illustrating a process of performing a first delay compensation operation on a first acoustic signal and/or a second acoustic signal to obtain a first speech signal corresponding to a first microphone and a second microphone according to an embodiment of the present application. The embodiment shown in fig. 2 is extended based on the embodiment shown in fig. 1, and the differences between the embodiment shown in fig. 2 and the embodiment shown in fig. 1 will be emphasized below, and the descriptions of the same parts will not be repeated.
As shown in fig. 2, in the call noise reduction method for an earphone provided in the embodiment of the present application, a step of performing a first delay compensation operation on a first acoustic signal and/or a second acoustic signal to obtain a first voice signal corresponding to a first microphone and a second microphone (step 20) includes the following steps.
Illustratively, the first transfer function is a transfer function of a space between a mouth of a user of the earphone and the second microphone, and is used for representing phase delay and amplitude attenuation which are experienced by an original voice signal of the user when the original voice signal reaches the second microphone, and the first transfer function is multiplied by the first acoustic signal in a frequency domain or convolved in a time domain to obtain a first delay signal corresponding to the first acoustic signal.
And step 22, determining a second delay signal corresponding to the second sound signal based on the second transfer function.
Illustratively, the second transfer function is a transfer function of a space between the mouth of the user of the earphone and the first microphone, and is used for representing phase delay and amplitude attenuation which are experienced by an original voice signal of the user when the original voice signal reaches the first microphone, and the second transfer function is multiplied by the second voice signal in a frequency domain or convolved in a time domain to obtain a second delay signal corresponding to the second voice signal.
And step 23, performing summation operation based on the first delay signal and the second delay signal to obtain a first voice signal.
According to the conversation noise reduction method of the earphone, the first delay signal corresponding to the first sound signal is determined based on the first transfer function, the second delay signal corresponding to the second sound signal is determined based on the second transfer function, and then the summation operation is carried out based on the first delay signal and the second delay signal to obtain the first voice signal, so that the first delay compensation operation is carried out on the first sound signal and/or the second sound signal, and the purpose of obtaining the first voice signal corresponding to the first microphone and the second microphone is achieved.
Fig. 3 is a schematic flow chart of a call noise reduction method for an earphone according to another embodiment of the present application. The embodiment shown in fig. 3 is extended based on the embodiment shown in fig. 1, and the differences between the embodiment shown in fig. 3 and the embodiment shown in fig. 1 will be emphasized below, and the descriptions of the same parts will not be repeated.
As shown in fig. 3, in the call noise reduction method for a headset according to the embodiment of the present application, after the step of acquiring the first acoustic signal collected by the first microphone and the second acoustic signal collected by the second microphone (step 10), the following steps are further included.
And step 30, performing second delay compensation operation on the first sound signal and/or the second sound signal to obtain a second voice signal corresponding to the first microphone and the second microphone.
Illustratively, the second delay compensation operation is used to reduce the signal-to-noise ratio of the signals collected by the microphone array. That is, the second speech signal has a reduced signal-to-noise ratio compared to the first acoustic signal and the second acoustic signal (e.g., the interfering acoustic signal is unchanged and the speech signal is attenuated).
Optionally, the second delay compensation operation is used to attenuate or eliminate the speech signal in the first acoustic signal and/or the second acoustic signal to reduce the signal-to-noise ratio of the signals collected by the microphone array.
It should be noted that the execution sequence of step 20 and step 30 may be determined according to actual situations, and this is not limited in this embodiment of the present application. In other words, step 30 may be performed before step 20, after step 20, or simultaneously with step 20.
And step 60, eliminating the interference sound signal in the first voice signal based on the second voice signal to obtain a third voice signal.
Since the first voice signal is obtained after the first delay compensation operation and the second voice signal is obtained after the second delay compensation operation, the interfering sound signal in the first voice signal can be eliminated based on the second voice signal to obtain the third voice signal. For example, the cancellation is performed by adding the first speech signal and the inverted second speech signal to obtain a third speech signal.
In the practical application process, a first sound signal collected by a first microphone and a second sound signal collected by a second microphone are firstly obtained, then first delay compensation operation is carried out on the first sound signal and/or the second sound signal to obtain a first voice signal corresponding to the first microphone and the second microphone, second delay compensation operation is carried out on the first sound signal and/or the second sound signal to obtain a second voice signal corresponding to the first microphone and the second microphone, and then interference sound signals in the first voice signal are eliminated based on the second voice signal to obtain a third voice signal.
The third voice signal is determined in a manner of eliminating the interference sound signal in the first voice signal by using the second voice signal, so that the call noise reduction method of the earphone provided by the embodiment of the application can further improve the signal-to-noise ratio of the signal collected by the microphone array.
Specifically, in both the first voice signal and the second voice signal, the direction of the disturbing sound signal and the direction of the voice signal are different from each other with respect to the microphone, and the direction of the disturbing sound signal in the first voice signal and the direction of the voice signal in the second voice signal coincide with each other. Furthermore, in the second speech signal the signal-to-noise ratio of the speech signal is reduced, for example in the second speech signal the interfering acoustic signal is unchanged and the speech signal is attenuated.
On the basis of this, the interference sound signal in the first speech signal can be eliminated based on the second speech signal in a subtraction cancellation manner, so as to obtain a third speech signal with a higher signal-to-noise ratio.
Fig. 4 is a schematic flow chart illustrating a process of performing a second delay compensation operation on a first acoustic signal and/or a second acoustic signal to obtain a second speech signal corresponding to a first microphone and a second microphone according to an embodiment of the present application. The embodiment shown in fig. 4 is extended based on the embodiment shown in fig. 3, and the differences between the embodiment shown in fig. 4 and the embodiment shown in fig. 3 will be emphasized below, and the descriptions of the same parts will not be repeated.
As shown in fig. 4, in the call noise reduction method for an earphone provided in the embodiment of the present application, a step of performing a second delay compensation operation on a first sound signal and/or a second sound signal to obtain a second voice signal corresponding to a first microphone and a second microphone (step 30) includes the following steps.
Illustratively, the first transfer function is a transfer function of a space between the mouth of the user of the earphone and the second microphone, and the first transfer function is multiplied by the first acoustic signal in a frequency domain or convolved in a time domain to obtain a first delay signal corresponding to the first acoustic signal.
And step 32, determining a second delay signal corresponding to the second sound signal based on the second transfer function.
Illustratively, the second transfer function is a transfer function of a space between the mouth of the user of the earphone and the first microphone, and the second transfer function is multiplied by the second sound signal in a frequency domain or convolved in a time domain to obtain a second delayed signal corresponding to the second sound signal.
It should be noted that, step 21 and step 22 are the same as step 31 and step 32, respectively, and in some embodiments, they may be performed once.
And step 33, performing a difference operation based on the first delay signal and the second delay signal to obtain a second voice signal.
According to the conversation noise reduction method of the earphone, the first delay signal corresponding to the first sound signal is determined based on the first transfer function, the second delay signal corresponding to the second sound signal is determined based on the second transfer function, and then the difference operation is carried out based on the first delay signal and the second delay signal to obtain the second voice signal, so that the second delay compensation operation is carried out on the first sound signal and/or the second sound signal, and the purpose of obtaining the second voice signal corresponding to the first microphone and the second microphone is achieved.
Fig. 5 is a schematic flow chart of a call noise reduction method for an earphone according to another embodiment of the present application. The embodiment shown in fig. 5 is extended based on the embodiment shown in fig. 3, and the differences between the embodiment shown in fig. 5 and the embodiment shown in fig. 3 will be emphasized below, and the descriptions of the same parts will not be repeated.
As shown in fig. 5, in the method for reducing noise in a call of a headset according to the embodiment of the present application, before the step of removing an interfering sound signal in a first voice signal based on a second voice signal to obtain a third voice signal (step 60), the following steps are further included.
And 50, performing filtering operation on the second voice signal to minimize the signal-to-noise ratio of the second voice signal to obtain a fourth voice signal.
Illustratively, the filtering operation is performed on the second speech signal based on an adaptive filter to minimize a signal-to-noise ratio of the second speech signal.
In the embodiment of the present application, the step of removing the interfering sound signal in the first speech signal based on the second speech signal to obtain the third speech signal (step 60) includes the following steps.
And 61, eliminating the interference sound signal in the first voice signal based on the fourth voice signal to obtain a third voice signal.
The method for reducing the noise of the earphone in the call provided by the embodiment of the application obtains a first sound signal collected by a first microphone and a second sound signal collected by a second microphone, then performs a first delay compensation operation on the first sound signal and/or the second sound signal to obtain a first voice signal corresponding to the first microphone and the second microphone, and performs a second delay compensation operation on the first sound signal and/or the second sound signal to obtain a second voice signal corresponding to the first microphone and the second microphone, and then performs a filtering operation on the second voice signal to minimize the signal-to-noise ratio of the second voice signal to obtain a fourth voice signal, and eliminates an interference sound signal in the first voice signal based on the fourth voice signal to obtain a third voice signal, so that the signal-to-noise ratio of the signals collected by the microphone array is effectively improved.
Since the fourth speech signal is a speech signal obtained by minimizing the signal-to-noise ratio of the second speech signal, and the signal-to-noise ratio of the fourth speech signal is less than or equal to the signal-to-noise ratio of the second speech signal, compared with the embodiment shown in fig. 3, the embodiment of the present application can further improve the signal-to-noise ratio of the signal collected by the microphone array.
Specifically, in the first voice signal, the second voice signal, and the fourth voice signal, the direction of the disturbing sound signal and the direction of the voice signal are different from each other with respect to the microphone, and the direction of the disturbing sound signal is the same among the first voice signal, the second voice signal, and the fourth voice signal, and the direction of the voice signal is the same among the first voice signal, the second voice signal, and the fourth voice signal. Furthermore, in the second speech signal the signal-to-noise ratio of the speech signal is reduced, for example in the second speech signal the interfering acoustic signal is unchanged and the speech signal is attenuated.
And because the fourth voice signal is obtained after minimizing the signal-to-noise ratio of the second voice signal, the change of the signal-to-noise ratio does not cause the change of the directions of the voice signal and the interference sound signal, which is equivalent to changing the sensitivity of collecting sounds in different directions (making the interference sound signal totally pass but the voice signal null). On the basis of this, the interference sound signal in the first speech signal can still be cancelled based on the fourth speech signal, so as to obtain a third speech signal with a higher signal-to-noise ratio.
Fig. 6 is a schematic flow chart of a call noise reduction method for an earphone according to still another embodiment of the present application. The embodiment shown in fig. 6 is extended based on the embodiment shown in fig. 5, and the differences between the embodiment shown in fig. 6 and the embodiment shown in fig. 5 will be emphasized below, and the descriptions of the same parts will not be repeated.
As shown in fig. 6, in the call noise reduction method for a headset according to the embodiment of the present application, before the step of performing a filtering operation on the second voice signal to minimize the signal-to-noise ratio of the second voice signal (step 50), the following steps are further included.
And step 40, determining a filter parameter corresponding to the filter operation based on the second voice signal and the deviation signal corresponding to the first voice signal and the second voice signal.
For example, the bias signal mentioned in step 40 is an error signal between the first speech signal and the second speech signal, i.e. a bias signal of the adaptive element of the adaptive filter. Wherein the adaptive filter is used to perform the filtering operation mentioned in step 40, and the second speech signal is the reference signal of the adaptive element of the adaptive filter.
In the embodiment of the present application, the step of performing a filtering operation on the second speech signal to minimize the signal-to-noise ratio of the second speech signal to obtain a fourth speech signal (step 50) includes the following steps.
And step 51, performing filtering operation on the second voice signal based on the finally determined filtering parameter in step 40 to obtain a fourth voice signal.
The method for reducing noise in a call of an earphone provided in the embodiment of the present application obtains a first voice signal collected by a first microphone and a second voice signal collected by a second microphone, then performs a first delay compensation operation on the first voice signal and/or the second voice signal to obtain a first voice signal corresponding to the first microphone and the second microphone, and performs a second delay compensation operation on the first voice signal and/or the second voice signal to obtain a second voice signal corresponding to the first microphone and the second microphone, then determines a filtering parameter corresponding to the filtering operation based on the second voice signal and a deviation signal corresponding to the first voice signal and the second voice signal, performs the filtering operation on the second voice signal based on the filtering parameter to obtain a fourth voice signal, and eliminates an interfering voice signal in the first voice signal based on the fourth voice signal, and the signal-to-noise ratio of the signals collected by the microphone array is effectively improved by the mode of obtaining the third voice signal.
Fig. 7 is a schematic structural diagram of a call noise reduction device of an earphone according to an embodiment of the present application. As shown in fig. 7, a device for reducing noise in a call of a headset according to an embodiment of the present application includes:
the acquiring module 100 is configured to acquire a first acoustic signal acquired by a first microphone and a second acoustic signal acquired by a second microphone.
The delay compensation module 200 is configured to perform a first delay compensation operation on the first acoustic signal and/or the second acoustic signal to obtain a first voice signal corresponding to the first microphone and the second microphone.
The conversation of earphone that this application embodiment provided falls device of making an uproar through the second sound signal that acquires first acoustic signal and the second microphone collection that acquires first microphone collection, carries out first time delay compensation operation to first acoustic signal and/or second sound signal then, obtains the mode of first speech signal that first microphone and second microphone correspond, has effectively improved the SNR of the signal that microphone array gathered.
It should be understood that the operations and functions of the obtaining module 100 and the delay compensation module 200 included in the call noise reduction device of the headset provided in fig. 7 may refer to the call noise reduction method of the headset provided in fig. 1 to fig. 6, and are not described herein again to avoid repetition.
Fig. 8 is a schematic structural diagram of an earphone according to an embodiment of the present application. As shown in fig. 8, the earphone 300 provided by the embodiment of the present application includes a voice noise reduction module 310, and a microphone array 320 and a speaker 330 communicatively connected to the voice noise reduction module 310. Wherein the microphone array 320 includes a first microphone and a second microphone. Specifically, the program stored in the voice noise reduction module 310 may be used to execute the call noise reduction method of the headset according to any of the above embodiments.
Optionally, the voice noise reduction module 310 includes a delay compensation unit for performing the delay compensation operation (such as the first delay compensation operation and/or the second delay compensation operation) mentioned in the above embodiments.
Illustratively, the headset 300 is a TWS headset.
Fig. 9 is a schematic structural diagram of a computer device according to an embodiment of the present application. As shown in fig. 9, a computer device 400 provided by embodiments of the present application includes one or more processors 410 and memory 420.
Processor 410 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in computer device 400 to perform desired functions.
Memory 420 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium and executed by the processor 410 to implement the above-described call noise reduction method for a headset of various embodiments of the present application and/or other desired functions. Various contents such as the first acoustic signal may also be stored in the computer readable storage medium.
In one example, the computer device 400 may further include: an input device 430 and an output device 440, which are interconnected by a bus system and/or other form of connection mechanism (not shown).
The input device 430 may include, for example, a keyboard, a mouse, a microphone, and the like.
The output device 440 may output various information including the first voice signal after the first delay compensation operation, etc. to the outside. The output means 440 may include, for example, a display, a communication network, speakers, a remote output device connected thereto, and so forth.
Of course, for simplicity, only some of the components of the computer device 400 relevant to the present application are shown in fig. 9, omitting components such as buses, input/output interfaces, and the like. In addition, computer device 400 may include any other suitable components depending on the particular application.
Illustratively, the computer device 400 may be a headset.
In addition to the above-described methods and apparatus, embodiments of the present application may also be a computer program product comprising computer program instructions which, when executed by a processor, cause the processor to perform the steps in the method of call noise reduction for a headset according to various embodiments of the present application described in the "exemplary methods" section of this specification above.
The computer program product may be written with program code for performing the operations of embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, the present application may also be a computer-readable storage medium having stored thereon computer program instructions, which, when executed by a processor, cause the processor to perform the steps in the method for call noise reduction of a headset according to various embodiments of the present application described in the above section "exemplary method" of the present specification.
The computer-readable storage medium may take any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing describes the general principles of the present application in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present application are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present application. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the foregoing disclosure is not intended to be exhaustive or to limit the disclosure to the precise details disclosed.
The block diagrams of devices, apparatuses, systems referred to in this application are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".
It should also be noted that in the devices, apparatuses, and methods of the present application, the components or steps may be decomposed and/or recombined. These decompositions and/or recombinations are to be considered as equivalents of the present application.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the application to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.
Claims (10)
1. A method for reducing noise of a call of an earphone is characterized by comprising the following steps:
acquiring a first sound signal acquired by a first microphone and a second sound signal acquired by a second microphone;
and performing a first delay compensation operation on the first acoustic signal and/or the second acoustic signal to obtain a first voice signal corresponding to the first microphone and the second microphone, wherein the first delay compensation operation is used for improving the signal-to-noise ratio of the signal collected by the microphone array.
2. The method of claim 1, wherein the performing a first delay compensation operation on the first acoustic signal and/or the second acoustic signal to obtain a first voice signal corresponding to the first microphone and the second microphone comprises:
determining a first delay signal corresponding to the first acoustic signal based on a first transfer function, wherein the first transfer function is a transfer function of a space between a mouth of an earphone user and the second microphone;
determining a second delay signal corresponding to the second sound signal based on a second transfer function, wherein the second transfer function is a transfer function of a space between the mouth of the earphone user and the first microphone;
and carrying out summation operation based on the first delay signal and the second delay signal to obtain the first voice signal.
3. The method of reducing noise in a headset according to claim 1, further comprising:
performing a second delay compensation operation on the first acoustic signal and/or the second acoustic signal to obtain a second voice signal corresponding to the first microphone and the second microphone, wherein the second delay compensation operation is used for reducing the signal-to-noise ratio of the signal acquired by the microphone array;
and eliminating the interference sound signal in the first voice signal based on the second voice signal to obtain a third voice signal.
4. The method of claim 3, wherein the performing a second delay compensation operation on the first acoustic signal and/or the second acoustic signal to obtain a second speech signal corresponding to the first microphone and the second microphone comprises:
determining a first delay signal corresponding to the first acoustic signal based on a first transfer function, wherein the first transfer function is a transfer function of a space between a mouth of an earphone user and the second microphone;
determining a second delay signal corresponding to the second sound signal based on a second transfer function, wherein the second transfer function is a transfer function of a space between the mouth of the earphone user and the first microphone;
and carrying out difference operation based on the first delay signal and the second delay signal to obtain the second voice signal.
5. The method of claim 3, wherein before the removing the interfering sound signal in the first voice signal based on the second voice signal to obtain a third voice signal, the method further comprises:
performing filtering operation on the second voice signal to minimize the signal-to-noise ratio of the second voice signal to obtain a fourth voice signal;
wherein, the removing the interference sound signal in the first voice signal based on the second voice signal to obtain a third voice signal includes:
and eliminating the interference sound signal in the first voice signal based on the fourth voice signal to obtain the third voice signal.
6. The method of claim 5, wherein before the filtering the second voice signal to minimize the signal-to-noise ratio of the second voice signal, the method further comprises:
determining a filtering parameter corresponding to the filtering operation based on the second voice signal and a deviation signal corresponding to the first voice signal and the second voice signal;
wherein the filtering the second voice signal to minimize the signal-to-noise ratio of the second voice signal to obtain a fourth voice signal includes:
and carrying out filtering operation on the second voice signal based on the filtering parameter to obtain the fourth voice signal.
7. A device for reducing noise in a communication of a headset, comprising:
the acquisition module is used for acquiring a first acoustic signal acquired by the first microphone and a second acoustic signal acquired by the second microphone;
and the delay compensation module is used for performing a first delay compensation operation on the first acoustic signal and/or the second acoustic signal to obtain a first voice signal corresponding to the first microphone and the second microphone, wherein the first delay compensation operation is used for improving the signal-to-noise ratio of the signal acquired by the microphone array.
8. A computer-readable storage medium, characterized in that the storage medium stores a computer program for executing the method of reducing the noise of a call of a headphone according to any one of the above claims 1 to 6.
9. A computer device, comprising:
a processor;
a memory for storing the processor-executable instructions;
the processor is configured to execute the call noise reduction method of the headset according to any one of claims 1 to 6.
10. An earphone, comprising:
a microphone array comprising a first microphone for acquiring a first acoustic signal and a second microphone for acquiring a second acoustic signal;
and the voice noise reduction module is used for performing first delay compensation operation on the first sound signal and/or the second sound signal to obtain a first voice signal corresponding to the first microphone and the second microphone, wherein the first delay compensation operation is used for improving the signal-to-noise ratio of the signal acquired by the microphone array.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110369227.3A CN114257908A (en) | 2021-04-06 | 2021-04-06 | Method and device for reducing noise of earphone during conversation, computer readable storage medium and earphone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110369227.3A CN114257908A (en) | 2021-04-06 | 2021-04-06 | Method and device for reducing noise of earphone during conversation, computer readable storage medium and earphone |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114257908A true CN114257908A (en) | 2022-03-29 |
Family
ID=80791018
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110369227.3A Pending CN114257908A (en) | 2021-04-06 | 2021-04-06 | Method and device for reducing noise of earphone during conversation, computer readable storage medium and earphone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114257908A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101031956A (en) * | 2004-07-22 | 2007-09-05 | 索福特迈克斯有限公司 | Headset for separation of speech signals in a noisy environment |
| CN101466056A (en) * | 2008-12-31 | 2009-06-24 | 瑞声声学科技(常州)有限公司 | Method and device for eliminating noise of microphone |
| US20100246851A1 (en) * | 2009-03-30 | 2010-09-30 | Nuance Communications, Inc. | Method for Determining a Noise Reference Signal for Noise Compensation and/or Noise Reduction |
| CN107172538A (en) * | 2012-11-12 | 2017-09-15 | 雅马哈株式会社 | Signal processing system and signal processing method |
| CN107316649A (en) * | 2017-05-15 | 2017-11-03 | 百度在线网络技术（北京）有限公司 | Audio recognition method and device based on artificial intelligence |
| CN110012331A (en) * | 2019-04-11 | 2019-07-12 | 杭州微纳科技股份有限公司 | A kind of far field diamylose far field audio recognition method of infrared triggering |
| EP3554095A1 (en) * | 2018-04-10 | 2019-10-16 | Nanjing Horizon Robotics Technology Co., Ltd. | Sound-processing apparatus and sound-processing method |
| CN110476208A (en) * | 2017-02-13 | 2019-11-19 | 伯斯有限公司 | Audio system and method for disturbing signal compensation |
| CN111640428A (en) * | 2020-05-29 | 2020-09-08 | 北京百度网讯科技有限公司 | Voice recognition method, device, equipment and medium |
| CN112511943A (en) * | 2020-12-04 | 2021-03-16 | 北京声智科技有限公司 | Sound signal processing method and device and electronic equipment |
-
2021
- 2021-04-06 CN CN202110369227.3A patent/CN114257908A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101031956A (en) * | 2004-07-22 | 2007-09-05 | 索福特迈克斯有限公司 | Headset for separation of speech signals in a noisy environment |
| CN101466056A (en) * | 2008-12-31 | 2009-06-24 | 瑞声声学科技(常州)有限公司 | Method and device for eliminating noise of microphone |
| US20100246851A1 (en) * | 2009-03-30 | 2010-09-30 | Nuance Communications, Inc. | Method for Determining a Noise Reference Signal for Noise Compensation and/or Noise Reduction |
| CN107172538A (en) * | 2012-11-12 | 2017-09-15 | 雅马哈株式会社 | Signal processing system and signal processing method |
| CN110476208A (en) * | 2017-02-13 | 2019-11-19 | 伯斯有限公司 | Audio system and method for disturbing signal compensation |
| CN107316649A (en) * | 2017-05-15 | 2017-11-03 | 百度在线网络技术（北京）有限公司 | Audio recognition method and device based on artificial intelligence |
| EP3554095A1 (en) * | 2018-04-10 | 2019-10-16 | Nanjing Horizon Robotics Technology Co., Ltd. | Sound-processing apparatus and sound-processing method |
| CN110012331A (en) * | 2019-04-11 | 2019-07-12 | 杭州微纳科技股份有限公司 | A kind of far field diamylose far field audio recognition method of infrared triggering |
| CN111640428A (en) * | 2020-05-29 | 2020-09-08 | 北京百度网讯科技有限公司 | Voice recognition method, device, equipment and medium |
| CN112511943A (en) * | 2020-12-04 | 2021-03-16 | 北京声智科技有限公司 | Sound signal processing method and device and electronic equipment |
Non-Patent Citations (1)
| Title |
|---|
| 张乃通: "《移动通信系统》", 哈尔滨工业大学出版社, pages: 31 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9922663B2 (en) | Voice signal processing method and apparatus | |
| US9749731B2 (en) | Sidetone generation using multiple microphones | |
| KR101183847B1 (en) | Methods and apparatus for suppressing ambient noise using multiple audio signals | |
| CN107431852B (en) | Signal processing apparatus, signal processing method and computer readable storage medium | |
| US10403259B2 (en) | Multi-microphone feedforward active noise cancellation | |
| US10469944B2 (en) | Noise reduction in multi-microphone systems | |
| JP2009194682A (en) | Head transfer function measuring method, and head transfer function convolution method and apparatus | |
| CN111968660A (en) | Echo cancellation device and method, electronic device, and storage medium | |
| CN111402910B (en) | Method and equipment for eliminating echo | |
| US11425517B2 (en) | Conversation support system, method and program for the same | |
| EP3627851B1 (en) | Signal processing method and signal processing device | |
| CN112997249B (en) | Voice processing method, device, storage medium and electronic equipment | |
| JP6822693B2 (en) | Audio output device, audio output method and audio output program | |
| CN114257908A (en) | Method and device for reducing noise of earphone during conversation, computer readable storage medium and earphone | |
| WO2022227982A1 (en) | Tws earphone and playing method and device of tws earphone | |
| US11523215B2 (en) | Method and system for using single adaptive filter for echo and point noise cancellation | |
| CN115209302A (en) | Audio noise reduction processing method, device, equipment, medium and program product | |
| CN114420153A (en) | Sound quality adjusting method, device, equipment and storage medium | |
| CN113542966A (en) | Earphone and control method thereof | |
| US9794678B2 (en) | Psycho-acoustic noise suppression | |
| CN112489669A (en) | Audio signal processing method, device, equipment and medium | |
| CN114257921A (en) | Sound pickup method and device, computer readable storage medium and earphone | |
| US11122366B2 (en) | Method and apparatus for attenuation of audio howling | |
| US20240127783A1 (en) | Noise cancellation method and apparatus, electronic device, noise cancellation headset, and storage medium | |
| CN114255732A (en) | Active noise reduction method and device, computer readable storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |