CN111327984B - Earphone auxiliary listening method based on null filtering and ear-worn equipment - Google Patents
Earphone auxiliary listening method based on null filtering and ear-worn equipment Download PDFInfo
- Publication number
- CN111327984B CN111327984B CN202010122083.7A CN202010122083A CN111327984B CN 111327984 B CN111327984 B CN 111327984B CN 202010122083 A CN202010122083 A CN 202010122083A CN 111327984 B CN111327984 B CN 111327984B
- Authority
- CN
- China
- Prior art keywords
- voice signals
- signal
- wearer
- voice
- time delay
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The application discloses an earphone hearing assisting method and an ear-wearing type device based on null filtering, wherein differential beam forming processing is carried out on two paths of received voice signals, signal time delay is increased on any one path of received voice signals and is differenced with the other path of received voice signals, and null response is formed between voice signals of a wearer in the two paths of received voice signals by adjusting the signal time delay. The method can form null response in the direction of the human mouth for signals with different frequencies to inhibit the voice signal of a wearer, has the characteristics of low power consumption and low time delay, and can effectively inhibit the voice signal of the wearer under the condition of extremely low signal-to-noise ratio to improve the auxiliary listening effect of the earphone.
Description
Technical Field
The application belongs to the technical field of electroacoustic, and particularly relates to an earphone auxiliary listening method based on null filtering and an ear-worn device.
Background
The types of earphones are various and can be classified into a headset, a wired earphone and a wireless bluetooth earphone according to the external structure. With the rapid development of technologies such as bluetooth, audio coding, integrated circuits, artificial intelligence and the like, earphones gradually approach to the trend of wireless and intelligent earphones, and people have higher and higher requirements on portability, controllability and versatility of earphone equipment. Therefore, the true wireless stereo bluetooth headset has been receiving attention and research from scholars in the related art since the advent. Traditional true wireless bluetooth headsets have been given audio playback, voice call, and man-machine interaction functions.
However, the earphone isolates the external acoustic environment of the wearer to a certain extent, and when people communicate with people in the surrounding environment or want to return to the real environment, the earphone is usually detached. The frequent wearing and the taking off of the earphone are troublesome, the user experience is influenced, the frequent wearing and the taking off of the earphone in the using process are avoided, the better user experience is achieved, and the problem to be solved at present is urgent.
Disclosure of Invention
The application discloses an earphone auxiliary listening method based on null filtering and ear-worn equipment, and aims to improve earphone auxiliary listening performance.
In view of the above technical problems, an embodiment of the first aspect of the present application provides an earphone hearing assistance method based on null filtering, which performs differential beam forming processing on two received voice signals, so that a null response is formed between the voice signals of a wearer in the two voice signals.
Optionally, the differential beamforming processing is performed on the two received voice signals, and specifically includes: and adding signal time delay for any one path of received voice signals, carrying out difference with the other path of received voice signals, and outputting a differential beam forming signal.
Optionally, before performing the differential beamforming processing on the two received voice signals, the method further includes: determining the incident angle difference of the voice signal of the wearer in the two received voice signals;
to two way voice signal received, carry out difference beam forming and handle, make and form the null response between the person's voice signal of wearing in two way voice signal, specifically include:
and adjusting the signal time delay to enable the incident angle difference between the voice signals of the wearer in the two voice signals to form null response when the incident angle difference falls within a preset range.
Optionally, adjusting the signal delay specifically includes: when two paths of voice signals are received based on the single-side double microphones, determining a reference value of signal time delay according to the sound velocity and the distance between the two microphones of the single-side double microphones, and adjusting the signal time delay to be the opposite number of the reference value; and/or when the two voice signals are received based on the double-side double microphones, adjusting the signal delay to be 0.
Optionally, after forming a null response between the wearer voice signals in the two voice signals, the method further includes: and performing framing processing on the differential beam forming signals by adopting a window function, and obtaining the frequency spectrum of the output signals through Fourier transform.
Optionally, after obtaining the frequency spectrum of the output signal through fourier transform, the method further includes: and performing frequency compensation on the frequency spectrum of the output signal to recover low-frequency components in the output signal.
In a second aspect, an embodiment of the present application further provides an ear-worn device, including dual microphones for receiving two voice signals, and the ear-worn device further includes a beam former, where:
and the beam former is used for carrying out differential beam forming processing on the two received voice signals so as to form null response between the voice signals of the wearer in the two voice signals.
Optionally, the differential beamformer is specifically configured to: adding signal time delay for any one path of received voice signals, carrying out difference with the other path of voice signals, and outputting a differential beam forming signal;
the ear-wearing type device is provided with a microprocessor, and the microprocessor is used for: determining the incident angle difference of the voice signal of the wearer in the two received voice signals; and adjusting the signal time delay to enable the incident angle difference between the voice signals of the wearer in the two voice signals to form null response when the incident angle difference falls within a preset range.
Optionally, the microprocessor is specifically configured to: when two paths of voice signals are received based on the single-side double microphones, determining a reference value of signal time delay according to the sound velocity and the distance between the two microphones of the single-side double microphones, and adjusting the signal time delay to be the opposite number of the reference value; and/or when the two voice signals are received based on the double-side double microphones, adjusting the signal delay to be 0.
Optionally, the microprocessor is further configured to: performing framing processing on the differential beam forming signals by adopting a window function, and obtaining the frequency spectrum of the output signals through Fourier transform; or, the ear-wearing device is further provided with a frequency compensator for performing frequency compensation on the frequency spectrum of the output signal and recovering the low-frequency component in the output signal.
The embodiment of the application provides a headphone hearing assistance method based on null filtering, aiming at two received voice signals, differential beam forming processing is carried out, null response is formed between the voice signals of a wearer in the two voice signals, the purpose of suppressing the voice of the wearer is achieved, good headphone hearing assistance mode user experience can be kept in a complex sound environment with a low signal-to-noise ratio, particularly in a duplex conversation scene, interference voice of the wearer is effectively suppressed under the condition of the low signal-to-noise ratio, external environment sound can be recovered while external target voice can be selectively enhanced, and headphone hearing assistance performance is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart of a method for assisting listening to an earphone based on null filtering according to an embodiment of the present application;
FIGS. 2 a-2 c are front, side and top views, respectively, of a wearer in an embodiment of the present application;
fig. 3 is a model schematic diagram of a first order differential beamformer of the dual microphone voice communication system disclosed in an embodiment of the present application;
FIGS. 4 a-4 d are diagrams of the 0 DEG directional null notch beamformer beam response disclosed in an embodiment of the present application, respectively;
FIGS. 5 a-5 d are diagrams of the 90 DEG directional null notch beamformer beam response disclosed in the embodiments of the present application, respectively;
fig. 6 is a schematic structural diagram of an ear-worn device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without any creative effort belong to the protection scope of the embodiments in the present application.
The earphone isolates the external acoustic environment of the wearer to a certain extent, and when people communicate with people in the surrounding environment or want to return to the real environment, the earphone is usually required to be detached. In order to avoid repeated wearing and detaching of the earphone, a hearing assisting mode, also called a transparent mode, is newly added to the new generation of real wireless Bluetooth earphones. In this mode, the earphone speaker will restore the external target voice, enabling the wearer to communicate with the outside without hindrance.
A bluetooth headset that turns on the secondary listening mode is similar to a hearing aid, the difference between the two being: the hearing aid mainly faces to a hearing loss patient, and aims to improve the perception of the patient to voice; the earphone is mainly oriented to normal hearing people, and the auxiliary hearing mode of the earphone emphasizes on eliminating the ear blocking effect of the earphone so as to recover the external environment sound. Therefore, the hearing aids have a different emphasis than the built-in algorithm for the earpiece listening mode: because the hearing threshold range of the hearing-impaired people is different from that of normal people, the wide dynamic compression technology and the frequency shift compression technology are key technologies of a hearing aid system, and the key technologies of the auxiliary hearing mode of the earphone comprise earphone equalization, voice noise reduction technology and the like.
The auxiliary listening mode enhances the practicability of the earphone, can improve the convenience of using the real wireless earphone by people, and improves the user experience. Because the voice energy of the wearer picked up by the earphone microphone system is too large, the voice of the wearer is inevitably amplified by the earphone loudspeaker, and the hearing comfort of the wearer is reduced, so that the application focuses on a noise reduction algorithm aiming at the voice signal of the wearer. Because the true wireless Bluetooth headset adopts the battery for power supply, the power consumption of the built-in algorithm is not too large. According to the characteristic that the position of the earphone and the position of the voice of a wearer are relatively fixed, the method and the device firstly utilize the binaural microphone array to carry out zero-trap beam forming so as to inhibit the voice of the wearer and enhance the external target voice. Then a low-pass frequency compensation filter is adopted to solve the problem of energy attenuation of the low-frequency part of the voice signal. The method has the characteristics of higher robustness, low power consumption and low time delay, and can be applied to a non-real-time voice enhancement technology and a real-time voice enhancement technology.
In the embodiment of the application, each ear-worn device (e.g., an earphone) is internally provided with two microphones for receiving two paths of voice signals, each path of voice signal includes a far-field environment signal and a wearer voice signal, when a person wears the earphone, the relative position between the sound emitted by the wearer and the microphones is fixed, and the incident direction is generally fixed and unchanged.
In a first aspect, an embodiment of the present application provides a method for assisting listening to an earphone based on null filtering, as shown in fig. 1, including the steps of:
and S101, performing differential beam forming processing on the two received voice signals.
Optionally, signal delay is added for any one of the two received voice signals, difference is made between the two received voice signals and the other voice signal, and a differential beam forming signal is output.
And S102, forming null response between the wearer voice signals in the two voice signals.
Specifically, the incident angle difference of the voice signal of the wearer in the two received voice signals may be determined first, and the signal delay may be adjusted according to the incident angle difference and the hardware structure of the ear-worn device, so that a null response may be formed when the incident angle difference between the voice signals of the wearer in the two received voice signals falls within a preset range.
Suppose that the discrete signals received by two channels of the earphone microphone array are x respectively1(n) and x2(n)：
x1(n)＝sm(n)*hm1(n)+sf(n)*hf1(n)+d1(n) (1)
x2(n)＝sm(n)*hm2(n)+sf(n)*hf2(n)+d2(n) (2)
Wherein n is the nth sample point, "+" represents convolution operation, sm(n) is the wearer's voice, sfAnd (n) is far-field target voice. h ismi(n) (i ═ 1,2) are respectively a pendantUnit impulse response of the wearer's voice to both microphones, hfi(n) (i is 1,2) is a unit impulse response of a far-field target voice to reach two microphones, di(n) (i ═ 1,2) are the noise signals received by the microphones, and equation (1) and equation (2) can be simplified approximately without considering acoustic reflection and propagation loss:
x1(n)＝sm(n)+sf(n)+d1(n) (3)
x2(n)＝sm(n-τm)+sf(n-τf)+d2(n) (4)
wherein, taumAnd τfThe time difference between the arrival of the wearer's voice and the far-field target voice at the two microphones, respectively.
As an implementation manner, a first-order differential beamformer is designed for the model, and the output signals of the first-order differential beamformer are as follows:
y(n)＝x1(n)-x2(n-T)
＝sm(n)-sm(n-τm-T)+sf(n)-sf(n-τf-T)+d1(n)-d2(n-T) (5)
＝ym(n)+yf(n)+d(n)
wherein T is a preset delay unit, ym(n) and yf(n) output signals of the wearer voice signal and the far-field target signal after being processed by a differential beam former, and d (n) noise signals after being spatially filtered. The first order difference beam former can form a zero notch beam response with a fixed incident direction by adjusting the size of T.
The method provided by the application is suitable for earphone dual-microphone array systems with various configurations, including a single-side dual-microphone system and a double-side dual-microphone array system. Fig. 2 a-2 c are schematic views showing the configuration of the earphone microphone array system, respectively, and fig. 2a is a schematic view showing a wearer wearing a bilateral wireless bluetooth earphone, in which both the bluetooth earphones on the left and right sides are in a dual microphone array configuration; FIG. 2b is a side view of FIG. 2a, as shown in FIG. 2b, the mouth of the person is approximately located on the extension line of the single-sided dual-microphone array, so that the two voice signals received by the dual microphones have almost the same incident angle, and the difference between the incident angles is almost 0; fig. 2c is a top view of fig. 2a, as shown in fig. 2c, the human mouth is located on the midperpendicular of the microphone arrays at the left and right sides, and the difference of the incident angles of the two voice signals is approximately 90 °.
Specifically, in the embodiment of the present application, for the adjustment of the signal delay, the following manner may be adopted: determining a reference value of signal time delay according to the sound velocity and the distance between two microphones of the single-side double microphones; for example, let reference value
c is the speed of sound, dmicIs the distance between the two microphones.
When the two voice signals are received based on the single-side double microphones, the incident angles of the two voice signals are nearly the same, and the difference of the incident angles is about 0 °, as an implementable mode, the allowable error exists, the preset range of the incident angles is set to 0-5 °, for example, when the difference of the incident angles of the two voice signals is 1 °, the preset range is 0-5 °, and the signal time delay is adjusted to be the opposite number of the reference value, namely T ═ T0；
Correspondingly, when the two voice signals are received based on the double-sided double microphones, the incident angle difference of the two voice signals is about 90 degrees, and at this time, as an implementation manner, the allowable error exists, the preset range of the incident angle is set to be 85-95 degrees, for example, when the incident angle difference of the two voice signals is 89 degrees, the preset range is 85-95 degrees, and the signal delay is adjusted to be 0 and the range which cannot be adjusted to be 0.01.
Specifically, for any signal s (n) with an incidence direction θ, a model of a first order difference beamformer of a dual microphone voice communication system is shown in fig. 3. Wherein d ismicIs the separation of the two microphones, i.e. the linear distance between the two microphones, and T is the delay unit. Assuming that the spectrum of the input signal S (n) is S (ω), the output of the first order differential beamformer is such that noise is not taken into accountThe spectrum out of y (n) can be expressed as:
Y(ω,θ)＝S(ω)(1-exp(-j(ωT+kdmiccosθ))) (6)
wherein k is a wave number, satisfies
And c is the speed of sound. exp is an exponential function with a natural constant e as the base. Derived, the magnitude of equation (6) is:
when the formula (7) is satisfied
The beamformer forms a null response in which,
representing a set of integers. Let the reference value
At this time, the corresponding null angle is:
without loss of generality, when l is 0, the null angle is independent of the signal frequency and can be written as:
according to fig. 2 a-2 c, the position of the voice signal of the wireless bluetooth headset wearer is relatively fixed, and for the single-side headset dual-microphone array, the incident direction of the voice signal of the wearer is θmAbout 0 deg. in order to form a null in that direction, pairThe delay unit should be set to T ═ T0(ii) a For a binaural transaudient array, the direction of incidence of the wearer's speech signal is θmApproximately 90 deg., the corresponding delay element should be set to T-0 in order to form a null in that direction.
In general, the distance between the two microphones of the single-side earphone is 1-2 cm, and the beam response of the dual-microphone array with the distance of 1.5cm is as shown in fig. 4 a-4 d, and as can be seen from the diagrams in fig. 4, the designed beam former can form the null in the 0 ° direction for different frequencies, so as to achieve the purpose of reducing the voice signal of the wearer. For a binaural dual microphone array, the average human head binaural distance is about 15.2cm according to ITU-T p.58 standard [11], and a null beamformer is designed for the dual microphone array in this configuration, resulting in the beam response shown in fig. 4. As can be seen from fig. 5 a-5 d, the beamformers are designed to form nulls in the 90 ° direction for different frequencies. Comparing fig. 4 and fig. 5, it can be seen that the beamformer formed by the binaural dual microphone array is higher in side lobe level and is also more likely to generate grating lobes than the single-sided dual microphone array due to the larger aperture of the binaural microphone array. Therefore, the zero-trap beam former with the single-side double-microphone array design has better effect.
By utilizing the designed null filter, although the voice signal of the wearer can be effectively reduced, the null filter has obvious high-pass filtering effect, thereby causing the phenomenon that the low-frequency component of the voice is seriously distorted. For a zero notch beamformer in the 0 ° direction, the frequency response curves of the signals incident in the 90 °, 30 ° and 60 ° directions through the spatial filter are cut by about 80dB for the low frequency components of the incident signals in the 90 ° direction and about 40dB for the low frequency components of the signals incident from the 30 ° and 60 ° directions. The frequency response of the 90 ° null beamformer is shown to be reduced by about 60dB for the low frequency components of the 0 ° incident signal and about 30dB for the low frequency components of the signals incident from the 30 ° and 60 ° directions. To solve the problem that the high pass effect of the zero notch beamformer causes low frequency distortion of the speech signal, the present application proposes a general frequency compensation filter:
wherein, ω iscTo cut off the frequency, the filter can be used for any angle of incidence. After the frequency compensation filtering, the frequency response curve of the zero notch beam former in the 0-degree direction or the 90-degree direction becomes very straight in the range of medium and low frequencies, which shows that the compensation filter can effectively relieve the high-pass effect brought by the zero notch beam former. In practical applications, considering the microphone inconsistency problem, the low frequency compensation may be too large, and the maximum value of equation (11) should be further constrained, namely:
wherein HmaxTo compensate for the upper filter amplitude bound, as an implementation possibility, this is set to 4.5 in the present embodiment.
The design principle of the signal model and the first-order difference beam former is introduced, and the null space filter in the voice signal direction of a wearer is designed aiming at the application of the auxiliary listening mode of the true wireless earphone, and the method comprises the following specific steps:
1) for a single-side dual microphone array system, when the delay unit is set as T ═ T0Then, a zero notch beam response in the 0 ° direction can be achieved, where the beamformer output can be written as:
y(n)＝x1(n-T0)-x2(n) (13)
for a binaural dual microphone array system, a zero notch beam response in the 90 ° direction can be achieved when the delay element is set to T-0, in which case the beamformer output can be written as:
y(n)＝x1(n)-x2(n) (14)
2) applying a window function w (n), such as a hamming window, to frame the obtained output signal Y (n), and obtaining a frequency spectrum Y (f, l) of Y (n) by fourier transform:
wherein f is the number of frequency points, l is the number of frames, R is the frame shift, N is the frame length, and also is the number of Fourier transform points.
3) The output signal of the beamformer is frequency compensated using a frequency compensation filter of equation (12) to recover the low frequency components of the signal:
Yc(f,l)＝Y(f,l)HL(f) (16)
wherein HL(f) Is a low pass filter designed by equation (12).
4) Carrying out inverse Fourier transform on the signal after frequency compensation to obtain a time domain output signal yc(n)。
According to one embodiment of the present application, the frequency compensation filter is expressed as:
wherein, ω iscTo cut-off frequency, dmicIs the microphone pitch and k is the wave number.
Based on the same inventive concept, referring to fig. 6, an embodiment of the present application further provides an ear-worn device 6, which includes a dual microphone 61 for receiving two voice signals, and a beam former 62, where:
and a beam former 62, configured to perform differential beam forming processing on the two received voice signals, so that a null response is formed between the wearer voice signals in the two voice signals.
A dual microphone 61 for picking up acoustic signals from the acoustic source and forming a left ear channel signal x1(n), right ear channel signal x2(n)。
Optionally, the differential beam former is specifically configured to add a signal delay to any one of the two received voice signals, perform a differential operation with the other voice signal, and output a differential beam formed signal.
Correspondingly, the ear-wearing type equipment is internally provided with a microprocessor which is used for determining the incident angle difference of the voice signal of the wearer in the two received voice signals; and adjusting the signal time delay to enable the incident angle difference between the voice signals of the wearer in the two voice signals to form null response when the incident angle difference falls within a preset range.
Optionally, the microprocessor is specifically configured to determine a reference value of the signal delay according to the sound velocity and a distance between two microphones of the single-side dual microphone when the two paths of voice signals are received based on the single-side dual microphone, and adjust the signal delay to be an opposite number of the reference value; and/or when the two voice signals are received based on the double-side double microphones, adjusting the signal delay to be 0.
Optionally, the microprocessor is further configured to perform framing processing on the differential beamforming signal by using a window function, and obtain a frequency spectrum of the output signal through fourier transform; or, the ear-wearing device is further provided with a frequency compensator for performing frequency compensation on the frequency spectrum of the output signal and recovering the low-frequency component in the output signal.
The application provides a speech enhancement algorithm based on null space filtering preprocessing aiming at an earphone auxiliary listening mode aiming at a dual-channel earphone system. The algorithm utilizes the characteristic that the relative position of a voice signal of a wearer and an earphone double-microphone array system is fixed, and designs a differential beam former, so that a null can be formed on signals with different frequencies in the direction of the human mouth to inhibit the voice signal of the wearer. In order to equalize the high pass effect of the zero notch beamformer, the present application further proposes a general low pass filter to recover the low frequency components of the target speech. The whole system has the characteristics of low power consumption and low time delay, and can effectively inhibit the voice signal of a wearer under the condition of extremely low signal-to-noise ratio so as to improve the auxiliary listening effect of the earphone.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods of the various embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the embodiments of the present application, and are not limited thereto; although embodiments of the present application have been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and these modifications or substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
Reference to the literature
[1]Dillon H.Hearing Aids[M].New York:Thieme Medical,2001.
[2]Baer T,Moore B C J,Spectral enhancement to compensate for reduced frequency selectivity[J].Journal of the Acoustical Society of America,1994 95(2992).
[3]Bruce I C.Physiological assessment of contrast-enhancing frequency shaping and multiband compression in hearing aids[J].Physiological Measurement.2004,25(4):945-956.
[4]Denk F,Schepker H,Doclo S,Kollmeier B.Equalization filter design for achieving acoustic transparency in a semi-open fit hearing device[C].ITG Conference on Speech Communication,Oldenburg,Germany.2018:226-230.
[5]Denk F,Vogl S,Schepker H,Kollmeier B,Blau M,Doclo S.The acoustically transparent hearing device:towards integration of individualized sound equalization,electro-acoustic modeling and feedback cancellation[C].Proceedings of the 1st International Conference on Challenges in Hearing Assistive Technology(CHAT-17),Stockholm,Sweden,2017:89-94.
[6]Pan C,Chen J,Benesty J.Theoretical analysis of differential microphone array beamforming and an improved solution[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing 2015,23(11):2093-2105.
[7]Hu X,Wang S,Zhou Y,Li X,Zheng C.Robustness analysis of time-domain and frequency-domain adaptive null-forming schemes[C].Information,Communications and Signal Processing(ICICS)2011 8th International Conference on.IEEE,2011.
[8]Capon J.High-resolution frequency-wave number spectrum analysis[J].Proceedings of the IEEE,1969,57(8):1408～1418.
[9] \37154;, social front, majoram, sensor array beam optimization design and application [ M ]. beijing, scientific press, 2009.
[10]Elko G W,Pong A N.A simple adaptive first-order differential microphone[C].Proceedings of 1995 Workshop on Applications of Signal Processing to Audio and Acoustics,New Paltz,NY,USA,1995:169-172.
[11]Head and torso simulator for telephonometry[S].ITU-T P.58,2011.
Claims (8)
1. The earphone auxiliary listening method based on the null filtering comprises the following steps:
performing differential beam forming processing on two paths of voice signals received based on double microphones, wherein each path of the two paths of voice signals comprises a far-field environment signal and a voice signal of a wearer;
by adjusting signal time delay, a null response is formed between the wearer voice signals in the two paths of voice signals so as to restrain the wearer voice signals in a fixed incident angle direction;
the adjusting the signal delay specifically includes:
when the two paths of voice signals are received based on the single-side double microphones, the incidence direction of the arrangement of the two microphones in the single-side double microphones and the voice signal of the wearer is 0 degree, a reference value of the signal time delay is determined according to the sound velocity and the distance between the two microphones of the single-side double microphones, and the signal time delay is adjusted to be the opposite number of the reference value; and/or the presence of a gas in the gas,
when the two paths of voice signals are received based on the double microphones at the two sides, the incidence directions of the two microphone arrays arranged in the double microphones at the two sides and the voice signals of the wearer are 90 degrees, and the signal time delay is adjusted to be 0.
2. The method according to claim 1, wherein the performing differential beamforming on the two received voice signals specifically includes:
and adding signal time delay for any one path of received voice signals, carrying out difference with the other path of received voice signals, and outputting a differential beam forming signal.
3. The method of claim 2, wherein before performing the differential beamforming on the two received voice signals, the method further comprises:
determining the incident angle difference of the voice signal of the wearer in the two received voice signals;
for the two received voice signals, performing differential beam forming processing to form null response between the voice signals of the wearer in the two voice signals, specifically comprising:
and adjusting the signal time delay to form null response when the incident angle difference between the voice signals of the wearer in the two paths of voice signals falls into a preset range.
4. The method according to any one of claims 2-3, wherein after forming a null response between the wearer voice signals in the two voice signals, further comprising:
and performing framing processing on the differential beam forming signal by adopting a window function, and obtaining the frequency spectrum of the output signal through Fourier transform.
5. The method of claim 4, wherein after obtaining the spectrum of the output signal by fourier transform, further comprising:
and performing frequency compensation on the frequency spectrum of the output signal to recover low-frequency components in the output signal.
6. An ear-worn device comprising dual microphones for receiving two voice signals, characterized in that the ear-worn device further comprises a beamformer, wherein:
the beam former is used for carrying out differential beam forming processing on the two received voice signals, and each of the two voice signals comprises a far-field environment signal and a voice signal of a wearer; by adjusting the signal time delay, a null response is formed between the voice signals of the wearer in the two paths of voice signals; to suppress the wearer's voice signal at a fixed incident angle direction;
wherein the adjusting the signal delay specifically includes: when the two paths of voice signals are received based on the single-side double microphones, the incidence direction of the arrangement of the two microphones in the single-side double microphones and the voice signal of the wearer is 0 degree, a reference value of the signal time delay is determined according to the sound velocity and the distance between the two microphones of the single-side double microphones, and the signal time delay is adjusted to be the opposite number of the reference value; and/or when the two paths of voice signals are received based on double microphones at two sides, the incidence directions of two microphone arrays arranged in the double microphones at the two sides and the voice signals of the wearer are 90 degrees, and the signal time delay is adjusted to be 0.
7. The ear-worn device of claim 6, wherein the beamformer is specifically configured to:
adding signal time delay for any one path of received voice signals, carrying out difference with the other path of voice signals, and outputting a differential beam forming signal;
be equipped with microprocessor in the ear-wearing formula equipment, microprocessor is used for:
determining the incident angle difference of the voice signal of the wearer in the two received voice signals;
and adjusting the signal time delay to form null response when the incident angle difference between the voice signals of the wearer in the two paths of voice signals falls into a preset range.
8. The ear-worn device of claim 7, wherein the microprocessor is further configured to: performing framing processing on the differential beam forming signal by adopting a window function, and obtaining a frequency spectrum of an output signal through Fourier transform;
or, the ear-worn device is further provided with a frequency compensator for performing frequency compensation on the frequency spectrum of the output signal and recovering the low-frequency component in the output signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010122083.7A CN111327984B (en) | 2020-02-27 | 2020-02-27 | Earphone auxiliary listening method based on null filtering and ear-worn equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010122083.7A CN111327984B (en) | 2020-02-27 | 2020-02-27 | Earphone auxiliary listening method based on null filtering and ear-worn equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111327984A CN111327984A (en) | 2020-06-23 |
| CN111327984B true CN111327984B (en) | 2022-04-22 |
Family
ID=71169164
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010122083.7A Active CN111327984B (en) | 2020-02-27 | 2020-02-27 | Earphone auxiliary listening method based on null filtering and ear-worn equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111327984B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1017252A2 (en) * | 1998-12-31 | 2000-07-05 | Resistance Technology, Inc. | Hearing aid system |
| CN104041073A (en) * | 2011-12-06 | 2014-09-10 | 苹果公司 | Near-field null and beamforming |
| EP3220664A1 (en) * | 2016-03-15 | 2017-09-20 | Starkey Laboratories, Inc. | Antenna system with adaptive configuration for hearing assistance device |
| CN107708045A (en) * | 2015-06-10 | 2018-02-16 | 西万拓私人有限公司 | Method for improving the reception signal in hearing system |
| CN108181612A (en) * | 2017-12-22 | 2018-06-19 | 达闼科技（北京）有限公司 | Determine the method and relevant apparatus of microphone beam profile angle |
| CN108694957A (en) * | 2018-04-08 | 2018-10-23 | 湖北工业大学 | The echo cancelltion design method formed based on circular microphone array beams |
| CN110035346A (en) * | 2019-02-26 | 2019-07-19 | 上海与德通讯技术有限公司 | Communication means, device, bluetooth headset and the storage medium of bluetooth headset |
| CN110383378A (en) * | 2019-06-14 | 2019-10-25 | 深圳市汇顶科技股份有限公司 | Difference Beam forming method and module, signal processing method and device, chip |
| CN110660404A (en) * | 2019-09-19 | 2020-01-07 | 北京声加科技有限公司 | Voice communication and interactive application system and method based on null filtering preprocessing |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102164328B (en) * | 2010-12-29 | 2013-12-11 | 中国科学院声学研究所 | Audio input system used in home environment based on microphone array |
| US20150063589A1 (en) * | 2013-08-28 | 2015-03-05 | Csr Technology Inc. | Method, apparatus, and manufacture of adaptive null beamforming for a two-microphone array |
-
2020
- 2020-02-27 CN CN202010122083.7A patent/CN111327984B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1017252A2 (en) * | 1998-12-31 | 2000-07-05 | Resistance Technology, Inc. | Hearing aid system |
| CN104041073A (en) * | 2011-12-06 | 2014-09-10 | 苹果公司 | Near-field null and beamforming |
| CN107708045A (en) * | 2015-06-10 | 2018-02-16 | 西万拓私人有限公司 | Method for improving the reception signal in hearing system |
| EP3220664A1 (en) * | 2016-03-15 | 2017-09-20 | Starkey Laboratories, Inc. | Antenna system with adaptive configuration for hearing assistance device |
| CN108181612A (en) * | 2017-12-22 | 2018-06-19 | 达闼科技（北京）有限公司 | Determine the method and relevant apparatus of microphone beam profile angle |
| CN108694957A (en) * | 2018-04-08 | 2018-10-23 | 湖北工业大学 | The echo cancelltion design method formed based on circular microphone array beams |
| CN110035346A (en) * | 2019-02-26 | 2019-07-19 | 上海与德通讯技术有限公司 | Communication means, device, bluetooth headset and the storage medium of bluetooth headset |
| CN110383378A (en) * | 2019-06-14 | 2019-10-25 | 深圳市汇顶科技股份有限公司 | Difference Beam forming method and module, signal processing method and device, chip |
| CN110660404A (en) * | 2019-09-19 | 2020-01-07 | 北京声加科技有限公司 | Voice communication and interactive application system and method based on null filtering preprocessing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111327984A (en) | 2020-06-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11657793B2 (en) | Voice sensing using multiple microphones | |
| US11594240B2 (en) | Audio signal processing for noise reduction | |
| EP3769305B1 (en) | Echo control in binaural adaptive noise cancellation systems in headsets | |
| CN110100453B (en) | Controlling wind noise in a dual-sided microphone array | |
| CN110089130B (en) | Dual-purpose double-side microphone array | |
| US9560451B2 (en) | Conversation assistance system | |
| US8611552B1 (en) | Direction-aware active noise cancellation system | |
| CN110856072B (en) | Earphone conversation noise reduction method and earphone | |
| WO2008045476A2 (en) | System and method for utilizing omni-directional microphones for speech enhancement | |
| US8615392B1 (en) | Systems and methods for producing an acoustic field having a target spatial pattern | |
| CN111935584A (en) | Wind noise processing method and device for wireless earphone assembly and earphone | |
| CN112866864A (en) | Environment sound hearing method and device, computer equipment and earphone | |
| US11153695B2 (en) | Hearing devices and related methods | |
| CN111327984B (en) | Earphone auxiliary listening method based on null filtering and ear-worn equipment | |
| Sunohara et al. | Low-latency real-time blind source separation with binaural directional hearing aids | |
| CN113329288B (en) | Bluetooth headset noise reduction method based on notch technology | |
| WO2021129196A1 (en) | Voice signal processing method and device | |
| Corey | Mixed-Delay Distributed Beamforming for Own-Speech Separation in Hearing Devices with Wireless Remote Microphones | |
| CN113115154A (en) | Environment sound hearing method and device, computer equipment and earphone |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |