CN117915252A - Auxiliary hearing device, howling resisting method and device thereof, signal processing method and circuit - Google Patents
Auxiliary hearing device, howling resisting method and device thereof, signal processing method and circuit Download PDFInfo
- Publication number
- CN117915252A CN117915252A CN202211242718.2A CN202211242718A CN117915252A CN 117915252 A CN117915252 A CN 117915252A CN 202211242718 A CN202211242718 A CN 202211242718A CN 117915252 A CN117915252 A CN 117915252A
- Authority
- CN
- China
- Prior art keywords
- ear
- leakage
- function
- sound signal
- test sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000003672 processing method Methods 0.000 title claims abstract description 21
- 230000006870 function Effects 0.000 claims abstract description 198
- 230000005236 sound signal Effects 0.000 claims abstract description 154
- 230000008030 elimination Effects 0.000 claims abstract description 49
- 238000003379 elimination reaction Methods 0.000 claims abstract description 49
- 238000009413 insulation Methods 0.000 claims abstract description 36
- 210000000883 ear external Anatomy 0.000 claims abstract description 26
- 210000003027 ear inner Anatomy 0.000 claims abstract description 18
- 238000012360 testing method Methods 0.000 claims description 110
- 238000012546 transfer Methods 0.000 claims description 69
- 230000008569 process Effects 0.000 claims description 19
- 238000012545 processing Methods 0.000 claims description 18
- 230000003321 amplification Effects 0.000 claims description 11
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 8
- 230000004044 response Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 12
- 230000002265 prevention Effects 0.000 description 7
- 235000000332 black box Nutrition 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 3
- 210000000613 ear canal Anatomy 0.000 description 3
- 206010011878 Deafness Diseases 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000010370 hearing loss Effects 0.000 description 2
- 231100000888 hearing loss Toxicity 0.000 description 2
- 208000016354 hearing loss disease Diseases 0.000 description 2
- 238000002955 isolation Methods 0.000 description 2
- 238000013178 mathematical model Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000005316 response function Methods 0.000 description 2
- 238000007789 sealing Methods 0.000 description 2
- 210000003454 tympanic membrane Anatomy 0.000 description 2
- 208000032041 Hearing impaired Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000010835 comparative analysis Methods 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
Landscapes
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The embodiment of the invention discloses auxiliary hearing equipment, an anti-howling method and device thereof, a signal processing method and circuit. The howling-resisting method comprises the following steps: based on the external ear sound signal FF collected by the external ear microphone and the internal ear sound signal FB collected by the internal ear microphone, an acoustic model of the hearing aid device is built; determining a leakage cancellation function Q(s) for reducing leakage according to the acoustic model; in normal use of the hearing aid device, the acoustic signals collected by the microphone outside the ear are processed in advance by the leakage elimination function Q(s) and then played by the loudspeaker, the generation of howling can be avoided based on leakage elimination, the sound insulation performance of the product and the comfort of a wearer are considered, and the user experience is improved.
Description
Technical Field
The present invention relates to the technical field of acoustic processing, and more particularly, to an auxiliary hearing device, and an anti-howling method and apparatus, a signal processing method, and a circuit thereof.
Background
A hearing aid device (also referred to as a hearing aid device) is a device for amplifying ambient sound and providing it to a hearing impaired user. The hearing aid devices are of various forms, and can be classified into open hearing aid devices and closed hearing aid devices according to whether or not they close the auditory canal when in use. For the closed hearing aid device, when the device is worn, the earplug divides the auditory canal into the outer auditory canal and the inner auditory canal, and the earplug seals the auditory canal and plays a role in sound insulation. Fig. 1 is a schematic structural view of a conventional hearing aid device. As in fig. 1, the conventional hearing aid device is simply provided with an external ear microphone, also referred to as a Feed Forward (FF) microphone, outside the ear canal. When the hearing aid device works, an external sound signal is picked up by the external microphone, processed and amplified by a digital signal Processing (DIGITAL SIGNAL Processing, DSP) circuit and sent to a loudspeaker (SPK) for sounding. The amplified external acoustic signal is received at the eardrum of the person to compensate for the hearing loss of the user.
In general, the better the closure of the ear plug of the hearing aid to the ear canal, the better the sound insulation performance, and the higher the gain multiple that the hearing aid can amplify, the greater the assistance to persons with moderate and severe hearing loss, but the reduced wearing comfort.
In carrying out the invention, the inventors found that:
After the external sound signals picked up by the external microphone are amplified by the DSP circuit, in the process of being played by the SPK of the hearing aid equipment, the sound insulation of the ear plug to the auditory canal cannot be very ideal, and the sound signals played by the SPK always have certain sound leakage. The leaked sound signals are picked up again by the microphone outside the ear, amplified by the DSP circuit and played again through the SPK, and positive feedback is formed under the condition that certain conditions are met, so that if the gain multiple of the DSP circuit is not well controlled, howling is caused, and user experience is seriously affected.
Disclosure of Invention
The technical problem to be solved by the embodiment of the invention is to provide auxiliary hearing equipment, and an anti-howling method and device, a signal processing method and circuit thereof, which can avoid the generation of howling based on leakage elimination.
According to a first aspect of the present invention, there is provided an anti-howling method of an auxiliary hearing device having a speaker, an in-ear microphone, and an out-of-ear microphone, the anti-howling method comprising:
Based on the external ear sound signal FF collected by the external ear microphone and the internal ear sound signal FB collected by the internal ear microphone, an acoustic model of the hearing aid device is established as Wherein: g '(s) is a gain function of the hearing aid device, H(s) is a circuit amplification gain function from FF to FB, P(s) is a sound insulation transfer function from FF to FB, P'(s) is a sound leakage transfer function from FB to FF, and Q(s) is a leakage elimination function from FB to FF;
Determining from the acoustic model a' said leakage cancellation function Q(s) for reducing leakage;
During normal use of the hearing aid device, the acoustic signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function Q(s) and then played by using the loudspeaker, so that howling is avoided.
According to a second aspect of the present invention, there is provided an anti-howling apparatus of a hearing aid device having a speaker, an in-ear microphone, and an out-of-ear microphone, the anti-howling apparatus being used for:
Based on the external ear sound signal FF collected by the external ear microphone and the internal ear sound signal FB collected by the internal ear microphone, an acoustic model of the hearing aid device is established as Wherein: g '(s) is a gain function of the hearing aid device, H(s) is a circuit amplification gain function from FF to FB, P(s) is a sound insulation transfer function from FF to FB, P'(s) is a sound leakage transfer function from FB to FF, and Q(s) is a leakage elimination function from FB to FF;
Determining from the acoustic model a' said leakage cancellation function Q(s) for reducing leakage;
During normal use of the hearing aid device, the acoustic signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function Q(s) and then played by using the loudspeaker, so that howling is avoided.
According to a third aspect of the present invention, there is provided a signal processing method of a hearing assistance device having a speaker, an in-ear microphone, and an out-of-ear microphone, the signal processing method comprising:
controlling the loudspeaker to play a test sound signal;
Respectively collecting in-ear test sound signals picked up by the in-ear microphone and out-of-ear test sound signals picked up by the out-of-ear microphone;
determining a leakage elimination function for reducing leakage according to the external test sound signal and the internal test sound signal; and
And in the normal use process of the hearing aid device, the sound signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function and then played by using the loudspeaker, so that howling is avoided.
According to a fourth aspect of the present invention, there is provided a signal processing circuit of a hearing assistance device having a speaker, an in-ear microphone, and an out-of-ear microphone, the signal processing circuit being configured to:
controlling the loudspeaker to play a test sound signal;
Respectively collecting in-ear test sound signals picked up by the in-ear microphone and out-of-ear test sound signals picked up by the out-of-ear microphone;
determining a leakage elimination function for reducing leakage according to the external test sound signal and the internal test sound signal; and
And in the normal use process of the hearing aid device, the sound signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function and then played by using the loudspeaker, so that howling is avoided.
According to a fifth aspect of the present invention, there is provided a hearing assistance device including a speaker, an out-of-ear microphone, an in-ear microphone, a memory, and a processor, the memory storing a computer program, the computer program being loaded and executed by the processor to implement the howling prevention method of the aforementioned hearing assistance device, or to implement the signal processing method of the aforementioned hearing assistance device.
The technical scheme of the embodiment of the invention can achieve the following beneficial effects:
The method and the device for howling resistance of the hearing aid device provided by the embodiment of the invention are characterized in that firstly, based on the external ear sound signal FF collected by the external ear microphone and the internal ear sound signal FB collected by the internal ear microphone, an acoustic model of the hearing aid device is established, and the acoustic model fully considers the sound insulation transfer function P(s) from FF to FB, the leakage transfer function P'(s) from FB to FF and the circuit amplification gain function H(s) from FF to FB, and introduces the leakage elimination function Q(s) from FB to FF, so that the actual working condition of the hearing aid device can be accurately reflected; then determining a leakage elimination function Q(s) for reducing leakage sound according to the acoustic model, wherein the leakage elimination function Q(s) and a leakage transfer function P'(s) form cancellation, and the earplug of the auxiliary hearing device can be simulated to be in an approximate complete sound insulation state; and in the normal use process of the hearing aid device, the leakage elimination function Q(s) is used for processing the sound signals collected by the microphone outside the ear in advance and then the sound signals are played by using the loudspeaker, so that the howling can be avoided based on leakage elimination.
In order to determine a leakage elimination function Q(s) for reducing leakage sound, the signal processing method and the circuit provided by the embodiment of the invention respectively collect an in-ear test sound signal and an out-ear test sound signal by controlling a loudspeaker to play the test sound signal, and then determine the leakage elimination function for reducing the leakage sound when simulating the earplug of the auxiliary hearing device to be in a complete sound insulation state according to the in-ear and out-ear test sound signals.
By adopting the scheme of each embodiment of the invention, the leakage of the sound in the ear can be equivalently eliminated, the total sound leakage quantity is reduced, the earplug is in an approximately complete sound insulation state, and the generation of howling is avoided based on the leakage elimination. In addition, the scheme of the embodiment of the invention also provides a concept of more effectively and accurately adjusting the gain function of the auxiliary hearing equipment, so that the gain multiple of the auxiliary hearing equipment without howling is improved, the sound insulation performance of the product and the comfort of a wearer are simultaneously considered, and the user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments described in the present invention, and other drawings may be obtained according to these drawings for those of ordinary skill in the art. In the drawings:
FIG. 1 is a schematic diagram of the structure of a conventional hearing assistance device;
FIG. 2 is a schematic diagram of the structure of the hearing aid device of the present invention;
fig. 3 is a flow chart of an anti-howling method of an auxiliary hearing device according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of an acoustic model of a conventional hearing assistance device;
FIG. 5 is a schematic diagram of the amplitude-frequency response of the leakage transfer function P' (f) and the gain function G (f) of a conventional hearing aid device;
FIG. 6 is a schematic diagram of an acoustic model of a hearing assistance device of the present invention;
FIG. 7 is a graph showing the amplitude-frequency response of the virtual leaky transfer function P '(s) and the gain function G' (f) of the hearing aid of the invention;
Fig. 8 is a functional schematic diagram of an anti-howling device of an auxiliary hearing device according to an embodiment of the present invention;
fig. 9 is a schematic flow chart of a signal processing method of a hearing assistance device according to an embodiment of the present invention;
Fig. 10 is a schematic functional structure of a hearing assistance device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. These embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited to the embodiments set forth herein.
Fig. 2 is a schematic diagram of the structure of the hearing aid device of the present invention. As shown in fig. 2, the hearing aid device of the present invention is provided with not only an external ear microphone (also referred to as FF microphone) outside the ear canal, but also an in-ear microphone, also referred to as a Feedback (FB) microphone, at a position near the Speaker (SPK) in the ear.
Fig. 3 is a flow chart of an anti-howling method of a secondary listening device according to an embodiment of the present invention. As shown in fig. 3, the provided howling prevention method for the hearing aid device includes the following steps S310 to S330:
step S310, based on the external ear sound signal FF collected by the external ear microphone and the internal ear sound signal FB collected by the internal ear microphone, the acoustic model of the hearing aid device is established as Wherein: g '(s) is a gain function of the hearing aid device, H(s) is an amplification gain function of a circuit from FF to FB, P(s) is a sound insulation transfer function from FF to FB, P'(s) is a sound leakage transfer function from FB to FF, and Q(s) is a leakage elimination function from FB to FF.
The process of establishing the acoustic model of the hearing aid device of the present invention will be described below.
Firstly, establishing an acoustic model of a conventional hearing assistance device
Fig. 4 is a schematic diagram of an acoustic model of a conventional hearing assistance device. As shown in fig. 4, based on the structure of the conventional hearing aid device shown in fig. 1, one acoustic reference points FF and E are selected outside the ear and in the ear, respectively. Wherein the outer ear reference point FF represents the outer ear acoustic signal collected by the outer ear microphone and the inner ear reference point E represents the inner ear acoustic signal collected at a location in the ear. The ideal in-ear location is at the human eardrum, but from an implementation point of view, it is typically chosen to be near the in-ear Speaker (SPK).
Based on the acoustic reference points FF and E, an acoustic model of the conventional hearing assistance device is established as follows:
Wherein: g(s) is the gain function of the conventional hearing aid device, P(s) is the sound insulation transfer function from FF to E, P'(s) is the leakage transfer function from E to FF, and H(s) is the circuit amplification gain function from FF to E.
Performance analysis of acoustic models of conventional hearing assistance devices
The statistical nature of the loop function H(s) ·p'(s) determines the gain of a conventional hearing aid device. In order to prevent howling, let s=2pi f×j for all frequencies f in the operating band, where j is an imaginary number, the loop function H(s) ·p'(s) needs to satisfy the following stability condition if acoustic howling does not occur:
1) Amplitude-frequency response <1, or
2) The amplitude-frequency response is equal to or greater than 1 and in any case has a phase margin.
Fig. 5 is a schematic diagram of amplitude-frequency response curves of a leakage transfer function P' (f) and a gain function G (f) of a conventional hearing aid device. In combination with the expression of the gain function G(s) of the conventional hearing aid device and fig. 5, it can be known that:
A) Low frequency band: for the hearing aid with good sealing performance, the sound insulation performance is good, the leakage transfer function P' (f) is small under the condition of small leakage, and larger hearing aid gain can be obtained. For the hearing aid device with general sealing performance, the sound insulation performance is general, even worse, and the leakage transfer function P' (f) is larger under the condition of larger leakage, but the moderate hearing aid gain can be obtained due to larger phase margin of the low frequency band.
B) High frequency band: the high frequency band has no phase margin, and the high auxiliary hearing gain can be obtained only under the condition that the sound insulation performance of auxiliary hearing equipment is good, namely the leakage transfer function P' (f) is small, depending on the passive sound insulation performance.
C) Medium frequency band: the sound isolation capability of mid-band is limited and is generally insufficient to support sufficiently high hearing aid gain without howling. As in the vicinity of f C frequency of fig. 5, in the case where the sound insulation performance of the hearing aid device is general, if the hearing aid gain at the frequency f C is set to be large, there is a risk of howling, but if the hearing aid gain at the frequency f C is set to be small, insufficient signal-to-noise ratio and poor speech intelligibility may result.
In addition, because the physical sound insulation of the low frequency and the medium frequency is not easy to realize and the hearing of the person is most sensitive at the medium frequency, the low frequency and the high frequency are sacrificed when necessary, and the voice frequency band mainly including the medium frequency is ensured.
From the above analysis, it is known that the gain function G(s) of the conventional hearing aid device depends on the sound insulation performance, but the product with the sound insulation performance being emphasized too much is easy to reduce the comfort of the wearer due to the ear blocking effect, and even is abandoned.
(III) improved idea of gain function G(s) of conventional hearing aid device
The statistical properties of the leaky transfer function P'(s) are determined for a given physical system; the sound isolation transfer function P(s) depends on the acoustic structural design of the ear plug of the hearing aid device, and is determined once the design is completed; the circuit amplifies the gain function H(s), which is part of the loop gain, and in order to ensure system stability, H(s) is subject to a stability condition where acoustic howling does not occur. Therefore, if the gain function G(s) of the conventional hearing aid device is continuously raised, only the leaky transfer function P'(s) can be used.
(IV) improving the structure of the conventional hearing aid device
In order to improve the gain function of conventional hearing assistance devices, the embodiment of the invention improves the structure of the conventional hearing assistance devices. An in-ear microphone (also referred to as FB microphone) is provided near the location of the in-ear Speaker (SPK), while a processing module is also added to the DSP circuit. Thus, the in-ear microphone can be used for picking up the sound signal of the in-ear reference point, and the sound signal is mixed with the sound signal picked up by the out-of-ear microphone after being processed by the DSP circuit.
(V) establishing an Acoustic model of the Hearing aid device of the present invention
Fig. 6 is a schematic diagram of an acoustic model of the hearing aid device of the present invention. As shown in fig. 6, based on the structure of the hearing aid device of the present invention shown in fig. 2, an external ear sound signal collected by an external ear microphone is selected as an external ear reference point FF, and an in-ear sound signal collected by an in-ear microphone is selected as an in-ear reference point FB. Based on the two acoustic reference points FF and FB, the acoustic model of the hearing assistance device is established as follows:
wherein: g '(s) is a gain function of the hearing aid device, H(s) is an amplification gain function of a circuit from FF to FB, P(s) is a sound insulation transfer function from FF to FB, P'(s) is a sound leakage transfer function from FB to FF, and Q(s) is a leakage elimination function from FB to FF.
It can be seen that the acoustic model of the hearing aid device of the present invention optimizes the acoustic model of the conventional hearing aid device, and the optimized acoustic model introduces the FB to FF leakage cancellation function Q(s), and uses P '(s) +q(s) instead of P'(s).
Step S320, determining a leakage cancellation function Q (S) for reducing leakage sound according to the acoustic model of the hearing aid device of the present invention.
For convenience of description, the sum P '(s) +q(s) of the leak transfer function P'(s) and the leak cancellation function Q(s) is defined as a virtual leak transfer function P "(s): p "(s) =p'(s) +q(s).
P'(s) represents the physical state of hearing assistance equipment, and the user feels that the ear is light when leaking sound is great, wears the comfort level higher, but can restrict the gain promotion of hearing assistance equipment, and to conventional hearing assistance equipment, wear comfort level and sound insulation performance are a pair of contradiction.
Ideally, the acoustic model of the hearing aid device according to the invention is such that: q(s) = -P '(s) such that Q(s) and P '(s) form a cancellation, i.e. such that P "(s) = P '(s) +q(s) = 0, at which time the total leakage is reduced to zero, reaching an approximately complete sound insulation state of the earplug of the hearing aid device.
From this, it is clear that by introducing the leakage cancellation function Q(s), the leakage transfer function P'(s) can be unchanged, but the leakage of the in-ear sound can be equivalently cancelled, and the total leakage amount can be reduced. And, by designing the processing module of the DSP circuit, the leakage cancellation function Q(s) is adjusted, and the physical state of the hearing aid device can be equivalently changed by optimizing the virtual leakage transfer function P "(s).
Fig. 7 is a schematic diagram of amplitude-frequency response curves of a virtual leaky sound transfer function P "(s) and a gain function G' (f) of the hearing aid device of the invention. The amplitude-frequency response curves of the leak transfer function P' (f) and the gain function G (f) of the conventional hearing aid device of fig. 5 are also shown in fig. 7 by dotted lines to facilitate comparative analysis of fig. 7 with fig. 5.
By canceling the introduced leakage cancellation function Q(s) with the leakage transfer function P '(s), the amplitude-frequency response of the virtual leakage transfer function P "(s) of the inventive hearing aid device is smaller than the amplitude-frequency response of the leakage transfer function P' (f) of a conventional hearing aid device. Also, non-zero portions of P '(f) with steady trends are also cancelled by Q(s) modeling, so that P'(s) has a zero-mean phase-frequency response. As shown in fig. 7, the optimized virtual leakage transfer function P "(s) is adjusted by the leakage cancellation function Q(s), and has the following characteristics:
1) The amplitude-frequency response is lower, so that the maximum gain of the hearing aid device can be effectively improved.
2) Phase-frequency response with zero mean. Because the absolute value of the sum of the phase-frequency responses of all the modules in the loop system is smaller than the threshold value in engineering practice, the smaller the phase-frequency response is, the larger the phase margin of the system is, so that the stability of the system is improved by improving the phase margin, and the gain of the hearing aid device is opportunistically improved continuously.
From the above analysis, after the leakage cancellation function Q(s) is introduced, the wearing comfort of the hearing aid device is still determined by the leakage transfer function P '(s), but the sound insulation performance of the hearing aid device is not determined by P'(s) any more, but is instead determined by the virtual leakage transfer function P "(s).
To determine the leakage cancellation function Q (S) for reducing leakage, this step S320 includes the following sub-steps S321 to S323:
S321, controlling the loudspeaker to play the test sound signal.
When the test sound signal is played, the test environment needs to be kept relatively quiet, no external interference is caused as much as possible, and only the internal loudspeaker is used for sound source excitation.
S322, respectively collecting in-ear test sound signals picked up by the in-ear microphone and out-of-ear test sound signals picked up by the out-of-ear microphone.
S323, determining a leakage elimination function for reducing leakage sound according to the external test sound signal and the internal test sound signal.
This substep S323 determines the leakage cancellation function Q (S) in two ways: one is a direct method, which utilizes an adaptive filtering algorithm to solve Q(s) in one step; the other is an indirect method, and the process of solving Q(s) is divided into two steps compared with a direct method.
(1) The direct method, this substep S323 may specifically be:
Expressing the mixed sound signal as a result of mixing the in-ear test sound signal processed by the leakage cancellation function Q(s) with the out-of-ear test sound signal; the leakage cancellation function Q(s) is solved by minimizing the energy of the mixed acoustic signal.
That is, the direct method is to solve for Q(s) in one step by minimizing the energy of the following formula:
min{||FF(s)+Q(s)·FB(s)||}，
Wherein FF(s) is an in-ear test sound signal, FB(s) is an in-ear test sound signal, Q(s) ·fb(s) is an in-ear test sound signal processed by the leakage cancellation function Q(s), and FF(s) +q(s) ·fb(s) is a defined mixed sound signal.
By using energy (second order norm) as an optimization index to minimize the mixed acoustic signal energy, Q(s) and P'(s) can be made statistically closest.
(2) The indirect method, this substep S323 may specifically be:
Firstly, according to the ratio of the external test sound signal to the internal test sound signal, obtaining a leakage transfer function P'(s); then, a cancellation signal of the leakage transfer function is obtained based on the leakage transfer function P'(s), and a leakage cancellation function Q(s) is determined based on the cancellation signal.
Namely: the first step of the indirect method is that the solution is as follows: wherein FF(s) is an external test acoustic signal and FB(s) is an in-ear test acoustic signal; the second step is that solving is carried out to obtain: q(s) =k (-P ' (s)), where-P '(s) represents a phase inversion operation for P '(s), and K represents a subsequent processing method for the result after the phase inversion, such as a nonlinear processing and smoothing method.
It should be noted that, in this substep S323, no processing method can be used in practice to completely process the sample into k=1, i.e., into Q (S) = -P' (S), so that only stable elimination in a statistical sense can be obtained. In addition, a variety of conventional system identification algorithms can be employed for the solving process of each transfer function. The so-called system identification algorithm is a conventional algorithm in the field of automatic control, and the basic idea is to determine a mathematical model by using test data based on a modeling method. The input and output data of the system can be obtained through experiments, and the data can reflect the dynamic characteristics of the system, so that the mathematical model of the system is reasonably built by utilizing the data information obtained through the experiments. For example, if it is desired to calculate the response function of the black-box system, the response function of the black-box system is finally solved by inputting known data into the black-box system, such as the off-ear test sound signal FF(s) and the in-ear test sound signal FB(s), into the black-box system, and then by measuring the input and output of the black-box system.
Step S330, in the normal use process of the hearing aid device, the sound signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function and then played by using the loudspeaker, so that the generation of howling is avoided.
The leakage cancellation function Q (S) obtained in step S320 is intended to be applied during normal use of the hearing aid device of the present invention.
In the step S330, the acoustic signal collected by the microphone outside the ear is processed in advance by using the leakage cancellation function Q (S) and then played by using the speaker, so that the leakage transfer function P' (S) before processing can be optimized into a virtual leakage transfer function P "(S) with better sound insulation performance, thereby equivalently canceling the leakage of the sound in the ear, reducing the total leakage amount, reaching the approximate complete sound insulation state of the earplug, and avoiding the generation of howling based on the leakage cancellation.
In summary, by adopting the howling prevention method of the hearing assistance device according to the embodiment of the present invention, the feedback microphone FB is set at the in-ear SPK to obtain the actual acoustic signal at the acoustic reference point E, and an improved acoustic model of the hearing assistance gain function G'(s) is established: the acoustic model fully considers the sound insulation transfer function from FF to E, the sound leakage transfer function from E to FF and the circuit amplification gain function from FF to E, thereby reflecting the actual working condition of the hearing aid device more accurately. Based on the acoustic model, a leakage elimination function Q(s) for reducing leakage sound can be obtained, so that the gain multiple of auxiliary hearing equipment can be improved, meanwhile, howling is avoided, the sound insulation performance of a product and the comfort of a wearer can be considered, and the user experience is improved.
Corresponding to the howling prevention method of the auxiliary hearing device, the embodiment of the invention also provides a howling prevention device of the auxiliary hearing device, the auxiliary hearing device is provided with a loudspeaker, an in-ear microphone and an out-of-ear microphone, and the howling prevention device is used for:
Based on the external ear sound signal FF collected by the external ear microphone and the internal ear sound signal FB collected by the internal ear microphone, the acoustic model of the auxiliary hearing device is established as Wherein: g '(s) is a gain function of the hearing aid device, H(s) is an amplification gain function of a circuit from FF to FB, P(s) is a sound insulation transfer function from FF to FB, P'(s) is a sound leakage transfer function from FB to FF, and Q(s) is a leakage elimination function from FB to FF;
according to the acoustic model of the hearing aid device of the invention, determining a leakage cancellation function Q(s) for reducing leakage;
in the normal use process of the hearing aid device, the sound signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function Q(s) and then played by using the loudspeaker, so that the generation of howling is avoided.
Wherein the provided anti-howling device is specifically used for determining a leakage cancellation function Q(s) for reducing leakage when determining an acoustic model of the hearing aid device according to the invention:
controlling a loudspeaker to play a test sound signal;
Respectively collecting an in-ear test sound signal picked up by an in-ear microphone and an out-ear test sound signal picked up by an out-of-ear microphone;
and determining a leakage elimination function for reducing leakage according to the external test sound signal and the internal test sound signal.
Wherein, confirm the leak elimination function used for reducing the sound leakage according to the test sound signal outside the ear and test sound signal in the ear, further specifically used for:
Expressing the mixed sound signal as a result of mixing the in-ear test sound signal processed by the leakage elimination function and the out-of-ear test sound signal, and solving to obtain the leakage elimination function by minimizing the energy of the mixed sound signal;
or firstly obtaining a leakage transfer function according to the ratio of the external test sound signal to the internal test sound signal, then obtaining a counteracting signal of the leakage transfer function based on the leakage transfer function, and determining a leakage eliminating function according to the counteracting signal.
The howling-resistant device of the hearing aid device provided by the embodiment of the invention can be further divided into a plurality of functional modules. Fig. 8 is a functional schematic diagram of an anti-howling device of an auxiliary hearing device according to an embodiment of the present invention. As shown in fig. 8, an anti-howling device for an auxiliary hearing device according to an embodiment of the present invention includes:
an acoustic model building unit 810 for building an acoustic model of the hearing aid device according to the present invention as based on the external ear sound signal FF collected by the external ear microphone and the in-ear sound signal FB collected by the in-ear microphone Wherein: g '(s) is a gain function of the hearing aid device, H(s) is an amplification gain function of a circuit from FF to FB, P(s) is a sound insulation transfer function from FF to FB, P'(s) is a sound leakage transfer function from FB to FF, and Q(s) is a leakage elimination function from FB to FF;
A signal processing unit 820 for determining a leakage cancellation function Q(s) for reducing leakage sound according to an acoustic model of the hearing aid device of the present invention;
The anti-howling unit 830 is configured to process the acoustic signal collected by the external microphone in advance by using the leakage cancellation function Q(s) and play the processed acoustic signal by using the speaker in order to avoid howling during normal use of the hearing assistance device of the present invention.
Wherein, the signal processing unit 820 may further include:
A play control module 821 for controlling the speaker to play the test sound signal;
The test sound signal collection module 822 is configured to collect an in-ear test sound signal picked up by the in-ear microphone and an out-ear test sound signal picked up by the out-of-ear microphone, respectively;
The leakage cancellation function determining module 823 is configured to determine a leakage cancellation function Q(s) for reducing leakage according to the external test sound signal and the internal test sound signal.
The determined leakage elimination function Q(s) and the leakage transfer function P'(s) form cancellation, and the earplug of the hearing aid device can be simulated to be in an approximate complete sound insulation state.
In some embodiments, the leakage cancellation function determination module 823 is specifically configured to:
the mixed sound signal is expressed as a result of mixing the in-ear test sound signal processed by the leakage cancellation function with the out-of-ear test sound signal, and the leakage cancellation function Q(s) is solved by minimizing the energy of the mixed sound signal.
In some embodiments, the leakage cancellation function determination module 823 is specifically configured to:
Obtaining a leakage transfer function P'(s) according to the ratio of the external test sound signal to the internal test sound signal; then, a cancellation signal of the leakage transfer function is obtained based on the leakage transfer function P'(s), and a leakage cancellation function Q(s) is determined according to the cancellation signal.
The implementation or explanation of each module or unit in the howling-preventing device of the auxiliary hearing device shown in fig. 8 can be referred to the foregoing embodiment of the howling-preventing method of the auxiliary hearing device, which is not described herein.
The method belongs to a technical conception with the howling resisting method of the auxiliary hearing equipment, and the embodiment of the invention also provides a signal processing method of the auxiliary hearing equipment. Fig. 9 is a flowchart of a signal processing method of a hearing assistance device according to an embodiment of the present invention. As described above, the hearing aid device of the present invention has a speaker, an in-ear microphone, and an out-of-ear microphone, and the provided signal processing method includes steps S910 to S940:
Step S910, controlling the speaker to play the test sound signal.
In this step S910, when playing the test sound signal, the test environment needs to be kept relatively quiet, so that no external interference is made as much as possible, and only the internal speaker is excited as the sound source.
In step S920, the in-ear test sound signal picked up by the in-ear microphone and the out-ear test sound signal picked up by the out-of-ear microphone are collected respectively.
In step S930, a leakage cancellation function for reducing leakage is determined according to the in-ear test sound signal and the out-ear test sound signal.
This step S930 may determine the leakage cancellation function for reducing leakage in two ways:
One is a direct method, which uses an adaptive filtering algorithm to solve in one step. Specifically, the mixed sound signal is expressed as a result of mixing an in-ear test sound signal processed by the leakage cancellation function with an out-of-ear test sound signal, and the leakage cancellation function is solved by minimizing the energy of the mixed sound signal.
The other is an indirect method, and the solving process is divided into two steps compared with a direct method. Specifically, the first step is to obtain a leakage transfer function according to the ratio of the external test sound signal to the internal test sound signal; and a second step of obtaining a cancellation signal of the leakage transfer function based on the leakage transfer function, and then determining a leakage elimination function according to the cancellation signal.
Step S940, in the normal use process of the hearing aid device of the present invention, the acoustic signal collected by the microphone outside the ear is processed in advance by using the leakage cancellation function and then played by using the speaker, so as to avoid the occurrence of howling.
In the step S940, the leakage of the sound in the ear can be equivalently eliminated, the total sound leakage is reduced, the earplug is in an approximately complete sound insulation state, and the generation of howling is avoided based on the leakage elimination.
The signal processing method of the hearing aid shown in fig. 9 can improve the gain multiple of the hearing aid, avoid the generation of howling, and simultaneously consider the sound insulation performance of the product and the comfort of the wearer, so that the user experience is improved. For specific explanation of each step in fig. 9, reference may be made to the corresponding step in the foregoing embodiment of the howling prevention method of the hearing assistance device, which is not described herein.
Corresponding to the foregoing signal processing method of the auxiliary hearing device, the embodiment of the present invention further provides a signal processing circuit of the auxiliary hearing device, where the auxiliary hearing device has a speaker, an in-ear microphone, and an out-of-ear microphone, and the provided signal processing circuit is used for:
controlling a loudspeaker to play a test sound signal;
Respectively collecting an in-ear test sound signal picked up by an in-ear microphone and an out-ear test sound signal picked up by an out-of-ear microphone;
Determining a leakage elimination function for reducing leakage according to the external test sound signal and the internal test sound signal; and
In the normal use process of the hearing aid device, the sound signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function and then played by using the loudspeaker, so that howling is avoided.
Wherein, confirm the leak elimination function used for reducing the sound leakage according to the test sound signal outside the ear and test sound signal in the ear, it is used for specifically:
Expressing a mixed sound signal as a result of mixing the in-ear test sound signal processed by the leakage cancellation function with the out-of-ear test sound signal, and solving to obtain the leakage cancellation function by minimizing the energy of the mixed sound signal;
or according to the ratio of the external test sound signal to the internal test sound signal, obtaining a leakage transfer function; and obtaining a cancellation signal of the leakage transfer function based on the leakage transfer function, and determining a leakage elimination function according to the cancellation signal.
The method for resisting howling of the auxiliary hearing device and the method for processing signals of the auxiliary hearing device belong to the same technical conception, and the embodiment of the invention also provides the auxiliary hearing device. Fig. 10 is a schematic functional structure of a hearing assistance device according to an embodiment of the present invention. Referring to fig. 10, an auxiliary hearing device provided by an embodiment of the present invention includes: the device comprises a loudspeaker, an external microphone, an in-ear microphone, a memory and a processor, wherein the memory stores a computer program which is loaded and executed by the processor to realize the howling resisting method of the auxiliary hearing device or realize the signal processing method of the auxiliary hearing device.
At the hardware level, the hearing aid device may optionally further comprise a communication module or the like. The speaker, the out-of-ear microphone, the in-ear microphone, the memory, the processor, and the communication module may be interconnected by an internal bus, which may be an ISA (Industry Standard Architecture ) bus, a PCI (PERIPHERAL COMPONENT INTERCONNECT, peripheral component interconnect standard) bus, or an EISA (Extended Industry Standard Architecture ) bus, or the like. The buses may be divided into address buses, data buses, control buses, etc. For ease of illustration, only one bi-directional arrow is shown in FIG. 10, but not only one bus or type of bus.
It will be apparent to those skilled in the art that aspects of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more readable storage media embodying a computer program.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.
The present invention is not limited to the specific embodiments described above, but any modifications, equivalents, improvements and modifications within the scope of the invention are possible to those skilled in the art, and are intended to be included in the scope of the claims.
Claims (10)
1. An anti-howling method of a secondary hearing device having a speaker, an in-ear microphone, and an out-of-ear microphone, the anti-howling method comprising:
Based on the external ear sound signal FF collected by the external ear microphone and the internal ear sound signal FB collected by the internal ear microphone, an acoustic model of the hearing aid device is established as Wherein: g '(s) is a gain function of the hearing aid device, H(s) is a circuit amplification gain function from FF to FB, P(s) is a sound insulation transfer function from FF to FB, P'(s) is a sound leakage transfer function from FB to FF, and Q(s) is a leakage elimination function from FB to FF;
Determining the leakage cancellation function Q(s) for reducing leakage according to the acoustic model;
During normal use of the hearing aid device, the acoustic signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function Q(s) and then played by using the loudspeaker, so that howling is avoided.
2. Anti-howling method according to claim 1, characterized in that said determining said leakage cancellation function Q(s) for reducing leakage according to said acoustic model comprises:
controlling the loudspeaker to play a test sound signal;
Respectively collecting in-ear test sound signals picked up by the in-ear microphone and out-of-ear test sound signals picked up by the out-of-ear microphone;
expressing a mixed sound signal as a result of mixing the in-ear test sound signal processed by the leakage cancellation function with the out-of-ear test sound signal;
the leakage cancellation function Q(s) is solved by minimizing the energy of the mixed acoustic signal.
3. Anti-howling method according to claim 1, characterized in that said determining said leakage cancellation function Q(s) for reducing leakage according to said acoustic model comprises:
controlling the loudspeaker to play a test sound signal;
Respectively collecting in-ear test sound signals picked up by the in-ear microphone and out-of-ear test sound signals picked up by the out-of-ear microphone;
Obtaining the leakage transfer function P'(s) according to the ratio of the external test sound signal to the internal test sound signal;
And obtaining a cancellation signal of the leakage transfer function based on the leakage transfer function P'(s), and determining the leakage elimination function Q(s) according to the cancellation signal.
4. An anti-howling device of a hearing aid device having a speaker, an in-ear microphone and an out-of-ear microphone, characterized in that the anti-howling device is adapted to:
Based on the external ear sound signal FF collected by the external ear microphone and the internal ear sound signal FB collected by the internal ear microphone, an acoustic model of the hearing aid device is established as Wherein: g '(s) is a gain function of the hearing aid device, H(s) is a circuit amplification gain function from FF to FB, P(s) is a sound insulation transfer function from FF to FB, P'(s) is a sound leakage transfer function from FB to FF, and Q(s) is a leakage elimination function from FB to FF;
Determining the leakage cancellation function Q(s) for reducing leakage according to the acoustic model;
During normal use of the hearing aid device, the acoustic signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function Q(s) and then played by using the loudspeaker, so that howling is avoided.
5. Anti-howling device as claimed in claim 4, characterized in that it is embodied for, when determining said leakage cancellation function Q(s) for reducing leakage according to said acoustic model:
controlling the loudspeaker to play a test sound signal;
Respectively collecting in-ear test sound signals picked up by the in-ear microphone and out-of-ear test sound signals picked up by the out-of-ear microphone;
expressing a mixed sound signal as a result of mixing the in-ear test sound signal processed by the leakage cancellation function with the out-of-ear test sound signal;
the leakage cancellation function Q(s) is solved by minimizing the energy of the mixed acoustic signal.
6. Anti-howling device as claimed in claim 4, characterized in that it is embodied for, when determining said leakage cancellation function Q(s) for reducing leakage according to said acoustic model:
controlling the loudspeaker to play a test sound signal;
Respectively collecting in-ear test sound signals picked up by the in-ear microphone and out-of-ear test sound signals picked up by the out-of-ear microphone;
Obtaining the leakage transfer function P'(s) according to the ratio of the external test sound signal to the internal test sound signal;
And obtaining a cancellation signal of the leakage transfer function based on the leakage transfer function P'(s), and determining the leakage elimination function Q(s) according to the cancellation signal.
7. A signal processing method of a hearing assistance device having a speaker, an in-ear microphone, and an out-of-ear microphone, the signal processing method comprising:
controlling the loudspeaker to play a test sound signal;
Respectively collecting in-ear test sound signals picked up by the in-ear microphone and out-of-ear test sound signals picked up by the out-of-ear microphone;
determining a leakage elimination function for reducing leakage according to the external test sound signal and the internal test sound signal; and
And in the normal use process of the hearing aid device, the sound signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function and then played by using the loudspeaker, so that howling is avoided.
8. The signal processing method according to claim 7, wherein the determining a leakage cancellation function for reducing leakage sound based on the in-ear test sound signal and the out-ear test sound signal includes:
expressing a mixed sound signal as a result of mixing the in-ear test sound signal processed by the leakage cancellation function with the out-of-ear test sound signal;
The leakage cancellation function is solved by minimizing the energy of the mixed acoustic signal.
9. A signal processing circuit of a hearing assistance device having a speaker, an in-ear microphone, and an out-of-ear microphone, the signal processing circuit being configured to:
controlling the loudspeaker to play a test sound signal;
Respectively collecting in-ear test sound signals picked up by the in-ear microphone and out-of-ear test sound signals picked up by the out-of-ear microphone;
determining a leakage elimination function for reducing leakage according to the external test sound signal and the internal test sound signal; and
And in the normal use process of the hearing aid device, the sound signals collected by the microphone outside the ear are processed in advance by using the leakage elimination function and then played by using the loudspeaker, so that howling is avoided.
10. A hearing aid device comprising a speaker, an out-of-ear microphone, an in-ear microphone, a memory and a processor, the memory having stored therein a computer program, the computer program being loaded and executed by the processor to implement the method of anti-howling of a hearing aid device as claimed in any one of claims 1 to 3, or to implement the method of signal processing of a hearing aid device as claimed in any one of claims 7 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211242718.2A CN117915252A (en) | 2022-10-11 | 2022-10-11 | Auxiliary hearing device, howling resisting method and device thereof, signal processing method and circuit |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211242718.2A CN117915252A (en) | 2022-10-11 | 2022-10-11 | Auxiliary hearing device, howling resisting method and device thereof, signal processing method and circuit |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117915252A true CN117915252A (en) | 2024-04-19 |
Family
ID=90680792
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211242718.2A Pending CN117915252A (en) | 2022-10-11 | 2022-10-11 | Auxiliary hearing device, howling resisting method and device thereof, signal processing method and circuit |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117915252A (en) |
-
2022
- 2022-10-11 CN CN202211242718.2A patent/CN117915252A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113676803B (en) | Active noise reduction method and device | |
| US11026041B2 (en) | Compensation of own voice occlusion | |
| US8081780B2 (en) | Method and device for acoustic management control of multiple microphones | |
| EP2583074B1 (en) | Method and apparatus for reducing the effect of environmental noise on listeners | |
| CN104081452B (en) | The method of regulation active denoising system | |
| US9779716B2 (en) | Occlusion reduction and active noise reduction based on seal quality | |
| US8660676B2 (en) | Mitigating the impact of nonlinear echos by dynamic range compression | |
| CN110996203B (en) | Earphone noise reduction method, device and system and wireless earphone | |
| US8811602B2 (en) | Full duplex speakerphone design using acoustically compensated speaker distortion | |
| EP2439958A1 (en) | A method of determining parameters in an adaptive audio processing algorithm and an audio processing system | |
| Pradhan et al. | Acoustic feedback cancellation in digital hearing aids: A sparse adaptive filtering approach | |
| WO2020248113A1 (en) | Bone sound transmission signal processing method and apparatus, chip, earphones, and storage medium | |
| CN111294719A (en) | Method and device for detecting in-ear state of ear-wearing type device and mobile terminal | |
| Akhtar et al. | Acoustic feedback cancellation in hearing aids using dual adaptive filtering and gain-controlled probe signal | |
| KR20230098282A (en) | Audio signal processing method and system for echo suppression | |
| JP2024517721A (en) | Audio optimization for noisy environments | |
| CN106297816B (en) | Echo cancellation nonlinear processing method and device and electronic equipment | |
| Borges et al. | A feed forward adaptive canceller to reduce the occlusion effect in hearing aids | |
| CN113299262A (en) | Active noise reduction method and device, earphone, readable storage medium and electronic equipment | |
| CN117915252A (en) | Auxiliary hearing device, howling resisting method and device thereof, signal processing method and circuit | |
| CN115884030A (en) | Noise reduction method and device, earphone equipment, storage medium and chip | |
| CN112804621B (en) | Audio equalization method, earphone circuit and earphone | |
| CN115225998A (en) | Earphone noise reduction method and device, earphone equipment and computer readable storage medium | |
| US20240071350A1 (en) | A method for automatically designing a feedforward filter | |
| CN113299263B (en) | Acoustic path determining method and device, readable storage medium and active noise reduction earphone |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |