CN115002635A - Sound self-adaptive adjusting method and system - Google Patents
Sound self-adaptive adjusting method and system Download PDFInfo
- Publication number
- CN115002635A CN115002635A CN202210544163.0A CN202210544163A CN115002635A CN 115002635 A CN115002635 A CN 115002635A CN 202210544163 A CN202210544163 A CN 202210544163A CN 115002635 A CN115002635 A CN 115002635A
- Authority
- CN
- China
- Prior art keywords
- sound signal
- sound
- signal
- remote
- far
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000005236 sound signal Effects 0.000 claims abstract description 228
- 230000003044 adaptive effect Effects 0.000 claims abstract description 33
- 230000005540 biological transmission Effects 0.000 claims abstract description 9
- 238000004590 computer program Methods 0.000 claims description 10
- 230000006978 adaptation Effects 0.000 claims description 4
- 230000001755 vocal effect Effects 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 4
- 238000012545 processing Methods 0.000 description 17
- 210000000613 ear canal Anatomy 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000004422 calculation algorithm Methods 0.000 description 5
- 230000009467 reduction Effects 0.000 description 5
- 230000000875 corresponding effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 229920001296 polysiloxane Polymers 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 206010011878 Deafness Diseases 0.000 description 1
- 208000032041 Hearing impaired Diseases 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000010370 hearing loss Effects 0.000 description 1
- 231100000888 hearing loss Toxicity 0.000 description 1
- 208000016354 hearing loss disease Diseases 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 239000000741 silica gel Substances 0.000 description 1
- 229910002027 silica gel Inorganic materials 0.000 description 1
- 210000003625 skull Anatomy 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/35—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using translation techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/43—Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention provides a sound adaptive adjustment method, which is used in a hearing aid with a built-in local microphone, and comprises the following steps: acquiring a first sound signal collected by the local microphone; acquiring a second sound signal acquired by a far-end device through wireless transmission, wherein the far-end device is positioned in a signal coverage range of the hearing aid; and mixing the first sound signal and the second sound signal according to a preset strategy to generate an output signal. The invention also provides a sound adaptive adjustment system, a computer device and a computer readable storage medium. According to the technical scheme provided by the invention, the far-end sound signal can be sent into the ear of a hearing aid wearer, so that the hearing aid has a very good hearing assistance effect, and especially the sound emitted by a far-end sound source is aimed at; and seamless switching and mixing of different degrees in a far-end microphone of a far-end device and a local microphone of a hearing aid can be realized in a self-adaptive mode.
Description
Technical Field
The present invention relates to the field of speech processing, and in particular, to a method, a system, a computer device, and a computer-readable storage medium for adaptively adjusting a sound.
Background
With the development of electronic devices, hearing aids have been developed for compensating for the hearing loss of hearing-impaired persons. Hearing aids are typically fitted in or behind the ear of a user to amplify and provide the amplified sound to the wearer. Hearing aids typically include a microphone to collect sound signals; a processor for amplifying the sound signal; and a speaker (which may be referred to as a receiver in the hearing aid art) that outputs sound.
The existing hearing aid has poor hearing assistance effect, and particularly has poor user experience for sound emitted by a far sound source.
Disclosure of Invention
An object of the present invention is to provide a sound adaptive adjustment method, system, computer device and computer readable storage medium, which are used to solve the above problems.
An aspect of the embodiments of the present invention provides a sound adaptive adjustment method, for use in a hearing aid with a built-in local microphone, the method including:
acquiring a first sound signal collected by the local microphone;
acquiring a second sound signal acquired by a far-end device through wireless transmission, wherein the far-end device is positioned in a signal coverage range of the hearing aid; and
mixing the first sound signal and the second sound signal according to a preset strategy to generate an output signal.
Optionally, mixing the first sound signal and the second sound signal according to a preset strategy to generate an output signal includes:
determining a signal correlation between the first sound signal and the second sound signal;
determining a physical distance between the hearing aid and the remote device based on the signal correlation;
determining a mixing weight of the first sound signal and a mixing weight of the second sound signal according to the physical distance;
mixing the first sound signal and the second sound signal according to the mixing weight of the first sound signal and the mixing weight of the second sound signal to generate the output signal, wherein the output signal is used for being provided to a loudspeaker.
Optionally, the remote device includes a plurality of remote microphones, and each of the remote microphones is respectively located at a different position and provides a remote sound signal;
the second sound signal is obtained by the following steps:
determining the sound source positions around the remote equipment through each path of remote sound signal;
determining the weight of each path of far-end sound signal according to the sound source position; and
and performing weighted superposition operation on the remote sound signals according to the weights of the remote sound signals to generate the second sound signal.
Optionally, the remote device includes a plurality of remote microphones, and each of the remote microphones is respectively located at a different position and respectively provides a remote sound signal;
the second sound signal is obtained by the following steps:
determining the signal-to-noise ratio of each path of far-end sound signal;
and determining the far-end sound signal with the highest signal-to-noise ratio from the various paths of far-end sound signals as the second sound signal.
Optionally, the determining the mixing weight of the first sound signal and the mixing weight of the second sound signal according to the physical distance includes:
judging whether the first sound signal comprises a human sound signal or not to obtain a first human sound judgment result;
determining whether the second sound signal comprises a human sound signal or not to obtain a second human sound judgment result;
and determining the mixing weight of the first sound signal and the mixing weight of the second sound signal according to the physical distance, the first voice judgment result and the second voice judgment result.
Optionally, the determining, according to the physical distance, the first voice determination result, and the second voice determination result, the mixing weight of the first sound signal and the mixing weight of the second sound signal includes:
determining a reverberation degree from the first sound signal or the second sound signal; and
and determining the mixing weight of the first sound signal and the mixing weight of the second sound signal according to the physical distance, the first human voice judgment result, the second human voice judgment result and the reverberation degree.
Optionally, the method further includes:
receiving a control instruction sent by electronic equipment; and
and adjusting the mixing weight of each path of signal for mixing sound on the basis of the preset strategy according to the control instruction.
An aspect of an embodiment of the present invention further provides a sound adaptive adjustment system, for use in a hearing aid with a built-in local microphone, the system including:
the first acquisition module is used for acquiring a first sound signal acquired by the local microphone;
the second acquisition module is used for acquiring a second sound signal acquired by a far-end device through wireless transmission, and the far-end device is positioned in a signal coverage range of the hearing aid; and
a mixing module for mixing the first sound signal and the second sound signal according to a preset strategy to generate an output signal.
An aspect of the embodiments of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the steps of the sound adaptive adjustment method described above are implemented.
An aspect of the embodiments of the present invention further provides a computer-readable storage medium, in which a computer program is stored, the computer program being executable by at least one processor to cause the at least one processor to perform the steps of the sound adaptive adjustment method as described above.
The sound self-adaptive adjusting method, the sound self-adaptive adjusting equipment and the computer readable storage medium provided by the embodiment of the invention have the following advantages:
the far-end microphone of the far-end equipment is used for collecting the far-end sound signal in an auxiliary mode and sending the far-end sound signal into the ear of a hearing aid wearer, so that a good hearing aid effect can be achieved, and user experience is good especially for sound emitted by a far-end sound source;
and the relation between the remote equipment and the hearing aid is switched without physical keys, and seamless switching and mixing of sound of different degrees in the remote microphone of the remote equipment and the local microphone of the hearing aid can be realized in a self-adaptive mode based on a preset strategy.
Drawings
Fig. 1 schematically shows a schematic view of the construction of a hearing aid and a remote device according to the invention;
fig. 2 schematically shows a flow chart of a sound adaptive adjustment method according to a first embodiment of the present invention;
fig. 3 is a schematic diagram illustrating one of the schematic architectures of a sound adaptive adjustment method according to a first embodiment of the present invention;
FIG. 4 is a flowchart of step S204 in FIG. 2;
fig. 5 schematically shows another construction of the hearing aid and the remote device according to the invention;
FIG. 6 is a distribution diagram and a beam pattern of each of the remote microphones of the remote device shown in FIG. 5;
FIG. 7 is a schematic architecture diagram of the sound adaptive adjustment method under the configuration shown in FIG. 5;
FIG. 8 is a flow chart of generating a second sound signal under the structure shown in FIG. 5;
FIG. 9 is a flow chart of another second sound signal generation under the configuration shown in FIG. 5;
FIG. 10 is a flowchart of step S404 in FIG. 4;
fig. 11 is a flowchart of step S1004 in fig. 10;
FIG. 12 is a flow chart schematically illustrating additional steps of a sound adaptive adjustment method according to a first embodiment of the present invention;
fig. 13 schematically shows a block diagram of a sound adaptive adjustment system according to a second embodiment of the present invention;
fig. 14 schematically shows a hardware architecture diagram of a computer device suitable for implementing a sound adaptive adjustment method according to a third embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the descriptions relating to "first", "second", etc. in the embodiments of the present invention are only for descriptive purposes and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.
In the description of the present invention, it should be understood that the numerical references before the steps do not identify the order of performing the steps, but merely serve to facilitate the description of the present invention and to distinguish each step, and thus should not be construed as limiting the present invention.
As shown in fig. 1, the sound adaptation method may be performed in a hearing aid 2, which hearing aid 2 is wirelessly connected to a remote device 4. The hearing aid 2 and the remote device 4 may be a kit combination, which operate in cooperation with each other.
The hearing aid 2 comprises a housing, which contains a local microphone 21, a transceiver module 22, a processor 23, and a speaker 24.
A local microphone 21 on the side of the hearing aid remote from the ear canal (outside the housing). I.e. the local microphone 21 is located at the side of the hearing aid remote from the ear canal, and may be used for acquiring ambient signals around the wearer.
The transceiver module 22, which may be a bluetooth module, a Zigbee module, or the like, is used for performing signal transmission with the remote device 4, such as a sound signal of the remote device 4, or sending a control signal to the remote device 4 to control the remote device 4.
And the processor 23 is electrically connected with the local microphone 21, the transceiving module 22 and the loudspeaker 24 and is used for processing signals provided by the local microphone 21 and the far-end equipment 4. Such as noise reduction, Wide Dynamic Range Compression (WDRC), beamforming, etc. The processor 23 may be a DSP (Digital Signal Processing) chip or the like.
And a speaker 24 for receiving the sound signal processed by the processor 23 and outputting the processed sound signal to the ear canal.
A silicone sleeve for at least partial insertion into the ear canal when the hearing aid 2 is worn. The silicone sleeve may to some extent block the sound around the wearer from entering the ear canal. Of course, the material of the silica gel sleeve can be replaced.
It is noted that the hearing aid 2 may also have a feedback microphone built into it, on the other side of the housing, in or close to the ear canal of the wearer when the hearing aid 2 is worn. It will be appreciated that the hearing aid 2, when worn, is located in the ear canal of the wearer and may be used to obtain feedback signals, such as signals transmitted through the skull of the wearer when speaking, signals output by the speaker 24. The feedback microphone may be used to determine whether the wearer is speaking himself.
The present invention may provide a sound adaptive adjustment scheme based on the above-mentioned structure of the hearing aid 2, and mix the sound signals according to the first sound signal (ambient environment signal) collected by the local microphone 21 and the second sound signal (transmitted to the hearing aid 2 wirelessly) collected by the remote device 4, and then output the mixed sound signal to the speaker 24.
A number of embodiments will be provided below, each of which may be used to implement the sound adaptation scheme described above. In this solution, no physical key is needed to switch the relationship between the remote device and the physical hearing aid, and seamless switching and signal mixing in the remote microphone of the remote device and the local microphone of the hearing aid can be done in an adaptive manner. And the switching/mixing mode adopts a weighted superposition mode of the two modes to mix signals according to the distance between the two modes, the signal-to-noise ratio of the signals collected by the far-end microphone, the discrimination of the human voice, the reverberation degree of the space where the switching/mixing mode is positioned and the like. For ease of understanding, the following description will exemplarily describe the hearing aid 2 as the execution body.
Example one
As shown in fig. 1, the hearing aid 2 comprises a local microphone 21, a transceiver module 22, a processor 23 and a speaker 24.
Fig. 2 schematically shows a flow chart of a sound adaptive adjustment method according to a first embodiment of the present invention.
As shown in fig. 2, the adaptive sound adjusting method may include steps S200 to S204, wherein:
and step S200, acquiring a first sound signal collected by the local microphone.
The local microphone 21 may acquire the wearer's ambient environment signal (i.e. the first sound signal) when the hearing aid 2 is worn on the wearer's ear. The first sound signal may include various sound signals around the wearer, such as sound signals of other people, sound signals of animals, and various sound signals of automobiles and the like.
Step S202, a second sound signal collected by a far-end device is obtained through wireless transmission, and the far-end device is located in a signal coverage range of the hearing aid.
The remote device 4 has one or more microphones or microphone arrays built in.
The remote device 4 may be raised to pick up sound, and may be placed, for example, near a television or a teacher in a classroom. The acquired and generated second sound signal is transmitted wirelessly to the hearing aid 2. It should be noted that, with respect to the hearing aid 2, the remote device 4 may be located within the signal coverage range of bluetooth or Zigbee of the hearing aid 2 without being limited in size. Therefore, the remote device 4 can perform noise reduction without being limited by power, and can provide the second sound signal obtained by processing such as noise reduction to the hearing aid 2 by using a plurality of microphones and an algorithm with a large complexity and a large cost.
Further, the remote device 4 comprises a microphone array by means of which the sound source position is accurately locked, according to which it is transmitted to the hearing aid 2 together with the second sound signal. The sound source position may also be used for subsequent processing.
Step S204, mixing the first sound signal and the second sound signal according to a preset strategy to generate an output signal.
Different strategies may be implemented, e.g., based on physical distance, orientation, degree of reverberation, presence or absence of human voice, and combinations thereof.
In an exemplary embodiment, as shown in fig. 3 and 4, the step S204 can be implemented by steps S400 to S406: step S400, determining a signal correlation between the first sound signal and the second sound signal; step S402 of determining a physical distance between the hearing aid and the remote device based on the signal correlation; step S404, determining a mixing weight of the first sound signal and a mixing weight of the second sound signal according to the physical distance; step S406, mixing the first sound signal and the second sound signal according to the mixing weight of the first sound signal and the mixing weight of the second sound signal to generate the output signal, wherein the output signal is provided to a speaker. In actual operation:
M(D)＝∑x(t)y(t-D)
where x (t) represents the first sound signal picked up by the local microphone 21, y (t) represents the second sound signal provided by the remote device 4, and D represents different delay values, which may vary from 1 to 100. The maximum of the different m (D) values is calculated, which corresponds to the value of D, which is the physical distance between the remote device 4 and the hearing aid 2. For example, when D is 40 max and the sampling rate is 16000hz, the physical distance between the remote device 4 and the hearing aid 2 is determined to be 40D/340 16000 and 40 340/16000 m is 0.85 m.
Further, a plurality of distance sections may be configured in advance, each distance section corresponding to a weight group, each weight group including a mixing weight corresponding to the first sound signal and a mixing weight corresponding to the second sound signal; the mixing weight of the first sound signal is inversely related to the physical distance between the hearing aid 2 and the remote device 4; the mixing weight of the second sound signal is positively correlated to the physical distance between the hearing aid 2 and the remote device 4.
Thus, in the present embodiment, a corresponding mixing strategy is performed depending on the physical distance between the hearing aid 2 and the remote device 4. When the physical distance between the hearing aid 2 and the remote device 4 is small, the first sound signal picked up by the local microphone is dominant. When the physical distance between the hearing aid 2 and the remote device 4 is large, more mixing of the second sound signal provided by the remote device 4 is required. In view of this, the primary and secondary of the sound can be effectively distinguished, and meanwhile, relatively real auditory distance feeling can be created, so that the auditory experience of the user is effectively improved.
In an exemplary embodiment, as shown in fig. 5, 6, 7 and 8, the remote device 4 may include a plurality of remote microphones, each at a different location and each providing a remote sound signal;
the second sound signal is obtained by the following steps:
step S800, determining sound source positions around the remote equipment through each path of remote sound signal;
step S802, determining the weight of each path of far-end sound signal according to the sound source position; and
step S804, performing a weighted overlap operation on the remote sound signals according to the weights of the remote sound signals to generate the second sound signal.
Since the remote unit 4 can be power-free, the location of the sound source can be quickly and accurately locked and tracked by using higher power algorithms. And based on the sound source position, the weights of the respective paths of far-end sound signals are adjusted (the far-end sound signals collected by the far-end microphone whose beam is directed to the sound source position have a higher weight than the far-end sound signals collected by the other far-end microphones), and mixing and noise reduction are performed, and the second sound signal obtained after processing such as noise reduction is supplied to the hearing aid 2.
Compared with processing (mixing and denoising) of each path of far-end sound signal in the hearing aid 2, the embodiment mixes and denoises each path of received signal with the assistance of the far-end device 4 to form one path of sound signal (namely, a second sound signal) to the hearing aid 2, so that the signal processing pressure of the hearing aid is effectively reduced, the processing speed is increased, and the better processing effect is achieved (the far-end device 4 is not limited by functions and can use complex operation).
Of course, there are multiple processing algorithms in the remote device 4. The hearing aid 2 may control the remote device 4 to adjust the processing algorithm for each remote sound signal according to the actual situation (current mode). For example, the current operation mode is a classroom mode, a home mode, a square mode. The current operation mode can be switched automatically according to the position of the hearing aid 2 (built-in positioning and map), or can be switched according to the control instruction of the electronic device. In response to the switching of the current operation mode, the hearing aid 2 will automatically trigger the transmission of control commands to control the remote device 4 to implement different sound signal acquisition strategies and processing algorithms. The remote device 4 may also identify the current scene in which it is located according to the collected remote sound signals, and request the hearing aid 2 to switch the operation mode so as to adapt to the environment.
In an exemplary embodiment, with continuing reference to fig. 5, 6, 7, and with further reference to fig. 9, the remote device 4 may include a plurality of remote microphones, each at a different location, each providing a remote sound signal;
the second sound signal is obtained by the following steps:
step S900, determining the signal-to-noise ratio of each path of far-end sound signal;
step S902, determining the far-end sound signal with the highest signal-to-noise ratio from the plurality of paths of far-end sound signals as the second sound signal.
The far-end sound signal with the highest signal-to-noise ratio usually contains a large component of the speech signal. Directly determining the far-end sound signal with the highest signal-to-noise ratio as the second sound signal may relieve the signal processing pressure of the far-end device 4.
In an exemplary embodiment, as shown in fig. 10, the step S404 may include steps S1000-S1004, wherein: step S1000, judging whether the first sound signal comprises a human sound signal or not to obtain a first human sound judgment result; step S1002, determining whether the second sound signal comprises a human sound signal or not to obtain a second human sound judgment result; step S1004, determining a mixing weight of the first sound signal and a mixing weight of the second sound signal according to the physical distance, the first vocal determination result, and the second vocal determination result.
Namely, whether the human voice exists or not is determined according to the physical distance, and the mixing weight of each sound signal is determined, so that the hearing experience is further improved.
The following cases are classified:
(1) the first sound signal comprises a human voice signal and the second sound signal comprises a human voice signal;
slightly increasing the mixing weight of the first sound signal, such as increasing by a preset level;
(2) the first sound signal comprises a human voice signal, and the second sound signal does not comprise a human voice signal;
increasing the mixing weight of the first sound signal, such as two preset levels;
(3) the first sound signal does not include a human voice signal, and the second sound signal includes a human voice signal;
increasing the mixing weight of the second sound signal, such as two preset levels;
in addition, when the wearer makes a sound himself, the wearer's own sound signal is also propagated through the air to the local microphone 21, so that the first sound signal may include the wearer's own sound signal. When it is detected that the first sound signal includes a human sound signal, it is necessary to further determine whether the first sound signal is a signal emitted by the wearer. As an example, if the first sound signal comprises the wearer's own signal, the mixing weight of the first sound signal is adjusted down on the basis of the adjustment, such as adjusting two preset levels down. In this example, it is possible to effectively prevent the wearer's own voice from being excessively amplified, increasing hearing comfort.
In addition, when it is detected that the second sound signal comprises a human voice signal, the sound source position is transmitted to the hearing aid 2. The hearing aid 2 also performs mixing of signals based on the sound source position so that the signal output to the wearer has a sense of orientation. The change of the orientation sense can further improve the hearing experience when people are moving at many times.
In an exemplary embodiment, as shown in fig. 11, the step S1004 may include steps S1100-S1102, wherein:
step S1100, determining the reverberation degree according to the first sound signal or the second sound signal;
step S1102, determining a mixing weight of the first sound signal and a mixing weight of the second sound signal according to the physical distance, the first human voice determination result, the second human voice determination result, and the reverberation degree.
When the reverberation is larger, it is more laborious to hear the far-end sound, and therefore, the mixing weight of the second sound signal is increased, so that the far-end sound can be more clearly heard even under the condition of larger reverberation.
In an exemplary embodiment, as shown in fig. 12, the method may further include the steps of:
step S1200, receiving a control instruction sent by the electronic equipment; and
and step S1202, adjusting the mixing weight of each path of signal for mixing sound on the basis of the preset strategy according to the control instruction.
Whether the electronic device may be a smartphone, etc.
Taking a smart phone as an example, the smart phone can flexibly control the selection of audio mixing through the strategy of controlling audio mixing through the APP.
Example two
As shown in fig. 13, a block diagram of a sound adaptive adjustment system 1300 according to a second embodiment of the present invention is schematically shown. The sound adaptation system 1300 is used in a hearing aid comprising a local microphone, a processor and a speaker, the local microphone being located on a side of the hearing aid remote from the ear canal. The system may be partitioned into one or more program modules, stored in a storage medium, and executed by one or more processors to implement embodiments of the invention. The program modules referred to in the embodiments of the present invention refer to a series of computer program instruction segments that can perform specific functions, and the following description will specifically describe the functions of the program modules in the embodiments. Specifically, the adaptive sound adjustment system 1300 includes the following modules:
a first obtaining module 1310, configured to obtain a first sound signal collected by the local microphone;
a second obtaining module 1320, configured to obtain, through wireless transmission, a second sound signal collected by a remote device, where the remote device is located within a signal coverage range of the hearing aid; and
a mixing module 1330 configured to mix the first sound signal and the second sound signal according to a preset strategy to generate an output signal.
As an alternative embodiment, the mixing module 1330 is further configured to:
determining a signal correlation between the first sound signal and the second sound signal;
determining a physical distance between the hearing aid and the remote device based on the signal correlation;
determining a mixing weight of the first sound signal and a mixing weight of the second sound signal according to the physical distance;
mixing the first sound signal and the second sound signal according to the mixing weight of the first sound signal and the mixing weight of the second sound signal to generate the output signal, wherein the output signal is used for being provided to a loudspeaker.
As an alternative embodiment, the remote device includes a plurality of remote microphones, each of the remote microphones is respectively located at a different position and respectively provides a remote sound signal;
the second sound signal is obtained by the following steps:
determining the sound source positions around the remote equipment through each path of remote sound signals;
determining the weight of each path of far-end sound signal according to the sound source position; and
and performing weighted superposition operation on the remote sound signals according to the weights of the remote sound signals to generate the second sound signal.
As an alternative embodiment, the remote device includes a plurality of remote microphones, each of the remote microphones is respectively located at a different position and respectively provides a remote sound signal;
the second sound signal is obtained by the following steps:
determining the signal-to-noise ratio of each path of far-end sound signal;
and determining the far-end sound signal with the highest signal-to-noise ratio from the far-end sound signals as the second sound signal.
As an alternative embodiment, the mixing module 1330 is further configured to:
judging whether the first sound signal comprises a human sound signal or not to obtain a first human sound judgment result;
determining whether the second sound signal comprises a human sound signal or not to obtain a second human sound judgment result;
and determining the mixing weight of the first sound signal and the mixing weight of the second sound signal according to the physical distance, the first voice judgment result and the second voice judgment result.
As an alternative embodiment, the mixing module 1330 is further configured to:
determining a reverberation degree from the first sound signal or the second sound signal; and
and determining the mixing weight of the first sound signal and the mixing weight of the second sound signal according to the physical distance, the first human voice judgment result, the second human voice judgment result and the reverberation degree.
As an optional embodiment, further comprising an adjusting module (not identified) for:
receiving a control instruction sent by electronic equipment; and
and adjusting the mixing weight of each path of signal for mixing sound on the basis of the preset strategy according to the control instruction.
EXAMPLE III
As shown in fig. 14, a schematic diagram of a hardware architecture of a computer device 10000 suitable for implementing a sound adaptive adjustment method according to a third embodiment of the present invention is shown. The computer device 10000 may be a hearing aid or a hearing device with hearing aid functionality. In this embodiment, the computer device 10000 is a device capable of automatically performing numerical calculation and/or information processing according to a preset or stored instruction. For example, a hearing aid with a hearing aid function, or the like may be used. As shown in fig. 14, computer device 10000 includes at least, but is not limited to: the memory 10010, processor 10020, and network interface 10030 may be communicatively linked to each other via a system bus. Wherein:
the memory 10010 includes at least one type of computer-readable storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the storage 10010 may be an internal storage module of the computer device 10000, such as a hard disk or a memory of the computer device 10000. In other embodiments, the memory 10010 may also be an external storage device of the computer device 10000, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), or the like, provided on the computer device 10000. Of course, the memory 10010 may also include both internal and external memory modules of the computer device 10000. In this embodiment, the memory 10010 is generally used for storing an operating system installed in the computer device 10000 and various types of application software, such as a program code of a sound adaptive adjustment method. In addition, the memory 10010 can also be used to temporarily store various types of data that have been output or are to be output.
Processor 10020, in some embodiments, can be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data Processing chip. The processor 10020 is generally configured to control overall operations of the computer device 10000, such as performing control and processing related to data interaction or communication with the computer device 10000. In this embodiment, the processor 10020 is configured to execute program codes stored in the memory 10010 or process data.
Network interface 10030 may comprise a wireless network interface or a wired network interface, and network interface 10030 is generally used to establish a communication link between computer device 10000 and other computer devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal via a network, establish a data transmission channel and a communication link between the computer device 10000 and the external terminal, and the like. The network may be an Intranet (Internet), the Internet (Internet), a Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth (Bluetooth), Wi-Fi, or other wireless or wired network. A means of
It should be noted that fig. 14 only illustrates a computer device having components 10010-10030, but it should be understood that not all of the illustrated components are required to be implemented and that more or fewer components may be implemented instead.
In this embodiment, the sound adaptive adjustment method stored in the memory 10010 can be further divided into one or more program modules and executed by one or more processors (in this embodiment, the processor 10020) to complete the embodiment of the present invention.
Example four
The present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the sound adaptive adjustment method in the embodiments.
In this embodiment, the computer-readable storage medium includes a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the computer readable storage medium may be an internal storage unit of the computer device, such as a hard disk or a memory of the computer device. In other embodiments, the computer readable storage medium may be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the computer device. Of course, the computer-readable storage medium may also include both internal and external storage devices of the computer device. In this embodiment, the computer-readable storage medium is generally used for storing an operating system and various types of application software installed in the computer device, for example, the program code of the sound adaptive adjustment method in the embodiment, and the like. Further, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are to be output.
It will be apparent to those skilled in the art that the modules or steps of the embodiments of the invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A method for adaptive sound adjustment, for use in a hearing aid with a built-in local microphone, the method comprising:
acquiring a first sound signal collected by the local microphone;
acquiring a second sound signal acquired by a far-end device through wireless transmission, wherein the far-end device is positioned in a signal coverage range of the hearing aid; and
mixing the first sound signal and the second sound signal according to a preset strategy to generate an output signal.
2. The adaptive sound adjustment method according to claim 1,
the mixing the first sound signal and the second sound signal according to a preset strategy to generate an output signal includes:
determining a signal correlation between the first sound signal and the second sound signal;
determining a physical distance between the hearing aid and the remote device based on the signal correlation;
determining a mixing weight of the first sound signal and a mixing weight of the second sound signal according to the physical distance;
mixing the first sound signal and the second sound signal according to the mixing weight of the first sound signal and the mixing weight of the second sound signal to generate the output signal, wherein the output signal is used for being provided to a loudspeaker.
3. The adaptive sound adjusting method according to claim 2, wherein the remote device comprises a plurality of remote microphones, each of the remote microphones being at a different location and providing a remote sound signal;
the second sound signal is obtained by the following steps:
determining the sound source positions around the remote equipment through each path of remote sound signals;
determining the weight of each path of far-end sound signal according to the sound source position; and
and performing weighted superposition operation on the remote sound signals according to the weights of the remote sound signals to generate the second sound signal.
4. The adaptive sound adjusting method according to claim 2, wherein the remote device comprises a plurality of remote microphones, each of the remote microphones being at a different location and providing a remote sound signal;
the second sound signal is obtained by the following steps:
determining the signal-to-noise ratio of each path of far-end sound signal;
and determining the far-end sound signal with the highest signal-to-noise ratio from the far-end sound signals as the second sound signal.
5. The sound adaptive adjustment method according to claim 3 or 4, wherein the determining the mixing weight of the first sound signal and the mixing weight of the second sound signal according to the physical distance comprises:
judging whether the first sound signal comprises a human sound signal or not to obtain a first human sound judgment result;
determining whether the second sound signal comprises a human sound signal or not to obtain a second human sound judgment result;
and determining the mixing weight of the first sound signal and the mixing weight of the second sound signal according to the physical distance, the first voice judgment result and the second voice judgment result.
6. The adaptive sound adjustment method according to claim 5, wherein the determining the mixing weight of the first sound signal and the mixing weight of the second sound signal according to the physical distance, the first vocal determination result, and the second vocal determination result comprises:
determining a reverberation degree from the first sound signal or the second sound signal; and
and determining the mixing weight of the first sound signal and the mixing weight of the second sound signal according to the physical distance, the first human voice judgment result, the second human voice judgment result and the reverberation degree.
7. The adaptive sound adjustment method according to claim 6, further comprising:
receiving a control instruction sent by electronic equipment; and
and adjusting the mixing weight of each path of signal for mixing sound on the basis of the preset strategy according to the control instruction.
8. A sound adaptation system for use in a hearing aid with a built-in local microphone, the system comprising:
the first acquisition module is used for acquiring a first sound signal acquired by the local microphone;
the second acquisition module is used for acquiring a second sound signal acquired by a far-end device through wireless transmission, and the far-end device is positioned in a signal coverage range of the hearing aid; and
a mixing module for mixing the first sound signal and the second sound signal according to a preset strategy to generate an output signal.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor, when executing the computer program, is adapted to implement the steps of the sound adaptive adjustment method of any of claims 1 to 7.
10. A computer-readable storage medium, in which a computer program is stored, which computer program is executable by at least one processor to cause the at least one processor to perform the steps of the sound adaptive adjustment method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210544163.0A CN115002635A (en) | 2022-05-18 | 2022-05-18 | Sound self-adaptive adjusting method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210544163.0A CN115002635A (en) | 2022-05-18 | 2022-05-18 | Sound self-adaptive adjusting method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115002635A true CN115002635A (en) | 2022-09-02 |
Family
ID=83026941
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210544163.0A Pending CN115002635A (en) | 2022-05-18 | 2022-05-18 | Sound self-adaptive adjusting method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115002635A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030235319A1 (en) * | 2002-06-24 | 2003-12-25 | Siemens Audiologische Technik Gmbh | Hearing aid system with a hearing aid and an external processor unit |
| US20110091056A1 (en) * | 2009-06-24 | 2011-04-21 | Makoto Nishizaki | Hearing aid |
| US20150043742A1 (en) * | 2013-08-09 | 2015-02-12 | Oticon A/S | Hearing device with input transducer and wireless receiver |
| US20150049892A1 (en) * | 2013-08-19 | 2015-02-19 | Oticon A/S | External microphone array and hearing aid using it |
| CN105898662A (en) * | 2015-02-13 | 2016-08-24 | 奥迪康有限公司 | Partner Microphone Unit And A Hearing System Comprising A Partner Microphone Unit |
| JP2017005356A (en) * | 2015-06-05 | 2017-01-05 | リウ チン フォンＣｈｉｎｇ−Ｆｅｎｇ ＬＩＵ | Method for processing audio signal and hearing aid system |
-
2022
- 2022-05-18 CN CN202210544163.0A patent/CN115002635A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030235319A1 (en) * | 2002-06-24 | 2003-12-25 | Siemens Audiologische Technik Gmbh | Hearing aid system with a hearing aid and an external processor unit |
| US20110091056A1 (en) * | 2009-06-24 | 2011-04-21 | Makoto Nishizaki | Hearing aid |
| US20150043742A1 (en) * | 2013-08-09 | 2015-02-12 | Oticon A/S | Hearing device with input transducer and wireless receiver |
| US20150049892A1 (en) * | 2013-08-19 | 2015-02-19 | Oticon A/S | External microphone array and hearing aid using it |
| CN105898662A (en) * | 2015-02-13 | 2016-08-24 | 奥迪康有限公司 | Partner Microphone Unit And A Hearing System Comprising A Partner Microphone Unit |
| JP2017005356A (en) * | 2015-06-05 | 2017-01-05 | リウ チン フォンＣｈｉｎｇ−Ｆｅｎｇ ＬＩＵ | Method for processing audio signal and hearing aid system |
Non-Patent Citations (1)
| Title |
|---|
| 邹采荣;梁瑞宇;谢跃: "数字助听器语音处理算法研究进展与展望", 《数据采集与处理》, 15 March 2016 (2016-03-15) * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10123134B2 (en) | Binaural hearing assistance system comprising binaural noise reduction | |
| US10567889B2 (en) | Binaural hearing system and method | |
| CN107690119B (en) | Binaural hearing system configured to localize sound source | |
| US20190115041A1 (en) | Hearing system | |
| EP3036915B1 (en) | Hearing aid having an adaptive classifier | |
| EP3248393B1 (en) | Hearing assistance system | |
| JP6360893B2 (en) | Hearing aid with classifier | |
| US9894446B2 (en) | Customization of adaptive directionality for hearing aids using a portable device | |
| JP2018137734A (en) | Binaural audibility accessory system with binaural impulse environment detector | |
| CN106878905B (en) | Method for determining objective perception quantity of noisy speech signal | |
| EP3337190B1 (en) | A method of reducing noise in an audio processing device | |
| CN103155409B (en) | For the method and system providing hearing auxiliary to user | |
| CN114727212B (en) | Audio processing method and electronic equipment | |
| EP3036914A1 (en) | Hearing aid having a classifier for classifying auditory environments and sharing settings | |
| WO2016015186A1 (en) | Acoustical signal processing method and device of communication device | |
| US20240373178A1 (en) | Bilateral hearing aid system and method of enhancing speech of one or more desired speakers | |
| US20210297797A1 (en) | Audition of hearing device settings, associated system and hearing device | |
| US10200795B2 (en) | Method of operating a hearing system for conducting telephone calls and a corresponding hearing system | |
| CN115002635A (en) | Sound self-adaptive adjusting method and system | |
| CN115811691A (en) | Method for operating a hearing device | |
| EP4422211A1 (en) | Method of optimizing audio processing in a hearing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |