CN113115154A - Environment sound hearing method and device, computer equipment and earphone - Google Patents
Environment sound hearing method and device, computer equipment and earphone Download PDFInfo
- Publication number
- CN113115154A CN113115154A CN202110367902.9A CN202110367902A CN113115154A CN 113115154 A CN113115154 A CN 113115154A CN 202110367902 A CN202110367902 A CN 202110367902A CN 113115154 A CN113115154 A CN 113115154A
- Authority
- CN
- China
- Prior art keywords
- signal
- sound
- earphone
- ambient
- microphone unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Circuit For Audible Band Transducer (AREA)
- Headphones And Earphones (AREA)
Abstract
The application provides an environmental sound hearing method and device, computer equipment and an earphone. This application is through right the environmental sound signal that microphone unit gathered carries out the compensation processing of signal distortion volume, then exports the compensation signal that the compensation processing obtained through the speaker, can make the sound that the people's ear heard with not wear the effect unanimous when the earphone is directly listened, avoid it because the separating of earphone structure keeps off and distorts.
Description
Technical Field
The application relates to the field of signal processing, in particular to an ambient sound hearing-through method, an ambient sound hearing-through device, computer equipment and an earphone.
Background
In recent years, earphones have been developed as consumer electronics products that are necessary for people in daily life. However, the same sound signal is not directly heard by the eardrum of the user, and the same effect is not obtained when the user wears the earphone. Due to the existence of the earphone structure, the transmission of sound through a physical isolation path inevitably has amplitude and phase distortion, and the perception capability of an earphone user to the surrounding environment is seriously affected.
Disclosure of Invention
Aiming at the defects of the prior art, the application provides the environmental sound hearing-through method and the earphone, so that the effect of the sound heard by the user is consistent with that of the sound directly heard without wearing the earphone under the condition of wearing the earphone. The technical scheme is specifically adopted in the application.
First, to achieve the above object, an ambient sound hearing method applied to an earphone including a microphone unit and a speaker is provided, the method including: performing compensation processing on signal distortion quantity of an environmental sound signal collected by the microphone unit, wherein the signal distortion quantity is determined by sound insulation characteristics of a structure of the earphone; and driving the loudspeaker to play the compensation signal obtained after the compensation processing.
Optionally, the ambient sound hearing method according to any of the above, wherein the ambient sound signal includes a target sound signal and a noise signal; before performing compensation processing of a signal distortion amount on the ambient sound signal collected by the microphone unit, the method further includes: gain the target acoustic signal and/or suppress the noise signal.
Optionally, the ambient sound hearing method according to any of the above, wherein the microphone unit comprises at least two microphones; the gain of the target acoustic signal comprises: determining the time delay amount between every two target sound signals in each environment sound signal according to the peak value of the cross-correlation function between every two at least two environment sound signals collected by the at least two microphones; aligning the at least two ambient sound signals based on the amount of time delay; and performing weighted summation processing on the at least two aligned environment sound signals to gain the target sound signal.
Optionally, in the ambient sound hearing method according to any of the above, a gain coefficient corresponding to the weighted sum processing is greater than or equal to 1.
Optionally, the method for ambient sound hearing through according to any one of the above embodiments, wherein the performing compensation processing on the ambient sound signal collected by the microphone unit by using the signal distortion amount includes: filtering the environment sound signal obtained after the weighted summation processing through a preset filtering unit to obtain the compensation signal; wherein a system transfer function of the filtering unit is determined by a difference of a first transfer function of a sound field space between a shell position of the earphone and a sound outlet boundary surface of the earphone before and after the earphone is worn by an ear canal of a user, a second transfer function of a secondary acoustic path of the earphone, and the gain coefficient.
Meanwhile, in order to achieve the above object, the present application further provides an ambient sound hearing device applied to an earphone, the earphone includes a microphone unit and a speaker, the device includes: the signal processing module is used for compensating signal distortion quantity of the environmental sound signal collected by the microphone unit, wherein the signal distortion quantity is determined by sound insulation characteristics of the structure of the earphone; and the signal driving module is used for driving the loudspeaker to play the compensation signal obtained after the compensation processing.
Simultaneously, this application still provides a computer equipment, and it includes: a processor; a memory comprising computer instructions stored thereon which, when executed by the processor, cause the processor to perform an ambient sound hear-through method as in any one of the above.
In addition, the present application also provides an earphone, which includes: the microphone unit is used for collecting environmental sound signals; a first processor connected to the microphone unit for performing compensation processing of a signal distortion amount of the ambient sound signal, wherein the signal distortion amount is determined by a sound insulation characteristic of a structure of the earphone; and the loudspeaker is connected with the first processor and used for playing the compensation signal obtained after the compensation processing.
Optionally, the earphone according to any of the above, wherein the first processor is further configured to, before the compensation process, gain a target sound signal in the ambient sound signal and/or suppress a noise signal in the ambient sound signal.
Optionally, the earphone as described in any of the above, further comprising: and the second processor is connected between the microphone unit and the loudspeaker and used for determining an anti-noise signal corresponding to the environment sound signal according to the environment sound signal and driving the loudspeaker to play the anti-noise signal.
Advantageous effects
This application is through right the environmental sound signal that microphone unit gathered carries out the compensation processing of signal distortion volume, then exports the compensation signal that the compensation processing obtained through the speaker, can make the sound signal that the people's ear heard unanimously with not wearing the effect when the earphone is directly listened, avoids it to separate because earphone structure to keep off and distort.
Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the application.
Drawings
The accompanying drawings are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application and not limit the application. In the drawings:
fig. 1 is a block diagram of a headset provided by an embodiment of the present application;
fig. 2 is a schematic diagram of an ambient sound hearing method according to an embodiment of the present application for performing compensation processing on an ambient sound signal.
Detailed Description
In order to make the purpose and technical solutions of the embodiments of the present application clearer, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings of the embodiments of the present application. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the application without any inventive step, are within the scope of protection of the application.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
In the present application, the meaning of "and/or" means that the respective cases exist individually or both at the same time.
In the present application, "connected" may mean either a direct connection between components or an indirect connection between components via other components.
The application firstly provides an earphone and an environmental sound perspective listening method applied to the earphone.
The headset comprises a microphone (unit), (first) processor and a speaker as shown in fig. 1. The microphone unit is used for collecting environment sound signals, and the first processor is used for executing the environment sound perspective listening method 10, and comprises the following steps:
s12, carrying out compensation processing of signal distortion quantity on the environment sound signal collected by the microphone unit; and
and S14, driving the loudspeaker to play the compensation signal obtained after the compensation processing.
The signal distortion amount based on compensation processing by the first processor is determined by the sound insulation characteristic of the structure of the earphone, so that a user can conveniently listen to outside sound by using the earphone, the effect of listening when the user does not wear the earphone is completely consistent, and signal distortion cannot be caused by the earphone structure.
Since the ambient sound signal collected by the microphone unit includes the target sound signal and the noise signal, in order to achieve a better sound transmission effect for the target sound signal, in the embodiment of the present application, before performing compensation processing on the signal distortion amount of the ambient sound signal collected by the microphone unit, the first processor may execute the steps further included in the method 10 described above:
and S16, performing gain on the target sound signal and/or suppressing the noise signal, thereby improving the signal-to-noise ratio of the collected environment sound signal so as to improve the target voice quality of the end user.
It should be understood by those skilled in the art that the above process of hearing through the target sound signal does not need to limit the number and layout of the earphone microphones, and the distortion effect caused by the earphone structure in the sound transmission process can be compensated by the operation processing of the sound signal.
In other implementations, the present application also provides an ambient sound hearing device that may be disposed in an earpiece having a microphone and a speaker. This environment sound hearing device includes:
the signal processing module is used for carrying out compensation processing on signal distortion quantity on the environmental sound signals collected by the microphone unit; and
and the signal driving module is used for driving the loudspeaker to play the compensation signal obtained after the compensation processing.
Wherein the amount of signal distortion on which the signal processing module performs the compensation process is determined by the sound insulation characteristics of the earphone structure.
In view of the above, in the earphone provided in the embodiment of the present application, at least two microphones are preferably provided.
In this implementation, in order to improve the target voice quality heard by the end user, the step S16 may further include the steps of:
and S162, determining the time delay amount between every two target sound signals in each environment sound signal according to the peak value of the cross-correlation function between every two at least two environment sound signals collected by at least two microphones.
And S164, aligning the environmental sound signals collected by each path based on the time delay amount between the target sound signals in each two paths.
And S166, performing weighted summation processing on the at least two aligned environment sound signals to gain the target sound signal.
Since the delay amount (i.e., the time difference) of the single-component sound signal arriving at each microphone successively depends on the azimuth angle formed by the sound source and the microphone unit composed of at least two microphones, the time difference of the ambient noise signal arriving at each microphone from the direction of the non-target sound source is different from the target sound signal arriving from the direction of the target sound source, and the delay amount determined in step S162 is used to "align" the ambient sound signals, where the target sound signal is aligned but the noise signal is not aligned.
Furthermore, at least two environment sound signals after being weighted and summed and aligned make the obtained target sound component more obvious relative to the obtained noise component, namely, the signal-to-noise ratio of the environment sound signals collected by the microphone unit is enhanced, and finally, the quality of the target voice heard by the user is improved.
In the embodiment of the present application, the weighted summation may be, for example, an arithmetic average, a weighted average, an algebraic summation, or the like, so that the gain coefficient for the target acoustic signal is equal to or greater than 1. The application does not limit the specific weighted summation algorithm.
In this implementation, the step S12 may further include the steps of:
and S122, filtering the environment sound signal obtained after the weighting and summing in the step S166 through a filtering unit to obtain a compensation signal to be played by the loudspeaker.
The system transfer function of the filtering unit is predetermined by the difference of the first transfer function of the sound field space between the earphone shell position and the boundary surface of the sound outlet hole of the earphone before and after the earphone is worn by the ear canal of the user, the second transfer function of the secondary acoustic path of the earphone and the gain coefficient of the target acoustic signal. Wherein the second transfer function of the secondary acoustic path of the earpiece comprises a transfer function of an electro-acoustic transduction of the loudspeaker and a transfer function of a space between the diaphragm face of the loudspeaker and the boundary face of the sound outlet aperture.
In the specific implementation, the first transfer functions of the sound field space between the positions of the earphone shell and the boundary surface of the sound outlet hole of the earphone before and after the earphone is worn are respectively calibrated twice in the design stage of the earphone and before and after the earphone is worn on the artificial head; the second transfer function can be obtained by directly calibrating the earphone body in the design stage; the gain coefficient corresponding to the weighted summation processing is determined by the weight value designed for each path of collected environment sound signals.
Referring to fig. 2, the lower part of fig. 2 shows a direct listening process of the target sound signal s (t) when the user does not wear the earphone, and the upper part shows an indirect listening process of the same target sound signal s (t) when the user wears the earphone. In order to solve the distortion problem when the target sound signal s (t) is heard through, that is, the signal obtained by the eardrum hearing through the earphone is the same as the directly heard signal s' (t), it needs to satisfy:
s(t)·T'1·T2+ks(t)·H·T3·T2＝s'(t)＝s(t)·T1·T2formula (1)
Wherein, T'1For the transfer function of the space between the position of the earphone housing and the boundary surface of the sound outlet when the earphone is worn, T1The transfer function of the space between the position where the earphone shell is supposed to be and the position where the boundary surface of the sound outlet hole is supposed to be when the earphone is not worn; t is2The transfer function of the space between the position where the boundary surface of the sound outlet hole is located and the tympanic membrane is independent of whether the user wears the earphone or not; t is3A transfer function for the secondary acoustic path of the earpiece; k is the gain factor for the target acoustic signal and H is the system transfer function of the filtering unit (i.e. the compensation unit shown in the figure).
By simplifying equation (1) above, the system transfer function of the filtering unit can be determined:
therefore, for the earphone with a microphone unit, a processor and a loudspeaker, in order to realize the compensation effect on the target sound signal s (t), a first processor (comprising a gain unit and a compensation unit shown in the figure) is connected with the microphone unit and the loudspeaker, the system transfer function H of the compensation unit is set according to the formula (2) so as to filter the environment sound signal ks (t) after gain, and the loudspeaker is driven to play the compensation signal obtained by filtering
The compensation signal is played through a loudspeaker to reach the tympanic membrane to become a compensation sound signal (T)1-T'1)T2s (T), and the target acoustic signal s (T) is transmitted to the tympanic membrane through the earphone structure to become a distorted acoustic signal T'1T2s (T), the two are superposed to obtain fidelity sound signal T1T2s (t) which is related to the acoustic signal s' (t) directly heard by the tympanic membrane when the earphone is not wornThe same is true.
Therefore, the ambient sound hearing method provided by the application can enable a user to listen to external sound by wearing the earphone, for example: prompting voice, companion conversation content, own speech content and the like, and eliminating sound distortion caused by the structure of the earphone, thereby ensuring that the effect of wearing the earphone is completely consistent with that of not wearing the earphone, and even the target voice heard when wearing the earphone is clearer.
In some embodiments, the earphone provided by the present application is an active noise reduction earphone, and the microphone unit shown in fig. 1 may be implemented as a reference microphone of the active noise reduction earphone, for example, and is disposed on the earphone housing, so that the ambient sound signal collected by the microphone unit includes an ambient noise signal to be transmitted into the ear canal of the user. Accordingly, the active noise reduction earphone further comprises:
a second processor coupled between the microphone unit and the speaker for determining an anti-noise signal corresponding to the ambient noise signal from the ambient acoustic signal. The anti-noise signal is played by a speaker to generate anti-noise waves to achieve active noise reduction in the ear canal region of the user.
Other embodiments of the present application also provide a computer device, comprising: a processor and a memory.
Wherein the memory includes computer instructions stored thereon which, when executed by the processor, cause the processor to perform the ambient sound hear-through method 10 as provided in any of the embodiments described above.
The above are merely embodiments of the present application, and the description is specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the protection scope of the present application.
Claims (10)
1. An ambient sound hearing method applied to an earphone, wherein the earphone comprises a microphone unit and a loudspeaker, the method comprising:
performing compensation processing on signal distortion quantity of an environmental sound signal collected by the microphone unit, wherein the signal distortion quantity is determined by sound insulation characteristics of a structure of the earphone;
and driving the loudspeaker to play the compensation signal obtained after the compensation processing.
2. The ambient acoustic hearing method according to claim 1, wherein the ambient acoustic signal comprises a target acoustic signal and a noise signal; before performing compensation processing of a signal distortion amount on the ambient sound signal collected by the microphone unit, the method further includes:
gain the target acoustic signal and/or suppress the noise signal.
3. The ambient acoustic hearing method of claim 2, wherein the microphone unit comprises at least two microphones; the gain of the target acoustic signal comprises:
determining the time delay amount between every two target sound signals in each environment sound signal according to the peak value of the cross-correlation function between every two at least two environment sound signals collected by the at least two microphones;
aligning the at least two ambient sound signals based on the amount of time delay;
and performing weighted summation processing on the at least two aligned environment sound signals to gain the target sound signal.
4. The ambient acoustic hearing method according to claim 3, wherein the weighted sum process corresponds to a gain factor of 1 or more.
5. The ambient acoustic hearing method according to claim 4, wherein the processing of compensating for the amount of signal distortion of the ambient acoustic signal picked up by the microphone unit comprises:
filtering the environment sound signal obtained after the weighted summation processing through a preset filtering unit to obtain the compensation signal; wherein a system transfer function of the filtering unit is determined by a difference of a first transfer function of a sound field space between a shell position of the earphone and a sound outlet boundary surface of the earphone before and after the earphone is worn by an ear canal of a user, a second transfer function of a secondary acoustic path of the earphone, and the gain coefficient.
6. An ambient sound hearing device for use with a headset comprising a microphone unit and a loudspeaker, the device comprising:
the signal processing module is used for compensating signal distortion quantity of the environmental sound signal collected by the microphone unit, wherein the signal distortion quantity is determined by sound insulation characteristics of the structure of the earphone;
and the signal driving module is used for driving the loudspeaker to play the compensation signal obtained after the compensation processing.
7. A computer device, comprising:
a processor;
a memory comprising computer instructions stored thereon that, when executed by the processor, cause the processor to perform the ambient sound hear-through method of any of claims 1-5.
8. An earphone, comprising:
the microphone unit is used for collecting environmental sound signals;
a first processor connected to the microphone unit for performing compensation processing of a signal distortion amount of the ambient sound signal, wherein the signal distortion amount is determined by a sound insulation characteristic of a structure of the earphone;
and the loudspeaker is connected with the first processor and used for playing the compensation signal obtained after the compensation processing.
9. The headphone of claim 8, wherein the first processor is further to gain a target sound signal in the ambient sound signal and/or suppress a noise signal in the ambient sound signal prior to the compensation process.
10. The headset of claim 8, further comprising: and the second processor is connected between the microphone unit and the loudspeaker and used for determining an anti-noise signal corresponding to the environment sound signal according to the environment sound signal and driving the loudspeaker to play the anti-noise signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110367902.9A CN113115154A (en) | 2021-04-06 | 2021-04-06 | Environment sound hearing method and device, computer equipment and earphone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110367902.9A CN113115154A (en) | 2021-04-06 | 2021-04-06 | Environment sound hearing method and device, computer equipment and earphone |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113115154A true CN113115154A (en) | 2021-07-13 |
Family
ID=76713901
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110367902.9A Pending CN113115154A (en) | 2021-04-06 | 2021-04-06 | Environment sound hearing method and device, computer equipment and earphone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113115154A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769857A (en) * | 2018-06-26 | 2018-11-06 | 会听声学科技（北京）有限公司 | sound compensation method, system and earphone |
| CN112866864A (en) * | 2021-02-26 | 2021-05-28 | 北京安声浩朗科技有限公司 | Environment sound hearing method and device, computer equipment and earphone |
-
2021
- 2021-04-06 CN CN202110367902.9A patent/CN113115154A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769857A (en) * | 2018-06-26 | 2018-11-06 | 会听声学科技（北京）有限公司 | sound compensation method, system and earphone |
| CN112866864A (en) * | 2021-02-26 | 2021-05-28 | 北京安声浩朗科技有限公司 | Environment sound hearing method and device, computer equipment and earphone |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106937196B (en) | Hearing device | |
| KR101285857B1 (en) | Ambient noise reduction arrangements | |
| EP2202998B1 (en) | A device for and a method of processing audio data | |
| US5732143A (en) | Noise cancellation apparatus | |
| EP0412902B1 (en) | Electroacoustic device for hearing needs including noise cancellation | |
| CN112866864A (en) | Environment sound hearing method and device, computer equipment and earphone | |
| CN111902866A (en) | Echo control in a binaural adaptive noise cancellation system in a headphone | |
| CN110856072B (en) | Earphone conversation noise reduction method and earphone | |
| US11330358B2 (en) | Wearable audio device with inner microphone adaptive noise reduction | |
| KR20160128412A (en) | Frequency-dependent sidetone calibration | |
| US11202161B2 (en) | System, method, and apparatus for generating and digitally processing a head related audio transfer function | |
| JP2013121106A (en) | Earhole attachment-type sound pickup device, signal processing device, and sound pickup method | |
| US11259127B2 (en) | Hearing device adapted to provide an estimate of a user's own voice | |
| US10748522B2 (en) | In-ear microphone with active noise control | |
| WO2004016037A1 (en) | Method of increasing speech intelligibility and device therefor | |
| WO2021126981A1 (en) | System, method, and apparatus for generating and digitally processing a head related audio transfer function | |
| CN113015052B (en) | Method for reducing low-frequency noise, wearable electronic equipment and signal processing module | |
| US11862138B2 (en) | Hearing device comprising an active emission canceller | |
| CN215818538U (en) | Earphone with feedback enhancement design | |
| CN113115154A (en) | Environment sound hearing method and device, computer equipment and earphone | |
| JP7375758B2 (en) | sound output device | |
| CN215729150U (en) | Glasses with hearing aid function | |
| CN111327984B (en) | Earphone auxiliary listening method based on null filtering and ear-worn equipment | |
| CN216057420U (en) | Earphone set | |
| EP4297436A1 (en) | A hearing aid comprising an active occlusion cancellation system and corresponding method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |