CN109862463A - Earphone audio playback method, earphone and its computer readable storage medium - Google Patents
Earphone audio playback method, earphone and its computer readable storage medium Download PDFInfo
- Publication number
- CN109862463A CN109862463A CN201811603161.4A CN201811603161A CN109862463A CN 109862463 A CN109862463 A CN 109862463A CN 201811603161 A CN201811603161 A CN 201811603161A CN 109862463 A CN109862463 A CN 109862463A
- Authority
- CN
- China
- Prior art keywords
- earphone
- audio
- audio signal
- playback method
- frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention relates to speaker technology fields, in particular to a kind of earphone, earphone is equipped with sequentially connected microphone, processor and loudspeaker, computer readable storage medium is stored in earphone, when computer program in the computer readable storage medium is run by the processor, external audio signal can be picked up by the microphone of earphone, then filtering is established according to filtering algorithm and estimates feedback path, after the audio signal that eve is exported to loudspeaker estimates feedback path phase convolution with filtering, it is removed from the audio signal that current time microphone is picked up, it is uttered long and high-pitched sounds with eliminating, the loudspeaker of audio signal earphone after eliminating of uttering long and high-pitched sounds is broadcast, realize audio playback, so as to power-assisted otopathy patient's hearing.
Description
Technical field
The present invention relates to speaker technology field, in particular to a kind of earphone has computer readable storage medium, Jie thereon
Matter is stored with computer program, which realizes a kind of earphone audio playback method when being run by the processor in earphone.
Background technique
The microphone of earphone has pickup function, can pick up earphone ambient audio, can be by certain method, to pickup
Audio especially human language sound handle and broadcast via loudspeaker, real-time voice playback is realized, so as to power-assisted
Otopathy patient (also known as hearing inconvenience crowd) hearing adapts to otopathy patient and needs.During audio playback, the sound of loudspeaker output
Some in frequency signal leaks, and reaches microphone, becomes input signal, if this part signal does not filter out, just will form howl
It cries.
Summary of the invention
It realizes audio playback present invention aims to earphone and does not generate and utter long and high-pitched sounds.
For this purpose, a kind of earphone audio playback method is provided, including
Audio obtaining step picks up external audio signal by the microphone of earphone；
The broadcast step executed after audio obtaining step, with the loudspeaker of earphone to the audio signal picked up into
Row plays；
Further include after audio obtaining step and before the step that broadcasts the echo that executes utter long and high-pitched sounds removal process, according to filter
Wave algorithm establishes filtering and estimates feedback path, and the audio signal that eve is exported to loudspeaker estimates feedback path phase with filtering
After convolution, removed from the audio signal that current time microphone is picked up.
Wherein, filtering algorithm system Normalized LMS Algorithm.
Wherein, further include noise suppressed step, the noise in the audio is inhibited.
Wherein, according toExecute the inhibition, in formula, E
(ω) is the frequency spectrum of the audio signal before non-noise reduction,For the frequency spectrum of noise in audio signal,After noise reduction
The frequency spectrum of audio signal, eiφ(ω)For the phase spectrum of the audio signal before non-noise reduction.
Wherein, noise spectrumIt is in speech pause gap or microphone is picked up when without voice audio signal
Frequency spectrum.
Wherein, further include loudness compensation step, same degree amplification is carried out to the audio signal of different sound pressure levels；Or it is right
The audio signal of low sound pressure levels is largely amplified, and is carried out lesser degree of amplification to the signal of high sound pressure level, is not put
Big or inhibition.
Wherein, further include band shifting step, the insensitive frequency range of audio signal middle ear patient is compressed or
It eliminates.
Wherein, band shifting step system compresses the insensitive frequency range in audio.
Wherein, the mode of the compression is to reduce the audio total amount of the insensitive frequency range in a frequency domain.
Wherein, the insensitive frequency range is known as original frequency range, numberical range fil~fiu；It is described to subtract in a frequency domain
The mode of few audio total amount is original frequency range fil~fiuIn audio compression to target frequency bands fol~fouIn the middle, wherein fil≤
fol< fou≤fiu。
Wherein, the filWith folIt is equal, the fiuFor infinity；Original frequency range fil~fiuIn audio compression arrive
Target frequency bands fol~fouDuring, give up frequency range fou~fiuBetween audio.
Wherein, according toCarry out the compression, formula
In, filFor the lower-frequency limit that need to convert original frequency range；folFor the lower-frequency limit of target frequency bands after transformation；fouFor target after transformation
The upper frequency limit of frequency range；P is variation coefficient.
Wherein, according to p=(fiu-fil)/(fou-fol) obtain the variation coefficient p, in formula, folFor target frequency after transformation
The lower-frequency limit of section.
Wherein, before audio being transformed to frequency domain, windowing process first is carried out to audio.
It wherein, further include gain rate-determining steps, the big audio signal data section of reducing strength；And/or enhancing intensity is small
Audio signal data section.
A kind of computer readable storage medium is also provided, computer program is stored with, when which is run by processor
Realize above-mentioned earphone audio playback method.
A kind of earphone, including sequentially connected microphone, processor and loudspeaker are also provided, further include above-mentioned computer
Readable storage medium storing program for executing, the computer program in the computer readable storage medium are run by the processor.
The utility model has the advantages that.
Earphone of the invention is equipped with sequentially connected microphone, processor and loudspeaker, and being stored with computer in earphone can
Earphone can be passed through when the computer program in the computer readable storage medium is run by the processor by reading storage medium
Microphone picks up external audio signal, then establishes filtering according to filtering algorithm and estimates feedback path, eve is exported to raising
After the audio signal of sound device estimates feedback path phase convolution with filtering, from the audio signal that current time microphone is picked up
It removes, is uttered long and high-pitched sounds with eliminating, the loudspeaker for the audio signal earphone after eliminating of uttering long and high-pitched sounds is broadcast, and audio playback is realized, so as to power-assisted
Otopathy patient's hearing.
Detailed description of the invention
The present invention will be further described with reference to the accompanying drawings, but the embodiment in attached drawing is not constituted to any limit of the invention
System, for those of ordinary skill in the art, without creative efforts, can also obtain according to the following drawings
Other attached drawings.
Fig. 1 is the flow chart of audio playback method.
Fig. 2 is that echo is uttered long and high-pitched sounds the flow chart of removal process.
Fig. 3 is the flow chart of noise suppressed step.
Fig. 4 is the flow chart that frequency remolds step.
Fig. 5 is the schematic diagram of spectral contrast before and after frequency transformation.
Specific embodiment
The invention will be further described with the following Examples.
See Fig. 1, in the earphone of the present embodiment, microphone picks up external audio signal, and the audio signal picked up is premenstrual
It sets after power amplifier amplifies and force down useless noise signal, amplified audio signal is made of high pass and low-pass filter anti-
Aliasing pre-filtering processing reduces influence of the noise to efficient voice signal, then use to filter out the noise other than designated frequency range
A/D conversion module, which changes into after digital quantity, to be sent into processor (can be ARM, DSP or other MCU), processor with it is computer-readable
Storage medium connects, and computer program is stored in the medium, and program can be run by processor.Handle when processor runs the program
Audio signal carry out playback process, audio signal that treated after D/A is converted, through audio signal signal output module export to
Loudspeaker, to broadcast to otopathy patient.Wherein, the audio signal back method that processor operation program is realized is specific as follows
The step of text is recorded.
S1. echo is uttered long and high-pitched sounds removal process
Some leakage, reaches microphone, becomes input signal, if do not filtered out, just in the audio of loudspeaker output
It will form and utter long and high-pitched sounds.See Fig. 2, writes algorithm filter with Normalized LMS Algorithm, so that establishing filtering estimates feedback path w (n),
The audio signal u (n) that previous moment is exported to loudspeaker estimates feedback path w (n) phase convolution with filtering, obtains making a whistling sound to echo
It makes the filtering simulated estimate feedback signal v (n), the feedback microphone signal of v (n) from current time then is estimated into filtering
Removal in d (n) obtains echo and utters long and high-pitched sounds the signal e (n) after eliminating.
S2. noise suppressed step
See Fig. 3, echo is uttered long and high-pitched sounds after elimination, reduces the noise jamming in signal e (n) by this step, improves band and makes an uproar letter
The signal-to-noise ratio of number e (n) and can identification.Noise estimation is carried out to signals with noise e (n) first, i.e., e (n) is split into x (n), s
(n) two parts obtain following formula (1).
E (n)=x (n)+s (n) (1)
In formula, e (n) is noisy speech；
X (n) is the target voice in noisy speech；
S (n) is the noise in noisy speech.
There to be E (ω)=X (ω)+S (ω) after formula (1) Fourier transformation, wherein noise S (ω) is between speech pause
E (ω), S (ω) are then substituted into following formula (2) by gap or the audio that microphone is picked up in no voice respectively, thus
Signal X (ω) after obtaining noise suppressed, and then obtain x (n).
In formula, eiφ(ω)For the phase spectrum of noisy speech e (n).
S3. loudness compensation step
This step is used to carry out loudness adjustment to x (n) specifically to can be Linear Amplifer, to the signal of different sound pressure levels
Carry out same degree amplification；Nonlinear amplification can also be used, the signal of low sound pressure levels is largely amplified, to height
The signal of sound pressure level carries out lesser degree of amplification, does not amplify or inhibit.
S4. frequency remolds step
Since otopathy patient can be insensitive to the frequency range where common noise in its working environment, the person that for a long time do not mine for coal such as is to adopting
Noise frequency range caused by coal is insensitive, therefore the insensitive frequency range of audio middle ear patient need to be compressed even by this step
It eliminates, to show the audio of other frequency ranges, so otopathy patient can be enable more clearly to listen to audio, otopathy is avoided to suffer from
Person feels in audio there is " blank spot " because of insensitive band interference.Herein it should be noted that, 1, otopathy patient it is unwise
Sense frequency range is different because of work, living environment difference；2, the audio that human ear is heard is by multiband audio frequency component common combination
It forms, therefore compression even is eliminated part of frequency range and audio can't be made to disappear, can only change its tone color.
This step specific implementation process is as shown in Figure 4, comprising:
S4-1. parameter setting step
Its insensitive frequency range is determined according to otopathy patient, and for convenience of stating, insensitive frequency range is hereafter known as original frequency range,
Numerical value is fil~fiu.It sets the compressed target frequency bands of original frequency range as fol~fou, variation coefficient p, range-adjusting coefficient
For k, wherein p, k can be a constant constant, be also possible to the variable of one group of variation；Typically, p=(f can be setiu-
fil)/(fou-fol)。
S4-2. adding window step
Due to needing to carry out Fast Fourier Transform (FFT) (FFT) to x (n), the analysis spectrum of digital signal is obtained, in order to reduce
Spectrum leakage, need to be to converting again after signal adding window.Specifically, x (n) is carried out windowing process, is formed adding window voice signal Sw (n)
=x (n) * w (n), wherein window function w (n) can be peaceful (Hanning) window or other of rectangular window, Hamming (Hamming) window, the Chinese
Suitable window type.
S4-3. Fourier transformation step
FFT variation is carried out to adding window voice signal Sw (n), signal is transformed into frequency domain from time domain, is obtained frequency spectrum X (f).
S4-4. band shifting step
New frequency spectrum X ' (f) is converted to obtain according to following formula (3), wherein formula (3) is as follows.
In formula, filFor the lower-frequency limit that need to convert original frequency range；
fiuFor the upper frequency limit that need to convert original frequency range；
folFor the lower-frequency limit of target frequency bands after transformation；
fouFor the upper frequency limit of target frequency bands after transformation；
P is variation coefficient.
The meaning of formula (3) is to see Fig. 5, if output frequency < f of audiool, then output spectrum and input, do not do and become
It changes；If the output frequency of audio is in fol-fouBetween, frequency spectrum is converted by formula, its significance lies in that by fol-fouBetween audio pressure
Contracting rear left moves to and 0-folBetween audio linking；If output frequency > f of audioou, then directly eliminated.
S4-5. gain step
This step is not preferred step, for carrying out amplitude gain to compressed audio.
S4-6. Fourier inversion step
IFFT change is carried out to X ' (f), frequency-region signal is transformed into time-domain audio signal, and then after acquisition frequency remodeling
x(n)。
S5. gain rate-determining steps
This step is used to detect the intensity of audio data section, and automatically to being determined as that the big data segment of intensity cuts down,
To being determined as that the small data segment of intensity enhances, specifically, a frame number strong point is obtained by certain length, calculates the frame amplitude
Characteristic value A is set amplitude characteristic value limit L (limit L can be divided into bound or multiple gears according to actual needs), then will
Amplitude characteristic value A is compared with each setting limit L, gain coefficient G=f (A, L), then by the frame primary data and gain
Coefficient G is multiplied, and obtains final audio signal to be output.
It should be noted that step mentioned by the above S1-S5, can carry out multinomial merging, its sequence also can be changed, also visually
Actual demand is increased and decreased.
Finally it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than the present invention is protected
The limitation of range is protected, although explaining in detail referring to preferred embodiment to the present invention, those skilled in the art are answered
Work as understanding, it can be with modification or equivalent replacement of the technical solution of the present invention are made, without departing from the reality of technical solution of the present invention
Matter and range.
Claims (10)
1. earphone audio playback method, including
Audio obtaining step picks up external audio signal by the microphone of earphone；
The broadcast step executed after audio obtaining step broadcasts the audio signal picked up with the loudspeaker of earphone
It puts；
It is characterized in that further include after audio obtaining step and before the step that broadcasts the echo that executes utter long and high-pitched sounds removal process, root
Filtering is established according to Normalized LMS Algorithm and estimates feedback path, and previous moment is exported to the audio signal and the filter of loudspeaker
After wave estimates feedback path phase convolution, removed from the audio signal that current time microphone is picked up.
2. earphone audio playback method as described in claim 1, it is characterized in that: further including noise suppressed step, to described
Noise in audio is inhibited.
3. earphone audio playback method as claimed in claim 2, it is characterized in that:
According toExecute the inhibition, in formula, E (ω) is not drop
The frequency spectrum of audio signal before making an uproar,For the frequency spectrum of noise in audio signal,For the audio signal after noise reduction
Frequency spectrum, eiφ(ω)For the phase spectrum of the audio signal before non-noise reduction.
4. earphone audio playback method as claimed in claim 3, it is characterized in that: noise spectrumIt is between speech pause
The frequency spectrum of gap or microphone is picked up when without voice audio signal.
5. earphone audio playback method as described in claim 1, it is characterized in that: further including loudness compensation step, to difference
The audio signal of sound pressure level carries out same degree amplification；Or the audio signal of low sound pressure levels is largely amplified, it is right
The signal of high sound pressure level carries out lesser degree of amplification, does not amplify or inhibit.
6. earphone audio playback method as described in claim 1, it is characterized in that: further including band shifting step, to audio
The insensitive frequency range of signal middle ear patient is compressed or is eliminated.
7. earphone audio playback method as claimed in claim 6, it is characterized in that:
According toIt is compressed, in formula, filFor original need to be converted
The lower-frequency limit of beginning frequency range；folFor the lower-frequency limit of target frequency bands after transformation；fouFor the upper frequency limit of target frequency bands after transformation；p
For variation coefficient.
8. earphone audio playback method as described in claim 1 is cut down strong it is characterized in that: further including gain rate-determining steps
Spend big audio signal data section；And/or enhance the small audio signal data section of intensity.
9. computer readable storage medium is stored with computer program, realized when which is run by processor as right is wanted
Seek 1~8 described in any item earphone audio playback methods.
10. earphone, including sequentially connected microphone, processor and loudspeaker, it is characterized in that further including as claimed in claim 9
Computer readable storage medium, the computer program in the computer readable storage medium run by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811603161.4A CN109862463A (en) | 2018-12-26 | 2018-12-26 | Earphone audio playback method, earphone and its computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811603161.4A CN109862463A (en) | 2018-12-26 | 2018-12-26 | Earphone audio playback method, earphone and its computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109862463A true CN109862463A (en) | 2019-06-07 |
Family
ID=66892469
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811603161.4A Pending CN109862463A (en) | 2018-12-26 | 2018-12-26 | Earphone audio playback method, earphone and its computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109862463A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113473345A (en) * | 2021-06-30 | 2021-10-01 | 歌尔科技有限公司 | Wearable device hearing assistance control method, device and system and readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1969320A (en) * | 2004-06-18 | 2007-05-23 | 松下电器产业株式会社 | Noise suppression device and noise suppression method |
| CN101272161A (en) * | 2008-04-30 | 2008-09-24 | 中山大学 | Self-adapting echo cancellation method |
| CN104243732A (en) * | 2013-06-05 | 2014-12-24 | Dsp集团有限公司 | Use of vibration sensor in acoustic echo cancellation |
| CN104902419A (en) * | 2014-12-26 | 2015-09-09 | 深圳市微纳集成电路与系统应用研究院 | Frequency shift compression method suitable for digital hearing aid |
| CN105307093A (en) * | 2015-11-26 | 2016-02-03 | 东南大学 | Self-adaptive hearing compensation method |
| CN108540893A (en) * | 2018-06-22 | 2018-09-14 | 会听声学科技（北京）有限公司 | Impulse noise suppression method, system and earphone |
-
2018
- 2018-12-26 CN CN201811603161.4A patent/CN109862463A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1969320A (en) * | 2004-06-18 | 2007-05-23 | 松下电器产业株式会社 | Noise suppression device and noise suppression method |
| CN101272161A (en) * | 2008-04-30 | 2008-09-24 | 中山大学 | Self-adapting echo cancellation method |
| CN104243732A (en) * | 2013-06-05 | 2014-12-24 | Dsp集团有限公司 | Use of vibration sensor in acoustic echo cancellation |
| CN104902419A (en) * | 2014-12-26 | 2015-09-09 | 深圳市微纳集成电路与系统应用研究院 | Frequency shift compression method suitable for digital hearing aid |
| CN105307093A (en) * | 2015-11-26 | 2016-02-03 | 东南大学 | Self-adaptive hearing compensation method |
| CN108540893A (en) * | 2018-06-22 | 2018-09-14 | 会听声学科技（北京）有限公司 | Impulse noise suppression method, system and earphone |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113473345A (en) * | 2021-06-30 | 2021-10-01 | 歌尔科技有限公司 | Wearable device hearing assistance control method, device and system and readable storage medium |
| CN113473345B (en) * | 2021-06-30 | 2022-11-01 | 歌尔科技有限公司 | Wearable device hearing assistance control method, device and system and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9892721B2 (en) | Information-processing device, information processing method, and program | |
| EP1312162B1 (en) | Voice enhancement system | |
| EP1709734B1 (en) | System for audio signal processing | |
| US9076456B1 (en) | System and method for providing voice equalization | |
| AU2009242464B2 (en) | System and method for dynamic sound delivery | |
| US20120278070A1 (en) | Combined microphone and earphone audio headset having means for denoising a near speech signal, in particular for a " hands-free" telephony system | |
| WO2012053629A1 (en) | Voice processor and voice processing method | |
| CN204482023U (en) | A kind of whistle inhibition system | |
| TW201346889A (en) | Noise cancellation method | |
| CN109493877A (en) | A kind of sound enhancement method and device of auditory prosthesis | |
| US10128809B2 (en) | Intelligent method and apparatus for spectral expansion of an input signal | |
| US9241214B2 (en) | Direct sound extraction device and reverberant sound extraction device | |
| US20160163334A1 (en) | Voice signal processing device and voice signal processing method | |
| JP2022506570A (en) | How to improve the sound quality of the super directional ultrasonic speaker device, and the ultrasonic speaker device equipped with it. | |
| CN110036440A (en) | Device and method for handling audio signal | |
| CN201726531U (en) | Audiphone combining AGC with dynamic amplification | |
| CN101808260A (en) | Audio dynamic feedback suppression method | |
| CN109862463A (en) | Earphone audio playback method, earphone and its computer readable storage medium | |
| CN106796782A (en) | Information processor, information processing method and computer program | |
| CN103580630A (en) | Automatic loudness control | |
| CN109862470A (en) | To method, earphone and its computer readable storage medium of otopathy patient broadcast | |
| CN102144257A (en) | Method for instantaneous peak level management and speech clarity enhancement | |
| RU2589298C1 (en) | Method of increasing legible and informative audio signals in the noise situation | |
| EP2816818A1 (en) | Sound field spatial stabilizer with echo spectral coherence compensation | |
| JP2009265422A (en) | Information processing apparatus and information processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190607 |
|
| RJ01 | Rejection of invention patent application after publication |